Amit Kumar Singh Email & Phone Number

Hyderabad

Software Engineer -Data AnalyticsFEUJI SOFTWARE SOLUTIONS PRIVATE LTD- HYDERABADResponsibilities:-Develop business logic for data migration between AWS S3 and SQL Serverusing PySpark.Building Azure Data Bricks notebook using PySpark to ingest data fromvarious sources to different layers in multiple formats like Parquet, CSV, JSON, xlsx etc.Performed Data cleaning operation in PySpark like handling missing data,duplicates, bad records and outliers. Along with this, also carried out Normalizing data, Data type conversion and Data anomalies detection.Develop complex and optimized SQL queries for Data validation, dataanalysis and reporting.Explored more on Azure Data Lake Storage and Azure data Factory.Generated Dashboard on fully processed data in Power Bi and Incorta.Develop the Data Mapping sheet, build logics and pipelines using AzureData bricks and PySpark keeping in mind the user's requirement andstandard.Collaborated closely with business units and IT teams to define projectscope, objectives, and success criteria, ensuring alignment withorganizational goalsLead the migration of on-premises data infrastructure to Azure, resulting incost savings and improved scalability.

Pune, Maharashtra, India

Saama Technologies (India) Pvt Ltd19 July 2021 - 20 September 2022Associate Software Engineer - Data EngineeringClient Name : GenentechProject Name : OasisProject Start Date: 21July 2021Project Description: Oasis Production Support team is primarily responsible for Extractingdata, Running scheduled process Dally, weekly and Monthly basis.Delivering the Business reports to stakeholders across global regionsusing tools like MS Excel with the data provided on a daily basis. Teamis also accountable for analyzing and resolving data issues in thePySpark, SQL faced by Business users, Analysts/Stake holders.Responsibilities: - Monitoring the scheduled jobs in AWS Airflow - Regular Monitoring and supervising the Daily, Weekly and Monthly AIRFLOW DAGS. - Performing Validation of Daily, Weekly and Monthly Process And reporting the discrepancies to Team lead. - Preparing Daily Weekly and Monthly Report and reporting the discrepancies in data to Team lead. -Analysis of Report solely as well as with team members and deciding the future course of action. -Handling Ad-Hoc request related to data discrepancies, other issues from Business users. -Hands on debugging the issues arises in AIRFLOW Dags. -Analysing large scale data using SQL in AWS Athena. -Analysing the Pyspark code in order to find out the data discrepancies. - Monitoring EMR jobs (ETL Pipeline)

Diploma In Big Data Analytics

B.Tech, Computer Science

Master'S In Public Policy, Public Policy, Economics, Governance,

Diploma In Engineering, Computer Science And Engineering

Pg - Diploma, Big Data Analytics, A

B.Tech, Computer Science And Engineering, A

Pg Diploma In Big Data Analytics

Master'S Degree, Public Policy Analysis

Bachelor Of Technology - Btech, Computer Science