Ankit Varma Email & Phone Number

Schaumburg, Il, Us

Skillfully prepared comprehensive documentation and analytic reports, delivering succinctly summarized outcomes, analyses, and conclusions to stakeholders.  Leveraged Amazon EMR, Amazon S3, and AWS Glue to design and implement scalable data processing solutions, optimizing performance and cost-effectiveness.  Transformed on-premises data processing to the cloud, migrating Hadoop and pyspark-based processes to AWS services, resulting in enhanced scalability and flexibility.  Developed data ingestion pipelines using AWS Glue, facilitating seamless and automated data movement from various sources into cloud-based data stores.  Demonstrated expertise in deploying and managing PySpark applications on Amazon EMR clusters, optimizing performance and resource utilization.  Introduced automated solutions using PySpark for reports previously generated manually in SAS, resulting in substantial savings in time, effort, and financial resources.  Developed Autosys JILS for effective job scheduling and automation, contributing to streamlined operational efficiency.  Collaborated closely with product owners and analysts to establish data pipelines for multi-source applications, ensuring efficient data flow.  Conducted thorough analysis of incoming data from diverse sources, curating and transforming it using PySpark Dataframes. Stored the processed data in Hive Tables utilizing the parquet file format.  Proactively addressed user-requested changes and enhancements to the application, ensuring seamless functionality.  Directed and managed a team of 5 junior Data Engineers, fostering a collaborative and high-performing work environment.  Assumed accountability for team deliverables within an Agile framework, championing a culture of on-time delivery through the principles of Agile methodology.

Paris, France, Fr

Client: Synchrony Financials Prepare documentation and analytic reports effectively and efficiently deliveringsummarized results, analysis and conclusions to stakeholders. Performed curation of incoming data coming from source in text format usingPySpark Dataframes and storing in Hive Tables using parquet file format. Provided automated solution for various reports in PySaprk which were doneearlier in SAS manually, saving manual efforts and time and money. Prepare Autosys JILS for jobs scheduling and automation. Design, build, test and deploy PySpark solution for various user requirements. Communicate with product owner and analysts for creating data pipeline formultisource applications. Perform in-depth analysis of existing application for any changes requested byusers. Managed a team of 5 junior Data Engineers. Accountable for team deliveries in Agile environment and lead culture of on timedelivery through agile methodology principles.

 Collaborated closely with users to gather requirements and formulate comprehensive designs.  Developed solutions to effectively maintain and manage diverse card data for the bank, aligned with user specifications.  Led the development and deployment of end-to-end data pipelines for ingesting, processing, and transforming multi-terabyte datasets using PySpark and Hadoop.  Successfully orchestrated the transition of code from Teradata/Mainframe environments to Hadoop/Unix. Integral in the creation of DMX Jobs, incorporating integrated Map-Reduce, as part of this migration process.  Leveraged SQOOP for seamless data import/export operations between Teradata and Hadoop.  Designed and implemented a PySpark application to automate the generation of user report.  Formulated intricate Hive queries for data transformations, optimizing data usability for downstream models.  Proficiently utilized various compression formats, including gzip, bzip2, and snappy, to enhance HDFS data storage efficiency.  Developed Autosys JILS for streamlined job scheduling and automation.  Conducted thorough Impact Analysis on modifications to existing mappings, offering valuable feedback.  Methodically analyzed and executed test cases across different testing phases, including integration, regression, and user testing.  Streamlined code deployment processes using BitBucket, Jenkins, JFrog Artifactory, and Ansible Tower.  Possess advanced proficiency in workflow scheduling and monitoring tools, such as Autosys and CA7.

Mumbai, Maharashtra, In

• Developing code for maintenance and storage of bank’s transactional data as per user’s request.• Teradata Query Performance Tuning using index, collect statistics which helps in running of the queries in minimal time. Got client appreciations for the same.• Have created and manipulated many scripts in BTEQ, Fast Load, MultiLoad, Fast Export, and TPT. Have also worked on conversion of MLOAD/FastLoad/FastExport to TPT for better compatibility. • Currently working on conversion of Application from Teradata/Mainframe to HADOOP/Unix. I am responsible for preparing MapReduce Job (DMX Job) as part of this conversion process.• Have been part of Teradata upgradation team (Upgrade Teradata 13 to Teradata 14).• Preparing Weekly status report and communicating with Clients on the same.• Created various test scenarios and test cases during testing phase of the project.• Have done three process improvements for the existing processes. • Acting on Ad-hoc request from the client and completing the same on time.

Engineer’S Degree, Computer Science

Higher Secondary, Maths