Ankit Sharma Email & Phone Number

Bengaluru, Karnataka, India

Chennai, Tamil Nadu, India

𝐂𝐑𝐎𝐍 𝐭𝐨 𝐀𝐢𝐫𝐟𝐥𝐨𝐰 𝐌𝐢𝐠𝐫𝐚𝐭𝐢𝐨𝐧 : • Led the migration from CRON-based scheduling to Apache Airflow for orchestrating data pipelines• Implemented dynamic DAG generator, enabling data science team to operate with 50% less reliance on data engineering for job scheduling, leading to a 30% reduction in time and resource consumption.• Retired legacy code with Airflow’s built-in alert features, ensuring proactive issue resolution while reducing complexity and optimizing resource consumption.𝐏𝐫𝐨𝐝𝐮𝐜𝐭 𝐈𝐧𝐯𝐞𝐧𝐭𝐨𝐫𝐲 𝐌𝐚𝐧𝐚𝐠𝐞𝐦𝐞𝐧𝐭 (𝐏𝐈𝐌) :• Optimized product inventory workflows with ETL processes (Pentaho) and robust SQL operations.• Engineered complex data transformations for JSON file processing, utilizing JavaScript code within Pentaho for API requests, making scalable bulk API calls, parsing responses and showcasing data manipulation skills.𝐁𝐚𝐭𝐜𝐡 𝐏𝐫𝐨𝐜𝐞𝐬𝐬𝐢𝐧𝐠 𝐃𝐚𝐭𝐚 𝐏𝐢𝐩𝐞𝐥𝐢𝐧𝐞 : • Engineered a Batch Data Pipeline to support Ad-hoc data requests utilizing Kafka Connect, Spark Streaming, and PySpark Batch Processing for data transformations.• Extracting data from Relational databases and efficiently loading to a data warehouse, Leveraging Elastic Search as a NoSQL staging layer• Simplified implementation of data pipelines eliminating the need of additional development activities, reduced response times by 70% for Ad-hoc business requests, enabling a more agile and efficient data analysis process.

Chennai, Tamil Nadu, India

• Implemented an ETL application to handle SQL operations, generate diverse output files (CSV, XLS, XLSX, TXT) with custom formatting based on client's requirements.• Utilized PySpark to design and implement data pipelines to load data from files to relational database.• Implemented data transformations using Pentaho & PySpark.• Gained in-depth knowledge of Data Engineering Fundamentals, designing & implementing data pipelines• Gained thorough understanding of Data Warehousing, Data Modelling and Dimensional Modelling.

Bachelor Of Technology, Computer Science

High School - 12Th, Pcm