Harshdeep Mishra Email & Phone Number

• Developed monthly data ingestion jobs using 𝐀𝐖𝐒 𝐋𝐚𝐦𝐛𝐝𝐚 and 𝐀𝐖𝐒 𝐄𝐯𝐞𝐧𝐭𝐛𝐫𝐢𝐝𝐠𝐞 to fetch claims data in FHIR format from 𝐁𝐂𝐃𝐀 𝐀𝐏𝐈, leading to 100% reduction in manual effort. Enhanced system reliability with real-time notifications via 𝐀𝐖𝐒 𝐒𝐍𝐒.• Utilized 𝐀𝐖𝐒 𝐆𝐥𝐮𝐞 and 𝐏𝐲𝐒𝐩𝐚𝐫𝐤 for preprocessing and integrating 𝐉𝐒𝐎𝐍 data from various sources into 𝐀𝐖𝐒 𝐑𝐞𝐝𝐬𝐡𝐢𝐟𝐭, achieving a 50% increase in data processing speed.• Designed and executed backend functionality for serving 𝐑𝐄𝐒𝐓 𝐀𝐏𝐈 requests using 𝐀𝐖𝐒 𝐀𝐏𝐈 𝐆𝐚𝐭𝐞𝐰𝐚𝐲 and 𝐋𝐚𝐦𝐛𝐝𝐚.• Developed a scalable 𝐌𝐋𝐎𝐩𝐬 𝐩𝐢𝐩𝐞𝐥𝐢𝐧𝐞 that automates the execution of a 6-step machine learning workflow in 𝐀𝐖𝐒 𝐒𝐚𝐠𝐞𝐌𝐚𝐤𝐞𝐫, triggered by user interactions on the frontend. Utilized AWS SageMaker 𝐀𝐮𝐭𝐨𝐌𝐋 to generate predictions as part of the pipeline.

• Implemented business Key Performance Indicators (𝐊𝐏𝐈𝐬) for a telecommunications client using 𝐏𝐲𝐒𝐩𝐚𝐫𝐤 on Google Cloud Platform (𝐆𝐂𝐏) and Amazon Web Services (𝐀𝐖𝐒) leveraging Customer 360 data.• Leveraged 𝐀𝐖𝐒 𝐆𝐥𝐮𝐞, S3, 𝐀𝐭𝐡𝐞𝐧𝐚, 𝐃𝐚𝐭𝐚𝐩𝐫𝐨𝐜, 𝐰𝐨𝐫𝐤𝐟𝐥𝐨𝐰 𝐭𝐞𝐦𝐩𝐥𝐚𝐭𝐞𝐬, and 𝐁𝐢𝐠𝐐𝐮𝐞𝐫𝐲 to ensure efficient data processing.• Successfully migrated a client use-case from 𝐨𝐧-𝐩𝐫𝐞𝐦𝐢𝐬𝐞𝐬 infrastructure written in 𝐬𝐡𝐞𝐥𝐥 to 𝐏𝐲𝐒𝐩𝐚𝐫𝐤 on 𝐆𝐂𝐏, resulting in improved performance and scalability.• Played a key role in implementing a 𝐮𝐭𝐢𝐥𝐢𝐭𝐲 𝐬𝐜𝐫𝐢𝐩𝐭 for dynamic cluster setup using 𝐓𝐞𝐫𝐫𝐚𝐟𝐨𝐫𝐦.

Mumbai, Maharashtra, India

• Spearheaded the implementation of a cloud solution which was a 𝐩𝐚𝐫𝐚𝐥𝐥𝐞𝐥 𝐩𝐫𝐨𝐜𝐞𝐬𝐬𝐢𝐧𝐠 𝐟𝐫𝐚𝐦𝐞𝐰𝐨𝐫𝐤 to process 300,000 pdf documents on 𝐆𝐂𝐏 utilizing 𝐜𝐥𝐨𝐮𝐝 𝐯𝐢𝐬𝐢𝐨𝐧 𝐀𝐏𝐈.• Wrote 𝐞𝐱𝐭𝐞𝐫𝐧𝐚𝐥 𝐬𝐜𝐫𝐢𝐩𝐭 for triggering the airflow pipelines concurrently with set 𝐞𝐱𝐩𝐞𝐫𝐢𝐦𝐞𝐧𝐭𝐚𝐥 𝐩𝐚𝐫𝐚𝐦𝐞𝐭𝐞𝐫𝐬 and 𝐨𝐩𝐭𝐢𝐦𝐢𝐳𝐞𝐝 the processing time by around 65% (9 days).• Led end-to-end migration of critical workflow orchestration projects from 𝐇𝐚𝐝𝐨𝐨𝐩 𝐞𝐜𝐨𝐬𝐲𝐬𝐭𝐞𝐦 to GCP Composer and Dataproc, improving overall 𝐫𝐞𝐬𝐨𝐮𝐫𝐜𝐞 𝐮𝐭𝐢𝐥𝐢𝐳𝐚𝐭𝐢𝐨𝐧 by 40%.• Migrated Generador Interfaz workflow by creating on-demand child workflows using 𝐉𝐒𝐎𝐍 file properties. Leveraged 𝐉𝐢𝐧𝐣𝐚 𝐭𝐞𝐦𝐩𝐥𝐚𝐭𝐞𝐬 and a 𝐆𝐂𝐒 𝐛𝐮𝐜𝐤𝐞𝐭 for seamless Airflow migration, resulting in a 15% 𝐞𝐟𝐟𝐢𝐜𝐢𝐞𝐧𝐜𝐲 boost.• Redesigned and implemented 𝐕𝐚𝐥𝐢𝐝𝐚𝐭𝐨𝐫 𝐰𝐨𝐫𝐤𝐟𝐥𝐨𝐰 𝐢𝐧 𝐀𝐢𝐫𝐟𝐥𝐨𝐰, enabling the triggering of 47 other workflows based on a 𝐂𝐑𝐎𝐍 schedule stored in an 𝐄𝐓𝐋-𝐜𝐨𝐧𝐭𝐫𝐨𝐥 𝐭𝐚𝐛𝐥𝐞.

Mumbai, Maharashtra, India

• Intensive training program covering 𝐂𝐥𝐨𝐮𝐝 𝐩𝐥𝐚𝐭𝐟𝐨𝐫𝐦𝐬 (𝐆𝐂𝐏 𝐚𝐧𝐝 𝐀𝐖𝐒), 𝐄𝐑 𝐦𝐨𝐝𝐞𝐥𝐢𝐧𝐠, 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 𝐩𝐫𝐢𝐧𝐜𝐢𝐩𝐥𝐞𝐬, 𝐇𝐚𝐝𝐨𝐨𝐩, 𝐀𝐩𝐚𝐜𝐡𝐞 𝐒𝐩𝐚𝐫𝐤, 𝐄𝐓𝐋 tools like 𝐈𝐧𝐟𝐨𝐫𝐦𝐚𝐭𝐢𝐜𝐚, and 𝐒𝐧𝐨𝐰𝐟𝐥𝐚𝐤𝐞, data visualization tools like 𝐓𝐚𝐛𝐥𝐞𝐚𝐮, providing a holistic view of data engineering.• Developed a real-time request simulation logic that individually sent requests from a fixed input file in Google Cloud Storage (𝐆𝐂𝐒) to a deployed machine learning model on 𝐕𝐞𝐫𝐭𝐞𝐱 𝐀𝐈.• Created a custom 𝐜𝐥𝐨𝐮𝐝 𝐝𝐚𝐭𝐚𝐟𝐥𝐨𝐰 template using 𝐀𝐩𝐚𝐜𝐡𝐞 𝐁𝐞𝐚𝐦 to perform basic transformations on data.• Utilized 𝐀𝐩𝐚𝐜𝐡𝐞 𝐀𝐢𝐫𝐟𝐥𝐨𝐰 as a workflow management platform to 𝐬𝐜𝐡𝐞𝐝𝐮𝐥𝐞 and 𝐨𝐫𝐜𝐡𝐞𝐬𝐭𝐫𝐚𝐭𝐞 daily processing jobs.

Master Of Science - Ms, Computer Science, 3.7

Courses : Algorithms, Data Intensive Computing, Network Concepts, Database Systems

Bachelor Of Engineering - Be, Computer Science, Cgpa : 9.15/10

Courses : Software Engineering, Machine Learning, Distributed Computing, Data warehousing & Mining

Higher Secondary Education, Science, 82.46%