Harshdeep Mishra

Harshdeep Mishra Email and Phone Number

MS CSE @ SUNY Buffalo | Data Engineer | AWS | GCP | Python | Spark | Cloud | SQL | Node.js | C++ | JavaScript
Harshdeep Mishra's Location
Buffalo, New York, United States, United States
About Harshdeep Mishra

I am a data engineer with over 2 years of experience in building and optimizing large-scale data pipelines using big data technologies like Apache Spark, Hadoop, and cloud platforms such as AWS and GCP. My expertise includes working with PySpark, SQL, and AWS Glue to manage and transform data, creating scalable solutions that drive business impact. I have successfully delivered data projects for industries such as telecommunications and healthcare, automating resource management and enhancing data processing efficiency.Currently pursuing a Master's in Computer Science at the University at Buffalo, I am further honing my skills in data engineering and cloud computing. I am actively seeking full-time data and software engineering opportunities starting December 2024, where I can leverage my experience and technical skills to contribute to impactful projects. Letโ€™s connect to explore potential collaborations or opportunities!๐“๐ž๐œ๐ก๐ง๐ข๐œ๐š๐ฅ ๐’๐ค๐ข๐ฅ๐ฅ๐ฌ : โ— ๐๐ซ๐จ๐ ๐ซ๐š๐ฆ๐ฆ๐ข๐ง๐  ๐ฅ๐š๐ง๐ ๐ฎ๐š๐ ๐ž๐ฌ: C/C++, Java, Python, JavaScript, SQL. โ— ๐–๐ž๐›: React.js, Node.js, HTML, CSS, REST APIs โ— ๐ƒ๐š๐ญ๐š: Spark, Beam, MySQL, Hadoop, Hive, Snowflake, Apache oozie, Docker. โ— ๐‚๐ฅ๐จ๐ฎ๐ ๐ฉ๐ฅ๐š๐ญ๐Ÿ๐จ๐ซ๐ฆ๐ฌ:

Harshdeep Mishra's Current Company Details

MS CSE @ SUNY Buffalo | Data Engineer | AWS | GCP | Python | Spark | Cloud | SQL | Node.js | C++ | JavaScript
Harshdeep Mishra Work Experience Details
  • Haver Ai Inc.
    Data Engineer Intern
    Haver Ai Inc. Jun 2024 - Aug 2024
    โ€ข Developed monthly data ingestion jobs using ๐€๐–๐’ ๐‹๐š๐ฆ๐›๐๐š and ๐€๐–๐’ ๐„๐ฏ๐ž๐ง๐ญ๐›๐ซ๐ข๐๐ ๐ž to fetch claims data in FHIR format from ๐๐‚๐ƒ๐€ ๐€๐๐ˆ, leading to 100% reduction in manual effort. Enhanced system reliability with real-time notifications via ๐€๐–๐’ ๐’๐๐’.โ€ข Utilized ๐€๐–๐’ ๐†๐ฅ๐ฎ๐ž and ๐๐ฒ๐’๐ฉ๐š๐ซ๐ค for preprocessing and integrating ๐‰๐’๐Ž๐ data from various sources into ๐€๐–๐’ ๐‘๐ž๐๐ฌ๐ก๐ข๐Ÿ๐ญ, achieving a 50% increase in data processing speed.โ€ข Designed and executed backend functionality for serving ๐‘๐„๐’๐“ ๐€๐๐ˆ requests using ๐€๐–๐’ ๐€๐๐ˆ ๐†๐š๐ญ๐ž๐ฐ๐š๐ฒ and ๐‹๐š๐ฆ๐›๐๐š.โ€ข Developed a scalable ๐Œ๐‹๐Ž๐ฉ๐ฌ ๐ฉ๐ข๐ฉ๐ž๐ฅ๐ข๐ง๐ž that automates the execution of a 6-step machine learning workflow in ๐€๐–๐’ ๐’๐š๐ ๐ž๐Œ๐š๐ค๐ž๐ซ, triggered by user interactions on the frontend. Utilized AWS SageMaker ๐€๐ฎ๐ญ๐จ๐Œ๐‹ to generate predictions as part of the pipeline.
    View
  • Skuad
    Data Engineer
    Skuad Dec 2022 - May 2023
    โ€ข Implemented business Key Performance Indicators (๐Š๐๐ˆ๐ฌ) for a telecommunications client using ๐๐ฒ๐’๐ฉ๐š๐ซ๐ค on Google Cloud Platform (๐†๐‚๐) and Amazon Web Services (๐€๐–๐’) leveraging Customer 360 data.โ€ข Leveraged ๐€๐–๐’ ๐†๐ฅ๐ฎ๐ž, S3, ๐€๐ญ๐ก๐ž๐ง๐š, ๐ƒ๐š๐ญ๐š๐ฉ๐ซ๐จ๐œ, ๐ฐ๐จ๐ซ๐ค๐Ÿ๐ฅ๐จ๐ฐ ๐ญ๐ž๐ฆ๐ฉ๐ฅ๐š๐ญ๐ž๐ฌ, and ๐๐ข๐ ๐๐ฎ๐ž๐ซ๐ฒ to ensure efficient data processing.โ€ข Successfully migrated a client use-case from ๐จ๐ง-๐ฉ๐ซ๐ž๐ฆ๐ข๐ฌ๐ž๐ฌ infrastructure written in ๐ฌ๐ก๐ž๐ฅ๐ฅ to ๐๐ฒ๐’๐ฉ๐š๐ซ๐ค on ๐†๐‚๐, resulting in improved performance and scalability.โ€ข Played a key role in implementing a ๐ฎ๐ญ๐ข๐ฅ๐ข๐ญ๐ฒ ๐ฌ๐œ๐ซ๐ข๐ฉ๐ญ for dynamic cluster setup using ๐“๐ž๐ซ๐ซ๐š๐Ÿ๐จ๐ซ๐ฆ.
    View
  • Quantiphi
    Data Engineer
    Quantiphi Nov 2021 - Nov 2022
    Mumbai, Maharashtra, India
    โ€ข Spearheaded the implementation of a cloud solution which was a ๐ฉ๐š๐ซ๐š๐ฅ๐ฅ๐ž๐ฅ ๐ฉ๐ซ๐จ๐œ๐ž๐ฌ๐ฌ๐ข๐ง๐  ๐Ÿ๐ซ๐š๐ฆ๐ž๐ฐ๐จ๐ซ๐ค to process 300,000 pdf documents on ๐†๐‚๐ utilizing ๐œ๐ฅ๐จ๐ฎ๐ ๐ฏ๐ข๐ฌ๐ข๐จ๐ง ๐€๐๐ˆ.โ€ข Wrote ๐ž๐ฑ๐ญ๐ž๐ซ๐ง๐š๐ฅ ๐ฌ๐œ๐ซ๐ข๐ฉ๐ญ for triggering the airflow pipelines concurrently with set ๐ž๐ฑ๐ฉ๐ž๐ซ๐ข๐ฆ๐ž๐ง๐ญ๐š๐ฅ ๐ฉ๐š๐ซ๐š๐ฆ๐ž๐ญ๐ž๐ซ๐ฌ and ๐จ๐ฉ๐ญ๐ข๐ฆ๐ข๐ณ๐ž๐ the processing time by around 65% (9 days).โ€ข Led end-to-end migration of critical workflow orchestration projects from ๐‡๐š๐๐จ๐จ๐ฉ ๐ž๐œ๐จ๐ฌ๐ฒ๐ฌ๐ญ๐ž๐ฆ to GCP Composer and Dataproc, improving overall ๐ซ๐ž๐ฌ๐จ๐ฎ๐ซ๐œ๐ž ๐ฎ๐ญ๐ข๐ฅ๐ข๐ณ๐š๐ญ๐ข๐จ๐ง by 40%.โ€ข Migrated Generador Interfaz workflow by creating on-demand child workflows using ๐‰๐’๐Ž๐ file properties. Leveraged ๐‰๐ข๐ง๐ฃ๐š ๐ญ๐ž๐ฆ๐ฉ๐ฅ๐š๐ญ๐ž๐ฌ and a ๐†๐‚๐’ ๐›๐ฎ๐œ๐ค๐ž๐ญ for seamless Airflow migration, resulting in a 15% ๐ž๐Ÿ๐Ÿ๐ข๐œ๐ข๐ž๐ง๐œ๐ฒ boost.โ€ข Redesigned and implemented ๐•๐š๐ฅ๐ข๐๐š๐ญ๐จ๐ซ ๐ฐ๐จ๐ซ๐ค๐Ÿ๐ฅ๐จ๐ฐ ๐ข๐ง ๐€๐ข๐ซ๐Ÿ๐ฅ๐จ๐ฐ, enabling the triggering of 47 other workflows based on a ๐‚๐‘๐Ž๐ schedule stored in an ๐„๐“๐‹-๐œ๐จ๐ง๐ญ๐ซ๐จ๐ฅ ๐ญ๐š๐›๐ฅ๐ž.
    View
  • Quantiphi
    Data Engineer Intern
    Quantiphi Jul 2021 - Nov 2021
    Mumbai, Maharashtra, India
    โ€ข Intensive training program covering ๐‚๐ฅ๐จ๐ฎ๐ ๐ฉ๐ฅ๐š๐ญ๐Ÿ๐จ๐ซ๐ฆ๐ฌ (๐†๐‚๐ ๐š๐ง๐ ๐€๐–๐’), ๐„๐‘ ๐ฆ๐จ๐๐ž๐ฅ๐ข๐ง๐ , ๐๐ข๐  ๐ƒ๐š๐ญ๐š ๐ฉ๐ซ๐ข๐ง๐œ๐ข๐ฉ๐ฅ๐ž๐ฌ, ๐‡๐š๐๐จ๐จ๐ฉ, ๐€๐ฉ๐š๐œ๐ก๐ž ๐’๐ฉ๐š๐ซ๐ค, ๐„๐“๐‹ tools like ๐ˆ๐ง๐Ÿ๐จ๐ซ๐ฆ๐š๐ญ๐ข๐œ๐š, and ๐’๐ง๐จ๐ฐ๐Ÿ๐ฅ๐š๐ค๐ž, data visualization tools like ๐“๐š๐›๐ฅ๐ž๐š๐ฎ, providing a holistic view of data engineering.โ€ข Developed a real-time request simulation logic that individually sent requests from a fixed input file in Google Cloud Storage (๐†๐‚๐’) to a deployed machine learning model on ๐•๐ž๐ซ๐ญ๐ž๐ฑ ๐€๐ˆ.โ€ข Created a custom ๐œ๐ฅ๐จ๐ฎ๐ ๐๐š๐ญ๐š๐Ÿ๐ฅ๐จ๐ฐ template using ๐€๐ฉ๐š๐œ๐ก๐ž ๐๐ž๐š๐ฆ to perform basic transformations on data.โ€ข Utilized ๐€๐ฉ๐š๐œ๐ก๐ž ๐€๐ข๐ซ๐Ÿ๐ฅ๐จ๐ฐ as a workflow management platform to ๐ฌ๐œ๐ก๐ž๐๐ฎ๐ฅ๐ž and ๐จ๐ซ๐œ๐ก๐ž๐ฌ๐ญ๐ซ๐š๐ญ๐ž daily processing jobs.
    View

Harshdeep Mishra Education Details

Frequently Asked Questions about Harshdeep Mishra

What is Harshdeep Mishra's role at the current company?

Harshdeep Mishra's current role is MS CSE @ SUNY Buffalo | Data Engineer | AWS | GCP | Python | Spark | Cloud | SQL | Node.js | C++ | JavaScript.

What schools did Harshdeep Mishra attend?

Harshdeep Mishra attended University At Buffalo, Thadomal Shahani Engineering College, Thakur College Of Science & Commerce.

Not the Harshdeep Mishra you were looking for?

View similar profiles

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.