Harsh Agrawal Email and Phone Number
Results-Driven Data Engineer | Architecting Robust Data Solutions | Transforming Data into Actionable Insights★ Passionate about leveraging data engineering to empower businesses with strategic advancements and informed decision-making.★ Pursuing Masters in Data Science From Liverpool John Moores University, England to enhance my skill in AI. CAREER HIGHLIGHTS‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾🎯 Architected and implemented a seamless Event Analytics Framework, enabling businesses to capture, process, and analyse diverse data points for invaluable insights.🎯 Developed a spark-based Data Ingestion Framework, simplifying data movement and reducing workload for data engineers through a simple YAML config file update.🎯 Implemented Redshift Workload Management (WLM) and role-based access system, ensuring enhanced performance, secure data access, and tailored permissions.🎯 Designed scalable data pipelines to improve accessibility and reliability, contributing to the overall success of data initiatives.AREAS OF EXPERTISE‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾✅ Data Architecture✅ Data Solutions Implementation✅ Event Analytics Frameworks✅ Data Ingestion✅ Redshift Workload Management (WLM)✅ Scalable Data PipelinesCOLLABORATIVE APPROACH‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾★ Actively collaborate with cross-functional teams to align data solutions with business goals, fostering synergy and driving successful outcomes.★ Play a key role in code reviews and mentor junior engineers, fostering a collaborative and knowledge-sharing environment.TECH/TOOLS EXPERTISE‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾🔧 Languages: Python, PySpark🔧 Data Analytics: Periscope, Google Data Studio🔧 AWS Services: S3, Redshift, IAM, CodePipeline, Kinesis Streams, Glue, RDS🔧 Database: MySQL🔧 Query Languages: PartiQL, HiveQL, PrestoQL, SQL🔧 Frameworks: Airflow, ETLs🔧 Version Control: Git, CodeCommit🔧 Data Manipulation: PandasLet's connect and explore how my expertise as a dedicated and skilled Data Engineer can drive data-driven insights and contribute to the success of your organisation. Reach out to me to discuss potential collaborations and exciting opportunities!
Jpmorganchase
View- Website:
- jpmorganchase.com
- Employees:
- 213060
-
Data Engineer Ii (Associate)JpmorganchaseBengaluru, Ka, In
-
Senior Data Engineer (Se-Ii)Cuemath Oct 2023 - Aug 2024Bengaluru, Karnataka, India➤ Architected and implemented an Event Analytics Framework designed to process over 50 million events daily. Leveraging AWS Kinesis, Redshift, and S3, this system efficiently captures, processes, and analyzes diverse data points from multiple sources. The framework plays a critical role in transforming raw data into actionable business insights, enabling organizations to make informed decisions and drive strategic advancements. This solution emphasizes scalability, reliability, and cost-effectiveness, addressing complex data needs in a dynamic business environment.➤ Direct Mapping Project: Built a system to match student leads from the website with the most suitable teachers using a scoring model based on preferences and performance metrics. Integrated data from Amazon RDS and Redshift with AWS Glue, processed it using Pandas, and applied a model to evaluate and rank teacher-student pairings. The top 20 matches were stored in S3, with notifications sent via SQS to trigger the selection process on the app. -
Data EngineerCuemath Jul 2022 - Sep 2023Bengaluru, Karnataka, India➤Data Ingestion Framework: Developed an automated system to sync production data from Amazon RDS (Postgres) to Amazon Redshift, replacing the costly and manual Amazon DMS solution. Utilised a YAML configuration file for flexible table management, and employed AWS Glue for data ingestion, handling complex data types with Redshift’s SUPER type. Implemented a masked view approach to protect sensitive (PII) data, ensuring that BI tools only access anonymised data. This solution allows developers to easily add new tables without Data Engineering intervention, significantly reducing costs and improving efficiency.➤ Redshift Workload Management and Role-Based Access System: Implemented Redshift WLM to optimise query performance and resource allocation, while introducing a role-based access system to secure data and tailor permissions for analysts, finance professionals, and engineering teams. Enhanced performance, ensured secure data access, and provided customised permissions to meet diverse user needs.
-
Software Developer Engineer IiNineleaps Apr 2022 - Jul 2022Bengaluru, Karnataka, IndiaClient: Uber AdtechKey Responsibilities:• Data Extraction and Improvement: Developed plugins for ad data extraction, focusing on enhancing data reliability and efficiency.• Pipeline Design: Designed scalable data pipelines for improved accessibility and reliability of ad data.• Infrastructure Maintenance: Built and maintained data infrastructure to ensure optimal performance and data integrity.• Team Collaboration: Contributed to code reviews, mentored junior engineers, and fostered a collaborative environment.• Data Integration and Quality: Integrated data from various sources into Hadoop, implementing rigorous monitoring and quality checks. -
Software Developer Engineer INineleaps Oct 2020 - Mar 2022Bengaluru, Karnataka, IndiaClient: Uber Rider, Uber TransitKey Responsibilities:• Stakeholder Collaboration: Engaged with multiple stakeholders to understand their needs and deliver tailored insights and dashboards.• Data Pipeline Optimization: Monitored and validated data pipelines to enhance reliability and performance, using DFDs and Python-based ETL pipelines.• Application Development: Developed scalable applications within the Hadoop Ecosystem to support distributed data processing.• Recognition: Received the Nineleaps Spotlight Award for outstanding performance on the project.
-
Member Of Technical Staff - IiNineleaps Aug 2019 - Oct 2020Bengaluru Area, India➤ Developing pipelines for extraction of data from a wide variety of data sources.➤ Working on the implementation of ETL and data processes for structured and unstructured data.➤ Responsible for the Design, build, test and maintain scalable and stable applications to support distributed processing using the Hadoop Ecosystem. ➤ Identifying ways to improve data reliability and efficiency.➤ Maintaining data quality for all data ingestion pipelines.➤ Responsible for finding out the root cause of failure, delivering updates to stakeholders based on analysis and then fixing it.➤ Writing testable code for optimal level of code coverage.
-
Graduate Engineering TraineeNineleaps Jan 2019 - Aug 2019Bengaluru Area, IndiaKey Achievements‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾★ Developed an internal React WebAPI project for Checklist Management System Portal.Tool & Framework Used‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾‾► Languages: NodeJS, JavaScript, CSS, HTML ► Framework: ExpressJS , Mocha (Test Framework), SonarQube (Continuous Code Quality Inspection)► Database: MySQL, MongoDB► Documentation: Swagger API
-
Alumni Mentor At Ib Hubs Startup School 2021Ib Hubs Jun 2021 - Jul 2021iB Hubs Startup School is a four-week-long student accelerator program where students with innovative ideas are put through intense learning after which, they're ready to successfully build and execute their business plans. They learn many things from thinking about their idea and make them executable to apply the learnings in the lifestyle itself.My main role here was to guide and mentor them with my knowledge and experience. -
PresidentThe Entrepreneurship Cell, Glbitm Oct 2018 - Jan 2019Greater Noida -
Head Of Media And AdvertismentThe Entrepreneurship Cell, Glbitm Aug 2017 - Oct 2018Greater Noida
-
Member Of Media And AdvertisementThe Entrepreneurship Cell, Glbitm Oct 2017 - Jul 2018Greater Noida
-
Campus EntrepreneurMoney-Wizards Aug 2018 - Oct 2018Greater NoidaMoney-Wizards, a pioneer company in financial education to bring personal finance awarenessamong college students across India. The Youth Money Olympiad(YMO) is administered as a personal finance assessment test in the multiple choice question format. It had been a phenomenal success that reached more than 33,000 students across 400 esteemed colleges from 100+ cities in India including students from the esteemed institutes.My job is to promote their event “Youth Money Olympiad” in my college campus. This internship helped me build my communication, marketing and selling skills in the process. -
Startup School 2018Ib Hubs Jun 2018 - Jul 2018Lucknow, IndiaiB Hubs Startup School is a four-week long student accelerator program where students with innovative ideas are put through an intense learning after which, they're ready to successfully build and execute their business plans. They learn many things from thinking about their idea and make them executable to apply the learnings in the lifestyle itself.I learnt a ton of things which I find helpful in my personal as well as professional life. A few things that I learnt in context of my idea were:➤ Building a product➤ Creating a strong value proposition➤ Creating a pitch➤ Building a strong team➤ Improving myself everyday
-
Summer Internship (Industrial Automation)Finetech Controls Jul 2017 - Aug 2017Greater Noida➤ Gain hands-on experience and practical skills in the dynamic field of industrial automation through this immersive summer internship program.➤ Collaborate with industry professionals, work on real-world projects, and learn to design, implement, and troubleshoot automation solutions. ➤ Develop expertise in PLC(Programmable Logic Controllers) programming.➤ Industrial Instrumentation➤ Coding: Ladder Logic
Harsh Agrawal Education Details
Frequently Asked Questions about Harsh Agrawal
What company does Harsh Agrawal work for?
Harsh Agrawal works for Jpmorganchase
What is Harsh Agrawal's role at the current company?
Harsh Agrawal's current role is Data Engineer II (Associate).
What schools did Harsh Agrawal attend?
Harsh Agrawal attended Liverpool John Moores University, International Institute Of Information Technology Bangalore, Gl Bajaj Institute Of Technology And Management, Central Board Of Secondary Education, Central Board Of Secondary Education.
Who are Harsh Agrawal's colleagues?
Harsh Agrawal's colleagues are Amy Solis, Kiran Prabhu, Ariel Rivera, Stevens Bremond, Myles M. Flores, Ryann Patrick Orola, Sachin Kumar.
Not the Harsh Agrawal you were looking for?
-
-
Harsh Agrawal
Business Operations & Growth Manager At Physics Wallah (Upsc Vertical) | Driving Success In EdtechVaranasi -
Harsh Agrawal
Bengaluru -
Harsh Agrawal
Building Ai Agents 💻 | Ai Automation Enthusiast 🤖 | No Code / Low Code Lover | Empowering D2C Businesses With Ai-Driven Customer Support SystemBengaluru
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial