Harsh Waghela Email & Phone Number

Mountain View, California, Us

Los Angeles , Ca, Us

Technology & Tools: Python 3, AWS Fargate/ECS, Docker, Airflow, Terraform• Designed API Fetchers for integrating third-party data using AWS Fargate (Docker), revamping analytics with improved insights.• Built a data ingestion pipeline for integrating clicks information into the Ad Platform Data Lake using Athena and Lambda.

Los Angeles , Ca, Us

Technology & Tools: Python 3, AWS ( Lambda + Glue + S3 + Athena ), Airflow, Terraform.The goal of my summer internship project was to rebuild an existing data pipeline on the AWS cloud. With the end goal of ingesting all the data sources into the new AWS Data Lake, a new design was proposed constituting of a Python-based Lambda function to download data coming in the form of email attachments and using AWS Glue for the conversion of data to Parquet format. My contributions to the project were as follows: 1) Enhanced the Lambda function to leverage Gmail API's UID search and label-based filtering capabilities to achieve 12x+ cost saving on Lambda billing.2) Re-structured the Lambda code to handle CSV, Excel, and Zip files in addition to making it extensible, thus lowering client onboarding time.3) Built Glue crawlers for inferring the schema metadata from files dropped on S3 by Lambda thereby allowing queries from Athena. 4) Developed a Glue job for converting files to Parquet format for improved performance.5) Utilized airflow to schedule Lambda and Glue jobs and also leverage backfill capability.6) Used Terraform to manage resources among different environments on AWS cloud.7) Completed onboarding of 21 email-based clients in 2 sprints.

Los Angeles, Ca, Us

1) Mentored a team of 4 undergraduate interns for the "Grand Challenge" problem of visualizing earthquake-draught scenarios using SCEC-VDO.

Los Angeles, Ca, Us

Tools and Technologies: Java, VTK Toolkit, Eclipse 1) Migrated codebase from SVN to Git.2) Designed and built plugins for the training module in SCEC-VDO using Java Swing and VTK toolkit.3) Bug fixes.4) Designed prototype classes and interfaces for capturing VTP objects in real-time from plugins to be later exported to a web interface.

Paris, France, Fr

Project: High-Performance Calculation Engine(HPCE)Tools and Technology: Bash scripting, Python 3, Java, REST, Sybase IQ, Sybase ASE, Datastax Cassandra, IBM Spectrum Symphony, Splunk, Jira Designed and developed a centralized automation script (Bash, Python, REST, Sybase) automating tedious processes covering the investigation of common issues and application of workarounds saving 200+ man-hours a year.  Collaborated with developers on planning and setup of a time-critical parallel production environment “Tier1” encompassing configuration of IBM Symphony grid/Coherence cluster to build and test Disaster Recovery mechanisms. Improved the investigation response time of production incidents by 20% pertaining to debugging/troubleshooting of technical defects on the GPU-based tool in addition to ensuring operational stability of Cassandra/Symphony. Chaired fortnightly HPCE problem management meetings to improve coordination between support and development teams, aimed at prioritizing root cause analysis and permanent resolution of issues.

Paris, France, Fr

Projects:1) High-Performance Calculation Engine (HPCE) Troubleshooting/Debugging production incidents and documenting known issues/bugs. Design and automate manual tasks in production and staging environments. Networking with both technical and non-technical project stakeholders across global teams situated in London, Paris, Brussels and Hong Kong locations to ensure resolution of incidents from a technical and business perspective as per agreed SLA’s.2) Data Integration (DI) -  Implemented monitoring via email alerts for production issues in Geneos to assist in proactive forecasting of potential issues thereby enhancing system stability by 50% across all business locations. Performed investigation of production incidents comprising of identification of gaps in the data pipeline, analyzing outlier feeds and recommending improvements to the ETL processes.

Master Of Science - Ms, Computer Science

Bachelor Of Engineering - Be, Information Technology