With over 3 years of experience in data engineering, I have honed my expertise in designing and constructing large-scale data pipelines and optimizing data processes. My technical skill set includes proficiency in AWS, Python, PySpark, and SQL, which I have leveraged to build efficient ETL workflows and data integration solutions. I am a Software Engineer at IGT Solutions. I design and deploy data pipelines using PySpark on AWS Glue, optimizing scripts to enhance performance and automate data processes, resulting in significant time savings. My ability to adapt and contribute effectively in team environments has been recognized with multiple awards for outstanding performance.Previously, as a Data Analyst, I utilized Python to validate data quality in large flat files and developed solutions for tracking and logging data ingestion events, enhancing daily data ingestion processes. My internship at Weoto TechLabs involved leading a team to design a facial recognition-based attendance system, where I built an interface for data collection and proposed a statistics-based employee evaluation metric.I am a certified professional with credentials in Microsoft Azure Fundamentals and Big Data with PySpark and AWS. My educational background includes a Bachelor’s in Computer Science from Savitribai Phule Pune University. I am dedicated to continuous learning and eager to take on new challenges to advance my skills in data engineering.Keywords: Data Engineering, ETL, Data Pipelines, AWS, Python, PySpark, Airflow, Data Integration, Data Quality, Cloud Computing, SQL, Big Data, Data Optimization, Data Automation, Microsoft Azure, Data Analyst.
-
Software EngineerIgt SolutionsPune, Mh, In -
Software EngineerIgt Solutions Aug 2024 - PresentPune, Maharashtra, India -
Associate Software EngineerIgt Solutions Aug 2022 - Jul 2024India- Designed, built, and deployed over 20 data pipelines for scheduled and ad-hoc data delivery using PySpark on AWS.- Collaborated in the design, development and refinement of the carrier on-boarding module to assist 8 new carriers onboard the system.- Optimized existing Python and PySpark scripts, effectively reducing the execution time by 30-50%.- Facilitated the prompt resolution of data-related issues through SQL query analysis and scenario reproduction.- Streamlined the statistics generation process by automating data gathering, resulting in over 90% in time savings. -
Data AnalystIgt Solutions Aug 2021 - Jul 2022India- Implemented over 6 AWS Glue Jobs to extract and manipulate large amounts of data for data pipeline integration.- Leveraged Python to perform file and data level validations in flat files, typically around 10GB.- Created a solution to track, log, and notify of unanticipated events in a 20+ step data ingestion pipeline.- Assisted in optimizing daily data ingestion by analyzing load trends and creating insightful metrics and charts using Python. -
Python InternWeoto Techlabs Jan 2020 - Mar 2020Nashik- Led a team of four in designing and building an organization-wide (50+ Employees) attendance systembased on facial recognition.- Designed and implemented a MongoDB-based interface to efficiently collect, process, and store facial data with a model accuracy of 99.38%, ensuring data integrity and security.- Proposed a statistics-based employee evaluation metric to assess employee times, eliminating manual work by 80%.
Ketan Yadav Education Details
-
8.67 Cgpa
Frequently Asked Questions about Ketan Yadav
What company does Ketan Yadav work for?
Ketan Yadav works for Igt Solutions
What is Ketan Yadav's role at the current company?
Ketan Yadav's current role is Software Engineer.
What schools did Ketan Yadav attend?
Ketan Yadav attended Savitribai Phule Pune University.
Who are Ketan Yadav's colleagues?
Ketan Yadav's colleagues are Inder Mohon Singh, Jennifer De Los Santos, Tushar Mehra, Sucharita Paul, Abegail Bunyi, Rakesh Ranjan, Kaushal Lohiya.
Not the Ketan Yadav you were looking for?
-
-
2tcs.com, gmail.com
-
-
Ketan Yadav
Bengaluru
Free Chrome Extension
Find emails, phones & company data instantly
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial