Vaibhav Jain Email and Phone Number
Career Highlights:> Experienced at Scotiabank as a Data Engineer, with an expertise in Data Transformation and Data Migration> Master of Engineering in Electrical and Computer Engineering; dedicated Data Engineer with robust skills in PySpark and Hadoop Stack.> Experience at Infosys as Systems Engineer (Data Engineer) optimizing batch processes and streamlining documentation for Pfizer> Proven success in technical prowess and collaborative projects, contributing to data-driven culture and innovation.> Creating pipelinesExperience and Expertise:> Specializes in Data Migration and Transformation through ELT Pipelines leveraging PySpark, and Hadoop Stack> Proficient in ad-hoc troubleshooting of issues, demonstrating a keen ability to quickly analyze and diagnose complex problems in real-time.> Experienced in employing a systematic approach to problem-solving, identifying root causes, and implementing effective solutions, ensuring minimal disruption to ongoing processes.> Instrumental in optimizing batch processes and detecting anomalies at InfosysPassion and Motivation:> Driven by working in diverse, cross-functional teams and mastering new technologies to contribute to data-driven culture and innovation.> Motivated by challenges that allow utilization of data engineering expertise to support and advance strategic goals, particularly in dynamic institutions.Future Goals:> Eager to bring expertise in data pipeline construction and optimization, analytical skills, and passion for innovation to a team making a difference through data.> Actively seeking opportunities for growth, learning, and contribution to organizations committed to leveraging data for strategic decision-making and innovation.Open to joining teams where I can apply my experience and skills to drive data-driven innovation and make a positive impact. Know of any such opportunities that might fit me? Connect with me @ vaibhav.jain9607@gmail.com
Publicis Canada
View- Website:
- publicis.ca
- Employees:
- 85
-
Data EngineerPublicis Canada Oct 2024 - PresentToronto, Ontario, Canada
-
Data EngineerScotiabank Jun 2023 - Oct 2024Ontario, Canada●Led an ETL project to integrate new data sources in Parquet format, transform and consolidate financial and customer-related data using PySpark, and load the data into a DB2 database. Optimized delta load processing by changing from weekly to daily loads, significantly reducing data size from 12-15 GB to under 1 GB.●Implemented an in-house PySpark-based framework to consolidate data from various sources, utilizing Parquet for data ingestion and historical data conversion, resulting in a 30% reduction in storage costs within 9 months.●Conducted strategic ETL pipeline data migration, enhancing performance by 20% and maximizing data integration accuracy by 95% through rigorous post-conversion testing, ad-hoc troubleshooting of data type mismatches, and optimization of marker files and COBOL copybooks, ensuring the efficient weekly transfer of ~4 TB of data.●Achieved a 90% success rate in parallel job runs, overseeing the execution of 800 jobs, by developing Python and shell scripts to sync files between two clusters, including both edge nodes and HDFS, during the migration to a Cloudera-based environment.●Automated job creation, log retrieval, and status updates through Java-based Tidal API scripts, reducing manual intervention by 90% and enabling efficient management of over 40,000 jobs.●Collaborated with cross-functional teams to gather and analyze business and functional requirements, managing the project life cycle using JIRA. Ensured adherence to project timelines, translated requirements into scalable solutions aligned with organizational architecture, and reduced issue resolution time by 15%. -
Systems EngineerInfosys Aug 2018 - Jun 2020●Improved report generation time by 75%, from 4 days to <1 day by developing automated bi-weekly Power BI dashboards, allowing for faster data-driven decisions.●Developed ETL processes leveraging Azure technologies and Big Data tools, resulting in a 40% decrease in data processing time, translating to annual savings of $80K in infrastructure costs.●Engineered efficient SQL pipelines to analyse 1500 web application logs, resulting in a 12% reduction in recurring errors within 6 months for a leading US pharmaceutical company.●Optimized 20+ batch processes using Python scripts, resulting in an 8% increase in ticket volume and decreased maintenance requirements.●Streamlined and documented 50+ data processes, producing user-friendly metadata to optimize access control and reduce high-priority ticket resolution time by over 20%, facilitating seamless data management and understanding.
Vaibhav Jain Education Details
-
4.18/4.3 -
Electrical, Electronics And Communications Engineering
Frequently Asked Questions about Vaibhav Jain
What company does Vaibhav Jain work for?
Vaibhav Jain works for Publicis Canada
What is Vaibhav Jain's role at the current company?
Vaibhav Jain's current role is Data Engineer | ETL , Hadoop, Spark, Azure | Expert in Pipeline Maintenance & Data Migration | Driving Data Integrity and Accessibility.
What schools did Vaibhav Jain attend?
Vaibhav Jain attended Ontario Tech University, Srm University.
Who are Vaibhav Jain's colleagues?
Vaibhav Jain's colleagues are Michaela Aulisio, Stephanie Gross, Phd, Farima Bahadori, Frances Bruce, Raisa De Pano, Marian Capaldo, Matthew Johnston.
Not the Vaibhav Jain you were looking for?
-
Vaibhav Jain
Toronto, On -
Vaibhav Jain
Canada -
-
vaibhav jain
Greater Toronto Area, Canada -
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial