Vaibhav Gole Email & Phone Number

Bengaluru

Associate Data Engineer L2 | Key Achievements & Contributions- Self-learned and implemented Azure technologies to elevate data engineering capabilities, contributing to scalable and efficient data platform solutions.- Built smart data pipelines for near real-time hiring insights, empowering recruiters to optimize processes and achieve goals.- Designed a framework to integrate interview data into IBI using GoodTime, providing a consolidated, real-time view for recruiting teams.- Created the Operation People Data Repository (OPDR & OTDR) as the single source of truth for PS team information, onboarding ~400 users and replacing outdated systems.- Enabled reporting across weekly, monthly, and yearly time grains for better stakeholder decision-making.- Integrated supervisor hierarchies and promotion history into datasets, supporting talent analytics and leadership decisions.- Merged People data with GDW/E+ datasets to provide comprehensive staffing and allocation insights from a unified source.- Mastered and implemented Azure Analysis Services for faster query performance and efficient data access.- Developed solutions like synchronous AAS model refresh with ADF and one-click Azure Analysis Cube deployments, saving time and reducing manual effort.- Automated pipeline monitoring to ensure SLA compliance and optimized Spark job performance, cutting runtime by 83% (1 hour to 10 minutes).- Automated user access management for Active Directory groups, handling ~2,500 daily requests without manual intervention.- Azure ADF, Logic App, Azure Functions, Databricks, T-SQL, Azure AAS, Tabular Model, DevOps, Azure Synapse Analytics, Fabric

• Developed and managed data pipelines and ETL processes, ensuring seamless data flow and integration across systems.•Governed a 6+ PB Hive data warehouse to ensure data integrity and accessibility for analytics and reporting.•Created custom modules like Dynamic Enrichment and Spark Tuning within Data Refinery, enhancing data processing capabilities•Designed and implemented a Python-based framework to capture KPI metrics in CSV and Excel formats, facilitating operational reporting.•Led automation efforts for Hadoop multinode cluster manual processes, streamlining operations and reducing manual errors.•Converted unstructured data via Kafka real-time streaming into structured data, enabling real-time reporting and analysis.•Optimized Spark jobs based on data volume and deployed and optimized Hadoop clusters for improved performance.•Collaborated closely with engineering and business teams to gather complex requirements and execute projects using Scrum/Agile methodology, ensuring alignment with business objectives.•Successfully conducted UAT and bug-free deployments in production environments, ensuring smooth project delivery.•Improved Scala code coverage by 2%, reaching a total of 60%, through rigorous testing and code optimization.•Proficient in Advanced Excel functionalities, leveraging them for data analysis and reporting purposes.

Ahemdabad

Bachelor Of Engineering - Be, Computer Engineering, First Class Distinction

Diploma In Computer Engineering, Computer Engineering Technologies/Technicians, First Class Distinction