– Skilled in leveraging Databricks Lakehouse for scalable data processing, ETL pipelines, and collaborative analytics.– Successfully transformed over 150+ DataStage ETL processes into Python-based Databricks workflows, resulting in optimized performance, enhanced data processing efficiency, and a remarkable 40% reduction in processing time.– Realized TCO reduction of $4M+ per year in infrastructure cost by migrating a 30TB+ database from Sybase IQ database into Snowflake.– Designed… Show more – Skilled in leveraging Databricks Lakehouse for scalable data processing, ETL pipelines, and collaborative analytics.– Successfully transformed over 150+ DataStage ETL processes into Python-based Databricks workflows, resulting in optimized performance, enhanced data processing efficiency, and a remarkable 40% reduction in processing time.– Realized TCO reduction of $4M+ per year in infrastructure cost by migrating a 30TB+ database from Sybase IQ database into Snowflake.– Designed and implemented Azure Data Factory pipelines, seamlessly orchestrating the loading of 300+ tables from diverse sources directly into Snowflake.– Enabled near real-time data extraction via Confluent Kafka Connect, handling seamless ingestion from over 600+ Kafka topics directly into Snowflake tables.– Proficient in Terraform for Azure, with hands-on experience in designing and creating comprehensive data architecture infrastructure for data teams.– Managed a team of 5 interns in which 2 focused on DataOps solutions, while 3 built an operations dashboard.– Architected & monitored data pipelines with 99.995% availability for 60+ clients, yielding impact $3Mn+.– Guided team to manage and solve 50+ tickets, enhancing data reporting accuracy for 10+ clients.– Executed 15+ team-building initiatives through meets, workshops, and events, enhancing team cohesion.– Led 10+ sprint planning sessions as Scrum Master, ensuring adherence to Scaled Agile methodology. Show less

– Developed and maintained scalable data pipelines through SQL optimization, data quality checks, and the implementation of best practices in data modeling, thus reduction of 2 TB of duplicates and improved overall runtime by 30%.– Reduced cost by $100k+ annually by migrating 1700 job schedules from TWS into a flexible open-source scheduler Airflow.– Achieved a 20% improvement in data quality by Analyzed and provided root cause analysis (RCA) for over 100+ tickets raised by business… Show more – Developed and maintained scalable data pipelines through SQL optimization, data quality checks, and the implementation of best practices in data modeling, thus reduction of 2 TB of duplicates and improved overall runtime by 30%.– Reduced cost by $100k+ annually by migrating 1700 job schedules from TWS into a flexible open-source scheduler Airflow.– Achieved a 20% improvement in data quality by Analyzed and provided root cause analysis (RCA) for over 100+ tickets raised by business users due to incorrect data.– Created and optimized a CDO Rally dashboard using Python’s Flask and MongoDB, reducing data retrieval time by 40% and improving metric accuracy by up to 25%.– Successfully led the migration of DataStage jobs, ensuring seamless transitions and maintaining data quality throughout.– Enhanced Jenkins pipelines, streamlining CI/CD processes for efficient software delivery.– Revamped data extraction design, reducing data footprint by ~2TB, saving cost of $1.5M/year.– Enhanced DevOps to monitor 2000+ workflows, delivering solutions for ~99.995% data availability. Show less

 Worked on Arduino and Raspberry Pi 3  Worked on various projects such as Trafficer, Baby Incubator, Home Automation, Obstacle Bot, and Smart water management system  Organised workshop for school students