I played a key role in implementing a Lakehouse architecture for Shell’s GRCA business, significantly improving data processing efficiency through the Medallion Architecture framework. I designed and developed data extraction processes from sources like MetricStream and ServiceNow using REST APIs, with data ingested into Azure Data Lake Storage. Utilizing Delta Live Tables, I optimized and maintained data flows to ensure clean, high-quality datasets for reporting and… Show more I played a key role in implementing a Lakehouse architecture for Shell’s GRCA business, significantly improving data processing efficiency through the Medallion Architecture framework. I designed and developed data extraction processes from sources like MetricStream and ServiceNow using REST APIs, with data ingested into Azure Data Lake Storage. Utilizing Delta Live Tables, I optimized and maintained data flows to ensure clean, high-quality datasets for reporting and decision-making.Additionally, I scheduled and monitored jobs using Databricks Workflows, ensuring timely and reliable data processing. Working within an Agile framework, I collaborated with cross-functional teams to deliver seamless and impactful data solutions tailored to business needs. Show less

I worked on migrating legacy transportation data to Azure Cloud, optimizing data transformation processes to enhance business intelligence. This involved transforming MTO transportation data on Azure Cloud based on business rules and ingesting it into Azure Synapse Analytics for further stages of the project. Additionally, I contributed to setting up CI/CD pipelines to streamline the development and deployment processes.

Certified with Big data analytics with spark and scala.Worked with the Unilever client, extracting and processing social media data for their marketing analytics using Apache Spark, Databricks, and Azure Data Lake. I also developed data solutions to support decision-making by transforming semi-structured JSON data into Parquet format and ingesting it into Azure Data Lake.

Worked as a key member of the software development team at the Karnataka Municipal Data Society, contributing to the development of various web and Android applications, with expertise in Core Java, Android framework, Spring Framework, and RESTful Web Services.