As a Data Engineer, I am passionate about transforming raw data into meaningful insights that enable data-driven decisions. I have a Bachelor of Technology in Electrical Engineering.My most recent experience was at Astegic, where I designed, developed, and deployed data pipelines using Azure Data Factory, ingesting structured and unstructured data from diverse sources into Azure data lakes and data warehouses. I reduced failures by approximately 20% through the implementation of automated error handling and retry mechanisms. I also queried data using Spark SQL on the Spark engine, optimizing dataset processing for faster results. I created and managed multiple Hive tables, implementing partitioning and bucketing for efficient data access. My core competencies include streamlining ETL processes, harnessing big data technologies (Hadoop, Spark), navigating SQL and NoSQL databases, implementing data warehousing solutions coding in Python and orchestrating data integration and pipelines (Airflow). I enjoy bringing the latest tools and techniques to the table, adapting them to meet the unique needs of each project. I thrive on collaboration, working closely with diverse teams to align data strategies with broader business goals.