As a Data Engineer with over 3 years of hands-on experience, I specialize in building and optimizing ETL pipelines using cutting-edge technologies like Azure Data Bricks, PySpark, and AWS services. My expertise includes data cleansing and preprocessing with Python, crafting SQL workflows in Alteryx, and creating automated CI/CD pipelines with Jenkins.I have a strong background in big data processing, data stream processing using Kafka, and executing data pipelines across both GCP and AWS platforms. My skill set also extends to using Apache NiFi and Airflow for job scheduling, as well as Glue and Athena for data extraction from data warehouses.