Software Engineer- Etl
CurrentAs an Azure Data Engineer specializing in Azure Data Factory (ADF), Azure Synapse Analytics, and PySpark, I play a pivotal role in designing and implementing robust data solutions. In my role, I am responsible for orchestrating end-to-end data workflows using Azure Data Factory. From data ingestion to transformation and loading, I ensure seamless data movement across various sources and destinations, facilitating a streamlined and efficient data processing pipeline.Working extensively with Azure Synapse Analytics, I contribute to the development of modern data warehouses that empower organizations to glean meaningful insights from vast amounts of structured and unstructured data. My proficiency extends to optimizing query performance, enhancing data security, and architecting scalable solutions that align with the evolving needs of businesses.PySpark serves as a cornerstone of my toolkit, enabling me to harness the power of Apache Spark for large-scale data processing. Through the application of Python programming, I create sophisticated data transformations and manipulations, pushing the boundaries of what is achievable in the realm of big data analytics.