Associate - Data Engineer
CurrentExperienced Data Engineer specializing in ETL processes, data migration, data warehousing, and data transformation using Azure Databricks, Azure Data Factory, and Azure Synapse Analytics. Proficient in Spark Streaming, Delta Live Tables, and Spark Batch Processing. Skilled in designing and implementing Medallion Architecture for Bronze, Silver, and Gold layers.Key Competencies:ETL and Data Migration:Proficient in designing and implementing ETL pipelines for data… Show more Experienced Data Engineer specializing in ETL processes, data migration, data warehousing, and data transformation using Azure Databricks, Azure Data Factory, and Azure Synapse Analytics. Proficient in Spark Streaming, Delta Live Tables, and Spark Batch Processing. Skilled in designing and implementing Medallion Architecture for Bronze, Silver, and Gold layers.Key Competencies:ETL and Data Migration:Proficient in designing and implementing ETL pipelines for data extraction, transformation, and loading.Expertise in handling large-scale data migration projects.Data Warehousing:Strong understanding of data warehousing concepts and best practices.Hands-on experience in creating and optimizing data warehouses using Azure Synapse Analytics.Azure Databricks:Extensive experience in leveraging Azure Databricks for data processing, including Spark Streaming and Batch Processing.Proficient in creating and optimizing Databricks transformation notebooks written in PySpark and Spark SQL.Azure Data Factory:Skilled in designing and orchestrating data workflows using Azure Data Factory.Expertise in creating and managing ADF activities for seamless data movement.Delta Live Tables:Proficient in implementing Delta Live Tables for real-time data processing and management.Medallion Architecture:Expertise in designing and implementing Medallion Architecture, including Bronze, Silver, and Gold layers for efficient data processing and storage. Show less
