Vamsi K Email and Phone Number

Experienced Data Engineer with a strong background in designing and implementing Big Data Analytics and data pipelines using Azure technologies. Proficient in analyzing large and critical datasets utilizing Azure Cloud services, Azure Data Lake Storage (ADLS Gen2), Azure Databricks, Delta Lakes, Hive and Spark. Skilled in developing production-ready Spark code for data extraction and transforming batch data from various sources into ADLS Gen2, using tools such as Azure Data Factory (ADF) and T-SQL for seamless data integration.Adept at migrating on-premises SQL Server databases and SSIS packages to Azure SQL Database and Azure Data Factory, Snowflake enhancing and optimizing data workflows for cloud infrastructure. Extensive experience in creating and managing data pipelines, performing ETL processes, and ensuring data integrity and performance optimization.Proficient in T-SQL scripting for data processing, transformation, and analysis within Azure SQL Database and SQL Server environments. Strong capabilities in developing Spark applications using Scala and Python, authoring Azure Databricks notebooks, and utilizing Azure Stream Analytics for real-time data processing from various streaming sources like Azure Event Hubs and Azure Service Bus.