Devam Shah Email and Phone Number

Microsoft Azure Data Engineer certified with over 5+ years of experience in IT, I possess a strong foundation in Azure Data Factory, Azure Databricks, Azure Data Lake, Azure SQL Database, Python, PySpark, and MS SQL Server. My skill set is complemented by exceptional analytical, coordination, interpersonal, leadership, and organizational skills. I excel in problem-solving and adapt quickly to new technologies, demonstrating a knack for designing development architectures and mastering new tools efficiently.In my current role, I gained hands-on experience in Unified Data Analytics with Databricks, including managing Databricks Notebooks and leveraging Delta Lake with Python and Spark SQL. I have developed Spark applications using PySpark-SQL in Databricks, focusing on data extraction, transformation, and aggregation from various file formats to uncover valuable insights into customer usage patterns.My understanding of Spark Architecture, encompassing Spark Core, Spark SQL, Data Frames, Spark Streaming, and key components like Driver Node, Worker Node, Stages, Executors, and Tasks, has contributed to the successful execution of complex data projects.I have created pipelines in Azure Data Factory, utilizing Linked Services, Datasets, Pipelines, and Activities to extract, transform, and load data from diverse sources, including on-premises databases, blob storage, and Azure SQL Database. Additionally, I have extensive experience in configuring Schedule Triggers in Azure Data Factory.Operating within Agile methodologies, I actively participated in Scrum meetings and collaborated effectively with onsite and offsite teams to deliver business intelligence solutions. With a proven ability to lead teams and deliver projects within deadlines, I am confident in my capacity to contribute effectively to data engineering initiatives.I want to pursue new opportunities and explore new boundaries. I can be reached either through my LinkedIn profile or by phone at +1 519-854-0926.