Ashil Shah Email & Phone Number

Frisco, Texas, United States

● Conceptualized Solution Architecture to integrate new MDM SaaS platform with existing sources and consumers creating conceptual and logical designs.● Shaped a solution design for batch, streaming and CDC data integration of various Onprem and SaaS sources using Striim in Databricks.● Developed Databricks Serverless Compute Solution Architecture with network and data security for enabling quick startup time for dashboards.● Designed a conceptual and logical framework for replacing… Show more ● Conceptualized Solution Architecture to integrate new MDM SaaS platform with existing sources and consumers creating conceptual and logical designs.● Shaped a solution design for batch, streaming and CDC data integration of various Onprem and SaaS sources using Striim in Databricks.● Developed Databricks Serverless Compute Solution Architecture with network and data security for enabling quick startup time for dashboards.● Designed a conceptual and logical framework for replacing ADF managed Airflow with Microsoft Fabric Data Workflows (Airflow) within existing Azure framework.● Formulated solution design for Gen AI application using AWS services like Bedrock, AWS Comprehend for client’s Gen AI initiative. Show less

Bengaluru, Karnataka, India

● Devised end-to-end data processing pipelines in Databricks Medallion Architecture, including data ingestion, validation, quality, and security, improving data accuracy by 35%.● Optimized Databricks job for top 10 sold items data extraction, enabling spark optimization techniques, reducing 50% processing time.● Constructed data pipelines for bringing data from various sources like REST API, SaaS platforms, Onprem databases, SFTP into Databricks Lakehouse.● Developed Azure DevOps… Show more ● Devised end-to-end data processing pipelines in Databricks Medallion Architecture, including data ingestion, validation, quality, and security, improving data accuracy by 35%.● Optimized Databricks job for top 10 sold items data extraction, enabling spark optimization techniques, reducing 50% processing time.● Constructed data pipelines for bringing data from various sources like REST API, SaaS platforms, Onprem databases, SFTP into Databricks Lakehouse.● Developed Azure DevOps pipelines for automated deployments of Databricks code in QA and Production environments.● Implemented ELT with serverless services like Azure Functions, Azure Logic Apps and Azure Cosmos DB facilitating scalability and cost reduction.● Designed a dimension model in Azure Synapse leveraging star schema enabling efficient information reporting.● Composed 4 interactive dashboards in Tableau for providing proof of concept to stakeholders and demonstrating rapid adaptability to new technologies.● Orchestrated comprehensive data pipelines using Airflow resulting in a significant reduction of manual intervention by 75% in pipeline runs. Show less

Bengaluru, Karnataka, India

● Demonstrated strong leadership capabilities by overseeing junior data engineers providing technical guidance leading to timely and accurate deliveries.● Leveraged Azure Data Factory pipelines for consolidating data from Onprem files and MS SQL Server sources into Azure Cloud.● Improved Azure SQL queries utilizing SQL optimization techniques achieving a reduction of 40% in query running time.● Conceptualized efficient data storage schema in Azure Synapse for large-scale data… Show more ● Demonstrated strong leadership capabilities by overseeing junior data engineers providing technical guidance leading to timely and accurate deliveries.● Leveraged Azure Data Factory pipelines for consolidating data from Onprem files and MS SQL Server sources into Azure Cloud.● Improved Azure SQL queries utilizing SQL optimization techniques achieving a reduction of 40% in query running time.● Conceptualized efficient data storage schema in Azure Synapse for large-scale data applying optimization techniques namely distribution and indexing facilitating faster query run times.● Collaborated with customer's business analysts to define ETL requirements, error handling, and log storing ensuring seamless data extraction, transformation, and loading.● Migrated on-prem data storage to data lake on ADLS for storing source and processed files for scalability.● Collaborated in the migration of SSIS packages seamlessly in Azure cloud with the help of ADF lift and shift process.● Formulated data insights strategies to be displayed on SSRS and PowerBI reports for enabling business decision-making. Show less

Master'S Degree, Computer Science

Master Of Technology - Mtech, Information Technology, 8.00

Bachelor'S Of Computer Application