• Built a Near Real-Time Monitoring Solution in Azure Data Explorer to track the lifecycle of orders within the supply chain, enabling a comprehensive view and detailed analysis of order progress from initiation to distribution. • Designed and implemented complex Kusto Queries and Policies to manage diverse business scenarios, ensuring data accuracy and consistency across the supply chain monitoring solution. • Integrated Azure Data Explorer with Databricks Delta Tables, creating a unified data view across platforms and enabling comprehensive reporting in Power BI, streamlining data analysis and decision-making processes. • Reduced platform costs by 50% through strategic optimization of resources in Azure Databricks, Azure Data Factory, and Azure Data Lake Storage (ADLS), leading to significant cost savings. • Developed and implemented automated archival and deletion logic for older data in ADLS, resulting in a 40% reduction in storage usage and improved data management. • Created an automated validation framework that checks over 130 data points across the solution, enhancing data accuracy, reliability, and compliance with business requirements.

• Designed and Developed Big Data Solution for One of the Largest Food and Beverages Company, tracking Orders Near Real Time using Spark Structured Streaming, improving data freshness by 90%. • Developed and maintained robust data pipelines to pull Data from various sources using Azure Data Factory. • Expertise in manipulating and analyzing complex, high volume, high dimensional data from various data sources. • Utilized Azure Stack, specifically Azure Databricks, Pyspark, Python, SQL, Azure Data Factory, and ETL tools, to develop robust data pipelines and workflows. • Optimized data processing workflows, resulting in improved efficiency and reduced processing time. • Designed and implemented a comprehensive validation/alerts framework to continuously monitor datasets and various processes within the architecture, ensuring data integrity and operational efficiency. • Actively participated in contributed Architecture, Code, and Quality assurance processes, ensuring the implementation of industry best practices and maintaining high-quality standards

- Developed a comprehensive Big Data solution focused on managing Master Customer Data and Insights for a leading Agrochemical Corporation.- Created ADF Pipelines to aggregate data from disparate source systems.- Executed intricate data cleansing, manipulation, and aggregation tasks using Pyspark to produce well-structured datasets.

- Developed a web-based Stock Portfolio Management System utilizing Python Flask and MySQL- Integrated a real-time stock price retrieval feature, enhancing the system with up-to-the-minute financial data- Created and executed various algorithms to analyze and visualize stock portfolio performance

- Design and implemented multiple Web Pages- Developed a deep understanding of all aspects of product development such as Identifying appropriate user requirement and designing a great user experience.