 Performed concurrent and incremental data ingestion from multiple APIsources through asyncio/threadpoolexecutor into Azure Blob Storagethrough Async Durable Functions reducing load time by around 80% Developed efficient masked datasets for Gen AI models Determined the size of the spark cluster and the number of executor & coresrequired according to the velocity and volume of data being ingested. Integrated data into medallion architecture in Delta Lake through optimizeddatabricks notebooks and created logic app flows to monitor pipelinefailures Created several orchestration pipelines to schedule, monitor and track theentire data lifecycle in ADF. Successfully migrated from all purpose clusters to job clusters to runproduction ready workflows and optimize costs. Developed multiple Logical Data models and Excel Simulation working filesto show-case several KPIs and metrics which helped the business to reduceits delinquent tenants and keep an effective track of its vacant inventory Integrated Azure Key Vault into ADF and ADB using system assignedManaged Identities for data security. Developed Business logic transformations using Pyspark and SQL. Developed complex DAX logic to support BI analytics Optimized the data ingestion process to provide analytics using around ~ 1Lakh XML POS files in near real time Provided an entire architecture to monitor and send alerts for incorrectlygenerated POS files to ensure data consistency through logic apps

IT Services (Jun 2021 - Dec 2022)• Migrated Enterprise data warehouse from SQL Server to Azure Synapse analytics.• Implemented data archival, encryption, and approval processes.• Reduced load time for ingesting large parquet files by around 80% by using multiprocessing.• Developed logging and audit tracking scripts using Python and Azure Data Factory.

Estimation of COP (Coefficient of Performance) for a refrigeration compressor

Worked in the Hydrogen Generation Unit (HGU) - studied appropriate flow parameters for production of approximately 99.99% pure Hydrogen

Compute a chart to depict the trends of chemical composition(determined by an optical spectrometer ) of the coal procured from different mines .