Krushna Kadam Email & Phone Number

Pune, Mh, In

Pune, Maharashtra, India

Pune, Maharashtra, India

CENTRAL DATALAKE• Spearheaded the development of a central data lake infrastructure, integrating supplier data, and serving as the cornerstone of our data ecosystem within a collaborative two-person team.• Devised a comprehensive data model to optimize data storage efficiency, implementing strategies to enhance SQL query performance for expedited data processing, while considering various dimensions including SCD.• Engineered Azure Data Factory (ADF) pipelines to automate seamless data synchronization from the central data lake to client databases, leveraging batch/job control mechanisms to enhance data accessibility and accuracy.• Enhanced API performance by seamlessly integrating Azure Cognitive Search, thereby fortifying data retrieval capabilities.• Orchestrated the development of Fast APIs for streamlined access to the central database, ensuring rapid and efficient data retrieval.GENERATIVEAI• Pioneered the development of a tool utilizing generative AI to accurately estimate the cost of any product based on previous purchase orders (POs) and commodity trends.• Established a comprehensive data model to accommodate data storage with various dimensions and fact tables.• Implemented fast APIs to efficiently deliver data to applications.• Skillfully handled complex SQL queries and views to support project requirements.

Pune, Maharashtra, India

• Constructed and fine-tuned ETL pipelines utilizing PySpark, Azure Data Factory (ADF), and Databricks to efficiently process large datasets, ensuring data integrity and accuracy through Batch/Job control mechanisms.• Leveraged Python to automate SQL scripts, optimizing tasks such as complete schema deletion and server-to-server data transfers, resulting in enhanced operational efficiency and reduced manual errors.• Engineered Python-based ETL pipelines integrating machine learning models and custom Named Entity Recognition (NER) models, enabling advanced data extraction and transformation from raw text data.• Demonstrated proficiency in various web scraping methods, effectively gathering and processing data from diverse sources to enhance analytical efforts.• Developed automation scripts customized for Excel and PowerPoint, simplifying data visualization and report generation processes.• Implemented Infrastructure as Code (IAC) deployment strategies, automating the setup and configuration of the entire Databricks environment for seamless operations.• Designed and implemented a formula parser using Python, enhancing data processing capabilities and enabling support for complex calculations within applications.

Kothrud

M.Sc., Data Science

B.Sc., Computer Science