Kishore Reddy Email & Phone Number

Massachusetts, United States

• Designed, built, and maintained scalable data pipelines using Python & MATLAB to ingest, process, & transform data from diverse sources.• Implemented ETL processes through SSIS to integrate data from various systems into MySQL databases for storage and analysis.• Designed and implemented data lake solutions using Azure Data Lake Storage (ADLS), allowing for scalable and cost-effective storage of structured and unstructured data.• Wrote complex SQL queries for data extraction, transformation, and loading, ensuring efficient data manipulation and retrieval.• Utilized Azure Databricks for big data processing and analytics, leveraging Apache Spark for high-performance data processing.• Implemented data pipelines using Azure Data Factory to orchestrate and automate data movement and transformation tasks.• Constructed & enforced cloud-based data solutions using Azure Logic Apps & Azure Synapse for seamless data integration & processing.• Utilized Apache Kafka for building real-time data pipelines, ensuring efficient data ingestion and processing.• Developed and optimized Spark jobs for efficient data processing, significantly improving data throughput and reducing processing times.• Implemented data partitioning and indexing strategies in Spark to enhance query performance and manage large datasets effectively.• Performed exploratory data analysis using Pandas, NumPy, Matplotlib, & Seaborn to derive insights from structured and unstructured data.• Developed interactive dashboards & reports using Tableau & SSRS to visualize key trends, facilitating data-driven decision-making.• Adhered within Agile/Scrum methodologies to collaborate with cross-functional teams and deliver data solutions in iterative sprints.

India

• Spearheaded scalable data pipelines using Python/R for seamless ingestion, processing, & transformation.• Employed SSMS for efficient database management, ensuring optimal storage and retrieval of data.• Orchestrated Azure data solutions using Azure Data Factory and Logic Apps for seamless integration and processing.• Developed ETL procedures to assure conformity, compliance with standards and lack of redundancy, translates business rules and functionality requirements into ETL procedures.• Produced interactive dashboards and reports by applying Power BI and SSRS, enabling stakeholders to visualize key metrics and trends.• Utilized Pandas for data manipulation and preprocessing, Sklearn for machine learning algorithms implementation, NumPy for numerical computations, and Matplotlib for creating interactive visualizations, contributing significantly to data-driven strategies and initiatives.• Developed scalable data models to meet business goals, ensuring performance and maintainability. Contributed to data engineering activities such as modeling, ingestion, and manipulation to support organizational objectives.• Tuned performance of slow jobs by improving design and configuration changes of PySpark jobs.