Sandeep Malka Email & Phone Number

United States

• Automated 80% of the tasks using SQL and Python scripts, saving the team roughly 10 hours of manual work each week.
• Created and managed robust data pipelines using AWS Glue ETL, optimizing data flow and processing efficiency by 45% while ensuring seamless integration and reliability.
• Applied advanced techniques to optimize data processing Using PySpark and Spark-Sql, resulting in a 45% reduction in processingTime and a 30% increase in data throughput efficiency.
• Leveraged Spark to automate the data cleaning process, achieving high-performance data handling and significantly reducing processing times.
• Utilized AWS services including EC2, S3, Lambda, Glue, and Athena to build scalable data processing solutions, reducing data Processing times by 50% and enhancing data accessibility and integration efficiency by 40%.
• Leveraged Snowflake for seamless data storage and pipeline integration, improving data access efficiency by 40% and reducing data handling time by 30%.

India

• Implemented ADF Pipelines to extract and transform data, optimizing ingestion into Azure Storage ADLS Gen2 in Parquet format, streamlined processing, reducing storage costs by 50% and boosting data access efficiency.
• Engineered efficient data transformations using Azure Databricks and Pyspark, streamlining ETL process to meet unique requirements, realized 40% reduction in processing time, elevating data quality for enhanced.
• Migrated and optimized SSIS packages to Databricks, resulting in a more than 50% increase in data processing speed and a substantial reduction in infrastructure costs.
• Developed robust data processing pipelines using python and spark, improving data throughput by 25% and ensuring reliable and scalable solutions.
• Integrated and optimized data pipelines within Azure Synapse Analytics, enhancing the performance of data queries and enabling seamless data integration across various sources, including Azure SQL and Blob Storage.
• Integrated code versioning and CI/CD pipelines with Azure DevOps, enabling faster, more reliable deployments and minimizing the risk of regressions.

Hyderabad, Telangana, India

Master'S Degree, Data Science And Analytics

Bachelor'S Degree, Electronics And Communication Engineer