Sameeksha Mali Email & Phone Number

Nagpur, Maharashtra, India

Pune, Maharashtra, India

• Experienced in developing and maintaining large data pipelines and managing operations of Multi-Terabyte of data. • Designed and implemented Spark jobs using PySpark.• Expertise in using Spark RDD transformations and actions to process large-scale structured and semi-structured data sets, including filtering, mapping, reducing, grouping, and aggregating data.• In DataFrames used different map & filter operations using lambda expressions.• Experienced in using Spark RDD optimization techniques, such as data partitioning, shuffle tuning, cache and persist and their impact on query performance.• Experienced in Import and Export large datasets between Hadoop and relational databases using Sqoop.• Strong experienced in writing complex queries for validating the data.• Having good understanding of query Optimization, Hive Performance Tuning• Experienced in Portion data imports, Incremental data imports, Modified data imports, Serialized data imports using automation job in sqoop.• Hands on experienced and understanding in Unix and Hadoop cluster commands, Git. • Ability to troubleshoot common issues in data pipelines, ETL process.• Worked on RDD & DataFrames in Spark includes Spark SQL, Different Files Format Conversions, Lambda, Read & Write operations etc.• Worked on Hive Performance Tuning.• Experienced with different storage file formats like ORC, CSV, Parquet and JSON.• Data flow validation from source to staging and target area.• Test Case execution, Troubleshoot the issues and validated the impact.• Involved in the analysis of source system and identification of business rules.• Experienced in optimizing Spark DataFrame performance by tuning various configuration settings, such as memory allocation, caching, and serialization.• Having good understanding of Hadoop-HDFS, Map-Reduce, Hive operations.• In depth knowledge in AWS cloud data platform including AWS Lambda,S3,IAM,EC2, CloudWatch,SNS, SQS,DynamoDB.

Bachelor Of Engineering - Be, Electrical And Electronics Engineering

Diploma Of Education, Electrical And Electronics Engineering, A+

Ssc, 88.20