Having 4 years of experience in designing, developing and maintaining large business application. Integrated AWS S3 with pyspark jobs to handle large datasets in a distributed environment.proficient in writing sqoop commands to transfer data between Hadoop and various databases such as MYSQL and SQL.Developed Spark jobs on AWS EMR for large-scale data stored in AWS S3 bucket.