 Overall 5+ Years of Experience in IT industry including 5+ Years of experience as Hadoop/ Spark Developer using Big Data Technologies like Hadoop Ecosystem, Spark Ecosystem and Shell Scripting , SQL. Hands on experience in using Big Data components like HDFS, YARN, Hive, Sqoop, HBase, Spark, Scala, Python, AWS S3, Glue, EMR, Redhshift. In-depth understanding of Spark Architecture including Spark Core, Spark SQL, Spark Structured API(DataFrame) using Scala and Python language. Experience in using Accumulator and Broadcast variable. Experience in transferring data from RDBMS to HDFS and Hive table using SQOOP. Experience in creating tables, partitioning, Bucketing, loading and aggregating data using Hive Hands on experience in NoSQL Databases like MongoDB Integration with Spark. Experience in manipulating/analyzing large datasets and finding patterns and insights withinstructured and unstructured data. Hands on Experience in Analysis, Design, Coding and Testing phases of Software Development Life Cycle (SDLC). Worked on Agile software development methodologies. Knowledge of AWS Cloud (EMR, S3, Athena, Glue, Redshift), Databricks and Kafka.