Data Engineer: Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support data processing, storage, and analysis. Overall 3 years of IT experience, working as a Data engineer in Equinox Analytics PVT LTD. Extensively worked on Bigdata, Hadoop, Spark Core, Spark Dataframe, Spark SQL, Hive, Sqoop and different relational databases to build next generation analytic platform. Building Complex Hive queries and very good understanding of partitions and joins for optimized performance. Experience in implementing Linux shell scripting and to run Sqoop job for data ingestion from RDBMS to HDFS. Experience on ETL tools like Spark, Sqoop etc. and Strong knowledge on Spark Architecture and RDD & Paired RDD. Worked on performance optimizations for Spark and Hive. Experience in implementing business logic using Pyspark. Fair knowledge of NoSQL database Hbase. Experience in using AWS cloud Platforms.Hands on SQL and programming language Python.