Around 7 years IT experience in Analysis, Design, Development and Big Data in Scala, Spark, Hadoop, Pig and HDFS environment and experience in Python.• Excellent technical and analytical skills with clear understanding of design goals and development for OLTP and dimensions modeling for OLAP.• Strong experience in building fully automated Continuous Integration & Continuous delivery pipelines and DevOps processors for agile store-based Applications in Retail and Transportations domain.• Experience in Amazon Web Services (AWS) concepts like EC2, S3, EMR, Glue, Athena, Elastic Cache, DynamoDB, Redshift, Aurora.• Worked on building visuals and dashboards using Power BI reporting tool.• Involved in Software development, Data warehousing and Analytics and Data engineering projects using Hadoop, MapReduce, Pig, Hive, and other open-source tools/technologies.• Experience in analyzing, designing, and developing ETL Strategies and processes, writing ETL specifications.• Experience in handling, configuration, and administration of databases like MySQL and NoSQL databases like MongoDB and Cassandra.• Learned on Google Cloud Platform (GCP), Kubernetes, dataflow, Pub/Sub, BigQuery, and other technologies.• Proficient knowledge and hand on experience in writing shell scripts in Linux.• Expertise in Hadoop Ecosystems tools which including HDFS, YARN, MapReduce, Pig, Hive, Sqoop, Flume, Spark, Zookeeper and Oozie.• Participated in the development improvement and maintenance of snowflake database applications.• Developed multiple POC's using PySpark, Scala and deployed on the YARN Cluster, compared the performance of Spark, with Hive and SQL.