Around 5+ Years of professional experience in full life cycle system development involving analysis, design development, testing, documentation, implementation & maintenance of application software in Web-based and Client/Server environment. Proficiency with Scala, Apache HBase, Hive, Pig, Sqoop, Zookeeper, Spark, Spark SQL, Spark Streaming, Kinesis, Airflow, Yarn, and Hadoop (HDFS, MapReduce). Designed, build and managed ELT data pipelines leveraging Airflow, python, and GCP solutions. Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML. Good Hand-on Experience in ETL processing, Migration and data processing using AWS services such as EC2, Athena, Glue, Lambda, S3, Relational Database Service (RDS) and other data-based services of AWS. Experience in using Snowflake Clone, Time Travel and building snow pipe. Proficient in building CI/CD pipelines in Jenkins using pipeline syntax and groovy libraries. Develop batch processing solutions by using Data Factory and Azure Data bricks. Experience in Big Data analytics, Data manipulation, using Hadoop Eco system tools Map - Reduce, Yarn/MRv2, Pig, Hive, HDFS, HBase, Spark, Kafka, Flume, Sqoop, Flume, Oozie, Avro, Sqoop, AWS, Spark integration with Cassandra, Avro, and Zookeeper.