Summary: • Having 7+ years of experience as a Big Data Engineer with expertise in designing data intensive applications using Hadoop Ecosystem, Big Data Analytical, Cloud Data engineering, Data Warehouse/ Data Mart, Data Visualization, Reporting, and Data Quality solutions. • Good experience on Architecture of Distributed systems and parallel processing, In-depth understanding of Spark execution framework. • Efficient ETL (extract/load/transform) workflows (Spark, Python, JavaScript) to process data in a timely and efficient manner. • Worked on Health care, Insurance, Telecom & other domains. • Designed solutions to process high volume data stream ingestion, processing and low latency data provisioning using Hadoop Ecosystems Hive, Pig, Scoop and Kafka, Python, Spark, Scala, NoSql, Nifi, Druid. • Expertise in writing end to end Data Processing Jobs to analyse data using MapReduce, Spark and Hive • Extensive experience in working with structured data using HiveQL, join operations, writing custom UDF’s and experienced in optimizing Hive Queries. • Enhanced the application by using HTML and Javascript for design and development. • Implemented stream processing using Kafka Streams, Streams API, DSL, KSQL. • Strong experience in migrating other databases to Snowflake. • Proficient in AWS Cloud Platform which includes services like EC2, S3, VPC, ELB, DynamoDB, Cloud Front, Cloud Watch, Route 53, Security Groups, Red shift, CloudWatch and CloudFormation. • Experience using various Hadoop Distributions (Cloudera, MapR, Hortonworks, Amazon AWS) to fully implement and leverage new Hadoop features.
