Big Data Architect - Strong experience, knowledge on HDFS, YARN, Sqoop, Hive, Spark Core, SQL, Streaming, Kafka messaging Queue, Nifi Dataflow, NoSQL (HBase, Phoenix), Oozie, Workflow automation (RPA), Maven, AWS, S3, EC2, EMR, Data Proc, Big Query and creating different data pipelines including Batch, Interactive and Real time streaming. Handled to landing, processing, curating, munging, loading all Variety, Velocity and Volume of sources (Legacy, Sensor, Web and Social Media Data) to different target datastores (DBs, HDFS, Hive, HBase, Elastic Search) and visualizing in Kibana for business users. Experienced in On-perm and Hybrid (AWS,GCP).Experienced in creating and managing different data pipelines:RDBMS (source) -> Spark Core/SQL (Transformation, Processing, curating, Munging) -> HDFS/Hive/NoSQL (Elastic Search) -> Kibana (Visualizing)Unification, Federation and Lambda ArchitectureRDBMS ----------------------------------- > Spark streaming -> HDFS/Hive Web Events -> Nifi (Producer) -> Kafka -> Spark Streaming (Real time streaming) -> Elastic Search -> Kibana (Visualizing)RDBMS/Linux FS/Real time events -> Spark SQL/DF/DS/UDF -> Real Time processing lookup -> Raw zone -> Metrics & Analytics Layer/Curated/Filtered/Trusted Zone for batch analysisReal Time visual Analytics:Simulation (Shell script) -> Nifi -> Kafka Queue/ RDBMS (Producer) -> Spark Streaming Consumer (Curation/Processing/Munging) -> Elastic Search -> Kibana (Real time visualizing) Awards and Achievements:• Handled multiple projects on financial year (2019-2020) and crossed 64% contribution margin.• Awarded “People Champ - 2019” and “CUSTOMER DELIGHT – 2017” for excellent contribution by demonstrating exemplary standards of performance towards TransUnion account.• AWS Certified Solutions Architect - Associate• Certified Scrum Master• Received ‘Propellers Award’ for 2014 Q3 in Capgemini.• Received ‘Team Excellence’ award for 2014 Q2 in Capgemini.• Awarded ‘STAR EMPLOYEE’ for 2014 Q1 in Capgemini.• Received performance ward “Star Employee of the Quarter” for period Nov 2011 to Jan 2012.• Received performance awards ‘SPOT AWARD’ and 'Star employee’ in CSC (2010).• Received special award ‘Best contribution to QC’ for the year of 2006 in Anadocs.