• 18+ years’ experience MapR certified Big Data (Hadoop) and Databricks certified Spark specialist with extensive knowledge on Spark 2.3, Hadoop V2 MapReduce, YARN, Hive, Kafka and webMethods integration platform. • Extensive knowledge and hands on experience on application design in distributed architecture and performance tuning of complex large data ingestion. • Core technical expertise on Spark programming in distributed environment, including Dataset, DataFrame, RDD, Pair RDD, Spark SQL, Spark Streaming using Database, Parquet, JSON, XML, ORC, Text and Sequence files. • In-depth knowledge of Spark internals, like Tungsten Binary Format, Catalyst Optimizer, Whole-Stage code generation, data partitioning, memory management, static and dynamic scheduling. • Core technical capabilities with Spark Structured Streaming using event time, watermarks on semi-structured data using Kafka topic, partitions, broker, producer, consumer.• Hands-on experience on Preprocessing and Feature Engineering.• Theoretical knowledge on different Machine Learning Algorithms like Regression, Classification, Recommendation, Graph Analysis.• Command on Scala and Java for Spark and Non-Spark development.