Sunil Kumar Email & Phone Number

Over a decade of hands-on experience in Analysis, Design, Development, and Implementation within the realm of data engineering. Proficient across the Hadoop Ecosystem, including HDFS, MapReduce, YARN, Spark, Sqoop, Hive, Pig, Impala, Oozie, and Apache Cassandra, among others. Particularly adept at harnessing Spark architecture and integrations, specializing in Spark SQL, Data Frames, and Datasets APIs.I design and implement Big Data Analytics architectures, develop Spark applications in Scala and Python, and create ETL pipelines using Data Lake Services. I excel at converting Hive/SQL queries into Spark transformations to enhance data processing. I worked on real-time data processing using Spark Streaming with Kafka and created Databricks notebooks for data analysis. I am also deeply enthusiastic about automation and constantly look for ways to streamline processes. By creating automated workflows, I decrease the need for manual tasks and reduce errors, enabling teams to concentrate on data analysis and strategic projects. My dedication to developing efficient and scalable data solutions leads to significant results and helps achieve organizational objectives.