I am a seasoned Information Technology professional with over 10 years of experience, specializing in BIGDATA using the HADOOP framework. My expertise spans various aspects of the software development life cycle, including Analysis, Design, Development, Testing, Documentation, Deployment, and Integration.My technical prowess extends to the Hadoop ecosystem, where I have extensively utilized components such as HDFS, YARN, MapReduce, Hive, Impala, Pig, Sqoop, HBase, Spark, Spark SQL, Kafka, Spark Streaming, Flume, Oozie, Zookeeper, and Hue. I possess a deep understanding of distributed systems, HDFS architecture, and the internal workings of MapReduce and Spark processing frameworks.In the realm of ETL (Extract, Transform, Load), I am well-versed in employing methods for data extraction, transformation, and loading within corporate-wide ETL solutions and Data Warehouse tools. I have successfully deployed Big Data Hadoop applications on cloud platforms, including Amazon Web Services (AWS) and Microsoft Azure, utilizing Talend for ETL processes.My cloud expertise extends beyond Hadoop, encompassing various AWS services such as Databases, Migration, Compute, IAM, Storage, Analytics, Network & Content Delivery, Lambda, and Application Integration. I have developed data ingestion modules using AWS Step Functions, AWS Glue, and Python modules, contributing to efficient data modeling and mining processes.I have actively participated in the migration of resources from data centers to both AWS and GCP cloud platforms. Proficient in handling streaming data in real-time, I have utilized Kafka, Flume, and Spark Streaming, with additional knowledge of Flink.Optimizing Hive tables and utilizing Spark-SQL for data manipulation are among my strengths. I have loaded processed data into AWS Redshift tables for Business reporting purposes and created views in AWS Athena to facilitate secure and streamlined data analysis access for downstream business teams.Throughout my career, I have demonstrated excellent programming skills in Java, C, SQL, and Python. I am well-versed in SDLC, Agile, and Waterfall methodologies, and I have extensive experience in Teradata database management. My ability to analyze business needs, develop effective solutions, and ensure timely deliverables has been a consistent hallmark of my career. I bring a wealth of experience in Business Analysis, Data Analysis, User Requirement Gathering, Data Cleansing, Data Transformations, and Reporting Analysis.
-
Data EngineerKemperChicago, Il, Us -
Data EngineerThe Bridge Corp ,Philadelphia, Pa Nov 2022 - PresentPhiladelphia, Pa
-
Data EngineerSociety Of Actuaries Jan 2020 - Oct 2022Schaumburg, Illinois, United States -
Data EngineerScientific Games Nov 2017 - Dec 2019Pleasanton, California, United States -
Software DeveloperInnovious Global Consultants Aug 2015 - May 2016India
-
Big Data DeveloperGem Sonics Private Limited Apr 2013 - Jul 2015India
Sunil M Education Details
-
Master Of Science - Ms -
Bachelor Of Technology - Btech
Frequently Asked Questions about Sunil M
What company does Sunil M work for?
Sunil M works for Kemper
What is Sunil M's role at the current company?
Sunil M's current role is Data Engineer.
What schools did Sunil M attend?
Sunil M attended Chicago State University, Kurukshetra University.
Who are Sunil M's colleagues?
Sunil M's colleagues are Andrew Rowden, Cpcu, Bridget Drayton, Ociel Galvan, Steven Stieber, Bud Wilson, Terence Randolph, Bruce Mccurdy.
Not the Sunil M you were looking for?
Free Chrome Extension
Find emails, phones & company data instantly
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial