Experienced Data Engineer with 9 years of experience in designing, developing and implementing scalable big data solutions. Proficient in Scala, Spark and Azure, with a proven track record of deploying, managing, and optimizing big data applications in the cloud. Adept in designing and implementing data processing pipelines to extract, transform and load large amounts of data. Strong problem-solving skills and a focus on delivering high-quality, efficient and reliable data systems.Experience Summary:  Having 9 years of experience in IT, especially in manufacture, media, education, Banking and Retail Domain. Experience in the field of computer science includes Big Data, Hadoop development and Java/J2EE technologies. Hand- good experience in cloud – Azure (Data Bricks, Data Factory (ADF), Data Lake)  Experience in working in various phases of software development right from Design to Build and Release. Expertise in Java, Scala and scripting Languages like Perl. Handle on Experience in Hadoop ecosystem including HDFS, Spark, Hive, Sqoop, Oozie, Kafka, Zookeeper, MapReduce, and Pig. Experience in Spark SQL, Spark Streaming in a production environment. Worked in building, configuring, monitoring and supporting Cloudera Hadoop CDH5. Extensive experience in creating Hive tables and queries using HiveQL Experience in Hive Partitions and bucketing to optimize performance. Experience in designing time driven and data driven automated workflow using Oozie. Worked with RDBMS including MySQL, Oracle, and DB2. Good knowledge in Data Mining, Machine Learning, Statistical Modeling algorithms, Python and Java. Good Knowledge and Hands on Experience on UNIX shell commands. Hands on experience in MVC architecture and J2EE framework like Struts. Hibernate. Familiar with Agile and Waterfall methodology. Good understanding in XML and JSON schemas Good Experience in IDE like MyEclipse, Scala IDE and IntelliJ. Fluent with version control tools like Bitbucket, SVN, CVS and Git Good Experience in builds tools like Ant, Maven, SBT. Experience in working in Onshore-Offshore development models. Good experience in client interaction, tracking and status Reporting. Good expertise in delivering independently & working with cross functional teams. Good at risk mitigation and handling escalations.  Good at connecting with people instantly