I have 10+ years of experience as Senior Data Engineer.With a robust background spanning over various domains, I bring a wealth of experience in navigating the intricacies of big data ecosystems. Proficient in Hadoop components such as HDFS, MapReduce, Sqoop, Flume, Pig, Hive, and adept at utilizing advanced tools like Spark, Kafka, and Snowflake.My programming arsenal includes Python, R, Scala, SAS, SQL, HiveQL, and Pig Latin, facilitating versatile data manipulation and analysis tasks.I excel in leveraging cloud technologies, with hands-on experience in AWS (EC2, S3, Redshift) and Azure Cloud (Data Lake, Data Factory, Cosmos DB). Scripting proficiency extends to Shell, Python, Perl, Unix, and JavaScript, while operating system expertise covers UNIX, LINUX, Ubuntu, and Windows. Across diverse databases including Snowflake, MySQL, Teradata, Oracle, SQL Server, PostgreSQL, and DB2.I've demonstrated adeptness in managing and optimizing data storage and retrieval. Familiarity with a range of IDE and DevOps tools such as Eclipse, SOAP UI, Ant, Maven, PyCharm, Jenkins, informs my seamless integration of development workflows. In the realm of ETL and reporting, I've honed my skills in Informatica, SSIS, SSRS, SSAS, Tableau, Power BI, and QlikView, ensuring streamlined data processing and visualization. Additionally, my proficiency extends to NoSQL databases like HBase, Cassandra, MongoDB, DynamoDB, and Cosmos DB, enhancing my capabilities in handling unstructured data. Version control proficiency with Git, SVN, and Bitbucket further streamlines collaborative efforts. Web development expertise encompasses HTML, XML, JSON, CSS, jQuery, and JavaScript, while DevOps proficiency extends to Jenkins, Docker, and Maven. With experience in integrating web services such as SOAP, JMS, Apache Tomcat, WebLogic, JBOSS, and Apache HTTP Server, I ensure seamless interoperability within distributed systems.Well-versed in methodologies including RAD, JAD, UML, SDLC, Jira, Confluence, Agile, and the Waterfall Model, I drive projects forward with structured and efficient approaches.