Data Engineering Excellence:With over 3 years of professional experience as a Data Engineer at Krithi Cybersoft Private Limited, I bring a robust foundation in Big Data environments, Hadoop ecosystems, SQL, and Denodo. My proficiency extends across the end-to-end application lifecycle management, showcasing expertise in tools like Denodo, Talend, and Hive for efficient data extraction and transformation.Agile Project Management Proficiency:I have successfully applied Agile methodology for project management, demonstrating the ability to organize and execute project tasks within specified timeframes. My hands-on experience includes handling the complete Software Development Life Cycle (SDLC) using Agile and hybrid methods. I am adept at planning, analysis, design, implementation, testing, and maintenance of projects.Denodo Expertise and Integration:Specializing in Denodo, I have leveraged its capabilities to provide agile, high-performance data integration and virtualization solutions. With a deep understanding of Denodo's architecture and functionality, I've implemented data virtualization strategies that enable real-time access to disparate data sources without the need for physical data movement. This has resulted in streamlined analytics, improved data governance, and reduced time-to-insight for business stakeholders.Hadoop Architecture and Component Understanding:My in-depth knowledge encompasses Hadoop architecture and its components, including YARN, HDFS, Name Node, Data Node, Job Tracker, Application Master, Resource Manager, Task Tracker, MapReduce, Spark, and Denodo. I have effectively utilized Cloudera, Hortonworks, and AWS Elastic MapReduce for the management of Hadoop distribution platforms.Cloud Services and CI/CD Implementation:Proficient in Microsoft Azure/Cloud Services, I have streamlined ETL processes and implemented CI/CD pipelines using GitLab CI. This ensures the efficient development processes, and my expertise extends to Microsoft Azure, Denodo, and GitLab CI for comprehensive cloud service utilization.Database Management and Configuration Expertise:I bring strong database skills, focusing on SQL Server and Oracle, with a specialization in ETL processes, data migration, and configuration management. Leveraging tools such as Talend, ERWIN, ER Studio, and Power Designer, I ensure efficient data handling and database configuration, contributing to the success of data-related initiatives.Skills: ETL Testing · Data Loading · Hadoop · Denodo · Microsoft Azure · Engineering Data Management · PL/SQL