Guru Kiran Shanmugam Email & Phone Number

London, Gb

Chennai, Tamil Nadu, India

Enhancing the reporting product of Beeswax data platformProviding Technical Leadership and Mentorship to Junior Engineers

Chennai, Tamil Nadu, India

𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬Collaborated closely with stakeholders to bridge gaps in requirements and ensure a comprehensive understanding of project goals.Translated functional requirements into conceptual, logical, and physical models, effectively aligning data engineering processes with project objectives.Developed a strategic approach to ETL and orchestration design, adhering to the medallion architecture for optimal data integration and processing.Constructed robust data pipelines utilizing Databricks and Airflow, facilitating efficient and reliable data flow throughout the system.Conducted thorough unit testing to validate data pipelines and documented test results to ensure the accuracy and reliability of data transformations.Prepared comprehensive source-to-target mappings and meticulously documented business rules, establishing clear guidelines for data integration and transformation processes.𝐀𝐜𝐡𝐢𝐞𝐯𝐞𝐦𝐞𝐧𝐭𝐬Significantly enhanced the accuracy of Ad capacity metrics to align with Google Ad Manager (GAM) Reports, effectively controlling discrepancies to approximately 1% as per GAM standards.Streamlined Airflow DAGs by reducing code size for parallel task creation by a remarkable 90%, employing dynamic task creation techniques based on configurations.Developed a reusable component for data migration from the data lake to Databricks lakehouse, resulting in a notable 50% reduction in effort required.

𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬Enhanced new features for the Data Ingestion module of the Tesser Pro product, resulting in improved functionality and efficiency.Translated business requirements into precise functional requirements, ensuring accurate and effective implementation.Spearheaded the implementation of various load types and file types within the data ingestion, cleanse, and transform modules.Oversaw the management of the DB layer of the product, encompassing the creation and maintenance of DB objects for optimal performance.

Chennai Area, India

𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬Assessed the existing data flows and meticulously devised a mapping document showcasing new transformation rules.Constructed efficient ETL data flows/workflows in Informatica to seamlessly handle both full load and incremental load processes.Successfully loaded the transformed data into the Exasol database.

Chennai Area, India

𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬Conducted requirement analysis and translated business requirements into functional requirements.Created conceptual and logical data models using the dimensional modeling technique.Evaluated raw data in data lake (S3) and formulated a mapping document with transformation rules.Implemented a logical data model in AWS RDS (PostgreSQL).Constructed ETL data flows/workflows for full load and incremental load using Xplenty.Optimized data retrieval performance through SQL query tuning and index creation.Developed intricate SQL queries to extract data for ad hoc business needs.

Chennai Area, India

𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬Developed and executed test scenarios and test cases to ensure end-to-end validation, guaranteeing data completeness and accuracy.Verified the implementation of transformation rules to ensure the integrity and quality of data.Conducted rigorous comparisons between target and source data to identify and rectify any instances of data corruption or discrepancies.Assessed and measured the performance of ETL jobs against agreed service level agreements (SLAs) to optimize efficiency.Methodically validated error tables and logs, promptly addressing any error exceptions for seamless project delivery.

Bachelor Of Engineering (B.E.), Computer Engineering

Bachelor of Engineering in Computer Science and Engineering

Sslc&Hsc