Responsibility:• Solution Design: Responsible for designing end-to-end data integration solutions for the OLE project and perform an analysis of the project's technical and business requirements and design its architecture and data flow.• Architecture Development: Responsible to create and maintain the overall architecture of data integration solutions. This includes designing and developing AbInitio graphs, plans, Data Lineage, Technical Hierarchy solution in Metadata Hub and scheduling jobs in Control Centre and maintain data storage in AWS S3 buckets.• Performance Optimization: Responsible to ensure data integration processes are efficient and optimized for performance. This involves identifying bottlenecks, tuning transformations, optimizing data loading, and enhancing solution performance.• Data Quality and Governance: Ensuring data quality and governance. Implement data validation, cleansing, and enrichment processes to ensure the accuracy and reliability of the integrated data.• Integration with Source and Target Systems: Responsible for integrating Ab Initio processes with various source systems (databases, APIs, flat files, KAFKA etc.) and target systems (data warehouses, data marts, cloud platforms, etc.).• Documentation: Document the Technical design, architecture, data flows, and other technical aspects of the solution.• Collaboration: Collaborate with business stakeholders, data analysts, developers, and other teams to understand requirements and provide technical solutions that align with business objectives.• Project Management: Associate in project management, overseeing the development lifecycle, timelines, and resource allocation for data integration projects.

ETL Technical Lead SME

• Interact with Data Stewards, Data Modelers and Data Architects to gather and understand ETL requirements.• Extracting, cleansing & processing data using Python and SQL. Responsible for loading, extracting, and validating client data in ADLS.• Analysing raw data, drawing conclusions & developing recommendations, and building SQL scripts to retrieve data for data loads using Azure Databricks.• Developing ETL process for analytical data from complex financial source data and performing deployment activities by developing release pipelines.• Working knowledge of the CI/CD process utilising version control systems GitHub.• Work experience in migrating data from Hadoop to ADLS and On-Prem to Cloud.

Senior AbInitio Developer