• Designed, developed, optimized, and maintained ETL pipelines using python script, resulting in a 20% improvement in data processing efficiency.• Built pipelines for optimal extraction, transformation, and loading of data from various sources using SQL and PrestoDB 'big data' technologies, resulting in a 30% increase in data integration efficiency• Responsible for building ETL pipelines using Azure Data Factory (ADF) and Azure Synapse Analytics.• Developed and maintained data warehouses in big data solutions, ensuring data integrity and reliability.• Building of Scalable ETL pipelines using Azure Data bricks and Amazon glue Cloud technologies• Utilized cloud computing services and infrastructure to develop scalable data solutions, optimizing data delivery and infrastructure.• Configured a scheduling mechanism (Apache Airflow) to automate the execution of ETL processes at predefined intervals, leading to process reliability.• Reduce pipeline processing time by 30% by optimizing a complex SQL query• Architected more than ten end-to-end data ingestion and processing pipelines with Kafka, spark, and Presto • Designed and implemented Customer Value Management Datastore with Hive and Presto, which enabled more robust reporting capabilities for marketing campaigns. • Automated data ingestion workflows with Python scripting on Airflow, saving hours of manual work per week.• Developed data quality frameworks using Python to monitor data feeds for data completeness, trend checks, automated deduplication, and data reconciliation between sources, which enhanced data quality by 30% for critical business decisions. • Ensured data platform availability by promptly resolving workload and platform failures within SLA. Hive • SQL • Airflow • Python • Bash Script • Apache NIFI • Jira

• Engaged in the Development and automation of new ETL pipelines both on Big data and BI systems.• Supported and attended to customer requests and escalations.• Participated in migration of ETL jobs as well as other services from BI system to Big Data interface (BDI).• Monitored Automated ETL pipelines.• Carried out reconciliations on files not completely loaded.• Developed ETL pipelines using Apache NIFI, shell scripts, and BDI (Big data interface).Played a key role in the design and development of business intelligence applications, utilizing programming and analytics expertise.• Coordinated the Automation of ETL Data Pipelines using Python script.• Automation of Python script using Apache Airflow.• Organized and provided technical guidance on Artefact owned by Business owners to comply with rules and regulations in Operations.• Managed external vendor relationships, negotiating service level agreements and ensuring delivery of quality services.• Responsible for the development and building of ETL pipelines using Optimized batch shell scripts and Apache Nifi.• Maintained Automated ETL jobs.• Developed alert systems for monitoring real-time, daily, and monthly loading.• Installed Apache NIFI on Linux servers provided by the customer.• Developed reconciliation system for completeness purposes.• Engaged in the creation of tables and views.• Developed stored procedures for data transformation and loading into final ETL tables.• Responsible for all required documentation throughout the project lifecycle.• Led a team of 5 in developing and monitoring applications within the IT environment

• Participated in the use of Back End Scripting for Automation of Jobs using Unix Shell Scripting commands for Extract, Transform, and Load (ETL) functions.• Employed PL/SQL programming language to appropriately manage Oracle database.• Participated in the Automation of workflows between systems on Apache NiFi.• Actively participated in the Workflow, Monitoring, and designing of the alerting system on Apache NIFI and Huawei BDI.• Provided necessary Technical Support to clients.• Developed High-level Project Plans, Resource allocation, milestones and contingency planning• Participated in migration and development of new ETL pipelines from BI system(Shell script) to Huawei Big data interface.• Developed end user manual documentation• Interfaced with customers to discuss project progress, issues and proffer solution.• Participated in the development of optimized batch shell scripts for ETL purposes across several industries.Skills: PL/SQL, Big Data Technologies, Python, Apache Nifi, Hadoop, Hive, Batch Shell Scripts, Unix, Stored Procedures

Key Result Areas1. Perform project oversight functions for selected projects within the bank’s project portfolio.2. Support project execution and governance by tracking deadlines, Deliverables, resources, and timelines throughout the project life cycle. 3. Develop project plans – including schedule, cost, human resource, budget and risk planning.4. Co-ordinate project team meetings provide status updates and develop weekly, monthly as well as quarterly project reports.6. Maintain technology vendor relationships and resolve stakeholder conflicts.7. Develop and communicate clear and actionable deliverables, or activities to be Completed to relevant teams and departments. 8. Ensure documentation, supporting materials, and project plans are updated and readily available for stakeholders.