Project member for Credit Guarantee Corporation Data Warehouse Project• Develop and optimizing financial data pipeline using SQL and components in StreamSets.• Creating Data Marts and Fact table using Postgresql.• Automate pipeline process by using DAG in Apache Airflow.Project member for Orion Data Security Track:• Applying masking policies on Apache Ranger through API using Talend Platform.• Grabbing system logs and storing inside secure zone.• Creating masking… Show more Project member for Credit Guarantee Corporation Data Warehouse Project• Develop and optimizing financial data pipeline using SQL and components in StreamSets.• Creating Data Marts and Fact table using Postgresql.• Automate pipeline process by using DAG in Apache Airflow.Project member for Orion Data Security Track:• Applying masking policies on Apache Ranger through API using Talend Platform.• Grabbing system logs and storing inside secure zone.• Creating masking policies logic using Regular Expression.• Perform storage of context values using PostgreSQL to aid relevant jobs.Project member for Orion GCIF Track:• Develop data engineering pipelines using Talend Big Data Platform for data transformation using Spark SQL.• Build multiple Talend Spark jobs to process cleaned data for data suspected duplicate detection and handling stage.• Manage storage and partitioning of parquet files using Hive and HDFS provided by Cloudera• Perform storage of context values and synchronisation of mismatch and suspected duplicate campaign tasks using PostgreSQL to aid relevant jobs.• Creating and updating lookup table in Talend Data Preparation using API inside Talend standard job and big data batch job.• Using Gitlab to synchronise development process with other track members.Project member for NFIS system for National Financial Crime Centre (NFCC)• Creating knowledge graph using Python and Neo4j Show less

Project member for Customer Premises Equipment Management• Develop Enterprise Data Warehouse using PostgreSQL and visualize it in Apache Superset.• Automate the pipeline process by using Apache Airflow.