(1) Developed the End-to-End data pipeline on Apache Airflow using Hooks,Operators,Xcom variablesand trigger rules and ingest the data in to datawarehouse.(2) Developed a standard processon Apache Airflow to take inputs and deploy the AI model on production that can be used by any client.(3) Developed Dashboards using Apache Superset and Power Bi to presen the KPIS to the stakeholders according to the required usecases.(4) Did Research and Development for constant improvement of the techstack and to use more efficient and robust ways to perform the ETL.(5) Automated the loading process and implemented email alertsto keep track of process success and failure for the client usingApache Airflow and greenplum - Created Sanity check functionsfor all the data feeds to check if data is good to load.(6) Developed File Counter alert and Data Decryption processthrough openssl and linux scripting.(7) Anlaysed and fixed the erroneous data on the client TelefonicaSpain and developed ETL pipelines to avoid Data loss andduplication.(8) Ensure Data Integrity and Quality by implementing intelligentdata sensors.(9) Migrated the End-to-End ETL processes and data from relational database to Distributed System and MPP datawarehouse.(10) Migrated the ET processes that were using talend for ETL to Apache Airflow.

(1) Planned and Executed end-to-end migration of ETL processes andDatabase from Mysql to Greenplum on many Big Data Clients(2) Handled the Big data using MPP datawarehouse like greenplum and make it available for the AI team(3) Monitor, troubleshoot and perform root cause analysis andresolve on all Production Issues.(4 ) Converted and validated Stored Procedures from Mysql toGreenplum(Massively Parallel Postgresql)(5) Created Python Utility to compare the data between Mysql and greenplum and calculate the mismatches