Data And Release Engineer
Current- Handled end-to-end release deployments, ensuring seamless transitions from testing to production while maintaining system stability and quality.- Maintained uninterrupted performance of a corporate data warehouse built on Hadoop (HDFS, Hive, Oozie, Apache Airflow, Pentaho DI, Vertica, and PostgreSQL), ensuring high SLA standards.- Optimized data pipelines and ETL frameworks using Apache Airflow, Pentaho DI, and integration tools, enhancing stability, resource… Show more - Handled end-to-end release deployments, ensuring seamless transitions from testing to production while maintaining system stability and quality.- Maintained uninterrupted performance of a corporate data warehouse built on Hadoop (HDFS, Hive, Oozie, Apache Airflow, Pentaho DI, Vertica, and PostgreSQL), ensuring high SLA standards.- Optimized data pipelines and ETL frameworks using Apache Airflow, Pentaho DI, and integration tools, enhancing stability, resource efficiency, and ensuring timely, accurate data delivery for analytics and reporting.- Proactively identified and resolved complex data pipeline issues, implementing long-term solutions and monitoring solutions to minimize recurrence, reduce troubleshooting incidents, and improve system stability.- Collaborated with the team to enhance release execution processes, resulting in faster deployments, improved quality, and a significant reduction in hotfixes.- Configured access policies, resource quotas, and pools using Apache Ranger, Vertica, and PostgreSQL, enhancing system governance and reducing troubleshooting incidents. Show less
