Senior Data Engineer
Current• Design, develop, and automate data pipelines across key banking domains, delivering transformed data to GCP, MINIO, or Hive, for enterprise-wide consumption • Lead the creation of consumption views for the Customer domain, integrating business logic for critical initiatives, and collaborating with stakeholders for data analysis in BigQuery • Lead a team of data engineers in the On-Prem to Cloud migration, converting ETL scripts from Spark to DBT • Design DBT macros to streamline data transformation and implement best practices, optimizing DBT pipelines for performance and scalability • Oversee daily pipeline monitoring, troubleshoot issues, and communicate with stakeholders • Manage and mentor a team of Co-Ops, providing guidance and technical oversight • Lead the recruitment efforts for interns, ensuring the acquisitionof top-tier talent to support organizational objectives and initiatives. • Tools/Language used: Google Cloud Platform, DBT, Airflow, Python, Spark-PySpark, SQL, MINIO, Hive