Data Engineer
Current- Managed ETL pipelines for over 50 clients across APAC and EMEA, ensuring seamless data accessibility through PowerBI and Delta Sharing, leveraging Azure Databricks and Apache Airflow for optimal performance.
- Teamed up with clients and services to understand pain points and enhance our Insights Product's data model, utilizing Pyspark and SQL to introduce new, valuable features.
- Created a robust internal data pipeline to track over 1000 databases, utilizing Azure Databricks and Airflow to streamline operations and improve data visibility, tracking problematic databases and significantly.
- Led the redesigning and ideation of client-facing PowerBI dashboards, collaborating with sales and services to deliver actionable insights and increasing adoption of dashboards by more than 50% YoY.