Data Engineer
Current• Managed ETL pipelines for over 50 clients across APAC and EMEA, ensuring seamless data accessibility through PowerBI and Delta Sharing, leveraging Azure Databricks and Apache Airflow for optimal performance.• Teamed up with clients and services to understand pain points and enhance our Insights Product's data model, utilizing Pyspark and SQL to introduce new, valuable features.• Created a robust internal data pipeline to track over 1000 databases, utilizing Azure Databricks and Airflow to streamline operations and improve data visibility, tracking problematic databases and significantly reducing time spent rectifying them. • Led the redesigning and ideation of client-facing PowerBI dashboards, collaborating with sales and services to deliver actionable insights and increasing adoption of dashboards by more than 50% YoY.