Director Of Data Engineer
CurrentBuilt ETL and ELT data pipelines with APIs, Azure Functions, Databricks, orchestrated with Airflow on Kubernetes, integrating data sources from external APIs, databases, and cloud storages.Designed and Administered SQL databases and CosmosDB, built complex workflows through stored procedures.Designed and automated distributed report generation (including data analysis and visualization) with web server, task queues, and message broker architecture.