Data Engineer
CurrentMy work as a data engineer has focused on helping customers set up modern data platforms mainly in Azure. I have worked on modernising existing data platform architectures using technologies such as Azure cloud platform for data processing, Agile Data Engine for data orchestration and Snowflake for data storage. In Azure, I have set up event-based data processing pipelines utilising data lake storage, Azure Data Factory, Synapse, and Python functions for fast and reliable data processing. I have also designed and published RESTful APIs for data dissemination utilising OpenAPI specifications, Terraform, and Azure API Management.