Data Engineer
CurrentScience & Technology project in collaboration between International Clients. Responsibilities include: * Architect and implement ETL processes to extract, transform, and load data from various sources into target systems, ensuring data consistency and quality.* Develop and maintain visually compelling data visualizations and dashboards using Microsoft Power BI.* Design, deploy, and optimize databases on Azure SQL to ensure seamless and high-performance data storage and retrieval.* Leverage Azure Databricks for advanced analytics and collaborative, scalable data engineering, enabling the processing of large datasets with efficiency.* Develop and manage data pipelines using Azure Data Factory to orchestrate and automate the movement and transformation of data across diverse sources.* Producing thorough documentation that captures the operational procedures and technical narratives and acts as a useful reference for both ongoing and upcoming projects.* Implement and manage data streaming solutions using Apache Kafka for real-time data processing and efficient communication between diverse data sources.
