Daniel Galea Email & Phone Number

Netherlands

Netherlands

Amsterdam, Nh, Nl

Freelance Data Engineer. Delivering business value through a variety of means such as:* Designing and deploying scalable data platforms with cloud-native and open-source technologies.* Building robust ETL/ELT pipelines to transform raw data into actionable insights.* Creating interactive dashboards and reports for smarter decision-making.* Collaborating with machine learning teams to operationalize AI models.* Developing GenAI solutions as standalone products or seamlessly integrated into your business and data pipelines.* Applying software engineering best practices for clean, maintainable, and reusable code.* Engaging with stakeholders to align technical solutions with business goals.Let’s connect to explore how we can drive your business forward together.

Utrecht, Nl

Part of my freelance work, please reach out for more information.

Amsterdam, Noord Holland, Nl

Responsibilities:* Formulating and maintaining a data strategy.* Formulating and maintaining a data governance framework, and implementing it across the company.* Formulating projects, managing stakeholders, and gathering business requirements to then translate them into technical requirements.* Setting up a secure network infrastructure for the data platform* Designing and building a data platform.* Designing and maintaining a Lakehouse.* Designing and building ELT data pipelines.* Designing and building dashboards & reports.Technology Stack: Amazon Web Services (AWS) - S3, Athena, Glue Data Catalog, Elastic Kubernetes Service (EKS), Simple Queue Service (SQS), Relational Database Service (RDS), CloudFormation, Elastic Map Reduce (EMR), Virtual Private Cloud (VPC)Open source - Apache Superset, Dagster, Delta Lake, Apache Spark (PySpark), Ansible, Docker, KubernetesCI/CD - GitLabProgramming Languages - Python, SQL, Bash

Amsterdam, Noord Holland, Nl

Amsterdam, Noord-Holland, Nl

Part of my consultancy work at Xomnia.Main Activities* Lead data engineer which entails taking ownership of projects, communicating with stakeholders, gathering requirements, building end-to-end data pipelines, delivering data products, and taking infrastucture related decisions on the data platform itself.* Migration from Teradata into a modern architecture in AWS.* Design and setup of cloud infrastructure used by data engineers, data analysts, and data scientists* Install and configure applications on Kubernetes (K8s) using HELM: such as Spark, Airflow, Prometheus, Grafana, and FluentD.* Custom development in Airflow 2 to enable the orchestration of various ELT pipelines.* Maintaining and developing a datalake in S3 and Delta Lake.* Development of data transformation pipelines in Spark (PySpark 3) and Delta Lake.* Exposing data through Redshift in an optimal manner (Spectrum and Materialized Views).Technology Stack: Amazon Web Services (AWS) - Elastic Kubernetes Service (EKS), Elastic Container Registry (ECR), Elastic Map Reduce (EMR), S3, Athena, Redshift, Spectrum, Lambda, Relational Database Service (RDS), CodeBuild, CodePipelineOther - Spark (PySpark 3), Python, Delta Lake, Airflow, Kubernetes, HELM, Grafana, Prometheus, FluentD, Terraform, SQL, Jenkins

Amsterdam, Nl

* Worked as a data engineer at different clients of Xomnia. Namely: Rabobank, TIP Trailer Services, and HEMA.* Created content for trainings and gave trainings as part of the Junior Development Programme and Machine Learning Engineering Programme respectively at Xomnia. Topics I gave training on are: Elastic Stack (Elasticsearch, Logstash, Beats, Kibana), and Microsoft Azure.* Organized trainings for Xomnia's core team. This included: - Generating a list of topics for different trainings to given throughout the year - Finding internal and external trainers for these topics - Forming a course outline with each trainer - Scheduling trainings, sending out invitation forms, and gathering feedback from trainees to relay back to trainers.* Career Mentor

Amsterdam, Nl

Amsterdam, Nl

Part of my consultancy work at Xomnia* Design and implement a data platform from scratch using various PaaS tools and services in Microsoft Azure* Build APIs between internal systems and external (3rd party) systems to enable seamless integration of data movement and availability* Design and implement ELT pipelines for both batch and streaming solutions using tools such as Azure Data Factory, Azure Functions, Azure Event Hubs, Azure Data Lake Storage, and Azure Databricks to handle structured and semi-structured data.* Communicate effectively with internal and external stakeholders to gather requirements for the data platform, data pipelines, data products, and any thing in between. Also, report any data quality issues and follow-up so that these issues are resolved in a timely manner. Technology Stack:Microsot Azure - SQL Server Database, Function Apps, API Management, Key Vault, Data Factory, Data Lake Storage Gen 2, Event Hubs, Databricks, Logic Apps, DevOpsOther - Python, Pandas, Spark (PySpark 3), SQL

Utrecht, Utrecht, Nl

Part of my consultancy work at Xomnia - Building and maintaining a data warehouse (following Kimball Group best practices), analytical queries, and dashboards which are used as a single source of truth for many different reporting needs. In my role I built ETL pipelines, wrote measures and queries in SSAS, and displayed various KPIs through Power BI.Technology stack: SQL-Server (T-SQL), SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), and Power BI.

Amsterdam, Noord Holland, Nl

I was tasked with helping to expand ETPAs’ energy trading platform by brainstorming for new ideas, ,developing new features , and improving existing features. I worked on both the back-end and front-end which included automated testing (unit and integration tests) through a CI/CD pipeline. Technology stack: Java, Spring Framework, Axon Framework, Gitlab (CI/CD), Maven, AngularJS, JUnit, Jasmine.

Mosta, Mt

Having been assigned to the R&D team I was tasked with developing web based systems to be used internally by the company. This involved back-end, front-end, and database development. Technology stack: Python (Flask, Pandas, Python JIRA), Java, Maven, MySQL, HTML, CSS, Bootstrap, JavaScript, JQuery, AngularJS, Jira

Master Of Science, Computer Science: Big Data Engineering

Master Of Science, Computer Science: Big Data Engineering

B.Sc. It (Hons), Software Development

Software Development (Exchange Student), Web Development, Game Development, Data Structures

Post-Secondary Certificate, Advanced Level: Philosophy, Computer Science ; Intermediate Level: Pure Maths, English, Physics, Sok