Eduardo Freitas

Eduardo Freitas Email and Phone Number

Engenheiro de Dados Pleno @ DNX Brasil
State of Paraná, Brazil
Eduardo Freitas's Location
Curitiba, Paraná, Brazil, Brazil
About Eduardo Freitas

As a Data Engineer, I take part in complex projects involving data from different sources, platforms and tools. I use Python, Spark, SQL, Docker and Terraform to create data ingestion and modeling pipelines, develop APIs and libraries, and administer and monitor AWS cloud computing services such as Databricks, Airflow and Grafana. I also contribute to access and privilege management in Redshift, code validation and versioning with Git, and the deployment of PostgreSQL databases and dashboards on the Grafana platform.I have a bachalor degree in Information Management from UFPR, where I acquired a solid foundation for understanding and applying effective data management practices, taking into account a company's administration, business and technologies. Before becoming a Data Engineer, I was an Analytics Engineer and Analytics Engineering intern at MadeiraMadeira, where I developed dashboards in Looker and Grafana, using LookML and SQL, and participated in the migration of MySQL analytical databases to Redshift, using Python and Airflow. I'm passionate about transforming data into valuable information that helps people make new discoveries and achieve goals that benefit their businesses or areas of activity.

Eduardo Freitas's Current Company Details
DNX Brasil

Dnx Brasil

View
Engenheiro de Dados Pleno
State of Paraná, Brazil
Website:
dnxbrasil.com
Employees:
42
Eduardo Freitas Work Experience Details
  • Dnx Brasil
    Engenheiro De Dados Pleno
    Dnx Brasil
    State Of Paraná, Brazil
  • Dnx Brasil
    Data Engineer Ii
    Dnx Brasil Jun 2024 - Present
  • Rentcars
    Data Engineer Ii
    Rentcars Apr 2024 - Jun 2024
    Localidade Curitiba, Paraná, Brazil
    - Change Data Capture (CDC) with Kafka and Debezium for MySQL database ingestion into the Data Lake using EKS, PySpark in EMR Container and S3. - API data ingestion using tools such as Python, Apache Airflow and EMR Containers; - Airflow DAGS maintenance.
  • Madeiramadeira
    Data Engineer I
    Madeiramadeira Mar 2023 - Mar 2024
    Curitiba, Paraná, Brasil
    - Development of data extraction and processing via API and also from production databases using SQL, Python, Apache Airflow, and Databricks;- Creation of a REST API with Reverse ETL to provide analytical data for the company's supplier and carrier score system dashboards, using Python, PySpark, Apache Airflow, Databricks, Terraform, Serverless, and AWS services such as Lambda, API Gateway, and S3;- Creating alerts in Slack for AWS EventBridge events related to the availability and performance of AWS services, using Python, Spacelift with Terraform, and AWS Lambda;- Deployment of a PostgreSQL database on the Grafana platform and creation of AWS service monitoring dashboards, with alerts in Slack, using SQL, Python, Docker, Spacelift with Terraform to scale up the necessary AWS infrastructure involving RDS, EFS, ECS, ECR, Security Group, and Secrets Manager;- Development of Python libraries to facilitate interaction with AWS resources, perform ingestion and validation of metadata in JSON format, perform UPSERT of Pandas and Spark dataframes with data quality in Redshift, and offer efficient methods for reading data from banks, using Python, SQL, and PySpark;- GitHub Code Owner and Reviewer of data pipelines with Python, SQL, PySpark, Apache Airflow, and Databricks scripts;- Managing permissions in AWS Redshift for different groups, roles, and users in the Analytics and Business Intelligence areas across the company;- Management of infrastructure as code (IAC) data repositories using Terraform on the Spacelift platform and support in using the platform;- Administration of Databricks, managing clusters, permissions, formulating guidelines for using the platform and supporting PySpark development for other teams and developing proof of concept for the Unity Catalog tool.
  • Madeiramadeira
    Analytics Engineer I
    Madeiramadeira Oct 2022 - Feb 2023
    Curitiba, Paraná, Brasil
    - Data modeling of new analytical tables for the Supply area;- Development of ETL pipelines using PySpark;- Documentation and cataloging of analytical bases and Supply business rules.
  • Madeiramadeira
    Analytics Engineering Intern
    Madeiramadeira Sep 2021 - Sep 2022
    Curitiba, Paraná, Brasil
    - Migration of MySQL analytical databases to Redshift, using Python, Airflow, SQL, AWS resources such as S3, Secrets and ParameterStore and Git for versioning.- Development of Grafana dashboards to monitor targets in real time. Providing links via an internal PHP webpage with Dashboards and Streaming links for the whole company using Vimeo;- DBT: Development of a POC for the use of the tool with Redshift and support for its use;- Refactoring and maintenance of Redshift and MySQL queries for logistics sector reports;- Migration of Dashboards from Tableau (MySQL source) to Looker (Redshift source);- Dashboard development in Looker with LookML.
  • Andritz Brazil
    Technical Documentation Intern
    Andritz Brazil Mar 2020 - Sep 2021
    Curitiba, Paraná
    - Support for information management activities with Greendocs, focusing on the dissemination of information and documents to the Andritz team, customers and suppliers; Participation in projects such as: Internship Training Plan; Greendocs E-learning, Selection of Minimum Functionalities for a New Environment in Greendocs and the Creation of Dashboards in Greendocs for Data Analysis.
  • Cine Uniplex
    General Assistant
    Cine Uniplex Aug 2018 - Mar 2020
    Colombo, Pr
    Customer service, auditing of merchandise, sales of products and tickets, sales closing spreadsheets, routine checks and maintenance of equipment (audio, video and air conditioning), setting up displays, programming weekly films and looking after the work environment.

Eduardo Freitas Education Details

Frequently Asked Questions about Eduardo Freitas

What company does Eduardo Freitas work for?

Eduardo Freitas works for Dnx Brasil

What is Eduardo Freitas's role at the current company?

Eduardo Freitas's current role is Engenheiro de Dados Pleno.

What schools did Eduardo Freitas attend?

Eduardo Freitas attended Universidade Federal Do Paraná.

Not the Eduardo Freitas you were looking for?

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.