Eduardo Freitas Email and Phone Number
As a Data Engineer, I take part in complex projects involving data from different sources, platforms and tools. I use Python, Spark, SQL, Docker and Terraform to create data ingestion and modeling pipelines, develop APIs and libraries, and administer and monitor AWS cloud computing services such as Databricks, Airflow and Grafana. I also contribute to access and privilege management in Redshift, code validation and versioning with Git, and the deployment of PostgreSQL databases and dashboards on the Grafana platform.I have a bachalor degree in Information Management from UFPR, where I acquired a solid foundation for understanding and applying effective data management practices, taking into account a company's administration, business and technologies. Before becoming a Data Engineer, I was an Analytics Engineer and Analytics Engineering intern at MadeiraMadeira, where I developed dashboards in Looker and Grafana, using LookML and SQL, and participated in the migration of MySQL analytical databases to Redshift, using Python and Airflow. I'm passionate about transforming data into valuable information that helps people make new discoveries and achieve goals that benefit their businesses or areas of activity.
Dnx Brasil
View- Website:
- dnxbrasil.com
- Employees:
- 42
-
Engenheiro De Dados PlenoDnx BrasilState Of Paraná, Brazil -
Data Engineer IiDnx Brasil Jun 2024 - Present -
Data Engineer IiRentcars Apr 2024 - Jun 2024Localidade Curitiba, Paraná, Brazil- Change Data Capture (CDC) with Kafka and Debezium for MySQL database ingestion into the Data Lake using EKS, PySpark in EMR Container and S3. - API data ingestion using tools such as Python, Apache Airflow and EMR Containers; - Airflow DAGS maintenance. -
Data Engineer IMadeiramadeira Mar 2023 - Mar 2024Curitiba, Paraná, Brasil- Development of data extraction and processing via API and also from production databases using SQL, Python, Apache Airflow, and Databricks;- Creation of a REST API with Reverse ETL to provide analytical data for the company's supplier and carrier score system dashboards, using Python, PySpark, Apache Airflow, Databricks, Terraform, Serverless, and AWS services such as Lambda, API Gateway, and S3;- Creating alerts in Slack for AWS EventBridge events related to the availability and performance of AWS services, using Python, Spacelift with Terraform, and AWS Lambda;- Deployment of a PostgreSQL database on the Grafana platform and creation of AWS service monitoring dashboards, with alerts in Slack, using SQL, Python, Docker, Spacelift with Terraform to scale up the necessary AWS infrastructure involving RDS, EFS, ECS, ECR, Security Group, and Secrets Manager;- Development of Python libraries to facilitate interaction with AWS resources, perform ingestion and validation of metadata in JSON format, perform UPSERT of Pandas and Spark dataframes with data quality in Redshift, and offer efficient methods for reading data from banks, using Python, SQL, and PySpark;- GitHub Code Owner and Reviewer of data pipelines with Python, SQL, PySpark, Apache Airflow, and Databricks scripts;- Managing permissions in AWS Redshift for different groups, roles, and users in the Analytics and Business Intelligence areas across the company;- Management of infrastructure as code (IAC) data repositories using Terraform on the Spacelift platform and support in using the platform;- Administration of Databricks, managing clusters, permissions, formulating guidelines for using the platform and supporting PySpark development for other teams and developing proof of concept for the Unity Catalog tool. -
Analytics Engineer IMadeiramadeira Oct 2022 - Feb 2023Curitiba, Paraná, Brasil- Data modeling of new analytical tables for the Supply area;- Development of ETL pipelines using PySpark;- Documentation and cataloging of analytical bases and Supply business rules. -
Analytics Engineering InternMadeiramadeira Sep 2021 - Sep 2022Curitiba, Paraná, Brasil- Migration of MySQL analytical databases to Redshift, using Python, Airflow, SQL, AWS resources such as S3, Secrets and ParameterStore and Git for versioning.- Development of Grafana dashboards to monitor targets in real time. Providing links via an internal PHP webpage with Dashboards and Streaming links for the whole company using Vimeo;- DBT: Development of a POC for the use of the tool with Redshift and support for its use;- Refactoring and maintenance of Redshift and MySQL queries for logistics sector reports;- Migration of Dashboards from Tableau (MySQL source) to Looker (Redshift source);- Dashboard development in Looker with LookML. -
Technical Documentation InternAndritz Brazil Mar 2020 - Sep 2021Curitiba, Paraná- Support for information management activities with Greendocs, focusing on the dissemination of information and documents to the Andritz team, customers and suppliers; Participation in projects such as: Internship Training Plan; Greendocs E-learning, Selection of Minimum Functionalities for a New Environment in Greendocs and the Creation of Dashboards in Greendocs for Data Analysis. -
General AssistantCine Uniplex Aug 2018 - Mar 2020Colombo, PrCustomer service, auditing of merchandise, sales of products and tickets, sales closing spreadsheets, routine checks and maintenance of equipment (audio, video and air conditioning), setting up displays, programming weekly films and looking after the work environment.
Eduardo Freitas Education Details
Frequently Asked Questions about Eduardo Freitas
What company does Eduardo Freitas work for?
Eduardo Freitas works for Dnx Brasil
What is Eduardo Freitas's role at the current company?
Eduardo Freitas's current role is Engenheiro de Dados Pleno.
What schools did Eduardo Freitas attend?
Eduardo Freitas attended Universidade Federal Do Paraná.
Not the Eduardo Freitas you were looking for?
-
3gmail.com, xerox.com, serviceaide.com
1 (650) 2XXXXXXX
-
Eduardo Freitas
Curitiba, Pr -
-
Eduardo Freitas
Dourados, Ms
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial