Eduardo Freitas Email & Phone Number

State Of Paraná, Brazil

Localidade Curitiba, Paraná, Brazil

- Change Data Capture (CDC) with Kafka and Debezium for MySQL database ingestion into the Data Lake using EKS, PySpark in EMR Container and S3. - API data ingestion using tools such as Python, Apache Airflow and EMR Containers; - Airflow DAGS maintenance.

Curitiba, Paraná, Brasil

- Development of data extraction and processing via API and also from production databases using SQL, Python, Apache Airflow, and Databricks;- Creation of a REST API with Reverse ETL to provide analytical data for the company's supplier and carrier score system dashboards, using Python, PySpark, Apache Airflow, Databricks, Terraform, Serverless, and AWS services such as Lambda, API Gateway, and S3;- Creating alerts in Slack for AWS EventBridge events related to the availability and performance of AWS services, using Python, Spacelift with Terraform, and AWS Lambda;- Deployment of a PostgreSQL database on the Grafana platform and creation of AWS service monitoring dashboards, with alerts in Slack, using SQL, Python, Docker, Spacelift with Terraform to scale up the necessary AWS infrastructure involving RDS, EFS, ECS, ECR, Security Group, and Secrets Manager;- Development of Python libraries to facilitate interaction with AWS resources, perform ingestion and validation of metadata in JSON format, perform UPSERT of Pandas and Spark dataframes with data quality in Redshift, and offer efficient methods for reading data from banks, using Python, SQL, and PySpark;- GitHub Code Owner and Reviewer of data pipelines with Python, SQL, PySpark, Apache Airflow, and Databricks scripts;- Managing permissions in AWS Redshift for different groups, roles, and users in the Analytics and Business Intelligence areas across the company;- Management of infrastructure as code (IAC) data repositories using Terraform on the Spacelift platform and support in using the platform;- Administration of Databricks, managing clusters, permissions, formulating guidelines for using the platform and supporting PySpark development for other teams and developing proof of concept for the Unity Catalog tool.

Curitiba, Paraná, Brasil

- Data modeling of new analytical tables for the Supply area;- Development of ETL pipelines using PySpark;- Documentation and cataloging of analytical bases and Supply business rules.

Curitiba, Paraná, Brasil

- Migration of MySQL analytical databases to Redshift, using Python, Airflow, SQL, AWS resources such as S3, Secrets and ParameterStore and Git for versioning.- Development of Grafana dashboards to monitor targets in real time. Providing links via an internal PHP webpage with Dashboards and Streaming links for the whole company using Vimeo;- DBT: Development of a POC for the use of the tool with Redshift and support for its use;- Refactoring and maintenance of Redshift and MySQL queries for logistics sector reports;- Migration of Dashboards from Tableau (MySQL source) to Looker (Redshift source);- Dashboard development in Looker with LookML.

Curitiba, Paraná

- Support for information management activities with Greendocs, focusing on the dissemination of information and documents to the Andritz team, customers and suppliers; Participation in projects such as: Internship Training Plan; Greendocs E-learning, Selection of Minimum Functionalities for a New Environment in Greendocs and the Creation of Dashboards in Greendocs for Data Analysis.

Colombo, Pr

Customer service, auditing of merchandise, sales of products and tickets, sales closing spreadsheets, routine checks and maintenance of equipment (audio, video and air conditioning), setting up displays, programming weekly films and looking after the work environment.