Bachelor's degree in Computer Science.Fluent in Portuguese, English, and advanced level in Spanish.Experience working with Data Engineering and Data Architecture projects:- Experience in Data Visualization, using tools like Metabase to turn data into actionable insights.- Experience in implementing and enhancing Data Lakes in the cloud, both on AWS and GCP, ensuring efficiency and scalability of the environments.- Proficiency in creating and managing orchestrated ETLs with Airflow, ensuring data integrity and timely delivery.- Commitment to clean and readable code development, adhering to Clean Code principles to ensure maintainability and scalability of solutions.- Experience in building data architecture pipelines in the Databricks environment, using PySpark for efficient processing of large volumes of data.- Solid knowledge and practical experience in advanced Python programming, using it as the primary tool for developing Data Engineering solutions.Certification:- AWS Certified Cloud Practitioner
-
Engenheiro De DadosProton.AiState Of Paraná, Brazil -
Data EngineerGlobo Sep 2023 - Present• Modernize batch extraction through Dataproc to increase efficiency and reduce operational costs.• Develop data extraction flows from Oracle and Salesforce databases to GCP, ensuring data integrity and security.• Implement extractions using the File Transfer Protocol (FTP) to GCP, simplifying the data ingestion process and ensuring data availability.• Conduct integrated testing on extraction pipelines to ensure the reliability and accuracy of data processing. -
Data Engineer - AdtechGlobo Feb 2023 - Sep 2023• Define architecture and implement data flow pipelines in GCP to optimize efficiency and scalability.• Develop and manage ETLs using Airflow to ensure data integrity and timeliness.• Establish programming best practices and process standards to foster a culture of technical excellence within the team.• Create Python libraries to streamline solution development and maintenance, enhancing team productivity.• Successfully implement the Dag Factory in Airflow Composer to reduce development time and ensure faster project delivery.
-
Data EngineerMadeiramadeira Jul 2021 - Jan 2023- Designed and developed efficient ETL pipelines using PySpark on Databricks, enabling scalable data processing for large datasets.- Implemented and managed orchestrated ETL pipelines using Airflow, ensuring data integrity, timely delivery, and efficient data flow.- Defined scalable data flow architectures for cloud environments (Databricks, AWS), optimizing data processing efficiency and scalability.- Successfully migrated batch data extraction from AWS EMR to Databricks, achieving improved performance and cost reduction.- Led the design and implementation of the company's data visualization platform using Metabase, empowering users to explore and gain insights from data. -
Data Engineer InternMadeiramadeira Oct 2020 - Jun 2021Curitiba, Paraná, Brasil- Contributed to the development of a scalable Data Lake on AWS, ensuring efficient storage and management of vast amounts of data for business intelligence.- Designed and implemented orchestrated ETL pipelines using Airflow, automating data extraction, transformation, and loading for various business areas.- Developed data pipelines tailored to specific business needs, enabling efficient data flow and access for critical business insights.- Optimized SQL queries for improved performance, ensuring efficient data retrieval and faster response times for analytical queries.
-
R&D StudentPucpr Aug 2019 - Jul 2020Curitiba E Região, Brasil- Use of the StreamDM library to run the experiments in Spark;- Construction of a Hadoop cluster to run the experiments;- Comparison of the accuracy rate between data mining algorithms running on Spark and MOA;- Execution of databases in the Hoeffding Tree decision tree algorithm. -
R&D InternLactec Jul 2018 - Dec 2018Curitiba E Região, Brasil- Study of WiSUN standards (including IEEE 802.15.4 and 6LoWPAN)- Assistance in the development of the WiSUN Edge Router (6LoWPAN)- Simulations and tests of WiSUN devices
Mateus P. Education Details
-
Data Science E Analytics -
Computer Science
-
Federal Institute Of ParanáIt
Frequently Asked Questions about Mateus P.
What company does Mateus P. work for?
Mateus P. works for Proton.ai
What is Mateus P.'s role at the current company?
Mateus P.'s current role is Engenheiro de Dados.
What schools did Mateus P. attend?
Mateus P. attended Mba Usp/esalq, Pontifical Catholic University Of Paraná, Federal Institute Of Paraná.
Who are Mateus P.'s colleagues?
Mateus P.'s colleagues are Clearance Sale, Sabu .ps Sabu Ps, Brian Pirot, Filip Petrushevski, Cathie Albert, Emily Stites, David Calvo.
Not the Mateus P. you were looking for?
-
Mateus P. de Almeida
São Paulo, Sp -
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial