As a Senior Data Engineer and Tech Lead at Itaú Unibanco, I lead a squad dedicated to developing data engineering solutions that support the organization's strategic initiatives. My key responsibilities include:Data Pipeline Architecture and Development: Designing, building, and optimizing scalable data pipelines to process large volumes of data in real-time, utilizing technologies such as Python, Scala, SQL, and Apache Spark.Data Governance: Ensuring data accuracy, security… Show more As a Senior Data Engineer and Tech Lead at Itaú Unibanco, I lead a squad dedicated to developing data engineering solutions that support the organization's strategic initiatives. My key responsibilities include:Data Pipeline Architecture and Development: Designing, building, and optimizing scalable data pipelines to process large volumes of data in real-time, utilizing technologies such as Python, Scala, SQL, and Apache Spark.Data Governance: Ensuring data accuracy, security, and compliance by implementing best practices in data governance and quality control.Cross-Functional Collaboration: Working closely with data scientists, analysts, and business stakeholders to translate business needs into effective technical solutions.Innovation and Continuous Improvement: Exploring new technologies and methodologies to enhance the efficiency and performance of data processes, constantly striving to add value to the business through intelligent data use.Team Leadership: Guiding and mentoring team members, fostering a collaborative environment focused on delivering high-quality results. Show less

As a Senior Data Engineer at iFood, I was responsible for designing, maintaining, and evolving systems and processes that transformed raw data into clean and consistent information, supporting various use cases including advanced analytics and machine learning.Key Responsibilities:Data Lifecycle Management: Managed the entire data lifecycle, from ingestion to archiving, ensuring data integrity and quality throughout the process.Data Security and Governance: Implemented… Show more As a Senior Data Engineer at iFood, I was responsible for designing, maintaining, and evolving systems and processes that transformed raw data into clean and consistent information, supporting various use cases including advanced analytics and machine learning.Key Responsibilities:Data Lifecycle Management: Managed the entire data lifecycle, from ingestion to archiving, ensuring data integrity and quality throughout the process.Data Security and Governance: Implemented robust security measures to protect data and ensured controlled access in compliance with company policies.Data Architecture: Proposed and implemented efficient and scalable data architectures to support the needs of different business areas.Data Modeling: Developed data models optimized for their intended use, ensuring that data structures were suitable for analysis and machine learning.Technologies and Tools:Programming Languages: Python, Scala, SQL.Tools and Frameworks: Apache Airflow, Databricks, Apache Spark/PySpark, Delta Lake, AWS Cloud, Kafka, PostgreSQL, Grafana.This role allowed me to apply and refine my skills in high-volume data environments, contributing to the optimization and innovation of data processes at iFood. Show less

As a Data Engineer, I was responsible for building, maintaining, and evolving a centralized Data Lake that integrates data originating from on-premise systems, third-party APIs, and other sources.Key Responsibilities:Data Collection: Extract data from various sources, including relational and non-relational databases, structured and unstructured files, and external APIs.Data Transformation: Perform necessary data transformations, including cleaning, aggregation, and… Show more As a Data Engineer, I was responsible for building, maintaining, and evolving a centralized Data Lake that integrates data originating from on-premise systems, third-party APIs, and other sources.Key Responsibilities:Data Collection: Extract data from various sources, including relational and non-relational databases, structured and unstructured files, and external APIs.Data Transformation: Perform necessary data transformations, including cleaning, aggregation, and validation, to ensure data quality and usability.Data Lake Construction and Monitoring: Develop and oversee the Data Lake that stores data from multiple sources, ensuring its availability and performance.Programming Languages: Python, SQL.Tools and Frameworks:Apache Nifi for data ingestionApache Airflow for process orchestrationAWS S3 for storage solutionsDremio as a Data Lake engineAWS Lambda Functions for serverless computingAWS Athena and Glue for querying and ETL Show less

Responsible for building, monitoring, and maintaining data pipelines.Key Tasks:Collecting data from various sources (relational and non-relational databases, structured and unstructured files).Transforming data as needed (cleaning, aggregation, validation).Storing data in databases or Data Lakes.Technologies: Python, Scala, Java, Go.Tools: Pandas, Spark, Kafka, AWS Big Data (EMR, Redshift, S3, Athena, Lambda, Glue), Prometheus, BigQuery.

Led and developed the customization of the Guidewire Gateway Portal for Agents, using AngularJS, HTML5, JavaScript, REST APIs, JSON, Gosu, and SQL Server.

Worked on integrating the Guidewire system with external systems using IBM Integration Bus, IBM MQ, and IBM Websphere as Middleware.

Developed and maintained features for a CRM and Billing system designed for telecommunications companies providing Pay TV and broadband Internet services.

Developed and maintained Business Process Management Systems (BPMS) and integration architecture (BPM & SOA). Led projects involving the redesign of service architecture for system integration and enhancements to the Fulfillment system (Order Management, Inventory, Provisioning, Service Activation) based on eTom, TAM, and SID frameworks (TMForum's Frameworx). Developed SOA applications with Java, exposed via Oracle Service Bus (OSB) or Aqualogic Service Bus (ESB), and deployed on Oracle… Show more Developed and maintained Business Process Management Systems (BPMS) and integration architecture (BPM & SOA). Led projects involving the redesign of service architecture for system integration and enhancements to the Fulfillment system (Order Management, Inventory, Provisioning, Service Activation) based on eTom, TAM, and SID frameworks (TMForum's Frameworx). Developed SOA applications with Java, exposed via Oracle Service Bus (OSB) or Aqualogic Service Bus (ESB), and deployed on Oracle Weblogic Application Server, ensuring code quality with Sonar and Continuous Integration with Atlassian Bamboo. Show less

Developed web systems for technical support and contract management with Front End in Adobe Flex 3 and Back End in Java JEE (Spring, Hibernate, Axis). Implemented XML file integrations with WebServices for fiscal documents and created user-friendly interfaces for small businesses using JSF, with databases including Oracle and PostgreSQL.

- Collaborating with senior developers to develop and maintain software applications- Writing clean and efficient code using Java programming language and related frameworks- Participating in code review and testing processes to ensure code quality and functionality- Learning new technologies and techniques related to software development- Assisting with troubleshooting and debugging issues in software applications- Working in a team environment to achieve project goals and… Show more - Collaborating with senior developers to develop and maintain software applications- Writing clean and efficient code using Java programming language and related frameworks- Participating in code review and testing processes to ensure code quality and functionality- Learning new technologies and techniques related to software development- Assisting with troubleshooting and debugging issues in software applications- Working in a team environment to achieve project goals and deadlines. Show less