Luiz Machado Email & Phone Number

Rio De Janeiro, Rio De Janeiro, Brazil

• Created standard methods for complex transformations in ETL processes for multiple tables, generating a single source of truth and simplifying maintenance• Enhanced Apache Hudi’s schema evolution by developing a Lambda function that enables the same behavior in AWS Glue• Developed a restructuring plan for a 40+ TB data lake architecture to enable better data governance and prevent data replication

Rio De Janeiro, Rio De Janeiro, Brazil

• Created and automated unit tests for an internal Python library, establishing CI/CD workflows in AWS• Translated complex stored procedures and business rules into PySpark scripts, streamlining data processing• Enforced MFA usage by configuring IAM rules within an AWS account, significantly enhancing security• Optimized AWS EMR cluster sizing, adhering to AWS best practices, achieving a 20% cost reduction• Utilized Apache Hudi’s diverse write operations to optimize data loading times while preserving historical snapshots

Rio De Janeiro, Rio De Janeiro, Brazil

• Built PySpark pipelines in AWS EMR for large-scale data processing, improving efficiency and reducing data retrieval times• Contributed to the development of a custom ETL management tool, streamlining and automating data processing• Enabled efficient ad-hoc querying and analysis by integrating AWS Athena with large data volumes in AWS S3• Automated data processing and transformation workflows using Apache NiFi, optimizing data flow• Securely managed access to AWS resources using IAM, ensuring a secure AWS environment

Rio De Janeiro, Rio De Janeiro, Brazil

• Built data pipelines using PySpark on GCP Dataproc• Deployed GCP infrastructure using Terraform, automating environment setup and management• Developed automated alerts to ensure data integrity and reliability• Worked closely with client in order to understand business requirements• Continuously enhanced and optimized code, improving product delivery quality

Niterói, Rio De Janeiro, Brazil

• Developed a JAMstack-based website• Created and customized an online store in JavaScript and CSS• Planned and delegated tasks• Created a knowledge base• Analyzed and optimized internal processes• Implemented an agile methodology• Managed contact with service providers• Developed and implemented an operational cost reduction plan• Assisted in developing a visual identity and in its application• Negotiated commercial partner deals

Bachelor'S Degree, Agricultural And Environmental Engineering

High School Diploma, Information Technology