Data Reliability Engineer - Specialist
CurrentA DRE has analogous characteristics to an SRE but focuses on the Big Data area, which includes both data engineering tools and data science and artificial intelligence tools. Some of my contributions at the Carrefour group include:Maintenance of an Environment with Hundreds of Petabytes Processed Monthly: Ensuring the efficiency and reliability of processing large volumes of data.Creation and Transcription of Infrastructure with IaC: Using tools like Terraform to automate and manage infrastructure effectively.Maintenance of Cloud Infrastructure Aligned with FinOps: Resulting in a 25% reduction in total cloud costs through efficient financial management practices.Autonomous Cloud Monitoring Agent: Implemented a monitoring system that reduced incidents due to a lack of computational resources, decreased costs, and initiated a self-healing environment capable of autonomously resolving production issues.CI/CD Structure for DataViz/Tableau: Increased dashboard loading speed and controlled BigQuery costs.CI/CD Structure for Data Engineer, DataViz, and Data Science: Improved the overall environment structure, increased data reliability, and kept costs under control.