Data Engineer with over 15 years of experience in distributed computing and cloud environments, specializing in the development of efficient pipelines and the management of data lakes, data lakehouses, and data warehouses. Expertise includes SQL, Python, Spark, and Shell Scripting, as well as cloud platforms such as AWS (certified) and Azure. With more than 10 years of experience in Tableau Desktop and Tableau Server, there is a strong focus on delivering powerful data visualizations and strategic insights.Proficient in Docker, creating scalable and replicable environments, with experience in databases like PostgreSQL, MySQL, MS SQL, and MariaDB, as well as tools such as Hive and Trino for fast and efficient queries. Additional knowledge includes Linux OS and Pentaho, enabling the orchestration of complex ETL processes.Business Intelligence solutions are integrated with tools like Tableau and Pentaho to transform data into strategic insights for sectors such as education, logistics, retail, healthcare, finance, and technology. The use of Apache Airflow optimizes ETL orchestration, while agile methodologies like Scrum streamline the development and delivery of data solutions, promoting a data-driven culture.Data governance practices are applied to ensure high-quality data cataloging and prevent silos, with the use of Open Metadata further enhancing governance and data quality. Expertise in CI/CD with GitHub and SSH keys ensures a secure workflow, with clear and accessible documentation through MkDocs.Solid experience with AWS, Minio, and Azure ensures the creation of scalable solutions aligned with market trends and technological demands. As a mentor and co-founder of tech initiatives, there is active participation in developing new talent and advancing data engineering as a strategic pillar within organizations.Skills: Pentaho, Apache Spark, PySpark, Delta Lake, Apache Airflow, Tableau, Power BI, Data Lakehouse, Data Warehousing, Minio, Hive, Trino, Python, SQL, Shell Scripting, Amazon Web Services (AWS), Azure, Docker, CI/CD, Git, Jenkins, Scrum, Agile Methodologies, PostgreSQL, MySQL, MS SQL, Linux
Listed skills include Microsoft Sql Server, Pl/Sql, Business Intelligence, Data Warehousing, and 11 others.