Data Engineer
CurrentI work with Airflow, creating and maintaining this environment in Kubernetes.I develop and maintain ETLs using Python and DuckDB, running on a Kubernetes cluster, with storage in S3 and Redshift as the analytical database.I lead a team of data engineers in the architecture and implementation of a Data Lake, using SCD Type 2 for data versioning.I use Python, Kubernetes, S3, and Redshift as the analytical foundation to provide scalable and efficient solutions for processing large… Show more I work with Airflow, creating and maintaining this environment in Kubernetes.I develop and maintain ETLs using Python and DuckDB, running on a Kubernetes cluster, with storage in S3 and Redshift as the analytical database.I lead a team of data engineers in the architecture and implementation of a Data Lake, using SCD Type 2 for data versioning.I use Python, Kubernetes, S3, and Redshift as the analytical foundation to provide scalable and efficient solutions for processing large volumes of data. Show less