Data Engineer
CurrentResponsabilities as Data Platform Engineer-Developed and managed data models and architecture for key Data Products.-Integrated and harmonized diverse data sources, ensuring consistency across Data Products.-Processed massive datasets (terabytes) utilizing technologies like PySpark, DuckDB, and Python.-Conducted in-depth data analysis with tools such as Pandas and Power BI.-Designed and optimized over 20 resilient Data Pipelines using ETL processes and orchestrated with Airflow.-Built and maintained scalable Data Infrastructure.-Deployed and administered Spark clusters, managing resources efficiently through Kubernetes.