Data Engineer
- Focused on using Python, Hive, Pyspark, and Hadoop to streamline data extraction, transformation, and loading (ETL) processes, ensuring seamless data flow.- Utilized Airflow for advanced scheduling and management of data processing tasks, enhancing reliability and timeliness of executions. I have built close to 50 pipelines for different tasks and different branches (Localization, Marketing, automation and so on).- Developed automated pipelines utilizing Hive and Hadoop, significantly improving data ingestion and management systems that interacted not only with internal databases but also with external databases such as Snowflake.- Leveraged the robust data infrastructure to perform comprehensive analyses, drawing actionable insights for strategic decision-making using tools like Tableau.