Data Engineer
CurrentI specialize in developing Python code to systematically ingest data from diverse sources, employing advanced tools such as Meltano to ensure a seamless and comprehensive process. I orchestrate these data pipelines efficiently using Airflow, ensuring optimal reliability and efficiency in the workflow.My expertise goes beyond data ingestion, as I actively contribute substantial value to the data warehouse. I specialize in modeling new data sources using Snowflake, tapping into its robust capabilities to enhance the overall data architecture. Simultaneously, I utilize dbt to refine and optimize existing models, thereby making a significant impact on the project's success.Key Highlights:- Data Warehouse Architect: Leading the design and construction of a robust company Data Warehouse using Snowflake and dbt.- E2E ETL Pipeline Developer: Building seamless ETL pipelines from source to destination using Python and Meltano.- Workflow Orchestration: Leveraging Airflow to orchestrate workflows, ensuring optimal reliability and efficiency.- AWS and Technology: Proficiently utilizing various AWS tools and complementary technologies like Astronomer and Docker to enhance project capabilities.