Graduate Data Engineer
• Developed and maintained efficient data pipelines for ingestion, transformation, and loading of large and complex data sets into the Redshift data warehouse. • Worked closely with cross-functional teams to understand business requirements and translate them into technical specifications for data pipelines. • Assisted software developers and data analysts in their data initiatives, providing expertise and support. • Implemented industry best practices and standards to ensure… Show more • Developed and maintained efficient data pipelines for ingestion, transformation, and loading of large and complex data sets into the Redshift data warehouse. • Worked closely with cross-functional teams to understand business requirements and translate them into technical specifications for data pipelines. • Assisted software developers and data analysts in their data initiatives, providing expertise and support. • Implemented industry best practices and standards to ensure consistent data delivery architecture across the organization. • Utilized SQL (MySQL/PostgreSQL) and Python for data processing, scripting, and automation. • Streamlined data extraction, transformation, and loading processes using ELT/ETL tools and frameworks. • Leveraged tools such as Fivetran, Meltano, and dbt for efficient data ingestion, loading, and transformation into Redshift. • Implemented data quality checks and validation processes to maintain data accuracy and integrity. • Resolved issues related to data pipelines and data ingestion processes. • Stayed updated with the latest trends and technologies in data engineering, identifying opportunities for process improvement and optimization.• Collaborated with fellow data engineers and stakeholders to enhance data infrastructure and architecture. Show less