Data Engineer Ii
CurrentAs a seasoned data engineer, I’ve honed my skills in managing, structuring, and analyzing complex datasets. In this role at Afiniti, I've had the privilege of working for clients such as Virgin Media, Comcast, Sky Group (UK), AT&T Mexico, T-Mobile, SFR (France), AA Insurance, Claro Colombia, and Enel. I'm skilled in in SQL, Python and other relevant technologies. Main responsibilities:Key Responsibilities:- Data Modelling:* Develop and maintain logical and physical data models for the data warehouse.* Design and implement data structures that support reporting and analytics requirements.* Collaborate with data analysts and business stakeholders to understand data requirements, and deliver actionable insights * Proficient in star schemas and snowflake models.- Data Integration:* Experience designing and building complete ETL processes moving and transforming data for ODS, Staging, and Data Warehousing* Optimize data integration processes for performance and reliability.* Utilizing ad-hoc techniques to perform on-the-fly analysis of data* Hands on Experience with open source software platforms (Linux)* Troubleshooting data integration issues* Experienced in Agile development processes* Experience working with Stored Procedures- Data Pipeline Management:* Design and maintain data pipelines that support real-time data ingestion and processing.* Ensure data quality and consistency throughout the pipeline.* Monitor and optimize data pipeline performance.- Data Warehouse Design:* Design and maintain the overall data warehouse architecture.* Implement and maintain data governance policies and procedures.* Ensure data security and privacy compliance.- Cross-Functional Collaboration:* Work closely with data analysts, business stakeholders, and other technical teams to understand data needs and requirements.* Collaborate with software engineers to ensure that data integration and reporting requirements are incorporated into development projects