Sr Data Engineer
Current• Involving in designing building, and managing scalable data systems and pipelines to ensure the data accessible, reliable and usable across an organization.• Designing and implementing ETL/ELT pipeline to move and transform data from various sources into target data systems.• Build and automate workflows for batch and real-time data ingestion and processing.• Design and manage scalable, cost-efficient storage solutions for both structured and unstructured data.• Implement strategies for data backup, replication, and disaster recovery.• Process, cleanse, and transform raw data into meaningful formats for analysis.• Orchestrate complex workflows by combining different data services to ensure data pipelines run efficiently.• Responsible for secure data in transit and at rest, ensuring encryption and proper access control.• Responsible for role-based access control (RBAC) and data masking techniques.• Optimize data pipelines for speed, scalability and cost efficiency.• Implement data quality checks and ensure that data integrity is maintained.• Working closely with data scientists, analysts, and business stakeholders to understand data requirements.• Responsible for provision and manage the cloud infrastructure necessary for data engineering workloads.• Responsible for implementing data governance frameworks to ensure data consistency, accuracy and proper documentation.