Data Engineer
CurrentData Pipeline Development: Build, maintain, and optimize scalable data pipelines for ingesting, processing, and transforming large datasets using Azure Data Factory, Databricks, or Synapse Analytics.Database Management: Design and implement relational and non-relational databases on Azure SQL, Cosmos DB, or SQL Server for optimal storage and access of structured and unstructured data.ETL/ELT Processes: Develop and maintain robust ETL (Extract, Transform, Load) or ELT processes to ensure data consistency, accuracy, and availability across systems.Data Warehousing: Architect and manage data warehouses on platforms like Azure Synapse to ensure efficient data storage and retrieval for advanced analytics and reporting.Cloud Integration: Collaborate with cross-functional teams to integrate cloud-based solutions such as Azure Data Lake and Azure Blob Storage to streamline data access and processing.Data Security and Compliance: Ensure data governance, security, and privacy by implementing best practices in data encryption, access control, and compliance with regulations like GDPR and HIPAA.Collaboration and Stakeholder Management: Work closely with business analysts, data scientists, and engineers to deliver reliable data solutions that meet business objectives and performance requirements.Automation and Optimization: Identify opportunities for automation in data workflows, and improve the performance of existing processes by optimizing resource utilization and minimizing latency.Monitoring and Troubleshooting: Monitor data pipeline health, debug failures, and implement automated alerts to proactively address potential issues before they impact business operations.