Data Engineering Architect
CurrentDesign and implement data engineering cloud-based solutions to support the data needs of the supply chain processes.Building robust, scalable, and efficient data pipelines that collect, process, and transform data from various sources to provide valuable insights and support decision-making within the supply chain organization.Work closely with Stakeholders/Planners, data scientists, and data analysts to understand the supply chain requirements, design a scalable and optimized data architecture, and select appropriate data storage solutions, databases, data warehouses, and data integration technologies based on the client's requirements.Develop data integration strategies and ETL (Extract, Transform, Load) pipelines to consolidate and integrate data from various supply chain sources. Design data models representing supply chain processes and support efficient data storage in cloud, retrieval, and analytics. This may involve DataWareHose, DataLake, and Delta Lake.Architect solutions to handle real-time data streaming and processing for time-sensitive supply chain activities, such as inventory tracking, demand forecasting, and order fulfillmentEnsure data quality, reliability, and accuracy by implementing data validation, cleansing, and governance processes. Maintain data documentation and metadata to provide data lineage and transparency.Optimize data pipelines and processing workflows to improve performance, reduce latency, and minimize data processing costs.Work collaboratively with cross-functional teams, including data scientists, business analysts, supply chain managers, and IT professionals, to understand business requirements and deliver data-driven solutions.Support identifying and resolving data-related issues and performance bottlenecks in the data infrastructure.