Lead Data Infrastructure Engineer
Cupertino, California, Us
• Led a team of data engineers in developing and executing data engineering strategies to support business objectives. Provide mentorship, guidance, and direction to ensure the team's productivity, growth, and alignment with goals.• Oversee the design, implementation, and maintenance of data infrastructure and systems. Which Includes managing Compute, Storage, Network resources, Databases, data pipelines/ETL processes and data lakes.• Establish and enforce data quality standards, data governance policies, and best practices for data management. Ensure data accuracy, consistency, and security throughout the datalifecycle• Collaborated with cross-functional teams to design and deploy complex data pipelines, delivering actionable insights and automation for better business processes.• Work closely with data scientists, analysts, and other stakeholders to understand their data requirements, provide support, and help translate their needs into effective data solutions• Lead the successful migration project from in-house infrastructure to a Cloud-based instance. Built, tested, and deployed an Active-Active system for data infrastructure• Implement monitoring tools and practices to proactively identify and address issues with data pipelines and systems. Respond to incidents promptly to minimize downtime and data loss.• Led the integration of NoSQL databases, including MongoDB and Cassandra, into our data infrastructure. • Key Achievements : Established a Data Lake infrastructure capable of hosting diverse data sources, alongside implementing lifecycle policies. Implemented near real-time data use cases utilizing Apache Kafka and Pinot. Led team of engineers through seamless migration activities, encompassing in-house and cloud infrastructures. Architected a reporting infrastructure, enabling analytics and management users to receive timely insights and the pulse of critical data.