Lead a team of data engineers in designing and implementing data pipelines using Kafka, Spark, and Hive, resulting in a 30% increase in data processing efficiency.Collaborate with cross-functional teams to design and implement containerization strategies using Docker, achieving 25% cost savings on infrastructure.Provide technical guidance and mentorship to junior consultants, enhancing their knowledge of big data technologies and best practices.Analyze and optimize Hue dashboards for real-time monitoring of data pipelines, resulting in a 15% reduction in unplanned downtime.Define and implement resource utilization metrics, improving infrastructure efficiency by 30% and reducing operational costs.Actively participate in client meetings to understand business requirements, propose technical solutions, and contribute to project planning and estimation processes.Supported and monitored big data issues using Cloudera and Hadoop cluster, resolving P5, P4, and P3 priority tickets within SLA.Implemented modern data warehousing techniques, optimizing data extraction, transformation, and loading processes, resulting in a 20% improvement in query performance.Leveraged AWS cloud services to design and implement scalable and cost-effective big data solutions, reducing infrastructure costs by 15%.Conducted Hive query optimization, enhancing query execution time by 30% and improving overall system performance.Designed and implemented dashboard monitoring for unplanned downtime, enabling proactive identification and resolution of system issues.Collaborated with cross-functional teams to upgrade Cloudera CDH 5.16 to CDH 6.2.3, ensuring minimal disruption to ongoing projects and achieving seamless migration.Conducted regular performance tuning of Hadoop clusters, optimizing resource allocation and reducing job execution time by 25%.Developed and maintained technical documentation and knowledge base, enabling efficient knowledge transfer and onboarding of new team members.Assisted in capacity planning and forecasting, ensuring scalability and performance optimization for upcoming projects.Actively participated in training programs and workshops to enhance technical skills and stay updated with the latest trends in big data and cloud technologies.