As a Lead Data Engineer at UST, I have over 10 years of experience in IT industry, specializing in big data system design, data engineering, data pipelines, and data quality. I have successfully implemented data pipelines, data quality and governance practices for clients in the retail domain, healthcare domain, etc. I was also involved in designing and maintaining the enterprise and regional data lake for my clients.I have expertise in Hadoop and GCP big data platforms and frameworks, such as Spark, Hive, Sqoop, Google Cloud Storage, Google DataProc, and BigQuery. I also have proficiency in Python, Java, Spring, Hibernate, and SQL, as well as experience with Kafka, Airflow, and UC4 Scheduler. I am certified in Big Data Hadoop Foundations, Big Data Spark Foundations, and Big Data - Programming by IBM. I am adept at self-learning and adapting to new technologies quickly and efficiently. I work with teams across different time zones, following the Agile/Scrum software development methodology.