Designed and implemented data pipelines on AWS cloud and Azure cloud. Worked on Hadoop, Sqoop, Hive, Spark with Scala, and NoSQL technologies.Developed and maintained data warehouses and analytical systems for business intelligence and data analysis purposes.Optimized data pipelines for performance, scalability, and reliability.Worked with cross-functional teams to understand their data needs and provide data solutions that met their requirements.Conducted data modeling, data architecture, and data integration activities to support the development of new data products and features.Collaborated with data scientists to integrate machine learning models into production systems.Developed and maintained ETL workflows using Unix shell script and python technology. Assisted in troubleshooting and resolving data-related issues.Conducted data modeling, data architecture, and data integration activities to support the development of new data products and features.Assisted in troubleshooting and resolving data-related issues.Skills:DatabricksAWS / Azure cloudHadoopDocker, KubernetesHive, SqoopSpark with ScalaNoSQLPythonSQLUnix shell scriptUC4 technology