Undergraduate student researcher at Parallel Intelligence Team, State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences.Our Project: Multimodal Foundation Model for Intelligent Cooking AssistanceThe Parallel Intelligence Team at the State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences is developing an intelligent dining platform that aims to explore unseen possibilities in dining industry. Our project focuses on building a multimodal model on base of LLaVA that can understand user queries and provide interactive, informative, and multimodal cooking recipes. The model is designed to integrate with robotic systems capable of automatically executing cooking instructions, functioning as self-agents. The ultimate goal is to make all functionalities accessible through a user-friendly web or mobile application.My Responsibilities:- Contributed to the software development of the intelligent dining platform, including system design and implementation, to ensure a seamless user experience and efficient functionality.- Participated in the development of the multimodal foundation model by enhancing its capabilities to understand and generate input and output in various modalities, building upon the existing LLaVA architecture.- Assisted in the integration of robotic systems with the multimodal foundation model by developing and training models that enable the robots to interpret and execute cooking instructions accurately.Collected, annotated, and organized data to train and improve the performance of the multimodal language model, ensuring its ability to provide accurate and helpful cooking assistance.- Collaborated with the team to design reward and incentive mechanisms for the intelligent dining platform, encouraging user engagement and contributions to further enhance the platform's capabilities.

- Responsible for overseeing daily operations, event planning and execution, and sponsorship coordination with businesses. Led and facilitated numerous campus and intercollegiate initiatives.

- Tasked with the strategic recruitment and leadership of the union's core team members, overseeing the allocation and management of tasks and project groups. - Spearheaded collaborations in 2023 with the Los Angeles Chinese Chamber of Commerce and municipal leaders from Boston, Duarte, and San Gabriel. These efforts culminated in the successful orchestration of over 10 community engagement events, designed to facilitate the societal integration of international students.

-Collaborated with China National Petroleum Corporation (CNPC), developed machine learning models, contributing to the creation and evaluation of more than five deep learning models with TensorFlow to optimize facilities management and repairs.-Conducted data preprocessing and analysis, manipulating and cleaning large datasets using Pandas and NumPy to prepare for modeling, and illustrated over 15 key data trends and insights through Matplotlib visualizations.