As a Graduate Research Assistant, I was fortunate enough to be involved in 2 papers, my primary work being “Rating-based Reinforcement Learning” which was accepted to AAAI 2024 and The Many Facets of Preference-Based Learning workshop at ICML 2023. I also was the primary programmer for “Deep Reinforcement Learning-based Optimal Time-constrained Intercept Guidance” which was accepted into AIAA Guidance, Navigation and Controls Conference. During this time, I led a team of 4-5 students to… Show more As a Graduate Research Assistant, I was fortunate enough to be involved in 2 papers, my primary work being “Rating-based Reinforcement Learning” which was accepted to AAAI 2024 and The Many Facets of Preference-Based Learning workshop at ICML 2023. I also was the primary programmer for “Deep Reinforcement Learning-based Optimal Time-constrained Intercept Guidance” which was accepted into AIAA Guidance, Navigation and Controls Conference. During this time, I led a team of 4-5 students to conduct research experiments utilizing ratings as well as preferences. I was the primary programmer for the project, taking feedback from results and implementing improvements for the algorithm. I help design and conduct an IRB approved user study to compare the user experience when using preferences and ratings. I also assisted with mentoring 7 students in the Unmanned Systems Lab to understand concepts such as classification, object detection, reinforcement learning and human guided reinforcement learning. This research was conducted under the supervision of Dr. Yongcan Cao of the University of Texas at San Antonio College of Engineering and Integrated Design. Show less

This is a continuation of the research that was being conducted in the Fall of 2021. In this role, I continue to present to technical and non-technical audiences, and assist incoming students on the project. My main role in this position is programming lead where I identify potential improvements within the code and implement changes to improve on results. The code is written in Python and uses TensorFlow, Keras, Numpy, Pandas and Matplotlib. This research was conducted under the supervision of… Show more This is a continuation of the research that was being conducted in the Fall of 2021. In this role, I continue to present to technical and non-technical audiences, and assist incoming students on the project. My main role in this position is programming lead where I identify potential improvements within the code and implement changes to improve on results. The code is written in Python and uses TensorFlow, Keras, Numpy, Pandas and Matplotlib. This research was conducted under the supervision of Dr. Yongcan Cao of the University of Texas at San Antonio College of Engineering and Integrated Design. Show less

Throughout the Fall of 2021, I worked on identifying and implementing novel methods for Reinforcement Learning using human preferences. My responsibilities consisted of gathering/providing preferences, contributing to the programming, creating introduction materials for incoming students, and giving technical and non-technical presentations for our research. The code was written in Python using TensorFlow. This research was conducted under the supervision of Dr. Yongcan Cao of the University of… Show more Throughout the Fall of 2021, I worked on identifying and implementing novel methods for Reinforcement Learning using human preferences. My responsibilities consisted of gathering/providing preferences, contributing to the programming, creating introduction materials for incoming students, and giving technical and non-technical presentations for our research. The code was written in Python using TensorFlow. This research was conducted under the supervision of Dr. Yongcan Cao of the University of Texas at San Antonio College of Engineering and Integrated Design. Show less

Throughout the Summer of 2021, I learned about the key components of Artificial Intelligence and attended lectures from leading researchers in the Artificial Intelligence field. I learned a foundation in Python, Machine Learning, Neural Networks, Deep Learning and Reinforcement Learning by attending various workshops for each topic. In the program I also began the research that I would continue to work on in my Undergraduate Research Assistant role and assisted others by providing learning… Show more Throughout the Summer of 2021, I learned about the key components of Artificial Intelligence and attended lectures from leading researchers in the Artificial Intelligence field. I learned a foundation in Python, Machine Learning, Neural Networks, Deep Learning and Reinforcement Learning by attending various workshops for each topic. In the program I also began the research that I would continue to work on in my Undergraduate Research Assistant role and assisted others by providing learning materials either I had found or that I had created for myself. This provided me with an understanding of how to approach problems in a different way as well as how to work with a small team to achieve a goal. This program was funded by the National Science Foundation and the Department of Defense for the Research Experiences for Undergraduates at the University of Texas at San Antonio. I worked on the Robotic Behavior Learning From Human Demonstrations project under the supervision of Dr. Yongcan Cao. Show less