Yu-Fu Liu Email and Phone Number

Develop an optics software which only needs a few clicks to generate commercial lens designs. Moreover, it aims to assist optics engineers at work. Lens Design Extrapolating ● Processed and augmented more than two hundred kinds of lens sequences to a large dataset ● Utilized semi-supervised learning and Deep Learning models to generate lens designs (regression task) ● Customized unsupervised loss function with Ray Tracing ● Adapted automatic hyper-parameter tuning to model training (AutoML) ● Created tools for lens system visualization and evaluation ● The RMS spot size of generated lens design achieved 0.0001

Work on ML/DL algorithms research and development in VR/AR and adapt them to our products with Python for real-time applications. Also use C++ for micro-controller/sensor development and computer networking.Body Pose Tracking (Human Motion Estimation)• Processed AMASS datasets and transformed to axis angle, rotation matrix, and 6D representation.• Utilized Text2Motion to synthesize motion clips by text descriptions for data augmentation.• Used a generative model (Diffusion Model) to predict pose (rotation and orientation).• Adapted physics features for optimizing our model performance.• Blended predicted poses with an SMPL model to visualize avatar with motions.Hand Gesture Recognition • Integrated EMG and IMU sensors into the Arduino, and transmitted data via TCP/IP or BLE.• Collected, labeled, pre-processed, and visualized 40+ subjects' data.• Utilized a MobileNet to reach a testing accuracy of 97% for four-gesture classification.• Used transfer learning and few-shot learning to customize new gestures.• Applied for a patent for our hand gesture recognition mechanism and applications.Conducted some tests and experiments for HMD system development by using tool scripts and ADB