Graduate Research Assistant
CurrentKey Achievements :-- Proposed a new concept "local minima at infinity" and new frameworks to study the landscape of noncoercive functions at infinity, and applied it to applications in machine learning, including artificial neural network and low rank matrix recovery.- Established global convergence of momentum method for smooth semialgebraic functions, relaxed two classical assumptions, globally Lipschitz gradient and coercivity, and improved the global convergence rate from O(1/√k) to o(1/k).- Implemented SGD and various types of momentum method on deep neural networks with different architectures using the same effective stepsize; the momentum method converged with a larger effective stepsize on 90% of experiments.- Presented and discussed state of art algorithms, analysis techniques and new research trends in an optimization study group with over 10 other researchers every month.