Robotics, Reinforcement Learning, Machine Learning, Computer Vision

machine learning for robot manipulation in the Nvidia Robotics Research Lab

Reinforcement learning for Robot Tasks with closed loop visuo-motor control

Part-time, I advise the team with on recent developments in deep reinforcement learning, provide guidance on algorithm implementation, and help vet deep learning candidates for recruiting.

--- RESEARCH ---Ph.D. Operations Research. Advisors: Ken Goldberg, Alper Atamturk, Pieter Abbeel, Laurent El Ghaoui, Jean PouliotThesis: Optimization and Design for Automation of Brachytherapy Delivery and Learning Robot-Assisted Surgical Subtasks M.S. Computer ScienceAdvisors: Ken Goldberg and Pieter AbbeelThesis: Autonomous Palpation for Tumor Localization: Design of a Palpation Probe and Gaussian Process Adaptive Sampling--- TEACHING ---* Worked with Prof. Lee Schruben on IEOR 131 in Spring 2016 Simulation of Stochastic Systems* Worked with Prof. Ken Goldberg on IEOR 115 in Fall 2013, Spring 2013. Fall 2011Industrial and Commercial Database SystemsIntroduces databases in SQL and MS Access with projects involving real world small/medium enterprise clients needing insights from their data. *Worked with the Dr. Ron Lensiak on IEOR 191 in Fall 2012.Entrepreneurship and Technology Class aimed at Berkeley Seniors. Aimed to encourage entrepreneurship with a very good product backed with a sound business plan replete with marketing, legal, sales, hiring and other aspects of running a new business.

Projects:1. Control System design for a anthropomophic robot, Golem Krang.Further analysis of failure models for the robot to design a real-time robot state identification system.2. Worked on a Boeing large scale localization and navigation problem in a environment with little or no visual cues.3. Modeled a Computer Vision algorithm for tracking and segmentation in video using combinatorial optimization.

Worked in Control and Instrumentation department of the plant. Badarpur Thermal Power Station(or BTPS) is the coal based thermal power generation plant. Besides studying the power generation process, I analyzed the PLC (Siemens) and the logic in use for real time monitoring and control

Worked on PLC systems in the plant for automatic Mixing Processes involving composites used alongside rubber in tyre manufacturing. Furthermore learn ladder-logic programming for the systems in the plant of Schneider and Siemens make.