Arpan Jain Email & Phone Number

Redmond, Washington, United States

Redmond, Washington, United States

Part of Bing Ads in Microsoft AI. Worked on improving deep learning inference.

Columbus, Ohio, United States

1. Leading High-Performance Deep Learning project created by Prof. Panda.2. Characterize and Evaluate the performance of distributed DNN training for Deep Learning frameworks like TensorFlow, PyTorch, MXNet on GPUs as well as CPUs. 3. Explore new parallelization strategies for distributed training and co-design it with Deep Learning Frameworks like TensorFlow and communication middleware MVAPICH2 4. Performance Regression and sanity testing software stacks that are released periodically (MVAPICH2, MVAPICH2-X, MVAPICH2-GDR, and OMB).

Bellevue, Washington, United States

Working on High-Performance Deep Learning using DeepSpeed

California, United States

Livermore, California, United States

1. Implemented sub-graph parallelism for multi-branch deep neural networks like Transformers and ResNeXt.2. Proposed novel design for sub-graph parallelism and optimized data parallelism for Transformers3. Optimized communication in Hydrogen library for sub-graph parallelism and realized inter-grid communicationfor distributed matrices.4. Achieved better performance than Data Parallelism for in-core Transformer models.5. Paper accepted at IPDPS ’21

Columbus, Ohio Area

Columbus, Ohio Area

Gwalior Area, India

Bangalore

Doctor Of Philosophy - Phd, Computer Science, 4.0/4.0

Integrating Deep Learning and High-Performance Computing

Integrated Btech + Mtech, Information Technology, 8.76/10