Algorithm Engineer
Current+ Research and development on algorithms for model training / interpreting compression and accelerating.+ Analyze model accuracy and performance after porting to a new platform.+ LLM inference accelerating methods like static KV cache / quantization / tensor parallel / speculative decoding.+ [Keras cv attention models](https://github.com/leondgarse/keras_cv_attention_models) - This project is the Keras / Tensorflow implementation of most SOTA CV models, also including ported Imagenet / COCO pre-trained weights, from other frameworks like PyToch / Jax / PaddlePaddle. Currently, most latest Imagenet model Tensorflow implementations in paperwithcode come from this project. - [Recognition models on Imagenet]. Such as FastViT, LCNet, CoAtNet, Uniformer. Most models are the only implementation for Keras on GitHub. - [Detection models on COCO]. Including EfficientDet, YOLOR / YOLOX / YOLOV8. As an improvement, realized the combination of any backbone + detection header + anchor loss. - [LLM models and CLIP training]. Including GPT2, LLaMA2 model architecture and CLIP training. - Other CV model like DDPM training / Stable Diffusion / Segment Anything model implementation. - [Model training]. Contains implementation of progressive training, token label training, model distillation and other advanced methods. - [PyTorch backend]. Supports using PyTorch as backend for Keras API, means a same model definition code can be used directly on TensorFlow or PyTorch.