Software Engineer (Backend, Ai)
CurrentWorking on developing an image engine, triton deployment, and optimization of models • Fine-tuning of 12B parameter model via the Lora technique. Improved inference time (latency) of the model by 11 times via Post-training quantization and quantization-aware training. Fusion of multiple Loras to improve creativity of the model. Made model compatible for serving requests via the Triton server.