Principal Engineer(Co-Founder)
CurrentBuildling Liyuan AI, a music Music by integrating suno.ai and LLM. Generating music based on pre-generated voice or user-cloned voice via Singing Voice Conversion & Singing Voice clone and vocal isolation.Features:- Users can specify content and themes to generate music and lyrics, using LLM platforms like GPT-4 to generate lyrics and a custom rhyme checker to improve the quality of Chinese lyrics.- Users can sing along with the music, and the audio will be retained for Singing Voice Cloning.- By applying vocal isolation and Singing Voice Conversion to the music generated by suno.ai, the platform creates music sung by the user's voice.Infra involved:The LLM integration platform used in this project is opensourced at [Github](https://github.com/raceychan/askgpt)AskGPT is a production-ready Dstirbuted, multi-Tenant ML-OPS platform that enables businesses to leverage cutting-edge pre-trained language models like OpenAI's ChatGPT as well as various LLMs model, Support training local models using pre-trained language models such as OpenAI.TechStack: python, c++, FastAPI, postgresql, pulsar, redis, ray, huggingface, SVC, etc.- User and Auth management system, allowing one account for all remote and local model serving, making the model serving layer transparent to user.- Asynchronous IO, parallel computation (500 QPS with 35 model inference response per core). Model serving is done through ray+huggingface/pytorch, with fastapi used.