Nlp Engineer
SQL Auto-Generation Large Model PlatformResponsible for training the SQL large model and prompt engineering based on the DIN-SQL framework. 1. Data preparation includes self-structured and manually annotated data, as well as open-source data (Spider). The data format consists of (Question, Schema_links, Step_by_Step, final SQL). Route prompts include general questions, easy prompts (simple SQL without join), mid prompts (two-table join), and hard prompts (multiple table join).2.Model training involves using CodeLLama34b for LoRA training, covering tasks such as route classification, SQL generation, and general text generation.3. Model deployment utilizes TGI and VLLM frameworks for routing user questions (non-SQL/easy/mid/hard), generating schema_links (containing fields and join relationships used in SQL), and finally incorporating the generated results into prompts to produce the final SQL