Llm Ops Engineer
– Streamlined data processing by automating Hindi Transcript cleaning and executing CTC segmentation through Nemo models, significantly optimizing operational procedures.– Conducted research and development to find a reliable evaluation metric for RAG (Retrieval Augmented Generation) evaluation.– Created a custom evaluation metric using LLM (Large Language Model) prompting for RAG evaluation.– Developed, assessed, and conducted benchmarks for three distinct RAG (Retrieval Augmented… Show more – Streamlined data processing by automating Hindi Transcript cleaning and executing CTC segmentation through Nemo models, significantly optimizing operational procedures.– Conducted research and development to find a reliable evaluation metric for RAG (Retrieval Augmented Generation) evaluation.– Created a custom evaluation metric using LLM (Large Language Model) prompting for RAG evaluation.– Developed, assessed, and conducted benchmarks for three distinct RAG (Retrieval Augmented Generation) architectures.– Used MLflow to build an end-to-end pipeline for benchmarking and hyperparameter tuning, ensuring efficient model development Show less