Data Scientist
Current• Developed a modular architecture based on the functional core and imperative shell pattern for a RAG application, enabling seamless integration of new frameworks.• Optimized LLM fine-tuning workflows by creating an AWS SageMaker script for finetuning various large language models (LLMs) for short text generation using QLoRA.• Built scalable cloud solutions on AWS, including ETL pipelines using Glue, Step Functions, and Lambda, infrastructure provisioning with CloudFormation, and data exploration with Athena.• Managed and evaluated machine learning models using Databricks MLflow, incorporating advanced techniques such as utilizing LLMs for evaluation.• Ensured high code quality standards by implementing pre-commit hooks, linters, and comprehensive testing methodologies, including BDD, TDD, and integration tests.