Coles 2024 Ssc Graduate - 2Nd Rotation - Digital Search - Data Scientist/Machine Learning Engineer
Current- Implement and fine-tune bi-encoders for efficient text representation, enabling better query-document matching in search systems.- Develop and optimise language models (LLMs) for natural language understanding and generation in search applications.- Utilise deep learning frameworks (PyTorch, Hugging Face) and search technologies (Elastic Search, Vector Search) to support machine learning pipelines.- Use Azure cloud services for scalable model deployment, data storage, and orchestration of machine learning workflows.- Work with Databricks and PySpark for big data processing, feature engineering, and optimizing machine learning pipelines in a distributed environment.- Analyse large-scale data to evaluate model performance, conduct A/B testing, and drive continuous improvements in search algorithms.- Stay up-to-date with advancements in NLP, retrieval systems, and semantic search to integrate cutting-edge solutions.