Research Dl Engineer
Moscow, Moscow City, Russia
1. I have developed a semi-supervised approach towards labeling subset of events using GPT-4 model. In the medical background, the patient's medical history and analysis are described using a sequence of ICD-10 codes (International Classification of Diseases, Tenth Revision) and codes specifically representing the patient's conducted analyses - LOINC codes (https://loinc.org). For example, for a patient diagnosed with chronic kidney failure (dis-N18), who then underwent an analysis for the T3/T4 ratio (l-701254) - see https://loinc.org/70152-4, and subsequently diagnosed with type 1 diabetes with kidney issues (dis-E102), the sequence would be "dis-N18 l-701254 dis-E102". That is, for each patient with their history of events, it is necessary to develop a neural embedding to capture the transitional boundaries between clusters of different patients.2. I have developed a model based on the Transformer architecture, in which positional embeddings have been removed, and layers have been modified to reduce the number of parameters to less than 6 million. Trained using triplet loss with a specified margin, the model yielded several unexpected discoveries and, as a result, outperformed the pretrained GloVe model significantly. Visually, the final (2D) clustering allowed for implicit learning of transitive features among clusters, consequently enabling more accurate predictions of transitions from one disease cluster to another.