Every hospital records its patients’ stories in its own dialect. One electronic medical record system may store a diagnosis as “acute MI,” another as “myocardial infarction, ST-elevation,” and a third as a free-text note buried in a physician’s narrative. For researchers hoping to pool data across institutions, this inconsistency is one of the most stubborn obstacles in medical informatics. A team of South Korean researchers now reports a machine learning approach that translates messy, real-world diagnosis text into the standardized vocabulary of SNOMED-CT — and their model achieves an accuracy of 0.934 across 273 clinical classes, rivaling state-of-the-art systems while offering a new window into how medical language lives inside the hidden mathematical spaces of language models.

The study, conducted by Sungsu Oh and Hyunsu Lee of Pusan National University’s Department of Physiology together with neurosurgeons In Ho Han, Jae Il Lee, and Byung Kwan Choi of Pusan National University Hospital, was published in Medical & Biological Engineering & Computing. The work tackles a problem that has plagued health informatics for decades: electronic medical record systems are heterogeneous by design, shaped by local workflows, billing requirements, and clinical habits. When hospitals want to collaborate — whether for multi-site clinical trials, epidemiological surveillance, or artificial intelligence development — their data must first be normalized onto a common clinical ontology. SNOMED-CT, the Systematized Nomenclature of Medicine—Clinical Terms, is the most comprehensive such ontology in existence, but mapping free-text diagnoses to its precise concepts has traditionally required laborious manual coding or brittle rule-based systems.

The Korean team’s strategy begins with ClinicalBERT, a variant of the BERT transformer architecture that has been pretrained on clinical text, giving it an innate familiarity with the abbreviations, fragments, and idiosyncrasies of physician prose. Rather than treating diagnosis classification as a pure text-labeling task, the researchers framed it as a problem of geometry. They trained ClinicalBERT on electronic medical record data to produce latent representations — dense numerical vectors — for spans of text corresponding to diagnoses. In parallel, they encoded the fully specified names, or FSNs, of SNOMED-CT concepts: the ontology’s unambiguous, self-describing labels such as “myocardial infarction (disorder).” The goal of the fine-tuning stage was to pull these two families of vectors toward one another in the embedding space, so that the vector for a hospital’s idiosyncratic diagnosis text would land close to the vector for its correct SNOMED-CT concept.

The alignment was accomplished through mean squared error-based fine-tuning, a loss function that penalizes the squared distance between the EMR-derived diagnosis embeddings and their target SNOMED-CT FSN embeddings. This is a conceptually elegant move: instead of asking the model to memorize a lookup table of diagnoses, the researchers asked it to reshape its internal geometry so that semantic equivalence becomes spatial proximity. Once the alignment was complete, the resulting latent representations were fed into a downstream classification model that assigns each diagnosis span to one of 273 SNOMED-CT classes.

The performance numbers are striking. The proposed model achieved an accuracy of 0.934, a weighted F1-score of 0.923, and a macro-averaged F1-score of 0.823 across the 273 classes. The gap between the weighted and macro scores reflects a familiar reality of clinical data: some diagnostic classes appear far more frequently than others, and models naturally excel at common conditions while struggling with rare ones. A macro-averaged F1 above 0.82 nevertheless indicates that the model maintains strong performance across the board, not merely on the frequent diagnoses that dominate hospital records.

Perhaps the most thought-provoking finding, however, is what the fine-tuning did not do. Despite measurably improving semantic alignment in the embedding space, the fine-tuned model performed roughly on par with the base, unmodified ClinicalBERT when it came to the downstream classification task. Both remained competitive with dedicated biomedical entity-linking systems — SapBERT, which achieved an accuracy of 0.944 in the comparison, and BioSyn, at 0.931. This apparent paradox — better alignment, similar classification — is one of the study’s central insights. The researchers analyzed the latent representations directly, examining how diagnosis vectors were distributed before and after fine-tuning, and found that the fine-tuned model exhibited reduced similarity distances and more distinct class separation. Fine-tuning reduced the average Manhattan distance between paired representations by 36.2 percent and the average cosine distance by 53.1 percent, evidence that the embeddings had indeed converged toward their ontological targets.

In other words, the geometry of the latent space became cleaner and more semantically coherent, even if the final classification accuracy did not climb. The authors suggest that base ClinicalBERT, having been pretrained on large volumes of clinical text, already encodes much of the structure needed for discrimination, and that MSE-based alignment improves the interpretability and organization of the space without necessarily adding discriminative power. This trade-off between semantic alignment and discriminative performance is a subtle but important consideration for anyone designing medical NLP systems: a model whose embeddings cluster cleanly by concept may be more useful for retrieval, normalization, and cross-dataset integration even when its headline accuracy is unchanged.

The implications reach beyond a single hospital’s coding workflow. Medical concept normalization is a foundational enabling technology for the secondary use of health data — the practice of reusing clinical records for research, quality improvement, and public health. Studies have documented both the enormous opportunity and the serious technical and privacy barriers involved. Manual coding is expensive and inconsistent; rule-based systems fail when clinicians invent new abbreviations; and naive deep learning classifiers trained at one institution often collapse when deployed at another, where documentation habits differ. An embedding-based approach that explicitly anchors diagnoses to SNOMED-CT fully specified names offers a path toward models that transfer more gracefully, because the anchor points are institution-independent.

Privacy considerations loom large in this domain, and the Korean team’s approach has advantages here as well. Because the model operates on diagnosis spans rather than whole patient records, and because the data used to train it were de-identified retrospective records — a design approved by the Institutional Review Board of Pusan National University Hospital, with informed consent waived for the de-identified data — the pipeline is compatible with privacy-preserving deployment. The authors describe the method as having strong potential for scalable, privacy-preserving medical concept normalization in real-world clinical environments. Notably, the trained artifacts are embeddings and classifiers rather than raw patient data, meaning institutions could in principle share model components without sharing records — a property that aligns with the growing movement toward federated and privacy-conscious health AI.

The study also contributes to a rapidly maturing field. Automated medical coding has seen an explosion of deep learning approaches in recent years, with transformer models applied to ICD-10 and SNOMED-CT coding tasks across multiple languages and healthcare systems. Comparisons in this literature are notoriously difficult because datasets, class counts, and annotation standards vary widely; by benchmarking directly against SapBERT and BioSyn, two widely cited biomedical representation models, the Pusan National University team situates their result within a recognizable landscape. Their 0.934 accuracy sits within roughly one percentage point of SapBERT’s 0.944, achieved with a straightforward MSE alignment strategy rather than specialized contrastive pretraining.

There are caveats, as with any machine learning study in medicine. The model was trained and evaluated on data from a single hospital network, and while 273 SNOMED-CT classes is a substantial label space, it is a small fraction of the ontology’s several hundred thousand concepts. Rare diagnoses, ambiguous abbreviations, and multilingual clinical text all remain open challenges. The authors also emphasize that the observed tension between semantic alignment and classification performance deserves further study — future work may find alignment objectives that improve both properties simultaneously, or demonstrate that better-aligned embeddings pay off in downstream tasks beyond classification, such as cross-lingual normalization or retrieval-augmented clinical decision support.

Still, the work represents a meaningful step toward a long-promised vision: hospital data that can travel. When a diagnosis written in a Busan emergency department can be automatically and reliably expressed in the same standardized language as one written in a Baltimore clinic, the foundations for multi-institutional research, fairer AI training datasets, and population-scale health insights become dramatically more accessible. The Korean team’s results suggest that the key may lie not just in better classifiers, but in sculpting the hidden geometric spaces where machines understand medicine — one embedding at a time.

Subject of Research: Automatic mapping and classification of diagnosis text in electronic medical records to SNOMED-CT concepts using ClinicalBERT latent representations for improved medical data integration.

Subject of Research: Technology and Engineering

Article Title: Diagnosis classification in EMR data using latent representations and SNOMED-CT mapping for improved medical data integration

Article References: Oh, S., Han, I. H., Lee, J. I., Choi, B. K., & Lee, H. (2026). Diagnosis classification in EMR data using latent representations and SNOMED-CT mapping for improved medical data integration. Medical & Biological Engineering & Computing. https://doi.org/10.1007/s11517-026-03654-5

Image Credits: AI Generated

DOI: 10.1007/s11517-026-03654-5

Keywords: Electronic medical record, SNOMED-CT, ClinicalBERT, Medical concept normalization, Diagnosis classification, Latent representations, Semantic alignment, Health informatics, Medical data integration, Natural language processing

Cite Scienmag News
APA MLA Chicago

Ophelia Keating. (September 9, 2026). Latent representations and SNOMED-CT mapping improve diagnosis classification in EMR data. Scienmag. https://scienmag.com/latent-representations-and-snomed-ct-mapping-improve-diagnosis-classification-in-emr-data/

Copy citation Download RIS

Tags: AI accuracy in medical diagnosisclinical data interoperabilityclinical data normalizationdeep learning for medical codingdiagnosis classificationdiagnosis classification in EMRselectronic health record interoperabilityelectronic medical record standardizationEMR data pooling challengesEMR data standardizationhealthcare data heterogeneityheterogeneity in EMR systemsmachine learning in healthcaremedical informaticsmedical language embedding spacesmedical language embeddingsmedical language translationmultilingual medical recordsnatural language processing in medicineSNOMED-CT mapping