Multimodal survival prediction using TabTransformer and BioClinicalBERT on MIMIC-III
2024 (English)In: Proceedings - 2024 IEEE International Conference on Big Data, BigData 2024, Institute of Electrical and Electronics Engineers (IEEE) , 2024, p. 1986-1992Conference paper, Published paper (Refereed)
Abstract [en]
This paper explores the development and evaluation of a multimodal system for survival prediction in clinical settings, leveraging both structured electronic health records and unstructured clinical notes. The core objective is to enhance the accuracy and reliability of survival predictions in Intensive Care Units by integrating diverse data types through advanced machine learning models. The system combines the novel architecture of Tabular Transformers, adapted to process structured data such as patient demographics, medical history, and diagnoses, with Multi-Layer Perceptrons for text embeddings obtained from BioClinicalBERT, a specialized model for clinical narratives. These models' integration aims to capture the complex and multifaceted nature of patient profiles, thereby improving prediction performance. The finalized system, a Logistic Regression instance that aggregates the obtained predictions, demonstrates superior performance on evaluation metrics, highlighting the system's ability to identify high-risk patients. Comprehensive benchmarking against decision trees, standalone MLPs, and various configurations underscored the robustness of the proposed system. This research highlights the transformative potential of multimodal data integration in medical predictive modeling. Thus, medical professionals can guide their efforts and prioritization of patient care, enabling more efficient and targeted allocation of resources during triage.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. p. 1986-1992
Keywords [en]
Clinical Notes, Electronic Health Records, Multimodality, Survival Prediction, Tabular Transformers
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-360559DOI: 10.1109/BigData62323.2024.10826011Scopus ID: 2-s2.0-85218041072OAI: oai:DiVA.org:kth-360559DiVA, id: diva2:1940625
Conference
2024 IEEE International Conference on Big Data, BigData 2024, Washington, United States of America, December 15-18, 2024
Note
Part of ISBN 9798350362480
QC 20250226
2025-02-262025-02-262025-02-26Bibliographically approved