Multimodal deep learning for biomedical data fusion: a review

Sören Richard Stahlschmidt, Benjamin Ulfenborg, Jane Synnergren

Briefings in Bioinformatics 2021 article cited by 750

importance 4/10 ai assisted Bioinformatics and Genomic Networks biomedical informatics stage: research

Biomedical data are increasingly multimodal, and researchers lack organized guidance on which deep learning fusion strategies to use.

Choosing fusion strategies well captures complex relationships among biological processes in health data.

Reviewed deep learning data fusion methods and proposed a detailed taxonomy; found deep fusion often outperforms unimodal and shallow approaches, with intermediate joint representation learning preferred.

Qualitative review finding: deep fusion strategies often outperform unimodal and shallow approaches.

Provides a taxonomy to guide fusion strategy choices in biomedical applications.

Venue Briefings in Bioinformatics
Published 2021
Work type article
Authors Sören Richard Stahlschmidt, Benjamin Ulfenborg, Jane Synnergren
Citations 750 (OpenAlex, at import time)
References 117
Model or method not stated in source
Organization not stated in source
Primary source https://doi.org/10.1093/bib/bbab569
Open access hybrid
Keywords multimodal, deep learning, data fusion, taxonomy, biomedical data
4 / 10

real but narrower advance

Review proposing a taxonomy of deep learning fusion strategies for biomedical data; a real but methodological, narrower advance; no scale stated.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Multimodal deep learning of fundus abnormalities and traditional risk factors for cardiovascular risk prediction
Yeong Chan Lee, Jiho Cha, Injeong Shim, Woong‐Yang Park, Se Woong Kang...
2023 107
10
2 Reliable Tuberculosis Detection Using Chest X-Ray With Deep Learning, Segmentation and Visualization
Tawsifur Rahman, Amith Abdullah Khandakar, Muhammad Abdul Kadir, Khand...
2020 651
10
3 A comparative analysis of machine learning classifiers for stroke prediction: A predictive analytics approach
Nitish Biswas, Khandaker Mohammad Mohi Uddin, Sarreha Tasmin Rikta, Sa...
2022 116
10
4 Cardiovascular Disease Diagnosis from DXA Scan and Retinal Images Using Deep Learning
Hamada R. H. Al-Absi, Mohammad Tariqul Islam, Mahmoud Ahmed Refaee, Mu...
2022 89
10
5 Proteomics and Machine Learning Approaches Reveal a Set of Prognostic Markers for COVID-19 Severity With Drug Repurposing Potential
Kruthi Suvarna, Deeptarup Biswas, Medha Gayathri J. Pai, Arup Acharjee...
2021 76
10