Distilling large language models for matching patients to clinical trials

Mauro Andrés Nievas Offidani, Aditya Basu, Yanshan Wang, Hrituraj Singh

Journal of the American Medical Informatics Association 2024 article cited by 67

importance 5/10 ai assisted Artificial Intelligence in Healthcare and Education clinical trials stage: research mixed

Matching patients to clinical trials requires analyzing eligibility against complex inclusion and exclusion criteria, which is slow and hard to scale.

Poor trial matching slows enrollment and limits patient access to new treatments.

LLMs analyzed patient eligibility against trial criteria; open-source LLMs were fine-tuned on a GPT-4-generated synthetic dataset and evaluated with automated and human-centric assessments.

Fine-tuned open-source LLMs achieved performance parity with proprietary counterparts such as GPT-3.5.

Evidence supports LLM feasibility for trial matching, with fine-tuned open-source models matching proprietary ones.

Venue Journal of the American Medical Informatics Association
Published 2024
Work type article
Authors Mauro Andrés Nievas Offidani, Aditya Basu, Yanshan Wang, Hrituraj Singh
Citations 67 (OpenAlex, at import time)
References 24
Model or method GPT-3.5, GPT-4, LLaMA 7B/13B/70B
Organization not stated in source
Primary source https://doi.org/10.1093/jamia/ocae073
Open access green
Keywords large language models, clinical trial matching, fine-tuning, GPT-4, LLaMA, eligibility
5 / 10

real but narrower advance

Trial matching is called high-stakes in healthcare, but abstract quantifies no patient or trial scale; feasibility demonstration with fine-tuned open-source models, no deployment.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Multimodal deep learning of fundus abnormalities and traditional risk factors for cardiovascular risk prediction
Yeong Chan Lee, Jiho Cha, Injeong Shim, Woong‐Yang Park, Se Woong Kang...
2023 107
10
2 Reliable Tuberculosis Detection Using Chest X-Ray With Deep Learning, Segmentation and Visualization
Tawsifur Rahman, Amith Abdullah Khandakar, Muhammad Abdul Kadir, Khand...
2020 651
10
3 A comparative analysis of machine learning classifiers for stroke prediction: A predictive analytics approach
Nitish Biswas, Khandaker Mohammad Mohi Uddin, Sarreha Tasmin Rikta, Sa...
2022 116
10
4 Cardiovascular Disease Diagnosis from DXA Scan and Retinal Images Using Deep Learning
Hamada R. H. Al-Absi, Mohammad Tariqul Islam, Mahmoud Ahmed Refaee, Mu...
2022 89
10
5 Proteomics and Machine Learning Approaches Reveal a Set of Prognostic Markers for COVID-19 Severity With Drug Repurposing Potential
Kruthi Suvarna, Deeptarup Biswas, Medha Gayathri J. Pai, Arup Acharjee...
2021 76
10