Zero-Shot Clinical Trial Patient Matching with LLMs

Michael Wornow, Alejandro Lozano, Dev Dash, Jenelle Jindal, Kenneth W. Mahaffey, Nigam Haresh Shah

NEJM AI 2024 article cited by 57

importance 8/10 partially solved Artificial Intelligence in Healthcare and Education clinical trials stage: research

Manually matching patients to clinical trial eligibility criteria takes up to 1 hour per patient, slowing drug development.

Faster, cheaper trial matching accelerates drug development and connects patients to potentially life-saving treatments.

Built a zero-shot LLM-based system that reads unstructured clinical text to evaluate trial inclusion criteria, plus a cost-efficient prompting strategy and a two-stage retrieval pipeline.

State-of-the-art scores on the n2c2 2018 cohort selection benchmark; matching an order of magnitude faster and cheaper than status quo

Benchmark-leading automated trial matching demonstrated on a public benchmark; broad real-world adoption not stated in source.

Venue NEJM AI
Published 2024
Work type article
Authors Michael Wornow, Alejandro Lozano, Dev Dash, Jenelle Jindal, Kenneth W. Mahaffey, Nigam Haresh Shah
Citations 57 (OpenAlex, at import time)
References 16
Model or method LLM-based system (specific model not stated in source)
Organization not stated in source
Primary source https://doi.org/10.1056/aics2400360
Open access green
Keywords clinical trial matching, LLM, zero-shot, n2c2 benchmark, patient screening, retrieval pipeline
8 / 10

major — millions of lives, an industry or a field

Abstract frames trial matching as a key unsolved challenge in bringing new drugs to market, with manual screening taking up to 1 hour per patient; affects the entire drug development pipeline.

Basis: stated. The source itself states the scale. Stated scale: up to 1 hour of manual work per patient. Method and limits.

# Paper Year Citations Importance
1 Multimodal deep learning of fundus abnormalities and traditional risk factors for cardiovascular risk prediction
Yeong Chan Lee, Jiho Cha, Injeong Shim, Woong‐Yang Park, Se Woong Kang...
2023 107
10
2 Reliable Tuberculosis Detection Using Chest X-Ray With Deep Learning, Segmentation and Visualization
Tawsifur Rahman, Amith Abdullah Khandakar, Muhammad Abdul Kadir, Khand...
2020 651
10
3 A comparative analysis of machine learning classifiers for stroke prediction: A predictive analytics approach
Nitish Biswas, Khandaker Mohammad Mohi Uddin, Sarreha Tasmin Rikta, Sa...
2022 116
10
4 Cardiovascular Disease Diagnosis from DXA Scan and Retinal Images Using Deep Learning
Hamada R. H. Al-Absi, Mohammad Tariqul Islam, Mahmoud Ahmed Refaee, Mu...
2022 89
10
5 Proteomics and Machine Learning Approaches Reveal a Set of Prognostic Markers for COVID-19 Severity With Drug Repurposing Potential
Kruthi Suvarna, Deeptarup Biswas, Medha Gayathri J. Pai, Arup Acharjee...
2021 76
10