A Hybrid Semi-Automated Workflow for Systematic and Literature Review Processes with Large Language Model Analysis

Anjia Ye, Ananda Maiti, Matthew W. Schmidt, SJ Pedersen

Future Internet 2024 article cited by 28

importance 6/10 ai assisted Meta-analysis and systematic reviews evidence synthesis stage: research proprietary model

Systematic reviews are rigorous but labor-intensive due to collaborative protocols, strict procedures, and large numbers of documents to screen.

The manual workload of systematic reviews slows evidence synthesis used across research and practice.

A semi-automated workflow uses Gemini-Pro to autonomously summarize text and extract key information, replacing manual title/abstract screening, full-text screening, and data extraction while keeping a human in the loop for inclusion/exclusion decisions.

not stated in source

Peer-reviewed workflow proposal; claimed accuracy maintenance is not quantified in the abstract.

Venue Future Internet
Published 2024
Work type article
Authors Anjia Ye, Ananda Maiti, Matthew W. Schmidt, SJ Pedersen
Citations 28 (OpenAlex, at import time)
References 28
Model or method Gemini-Pro (GPT-4/ChatGPT also referenced)
Organization not stated in source
Primary source https://doi.org/10.3390/fi16050167
Open access gold
Keywords systematic review, LLM, Gemini-Pro, screening automation, human-in-the-loop
6 / 10

significant — thousands to millions affected

Systematic reviews underpin evidence synthesis across research and practice; reducing their manual workload benefits the broader research community, though the abstract states no scale of affected users.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Machine Learning as a Tool for Hypothesis Generation
Jens Ludwig, Sendhil Mullainathan
2024 85
6
2 Restoring and attributing ancient texts using deep neural networks
Yannis Assael, Thea Sommerschield, Brendan Shillingford, Mahyar Bordba...
2022 206
5
3 Prediction on Domestic Violence in Bangladesh during the COVID-19 Outbreak Using Machine Learning Methods
Md. Murad Hossain, Md. Asadullah, Abidur Rahaman, Md Sipon Miah, Md. Z...
2021 41
5
4 The emergence of large language models as tools in literature reviews: a large language model-assisted systematic review
Dmitry Scherbakov, Nina Hubig, Vinita Gangaram Jansari, Alexander Baku...
2025 145
5
5 Can Large Language Models Transform Computational Social Science?
Caleb Ziems, William Held, Omar Shaikh, Jiaao Chen, Zhehao Zhang, Diyi...
2023 559
4