BloombergGPT: A Large Language Model for Finance

Shijie Wu, Ozan İrsoy, Steven Z. Lu, Vadim Dabravolski, Mark H. Dredze, Sebastian Gehrmann, Prabhanjan Kambadur, David Rosenberg et al.

RePEc: Research Papers in Economics 2023 preprint cited by 289

importance 6/10 solved Topic Modeling financial services stage: research proprietary model

No large language model specialized for the financial domain had been reported, despite broad NLP use in finance.

Financial tasks like sentiment analysis and question answering need domain-specific language models.

Trained BloombergGPT, a 50-billion-parameter LLM, on 363 billion tokens of financial data plus 345 billion general-purpose tokens, validated on standard, open financial, and internal benchmarks.

Outperforms existing models on financial tasks by significant margins without sacrificing general performance; exact benchmark numbers not stated in source.

First reported finance-specialized LLM, but performance claims rest on largely self-constructed benchmarks.

Venue RePEc: Research Papers in Economics
Published 2023
Work type preprint
Authors Shijie Wu, Ozan İrsoy, Steven Z. Lu, Vadim Dabravolski, Mark H. Dredze, Sebastian Gehrmann, Prabhanjan Kambadur, David Rosenberg et al.
Citations 289 (OpenAlex, at import time)
Model or method BloombergGPT (50 billion parameter language model)
Organization Bloomberg
Primary source https://doi.org/10.48550/arxiv.2303.17564
Open access green
Keywords large language model, finance, BloombergGPT, domain-specific training, NLP benchmarks
6 / 10

significant — thousands to millions affected

First reported finance-specialized LLM; financial NLP spans a large industry (sentiment analysis, NER, QA), but abstract states no scale of users or impact.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Optimizing fraud detection in financial transactions with machine learning and imbalance mitigation
Ezaz Aldahasi, Rama Khaled Alsheikh, Fakhri Alam Khan, Gwanggil Jeon
2024 66
7
2 Search Personalization Using Machine Learning
Hema Yoganarasimhan
2020 167
6
3 Combinatorial Optimization-Enriched Machine Learning to Solve the Dynamic Vehicle Routing Problem with Time Windows
Léo Baty, Kai Jungel, Patrick S. Klein, Axel Parmentier, Maximilian Sc...
2024 69
6
4 A review of the applications of multi-agent reinforcement learning in smart factories
Fouad Bahrpeyma, Dirk Reichelt
2022 76
6
5 Credit risk prediction based on causal machine learning: Bayesian network learning, default inference, and interpretation
Jiaming Liu, Xuemei Zhang, Haitao Xiong
2024 30
6