Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Problem
Achieving superhuman play in chess, shogi and Go previously required decades of handcrafted, domain-specific engineering.
Why it matters
A single general learning algorithm could replace domain-specific expert engineering across complex domains.
What the AI did
AlphaZero generalized tabula rasa self-play reinforcement learning into one algorithm that learned chess, shogi and Go from random play and rules only.
Results
Superhuman play in chess, shogi and Go within 24 hours; convincingly defeated a world-champion program in each case.
Impact
Shows one general RL algorithm can reach superhuman play across multiple complex domains without domain knowledge.
Record
| Venue | arXiv (Cornell University) |
|---|---|
| Published | 2017 |
| Work type | preprint |
| Authors | David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre et al. |
| Citations | 1,024 (OpenAlex, at import time) |
| References | 23 |
| Model or method | AlphaZero |
| Organization | not stated in source |
| Primary source | https://doi.org/10.48550/arxiv.1712.01815 |
| Open access | green |
| Keywords | AlphaZero, reinforcement learning, self-play, chess, shogi, Go |
Importance rating
significant — thousands to millions affected
One general algorithm achieved superhuman play in chess, shogi and Go within 24 hours, replacing decades of domain-specific engineering; foundational for AI but games are not a direct large-scale societal problem.
More in Software & Coding
| # | Paper | Year | Citations | Importance |
|---|---|---|---|---|
| 1 | ImageNet classification with deep convolutional neural networks | 2017 | 106,345 |
8
|
| 2 | Deep Residual Learning for Image Recognition | 2016 | 221,134 |
8
|
| 3 | Faster sorting algorithms discovered using deep reinforcement learning | 2023 | 175 |
8
|
| 4 | A deep learning‐based approach for software vulnerability detection using code metrics | 2022 | 42 |
7
|
| 5 | Deep Learning-Based Attack Detection and Classification in Android Devices | 2023 | 41 |
7
|