Solving Rubik's Cube with a Robot Hand

OpenAI, Ilge Akkaya, Marcin Andrychowicz, Maciek Chociej, Mateusz Litwin, Bob McGrew, Arthur J Petron, Alex Paino et al.

arXiv (Cornell University) 2019 preprint cited by 569

importance 6/10 solved Reinforcement Learning in Robotics robotics stage: research

Solving a Rubik's cube with a real humanoid robot hand requires robust control and state estimation despite the sim-to-real gap.

Real-world dexterous manipulation of complex objects is a long-standing robotics challenge.

Automatic domain randomization (ADR) generated increasingly difficult simulated environments; control policies and vision estimators trained in simulation transferred to the real robot, showing emergent meta-learning.

Solved a Rubik's cube with a humanoid robot hand; no quantitative success rate stated in abstract.

Demonstrated sim2real transfer solving manipulation of unprecedented complexity on a real robot.

Venue arXiv (Cornell University)
Published 2019
Work type preprint
Authors OpenAI, Ilge Akkaya, Marcin Andrychowicz, Maciek Chociej, Mateusz Litwin, Bob McGrew, Arthur J Petron, Alex Paino et al.
Citations 569 (OpenAlex, at import time)
References 111
Model or method memory-augmented models trained with automatic domain randomization (ADR)
Organization OpenAI (per abstract URL)
Primary source https://doi.org/10.48550/arxiv.1910.07113
Open access green
Keywords robot hand, Rubik's cube, domain randomization, sim2real transfer, meta-learning
6 / 10

significant — thousands to millions affected

Abstract calls it a manipulation problem of unprecedented complexity solved on a real robot; a genuinely new capability in sim2real dexterous robotics, though no scale of beneficiaries is given.

Basis: stated. The source itself states the scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Autonomous robotic laparoscopic surgery for intestinal anastomosis
Hamed Saeidi, Justin David Opfermann, Michael Kam, Shuwen Wei, Simon L...
2022 384
7
2 PaLM-E: An Embodied Multimodal Language Model
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Cho...
2023 346
6
3 Assistive Navigation Using Deep Reinforcement Learning Guiding Robot With UWB/Voice Beacons and Semantic Feedbacks for Blind and Visually Impaired People
Chen-Lung Lu, Ziyan Liu, Jui-Te Huang, Ching-I Huang, Bo-Hui Wang, Yi...
2021 48
6
4 Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges
Yi Zhou, Lulu Liu, Haocheng Zhao, Miguel López‐Benítez, Limin Yu, Yuta...
2022 154
6
5 Learning robust autonomous navigation and locomotion for wheeled-legged robots
Joonho Lee, Marko Bjelonic, Alexander Reske, Lorenz Wellhausen, Takahi...
2024 132
6