Autonomous Underwater Vehicle Docking Under Realistic Assumptions Using Deep Reinforcement Learning

Narcís Palomeras, Pere Ridao

Drones 2024 article cited by 14

importance 4/10 partially solved Underwater Vehicles and Communication Systems marine robotics stage: research

Autonomously homing and docking an underwater vehicle under realistic, noisy ocean conditions where traditional controllers struggle.

Ocean complexity and variability constrain traditional controllers, limiting autonomous underwater vehicle operations.

Deep Reinforcement Learning policies were trained for homing and docking using a novel observation space combining raw noisy observations with EKF-filtered data.

Stable policies in fewer learning steps, outperforming traditional control methods in simulations

Simulation evidence suggests DRL with EKF-filtered observations can outperform traditional docking controllers; real-vehicle validation not stated.

Venue Drones
Published 2024
Work type article
Authors Narcís Palomeras, Pere Ridao
Citations 14 (OpenAlex, at import time)
References 48
Model or method Deep Reinforcement Learning (specific algorithms not stated)
Organization not stated in source
Primary source https://doi.org/10.3390/drones8110673
Open access gold
Keywords AUV, docking, deep reinforcement learning, EKF, simulation
4 / 10

real but narrower advance

AUV homing/docking under realistic ocean noise is a meaningful autonomy capability, but evidence is simulation-only and no scale, fleet size, or application impact is stated.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Autonomous robotic laparoscopic surgery for intestinal anastomosis
Hamed Saeidi, Justin David Opfermann, Michael Kam, Shuwen Wei, Simon L...
2022 384
7
2 Solving Rubik's Cube with a Robot Hand
OpenAI, Ilge Akkaya, Marcin Andrychowicz, Maciek Chociej, Mateusz Litw...
2019 569
6
3 PaLM-E: An Embodied Multimodal Language Model
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Cho...
2023 346
6
4 Assistive Navigation Using Deep Reinforcement Learning Guiding Robot With UWB/Voice Beacons and Semantic Feedbacks for Blind and Visually Impaired People
Chen-Lung Lu, Ziyan Liu, Jui-Te Huang, Ching-I Huang, Bo-Hui Wang, Yi...
2021 48
6
5 Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges
Yi Zhou, Lulu Liu, Haocheng Zhao, Miguel López‐Benítez, Limin Yu, Yuta...
2022 154
6