arXiv Analytics

Sign in

arXiv:1706.09520 [cs.LG]AbstractReferencesReviewsResources

Neural SLAM

Jingwei Zhang, Lei Tai, Joschka Boedecker, Wolfram Burgard, Ming Liu

Published 2017-06-29Version 1

We present an approach for agents to learn representations of a global map from sensor data, to aid their exploration in new environments. To achieve this, we embed procedures mimicking that of traditional Simultaneous Localization and Mapping (SLAM) into the soft attention based addressing of external memory architectures, in which the external memory acts as an internal representation of the environment. This structure encourages the evolution of SLAM-like behaviors inside a completely differentiable deep neural network. We show that this approach can help reinforcement learning agents to successfully explore new environments where long-term memory is essential. We validate our approach in both challenging grid-world environments and preliminary Gazebo experiments.

Comments: A video showing our experimental results will be uploaded soon
Categories: cs.LG, cs.AI, cs.RO
Related articles: Most relevant | Search more
arXiv:1907.01285 [cs.LG] (Published 2019-07-02)
Learning the Arrow of Time
arXiv:2106.10075 [cs.LG] (Published 2021-06-18)
Learning to Plan via a Multi-Step Policy Regression Method
arXiv:2010.00581 [cs.LG] (Published 2020-10-01)
Multi-agent Social Reinforcement Learning Improves Generalization