Context-Aware Replanning with Pre-Explored Semantic Map for Object Navigation

Published: 05 Sept 2024, Last Modified: 08 Nov 2024CoRL 2024EveryoneRevisionsBibTeXCC BY 4.0
Keywords: VLMs, map, navigation, uncertainty, multi-view consistency, robotics
Abstract: Pre-explored Semantic Map, constructed through prior exploration using visual language models (VLMs), has proven effective as a foundational element for training-free robotic applications. However, existing approaches assume the map's accuracy and do not provide effective mechanisms for revising decisions based on incorrect maps. This work introduces Context-Aware Replanning (CARe),, which estimates map uncertainty through confidence scores and multi-view consistency, enabling the agent to revise erroneous decisions stemming from inaccurate maps without additional labels. We demonstrate the effectiveness of our proposed method using two modern map backbones, VLMaps and OpenMask3D, and show significant improvements in performance on object navigation tasks.
Supplementary Material: zip
Spotlight Video: mp4
Video: https://drive.google.com/file/d/1e6vchQJiaeyzKty5Si5mAvAsn9LXlGIv/preview
Website: https://care-maps.github.io/
Code: https://github.com/CARe-maps/CARe_experiments
Publication Agreement: pdf
Student Paper: yes
Submission Number: 682
Loading