Language and Robotics: Toward Building Robots Coexisting with Human Society Using Language Interface

Yutaka Nakamura, Shuhei Kurita, Koichiro Yoshino

Abstract: Robots are one of the archetypes of AI systems we imagine, and the realization of such robots operating in the real world with language interfaces has long been a dream of us. This vision we have dreamed of is rapidly becoming a reality with the contribution of recent advancements in large language models (LLMs). However, there are still many problems that the research community needs to tackle in order for LLMs and other NLP tools to work in the real world.