Project Progress on XR-AI Platform for Tele-Rehab and Health Guidance

Takeshi Kurata, Kunihiro Ogata, Shusuke Kanazawa, Yumeko Imamura, Akihiro Sato, Satoki Ogiso, Yoshiyuki Kobayashi, Ryosuke Ichikari, Satoshi Nakae, Mitsunori Tada, Tomoki Aoyama, Hiroki Shimizu, Hideaki Kuzuoka, Takuto Nakamura, Takeshi Koshihara, Masao Kuroda, Hidemitsu Sorimachi, Fumihiro Naruse

Abstract: The main objectives of this project, launched in July 2021, is to mitigate and solve issues regarding health care services such as rehabilitation and specific health guidance while alleviating spatio-temporal, economic, and cognitive constraints by establishing remote technology foundation. There are four themes in this project. In theme #1, we have been developing the MR3 devices consisting of Wear and Mannequin for supporting detailed assessments of customers' physical functions and haptic interaction respectively. The central issue of theme #2 is to support intrinsic motivation for rehabilitation and exercise training through XR technologies as in virtual (self) coembodiment and hand redirection. In addition, we have also been investigating how to deal with one-to-many and zero-to-many situations. Theme #3 has aimed on establishing AI technology foundation for creating, monitoring progress of, and updating telerehab programs mainly for the upper limb. Systems for always-on monitoring during daily life and work developed in theme #4 is expected to be served as a common foundation for various tele-healthcare services. This paper reports on the progress of the above-mentioned themes in this project.