Recording and Reproducing High Order Surround Auditory Scenes for Mixed and Augmented Reality

Zhiyun Li, Ramani Duraiswami, Larry S. Davis

Abstract: Virtual reality systems are largely based on computer graphics and vision technologies. However, sound also plays an important role in human's interaction with the surrounding environment, especially for the visually impaired people. In this paper, we develop the theory of recording and reproducing real-world surround auditory scenes in high orders using specially designed microphone and loudspeaker arrays. It is complementary to vision-based technologies in creating mixed and augmented realities. Design examples and simulations are presented.