Blended Physical-Digital Kinesthetic Feedback for Mixed Reality-Based Conceptual Design-In-Context

Abhijeet Singh Raina, Vipul Mone, Mehdi Gorjian, Shinjiro Sueda, Francis Quek, Vinayak Raman Krishnamurthy

Letter Of Changes:

Summary of Revisions
1. Include missing information in statistics: test descriptions, test statistics, post-hoc test descriptions, and highlighting
confidence intervals or effect sizes in graphs - We have included hypothesis testing and post-hoc analysis descriptions
and statistics in sections 6.1 (sub-sections 6.1.1, 6.1.3, and 6.1.4) and 6.2 (sub-sections 6.2.1 and 6.2.2). We have
highlighted the confidence intervals in Figures 8, 9, 10, and 11.
2. Rename ”tangible stimulus” throughout to something more specific/fitting to the work (less generic) - We have replaced
”Tangible Stimuli” with ”Blended Physical-Digital Kinesthetic Feedback”. For brevity, we have used the term "blended haptics" for this term throughout the paper.
3. Shorten related work and introduction to make room for a related work section of AR haptics - We have added section
2.4 - ”Augmented Reality in Haptics” and shortened the introduction.

Keywords: Tangible Interactions, Haptics, Conceptual Design, 3D Sketching

TL;DR: We investigate blended physical-digital kinesthetic feedback as a means for controlled 3D design ideation in mixed reality (MR) environments by blending digital haptic feedback with real physical touch.

Abstract: In this paper, we investigate blended physical-digital kinesthetic feedback (or blended haptics in short) as a means for controlled three-dimensional design ideation in mixed reality (MR) environments. We define blended haptics as a spatial interaction wherein a physical object (e.g. a 3D printed human head) provides a specific design context for a user to generate ideas through physical manipulation of and on the object (e.g. drawing a digital sketch of a helmet) in the virtual environment. Using 3D wire-frame modeling as a concrete digital prototyping context, we investigate this idea of blended haptics in terms of how it supports design cognition specifically in spatial user interfaces. For this, we implemented a modeling tool as an experimental setup that allows a user to directly create curve-networks (wire-frame models) on a physical object (i.e. a contextual proxy) with one hand while simultaneously controlling the object with the other hand using a tracked turn-table. The key idea is that the user can simultaneously experience kinesthetic feedback from both the physical objects as well as the digital wire-frame models. To systematically investigate our approach, we conducted a comparative user evaluation of conceptual design tasks performed by two groups of users, one with the blended haptics (e.g. physical head and digital helmet) and the other with purely digital haptic feedback (e.g. digital head and digital helmet). Our study shows that blended haptics required less physical effort in the design task and resulted in concepts with higher novelty score as compared to using purely digital haptic feedback.

Submission Number: 2