Voice-Based Virtual Assistants for User Interaction Modeling

Marco Brambilla, Davide Molinelli

Abstract: In this work, we propose a virtual assistant that allows building models by means of voice commands. To demonstrate the generality of the approach, we describe three alternative strategies that apply voice-based support at three levels of detail: a fully-guided strategy; a pattern-based strategy; and an element-based strategy. We describe our implementation experience with the development of a design assistant covering the three strategies described above for OMG’s IFML (Interaction Flow Modeling Language), in the context of user interaction design, including the integration with the Amazon Alexa assistant. We report our results that show how the assistant can bring advantages in terms of productivity.