Real-Time Dynamic Digital Scenography: An Electronic Opera as a Use Case

Published: 01 Jan 2021, Last Modified: 08 Apr 2025ArtsIT 2021EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: In scenography, digital media has been increasingly used to design richer and more immersive experiences, for example, using video mapping or holographic projection. However, such technologies may sometimes collide with the natural (and sometimes unavoidable) improvisation moments of live interpretation. Thus, to ensure the control of these effects, large technical teams are often needed in the production of such events, which may become unfeasible in smaller size productions with smaller budgets. To test possible solutions to this problem, we endorsed the creation of an interactive low-budget scenario for the electronic opera TMIE, Standing on the Threshold of the Outside World, by the composer Carlos Alberto Augusto. To accomplish that, image projection techniques are combined with software to create scenarios that are capable of dynamically changing during the opera and interact with artists in real-time. This paper presents some of the experiments done so far, such as a set of interactive digital effects automatically controlled using computer vision, and simple software to manually control or time the sequence of effects during the show. Then, we discuss the potential of these techniques aimed at enabling the generation of atypical graphic solutions for live shows, as well as the practicality of having a user interface to easily manage the entry and exit times of each of the developed scenarios.
Loading

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview