Publications
With our publications we cover the most diverse research areas that arise in the field of man, task and technology. In addition to traditional Business Information Systems topics such as knowledge management and business process management, you will also find articles on current topics such as blended learning, cloud computing or smart grids. Use this overview to get an impression of the range and possibilities of research in Business Information Systems at the University of Duisburg-Essen.
Type of Publication: Article in Collected Edition
SoundsRide: Affordance-Synchronized Music Mixing for In-Car Audio Augmented Reality (Best Paper Award)
- Author(s):
- Kari, Mohamed; Grosse-Puppendahl, Tobias; Jagaciak, Alexander; Bethge, David; Schütte, Reinhard; Holz, Christian
- Title of Anthology:
- The 34th Annual ACM Symposium on User Interface Software and Technology
- pages:
- 118-133
- Publisher:
- Association for Computing Machinery
- Location(s):
- New York, NY, USA
- Publication Date:
- 2021
- ISBN:
- 9781450386357
- Keywords:
- auditory augmented reality, sound affordances, context-adaptive music
- Digital Object Identifier (DOI):
- doi:10.1145/3472749.3474739
- Citation:
- Download BibTeX
Abstract
Music is a central instrument in video gaming to attune a player’s attention to the current atmosphere and increase their immersion in the game. We transfer the idea of scene-adaptive music to car drives and propose SoundsRide, an in-car audio augmented reality system that mixes music in real-time synchronized with sound affordances along the ride. After exploring the design space of affordance-synchronized music, we design SoundsRide to temporally and spatially align high-contrast events on the route, e.g., highway entrances or tunnel exits, with high-contrast events in music, e.g., song transitions or beat drops, for any recorded and annotated GPS trajectory by a three-step procedure. In real-time, SoundsRide 1) estimates temporal distances to events on the route, 2) fuses these novel estimates with previous estimates in a cost-aware music-mixing plan, and 3) if necessary, re-computes an updated mix to be propagated to the audio output. To minimize user-noticeable updates to the mix, SoundsRide fuses new distance information with a filtering procedure that chooses the best updating strategy given the last music-mixing plan, the novel distance estimations, and the system parameterization. We technically evaluate SoundsRide and conduct a user evaluation with 8 participants to gain insights into how users perceive SoundsRide in terms of mixing, affordances, and synchronicity. We find that SoundsRide can create captivating music experiences and positively as well as negatively influence subjectively perceived driving safety, depending on the mix and user.