Enabling Active Interaction With Music And Sound In Multisensory Environments

Challis, BP, Kang, A, Rimmer, R and Hildred, M (2017) Enabling Active Interaction With Music And Sound In Multisensory Environments. EAI Endorsed Transactions on Creative Technologies, 4 (11). e3. ISSN 2409-9708

Preview

Published Version Available under License Creative Commons Attribution. Download (3MB) | Preview

Abstract

In recognising a lack of established design principles for multisensory environments (MSEs), two case studies are described which challenge current trends for creating and resourcing sensory spaces. Both environments were regarded as spaces within which to work rather than as a given suite of technologies and the activities being explored placed much emphasis on moving beyond passive modes of interaction for sound and music. Stimulating interactive story-worlds were enabled for children with Special Educational Needs and assistive technologies were used to enable individuals to affect the environment as a whole. In using game-play within the activities, it was also recognised that adaptive-audio (as used in computer gaming) could offer considerable impact within physical spaces such as MSEs. Future directions are outlined including defining core design principles, embedding adaptive-audio techniques within specialist software and exploring the benefits of MSEs for stroke survivors.