Non-speech voice for sonic interaction: a catalogue

Davide Rocchesso, Alan Del Piccolo, Davide Rocchesso

Research output: Contribution to journalArticlepeer-review

Abstract

This paper surveys the uses of non-speech voice as an interaction modality within sonic applications. Three main contexts of use have been identified: sound retrieval, sound synthesis and control, and sound design. An overview of different choices and techniques regarding the style of interaction, the selection of vocal features and their mapping to sound features or controls is here displayed. A comprehensive collection of examples instantiates the use of non-speech voice in actual tools for sonic interaction. It is pointed out that while voice-based techniques are already being used proficiently in sound retrieval and sound synthesis, their use in sound design is still at an exploratory phase. An example of creation of a voice-driven sound design tool is here illustrated
Original languageEnglish
Pages (from-to)39-55
Number of pages17
JournalJournal on Multimodal User Interfaces
Volume11
Publication statusPublished - 2017

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Non-speech voice for sonic interaction: a catalogue'. Together they form a unique fingerprint.

Cite this