A Comparative Study of Pitch-Based Gestures in Nonverbal Vocal Interaction

Nonverbal vocal interaction (NVVI) is an input modality by means of which users control the computer by producing sounds other than speech. Previous research in this field has focused mainly on studying isolated instances of NVVI (such as mouse cursor control in computer games) and their performance. This paper presents a study with 36 elderly users in which basic NVVI vocal gestures (commands) were ranked by their perceived fatigue, satisfaction, and efficiency. The results of this study inspired a set of NVVI gesture design guidelines that are also presented in this paper.

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 42(6):1567-1571, 2012.

Additional material