Experiments using speech, non-speech sound and stereophony as communication metaphors in information systems

Abstract

The paper describes experiments that utilised sound, synthesised speech and stereophonic output to communicate data in information systems. A stock control information system was the experimental platform for these experiments. The first experiment utilised rhythms and timbre to communicate windows and their associated functions in the system. The second experiment utilised simultaneously speech and sound to communicate a large amount of information to users of the system. The third experiment tested various stereophonic positions. Experimental results indicated that the use of rhythms and timbre in an information system can help to either complement and re-enforce information received by the users via the visual channel or as an alternative for special users such as visually impaired users. The simultaneous use of sound and speech indicated that the auditory messages can be used together to maximise the volume of the information communicated to the user. Results also indicated that stereophonic output can be useful in the design of multimedia information systems. Many different types of information of the stock control system were successfully communicated using this approach. The paper concludes with a set of empirically derived guidelines for the use of speech, sound and stereophony. For example, some issues include presentation, classification and structure of auditory messages as part of the interface design in information systems.