Sound localization and Visualization device

Abstract

This paper proposes a novel method to tackle complete hearing loss by visualizing sound frequency and estimating its direction of arrival. The `Visualization device', as we may call it, essentially consists of a particle velocity sensor, a microphone, a digital signal processor and a transparent display module. Information regarding the nature (frequency/pitch) and direction of arrival of sound is displayed in a transparent display module mounted in front of the user's eyes. Sound is represented as color by mapping its frequency to an RGB color value. With proper training, an individual without the gift of hearing can use the device to identify different sound sources in the environment.