Research on Cross-sensory Information Enhancement Effect Based on the Analysis of Multi-mode Brain Imaging

Abstract

Cross-sensory information enhancement effect means that the information obtained from a sense channel can enhance the brain’s judgment on the information from another sensory channel. The research on the special multisensory integration has a very important role in the study of human perception, learning and memory.In this study, EEG data of subjects from single sensory area and multi-sensory joint areas will be obtained by cross-sensory stimulation experiments. After the analysis from the time, frequency and spatial domains, the features of cross-sensory information enhancement are extracted. The brain areas where information exchanges exist will be determined.By designing the experiments (single-sensory sustained attention task, sSAT and multi-sensory sustained attention task, mSAT), we obtain induced brain waves, and analyze human EEG information from which we extract ERP (Event Related Potential) component and conduct discriminatory analysis. Then we study the reaction mechanism of the brain. Using behavioral analysis, ERP time domain analysis and time-frequency analysis technology, we compare the results of two kinds of experiments (sSAT and mSAT) to explore the physiological mechanism of sustained attention.On this basis of analyzing subjects’ individual differernces, an effective neurofeedback training method will be established to activate the various functional areas of the brain, which provides a theoretical basis for development of instruments to enhance perception and improve the living conditions of the populations whose sensory perception is decreased. This study has enormous social value.