Simultaneous analysis of fMRI and EEG biosignals: a multimodal fusion approach

Abstract

This paper presents a proposal of new analyses for data from functional magnetic resonance images and electroencephalographic signals acquired simultaneously. Considering the current state of the art in this field, the methodology is proposed in the context of multimodal fusion that can be applied in early and/or late stages of the processing. Several problems such as spatial and time synchronization of the data and possible solutions to deal with them based on over-sampling or under-sampling are discussed. The principal objective of this ongoing research consists of increasing temporal and spatial resolution for recognition of activation zones of the brain (zones of interest) during cognitive tasks. Some preliminary results of 3D reconstruction of the brain volume from electroencephalographic signals of a subject carrying out an oddball task are included.