Transferring knowledge between learning systems

Abstract

We consider a pair of multimodal integration systems, a teacher and a learner and demonstrate how the knowledge is transferred from the teacher to the learner in an incremental fashion. By combining effectors to a perceptual integration network influenced by hypothesised endogenous “action thoughts”, we present a simplified model of how a universal or common coding scheme can be used to represent dual auditory and visual sensory pathways and integrate these with articulatory and gestural forms of motor control. As an example the system learns visual representation of Chinese characters and their related Mandarin pronunciation.