On designing a visual system# (towards a Gibsonian computational model of vision)

Abstract This paper contrasts the standard (in AI) ‘modular’ theory of the nature of vision with a more general theory of vision as involving multiple functions and multiple relationships with other sub-systems of an intelligent system. The modular theory (e.g. as expounded by Marr) treats vision as entirely, and permanently, concerned with the production of a limited range of descriptions of visible surfaces, for a central database; while the ‘labyrinthine’ design allows any output that a visual system can be trained to associate reliably with features of an optic array and allows forms of learning that set up new communication channels. The labyrinthine theory turns out to have much in common with J.J. Gibson's theory of affordances, while not eschewing information processing as he did. It also seems to fit better than the modular theory with neurophysiological evidence of rich interconnectivity within and between sub-systems in the brain. Some of the trade-offs between different designs are discussed i...