Adaptively Timed Learning

Abstract

This chapter explains how humans and other animals learn to adaptively time their behaviors to match external environmental constraints. It hereby explains how nerve cells learn to bridge big time intervals of hundreds of milliseconds or even several seconds, and thereby associate events that are separated in time. This is accomplished by a spectrum of cells that each respond in overlapping time intervals and whose population response can bridge intervals much larger than any individual cell can. Such spectral timing occurs in circuits that include the lateral entorhinal cortex and hippocampal cortex. Trace conditioning, in which CS and US are separated in time, requires the hippocampus, whereas delay conditioning, in which they overlap, does not. The Weber law observed in trace conditioning naturally emerges from spectral timing dynamics, as later confirmed by data about hippocampal time cells. Hippocampal adaptive timing enables a cognitive-emotional resonance to be sustained long enough to become conscious of its feeling and its causal event, and to support BDNF-modulated memory consolidation. Spectral timing supports balanced exploratory and consummatory behaviors whereby restless exploration for immediate gratification is replaced by adaptively timed consummation. During expected disconfirmations of reward, orienting responses are inhibited until an adaptively timed response is released. Hippocampally-mediated incentive motivation supports timed responding via the cerebellum. mGluR regulates adaptive timing in hippocampus, cerebellum, and basal ganglia. Breakdowns of mGluR and dopamine modulation cause symptoms of autism and Fragile X syndrome. Inter-personal circular reactions enable social cognitive capabilities, including joint attention and imitation learning, to develop.