Incubation of craving is a phenomenon describing the intensification of craving for a reward over extended periods of abstinence from reinforcement. Animal models use instrumental markers of craving to reward cues to examine incubation, while human paradigms rely on subjective self-reports. Here, we characterize an animal-inspired, novel human paradigm that showed strong positive relationships between self-reports and instrumental markers of craving for favored palatable foods. Further, we found consistent nonlinear relationships with time since last consumption and self-reports, and preliminary patterns between time and instrumental responses. These findings provide a novel approach to establishing an animal-inspired human model of incubation.
One characteristic of long-term memory is the existence of an inverted U-shaped response to increasing intervals between training sessions, and consequently, an optimal spacing that maximizes memory formation. Current models of this spacing effect focus on specific molecular components and their interactions. Here, we computationally study the underlying network architecture, in particular, the potential of motif dynamics in qualitatively capturing the spacing effect in a manner that is independent of the animal model, biomolecular components, and the timescales involved. We define a common training and test protocol, and computationally identify network topologies that can qualitatively replicate the experimentally observed characteristics of the spacing effect. For 41 motifs derived from fundamental network architectures such as autoregulation, feedback, and feedforward motifs, we tested their capacity to manifest the spacing effect in terms of an inverted U-shaped response curve, using different combinations of stimulation protocols, response metrics, and kinetic parameters. Our findings indicate that positive feedback motifs where the stimulus enhances conversion reaction in the loop replicate the spacing effect across all response metrics, while feedforward motifs exhibit a metric-specific spacing effect. For some parameter combinations, linear cascades of activation and conversion reactions were found sufficient to qualitatively exhibit spacing effect characteristics.
Flexible decision-making requires a balance between exploring features of an environment and exploiting prior knowledge. Behavioral flexibility is typically measured by how long it takes subjects to consistently make accurate choices after reward contingencies switch or task rules change. This measure, however, only allows for tracking flexibility across multiple trials, and does not assess the degree of flexibility. Plus, although increases in decision-making accuracy are strong indicators of learning, other decision-making behaviors have also been suggested as markers of flexibility, such as the on-the-fly decision reversals known as vicarious trial and error (VTE) or switches to a different, but incorrect, strategy. We sought to relate flexibility, learning, and neural activity by comparing choice history-derived evaluation of strategy use with changes in decision-making accuracy and VTE behavior while recording from the medial prefrontal cortex (mPFC) in rats. Using a set-shifting task that required rats to repeatedly switch between spatial decision-making strategies, we show that a previously developed strategy likelihood estimation procedure could identify putative learning points based on decision history. We confirm the efficacy of learning point estimation by showing increases in decision-making accuracy aligned to the learning point. Additionally, we show increases in the rate of VTE behavior surrounding identified learning points. By calculating changes in strategy likelihoods across trials, we tracked flexibility on a trial-by-trial basis and show that flexibility scores also increased around learning points. Further, we demonstrate that VTE behaviors could be separated into indecisive and deliberative subtypes depending on whether they occurred during periods of high or low flexibility and whether they led to correct or incorrect choice outcomes. Field potential recordings from the mPFC during decisions exhibited increased beta band activity on trials with VTE compared to non-VTE trials, as well as increased gamma during periods when learned strategies could be exploited compared to prelearning, exploratory periods. This study demonstrates that increased behavioral flexibility and VTE rates are often aligned to task learning. These relationships can break down, however, suggesting that VTE is not always an indicator of deliberative decision-making. Additionally, we further implicate the mPFC in decision-making and learning by showing increased beta-based activity on VTE trials and increased gamma after learning.
Synaptic potentiation has been linked to learning in sensory cortex, but the connection between this potentiation and increased sensory-evoked neural activity is not clear. Here, we used longitudinal in vivo Ca2+ imaging in the barrel cortex of awake mice to test the hypothesis that increased excitatory synaptic strength during the learning of a whisker-dependent sensory-association task would be correlated with enhanced stimulus-evoked firing. To isolate stimulus-evoked responses from dynamic, task-related activity, imaging was performed outside of the training context. Although prior studies indicate that multiwhisker stimuli drive robust subthreshold activity, we observed sparse activation of L2/3 pyramidal (Pyr) neurons in both control and trained mice. Despite evidence for excitatory synaptic strengthening at thalamocortical and intracortical synapses in this brain area at the onset of learning-indeed, under our imaging conditions thalamocortical axons were robustly activated-we observed that L2/3 Pyr neurons in somatosensory (barrel) cortex displayed only modest increases in stimulus-evoked activity that were concentrated at the onset of training. Activity renormalized over longer training periods. In contrast, when stimuli and rewards were uncoupled in a pseudotraining paradigm, stimulus-evoked activity in L2/3 Pyr neurons was significantly suppressed. These findings indicate that sensory-association training but not sensory stimulation without coupled rewards may briefly enhance sensory-evoked activity, a phenomenon that might help link sensory input to behavioral outcomes at the onset of learning.
How does repeated stimulation of mechanoafferents affect feeding motor neurons? Monosynaptic connections from a mechanoafferent population in the Aplysia buccal ganglia to five motor followers with different functions were examined during repeated stimulus trains. The mechanoafferents produced both fast and slow synaptic outputs, which could be excitatory or inhibitory. In contrast, other Aplysia mechanoafferents produce only fast excitation on their followers. In addition, patterns of synaptic connections were different to the different motor followers. Some followers received both fast excitation and fast inhibition, whereas others received exclusively fast excitation. All followers showed strong decreases in fast postsynaptic potential (PSP) amplitude within a stimulus train. Fast and slow synaptic connections were of net opposite signs in some followers but not in others. For one follower, synaptic contacts were not uniform from all subareas of the mechanoafferent cluster. Differences in properties of the buccal ganglia mechanoafferents and other Aplysia mechanoafferents may arise because the buccal ganglia neurons innervate the interior of the feeding apparatus, rather than an external surface, and connect to motor neurons for muscles with different motor functions. Fast connection patterns suggest that these synapses may be activated when food slips, biasing the musculature to release food. The largest slow inhibitory synaptic PSPs may contribute to a delay in the onset of the next behavior. Additional functions are also possible.
Changes caused by learning that a food is inedible in Aplysia were examined for fast and slow synaptic connections from the buccal ganglia S1 cluster of mechanoafferents to five followers, in response to repeated stimulus trains. Learning affected only fast connections. For these, unique patterns of change were present in each follower, indicating that learning differentially affects the different branches of the mechanoafferents to their followers. In some followers, there were increases in either excitatory or inhibitory connections, and in others, there were decreases. Changes in connectivity resulted from changes in the amplitude of excitation or inhibition, or as a result of the number of connections, or of both. Some followers also exhibited changes in either within or between stimulus train plasticity as a result of learning. In one follower, changes differed from the different areas of the S1 cluster. The patterns of changes in connectivity were consistent with the behavioral changes produced by learning, in that they would produce an increase in the bias to reject or to release food, and a decrease in the likelihood to respond to food.
The brain constantly compares past and present experiences to predict the future, thereby enabling instantaneous and future behavioral adjustments. Integration of external information with the animal's current internal needs and behavioral state represents a key challenge of the nervous system. Recent advancements in dissecting the function of the Drosophila mushroom body (MB) at the single-cell level have uncovered its three-layered logic and parallel systems conveying positive and negative values during associative learning. This review explores a lesser-known role of the MB in detecting and integrating body states such as hunger, thirst, and sleep, ultimately modulating motivation and sensory-driven decisions based on the physiological state of the fly. State-dependent signals predominantly affect the activity of modulatory MB input neurons (dopaminergic, serotoninergic, and octopaminergic), but also induce plastic changes directly at the level of the MB intrinsic and output neurons. Thus, the MB emerges as a tightly regulated relay station in the insect brain, orchestrating neuroadaptations due to current internal and behavioral states leading to short- but also long-lasting changes in behavior. While these adaptations are crucial to ensure fitness and survival, recent findings also underscore how circuit motifs in the MB may reflect fundamental design principles that contribute to maladaptive behaviors such as addiction or depression-like symptoms.