An examination of innate behavior and its possible origins suggests parallels with the formation of habitual behavior. Inflexible but adaptive responses—innate reflexive behavior, Pavlovian conditioned responses, and operant habits—may have evolved from variable behavior in phylogeny and ontogeny. This form of “plasticity-first” scientific narrative was unpopular post-Darwin but has recently gained credibility in evolutionary biology. The present article seeks to identify originating events and contingencies contributing to such inflexible but adaptive behavior at both phylogenic and ontogenic levels of selection. In ontogeny, the development of inflexible performance (i.e., habit) from variable operant behavior is reminiscent of the genetic accommodation of initially variable phylogenic traits. The effects characteristic of habit (e.g., unresponsiveness to reinforcer devaluation) are explicable as the result of a conflict between behaviors at distinct levels of selection. The present interpretation validates the practice of seeking hard analogies between evolutionary biology and operant behavior. Finding such parallels implies the validity of a claim that organismal behavior, both innate and learned, is a product of selection by consequences. A complete and coherent account of organismal behavior may ultimately focus on functional selective histories in much the same way evolutionary biology does with its subject matter.
{"title":"The behavioral origins of phylogenic responses and ontogenic habits","authors":"W. David Stahlman, Kenneth J. Leising","doi":"10.1002/jeab.892","DOIUrl":"10.1002/jeab.892","url":null,"abstract":"<p>An examination of innate behavior and its possible origins suggests parallels with the formation of habitual behavior. Inflexible but adaptive responses—innate reflexive behavior, Pavlovian conditioned responses, and operant habits—may have evolved from variable behavior in phylogeny and ontogeny. This form of “plasticity-first” scientific narrative was unpopular post-Darwin but has recently gained credibility in evolutionary biology. The present article seeks to identify originating events and contingencies contributing to such inflexible but adaptive behavior at both phylogenic and ontogenic levels of selection. In ontogeny, the development of inflexible performance (i.e., habit) from variable operant behavior is reminiscent of the genetic accommodation of initially variable phylogenic traits. The effects characteristic of habit (e.g., unresponsiveness to reinforcer devaluation) are explicable as the result of a conflict between behaviors at distinct levels of selection. The present interpretation validates the practice of seeking hard analogies between evolutionary biology and operant behavior. Finding such parallels implies the validity of a claim that organismal behavior, both innate and learned, is a product of selection by consequences. A complete and coherent account of organismal behavior may ultimately focus on functional selective histories in much the same way evolutionary biology does with its subject matter.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"121 1","pages":"27-37"},"PeriodicalIF":2.7,"publicationDate":"2023-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jeab.892","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138445146","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rose S. Bono, Augustus M. White, Cosima Hoetger, Thokozeni Lipato, Warren K. Bickel, Caroline O. Cobb, Andrew J. Barnes
We examine whether cigarettes serve as substitutes for electronic nicotine delivery systems (ENDS) among ENDS users and demonstrate methodological extensions of data from a cross-price purchase task to inform policies and interventions. During a clinical laboratory study, n = 19 exclusive ENDS users and n = 17 dual cigarette/ENDS users completed a cross-price purchase task with cigarettes available at a fixed price while prices of own-brand ENDS increased. We estimated cross-price elasticity using linear models to examine substitutability. We defined five additional outcomes: nonzero cross-price intensity (purchasing cigarettes if ENDS were free), constant null demand (not purchasing cigarettes at any ENDS price), cross-product crossover point (first price where participants purchased more cigarettes than ENDS), dual-demand score (percentage of prices where both products were purchased), and dual-use break point (minimum relative price to force complete substitution). The cross-price elasticity results indicated that cigarettes could serve as substitutes for ENDS among ENDS users on average, but this average effect masked substantial heterogeneity in profiles of demand (here, a measure of the drug's reinforcement potential). Policies and regulations that increase ENDS prices appear unlikely to steer most exclusive ENDS users toward cigarette use, as most would not purchase cigarettes at any ENDS price, but they could prompt some dual users to substitute cigarettes completely while others remain dual users. This heterogeneity in consumer responses suggests additional indices of cross-product demand are useful to characterize the anticipated and unanticipated effects of tobacco price policies more fully.
{"title":"Expanding on cross-price elasticity: Understanding tobacco product demand and substitution from the cross-price purchase task","authors":"Rose S. Bono, Augustus M. White, Cosima Hoetger, Thokozeni Lipato, Warren K. Bickel, Caroline O. Cobb, Andrew J. Barnes","doi":"10.1002/jeab.890","DOIUrl":"10.1002/jeab.890","url":null,"abstract":"<p>We examine whether cigarettes serve as substitutes for electronic nicotine delivery systems (ENDS) among ENDS users and demonstrate methodological extensions of data from a cross-price purchase task to inform policies and interventions. During a clinical laboratory study, <i>n</i> = 19 exclusive ENDS users and <i>n</i> = 17 dual cigarette/ENDS users completed a cross-price purchase task with cigarettes available at a fixed price while prices of own-brand ENDS increased. We estimated cross-price elasticity using linear models to examine substitutability. We defined five additional outcomes: nonzero cross-price intensity (purchasing cigarettes if ENDS were free), constant null demand (not purchasing cigarettes at any ENDS price), cross-product crossover point (first price where participants purchased more cigarettes than ENDS), dual-demand score (percentage of prices where both products were purchased), and dual-use break point (minimum relative price to force complete substitution). The cross-price elasticity results indicated that cigarettes could serve as substitutes for ENDS among ENDS users on average, but this average effect masked substantial heterogeneity in profiles of demand (here, a measure of the drug's reinforcement potential). Policies and regulations that increase ENDS prices appear unlikely to steer most exclusive ENDS users toward cigarette use, as most would not purchase cigarettes at any ENDS price, but they could prompt some dual users to substitute cigarettes completely while others remain dual users. This heterogeneity in consumer responses suggests additional indices of cross-product demand are useful to characterize the anticipated and unanticipated effects of tobacco price policies more fully.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"121 2","pages":"175-188"},"PeriodicalIF":2.7,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138291269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The rate of discounting future goods is a crucial factor in intertemporal trade-offs, upon which depends not only individual well-being but also that of our planet: How much privation now for a temperate future for our grandchildren? What is the best way to measure how the value of future goods decreases with its delay? The most accurate discount functions involve several covarying parameters, making interpretation equivocal. A universal and robust measure is the area under the discount curve, the AuC. The AuC of a hyperbolic discount function is a logarithmic function of the discount rate, k. The same integral also approximates the area under a hyperboloid function. A simple technique converts each datum into estimates of the discount rate, eliminating rogue data points in the process. These trimmed estimates are converted into areas and tested against data, where they succeed at predicting the AuC and its relation to log(k).
{"title":"From data through discount rates to the area under the curve","authors":"Peter R. Killeen","doi":"10.1002/jeab.888","DOIUrl":"10.1002/jeab.888","url":null,"abstract":"<p>The rate of discounting future goods is a crucial factor in intertemporal trade-offs, upon which depends not only individual well-being but also that of our planet: How much privation now for a temperate future for our grandchildren? What is the best way to measure how the value of future goods decreases with its delay? The most accurate discount functions involve several covarying parameters, making interpretation equivocal. A universal and robust measure is the area under the discount curve, the <i>AuC</i>. The <i>AuC</i> of a hyperbolic discount function is a logarithmic function of the discount rate, <i>k</i>. The same integral also approximates the area under a hyperboloid function. A simple technique converts each datum into estimates of the discount rate, eliminating rogue data points in the process. These trimmed estimates are converted into areas and tested against data, where they succeed at predicting the <i>AuC</i> and its relation to log(<i>k</i>).</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"121 2","pages":"259-265"},"PeriodicalIF":2.7,"publicationDate":"2023-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138176522","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jan De Houwer, Martin Finn, Yannick Boddez, Sean Hughes, Jamie Cummins
Many researchers have tackled the question of how behavior is influenced by its outcomes. Some have adopted a nonmechanistic (functional) perspective that attempts to describe the influence of outcomes on behavior. Others have adopted a mechanistic (cognitive) perspective that attempts to explain the influence of outcomes on behavior. Orthogonal to this distinction, some have focused on the influence of outcomes that a behavior had in the past, whereas others also consider the influence of outcomes that a behavior might have in the future. In this article, we relate these different perspectives with the goal of reducing misunderstandings and fostering collaborations between researchers who adopt different perspectives on the common question of how behavior is influenced by its outcomes.
{"title":"Relating different perspectives on how outcomes of behavior influence behavior","authors":"Jan De Houwer, Martin Finn, Yannick Boddez, Sean Hughes, Jamie Cummins","doi":"10.1002/jeab.887","DOIUrl":"10.1002/jeab.887","url":null,"abstract":"<p>Many researchers have tackled the question of how behavior is influenced by its outcomes. Some have adopted a nonmechanistic (functional) perspective that attempts to describe the influence of outcomes on behavior. Others have adopted a mechanistic (cognitive) perspective that attempts to explain the influence of outcomes on behavior. Orthogonal to this distinction, some have focused on the influence of outcomes that a behavior had in the past, whereas others also consider the influence of outcomes that a behavior might have in the future. In this article, we relate these different perspectives with the goal of reducing misunderstandings and fostering collaborations between researchers who adopt different perspectives on the common question of how behavior is influenced by its outcomes.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"121 1","pages":"123-133"},"PeriodicalIF":2.7,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50158260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Delayed matching to sample (DMTS) increases the probability of equivalence class formation. Precurrent responses can mediate the retention interval in DMTS trials and control the selection of comparisons. In human participants, precurrent responses usually consist of naming the experimental stimuli based on their similarities to meaningful stimuli with preexperimental history. We tested whether precurrents expand classes by serving as nodes between experimental and meaningful stimuli. A DMTS (2 s) was used throughout the entire experiment. Eleven undergraduates learned A1B1 and A2B2 relations and then were submitted to ArC trials that required them to answer math problems presented during the DMTS interval: when the sample was A1, the problems resulted in 12 and C1 was correct; when the sample was A2, they resulted in 9 and C2 was correct. Response-as-node tests assessed whether participants would relate B1 and C1 to the printed number 12 and B2 and C2 to the printed number 9. Ten participants responded accordingly to this pattern, showing that the responses to the problems expanded the classes. Parity tests using the words “even” and “odd” further confirmed this hypothesis. These results contribute to understanding why DMTS enhances equivalence performances. Implications of using this procedure in stimulus-equivalence studies are discussed.
{"title":"Evidence of precurrent responses expanding equivalence classes in a delayed matching-to-sample task","authors":"Giovan W. Ribeiro, Deisy G. de Souza","doi":"10.1002/jeab.886","DOIUrl":"10.1002/jeab.886","url":null,"abstract":"<p>Delayed matching to sample (DMTS) increases the probability of equivalence class formation. Precurrent responses can mediate the retention interval in DMTS trials and control the selection of comparisons. In human participants, precurrent responses usually consist of naming the experimental stimuli based on their similarities to meaningful stimuli with preexperimental history. We tested whether precurrents expand classes by serving as nodes between experimental and meaningful stimuli. A DMTS (2 s) was used throughout the entire experiment. Eleven undergraduates learned A1B1 and A2B2 relations and then were submitted to ArC trials that required them to answer math problems presented during the DMTS interval: when the sample was A1, the problems resulted in 12 and C1 was correct; when the sample was A2, they resulted in 9 and C2 was correct. Response-as-node tests assessed whether participants would relate B1 and C1 to the printed number 12 and B2 and C2 to the printed number 9. Ten participants responded accordingly to this pattern, showing that the responses to the problems expanded the classes. Parity tests using the words “even” and “odd” further confirmed this hypothesis. These results contribute to understanding why DMTS enhances equivalence performances. Implications of using this procedure in stimulus-equivalence studies are discussed.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"121 2","pages":"151-162"},"PeriodicalIF":2.7,"publicationDate":"2023-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41136527","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Three pigeon dyads were exposed to a two-component multiple schedule comprised of two tandem variable-interval 30-s interresponse time (IRT) > 3-s schedules in the presence of different stimuli. Pecks to keys by both pigeons of a dyad occurring within 500 ms of one another were required for reinforcement under one tandem schedule (the coordination component), and such coordinated responses were not required under the other (the control component). The terminal link of each schedule ensured that the reinforced coordination response was an IRT > 3 s. Rates of coordinated IRTs > 3 s and total rates of coordinated responses (composed of IRTs > 3 s and IRTs ≤ 3 s) were higher in the coordination components than in either of two different control components in which coordination was not required for reinforcement. This difference in coordinated responses in the presence and absence of the coordination requirement under stimulus control transitorily deteriorated and then was reestablished when the relation between the stimulus and the coordination contingency or its absence was reversed. The results show coordinated responding to function as a discriminated social operant.
{"title":"Stimulus control of a social operant","authors":"Kennon A. Lattal, Hiroto Okouchi","doi":"10.1002/jeab.878","DOIUrl":"10.1002/jeab.878","url":null,"abstract":"<p>Three pigeon dyads were exposed to a two-component multiple schedule comprised of two tandem variable-interval 30-s interresponse time (IRT) > 3-s schedules in the presence of different stimuli. Pecks to keys by both pigeons of a dyad occurring within 500 ms of one another were required for reinforcement under one tandem schedule (the coordination component), and such coordinated responses were not required under the other (the control component). The terminal link of each schedule ensured that the reinforced coordination response was an IRT > 3 s. Rates of coordinated IRTs > 3 s and total rates of coordinated responses (composed of IRTs > 3 s and IRTs ≤ 3 s) were higher in the coordination components than in either of two different control components in which coordination was not required for reinforcement. This difference in coordinated responses in the presence and absence of the coordination requirement under stimulus control transitorily deteriorated and then was reestablished when the relation between the stimulus and the coordination contingency or its absence was reversed. The results show coordinated responding to function as a discriminated social operant.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"120 3","pages":"330-343"},"PeriodicalIF":2.7,"publicationDate":"2023-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41136529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Carlos Eduardo Costa, André Connor de Méo Luiz, Lucas Franco Carmona, Guilherme Dutra Ponce, Roberto Alves Banaco, Kennon A. Lattal
Behavioral momentum theory (BMT) provides a theoretical and methodological framework for understanding how differentially maintained operant responding resists disruption. A common way to test operant resistance involves contingencies with suppressive effects, such as extinction or prefeeding. Other contingencies with known suppressive effects, such as response-cost procedures arranged as point-loss or increases in response force, remain untested as disruptive events within the BMT framework. In the present set of three experiments, responding of humans was maintained by point accumulation programmed according to a multiple variable-interval (VI) VI schedule with different reinforcement rates in either of two components. Subsequently, subtracting a point following each response (Experiment 1) or increasing the force required for the response to be registered (Experiments 2 and 3 decreased response rates, but responding was less disrupted in the component associated with the higher reinforcement rate. The point-loss contingency and increased response force similarly affected response rates by suppressing responding and human persistence, replicating previous findings with humans and nonhuman animals when other types of disruptive events (e.g., extinction and prefeeding) were investigated. The present findings moreover extend the generality of the effects of reinforcement rate on persistence, and thus BMT, extending the analysis of resistance to two well-known manipulations used to reduce responding in the experimental analysis of behavior.
{"title":"Response-dependent point loss and response force as disrupting operations on behavioral resistance to change in humans","authors":"Carlos Eduardo Costa, André Connor de Méo Luiz, Lucas Franco Carmona, Guilherme Dutra Ponce, Roberto Alves Banaco, Kennon A. Lattal","doi":"10.1002/jeab.885","DOIUrl":"10.1002/jeab.885","url":null,"abstract":"<p>Behavioral momentum theory (BMT) provides a theoretical and methodological framework for understanding how differentially maintained operant responding resists disruption. A common way to test operant resistance involves contingencies with suppressive effects, such as extinction or prefeeding. Other contingencies with known suppressive effects, such as response-cost procedures arranged as point-loss or increases in response force, remain untested as disruptive events within the BMT framework. In the present set of three experiments, responding of humans was maintained by point accumulation programmed according to a multiple variable-interval (VI) VI schedule with different reinforcement rates in either of two components. Subsequently, subtracting a point following each response (Experiment 1) or increasing the force required for the response to be registered (Experiments 2 and 3 decreased response rates, but responding was less disrupted in the component associated with the higher reinforcement rate. The point-loss contingency and increased response force similarly affected response rates by suppressing responding and human persistence, replicating previous findings with humans and nonhuman animals when other types of disruptive events (e.g., extinction and prefeeding) were investigated. The present findings moreover extend the generality of the effects of reinforcement rate on persistence, and thus BMT, extending the analysis of resistance to two well-known manipulations used to reduce responding in the experimental analysis of behavior.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"121 2","pages":"163-174"},"PeriodicalIF":2.7,"publicationDate":"2023-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41136528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Luis Antonio Pérez-González, Héctor Martínez, Marlon Palomino
We hypothesized that a three-sample conditional discrimination can emerge as a result of learning conditional discriminations with relational stimuli. After learning three first-order conditional discriminations AB, PQ, and CD, we taught a second-order conditional discrimination XAB in which X1 indicated selection of related stimuli (e.g., A1 and B1) and X2 of unrelated stimuli (e.g., A1 and B2). Then, we probed the emergence of conditional discriminations PQX and XCD in which the X stimuli were comparisons and contextual stimuli, respectively. Finally, a conditional discrimination was probed with stimuli P, Q, and C as samples and D1 and D2 as comparisons. When the P and Q stimuli were related (and related to X1 in PQX), all participants selected the D stimulus that was related to the C stimulus (D1 when C1 was present and D2 when C2 was present); when the P and Q stimuli were unrelated (and related to X2 in PQX), they selected the D stimulus unrelated to the C stimulus (D2 when C1 and D1 when C2), which demonstrated emergence based on the relations established among all stimuli. In Experiment 2, the teaching of XAB was omitted and only one in six participants demonstrated emergence, which indicated that relational stimuli X1 and X2 played an important role in emergence. Thus, a new type of emergence that mimics analogical reasoning was demonstrated. The obtained outcome suggests that this procedure provides a learning foundation for acquiring reasoning capabilities.
{"title":"Emergence of a three-sample conditional discrimination as foundation for reasoning capabilities","authors":"Luis Antonio Pérez-González, Héctor Martínez, Marlon Palomino","doi":"10.1002/jeab.877","DOIUrl":"10.1002/jeab.877","url":null,"abstract":"<p>We hypothesized that a three-sample conditional discrimination can emerge as a result of learning conditional discriminations with relational stimuli. After learning three first-order conditional discriminations AB, PQ, and CD, we taught a second-order conditional discrimination XAB in which X1 indicated selection of related stimuli (e.g., A1 and B1) and X2 of unrelated stimuli (e.g., A1 and B2). Then, we probed the emergence of conditional discriminations PQX and XCD in which the X stimuli were comparisons and contextual stimuli, respectively. Finally, a conditional discrimination was probed with stimuli P, Q, and C as samples and D1 and D2 as comparisons. When the P and Q stimuli were related (and related to X1 in PQX), all participants selected the D stimulus that was related to the C stimulus (D1 when C1 was present and D2 when C2 was present); when the P and Q stimuli were unrelated (and related to X2 in PQX), they selected the D stimulus unrelated to the C stimulus (D2 when C1 and D1 when C2), which demonstrated emergence based on the relations established among all stimuli. In Experiment 2, the teaching of XAB was omitted and only one in six participants demonstrated emergence, which indicated that relational stimuli X1 and X2 played an important role in emergence. Thus, a new type of emergence that mimics analogical reasoning was demonstrated. The obtained outcome suggests that this procedure provides a learning foundation for acquiring reasoning capabilities.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"120 3","pages":"376-393"},"PeriodicalIF":2.7,"publicationDate":"2023-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41179194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study investigated how goal-directed and habitual behaviors recover after extinction within the context of the resurgence effect, a form of relapse induced by the removal or worsening of alternative reinforcement. Rats were trained to press a target lever with one reinforcer (O1) for either minimal (4) or extended (16) sessions. An extinction test after the completion of O1 devaluation confirmed that minimal and extended training formed goal-directed and habitual behaviors, respectively. Then, pressing an alternative lever was reinforced with a second reinforcer (O2) while the target response was placed on extinction. When O2 was discontinued, the minimally trained target response resurged with goal-directed status as in the extinction test. However, the extinguished habitual behavior in the extensively trained rats did not recover as a habit but instead with goal-directed status, possibly due to the context specificity of habits or the introduction of a new response–reinforcer contingency. The critical finding that reinforcer devaluation consistently led to less resurgence regardless of the amount of acquisition training provides a clinical implication that coupling differential-reinforcement-of-alternative-behavior (DRA) treatments with the devaluation of the associated reinforcer of problematic behavior could effectively diminish its recurrence.
{"title":"Resurgence of goal-directed actions and habits","authors":"Shun Fujimaki, Ting Hu, Yutaka Kosaki","doi":"10.1002/jeab.884","DOIUrl":"10.1002/jeab.884","url":null,"abstract":"<p>This study investigated how goal-directed and habitual behaviors recover after extinction within the context of the resurgence effect, a form of relapse induced by the removal or worsening of alternative reinforcement. Rats were trained to press a target lever with one reinforcer (O1) for either minimal (4) or extended (16) sessions. An extinction test after the completion of O1 devaluation confirmed that minimal and extended training formed goal-directed and habitual behaviors, respectively. Then, pressing an alternative lever was reinforced with a second reinforcer (O2) while the target response was placed on extinction. When O2 was discontinued, the minimally trained target response resurged with goal-directed status as in the extinction test. However, the extinguished habitual behavior in the extensively trained rats did not recover as a habit but instead with goal-directed status, possibly due to the context specificity of habits or the introduction of a new response–reinforcer contingency. The critical finding that reinforcer devaluation consistently led to less resurgence regardless of the amount of acquisition training provides a clinical implication that coupling differential-reinforcement-of-alternative-behavior (DRA) treatments with the devaluation of the associated reinforcer of problematic behavior could effectively diminish its recurrence.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"121 1","pages":"97-107"},"PeriodicalIF":2.7,"publicationDate":"2023-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10246587","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The three principles of reinforcement are (1) events such as incentives and reinforcers increase the activity of an organism; (2) that activity is bounded by competition from other responses; and (3) animals approach incentives and their signs, guided by their temporal and physical conditions, together called the “contingencies of reinforcement.” Mathematical models of each of these principles comprised mathematical principles of reinforcement (MPR; Killeen, 1994). Over the ensuing decades, MPR was extended to new experimental contexts. This article reviews the basic theory and its extensions to satiation, warm-up, extinction, sign tracking, pausing, and sequential control in progressive-ratio and multiple schedules. In the latter cases, a single equation balancing target and competing responses governs behavioral contrast and behavioral momentum. Momentum is intrinsic in the fundamental equations, as behavior unspools more slowly from highly aroused responses conditioned by higher rates of incitement than it does from responses from leaner contexts. Habits are responses that have accrued substantial behavioral momentum. Operant responses, being predictors of reinforcement, are approached by making them: The sight and feel of a paw on a lever is approached by placing paw on lever, as attempted for any sign of reinforcement. Behavior in concurrent schedules is governed by approach to momentarily richer patches (melioration). Applications of MPR in behavioral pharmacology and delay discounting are noted.
{"title":"Theory of reinforcement schedules","authors":"Peter R. Killeen","doi":"10.1002/jeab.880","DOIUrl":"10.1002/jeab.880","url":null,"abstract":"<p>The three principles of reinforcement are (1) events such as incentives and reinforcers increase the activity of an organism; (2) that activity is bounded by competition from other responses; and (3) animals approach incentives and their signs, guided by their temporal and physical conditions, together called the “contingencies of reinforcement.” Mathematical models of each of these principles comprised <i>mathematical principles of reinforcement</i> (MPR; Killeen, 1994)<i>.</i> Over the ensuing decades, MPR was extended to new experimental contexts. This article reviews the basic theory and its extensions to satiation, warm-up, extinction, sign tracking, pausing, and sequential control in progressive-ratio and multiple schedules. In the latter cases, a single equation balancing target and competing responses governs behavioral contrast and behavioral momentum. Momentum is intrinsic in the fundamental equations, as behavior unspools more slowly from highly aroused responses conditioned by higher rates of incitement than it does from responses from leaner contexts. Habits are responses that have accrued substantial behavioral momentum. Operant responses, being predictors of reinforcement, are approached by making them: The sight and feel of a paw on a lever is approached by placing paw on lever, as attempted for any sign of reinforcement. Behavior in concurrent schedules is governed by approach to momentarily richer patches (melioration). Applications of MPR in behavioral pharmacology and delay discounting are noted.</p>","PeriodicalId":17411,"journal":{"name":"Journal of the experimental analysis of behavior","volume":"120 3","pages":"289-319"},"PeriodicalIF":2.7,"publicationDate":"2023-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10598239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}