Information, certainty, and learning.

Justin A Harris, Charles Randy Gallistel
{"title":"Information, certainty, and learning.","authors":"Justin A Harris, Charles Randy Gallistel","doi":"10.1101/2024.07.31.606111","DOIUrl":null,"url":null,"abstract":"More than four decades ago, Gibbon and Balsam (1981) showed that the acquisition of Pavlovian conditioning in pigeons is directly related to the informativeness of the conditioning stimulus (CS) about the unconditioned stimulus (US), where informativeness is defined as the ratio of the US-US interval (C) to the CS-US interval (T). However, the evidence for this relationship in other species has been equivocal. Here, we describe an experiment that measured the acquisition of appetitive Pavlovian conditioning in 14 groups of rats trained with different C/T ratios (ranging from 1.5 to 300) to establish how learning is related to informativeness. We show that the number of trials required for rats to start responding to the CS is determined by the C/T ratio and, remarkably, the specific scalar relationship between the rate of learning and informativeness aligns very closely to that previously obtained with pigeons. We also found that the response rate after extended conditioning is strongly related to T, with the terminal CS response rate being a scalar function of the CS reinforcement rate (1/T). Moreover, this same scalar relationship extended to the rats' response rates during the (never-reinforced) inter-trial interval, which was directly proportional to the contextual rate of reinforcement (1/C). The findings establish that animals encode rates of reinforcement, and that conditioning is directly related to how much information the CS provides about the US. The consistency of the data across species, captured by a simple regression function, suggests a universal model of conditioning","PeriodicalId":501210,"journal":{"name":"bioRxiv - Animal Behavior and Cognition","volume":"5 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"bioRxiv - Animal Behavior and Cognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.07.31.606111","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

More than four decades ago, Gibbon and Balsam (1981) showed that the acquisition of Pavlovian conditioning in pigeons is directly related to the informativeness of the conditioning stimulus (CS) about the unconditioned stimulus (US), where informativeness is defined as the ratio of the US-US interval (C) to the CS-US interval (T). However, the evidence for this relationship in other species has been equivocal. Here, we describe an experiment that measured the acquisition of appetitive Pavlovian conditioning in 14 groups of rats trained with different C/T ratios (ranging from 1.5 to 300) to establish how learning is related to informativeness. We show that the number of trials required for rats to start responding to the CS is determined by the C/T ratio and, remarkably, the specific scalar relationship between the rate of learning and informativeness aligns very closely to that previously obtained with pigeons. We also found that the response rate after extended conditioning is strongly related to T, with the terminal CS response rate being a scalar function of the CS reinforcement rate (1/T). Moreover, this same scalar relationship extended to the rats' response rates during the (never-reinforced) inter-trial interval, which was directly proportional to the contextual rate of reinforcement (1/C). The findings establish that animals encode rates of reinforcement, and that conditioning is directly related to how much information the CS provides about the US. The consistency of the data across species, captured by a simple regression function, suggests a universal model of conditioning
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
信息、确定性和学习。
四十多年前,Gibbon 和 Balsam(1981 年)研究表明,鸽子对巴甫洛夫条件反射的习得与条件刺激(CS)对非条件刺激(US)的信息量直接相关,其中信息量被定义为 US-US 间隔(C)与 CS-US 间隔(T)之比。然而,这种关系在其他物种中的证据并不明确。在这里,我们描述了一项实验,该实验测量了 14 组大鼠在不同的 C/T 比值(从 1.5 到 300 不等)训练下获得食欲巴甫洛夫条件反射的情况,以确定学习与信息量之间的关系。我们的研究表明,大鼠开始对 CS 作出反应所需的试验次数由 C/T 比率决定,而且值得注意的是,学习率与知情度之间的具体标度关系与之前在鸽子身上获得的结果非常接近。我们还发现,扩展条件反射后的反应率与 T 密切相关,最终的 CS 反应率是 CS 强化率(1/T)的标量函数。此外,这种标量关系还延伸到大鼠在(从未被强化的)试验间歇期的反应率,它与情境强化率(1/C)成正比。这些研究结果证明,动物会对强化率进行编码,而条件反射与 CS 提供的美国信息的多少直接相关。通过简单的回归函数可以捕捉到不同物种数据的一致性,这表明存在一种普遍的条件反射模型
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Emotional contexts influence vocal individuality in ungulates Athene cunicularia hypugaea wintering in a central California urban setting arrive later, leave earlier, prefer sheltered micro-habitat, tolerate rain, and contend with diverse predators Monkeys Predict US Elections Meat transfers follow social ties in the multi-level society of Guinea baboons but are not related to male reproductive success Jumping spiders are not fooled by the peripheral drift illusion
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1