{"title":"Cognitive effort assessment through pupillary responses: Insights from multinomial processing tree modeling and neural interconnections","authors":"Gahangir Hossain, J. Elkins","doi":"10.30935/ojcmt/14196","DOIUrl":null,"url":null,"abstract":"The pupillary responses of humans exhibit variations in size, which are mediated by optic and oculomotor cranial nerves. Due to their sensitivity and high resolution of pupillary responses, they are used for a long time as measurement metrics of cognitive effort. Investigating the extent of cognitive effort required during tasks of varying difficulty is crucial for understanding the neural interconnections underlying these pupillary responses. This study aims to assess human cognitive efforts involved in visually presented cognitive tasks using the multinomial processing tree (MPT) model, an analytical tool that disentangles and predicts distinct cognitive processes, resulting in changes in pupil diameter. To achieve this, a pupillary response dataset was collected during mental multiplication (MM) tasks and visual stimuli presentations as cognitive tasks. MPT model describes observed response frequencies across various response categories and determines the transition probabilities from one latent state to the next. The expectation maximization (EM) algorithm is employed with MPT model to estimate parameter values based on response frequency within each category. Both group-level and individual subject-to-subject comparisons are conducted to estimate cognitive effort. The results reveal that in the group comparison and with respect to task difficulty level, that subject’s knowledge on MM task influences the successfully solve the problem. Regarding individual analysis, no significant differences are observed in parameters related to correct recall, problem-solving ability, and time constraint compliance. However, some significant differences are found in parameters associated with the perceived difficulty level and ability to recall the correct answers. MPT model combined with EM algorithm constitutes a probabilistic model that enhances pupillary responses identification related to the cognitive effort. Potential applications of this model include disease diagnostics based on parameter values and identification of neural pathways that are involved in the pupillary response and subject’s cognitive effort. Furthermore, efforts are underway to connect this psychological model with an artificial neural network.","PeriodicalId":42941,"journal":{"name":"Online Journal of Communication and Media Technologies","volume":null,"pages":null},"PeriodicalIF":0.7000,"publicationDate":"2024-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Online Journal of Communication and Media Technologies","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.30935/ojcmt/14196","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMMUNICATION","Score":null,"Total":0}
引用次数: 0
Abstract
The pupillary responses of humans exhibit variations in size, which are mediated by optic and oculomotor cranial nerves. Due to their sensitivity and high resolution of pupillary responses, they are used for a long time as measurement metrics of cognitive effort. Investigating the extent of cognitive effort required during tasks of varying difficulty is crucial for understanding the neural interconnections underlying these pupillary responses. This study aims to assess human cognitive efforts involved in visually presented cognitive tasks using the multinomial processing tree (MPT) model, an analytical tool that disentangles and predicts distinct cognitive processes, resulting in changes in pupil diameter. To achieve this, a pupillary response dataset was collected during mental multiplication (MM) tasks and visual stimuli presentations as cognitive tasks. MPT model describes observed response frequencies across various response categories and determines the transition probabilities from one latent state to the next. The expectation maximization (EM) algorithm is employed with MPT model to estimate parameter values based on response frequency within each category. Both group-level and individual subject-to-subject comparisons are conducted to estimate cognitive effort. The results reveal that in the group comparison and with respect to task difficulty level, that subject’s knowledge on MM task influences the successfully solve the problem. Regarding individual analysis, no significant differences are observed in parameters related to correct recall, problem-solving ability, and time constraint compliance. However, some significant differences are found in parameters associated with the perceived difficulty level and ability to recall the correct answers. MPT model combined with EM algorithm constitutes a probabilistic model that enhances pupillary responses identification related to the cognitive effort. Potential applications of this model include disease diagnostics based on parameter values and identification of neural pathways that are involved in the pupillary response and subject’s cognitive effort. Furthermore, efforts are underway to connect this psychological model with an artificial neural network.
人类的瞳孔反应大小不一,由视神经和眼球运动颅神经介导。由于瞳孔反应的灵敏性和高分辨率,它们长期以来一直被用作认知努力的测量指标。调查不同难度任务中所需的认知努力程度对于了解这些瞳孔反应背后的神经互连至关重要。多叉处理树(MPT)模型是一种分析工具,它能分解和预测不同的认知过程,从而导致瞳孔直径的变化。为此,我们收集了心算乘法(MM)任务和视觉刺激呈现作为认知任务时的瞳孔反应数据集。MPT 模型描述了在各种反应类别中观察到的反应频率,并确定了从一个潜伏状态到下一个潜伏状态的过渡概率。期望最大化(EM)算法与 MPT 模型一起使用,根据每个类别中的反应频率来估计参数值。为了估算认知努力,我们进行了组间比较和受试者间比较。结果显示,在群体比较中,就任务难度而言,受试者对 MM 任务的了解程度会影响其成功解决问题的程度。在个体分析方面,与正确回忆、解决问题能力和遵守时间限制相关的参数没有发现显著差异。然而,在与感知难度水平和回忆正确答案的能力相关的参数方面,却发现了一些明显的差异。MPT 模型与 EM 算法相结合构成了一个概率模型,可增强与认知努力相关的瞳孔反应识别能力。该模型的潜在应用包括根据参数值进行疾病诊断,以及识别参与瞳孔反应和受试者认知努力的神经通路。此外,目前正在努力将这一心理模型与人工神经网络连接起来。