首页 > 最新文献

Cognitive Computation and Systems最新文献

英文 中文
Abnormal event detection model using an improved ResNet101 in context aware surveillance system 基于改进的ResNet101的环境感知监控系统异常事件检测模型
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-06-01 DOI: 10.1049/ccs2.12084
Rakesh Kalshetty, A.Vajitha Parveen
Surveillance system plays a significant role for achieving security monitoring in the place of crowd areas. Offline monitoring of these crowd activity is quite challenging because it requires huge number of human resources for attaining efficient tracking. For shortcoming these issue automated and intelligent based system must be developed for efficiently monitor crowd and detect abnormal activity. However the existing methods faces issues like irrelevant features, high cost and process complexity. In this current research context aware surveillance‐system utilising hybrid ResNet101‐ANN is developed for effective abnormal activity detection. For this proposed approach video acquired from surveillance camera is considered as input. Then, acquired video is segmented into multiple frames. After that pre‐processing techniques such as denoising using mean filter, motion deblurring, contrast enhancement using Histogram Equalisation and canny edge detection is applied in this segmented frames. Further, the pre‐processed frame is fetched into hybrid ResNet101‐ANN classifier for abnormal event classification. Here, ResNet101 is used for extracting the features from the frames and Artificial neural network which replaces the fully connected layer of ResNet101 us used to detect the abnormal activity. If once abnormal‐events detected the context aware services generate alert to the user for preventing abnormal‐activities. Accuracy, precision, recall, and error values reached for the proposed‐model on simulation were 0.98, 0.98, 0.98 and 0.017 respectively. Using this proposed model effective crowd monitoring and abnormal activity detection can be achieved.
监控系统是实现人群聚集场所安全监控的重要手段。这些人群活动的离线监测是相当具有挑战性的,因为它需要大量的人力资源来实现有效的跟踪。针对这些问题的不足,必须开发基于自动化和智能化的系统,以便有效地监控人群和检测异常活动。但现有方法存在特征不相关、成本高、工艺复杂等问题。在当前的研究背景下,利用ResNet101 - ANN混合的感知监测系统被开发用于有效的异常活动检测。在该方法中,从监控摄像机获取的视频作为输入。然后,将采集到的视频分割成多帧。之后,预处理技术,如使用均值滤波去噪,运动去模糊,对比度增强使用直方图均衡化和巧妙的边缘检测应用于这个分割帧。然后,将预处理后的帧提取到ResNet101 - ANN混合分类器中进行异常事件分类。在这里,ResNet101用于从帧中提取特征,人工神经网络取代ResNet101的全连接层,用于检测异常活动。一旦检测到异常事件,上下文感知服务就会向用户发出警报,以防止异常活动。在模拟中,所提出模型的准确度、精密度、召回率和误差值分别为0.98、0.98、0.98和0.017。利用该模型可以实现有效的人群监控和异常活动检测。
{"title":"Abnormal event detection model using an improved ResNet101 in context aware surveillance system","authors":"Rakesh Kalshetty, A.Vajitha Parveen","doi":"10.1049/ccs2.12084","DOIUrl":"https://doi.org/10.1049/ccs2.12084","url":null,"abstract":"Surveillance system plays a significant role for achieving security monitoring in the place of crowd areas. Offline monitoring of these crowd activity is quite challenging because it requires huge number of human resources for attaining efficient tracking. For shortcoming these issue automated and intelligent based system must be developed for efficiently monitor crowd and detect abnormal activity. However the existing methods faces issues like irrelevant features, high cost and process complexity. In this current research context aware surveillance‐system utilising hybrid ResNet101‐ANN is developed for effective abnormal activity detection. For this proposed approach video acquired from surveillance camera is considered as input. Then, acquired video is segmented into multiple frames. After that pre‐processing techniques such as denoising using mean filter, motion deblurring, contrast enhancement using Histogram Equalisation and canny edge detection is applied in this segmented frames. Further, the pre‐processed frame is fetched into hybrid ResNet101‐ANN classifier for abnormal event classification. Here, ResNet101 is used for extracting the features from the frames and Artificial neural network which replaces the fully connected layer of ResNet101 us used to detect the abnormal activity. If once abnormal‐events detected the context aware services generate alert to the user for preventing abnormal‐activities. Accuracy, precision, recall, and error values reached for the proposed‐model on simulation were 0.98, 0.98, 0.98 and 0.017 respectively. Using this proposed model effective crowd monitoring and abnormal activity detection can be achieved.","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"5 1","pages":"153-167"},"PeriodicalIF":0.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57692010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Detection of emotional and behavioural changes after traumatic brain injury: A comprehensive survey 创伤性脑损伤后情绪和行为变化的检测:一项综合调查
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-03-07 DOI: 10.1049/ccs2.12075
Neha Vutakuri

Traumatic brain injury (TBI) can affect normal brain function and may be caused by a vehicle accident, falling, and so on. The purpose of this survey is to provide clear knowledge of TBI, the causes of TBI, the impacts of TBI, and the role of family members and friends in recovery. TBI affects the daily life of the patients, both physically and mentally. After TBI, the patients may experience many emotional and behavioural changes because of a lack of certain brain functions. These changes affect their personal and social relationships. On the other hand, these changes depend on the severity of the TBI (i.e. mild, moderate, or severe), which is measured using the Glasgow coma score. Generally, three processes are used for emotion recognition: preprocessing, feature extraction, and emotion recognition. Preprocessing is performed for landmark detection and pose normalisation, which improves the performance of emotion detection. Feature extraction and emotion recognition are performed by various deep learning techniques, such as convolution neural networks and long short-term memory. These techniques recognise the behavioural and emotional changes (depression, anxiety, anger, personality changes etc.) of TBI patients using facial expressions. Family members and friends play an important role in TBI patients' recovery, the extent of which is based on the severity of the TBI. The care of family members and friends leads to quick recovery and rehabilitation of patients from TBI. Finally, testing is performed using Computed Tomography images, Magnetic Resonance Imaging images, Electroencephalography signals, and patient demographics, which together show that the deep learning methods achieve better performance in terms of accuracy, precision, recall, and F-measure in recognising emotional and behavioural changes after TBI. The authors conclude with a summary of the future of emotional and behavioural change prediction methods for TBI patients.

创伤性脑损伤(TBI)会影响正常的大脑功能,可能是由车祸、跌倒等引起的。本调查的目的是提供有关TBI、TBI的原因、TBI影响以及家人和朋友在康复中的作用的明确知识。TBI影响患者的日常生活,包括身体和精神。TBI后,由于缺乏某些大脑功能,患者可能会经历许多情绪和行为变化。这些变化会影响他们的个人和社会关系。另一方面,这些变化取决于TBI的严重程度(即轻度、中度或重度),这是使用格拉斯哥昏迷评分来测量的。情绪识别通常采用三个过程:预处理、特征提取和情绪识别。对地标检测和姿态归一化进行预处理,提高了情绪检测的性能。特征提取和情绪识别是通过各种深度学习技术进行的,如卷积神经网络和长短期记忆。这些技术通过面部表情识别TBI患者的行为和情绪变化(抑郁、焦虑、愤怒、性格变化等)。家人和朋友在TBI患者的康复中起着重要作用,康复程度取决于TBI的严重程度。家人和朋友的照顾使TBI患者快速康复。最后,使用计算机断层扫描图像、磁共振成像图像、脑电图信号和患者人口统计数据进行测试,这些数据共同表明,深度学习方法在识别TBI后的情绪和行为变化方面,在准确性、准确性、回忆力和F测量方面取得了更好的性能。作者总结了TBI患者情绪和行为变化预测方法的未来。
{"title":"Detection of emotional and behavioural changes after traumatic brain injury: A comprehensive survey","authors":"Neha Vutakuri","doi":"10.1049/ccs2.12075","DOIUrl":"https://doi.org/10.1049/ccs2.12075","url":null,"abstract":"<p>Traumatic brain injury (TBI) can affect normal brain function and may be caused by a vehicle accident, falling, and so on. The purpose of this survey is to provide clear knowledge of TBI, the causes of TBI, the impacts of TBI, and the role of family members and friends in recovery. TBI affects the daily life of the patients, both physically and mentally. After TBI, the patients may experience many emotional and behavioural changes because of a lack of certain brain functions. These changes affect their personal and social relationships. On the other hand, these changes depend on the severity of the TBI (i.e. mild, moderate, or severe), which is measured using the Glasgow coma score. Generally, three processes are used for emotion recognition: preprocessing, feature extraction, and emotion recognition. Preprocessing is performed for landmark detection and pose normalisation, which improves the performance of emotion detection. Feature extraction and emotion recognition are performed by various deep learning techniques, such as convolution neural networks and long short-term memory. These techniques recognise the behavioural and emotional changes (depression, anxiety, anger, personality changes etc.) of TBI patients using facial expressions. Family members and friends play an important role in TBI patients' recovery, the extent of which is based on the severity of the TBI. The care of family members and friends leads to quick recovery and rehabilitation of patients from TBI. Finally, testing is performed using Computed Tomography images, Magnetic Resonance Imaging images, Electroencephalography signals, and patient demographics, which together show that the deep learning methods achieve better performance in terms of accuracy, precision, recall, and F-measure in recognising emotional and behavioural changes after TBI. The authors conclude with a summary of the future of emotional and behavioural change prediction methods for TBI patients.</p>","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"5 1","pages":"42-63"},"PeriodicalIF":0.0,"publicationDate":"2023-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12075","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50137433","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Detection of pedestrians and vehicles in autonomous driving with selective kernel networks 基于选择性核网络的自动驾驶中行人和车辆检测
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-03-03 DOI: 10.1049/ccs2.12078
Zhenlin Zhang, Gao Hanwen, Xingang Wu

Accurate detection of pedestrians and vehicles on the road is an important content in autonomous driving technology. In this article, a method to optimise the object detection network using the channel attention mechanism is proposed. In general, small object detection problems and difficult sample detection problems in object detection tasks can be solved by using feature pyramids. Different from building a feature pyramid, the authors did not make extensive changes to the network, but used the channel attention mechanism to dynamically adjust the output of a layer during the feature extraction process, allowing each neuron to adjust its receptive field size adaptively according to multiple scales of the input information, so that the network pays attention to the extraction of important features, especially the features of small objects and difficult samples. In order to evaluate the performance of the proposed method, experiments were conducted on standard benchmark data sets. It has been observed that the proposed method is superior to the original object detection network in terms of the detection accuracy of pedestrians and vehicles, especially the detection of small objects.

准确检测道路上的行人和车辆是自动驾驶技术的重要内容。本文提出了一种利用通道注意力机制优化目标检测网络的方法。通常,可以通过使用特征金字塔来解决对象检测任务中的小对象检测问题和难样本检测问题。与构建特征金字塔不同,作者没有对网络进行广泛的改变,而是在特征提取过程中使用通道注意力机制动态调整一层的输出,允许每个神经元根据输入信息的多个尺度自适应地调整其感受野大小,使得网络注重重要特征的提取,特别是小对象和难样本的特征。为了评估所提出方法的性能,在标准基准数据集上进行了实验。已经观察到,在行人和车辆的检测精度方面,特别是在小物体的检测方面,所提出的方法优于原始物体检测网络。
{"title":"Detection of pedestrians and vehicles in autonomous driving with selective kernel networks","authors":"Zhenlin Zhang,&nbsp;Gao Hanwen,&nbsp;Xingang Wu","doi":"10.1049/ccs2.12078","DOIUrl":"https://doi.org/10.1049/ccs2.12078","url":null,"abstract":"<p>Accurate detection of pedestrians and vehicles on the road is an important content in autonomous driving technology. In this article, a method to optimise the object detection network using the channel attention mechanism is proposed. In general, small object detection problems and difficult sample detection problems in object detection tasks can be solved by using feature pyramids. Different from building a feature pyramid, the authors did not make extensive changes to the network, but used the channel attention mechanism to dynamically adjust the output of a layer during the feature extraction process, allowing each neuron to adjust its receptive field size adaptively according to multiple scales of the input information, so that the network pays attention to the extraction of important features, especially the features of small objects and difficult samples. In order to evaluate the performance of the proposed method, experiments were conducted on standard benchmark data sets. It has been observed that the proposed method is superior to the original object detection network in terms of the detection accuracy of pedestrians and vehicles, especially the detection of small objects.</p>","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"5 1","pages":"64-70"},"PeriodicalIF":0.0,"publicationDate":"2023-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12078","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50119479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Review on human-like robot manipulation using dexterous hands 灵巧手类人机器人操作综述
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-02-18 DOI: 10.1049/ccs2.12073
Suhas Kadalagere Sampath, Ning Wang, Hao Wu, Chenguang Yang

In recent years, human hand-based robotic hands or dexterous hands have gained attention due to their enormous capabilities of handling soft materials compared to traditional grippers. Back in the earlier days, the development of a hand model close to that of a human was an impossible task but with the advancements made in technology, dexterous hands with three, four or five-fingered robotic hands have been developed to mimic human hand nature. However, human-like manipulation of dexterous hands to this date remains a challenge. Thus, this review focuses on (a) the history and motivation behind the development of dexterous hands, (b) a brief overview of the available multi-fingered hands, and (c) learning-based methods such as traditional and data-driven learning methods for manipulating dexterous hands. Additionally, it discusses the challenges faced in terms of the manipulation of multi-fingered or dexterous hands.

近年来,与传统的抓取器相比,基于人手的机械手或灵巧手由于其处理软材料的巨大能力而受到关注。在早期,开发一种接近人类的手模型是一项不可能完成的任务,但随着技术的进步,用三指、四指或五指机械手制作的灵巧手已经被开发出来,以模仿人类的手的本性。然而,迄今为止,人类对灵巧双手的操作仍然是一个挑战。因此,这篇综述的重点是(a)灵巧手发展的历史和动机,(b)现有多指手的简要概述,以及(c)基于学习的方法,如操纵灵巧手的传统和数据驱动的学习方法。此外,它还讨论了在多指或灵巧手的操作方面面临的挑战。
{"title":"Review on human-like robot manipulation using dexterous hands","authors":"Suhas Kadalagere Sampath,&nbsp;Ning Wang,&nbsp;Hao Wu,&nbsp;Chenguang Yang","doi":"10.1049/ccs2.12073","DOIUrl":"https://doi.org/10.1049/ccs2.12073","url":null,"abstract":"<p>In recent years, human hand-based robotic hands or dexterous hands have gained attention due to their enormous capabilities of handling soft materials compared to traditional grippers. Back in the earlier days, the development of a hand model close to that of a human was an impossible task but with the advancements made in technology, dexterous hands with three, four or five-fingered robotic hands have been developed to mimic human hand nature. However, human-like manipulation of dexterous hands to this date remains a challenge. Thus, this review focuses on (a) the history and motivation behind the development of dexterous hands, (b) a brief overview of the available multi-fingered hands, and (c) learning-based methods such as traditional and data-driven learning methods for manipulating dexterous hands. Additionally, it discusses the challenges faced in terms of the manipulation of multi-fingered or dexterous hands.</p>","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"5 1","pages":"14-29"},"PeriodicalIF":0.0,"publicationDate":"2023-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12073","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50136978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Adaptive classification helps hybrid visual brain computer interface systems handle non-stationary cortical signals 自适应分类有助于混合视觉脑机接口系统处理非平稳皮层信号
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-02-13 DOI: 10.1049/ccs2.12077
Deepak D. Kapgate, Krishna Prasad. K

The classifier efficiency of the brain-computer interface systems is significantly impacted by the non-stationarity of electroencephalogram (EEG) signals. We propose an adaptive variant of the linear discriminant analysis (LDA) classifier as a solution to this problem. This classifier constantly adjusts its parameters to account for the most recent EEG data. In this study, the authors will update the mean values as well as the covariance matrix of each class pair. Visually evoked cortical potential datasets are used to check how well the proposed classifier performs. The authors prove that the proposed adaptive LDA performs much better than both static multiclass LDA and adaptive PMean LDA.

脑机接口系统的分类器效率受到脑电图(EEG)信号的非平稳性的显著影响。我们提出了一种线性判别分析(LDA)分类器的自适应变体来解决这个问题。该分类器不断调整其参数以考虑最新的EEG数据。在这项研究中,作者将更新每个类对的均值以及协方差矩阵。视觉诱发皮层电位数据集用于检查所提出的分类器的性能。作者证明了所提出的自适应LDA比静态多类LDA和自适应PMean LDA都要好得多。
{"title":"Adaptive classification helps hybrid visual brain computer interface systems handle non-stationary cortical signals","authors":"Deepak D. Kapgate,&nbsp;Krishna Prasad. K","doi":"10.1049/ccs2.12077","DOIUrl":"https://doi.org/10.1049/ccs2.12077","url":null,"abstract":"<p>The classifier efficiency of the brain-computer interface systems is significantly impacted by the non-stationarity of electroencephalogram (EEG) signals. We propose an adaptive variant of the linear discriminant analysis (LDA) classifier as a solution to this problem. This classifier constantly adjusts its parameters to account for the most recent EEG data. In this study, the authors will update the mean values as well as the covariance matrix of each class pair. Visually evoked cortical potential datasets are used to check how well the proposed classifier performs. The authors prove that the proposed adaptive LDA performs much better than both static multiclass LDA and adaptive PMean LDA.</p>","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"5 1","pages":"86-93"},"PeriodicalIF":0.0,"publicationDate":"2023-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12077","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50131152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Review and analysis of deep neural network models for Alzheimer's disease classification using brain medical resonance imaging 脑医学共振成像用于阿尔茨海默病分类的深度神经网络模型综述与分析
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-02-10 DOI: 10.1049/ccs2.12072
Shruti Pallawi, Dushyant Kumar Singh

Alzheimer's disease is a type of progressive neurological disorder which is irreversible and the patient suffers from severe memory loss. This disease is the seventh largest cause of death across the globe. As yet there is no cure for this disease, the only way to control it is its early diagnosis. Deep Learning techniques are mostly preferred in classification tasks because of their high accuracy over a large dataset. The main focus of this paper is on fine-tuning and evaluating the Deep Convolutional Networks for Alzheimer's disease classification. An empirical analysis of various deep learning-based neural network models has been done. The architectures evaluation includes InceptionV3, ResNet with 50 layers and 101 layers and DenseNet with 169 layers. The dataset has been taken from Kaggle which is publicly available and comprises of four classes which represents the various stages of Alzheimer's disease. In our experiment, the accuracy of DenseNet consistently improved with the increase in the number of epochs resulting in a 99.94% testing accuracy score better than the rest of the architectures. Although the results obtained are satisfactory, but for future research, we can apply transfer learning on other deep models like Inception V4, AlexNet etc., to increase accuracy and decrease computational time. Also, in future we can work on other datasets like ADNI or OASIS and use Positron emitted tomography, diffusion tensor imaging neuroimages and their combinations for better result.

阿尔茨海默病是一种进行性神经系统疾病,是不可逆的,患者患有严重的记忆力丧失。这种疾病是全球第七大死亡原因。目前还没有治愈这种疾病的方法,控制它的唯一方法是早期诊断。深度学习技术在分类任务中大多是首选技术,因为它们在大型数据集上具有较高的准确性。本文的主要重点是对用于阿尔茨海默病分类的深度卷积网络进行微调和评估。对各种基于深度学习的神经网络模型进行了实证分析。架构评估包括InceptionV3、具有50层和101层的ResNet以及具有169层的DenseNet。该数据集取自Kaggle,该数据集由四个类别组成,代表阿尔茨海默病的各个阶段。在我们的实验中,DenseNet的准确性随着历元数量的增加而不断提高,导致99.94%的测试准确性得分优于其他架构。虽然获得的结果令人满意,但对于未来的研究,我们可以将迁移学习应用于其他深度模型,如Inception V4、AlexNet等,以提高精度并减少计算时间。此外,在未来,我们可以在其他数据集上工作,如ADNI或OASIS,并使用正电子发射断层扫描、扩散张量成像神经图像及其组合来获得更好的结果。
{"title":"Review and analysis of deep neural network models for Alzheimer's disease classification using brain medical resonance imaging","authors":"Shruti Pallawi,&nbsp;Dushyant Kumar Singh","doi":"10.1049/ccs2.12072","DOIUrl":"https://doi.org/10.1049/ccs2.12072","url":null,"abstract":"<p>Alzheimer's disease is a type of progressive neurological disorder which is irreversible and the patient suffers from severe memory loss. This disease is the seventh largest cause of death across the globe. As yet there is no cure for this disease, the only way to control it is its early diagnosis. Deep Learning techniques are mostly preferred in classification tasks because of their high accuracy over a large dataset. The main focus of this paper is on fine-tuning and evaluating the Deep Convolutional Networks for Alzheimer's disease classification. An empirical analysis of various deep learning-based neural network models has been done. The architectures evaluation includes InceptionV3, ResNet with 50 layers and 101 layers and DenseNet with 169 layers. The dataset has been taken from Kaggle which is publicly available and comprises of four classes which represents the various stages of Alzheimer's disease. In our experiment, the accuracy of DenseNet consistently improved with the increase in the number of epochs resulting in a 99.94% testing accuracy score better than the rest of the architectures. Although the results obtained are satisfactory, but for future research, we can apply transfer learning on other deep models like Inception V4, AlexNet etc., to increase accuracy and decrease computational time. Also, in future we can work on other datasets like ADNI or OASIS and use Positron emitted tomography, diffusion tensor imaging neuroimages and their combinations for better result.</p>","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"5 1","pages":"1-13"},"PeriodicalIF":0.0,"publicationDate":"2023-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12072","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50127206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Speech emotion recognition with artificial intelligence for contact tracing in the COVID-19 pandemic 新冠肺炎大流行中用于接触者追踪的人工智能语音情感识别
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-02-08 DOI: 10.1049/ccs2.12076
Francesco Pucci, Pasquale Fedele, Giovanna Maria Dimitri

If understanding sentiments is already a difficult task in human-human communication, this becomes extremely challenging when a human-computer interaction happens, as for instance in chatbot conversations. In this work, a machine learning neural network-based Speech Emotion Recognition system is presented to perform emotion detection in a chatbot virtual assistant whose task was to perform contact tracing during the COVID-19 pandemic. The system was tested on a novel dataset of audio samples, provided by the company Blu Pantheon, which developed virtual agents capable of autonomously performing contacts tracing for individuals positive to COVID-19. The dataset provided was unlabelled for the emotions associated to the conversations. Therefore, the work was structured using a sort of transfer learning strategy. First, the model is trained using the labelled and publicly available Italian-language dataset EMOVO Corpus. The accuracy achieved in testing phase reached 92%. To the best of their knowledge, thiswork represents the first example in the context of chatbot speech emotion recognition for contact tracing, shedding lights towards the importance of the use of such techniques in virtual assistants and chatbot conversational contexts for psychological human status assessment. The code of this work was publicly released at: https://github.com/fp1acm8/SER.

如果理解情感在人类交流中已经是一项艰巨的任务,那么当人机交互发生时,这将变得极具挑战性,例如在聊天机器人对话中。在这项工作中,提出了一种基于机器学习神经网络的语音情感识别系统,用于在聊天机器人虚拟助手中进行情感检测,该虚拟助手的任务是在新冠肺炎大流行期间进行接触者追踪。该系统在Blu Pantheon公司提供的一个新的音频样本数据集上进行了测试,该公司开发了能够自主追踪新冠肺炎阳性个体接触者的虚拟代理。所提供的数据集未标记与对话相关的情绪。因此,这项工作采用了一种迁移学习策略。首先,使用标记的和公开可用的意大利语数据集EMOVO语料库对模型进行训练。测试阶段的准确率达到92%。据他们所知,这项工作代表了聊天机器人语音情感识别用于联系人追踪的第一个例子,揭示了在虚拟助理和聊天机器人对话环境中使用此类技术对人类心理状态评估的重要性。本作品的代码公开发布于:https://github.com/fp1acm8/SER.
{"title":"Speech emotion recognition with artificial intelligence for contact tracing in the COVID-19 pandemic","authors":"Francesco Pucci,&nbsp;Pasquale Fedele,&nbsp;Giovanna Maria Dimitri","doi":"10.1049/ccs2.12076","DOIUrl":"https://doi.org/10.1049/ccs2.12076","url":null,"abstract":"<p>If understanding sentiments is already a difficult task in human-human communication, this becomes extremely challenging when a human-computer interaction happens, as for instance in chatbot conversations. In this work, a machine learning neural network-based Speech Emotion Recognition system is presented to perform emotion detection in a chatbot virtual assistant whose task was to perform contact tracing during the COVID-19 pandemic. The system was tested on a novel dataset of audio samples, provided by the company Blu Pantheon, which developed virtual agents capable of autonomously performing contacts tracing for individuals positive to COVID-19. The dataset provided was unlabelled for the emotions associated to the conversations. Therefore, the work was structured using a sort of transfer learning strategy. First, the model is trained using the labelled and publicly available Italian-language dataset EMOVO Corpus. The accuracy achieved in testing phase reached 92%. To the best of their knowledge, thiswork represents the first example in the context of chatbot speech emotion recognition for contact tracing, shedding lights towards the importance of the use of such techniques in virtual assistants and chatbot conversational contexts for psychological human status assessment. The code of this work was publicly released at: https://github.com/fp1acm8/SER.</p>","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"5 1","pages":"71-85"},"PeriodicalIF":0.0,"publicationDate":"2023-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12076","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50139375","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An efficient routing protocol for coherent energy using mayfly optimization algorithm in heterogeneous wireless sensor networks 异构无线传感器网络中基于mayfly优化算法的高效相干能量路由协议
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-01 DOI: 10.1049/ccs2.12074
Pathrose Jasmine Lizy, Natarasan Chenthalir Indra
{"title":"An efficient routing protocol for coherent energy using mayfly optimization algorithm in heterogeneous wireless sensor networks","authors":"Pathrose Jasmine Lizy,&nbsp;Natarasan Chenthalir Indra","doi":"10.1049/ccs2.12074","DOIUrl":"https://doi.org/10.1049/ccs2.12074","url":null,"abstract":"","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"5 1","pages":"30-41"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12074","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50144468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cognitive Computation and Systems: First International Conference, ICCCS 2022, Beijing, China, December 17–18, 2022, Revised Selected Papers 认知计算与系统:第一届国际会议,ICCCS 2022,中国北京,2022年12月17-18日,修订论文选集
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-01 DOI: 10.1007/978-981-99-2789-0
{"title":"Cognitive Computation and Systems: First International Conference, ICCCS 2022, Beijing, China, December 17–18, 2022, Revised Selected Papers","authors":"","doi":"10.1007/978-981-99-2789-0","DOIUrl":"https://doi.org/10.1007/978-981-99-2789-0","url":null,"abstract":"","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"51134532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
CORRIGENDUM: [Guest editorial: Music perception and cognition in music technology] 勘误:[客座社论:音乐技术中的音乐感知和认知]
Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-09-01 DOI: 10.1049/ccs2.12071

The authors wish to bring to the readers' attention the following error in the article by Zijin Li and Stephen McAdams, “Guest editorial: Music perception and cognition in music technology” [1].

The co-author Stephen McAdams' name should be removed from the article.

作者希望提请读者注意李紫金和斯蒂芬·麦克亚当斯的文章“客座社论:音乐技术中的音乐感知和认知”[1]中的以下错误。合著者Stephen McAdams的名字应该从文章中删除。
{"title":"CORRIGENDUM: [Guest editorial: Music perception and cognition in music technology]","authors":"","doi":"10.1049/ccs2.12071","DOIUrl":"https://doi.org/10.1049/ccs2.12071","url":null,"abstract":"<p>The authors wish to bring to the readers' attention the following error in the article by Zijin Li and Stephen McAdams, “Guest editorial: Music perception and cognition in music technology” [<span>1</span>].</p><p>The co-author Stephen McAdams' name should be removed from the article.</p>","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"4 4","pages":"400"},"PeriodicalIF":0.0,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12071","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"137630451","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Cognitive Computation and Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1