首页 > 最新文献

CAAI Transactions on Intelligence Technology最新文献

英文 中文
Guest Editorial: Knowledge-based deep learning system in bio-medicine 特邀社论:生物医学中基于知识的深度学习系统
IF 8.4 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-08-09 DOI: 10.1049/cit2.12364
Yu-Dong Zhang, Juan Manuel Górriz

Numerous healthcare procedures can be viewed as medical sector decisions. In the modern era, computers have become indispensable in the realm of medical decision-making. However, the common view of computers in the medical field typically extends only to applications that support doctors in diagnosing diseases. To more tightly intertwine computers with the biomedical sciences, professionals are now more frequently utilising knowledge-driven deep learning systems (KDLS) and their foundational technologies, especially in the domain of neuroimaging (NI).

Data for medical purposes can be sourced from a variety of imaging techniques, including but not limited to Computed Tomography (CT), Magnetic Resonance Imaging (MRI), Ultrasound, Single Photon Emission Computed Tomography (SPECT), Positron Emission Tomography (PET), Magnetic Particle Imaging (MPI), Electroencephalography (EEG), Magnetoencephalography (MEG), Optical Microscopy and Tomography, Photoacoustic Tomography, Electron Tomography, and Atomic Force Microscopy.

Historically, these imaging techniques have been analysed using traditional statistical methods, such as hypothesis testing or Bayesian inference, which often presuppose certain conditions that are not always met. An emerging solution is the implementation of machine learning (ML) within the context of KDLS, allowing for the empirical mapping of complex, multi-dimensional relationships within data sets.

The objective of this special issue is to showcase the latest advancements in the methodology of KDLS for evaluating functional connectivity, neurological disorders, and clinical neuroscience, such as conditions like Alzheimer's, Parkinson's, cerebrovascular accidents, brain tumours, epilepsy, multiple sclerosis, ALS, Autism Spectrum Disorder, and more. Additionally, the special issue seeks to elucidate the mechanisms behind the predictive capabilities of ML methods within KDLS for brain-related diseases and disorders.

We received an abundance of submissions, totalling more than 40, from over 10 countries. After a meticulous and rigorous peer review process, which employed a double-blind methodology, we ultimately selected eight outstanding papers for publication. This process ensured the highest standards of quality and impartiality in the selection.

In the article ‘A deep learning fusion model for accurate classification of brain tumours in Magnetic Resonance images’, Zebari et al. created a robust deep learning (DL) fusion model for accurate brain tumour classification. To enhance performance, they employed data augmentation to expand the training dataset. The model leveraged VGG16, ResNet50, and convolutional deep belief networks to extract features from MRI images using a softmax classifier. By fusing features from two DL models, the fusion model notably boosted classification precision. Tested with a publicly available dataset, it achieved a remarkable 98.98% accuracy rate, outperforming existing me

许多医疗保健程序都可以被视为医疗部门的决策。在现代,计算机已成为医疗决策领域不可或缺的工具。然而,通常人们对计算机在医疗领域的应用仅限于辅助医生诊断疾病。为了将计算机与生物医学更紧密地结合在一起,专业人士现在更频繁地使用知识驱动的深度学习系统(KDLS)及其基础技术,尤其是在神经成像(NI)领域。用于医疗目的的数据可以来自各种成像技术,包括但不限于计算机断层扫描(CT)、磁共振成像(MRI)、超声波、单光子发射计算机断层扫描(SPECT)、正电子发射计算机断层扫描(PET)、磁粉成像(MPI)、脑电图(EEG)、脑磁图(MEG)、光学显微镜和断层扫描、光声断层扫描、电子断层扫描和原子力显微镜。一直以来,这些成像技术都是采用传统的统计方法进行分析的,如假设检验或贝叶斯推理,而这些方法往往预先假定了某些条件,但这些条件并非总能得到满足。本特刊旨在展示 KDLS 在评估功能连接、神经系统疾病和临床神经科学方面的最新进展,例如阿尔茨海默病、帕金森病、脑血管意外、脑肿瘤、癫痫、多发性硬化、渐冻人症、自闭症等疾病。此外,该特刊还试图阐明 KDLS 中的 ML 方法对脑相关疾病和障碍的预测能力背后的机制。我们收到了来自 10 多个国家的大量投稿,共计 40 多篇。我们收到了来自 10 多个国家的大量投稿,共计 40 篇。经过细致严格的同行评审(采用双盲方法),我们最终选出了 8 篇优秀论文予以发表。在《用于磁共振图像中脑肿瘤精确分类的深度学习融合模型》一文中,Zebari 等人创建了一个强大的深度学习(DL)融合模型,用于精确的脑肿瘤分类。为了提高性能,他们采用了数据增强技术来扩展训练数据集。该模型利用 VGG16、ResNet50 和卷积深度信念网络,使用 softmax 分类器从 MRI 图像中提取特征。通过融合两个 DL 模型的特征,融合模型显著提高了分类精度。在《基于知识的深度学习分类系统》一文中,Dhaygude 等人提出了一种融合了多任务学习和注意力机制的深度三维卷积神经网络。他们利用升级后的初级 C3D 网络来创建更粗糙的底层特征图。它引入了一个新的卷积块,重点关注磁共振成像图像的结构方面,另一个卷积块则提取特征图中某些像素位置特有的注意力权重,并与特征图输出相乘。然后,使用多个全连接层实现多任务学习,产生三个输出,包括主要分类任务。另外两个输出在训练过程中采用反向传播,以改进主要分类工作。实验结果表明,作者提出的方法优于当前的 AD 分类方法,在阿尔茨海默病神经影像倡议数据集上实现了更高的分类准确率和其他指标。在题为 "A novel medical image data protection scheme for smart healthcare system "的论文中,Rehman 等人提出了一种利用位平面分解和混沌理论的轻量级医学图像加密方案。实验结果表明,该方案的熵值为 7.999,能量为 0.0156,相关性为 0.0001。在题为 "通过动态网络实现图像超分辨率 "的论文中,Tian 等人提出了一种用于图像超分辨率的动态网络(DSRNet),它包含残差增强块、宽增强块、特征细化块和构造块。
{"title":"Guest Editorial: Knowledge-based deep learning system in bio-medicine","authors":"Yu-Dong Zhang,&nbsp;Juan Manuel Górriz","doi":"10.1049/cit2.12364","DOIUrl":"https://doi.org/10.1049/cit2.12364","url":null,"abstract":"<p>Numerous healthcare procedures can be viewed as medical sector decisions. In the modern era, computers have become indispensable in the realm of medical decision-making. However, the common view of computers in the medical field typically extends only to applications that support doctors in diagnosing diseases. To more tightly intertwine computers with the biomedical sciences, professionals are now more frequently utilising knowledge-driven deep learning systems (KDLS) and their foundational technologies, especially in the domain of neuroimaging (NI).</p><p>Data for medical purposes can be sourced from a variety of imaging techniques, including but not limited to Computed Tomography (CT), Magnetic Resonance Imaging (MRI), Ultrasound, Single Photon Emission Computed Tomography (SPECT), Positron Emission Tomography (PET), Magnetic Particle Imaging (MPI), Electroencephalography (EEG), Magnetoencephalography (MEG), Optical Microscopy and Tomography, Photoacoustic Tomography, Electron Tomography, and Atomic Force Microscopy.</p><p>Historically, these imaging techniques have been analysed using traditional statistical methods, such as hypothesis testing or Bayesian inference, which often presuppose certain conditions that are not always met. An emerging solution is the implementation of machine learning (ML) within the context of KDLS, allowing for the empirical mapping of complex, multi-dimensional relationships within data sets.</p><p>The objective of this special issue is to showcase the latest advancements in the methodology of KDLS for evaluating functional connectivity, neurological disorders, and clinical neuroscience, such as conditions like Alzheimer's, Parkinson's, cerebrovascular accidents, brain tumours, epilepsy, multiple sclerosis, ALS, Autism Spectrum Disorder, and more. Additionally, the special issue seeks to elucidate the mechanisms behind the predictive capabilities of ML methods within KDLS for brain-related diseases and disorders.</p><p>We received an abundance of submissions, totalling more than 40, from over 10 countries. After a meticulous and rigorous peer review process, which employed a double-blind methodology, we ultimately selected eight outstanding papers for publication. This process ensured the highest standards of quality and impartiality in the selection.</p><p>In the article ‘A deep learning fusion model for accurate classification of brain tumours in Magnetic Resonance images’, Zebari et al. created a robust deep learning (DL) fusion model for accurate brain tumour classification. To enhance performance, they employed data augmentation to expand the training dataset. The model leveraged VGG16, ResNet50, and convolutional deep belief networks to extract features from MRI images using a softmax classifier. By fusing features from two DL models, the fusion model notably boosted classification precision. Tested with a publicly available dataset, it achieved a remarkable 98.98% accuracy rate, outperforming existing me","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":8.4,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cit2.12364","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142007148","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DRRN: Differential rectification & refinement network for ischemic infarct segmentation DRRN:用于缺血性梗死分割的差分整流与细化网络
IF 8.4 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-24 DOI: 10.1049/cit2.12350
Wenxue Zhou, Wenming Yang, Qingmin Liao
Accurate segmentation of infarct tissue in ischemic stroke is essential to determine the extent of injury and assess the risk and choose optimal treatment for this life‐threatening disease. With the prior knowledge that asymmetric analysis of anatomical structures can provide discriminative information, plenty of symmetry‐based approaches have emerged to detect abnormalities in brain images. However, the inevitable non‐pathological noise has not been fully alleviated and weakened, leading to unsatisfactory results. A novel differential rectification and refinement network (DRRN) for the automatic segmentation of ischemic strokes is proposed. Specifically, a differential feature perception encoder (DFPE) is developed to fully exploit and propagate the bilateral quasi‐symmetry of healthy brains. In DFPE, an erasure‐rectification (ER) module is devised to rectify pseudo‐lesion features caused by non‐pathological noise through utilising discriminant features within the symmetric neighbourhood of the original image. And a differential‐attention (DA) mechanism is also integrated to fully perceive the differences in cross‐axial features and estimate the similarity of long‐range spatial context information. In addition, a crisscross differential feature reinforce module embedded with multiple boundary enhancement attention modules is designed to effectively integrate multi‐scale features and refine textual details and margins of the infarct area. Experimental results on the public ATLAS and Kaggle dataset demonstrate the effectiveness of DRRN over state‐of‐the‐arts.
准确分割缺血性脑卒中的梗死组织对于确定损伤程度、评估风险和选择最佳治疗方法至关重要。由于解剖结构的非对称分析可提供鉴别信息,因此出现了大量基于对称性的方法来检测大脑图像中的异常。然而,不可避免的非病理噪声并没有得到充分缓解和削弱,导致结果不尽人意。本文提出了一种用于缺血性脑卒中自动分割的新型差分整流和细化网络(DRRN)。具体来说,开发了一种差分特征感知编码器(DFPE),以充分利用和传播健康大脑的双侧准对称性。在 DFPE 中,设计了一个擦除校正(ER)模块,通过利用原始图像对称邻域内的判别特征,校正由非病理性噪声引起的伪缺损特征。此外,还集成了差分注意(DA)机制,以充分感知交叉轴向特征的差异,并估计远距离空间上下文信息的相似性。此外,还设计了一个内嵌多个边界增强注意模块的十字交叉差异特征强化模块,以有效整合多尺度特征并完善梗死区域的文字细节和边缘。在公开的 ATLAS 和 Kaggle 数据集上的实验结果表明,DRRN 比现有技术更有效。
{"title":"DRRN: Differential rectification & refinement network for ischemic infarct segmentation","authors":"Wenxue Zhou, Wenming Yang, Qingmin Liao","doi":"10.1049/cit2.12350","DOIUrl":"https://doi.org/10.1049/cit2.12350","url":null,"abstract":"Accurate segmentation of infarct tissue in ischemic stroke is essential to determine the extent of injury and assess the risk and choose optimal treatment for this life‐threatening disease. With the prior knowledge that asymmetric analysis of anatomical structures can provide discriminative information, plenty of symmetry‐based approaches have emerged to detect abnormalities in brain images. However, the inevitable non‐pathological noise has not been fully alleviated and weakened, leading to unsatisfactory results. A novel differential rectification and refinement network (DRRN) for the automatic segmentation of ischemic strokes is proposed. Specifically, a differential feature perception encoder (DFPE) is developed to fully exploit and propagate the bilateral quasi‐symmetry of healthy brains. In DFPE, an erasure‐rectification (ER) module is devised to rectify pseudo‐lesion features caused by non‐pathological noise through utilising discriminant features within the symmetric neighbourhood of the original image. And a differential‐attention (DA) mechanism is also integrated to fully perceive the differences in cross‐axial features and estimate the similarity of long‐range spatial context information. In addition, a crisscross differential feature reinforce module embedded with multiple boundary enhancement attention modules is designed to effectively integrate multi‐scale features and refine textual details and margins of the infarct area. Experimental results on the public ATLAS and Kaggle dataset demonstrate the effectiveness of DRRN over state‐of‐the‐arts.","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":8.4,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141807294","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Norm‐based zeroing neural dynamics for time‐variant non‐linear equations 基于规范的时变非线性方程归零神经动力学
IF 8.4 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-03 DOI: 10.1049/cit2.12360
Linyan Dai, Hanyi Xu, Yinyan Zhang, Bolin Liao
Zeroing neural dynamic (ZND) model is widely deployed for time‐variant non‐linear equations (TVNE). Various element‐wise non‐linear activation functions and integration operations are investigated to enhance the convergence performance and robustness in most proposed ZND models for solving TVNE, leading to a huge cost of hardware implementation and model complexity. To overcome these problems, the authors develop a new norm‐based ZND (NBZND) model with strong robustness for solving TVNE, not applying element‐wise non‐linear activated functions but introducing a two‐norm operation to achieve finite‐time convergence. Moreover, the authors develop a discrete‐time NBZND model for the potential deployment of the model on digital computers. Rigorous theoretical analysis for the NBZND is provided. Simulation results substantiate the advantages of the NBZND model for solving TVNE.
归零神经动态(ZND)模型被广泛应用于时变非线性方程(TVNE)。在大多数用于求解 TVNE 的 ZND 模型中,为了提高收敛性能和鲁棒性,研究人员研究了各种元素非线性激活函数和积分运算,但这导致了巨大的硬件实现成本和模型复杂性。为了克服这些问题,作者开发了一种新的基于规范的 ZND(NBZND)模型,该模型具有很强的鲁棒性,可用于求解 TVNE,它没有应用元素非线性激活函数,而是引入了双规范运算,以实现有限时间收敛。此外,作者还开发了离散时间 NBZND 模型,以便在数字计算机上部署该模型。作者对 NBZND 进行了严格的理论分析。仿真结果证明了 NBZND 模型在求解 TVNE 方面的优势。
{"title":"Norm‐based zeroing neural dynamics for time‐variant non‐linear equations","authors":"Linyan Dai, Hanyi Xu, Yinyan Zhang, Bolin Liao","doi":"10.1049/cit2.12360","DOIUrl":"https://doi.org/10.1049/cit2.12360","url":null,"abstract":"Zeroing neural dynamic (ZND) model is widely deployed for time‐variant non‐linear equations (TVNE). Various element‐wise non‐linear activation functions and integration operations are investigated to enhance the convergence performance and robustness in most proposed ZND models for solving TVNE, leading to a huge cost of hardware implementation and model complexity. To overcome these problems, the authors develop a new norm‐based ZND (NBZND) model with strong robustness for solving TVNE, not applying element‐wise non‐linear activated functions but introducing a two‐norm operation to achieve finite‐time convergence. Moreover, the authors develop a discrete‐time NBZND model for the potential deployment of the model on digital computers. Rigorous theoretical analysis for the NBZND is provided. Simulation results substantiate the advantages of the NBZND model for solving TVNE.","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":8.4,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141682684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Combining kernelised autoencoding and centroid prediction for dynamic multi‐objective optimisation 将核化自动编码与中心点预测相结合,实现动态多目标优化
IF 5.1 2区 计算机科学 Q1 Computer Science Pub Date : 2024-06-13 DOI: 10.1049/cit2.12335
Zhanglu Hou, Juan Zou, Gan Ruan, Yuan Liu, Yizhang Xia
Evolutionary algorithms face significant challenges when dealing with dynamic multi‐objective optimisation because Pareto optimal solutions and/or Pareto optimal fronts change. The authors propose a unified paradigm, which combines the kernelised autoncoding evolutionary search and the centroid‐based prediction (denoted by KAEP), for solving dynamic multi‐objective optimisation problems (DMOPs). Specifically, whenever a change is detected, KAEP reacts effectively to it by generating two subpopulations. The first subpopulation is generated by a simple centroid‐based prediction strategy. For the second initial subpopulation, the kernel autoencoder is derived to predict the moving of the Pareto‐optimal solutions based on the historical elite solutions. In this way, an initial population is predicted by the proposed combination strategies with good convergence and diversity, which can be effective for solving DMOPs. The performance of the proposed method is compared with five state‐of‐the‐art algorithms on a number of complex benchmark problems. Empirical results fully demonstrate the superiority of the proposed method on most test instances.
进化算法在处理动态多目标优化时面临着巨大挑战,因为帕累托最优解和/或帕累托最优前沿会发生变化。作者提出了一种统一的范式,它结合了核化自动编码进化搜索和基于中心点的预测(用 KAEP 表示),用于解决动态多目标优化问题(DMOPs)。具体来说,只要检测到变化,KAEP 就会生成两个子群,从而对变化做出有效反应。第一个子群由基于中心点的简单预测策略生成。对于第二个初始子群,内核自动编码器会根据历史上的精英解来预测帕累托最优解的移动。这样,通过所提出的组合策略预测出的初始种群具有良好的收敛性和多样性,可以有效地解决 DMOP 问题。在一些复杂的基准问题上,将所提方法的性能与五种最先进的算法进行了比较。实证结果充分证明了所提方法在大多数测试实例上的优越性。
{"title":"Combining kernelised autoencoding and centroid prediction for dynamic multi‐objective optimisation","authors":"Zhanglu Hou, Juan Zou, Gan Ruan, Yuan Liu, Yizhang Xia","doi":"10.1049/cit2.12335","DOIUrl":"https://doi.org/10.1049/cit2.12335","url":null,"abstract":"Evolutionary algorithms face significant challenges when dealing with dynamic multi‐objective optimisation because Pareto optimal solutions and/or Pareto optimal fronts change. The authors propose a unified paradigm, which combines the kernelised autoncoding evolutionary search and the centroid‐based prediction (denoted by KAEP), for solving dynamic multi‐objective optimisation problems (DMOPs). Specifically, whenever a change is detected, KAEP reacts effectively to it by generating two subpopulations. The first subpopulation is generated by a simple centroid‐based prediction strategy. For the second initial subpopulation, the kernel autoencoder is derived to predict the moving of the Pareto‐optimal solutions based on the historical elite solutions. In this way, an initial population is predicted by the proposed combination strategies with good convergence and diversity, which can be effective for solving DMOPs. The performance of the proposed method is compared with five state‐of‐the‐art algorithms on a number of complex benchmark problems. Empirical results fully demonstrate the superiority of the proposed method on most test instances.","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":5.1,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141346678","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
SACNN‐IDS: A self‐attention convolutional neural network for intrusion detection in industrial internet of things SACNN-IDS:用于工业物联网入侵检测的自关注卷积神经网络
IF 5.1 2区 计算机科学 Q1 Computer Science Pub Date : 2024-06-12 DOI: 10.1049/cit2.12352
Mimonah Al Qathrady, Safi Ullah, Mohammed S. Alshehri, Jawad Ahmad, Sultan Almakdi, Samar M. Alqhtani, M. A. Khan, B. Ghaleb
Industrial Internet of Things (IIoT) is a pervasive network of interlinked smart devices that provide a variety of intelligent computing services in industrial environments. Several IIoT nodes operate confidential data (such as medical, transportation, military, etc.) which are reachable targets for hostile intruders due to their openness and varied structure. Intrusion Detection Systems (IDS) based on Machine Learning (ML) and Deep Learning (DL) techniques have got significant attention. However, existing ML and DL‐based IDS still face a number of obstacles that must be overcome. For instance, the existing DL approaches necessitate a substantial quantity of data for effective performance, which is not feasible to run on low‐power and low‐memory devices. Imbalanced and fewer data potentially lead to low performance on existing IDS. This paper proposes a self‐attention convolutional neural network (SACNN) architecture for the detection of malicious activity in IIoT networks and an appropriate feature extraction method to extract the most significant features. The proposed architecture has a self‐attention layer to calculate the input attention and convolutional neural network (CNN) layers to process the assigned attention features for prediction. The performance evaluation of the proposed SACNN architecture has been done with the Edge‐IIoTset and X‐IIoTID datasets. These datasets encompassed the behaviours of contemporary IIoT communication protocols, the operations of state‐of‐the‐art devices, various attack types, and diverse attack scenarios.
工业物联网(IIoT)是一个由相互连接的智能设备组成的无处不在的网络,可在工业环境中提供各种智能计算服务。一些 IIoT 节点运行着机密数据(如医疗、交通、军事等),由于其开放性和多样的结构,成为敌对入侵者可以接触到的目标。基于机器学习(ML)和深度学习(DL)技术的入侵检测系统(IDS)备受关注。然而,现有的基于 ML 和 DL 的 IDS 仍然面临着许多必须克服的障碍。例如,现有的深度学习方法需要大量数据才能有效发挥作用,而这在低功耗和低内存设备上是不可行的。不平衡和较少的数据可能导致现有 IDS 性能低下。本文提出了一种自注意卷积神经网络(SACNN)架构,用于检测物联网网络中的恶意活动,并提出了一种适当的特征提取方法来提取最重要的特征。所提出的架构有一个计算输入注意力的自注意力层和处理分配注意力特征以进行预测的卷积神经网络(CNN)层。已利用 Edge-IIoTset 和 X-IIoTID 数据集对拟议的 SACNN 架构进行了性能评估。这些数据集涵盖了当代物联网通信协议的行为、最先进设备的操作、各种攻击类型以及各种攻击场景。
{"title":"SACNN‐IDS: A self‐attention convolutional neural network for intrusion detection in industrial internet of things","authors":"Mimonah Al Qathrady, Safi Ullah, Mohammed S. Alshehri, Jawad Ahmad, Sultan Almakdi, Samar M. Alqhtani, M. A. Khan, B. Ghaleb","doi":"10.1049/cit2.12352","DOIUrl":"https://doi.org/10.1049/cit2.12352","url":null,"abstract":"Industrial Internet of Things (IIoT) is a pervasive network of interlinked smart devices that provide a variety of intelligent computing services in industrial environments. Several IIoT nodes operate confidential data (such as medical, transportation, military, etc.) which are reachable targets for hostile intruders due to their openness and varied structure. Intrusion Detection Systems (IDS) based on Machine Learning (ML) and Deep Learning (DL) techniques have got significant attention. However, existing ML and DL‐based IDS still face a number of obstacles that must be overcome. For instance, the existing DL approaches necessitate a substantial quantity of data for effective performance, which is not feasible to run on low‐power and low‐memory devices. Imbalanced and fewer data potentially lead to low performance on existing IDS. This paper proposes a self‐attention convolutional neural network (SACNN) architecture for the detection of malicious activity in IIoT networks and an appropriate feature extraction method to extract the most significant features. The proposed architecture has a self‐attention layer to calculate the input attention and convolutional neural network (CNN) layers to process the assigned attention features for prediction. The performance evaluation of the proposed SACNN architecture has been done with the Edge‐IIoTset and X‐IIoTID datasets. These datasets encompassed the behaviours of contemporary IIoT communication protocols, the operations of state‐of‐the‐art devices, various attack types, and diverse attack scenarios.","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":5.1,"publicationDate":"2024-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141353000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A systematic mapping to investigate the application of machine learning techniques in requirement engineering activities 调查机器学习技术在需求工程活动中的应用的系统制图
IF 5.1 2区 计算机科学 Q1 Computer Science Pub Date : 2024-06-10 DOI: 10.1049/cit2.12348
Shoaib Hassan, Qianmu Li, Khursheed Aurangzeb, Affan Yasin, Javed Ali Khan, Muhammad Shahid Anwar
Over the past few years, the application and usage of Machine Learning (ML) techniques have increased exponentially due to continuously increasing the size of data and computing capacity. Despite the popularity of ML techniques, only a few research studies have focused on the application of ML especially supervised learning techniques in Requirement Engineering (RE) activities to solve the problems that occur in RE activities. The authors focus on the systematic mapping of past work to investigate those studies that focused on the application of supervised learning techniques in RE activities between the period of 2002–2023. The authors aim to investigate the research trends, main RE activities, ML algorithms, and data sources that were studied during this period. Forty‐five research studies were selected based on our exclusion and inclusion criteria. The results show that the scientific community used 57 algorithms. Among those algorithms, researchers mostly used the five following ML algorithms in RE activities: Decision Tree, Support Vector Machine, Naïve Bayes, K‐nearest neighbour Classifier, and Random Forest. The results show that researchers used these algorithms in eight major RE activities. Those activities are requirements analysis, failure prediction, effort estimation, quality, traceability, business rules identification, content classification, and detection of problems in requirements written in natural language. Our selected research studies used 32 private and 41 public data sources. The most popular data sources that were detected in selected studies are the Metric Data Programme from NASA, Predictor Models in Software Engineering, and iTrust Electronic Health Care System.
在过去几年里,由于数据规模和计算能力的持续增长,机器学习(ML)技术的应用和使用呈指数级增长。尽管 ML 技术很受欢迎,但只有少数研究关注 ML 的应用,特别是在需求工程(RE)活动中的监督学习技术,以解决 RE 活动中出现的问题。作者重点对过去的工作进行了系统梳理,调查了 2002-2023 年间那些关注监督学习技术在需求工程活动中应用的研究。作者旨在调查这一时期的研究趋势、主要可再生能源活动、ML 算法和数据来源。根据我们的排除和纳入标准,选出了 45 项研究。结果显示,科学界使用了 57 种算法。在这些算法中,研究人员在 RE 活动中主要使用了以下五种 ML 算法:决策树、支持向量机、奈夫贝叶斯、K-近邻分类器和随机森林。结果显示,研究人员在八项主要的 RE 活动中使用了这些算法。这些活动包括需求分析、故障预测、工作量估算、质量、可追溯性、业务规则识别、内容分类以及检测以自然语言编写的需求中存在的问题。我们选择的研究使用了 32 个私有数据源和 41 个公共数据源。在所选研究中发现的最受欢迎的数据源是美国国家航空航天局的度量数据计划、软件工程中的预测模型和 iTrust 电子医疗保健系统。
{"title":"A systematic mapping to investigate the application of machine learning techniques in requirement engineering activities","authors":"Shoaib Hassan, Qianmu Li, Khursheed Aurangzeb, Affan Yasin, Javed Ali Khan, Muhammad Shahid Anwar","doi":"10.1049/cit2.12348","DOIUrl":"https://doi.org/10.1049/cit2.12348","url":null,"abstract":"Over the past few years, the application and usage of Machine Learning (ML) techniques have increased exponentially due to continuously increasing the size of data and computing capacity. Despite the popularity of ML techniques, only a few research studies have focused on the application of ML especially supervised learning techniques in Requirement Engineering (RE) activities to solve the problems that occur in RE activities. The authors focus on the systematic mapping of past work to investigate those studies that focused on the application of supervised learning techniques in RE activities between the period of 2002–2023. The authors aim to investigate the research trends, main RE activities, ML algorithms, and data sources that were studied during this period. Forty‐five research studies were selected based on our exclusion and inclusion criteria. The results show that the scientific community used 57 algorithms. Among those algorithms, researchers mostly used the five following ML algorithms in RE activities: Decision Tree, Support Vector Machine, Naïve Bayes, K‐nearest neighbour Classifier, and Random Forest. The results show that researchers used these algorithms in eight major RE activities. Those activities are requirements analysis, failure prediction, effort estimation, quality, traceability, business rules identification, content classification, and detection of problems in requirements written in natural language. Our selected research studies used 32 private and 41 public data sources. The most popular data sources that were detected in selected studies are the Metric Data Programme from NASA, Predictor Models in Software Engineering, and iTrust Electronic Health Care System.","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":5.1,"publicationDate":"2024-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141363764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Guest Editorial: Special issue on trustworthy machine learning for behavioural and social computing 客座编辑:行为和社交计算的可信机器学习特刊
IF 5.1 2区 计算机科学 Q1 Computer Science Pub Date : 2024-06-08 DOI: 10.1049/cit2.12353
Zhi-Hui Zhan, Jianxin Li, Xuyun Zhang, Deepak Puthal

Machine learning has been extensively applied in behavioural and social computing, encompassing a spectrum of applications such as social network analysis, click stream analysis, recommendation of points of interest, and sentiment analysis. The datasets pertinent to these applications are inherently linked to human behaviour and societal dynamics, posing a risk of disclosing personal or sensitive information if mishandled or subjected to attacks. To safeguard individuals from potential privacy breaches, numerous governments have enacted a range of legal frameworks and regulatory measures. Examples include the Personal Information Protection Law of the People's Republic of China, the European Union's GDPR for privacy, and Australia's Artificial Intelligence Ethics Framework for many ethical aspects like fairness and reliability. Despite these legislative efforts, the technical implementation of these regulations to ensure trustworthy machine learning in behavioural and social computing remains a significant challenge. Trustworthy machine learning, being a fast-developing field, necessitates further in-depth exploration across multiple dimensions, including but not limited to fairness, privacy, reliability, explainability, robustness, and security, from a holistic and interdisciplinary viewpoint. This special issue is dedicated to facilitating the exchange and discussion of state-of-the-art research findings from academia and industry alike. The seven high-quality papers collected in this special issue place a particular emphasis on showcasing the latest advancements in concepts, algorithms, systems, platforms, and applications, as well as exploring future trends pertinent to the field of trustworthy machine learning for behavioural and social computing.

In the first paper, ‘Trustworthy semi-supervised anomaly detection for online-to-offline logistics business in merchant identification’, Yong Li et al. have developed a semi-supervised framework for the detection of anomalous merchants within the logistics sector. The methodology begins with an extensive data-driven examination comparing the behaviours of regular and anomalous customers. Utilising the insights from this analysis, the authors then implemented a contrastive learning for data augmentation, which capitalises on the imprecise labelling of customer data. Subsequently, their model is employed to identify customers exhibiting abnormal package reception and dispatch patterns in logistics operations. The framework's efficacy is substantiated by an empirical study that leverages 8 months of authentic order data, sourced from Beijing and provided by one of China's foremost logistics corporations.

The second paper, entitled ‘Towards trustworthy multi-modal motion prediction: Holistic evaluation and interpretability of outputs’ by Sandra Carrasco Limeros et al., is advancing toward the creation of dependable motion prediction models, with a focus on the evaluation, robustness, and

机器学习已广泛应用于行为和社交计算领域,包括社交网络分析、点击流分析、兴趣点推荐和情感分析等一系列应用。与这些应用相关的数据集与人类行为和社会动态有着内在联系,如果处理不当或受到攻击,就有可能泄露个人或敏感信息。为了保护个人隐私不被侵犯,许多国家的政府制定了一系列法律框架和监管措施。这方面的例子包括《中华人民共和国个人信息保护法》、欧盟针对隐私的 GDPR 以及澳大利亚针对公平性和可靠性等诸多伦理方面的《人工智能伦理框架》。尽管做出了这些立法努力,但如何在技术上落实这些法规,以确保行为和社交计算中的机器学习值得信赖,仍然是一项重大挑战。值得信赖的机器学习是一个快速发展的领域,需要从整体和跨学科的角度,从多个维度进一步深入探讨,包括但不限于公平性、隐私、可靠性、可解释性、稳健性和安全性。本特刊致力于促进学术界和业界对最新研究成果的交流和讨论。本特刊收录的七篇高质量论文特别强调展示概念、算法、系统、平台和应用方面的最新进展,以及探索与行为和社交计算领域可信机器学习相关的未来趋势。在第一篇论文《商户识别中从线上到线下物流业务的可信半监督异常检测》中,李勇等人开发了一个半监督框架,用于检测物流行业中的异常商户。该方法首先对常规客户和异常客户的行为进行了广泛的数据驱动检查。利用这一分析的洞察力,作者随后实施了一种用于数据增强的对比学习方法,该方法利用了客户数据的不精确标签。随后,他们采用该模型来识别物流运营中表现出异常包裹接收和发送模式的客户。第二篇论文题为 "迈向可信的多模式运动预测":Sandra Carrasco Limeros 等人撰写的第二篇论文题为 "迈向值得信赖的多模式运动预测:输出的整体评估和可解释性",该论文致力于创建可靠的运动预测模型,重点关注结果的评估、稳健性和可解释性。论文首先强调了现有评估方法的主要差异和不足,尤其是缺乏多样性评估和与交通场景的兼容性。然后,通过稳健性分析,作者证明了无法感知道路地形比无法感知其他道路使用者对系统性能的影响更为明显。在此基础上,作者提出了 DenseTNT-意图模型的输出结果,该模型展示了多样化、合规和精确的高级意图,从而提高了预测的整体质量。总的来说,我们提出的方法和研究结果为自动驾驶汽车可信运动预测系统的发展做出了重大贡献:Yue Cong 等人的第三篇论文题为 "Ada-FFL:自适应计算公平性联合学习",介绍了一种自适应公平性联合学习方法,这是一种自适应公平性聚合技术,可在联合学习过程中考虑本地模型更新的差异。这种方法提供了一种更灵活的聚合机制,使其能够适应各种联合数据集。随后,作者详细研究了单个客户端对公平系数的影响。基于这些见解,作者提出了一种新方法,能以更有效的方式显著提高联合学习系统的性能和公平性。在各种联合数据集上进行的一系列综合实验评估得出的结果证明了所提方法的优越性。与现有的基线方法相比,这些结果凸显了所提出的方法在模型性能和公平性方面的明显优势。 我们希望这些入选作品能加深社会各界对当前流行趋势的理解,为今后的探索提供路径。我们衷心感谢所有投稿者选择本特刊作为分享其学术见解的场所。我们还要感谢读者,他们富有洞察力和建设性的评论对作者大有裨益。此外,我们还要感谢 IET 团队在本特刊编写过程中给予的坚定支持和指导。
{"title":"Guest Editorial: Special issue on trustworthy machine learning for behavioural and social computing","authors":"Zhi-Hui Zhan,&nbsp;Jianxin Li,&nbsp;Xuyun Zhang,&nbsp;Deepak Puthal","doi":"10.1049/cit2.12353","DOIUrl":"https://doi.org/10.1049/cit2.12353","url":null,"abstract":"<p>Machine learning has been extensively applied in behavioural and social computing, encompassing a spectrum of applications such as social network analysis, click stream analysis, recommendation of points of interest, and sentiment analysis. The datasets pertinent to these applications are inherently linked to human behaviour and societal dynamics, posing a risk of disclosing personal or sensitive information if mishandled or subjected to attacks. To safeguard individuals from potential privacy breaches, numerous governments have enacted a range of legal frameworks and regulatory measures. Examples include the Personal Information Protection Law of the People's Republic of China, the European Union's GDPR for privacy, and Australia's Artificial Intelligence Ethics Framework for many ethical aspects like fairness and reliability. Despite these legislative efforts, the technical implementation of these regulations to ensure trustworthy machine learning in behavioural and social computing remains a significant challenge. Trustworthy machine learning, being a fast-developing field, necessitates further in-depth exploration across multiple dimensions, including but not limited to fairness, privacy, reliability, explainability, robustness, and security, from a holistic and interdisciplinary viewpoint. This special issue is dedicated to facilitating the exchange and discussion of state-of-the-art research findings from academia and industry alike. The seven high-quality papers collected in this special issue place a particular emphasis on showcasing the latest advancements in concepts, algorithms, systems, platforms, and applications, as well as exploring future trends pertinent to the field of trustworthy machine learning for behavioural and social computing.</p><p>In the first paper, ‘Trustworthy semi-supervised anomaly detection for online-to-offline logistics business in merchant identification’, Yong Li et al. have developed a semi-supervised framework for the detection of anomalous merchants within the logistics sector. The methodology begins with an extensive data-driven examination comparing the behaviours of regular and anomalous customers. Utilising the insights from this analysis, the authors then implemented a contrastive learning for data augmentation, which capitalises on the imprecise labelling of customer data. Subsequently, their model is employed to identify customers exhibiting abnormal package reception and dispatch patterns in logistics operations. The framework's efficacy is substantiated by an empirical study that leverages 8 months of authentic order data, sourced from Beijing and provided by one of China's foremost logistics corporations.</p><p>The second paper, entitled ‘Towards trustworthy multi-modal motion prediction: Holistic evaluation and interpretability of outputs’ by Sandra Carrasco Limeros et al., is advancing toward the creation of dependable motion prediction models, with a focus on the evaluation, robustness, and","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":5.1,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cit2.12353","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141430192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
4D foetal cardiac ultrasound image detection based on deep learning with weakly supervised localisation for rapid diagnosis of evolving hypoplastic left heart syndrome 基于深度学习和弱监督定位的 4D 胎儿心脏超声图像检测,用于快速诊断演变型左心发育不全综合征
IF 5.1 2区 计算机科学 Q1 Computer Science Pub Date : 2024-06-07 DOI: 10.1049/cit2.12354
Gang Wang, Weisheng Li, Mingliang Zhou, Haobo Zhu, Guang Yang, Choon Hwai Yap
Hypoplastic left heart syndrome (HLHS) is a rare, complex, and incredibly foetal congenital heart disease. To decrease neonatal mortality, evolving HLHS (eHLHS) in pregnant women should be critically diagnosed as soon as possible. However, diagnosis is currently heavily dependent on skilled medical professionals using foetal cardiac ultrasound images, making it difficult to rapidly and easily examine for this disease. Herein, the authors propose a cost‐effective deep learning framework for rapid diagnosis of eHLHS (RDeH), which we have named RDeH‐Net. Briefly, the framework implements a coarse‐to‐fine two‐stage detection approach, with a structure classification network for 4D human foetal cardiac ultrasound images from various spatial and temporal domains, and a fine detection module with weakly‐supervised localisation for high‐precision nidus localisation and physician assistance. The experiments extensively compare the authors’ network with other state‐of‐the‐art methods on a 4D human foetal cardiac ultrasound image dataset and show two main benefits: (1) it achieved superior average accuracy of 99.37% on three categories of foetal ultrasound images from different cases; (2) it demonstrates visually fine detection performance with weakly supervised localisation. This framework could be used to accelerate the diagnosis of eHLHS, and hence significantly lessen reliance on experienced medical physicians.
左心发育不全综合征(HLHS)是一种罕见、复杂且令人难以置信的胎儿先天性心脏病。为了降低新生儿死亡率,应尽快对孕妇的演变型 HLHS(eHLHS)进行重症诊断。然而,目前的诊断在很大程度上依赖于熟练的医疗专业人员使用胎儿心脏超声图像,因此很难快速、方便地检查出这种疾病。在此,作者提出了一种用于快速诊断 eHLHS(RDeH)的经济高效的深度学习框架,我们将其命名为 RDeH-Net。简而言之,该框架实现了一种从粗到细的两阶段检测方法,其结构分类网络适用于来自不同时空域的 4D 人体胎儿心脏超声图像,而精细检测模块则具有弱监督定位功能,可用于高精度巢穴定位和医生辅助诊断。实验将作者的网络与其他最先进的方法在四维人类胎儿心脏超声图像数据集上进行了广泛比较,并显示了两个主要优点:(1) 它在不同病例的三类胎儿超声图像上实现了 99.37% 的超高平均准确率;(2) 它在弱监督定位的情况下展示了视觉上的精细检测性能。该框架可用于加速 eHLHS 的诊断,从而大大减少对经验丰富的医生的依赖。
{"title":"4D foetal cardiac ultrasound image detection based on deep learning with weakly supervised localisation for rapid diagnosis of evolving hypoplastic left heart syndrome","authors":"Gang Wang, Weisheng Li, Mingliang Zhou, Haobo Zhu, Guang Yang, Choon Hwai Yap","doi":"10.1049/cit2.12354","DOIUrl":"https://doi.org/10.1049/cit2.12354","url":null,"abstract":"Hypoplastic left heart syndrome (HLHS) is a rare, complex, and incredibly foetal congenital heart disease. To decrease neonatal mortality, evolving HLHS (eHLHS) in pregnant women should be critically diagnosed as soon as possible. However, diagnosis is currently heavily dependent on skilled medical professionals using foetal cardiac ultrasound images, making it difficult to rapidly and easily examine for this disease. Herein, the authors propose a cost‐effective deep learning framework for rapid diagnosis of eHLHS (RDeH), which we have named RDeH‐Net. Briefly, the framework implements a coarse‐to‐fine two‐stage detection approach, with a structure classification network for 4D human foetal cardiac ultrasound images from various spatial and temporal domains, and a fine detection module with weakly‐supervised localisation for high‐precision nidus localisation and physician assistance. The experiments extensively compare the authors’ network with other state‐of‐the‐art methods on a 4D human foetal cardiac ultrasound image dataset and show two main benefits: (1) it achieved superior average accuracy of 99.37% on three categories of foetal ultrasound images from different cases; (2) it demonstrates visually fine detection performance with weakly supervised localisation. This framework could be used to accelerate the diagnosis of eHLHS, and hence significantly lessen reliance on experienced medical physicians.","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":5.1,"publicationDate":"2024-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141373007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A fault‐tolerant and scalable boosting method over vertically partitioned data 垂直分区数据上的容错和可扩展提升方法
IF 5.1 2区 计算机科学 Q1 Computer Science Pub Date : 2024-06-05 DOI: 10.1049/cit2.12339
Hai Jiang, Songtao Shang, Peng Liu, Tong Yi
Vertical federated learning (VFL) can learn a common machine learning model over vertically partitioned datasets. However, VFL are faced with these thorny problems: (1) both the training and prediction are very vulnerable to stragglers; (2) most VFL methods can only support a specific machine learning model. Suppose that VFL incorporates the features of centralised learning, then the above issues can be alleviated. With that in mind, this paper proposes a new VFL scheme, called FedBoost, which makes private parties upload the compressed partial order relations to the honest but curious server before training and prediction. The server can build a machine learning model and predict samples on the union of coded data. The theoretical analysis indicates that the absence of any private party will not affect the training and prediction as long as a round of communication is achieved. Our scheme can support canonical tree‐based models such as Tree Boosting methods and Random Forests. The experimental results also demonstrate the availability of our scheme.
垂直联合学习(VFL)可以在垂直分割的数据集上学习一个通用的机器学习模型。然而,垂直联合学习面临着这些棘手的问题:(1)训练和预测都很容易受到散兵游勇的影响;(2)大多数垂直联合学习方法只能支持特定的机器学习模型。假设 VFL 结合了集中学习的特点,那么上述问题就可以得到缓解。有鉴于此,本文提出了一种新的 VFL 方案,称为 FedBoost,它让私人方在训练和预测前将压缩的部分秩关系上传到诚实但好奇的服务器。服务器可以建立机器学习模型,并对编码数据的联合样本进行预测。理论分析表明,只要实现一轮通信,没有任何私有方的存在不会影响训练和预测。我们的方案可以支持基于树的典型模型,如树提升法和随机森林。实验结果也证明了我们方案的可用性。
{"title":"A fault‐tolerant and scalable boosting method over vertically partitioned data","authors":"Hai Jiang, Songtao Shang, Peng Liu, Tong Yi","doi":"10.1049/cit2.12339","DOIUrl":"https://doi.org/10.1049/cit2.12339","url":null,"abstract":"Vertical federated learning (VFL) can learn a common machine learning model over vertically partitioned datasets. However, VFL are faced with these thorny problems: (1) both the training and prediction are very vulnerable to stragglers; (2) most VFL methods can only support a specific machine learning model. Suppose that VFL incorporates the features of centralised learning, then the above issues can be alleviated. With that in mind, this paper proposes a new VFL scheme, called FedBoost, which makes private parties upload the compressed partial order relations to the honest but curious server before training and prediction. The server can build a machine learning model and predict samples on the union of coded data. The theoretical analysis indicates that the absence of any private party will not affect the training and prediction as long as a round of communication is achieved. Our scheme can support canonical tree‐based models such as Tree Boosting methods and Random Forests. The experimental results also demonstrate the availability of our scheme.","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":5.1,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141384583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
WaveSeg‐UNet model for overlapped nuclei segmentation from multi‐organ histopathology images 用于从多器官组织病理学图像中分割重叠细胞核的 WaveSeg-UNet 模型
IF 5.1 2区 计算机科学 Q1 Computer Science Pub Date : 2024-06-03 DOI: 10.1049/cit2.12351
Hameed Ullah Khan, B. Raza, Muhammad Asad Iqbal Khan, Muhammed Faheem
Nuclei segmentation is a challenging task in histopathology images. It is challenging due to the small size of objects, low contrast, touching boundaries, and complex structure of nuclei. Their segmentation and counting play an important role in cancer identification and its grading. In this study, WaveSeg‐UNet, a lightweight model, is introduced to segment cancerous nuclei having touching boundaries. Residual blocks are used for feature extraction. Only one feature extractor block is used in each level of the encoder and decoder. Normally, images degrade quality and lose important information during down‐sampling. To overcome this loss, discrete wavelet transform (DWT) alongside max‐pooling is used in the down‐sampling process. Inverse DWT is used to regenerate original images during up‐sampling. In the bottleneck of the proposed model, atrous spatial channel pyramid pooling (ASCPP) is used to extract effective high‐level features. The ASCPP is the modified pyramid pooling having atrous layers to increase the area of the receptive field. Spatial and channel‐based attention are used to focus on the location and class of the identified objects. Finally, watershed transform is used as a post processing technique to identify and refine touching boundaries of nuclei. Nuclei are identified and counted to facilitate pathologists. The same domain of transfer learning is used to retrain the model for domain adaptability. Results of the proposed model are compared with state‐of‐the‐art models, and it outperformed the existing studies.
细胞核分割是组织病理学图像中一项具有挑战性的任务。由于对象尺寸小、对比度低、边界易触碰以及细胞核结构复杂,因此这项工作极具挑战性。细胞核的分割和计数在癌症鉴定和分级中发挥着重要作用。在本研究中,引入了轻量级模型 WaveSeg-UNet 来分割具有触摸边界的癌核。残留块用于特征提取。编码器和解码器的每一级都只使用一个特征提取块。通常,图像在向下采样时会降低质量并丢失重要信息。为了克服这种损失,在下采样过程中使用了离散小波变换(DWT)和最大池化技术。在上采样过程中,使用反 DWT 来重新生成原始图像。在所提模型的瓶颈部分,使用了无空间通道金字塔池化(ASCPP)来提取有效的高级特征。ASCPP 是一种改进的金字塔池化技术,具有无齿层以增加感受野的面积。空间注意力和基于通道的注意力用于关注识别对象的位置和类别。最后,采用分水岭变换作为后处理技术来识别和细化触核边界。对细胞核进行识别和计数,为病理学家提供便利。同一领域的迁移学习用于重新训练模型,以获得领域适应性。所提模型的结果与最先进的模型进行了比较,结果表明它优于现有的研究。
{"title":"WaveSeg‐UNet model for overlapped nuclei segmentation from multi‐organ histopathology images","authors":"Hameed Ullah Khan, B. Raza, Muhammad Asad Iqbal Khan, Muhammed Faheem","doi":"10.1049/cit2.12351","DOIUrl":"https://doi.org/10.1049/cit2.12351","url":null,"abstract":"Nuclei segmentation is a challenging task in histopathology images. It is challenging due to the small size of objects, low contrast, touching boundaries, and complex structure of nuclei. Their segmentation and counting play an important role in cancer identification and its grading. In this study, WaveSeg‐UNet, a lightweight model, is introduced to segment cancerous nuclei having touching boundaries. Residual blocks are used for feature extraction. Only one feature extractor block is used in each level of the encoder and decoder. Normally, images degrade quality and lose important information during down‐sampling. To overcome this loss, discrete wavelet transform (DWT) alongside max‐pooling is used in the down‐sampling process. Inverse DWT is used to regenerate original images during up‐sampling. In the bottleneck of the proposed model, atrous spatial channel pyramid pooling (ASCPP) is used to extract effective high‐level features. The ASCPP is the modified pyramid pooling having atrous layers to increase the area of the receptive field. Spatial and channel‐based attention are used to focus on the location and class of the identified objects. Finally, watershed transform is used as a post processing technique to identify and refine touching boundaries of nuclei. Nuclei are identified and counted to facilitate pathologists. The same domain of transfer learning is used to retrain the model for domain adaptability. Results of the proposed model are compared with state‐of‐the‐art models, and it outperformed the existing studies.","PeriodicalId":46211,"journal":{"name":"CAAI Transactions on Intelligence Technology","volume":null,"pages":null},"PeriodicalIF":5.1,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141269985","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
CAAI Transactions on Intelligence Technology
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1