首页 > 最新文献

Frontiers in Artificial Intelligence最新文献

英文 中文
Exploring the performance of automatic speaker recognition using twin speech and deep learning-based artificial neural networks 探索使用双语音和基于深度学习的人工神经网络自动识别说话人的性能
Pub Date : 2024-02-08 DOI: 10.3389/frai.2024.1287877
Julio Cesar Cavalcanti, Ronaldo Rodrigues da Silva, Anders Eriksson, P. Barbosa
This study assessed the influence of speaker similarity and sample length on the performance of an automatic speaker recognition (ASR) system utilizing the SpeechBrain toolkit. The dataset comprised recordings from 20 male identical twin speakers engaged in spontaneous dialogues and interviews. Performance evaluations involved comparing identical twins, all speakers in the dataset (including twin pairs), and all speakers excluding twin pairs. Speech samples, ranging from 5 to 30 s, underwent assessment based on equal error rates (EER) and Log cost-likelihood ratios (Cllr). Results highlight the substantial challenge posed by identical twins to the ASR system, leading to a decrease in overall speaker recognition accuracy. Furthermore, analyses based on longer speech samples outperformed those using shorter samples. As sample size increased, standard deviation values for both intra and inter-speaker similarity scores decreased, indicating reduced variability in estimating speaker similarity/dissimilarity levels in longer speech stretches compared to shorter ones. The study also uncovered varying degrees of likeness among identical twins, with certain pairs presenting a greater challenge for ASR systems. These outcomes align with prior research and are discussed within the context of relevant literature.
本研究利用 SpeechBrain 工具包评估了说话者相似度和样本长度对自动说话者识别(ASR)系统性能的影响。数据集由 20 位男性同卵双胞胎说话者在自发对话和访谈中的录音组成。性能评估包括比较同卵双胞胎、数据集中的所有发言人(包括双胞胎)和不包括双胞胎的所有发言人。语音样本从 5 秒到 30 秒不等,根据等错误率 (EER) 和对数成本似然比 (Cllr) 进行评估。结果表明,同卵双胞胎给 ASR 系统带来了巨大的挑战,导致说话人的整体识别准确率下降。此外,基于较长语音样本的分析结果优于使用较短样本的分析结果。随着样本量的增加,说话人内部和说话人之间相似度得分的标准偏差值都有所下降,这表明与较短的样本相比,较长语音样本在估计说话人相似度/不相似度水平方面的变异性有所降低。研究还发现,同卵双胞胎之间的相似程度各不相同,某些双胞胎对自动识别系统提出了更大的挑战。这些结果与之前的研究结果一致,并在相关文献中进行了讨论。
{"title":"Exploring the performance of automatic speaker recognition using twin speech and deep learning-based artificial neural networks","authors":"Julio Cesar Cavalcanti, Ronaldo Rodrigues da Silva, Anders Eriksson, P. Barbosa","doi":"10.3389/frai.2024.1287877","DOIUrl":"https://doi.org/10.3389/frai.2024.1287877","url":null,"abstract":"This study assessed the influence of speaker similarity and sample length on the performance of an automatic speaker recognition (ASR) system utilizing the SpeechBrain toolkit. The dataset comprised recordings from 20 male identical twin speakers engaged in spontaneous dialogues and interviews. Performance evaluations involved comparing identical twins, all speakers in the dataset (including twin pairs), and all speakers excluding twin pairs. Speech samples, ranging from 5 to 30 s, underwent assessment based on equal error rates (EER) and Log cost-likelihood ratios (Cllr). Results highlight the substantial challenge posed by identical twins to the ASR system, leading to a decrease in overall speaker recognition accuracy. Furthermore, analyses based on longer speech samples outperformed those using shorter samples. As sample size increased, standard deviation values for both intra and inter-speaker similarity scores decreased, indicating reduced variability in estimating speaker similarity/dissimilarity levels in longer speech stretches compared to shorter ones. The study also uncovered varying degrees of likeness among identical twins, with certain pairs presenting a greater challenge for ASR systems. These outcomes align with prior research and are discussed within the context of relevant literature.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"4 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139851960","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A dynamic approach for visualizing and exploring concept hierarchies from textbooks 可视化和探索教科书概念层次的动态方法
Pub Date : 2024-02-08 DOI: 10.3389/frai.2024.1285026
Sabine Wehnert, Praneeth Chedella, Jonas Asche, Ernesto William De Luca
In this study, we propose a visualization technique to explore and visualize concept hierarchies generated from a textbook in the legal domain. Through a human-centered design process, we developed a tool that allows users to effectively navigate through and explore complex hierarchical concepts in three kinds of traversal techniques: top-down, middle-out, and bottom-up. Our concept hierarchies offer an overview over a given domain, with increasing level of detail toward the bottom of the hierarchy which is consisting of entities. In the legal use case we considered, the concepts were adapted from section headings in a legal textbook, whereas references to law or legal cases inside the textbook became entities. The design of this tool is refined following various steps such as gathering user needs, pain points of an existing visualization, prototyping, testing, and refining. The resulting interface offers users several key features such as dynamic search and filter, explorable concept nodes, and a preview of leaf nodes at every stage. A high-fidelity prototype was created to test our theory and design. To test our concept, we used the System Usability Scale as a way to measure the prototype's usability, a task-based survey to asses the tool's ability in assisting users in gathering information and interacting with the prototype, and finally mouse tracking to understand user interaction patterns. Along with this, we gathered audio and video footage of users when participating in the study. This footage also helped us in getting feedback when the survey responses required further information. The data collected provided valuable insights to set the directions for extending this study. As a result, we have accounted for varying hierarchy depths, longer text spans than only one to two words in the elements of the hierarchy, searchability, and exploration of the hierarchies. At the same time, we aimed for minimizing visual clutter and cognitive overload. We show that existing approaches are not suitable to visualize the type of data which we support with our visualization.
在本研究中,我们提出了一种可视化技术,用于探索和可视化法律领域教科书中生成的概念层次。通过以人为本的设计过程,我们开发了一种工具,允许用户通过三种遍历技术有效地浏览和探索复杂的层次概念:自上而下、中间向外和自下而上。我们的概念层次结构提供了一个给定领域的概览,层次结构的底层由实体组成,其详细程度不断增加。在我们考虑的法律用例中,概念改编自法律教科书中的章节标题,而教科书中对法律或法律案例的引用则成为实体。该工具的设计经过了收集用户需求、现有可视化的痛点、原型设计、测试和完善等多个步骤。最终的界面为用户提供了几个关键功能,如动态搜索和过滤、可探索的概念节点以及每个阶段的叶节点预览。我们创建了一个高保真原型来测试我们的理论和设计。为了测试我们的概念,我们使用了系统可用性量表(System Usability Scale)来衡量原型的可用性,使用基于任务的调查来评估工具在协助用户收集信息和与原型交互方面的能力,最后使用鼠标跟踪来了解用户的交互模式。此外,我们还收集了用户参与研究时的音频和视频片段。当调查反馈需要更多信息时,这些录像也有助于我们获得反馈。收集到的数据提供了宝贵的见解,为本研究的扩展指明了方向。因此,我们考虑到了不同的层次结构深度、层次结构元素中长文本跨度(而不是只有一到两个单词)、可搜索性以及对层次结构的探索。同时,我们的目标是尽量减少视觉混乱和认知过载。我们的研究表明,现有的方法并不适合可视化我们所支持的数据类型。
{"title":"A dynamic approach for visualizing and exploring concept hierarchies from textbooks","authors":"Sabine Wehnert, Praneeth Chedella, Jonas Asche, Ernesto William De Luca","doi":"10.3389/frai.2024.1285026","DOIUrl":"https://doi.org/10.3389/frai.2024.1285026","url":null,"abstract":"In this study, we propose a visualization technique to explore and visualize concept hierarchies generated from a textbook in the legal domain. Through a human-centered design process, we developed a tool that allows users to effectively navigate through and explore complex hierarchical concepts in three kinds of traversal techniques: top-down, middle-out, and bottom-up. Our concept hierarchies offer an overview over a given domain, with increasing level of detail toward the bottom of the hierarchy which is consisting of entities. In the legal use case we considered, the concepts were adapted from section headings in a legal textbook, whereas references to law or legal cases inside the textbook became entities. The design of this tool is refined following various steps such as gathering user needs, pain points of an existing visualization, prototyping, testing, and refining. The resulting interface offers users several key features such as dynamic search and filter, explorable concept nodes, and a preview of leaf nodes at every stage. A high-fidelity prototype was created to test our theory and design. To test our concept, we used the System Usability Scale as a way to measure the prototype's usability, a task-based survey to asses the tool's ability in assisting users in gathering information and interacting with the prototype, and finally mouse tracking to understand user interaction patterns. Along with this, we gathered audio and video footage of users when participating in the study. This footage also helped us in getting feedback when the survey responses required further information. The data collected provided valuable insights to set the directions for extending this study. As a result, we have accounted for varying hierarchy depths, longer text spans than only one to two words in the elements of the hierarchy, searchability, and exploration of the hierarchies. At the same time, we aimed for minimizing visual clutter and cognitive overload. We show that existing approaches are not suitable to visualize the type of data which we support with our visualization.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"49 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139852080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Machine learning-based infant crying interpretation 基于机器学习的婴儿哭声解读
Pub Date : 2024-02-08 DOI: 10.3389/frai.2024.1337356
M. Hammoud, Melaku N. Getahun, Anna Baldycheva, Andrey Somov
Crying is an inevitable character trait that occurs throughout the growth of infants, under conditions where the caregiver may have difficulty interpreting the underlying cause of the cry. Crying can be treated as an audio signal that carries a message about the infant's state, such as discomfort, hunger, and sickness. The primary infant caregiver requires traditional ways of understanding these feelings. Failing to understand them correctly can cause severe problems. Several methods attempt to solve this problem; however, proper audio feature representation and classifiers are necessary for better results. This study uses time-, frequency-, and time-frequency-domain feature representations to gain in-depth information from the data. The time-domain features include zero-crossing rate (ZCR) and root mean square (RMS), the frequency-domain feature includes the Mel-spectrogram, and the time-frequency-domain feature includes Mel-frequency cepstral coefficients (MFCCs). Moreover, time-series imaging algorithms are applied to transform 20 MFCC features into images using different algorithms: Gramian angular difference fields, Gramian angular summation fields, Markov transition fields, recurrence plots, and RGB GAF. Then, these features are provided to different machine learning classifiers, such as decision tree, random forest, K nearest neighbors, and bagging. The use of MFCCs, ZCR, and RMS as features achieved high performance, outperforming state of the art (SOTA). Optimal parameters are found via the grid search method using 10-fold cross-validation. Our MFCC-based random forest (RF) classifier approach achieved an accuracy of 96.39%, outperforming SOTA, the scalogram-based shuffleNet classifier, which had an accuracy of 95.17%.
哭泣是婴儿在成长过程中不可避免的性格特征,在这种情况下,看护人可能难以理解哭泣的根本原因。啼哭可被视为一种声音信号,传递着婴儿的状态信息,如不舒服、饥饿和生病等。婴儿的主要照顾者需要用传统的方法来理解这些感受。如果不能正确理解,就会造成严重的问题。有几种方法试图解决这一问题,但要取得更好的效果,必须要有适当的音频特征表示和分类器。本研究使用时域、频域和时频域特征表示法从数据中获取深度信息。时域特征包括零交叉率(ZCR)和均方根(RMS),频域特征包括梅尔频谱图(Mel-spectrogram),时频域特征包括梅尔频率倒频谱系数(MFCC)。此外,时间序列成像算法可将 20 个 MFCC 特征转化为图像,并使用不同的算法:格拉米安角差场、格拉米安角和场、马尔可夫转换场、递归图和 RGB GAF。然后,将这些特征提供给不同的机器学习分类器,如决策树、随机森林、K 最近邻和袋式分类。使用 MFCCs、ZCR 和 RMS 作为特征实现了较高的性能,优于最新技术(SOTA)。通过使用 10 倍交叉验证的网格搜索法找到了最佳参数。我们基于 MFCC 的随机森林 (RF) 分类器的准确率达到了 96.39%,超过了 SOTA 和基于 scalogram 的 shuffleNet 分类器,后者的准确率为 95.17%。
{"title":"Machine learning-based infant crying interpretation","authors":"M. Hammoud, Melaku N. Getahun, Anna Baldycheva, Andrey Somov","doi":"10.3389/frai.2024.1337356","DOIUrl":"https://doi.org/10.3389/frai.2024.1337356","url":null,"abstract":"Crying is an inevitable character trait that occurs throughout the growth of infants, under conditions where the caregiver may have difficulty interpreting the underlying cause of the cry. Crying can be treated as an audio signal that carries a message about the infant's state, such as discomfort, hunger, and sickness. The primary infant caregiver requires traditional ways of understanding these feelings. Failing to understand them correctly can cause severe problems. Several methods attempt to solve this problem; however, proper audio feature representation and classifiers are necessary for better results. This study uses time-, frequency-, and time-frequency-domain feature representations to gain in-depth information from the data. The time-domain features include zero-crossing rate (ZCR) and root mean square (RMS), the frequency-domain feature includes the Mel-spectrogram, and the time-frequency-domain feature includes Mel-frequency cepstral coefficients (MFCCs). Moreover, time-series imaging algorithms are applied to transform 20 MFCC features into images using different algorithms: Gramian angular difference fields, Gramian angular summation fields, Markov transition fields, recurrence plots, and RGB GAF. Then, these features are provided to different machine learning classifiers, such as decision tree, random forest, K nearest neighbors, and bagging. The use of MFCCs, ZCR, and RMS as features achieved high performance, outperforming state of the art (SOTA). Optimal parameters are found via the grid search method using 10-fold cross-validation. Our MFCC-based random forest (RF) classifier approach achieved an accuracy of 96.39%, outperforming SOTA, the scalogram-based shuffleNet classifier, which had an accuracy of 95.17%.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"53 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139853145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A multi-center distributed learning approach for Parkinson's disease classification using the traveling model paradigm 使用行进模型范例的帕金森病分类多中心分布式学习方法
Pub Date : 2024-02-07 DOI: 10.3389/frai.2024.1301997
Raissa Souza, Emma A. M. Stanley, Milton Camacho, Richard Camicioli, O. Monchi, Zahinoor Ismail, M. Wilms, Nils D. Forkert
Distributed learning is a promising alternative to central learning for machine learning (ML) model training, overcoming data-sharing problems in healthcare. Previous studies exploring federated learning (FL) or the traveling model (TM) setup for medical image-based disease classification often relied on large databases with a limited number of centers or simulated artificial centers, raising doubts about real-world applicability. This study develops and evaluates a convolution neural network (CNN) for Parkinson's disease classification using data acquired by 83 diverse real centers around the world, mostly contributing small training samples. Our approach specifically makes use of the TM setup, which has proven effective in scenarios with limited data availability but has never been used for image-based disease classification. Our findings reveal that TM is effective for training CNN models, even in complex real-world scenarios with variable data distributions. After sufficient training cycles, the TM-trained CNN matches or slightly surpasses the performance of the centrally trained counterpart (AUROC of 83% vs. 80%). Our study highlights, for the first time, the effectiveness of TM in 3D medical image classification, especially in scenarios with limited training samples and heterogeneous distributed data. These insights are relevant for situations where ML models are supposed to be trained using data from small or remote medical centers, and rare diseases with sparse cases. The simplicity of this approach enables a broad application to many deep learning tasks, enhancing its clinical utility across various contexts and medical facilities.
在机器学习(ML)模型训练中,分布式学习是中心学习的一种有前途的替代方法,可以克服医疗保健领域的数据共享问题。以往探索基于医学影像的疾病分类的联合学习(FL)或巡回模型(TM)设置的研究往往依赖于中心数量有限的大型数据库或模拟人工中心,这让人对其在现实世界中的适用性产生怀疑。本研究利用全球 83 个不同真实中心获得的数据,开发并评估了用于帕金森病分类的卷积神经网络(CNN),这些中心大多提供了少量训练样本。我们的方法特别使用了 TM 设置,该设置已被证明在数据可用性有限的情况下有效,但从未用于基于图像的疾病分类。我们的研究结果表明,即使在数据分布多变的复杂现实世界场景中,TM 也能有效地训练 CNN 模型。经过足够的训练周期后,TM 训练的 CNN 的性能可与集中训练的 CNN 相媲美,甚至略胜一筹(AUROC 为 83% 对 80%)。我们的研究首次强调了 TM 在三维医学图像分类中的有效性,尤其是在训练样本有限和异构分布式数据的情况下。这些见解对于使用来自小型或偏远医疗中心的数据训练 ML 模型以及病例稀少的罕见疾病具有重要意义。这种方法非常简单,可广泛应用于许多深度学习任务,从而提高其在各种环境和医疗设施中的临床实用性。
{"title":"A multi-center distributed learning approach for Parkinson's disease classification using the traveling model paradigm","authors":"Raissa Souza, Emma A. M. Stanley, Milton Camacho, Richard Camicioli, O. Monchi, Zahinoor Ismail, M. Wilms, Nils D. Forkert","doi":"10.3389/frai.2024.1301997","DOIUrl":"https://doi.org/10.3389/frai.2024.1301997","url":null,"abstract":"Distributed learning is a promising alternative to central learning for machine learning (ML) model training, overcoming data-sharing problems in healthcare. Previous studies exploring federated learning (FL) or the traveling model (TM) setup for medical image-based disease classification often relied on large databases with a limited number of centers or simulated artificial centers, raising doubts about real-world applicability. This study develops and evaluates a convolution neural network (CNN) for Parkinson's disease classification using data acquired by 83 diverse real centers around the world, mostly contributing small training samples. Our approach specifically makes use of the TM setup, which has proven effective in scenarios with limited data availability but has never been used for image-based disease classification. Our findings reveal that TM is effective for training CNN models, even in complex real-world scenarios with variable data distributions. After sufficient training cycles, the TM-trained CNN matches or slightly surpasses the performance of the centrally trained counterpart (AUROC of 83% vs. 80%). Our study highlights, for the first time, the effectiveness of TM in 3D medical image classification, especially in scenarios with limited training samples and heterogeneous distributed data. These insights are relevant for situations where ML models are supposed to be trained using data from small or remote medical centers, and rare diseases with sparse cases. The simplicity of this approach enables a broad application to many deep learning tasks, enhancing its clinical utility across various contexts and medical facilities.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"68 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139856108","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A multi-center distributed learning approach for Parkinson's disease classification using the traveling model paradigm 使用行进模型范例的帕金森病分类多中心分布式学习方法
Pub Date : 2024-02-07 DOI: 10.3389/frai.2024.1301997
Raissa Souza, Emma A. M. Stanley, Milton Camacho, Richard Camicioli, O. Monchi, Zahinoor Ismail, M. Wilms, Nils D. Forkert
Distributed learning is a promising alternative to central learning for machine learning (ML) model training, overcoming data-sharing problems in healthcare. Previous studies exploring federated learning (FL) or the traveling model (TM) setup for medical image-based disease classification often relied on large databases with a limited number of centers or simulated artificial centers, raising doubts about real-world applicability. This study develops and evaluates a convolution neural network (CNN) for Parkinson's disease classification using data acquired by 83 diverse real centers around the world, mostly contributing small training samples. Our approach specifically makes use of the TM setup, which has proven effective in scenarios with limited data availability but has never been used for image-based disease classification. Our findings reveal that TM is effective for training CNN models, even in complex real-world scenarios with variable data distributions. After sufficient training cycles, the TM-trained CNN matches or slightly surpasses the performance of the centrally trained counterpart (AUROC of 83% vs. 80%). Our study highlights, for the first time, the effectiveness of TM in 3D medical image classification, especially in scenarios with limited training samples and heterogeneous distributed data. These insights are relevant for situations where ML models are supposed to be trained using data from small or remote medical centers, and rare diseases with sparse cases. The simplicity of this approach enables a broad application to many deep learning tasks, enhancing its clinical utility across various contexts and medical facilities.
在机器学习(ML)模型训练中,分布式学习是中心学习的一种有前途的替代方法,可以克服医疗保健领域的数据共享问题。以往探索基于医学影像的疾病分类的联合学习(FL)或巡回模型(TM)设置的研究往往依赖于中心数量有限的大型数据库或模拟人工中心,这让人对其在现实世界中的适用性产生怀疑。本研究利用全球 83 个不同真实中心获得的数据,开发并评估了用于帕金森病分类的卷积神经网络(CNN),这些中心大多提供了少量训练样本。我们的方法特别使用了 TM 设置,该设置已被证明在数据可用性有限的情况下有效,但从未用于基于图像的疾病分类。我们的研究结果表明,即使在数据分布多变的复杂现实世界场景中,TM 也能有效地训练 CNN 模型。经过足够的训练周期后,TM 训练的 CNN 的性能可与集中训练的 CNN 相媲美,甚至略胜一筹(AUROC 为 83% 对 80%)。我们的研究首次强调了 TM 在三维医学图像分类中的有效性,尤其是在训练样本有限和异构分布式数据的情况下。这些见解对于使用来自小型或偏远医疗中心的数据训练 ML 模型以及病例稀少的罕见疾病具有重要意义。这种方法非常简单,可广泛应用于许多深度学习任务,从而提高其在各种环境和医疗设施中的临床实用性。
{"title":"A multi-center distributed learning approach for Parkinson's disease classification using the traveling model paradigm","authors":"Raissa Souza, Emma A. M. Stanley, Milton Camacho, Richard Camicioli, O. Monchi, Zahinoor Ismail, M. Wilms, Nils D. Forkert","doi":"10.3389/frai.2024.1301997","DOIUrl":"https://doi.org/10.3389/frai.2024.1301997","url":null,"abstract":"Distributed learning is a promising alternative to central learning for machine learning (ML) model training, overcoming data-sharing problems in healthcare. Previous studies exploring federated learning (FL) or the traveling model (TM) setup for medical image-based disease classification often relied on large databases with a limited number of centers or simulated artificial centers, raising doubts about real-world applicability. This study develops and evaluates a convolution neural network (CNN) for Parkinson's disease classification using data acquired by 83 diverse real centers around the world, mostly contributing small training samples. Our approach specifically makes use of the TM setup, which has proven effective in scenarios with limited data availability but has never been used for image-based disease classification. Our findings reveal that TM is effective for training CNN models, even in complex real-world scenarios with variable data distributions. After sufficient training cycles, the TM-trained CNN matches or slightly surpasses the performance of the centrally trained counterpart (AUROC of 83% vs. 80%). Our study highlights, for the first time, the effectiveness of TM in 3D medical image classification, especially in scenarios with limited training samples and heterogeneous distributed data. These insights are relevant for situations where ML models are supposed to be trained using data from small or remote medical centers, and rare diseases with sparse cases. The simplicity of this approach enables a broad application to many deep learning tasks, enhancing its clinical utility across various contexts and medical facilities.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"358 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139796428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analyzing global utilization and missed opportunities in debt-for-nature swaps with generative AI 用生成式人工智能分析债换自然中的全球利用率和错失的机会
Pub Date : 2024-02-05 DOI: 10.3389/frai.2024.1167137
Nataliya Tkachenko, Simon Frieder, Ryan-Rhys Griffiths, Christoph Nedopil
We deploy a prompt-augmented GPT-4 model to distill comprehensive datasets on the global application of debt-for-nature swaps (DNS), a pivotal financial tool for environmental conservation. Our analysis includes 195 nations and identifies 21 countries that have not yet used DNS before as prime candidates for DNS. A significant proportion demonstrates consistent commitments to conservation finance (0.86 accuracy as compared to historical swaps records). Conversely, 35 countries previously active in DNS before 2010 have since been identified as unsuitable. Notably, Argentina, grappling with soaring inflation and a substantial sovereign debt crisis, and Poland, which has achieved economic stability and gained access to alternative EU conservation funds, exemplify the shifting suitability landscape. The study's outcomes illuminate the fragility of DNS as a conservation strategy amid economic and political volatility.
我们采用了一个及时增强的 GPT-4 模型,提炼出了有关全球应用债换自然(DNS)的综合数据集,这是一种用于环境保护的重要金融工具。我们的分析包括 195 个国家,发现 21 个尚未使用过债换自然的国家是债换自然的主要候选国。其中很大一部分国家表现出对环境保护融资的一贯承诺(与历史互换记录相比,准确率达到 0.86)。相反,有 35 个在 2010 年之前曾积极参与 DNS 的国家后来被认定为不适合 DNS。值得注意的是,阿根廷正努力应对飙升的通货膨胀和严重的主权债务危机,而波兰则实现了经济稳定,并获得了欧盟保护基金的替代资金,这些国家都是适宜性不断变化的典范。研究结果表明,在经济和政治动荡的情况下,DNS 作为一种保护战略是脆弱的。
{"title":"Analyzing global utilization and missed opportunities in debt-for-nature swaps with generative AI","authors":"Nataliya Tkachenko, Simon Frieder, Ryan-Rhys Griffiths, Christoph Nedopil","doi":"10.3389/frai.2024.1167137","DOIUrl":"https://doi.org/10.3389/frai.2024.1167137","url":null,"abstract":"We deploy a prompt-augmented GPT-4 model to distill comprehensive datasets on the global application of debt-for-nature swaps (DNS), a pivotal financial tool for environmental conservation. Our analysis includes 195 nations and identifies 21 countries that have not yet used DNS before as prime candidates for DNS. A significant proportion demonstrates consistent commitments to conservation finance (0.86 accuracy as compared to historical swaps records). Conversely, 35 countries previously active in DNS before 2010 have since been identified as unsuitable. Notably, Argentina, grappling with soaring inflation and a substantial sovereign debt crisis, and Poland, which has achieved economic stability and gained access to alternative EU conservation funds, exemplify the shifting suitability landscape. The study's outcomes illuminate the fragility of DNS as a conservation strategy amid economic and political volatility.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"5 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139805663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analyzing global utilization and missed opportunities in debt-for-nature swaps with generative AI 用生成式人工智能分析债换自然中的全球利用率和错失的机会
Pub Date : 2024-02-05 DOI: 10.3389/frai.2024.1167137
Nataliya Tkachenko, Simon Frieder, Ryan-Rhys Griffiths, Christoph Nedopil
We deploy a prompt-augmented GPT-4 model to distill comprehensive datasets on the global application of debt-for-nature swaps (DNS), a pivotal financial tool for environmental conservation. Our analysis includes 195 nations and identifies 21 countries that have not yet used DNS before as prime candidates for DNS. A significant proportion demonstrates consistent commitments to conservation finance (0.86 accuracy as compared to historical swaps records). Conversely, 35 countries previously active in DNS before 2010 have since been identified as unsuitable. Notably, Argentina, grappling with soaring inflation and a substantial sovereign debt crisis, and Poland, which has achieved economic stability and gained access to alternative EU conservation funds, exemplify the shifting suitability landscape. The study's outcomes illuminate the fragility of DNS as a conservation strategy amid economic and political volatility.
我们采用了一个及时增强的 GPT-4 模型,提炼出了有关全球应用债换自然(DNS)的综合数据集,这是一种用于环境保护的重要金融工具。我们的分析包括 195 个国家,发现 21 个尚未使用过债换自然的国家是债换自然的主要候选国。其中很大一部分国家表现出对环境保护融资的一贯承诺(与历史互换记录相比,准确率达到 0.86)。相反,有 35 个在 2010 年之前曾积极参与 DNS 的国家后来被认定为不适合 DNS。值得注意的是,阿根廷正努力应对飙升的通货膨胀和严重的主权债务危机,而波兰则实现了经济稳定,并获得了欧盟保护基金的替代资金,这些国家都是适宜性不断变化的典范。研究结果表明,在经济和政治动荡的情况下,DNS 作为一种保护战略是脆弱的。
{"title":"Analyzing global utilization and missed opportunities in debt-for-nature swaps with generative AI","authors":"Nataliya Tkachenko, Simon Frieder, Ryan-Rhys Griffiths, Christoph Nedopil","doi":"10.3389/frai.2024.1167137","DOIUrl":"https://doi.org/10.3389/frai.2024.1167137","url":null,"abstract":"We deploy a prompt-augmented GPT-4 model to distill comprehensive datasets on the global application of debt-for-nature swaps (DNS), a pivotal financial tool for environmental conservation. Our analysis includes 195 nations and identifies 21 countries that have not yet used DNS before as prime candidates for DNS. A significant proportion demonstrates consistent commitments to conservation finance (0.86 accuracy as compared to historical swaps records). Conversely, 35 countries previously active in DNS before 2010 have since been identified as unsuitable. Notably, Argentina, grappling with soaring inflation and a substantial sovereign debt crisis, and Poland, which has achieved economic stability and gained access to alternative EU conservation funds, exemplify the shifting suitability landscape. The study's outcomes illuminate the fragility of DNS as a conservation strategy amid economic and political volatility.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"51 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139865708","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editorial: Financial intermediation versus disintermediation: opportunities and challenges in the FinTech era, volume II 社论:金融中介与脱媒:金融科技时代的机遇与挑战》,第二卷
Pub Date : 2024-01-19 DOI: 10.3389/frai.2024.1326358
Anna Omarini
{"title":"Editorial: Financial intermediation versus disintermediation: opportunities and challenges in the FinTech era, volume II","authors":"Anna Omarini","doi":"10.3389/frai.2024.1326358","DOIUrl":"https://doi.org/10.3389/frai.2024.1326358","url":null,"abstract":"","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"22 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139525266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Artificial intelligence in biology and medicine, and radioprotection research: perspectives from Jerusalem 生物学和医学中的人工智能以及辐射防护研究:耶路撒冷的观点
Pub Date : 2024-01-11 DOI: 10.3389/frai.2023.1291136
Y. Socol, Ariella Richardson, Imene Garali-Zineddine, Stephane Grison, Guillaume Vares, Dmitry Klokov
While AI is widely used in biomedical research and medical practice, its use is constrained to few specific practical areas, e.g., radiomics. Participants of the workshop on “Artificial Intelligence in Biology and Medicine” (Jerusalem, Feb 14–15, 2023), both researchers and practitioners, aimed to build a holistic picture by exploring AI advancements, challenges and perspectives, as well as to suggest new fields for AI applications. Presentations showcased the potential of large language models (LLMs) in generating molecular structures, predicting protein-ligand interactions, and promoting democratization of AI development. Ethical concerns in medical decision making were also addressed. In biological applications, AI integration of multi-omics and clinical data elucidated the health relevant effects of low doses of ionizing radiation. Bayesian latent modeling identified statistical associations between unobserved variables. Medical applications highlighted liquid biopsy methods for non-invasive diagnostics, routine laboratory tests to identify overlooked illnesses, and AI's role in oral and maxillofacial imaging. Explainable AI and diverse image processing tools improved diagnostics, while text classification detected anorexic behavior in blog posts. The workshop fostered knowledge sharing, discussions, and emphasized the need for further AI development in radioprotection research in support of emerging public health issues. The organizers plan to continue the initiative as an annual event, promoting collaboration and addressing issues and perspectives in AI applications with a focus on low-dose radioprotection research. Researchers involved in radioprotection research and experts in relevant public policy domains are invited to explore the utility of AI in low-dose radiation research at the next workshop.
虽然人工智能在生物医学研究和医疗实践中得到了广泛应用,但其应用仅限于一些特定的实际领域,如放射组学。人工智能在生物学和医学中的应用 "研讨会(耶路撒冷,2023 年 2 月 14-15 日)的与会者,包括研究人员和从业人员,旨在通过探讨人工智能的进步、挑战和前景来构建一个全面的图景,并提出人工智能应用的新领域。演讲展示了大型语言模型(LLM)在生成分子结构、预测蛋白质配体相互作用以及促进人工智能发展民主化方面的潜力。会议还讨论了医疗决策中的伦理问题。在生物应用方面,人工智能整合了多组学和临床数据,阐明了低剂量电离辐射对健康的影响。贝叶斯潜模型确定了未观察变量之间的统计关联。医疗应用突出了用于无创诊断的液体活检方法、用于识别被忽视疾病的常规实验室检测,以及人工智能在口腔颌面成像中的作用。可解释的人工智能和多样化的图像处理工具改进了诊断,而文本分类则检测出了博文中的厌食行为。研讨会促进了知识共享和讨论,并强调了在辐射防护研究中进一步发展人工智能以支持新出现的公共卫生问题的必要性。组织者计划将这一倡议作为年度活动延续下去,促进合作,解决人工智能应用中的问题和观点,重点关注低剂量辐射防护研究。欢迎参与辐射防护研究的研究人员和相关公共政策领域的专家在下一次研讨会上探讨人工智能在低剂量辐射研究中的应用。
{"title":"Artificial intelligence in biology and medicine, and radioprotection research: perspectives from Jerusalem","authors":"Y. Socol, Ariella Richardson, Imene Garali-Zineddine, Stephane Grison, Guillaume Vares, Dmitry Klokov","doi":"10.3389/frai.2023.1291136","DOIUrl":"https://doi.org/10.3389/frai.2023.1291136","url":null,"abstract":"While AI is widely used in biomedical research and medical practice, its use is constrained to few specific practical areas, e.g., radiomics. Participants of the workshop on “Artificial Intelligence in Biology and Medicine” (Jerusalem, Feb 14–15, 2023), both researchers and practitioners, aimed to build a holistic picture by exploring AI advancements, challenges and perspectives, as well as to suggest new fields for AI applications. Presentations showcased the potential of large language models (LLMs) in generating molecular structures, predicting protein-ligand interactions, and promoting democratization of AI development. Ethical concerns in medical decision making were also addressed. In biological applications, AI integration of multi-omics and clinical data elucidated the health relevant effects of low doses of ionizing radiation. Bayesian latent modeling identified statistical associations between unobserved variables. Medical applications highlighted liquid biopsy methods for non-invasive diagnostics, routine laboratory tests to identify overlooked illnesses, and AI's role in oral and maxillofacial imaging. Explainable AI and diverse image processing tools improved diagnostics, while text classification detected anorexic behavior in blog posts. The workshop fostered knowledge sharing, discussions, and emphasized the need for further AI development in radioprotection research in support of emerging public health issues. The organizers plan to continue the initiative as an annual event, promoting collaboration and addressing issues and perspectives in AI applications with a focus on low-dose radioprotection research. Researchers involved in radioprotection research and experts in relevant public policy domains are invited to explore the utility of AI in low-dose radiation research at the next workshop.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"46 22","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139534067","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A survey on the role of artificial intelligence in managing Long COVID 关于人工智能在管理 Long COVID 中的作用的调查
Pub Date : 2024-01-11 DOI: 10.3389/frai.2023.1292466
Ijaz Ahmad, Alessia Amelio, A. Merla, Francesca Scozzari
In the last years, several techniques of artificial intelligence have been applied to data from COVID-19. In addition to the symptoms related to COVID-19, many individuals with SARS-CoV-2 infection have described various long-lasting symptoms, now termed Long COVID. In this context, artificial intelligence techniques have been utilized to analyze data from Long COVID patients in order to assist doctors and alleviate the considerable strain on care and rehabilitation facilities. In this paper, we explore the impact of the machine learning methodologies that have been applied to analyze the many aspects of Long COVID syndrome, from clinical presentation through diagnosis. We also include the text mining techniques used to extract insights and trends from large amounts of text data related to Long COVID. Finally, we critically compare the various approaches and outline the work that has to be done to create a robust artificial intelligence approach for efficient diagnosis and treatment of Long COVID.
在过去几年中,一些人工智能技术被应用到 COVID-19 的数据中。除了与 COVID-19 相关的症状外,许多感染了 SARS-CoV-2 的人还描述了各种持续时间较长的症状,现在被称为长 COVID。在这种情况下,人工智能技术被用来分析长 COVID 患者的数据,以协助医生减轻护理和康复设施的巨大压力。在本文中,我们将探讨机器学习方法的影响,这些方法已被用于分析 Long COVID 综合征从临床表现到诊断的诸多方面。我们还介绍了文本挖掘技术,该技术用于从与 Long COVID 相关的大量文本数据中提取见解和趋势。最后,我们对各种方法进行了批判性比较,并概述了为高效诊断和治疗 Long COVID 而创建强大人工智能方法所需做的工作。
{"title":"A survey on the role of artificial intelligence in managing Long COVID","authors":"Ijaz Ahmad, Alessia Amelio, A. Merla, Francesca Scozzari","doi":"10.3389/frai.2023.1292466","DOIUrl":"https://doi.org/10.3389/frai.2023.1292466","url":null,"abstract":"In the last years, several techniques of artificial intelligence have been applied to data from COVID-19. In addition to the symptoms related to COVID-19, many individuals with SARS-CoV-2 infection have described various long-lasting symptoms, now termed Long COVID. In this context, artificial intelligence techniques have been utilized to analyze data from Long COVID patients in order to assist doctors and alleviate the considerable strain on care and rehabilitation facilities. In this paper, we explore the impact of the machine learning methodologies that have been applied to analyze the many aspects of Long COVID syndrome, from clinical presentation through diagnosis. We also include the text mining techniques used to extract insights and trends from large amounts of text data related to Long COVID. Finally, we critically compare the various approaches and outline the work that has to be done to create a robust artificial intelligence approach for efficient diagnosis and treatment of Long COVID.","PeriodicalId":508738,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"43 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139533389","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Frontiers in Artificial Intelligence
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1