首页 > 最新文献

Patterns最新文献

英文 中文
Best holdout assessment is sufficient for cancer transcriptomic model selection. 最佳抵抗评估是充分的癌症转录组模型选择。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-12-06 eCollection Date: 2024-12-13 DOI: 10.1016/j.patter.2024.101115
Jake Crawford, Maria Chikina, Casey S Greene

Guidelines in statistical modeling for genomics hold that simpler models have advantages over more complex ones. Potential advantages include cost, interpretability, and improved generalization across datasets or biological contexts. We directly tested the assumption that small gene signatures generalize better by examining the generalization of mutation status prediction models across datasets (from cell lines to human tumors and vice versa) and biological contexts (holding out entire cancer types from pan-cancer data). We compared model selection between solely cross-validation performance and combining cross-validation performance with regularization strength. We did not observe that more regularized signatures generalized better. This result held across both generalization problems and for both linear models (LASSO logistic regression) and non-linear ones (neural networks). When the goal of an analysis is to produce generalizable predictive models, we recommend choosing the ones that perform best on held-out data or in cross-validation instead of those that are smaller or more regularized.

基因组学统计建模指南认为,简单的模型比复杂的模型更有优势。潜在的优势包括成本、可解释性和跨数据集或生物背景的改进泛化。我们通过检查跨数据集(从细胞系到人类肿瘤,反之亦然)和生物学背景(从泛癌症数据中保留整个癌症类型)的突变状态预测模型的泛化,直接测试了小基因特征泛化更好的假设。我们比较了单独交叉验证性能和将交叉验证性能与正则化强度相结合的模型选择。我们没有观察到更正则化的签名泛化得更好。这一结果适用于泛化问题、线性模型(LASSO逻辑回归)和非线性模型(神经网络)。当分析的目标是产生可推广的预测模型时,我们建议选择那些在保留数据或交叉验证中表现最好的模型,而不是那些更小或更正则化的模型。
{"title":"Best holdout assessment is sufficient for cancer transcriptomic model selection.","authors":"Jake Crawford, Maria Chikina, Casey S Greene","doi":"10.1016/j.patter.2024.101115","DOIUrl":"https://doi.org/10.1016/j.patter.2024.101115","url":null,"abstract":"<p><p>Guidelines in statistical modeling for genomics hold that simpler models have advantages over more complex ones. Potential advantages include cost, interpretability, and improved generalization across datasets or biological contexts. We directly tested the assumption that small gene signatures generalize better by examining the generalization of mutation status prediction models across datasets (from cell lines to human tumors and vice versa) and biological contexts (holding out entire cancer types from pan-cancer data). We compared model selection between solely cross-validation performance and combining cross-validation performance with regularization strength. We did not observe that more regularized signatures generalized better. This result held across both generalization problems and for both linear models (LASSO logistic regression) and non-linear ones (neural networks). When the goal of an analysis is to produce generalizable predictive models, we recommend choosing the ones that perform best on held-out data or in cross-validation instead of those that are smaller or more regularized.</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 12","pages":"101115"},"PeriodicalIF":6.7,"publicationDate":"2024-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11701843/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142956206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The recent Physics and Chemistry Nobel Prizes, AI, and the convergence of knowledge fields. 最近的物理学和化学诺贝尔奖,人工智能和知识领域的融合。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-25 eCollection Date: 2024-12-13 DOI: 10.1016/j.patter.2024.101099
Charles H Martin, Ganesh Mani

This article examines the convergence of physics, chemistry, and artificial intelligence (AI), highlighted by recent Nobel Prizes. It traces the historical development of neural networks, emphasizing interdisciplinary research's role in advancing AI. The authors advocate for nurturing AI-enabled polymaths to bridge the gap between theoretical advancements and practical applications, driving progress toward artificial general intelligence (AGI).

这篇文章探讨了最近诺贝尔奖所突出的物理、化学和人工智能(AI)的融合。它追溯了神经网络的历史发展,强调了跨学科研究在推进人工智能方面的作用。作者主张培养支持人工智能的通才,以弥合理论进步和实际应用之间的差距,推动人工通用智能(AGI)的发展。
{"title":"The recent Physics and Chemistry Nobel Prizes, AI, and the convergence of knowledge fields.","authors":"Charles H Martin, Ganesh Mani","doi":"10.1016/j.patter.2024.101099","DOIUrl":"https://doi.org/10.1016/j.patter.2024.101099","url":null,"abstract":"<p><p>This article examines the convergence of physics, chemistry, and artificial intelligence (AI), highlighted by recent Nobel Prizes. It traces the historical development of neural networks, emphasizing interdisciplinary research's role in advancing AI. The authors advocate for nurturing AI-enabled polymaths to bridge the gap between theoretical advancements and practical applications, driving progress toward artificial general intelligence (AGI).</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 12","pages":"101099"},"PeriodicalIF":6.7,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11701849/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142956221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cross-modal contrastive learning for unified placenta analysis using photographs. 使用照片进行统一胎盘分析的跨模式对比学习。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-19 eCollection Date: 2024-12-13 DOI: 10.1016/j.patter.2024.101097
Yimu Pan, Manas Mehta, Jeffery A Goldstein, Joseph Ngonzi, Lisa M Bebell, Drucilla J Roberts, Chrystalle Katte Carreon, Kelly Gallagher, Rachel E Walker, Alison D Gernand, James Z Wang

The placenta is vital to maternal and child health but often overlooked in pregnancy studies. Addressing the need for a more accessible and cost-effective method of placental assessment, our study introduces a computational tool designed for the analysis of placental photographs. Leveraging images and pathology reports collected from sites in the United States and Uganda over a 12-year period, we developed a cross-modal contrastive learning algorithm consisting of pre-alignment, distillation, and retrieval modules. Moreover, the proposed robustness evaluation protocol enables statistical assessment of performance improvements, provides deeper insight into the impact of different features on predictions, and offers practical guidance for its application in a variety of settings. Through extensive experimentation, our tool demonstrates an average area under the receiver operating characteristic curve score of over 82% in both internal and external validations, which underscores the potential of our tool to enhance clinical care across diverse environments.

胎盘对母婴健康至关重要,但在妊娠研究中往往被忽视。为了解决对胎盘评估的更容易获得和成本效益的方法的需求,我们的研究引入了一个设计用于分析胎盘照片的计算工具。利用12年来从美国和乌干达收集的图像和病理报告,我们开发了一种跨模态对比学习算法,包括预校准、蒸馏和检索模块。此外,所提出的鲁棒性评估协议能够对性能改进进行统计评估,更深入地了解不同特征对预测的影响,并为其在各种环境中的应用提供实际指导。通过广泛的实验,我们的工具显示,在内部和外部验证中,接受者工作特征曲线得分下的平均面积超过82%,这强调了我们的工具在不同环境下增强临床护理的潜力。
{"title":"Cross-modal contrastive learning for unified placenta analysis using photographs.","authors":"Yimu Pan, Manas Mehta, Jeffery A Goldstein, Joseph Ngonzi, Lisa M Bebell, Drucilla J Roberts, Chrystalle Katte Carreon, Kelly Gallagher, Rachel E Walker, Alison D Gernand, James Z Wang","doi":"10.1016/j.patter.2024.101097","DOIUrl":"https://doi.org/10.1016/j.patter.2024.101097","url":null,"abstract":"<p><p>The placenta is vital to maternal and child health but often overlooked in pregnancy studies. Addressing the need for a more accessible and cost-effective method of placental assessment, our study introduces a computational tool designed for the analysis of placental photographs. Leveraging images and pathology reports collected from sites in the United States and Uganda over a 12-year period, we developed a cross-modal contrastive learning algorithm consisting of pre-alignment, distillation, and retrieval modules. Moreover, the proposed robustness evaluation protocol enables statistical assessment of performance improvements, provides deeper insight into the impact of different features on predictions, and offers practical guidance for its application in a variety of settings. Through extensive experimentation, our tool demonstrates an average area under the receiver operating characteristic curve score of over 82% in both internal and external validations, which underscores the potential of our tool to enhance clinical care across diverse environments.</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 12","pages":"101097"},"PeriodicalIF":6.7,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11701861/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142956210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the hidden world of RNA viruses with a transformer-based tool. 利用基于变压器的工具探索 RNA 病毒的隐秘世界。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-08 DOI: 10.1016/j.patter.2024.101095
So Nakagawa, Shoichi Sakaguchi

Hou and He et al.1 developed a new RNA virus identification tool named LucaProt, a transformer-based bioinformatics software using sequence and structural characteristics of RNA-dependent RNA polymerases (RdRPs), which are essential for almost all RNA viruses. LucaProt can identify RdRPs from highly diverse RNA viruses, unveiling the hidden RNA virosphere.

LucaProt是一种基于变压器的生物信息学软件,它利用几乎所有RNA病毒都必需的RNA依赖性RNA聚合酶(RdRPs)的序列和结构特征来识别RNA病毒。LucaProt 可以从高度多样化的 RNA 病毒中识别 RdRPs,从而揭开隐藏的 RNA 病毒球的面纱。
{"title":"Exploring the hidden world of RNA viruses with a transformer-based tool.","authors":"So Nakagawa, Shoichi Sakaguchi","doi":"10.1016/j.patter.2024.101095","DOIUrl":"10.1016/j.patter.2024.101095","url":null,"abstract":"<p><p>Hou and He et al.<sup>1</sup> developed a new RNA virus identification tool named LucaProt, a transformer-based bioinformatics software using sequence and structural characteristics of RNA-dependent RNA polymerases (RdRPs), which are essential for almost all RNA viruses. LucaProt can identify RdRPs from highly diverse RNA viruses, unveiling the hidden RNA virosphere.</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 11","pages":"101095"},"PeriodicalIF":6.7,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11573883/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142682995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hopfield and Hinton's neural network revolution and the future of AI. Hopfield 和 Hinton 的神经网络革命与人工智能的未来。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-08 DOI: 10.1016/j.patter.2024.101094
James Z Wang, Brad Wyble

In this opinion piece, the authors, from the fields of artificial intelligence (AI) and psychology, reflect on how the foundational discoveries of Nobel laureates Hopfield and Hinton have influenced their research. They also discuss emerging directions in AI and the challenges that lie ahead for neural networks and machine learning.

在这篇评论文章中,来自人工智能(AI)和心理学领域的作者们思考了诺贝尔奖得主霍普菲尔德和辛顿的奠基性发现如何影响了他们的研究。他们还讨论了人工智能的新方向以及神经网络和机器学习面临的挑战。
{"title":"Hopfield and Hinton's neural network revolution and the future of AI.","authors":"James Z Wang, Brad Wyble","doi":"10.1016/j.patter.2024.101094","DOIUrl":"10.1016/j.patter.2024.101094","url":null,"abstract":"<p><p>In this opinion piece, the authors, from the fields of artificial intelligence (AI) and psychology, reflect on how the foundational discoveries of Nobel laureates Hopfield and Hinton have influenced their research. They also discuss emerging directions in AI and the challenges that lie ahead for neural networks and machine learning.</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 11","pages":"101094"},"PeriodicalIF":6.7,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11573896/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142682997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Privacy of single-cell gene expression data. 单细胞基因表达数据的隐私。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-08 DOI: 10.1016/j.patter.2024.101096
Hyunghoon Cho

The possibility that single-cell gene expression datasets could leak information about individuals' genotypes has been largely unexplored. Walker et al. showed that even noisy genotype predictions derived from these data can be linked to the corresponding genotype profiles with significant accuracy.

单细胞基因表达数据集可能会泄露个体的基因型信息,但这种可能性在很大程度上还未被探索。Walker 等人的研究表明,即使从这些数据中得出的基因型预测是嘈杂的,也能准确无误地与相应的基因型图谱联系起来。
{"title":"Privacy of single-cell gene expression data.","authors":"Hyunghoon Cho","doi":"10.1016/j.patter.2024.101096","DOIUrl":"10.1016/j.patter.2024.101096","url":null,"abstract":"<p><p>The possibility that single-cell gene expression datasets could leak information about individuals' genotypes has been largely unexplored. Walker et al. showed that even noisy genotype predictions derived from these data can be linked to the corresponding genotype profiles with significant accuracy.</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 11","pages":"101096"},"PeriodicalIF":6.7,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11573887/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142683000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A multi-dimensional approach to the future of digital research infrastructure for systemic environmental science. 从多维角度探讨系统环境科学数字研究基础设施的未来。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-08 DOI: 10.1016/j.patter.2024.101092
Kelly Widdicks, Faiza Samreen, Gordon S Blair, Susannah Rennie, John Watkins

Digital research infrastructure (DRI) for environmental science requires significant transformation to support the changing nature of science and utilize digital innovations. Numerous challenges prevent this change yet simultaneously pose exciting principles to drive the future of DRI. This opinion piece details a multi-dimensional approach toward these futures for the environmental community.

环境科学的数字研究基础设施(DRI)需要进行重大变革,以支持不断变化的科学性质并利用数字创新。众多挑战阻碍了这一变革,但同时也提出了推动 DRI 未来发展的激动人心的原则。本评论文章详细介绍了环境界实现这些未来的多维方法。
{"title":"A multi-dimensional approach to the future of digital research infrastructure for systemic environmental science.","authors":"Kelly Widdicks, Faiza Samreen, Gordon S Blair, Susannah Rennie, John Watkins","doi":"10.1016/j.patter.2024.101092","DOIUrl":"10.1016/j.patter.2024.101092","url":null,"abstract":"<p><p>Digital research infrastructure (DRI) for environmental science requires significant transformation to support the changing nature of science and utilize digital innovations. Numerous challenges prevent this change yet simultaneously pose exciting principles to drive the future of DRI. This opinion piece details a multi-dimensional approach toward these futures for the environmental community.</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 11","pages":"101092"},"PeriodicalIF":6.7,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11573892/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142682991","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How could the United Nations Global Digital Compact prevent cultural imposition and hermeneutical injustice? 联合国全球数字契约如何防止文化强加和诠释学上的不公正?
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-08 DOI: 10.1016/j.patter.2024.101078
Arthur Gwagwa, Warmhold Jan Thomas Mollema

As the geopolitical superpowers race to regulate the digital realm, their divergent rights-centered, market-driven, and social-control-based approaches require a global compact on digital regulation. If diverse regulatory jurisdictions remain, forms of domination entailed by cultural imposition and hermeneutical injustice related to AI legislation and AI systems will follow. We argue for consensual regulation on shared substantive issues, accompanied by proper standardization and coordination. Failure to attain consensus will fragment global digital regulation, enable regulatory capture by authoritarian powers or bad corporate actors, and deepen the historical geopolitical power asymmetries between the global South and the global North. To prevent an unjust regulatory landscape where the global South's cultural and hermeneutic resources are absent, two principles for the Global Digital Compact to counter these prospective harms are proposed and discussed: (1) "recognitive consensus on key substantive benefits and harms" and (2) "procedural consensus on global coordination and essential standards."

随着地缘政治超级大国竞相监管数字领域,它们以权利为中心、以市场为驱动、以社会控制为基础的不同方法要求就数字监管达成一项全球契约。如果仍然存在不同的监管管辖区,那么与人工智能立法和人工智能系统相关的文化强加和诠释学不公正所带来的支配形式就会随之而来。我们主张对共同的实质性问题进行协商一致的监管,同时进行适当的标准化和协调。如果不能达成共识,全球数字监管就会支离破碎,使监管被专制权力或不良企业行为者攫取,并加深全球南方和全球北方之间历史性的地缘政治力量不对称。为了防止出现全球南方文化和诠释学资源缺失的不公正监管格局,我们提出并讨论了全球数字契约的两项原则,以应对这些潜在的危害:(1) "就关键的实质性利益和危害达成公认的共识",(2) "就全球协调和基本标准达成程序性共识"。
{"title":"How could the United Nations Global Digital Compact prevent cultural imposition and hermeneutical injustice?","authors":"Arthur Gwagwa, Warmhold Jan Thomas Mollema","doi":"10.1016/j.patter.2024.101078","DOIUrl":"10.1016/j.patter.2024.101078","url":null,"abstract":"<p><p>As the geopolitical superpowers race to regulate the digital realm, their divergent rights-centered, market-driven, and social-control-based approaches require a global compact on digital regulation. If diverse regulatory jurisdictions remain, forms of domination entailed by cultural imposition and hermeneutical injustice related to AI legislation and AI systems will follow. We argue for consensual regulation on shared substantive issues, accompanied by proper standardization and coordination. Failure to attain consensus will fragment global digital regulation, enable regulatory capture by authoritarian powers or bad corporate actors, and deepen the historical geopolitical power asymmetries between the global South and the global North. To prevent an unjust regulatory landscape where the global South's cultural and hermeneutic resources are absent, two principles for the Global Digital Compact to counter these prospective harms are proposed and discussed: (1) \"recognitive consensus on key substantive benefits and harms\" and (2) \"procedural consensus on global coordination and essential standards.\"</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 11","pages":"101078"},"PeriodicalIF":6.7,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11573906/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142682998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Benchmark suites instead of leaderboards for evaluating AI fairness. 用基准套件代替排行榜来评估人工智能的公平性。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-08 DOI: 10.1016/j.patter.2024.101080
Angelina Wang, Aaron Hertzmann, Olga Russakovsky

Benchmarks and leaderboards are commonly used to track the fairness impacts of artificial intelligence (AI) models. Many critics argue against this practice, since it incentivizes optimizing for metrics in an attempt to build the "most fair" AI model. However, this is an inherently impossible task since different applications have different considerations. While we agree with the critiques against leaderboards, we believe that the use of benchmarks can be reformed. Thus far, the critiques of leaderboards and benchmarks have become unhelpfully entangled. However, benchmarks, when not used for leaderboards, offer important tools for understanding a model. We advocate for collecting benchmarks into carefully curated "benchmark suites," which can provide researchers and practitioners with tools for understanding the wide range of potential harms and trade-offs among different aspects of fairness. We describe the research needed to build these benchmark suites so that they can better assess different usage modalities, cover potential harms, and reflect diverse perspectives. By moving away from leaderboards and instead thoughtfully designing and compiling benchmark suites, we can better monitor and improve the fairness impacts of AI technology.

基准和排行榜通常用于跟踪人工智能(AI)模型对公平性的影响。许多批评者反对这种做法,因为它激励人们优化指标,试图建立 "最公平 "的人工智能模型。然而,这本来就是不可能完成的任务,因为不同的应用有不同的考虑因素。虽然我们同意对排行榜的批评,但我们认为可以对基准的使用进行改革。迄今为止,对排行榜和基准的批评已经纠缠在一起,毫无益处。然而,基准在不用于排行榜的情况下,也是理解模型的重要工具。我们主张将基准收集起来,形成精心策划的 "基准套件",为研究人员和从业人员提供了解各种潜在危害和公平性不同方面之间权衡的工具。我们描述了建立这些基准套件所需的研究,以便它们能够更好地评估不同的使用模式、涵盖潜在的危害并反映不同的观点。通过摒弃排行榜,转而深思熟虑地设计和汇编基准套件,我们可以更好地监控和改进人工智能技术对公平性的影响。
{"title":"Benchmark suites instead of leaderboards for evaluating AI fairness.","authors":"Angelina Wang, Aaron Hertzmann, Olga Russakovsky","doi":"10.1016/j.patter.2024.101080","DOIUrl":"10.1016/j.patter.2024.101080","url":null,"abstract":"<p><p>Benchmarks and leaderboards are commonly used to track the fairness impacts of artificial intelligence (AI) models. Many critics argue against this practice, since it incentivizes optimizing for metrics in an attempt to build the \"most fair\" AI model. However, this is an inherently impossible task since different applications have different considerations. While we agree with the critiques against leaderboards, we believe that the use of benchmarks can be reformed. Thus far, the critiques of leaderboards and benchmarks have become unhelpfully entangled. However, benchmarks, when not used for leaderboards, offer important tools for understanding a model. We advocate for collecting benchmarks into carefully curated \"benchmark suites,\" which can provide researchers and practitioners with tools for understanding the wide range of potential harms and trade-offs among different aspects of fairness. We describe the research needed to build these benchmark suites so that they can better assess different usage modalities, cover potential harms, and reflect diverse perspectives. By moving away from leaderboards and instead thoughtfully designing and compiling benchmark suites, we can better monitor and improve the fairness impacts of AI technology.</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 11","pages":"101080"},"PeriodicalIF":6.7,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11573903/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142682993","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Toward a tipping point in federated learning in healthcare and life sciences. 迈向医疗保健和生命科学领域联合学习的临界点。
IF 6.7 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-11-08 DOI: 10.1016/j.patter.2024.101077
Inken Hagestedt, Ian Hales, Eric Boernert, Holger R Roth, Michael A Hoeh, Robin Röhm, Ellie Dobson, José Tomás Prieto

We discuss the real-world application of federated learning (FL) in the healthcare and life sciences industry, noting a tipping point in its adoption beyond academia. Sharing our experiences with multi-hospital and multi-pharma collaborations, we highlight the importance of involving key stakeholders to develop production-grade FL solutions that are fully compliant with stringent privacy and security standards.

我们讨论了联合学习(FL)在医疗保健和生命科学行业的实际应用,指出了其在学术界以外的应用临界点。在分享我们与多家医院和多家制药公司合作的经验时,我们强调了主要利益相关者参与开发完全符合严格的隐私和安全标准的生产级联合学习解决方案的重要性。
{"title":"Toward a tipping point in federated learning in healthcare and life sciences.","authors":"Inken Hagestedt, Ian Hales, Eric Boernert, Holger R Roth, Michael A Hoeh, Robin Röhm, Ellie Dobson, José Tomás Prieto","doi":"10.1016/j.patter.2024.101077","DOIUrl":"10.1016/j.patter.2024.101077","url":null,"abstract":"<p><p>We discuss the real-world application of federated learning (FL) in the healthcare and life sciences industry, noting a tipping point in its adoption beyond academia. Sharing our experiences with multi-hospital and multi-pharma collaborations, we highlight the importance of involving key stakeholders to develop production-grade FL solutions that are fully compliant with stringent privacy and security standards.</p>","PeriodicalId":36242,"journal":{"name":"Patterns","volume":"5 11","pages":"101077"},"PeriodicalIF":6.7,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11573894/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142683001","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Patterns
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1