Trade-off Analysis in Learning-augmented Algorithms with Societal Design Criteria

Q4 Computer Science Performance Evaluation Review Pub Date : 2023-09-28 DOI:10.1145/3626570.3626590
Mohammad H. Hajiesmaili
{"title":"Trade-off Analysis in Learning-augmented Algorithms with Societal Design Criteria","authors":"Mohammad H. Hajiesmaili","doi":"10.1145/3626570.3626590","DOIUrl":null,"url":null,"abstract":"Traditionally, computer systems are designed to optimize classic notions of performance such as flow completion time, cost, etc. The system performance is then typically evaluated by characterizing theoretical bounds in worst-case settings over a single performance metric. In the next generation of computer systems, societal design criteria, such as carbon awareness and fairness, becomes a first-class design goal. However, the classic performance metrics may conflict with societal criteria. Foundational understanding and performance evaluations of systems with these inherent trade-offs lead to novel research questions that could be considered new educational components for performance analysis courses. The classic techniques, e.g., worst-case analysis, for systems with conflicting objectives may lead to the impossibility of results. However, a foundational understanding of the impossibility of results calls for new techniques and tools. In traditional performance evaluation, to understand the foundational limits, typically, it is sufficient to derive lower-bound arguments in worst-case settings. In the new era of system design, lower bounds are inherently about trade-offs between different objectives. Characterizing these trade-offs in settings with multiple design criteria is closer to the notion of Pareto-optimality, which is drastically different from classic lower bounds. With the impossibility of results using classic paradigms, one possible direction is to (re)design systems following the emerging direction of learning-augmented algorithms. With this approach, it might be possible to remove/mitigate the foundational conflict between classic vs. societal metrics using the right predictions. However, the performance evaluation of learning-augmented algorithms calls for a new set of technical questions, which we highlight in this paper.","PeriodicalId":35745,"journal":{"name":"Performance Evaluation Review","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Performance Evaluation Review","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3626570.3626590","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 0

Abstract

Traditionally, computer systems are designed to optimize classic notions of performance such as flow completion time, cost, etc. The system performance is then typically evaluated by characterizing theoretical bounds in worst-case settings over a single performance metric. In the next generation of computer systems, societal design criteria, such as carbon awareness and fairness, becomes a first-class design goal. However, the classic performance metrics may conflict with societal criteria. Foundational understanding and performance evaluations of systems with these inherent trade-offs lead to novel research questions that could be considered new educational components for performance analysis courses. The classic techniques, e.g., worst-case analysis, for systems with conflicting objectives may lead to the impossibility of results. However, a foundational understanding of the impossibility of results calls for new techniques and tools. In traditional performance evaluation, to understand the foundational limits, typically, it is sufficient to derive lower-bound arguments in worst-case settings. In the new era of system design, lower bounds are inherently about trade-offs between different objectives. Characterizing these trade-offs in settings with multiple design criteria is closer to the notion of Pareto-optimality, which is drastically different from classic lower bounds. With the impossibility of results using classic paradigms, one possible direction is to (re)design systems following the emerging direction of learning-augmented algorithms. With this approach, it might be possible to remove/mitigate the foundational conflict between classic vs. societal metrics using the right predictions. However, the performance evaluation of learning-augmented algorithms calls for a new set of technical questions, which we highlight in this paper.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于社会设计准则的学习增强算法的权衡分析
传统上,计算机系统的设计是为了优化经典的性能概念,如流量、完井时间、成本等。然后,系统性能通常通过在单个性能指标上描述最坏情况设置的理论界限来评估。在下一代计算机系统中,社会设计标准,如碳意识和公平性,成为一流的设计目标。然而,经典的绩效指标可能与社会标准相冲突。对具有这些内在权衡的系统的基本理解和性能评估导致了新的研究问题,这些问题可以被视为性能分析课程的新教育组成部分。对于具有冲突目标的系统,经典技术,例如最坏情况分析,可能导致不可能得到结果。然而,对结果不可能的基本理解需要新的技术和工具。在传统的性能评估中,为了理解基本限制,通常,在最坏情况下推导下界参数就足够了。在系统设计的新时代,下限本质上是关于不同目标之间的权衡。用多种设计标准来描述这些权衡更接近于帕累托最优的概念,这与经典的下限有很大的不同。由于使用经典范式的结果是不可能的,一个可能的方向是(重新)设计系统遵循学习增强算法的新兴方向。有了这种方法,就有可能通过正确的预测消除/缓解经典指标与社会指标之间的基本冲突。然而,学习增强算法的性能评估需要一系列新的技术问题,我们在本文中强调了这些问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Performance Evaluation Review
Performance Evaluation Review Computer Science-Computer Networks and Communications
CiteScore
1.00
自引率
0.00%
发文量
193
期刊最新文献
Exponential Tail Bounds on Queues Tackling Deployability Challenges in ML-Powered Networks GHZ distillation protocols in the presence of decoherence Markov Decision Process Framework for Control-Based Reinforcement Learning Entanglement Management through Swapping over Quantum Internets
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1