首页 > 最新文献

Journal of Artificial Intelligence Research最新文献

英文 中文
Better Decision Heuristics in CDCL through Local Search and Target Phases 基于局部搜索和目标阶段的CDCL优化决策启发式
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-08-08 DOI: 10.1613/jair.1.13666
Shaowei Cai, Xindi Zhang, M. Fleury, Armin Biere
On practical applications, state-of-the-art SAT solvers dominantly use the conflict-driven clause learning (CDCL) paradigm. An alternative for satisfiable instances is local search solvers, which is more successful on random and hard combinatorial instances. Although there have been attempts to combine these methods in one framework, a tight integration which improves the state of the art on a broad set of application instances has been missing. We present a combination of techniques that achieves such an improvement. Our first contribution is to maximize in a local search fashion the assignment trail in CDCL, by sticking to and extending promising assignments via a technique called target phases. Second, we relax the CDCL framework by again extending promising branches to complete assignments while ignoring conflicts. These assignments are then used as starting point of local search which tries to find improved assignments with fewer unsatisfied clauses. Third, these improved assignments are imported back to the CDCL loop where they are used to determine the value assigned to decision variables. Finally, the conflict frequency of variables in local search can be exploited during variable selection in branching heuristics of CDCL. We implemented these techniques to improve three representative CDCL solvers (Glucose, MapleLcm DistChronoBT, and Kissat). Experiments on benchmarks from the main tracks of the last three SAT Competitions from 2019 to 2021 and an additional benchmark set from spectrum allocation show that the techniques bring significant improvements, particularly and not surprisingly, on satisfiable real-world application instances. We claim that these techniques were essential to the large increase in performance witnessed in the SAT Competition 2020 where Kissat and Relaxed LcmdCbDl NewTech were leading the field followed by CryptoMiniSAT-Ccnr, which also incorporated similar ideas.
在实际应用中,最先进的SAT求解器主要使用冲突驱动子句学习(CDCL)范式。可满足实例的另一种选择是局部搜索求解器,它在随机和硬组合实例上更成功。尽管已经有人尝试将这些方法组合到一个框架中,但是缺少一种紧密的集成,这种集成可以在广泛的应用程序实例集上提高技术水平。我们提出了一种实现这种改进的技术组合。我们的第一个贡献是通过一种称为目标阶段的技术坚持和扩展有前途的任务,以局部搜索方式最大化CDCL中的任务轨迹。其次,我们通过再次扩展有希望的分支来完成任务而忽略冲突来放松CDCL框架。然后将这些赋值作为局部搜索的起点,试图找到具有较少不满足子句的改进赋值。第三,这些改进的赋值被导入到CDCL循环中,在那里它们被用来确定分配给决策变量的值。最后,在CDCL分支启发式的变量选择中,可以利用局部搜索中变量的冲突频率。我们实施了这些技术来改进三个代表性的CDCL求解器(Glucose, mapelcm DistChronoBT和Kissat)。在2019年至2021年的最后三场SAT竞赛的主要赛道上进行的基准测试以及频谱分配的额外基准测试表明,这些技术带来了显着的改进,特别是在令人满意的实际应用实例上。我们声称,这些技术对于在2020年SAT竞赛中看到的性能大幅提高至关重要,其中Kissat和relax LcmdCbDl NewTech在该领域处于领先地位,其次是CryptoMiniSAT-Ccnr,后者也采用了类似的想法。
{"title":"Better Decision Heuristics in CDCL through Local Search and Target Phases","authors":"Shaowei Cai, Xindi Zhang, M. Fleury, Armin Biere","doi":"10.1613/jair.1.13666","DOIUrl":"https://doi.org/10.1613/jair.1.13666","url":null,"abstract":"On practical applications, state-of-the-art SAT solvers dominantly use the conflict-driven clause learning (CDCL) paradigm. An alternative for satisfiable instances is local search solvers, which is more successful on random and hard combinatorial instances. Although there have been attempts to combine these methods in one framework, a tight integration which improves the state of the art on a broad set of application instances has been missing. We present a combination of techniques that achieves such an improvement. Our first contribution is to maximize in a local search fashion the assignment trail in CDCL, by sticking to and extending promising assignments via a technique called target phases. Second, we relax the CDCL framework by again extending promising branches to complete assignments while ignoring conflicts. These assignments are then used as starting point of local search which tries to find improved assignments with fewer unsatisfied clauses. Third, these improved assignments are imported back to the CDCL loop where they are used to determine the value assigned to decision variables. Finally, the conflict frequency of variables in local search can be exploited during variable selection in branching heuristics of CDCL. We implemented these techniques to improve three representative CDCL solvers (Glucose, MapleLcm DistChronoBT, and Kissat). Experiments on benchmarks from the main tracks of the last three SAT Competitions from 2019 to 2021 and an additional benchmark set from spectrum allocation show that the techniques bring significant improvements, particularly and not surprisingly, on satisfiable real-world application instances. We claim that these techniques were essential to the large increase in performance witnessed in the SAT Competition 2020 where Kissat and Relaxed LcmdCbDl NewTech were leading the field followed by CryptoMiniSAT-Ccnr, which also incorporated similar ideas.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"357 1","pages":"1515-1563"},"PeriodicalIF":5.0,"publicationDate":"2022-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76317989","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Improving Simulated Annealing for Clique Partitioning Problems 团划分问题的改进模拟退火
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-07-27 DOI: 10.1613/jair.1.13382
Jian Gao, Yiqi Lv, Minghao Liu, Shaowei Cai, Feifei Ma
The Clique Partitioning Problem (CPP) is essential in graph theory with a number of important applications. Due to its NP-hardness, efficient algorithms for solving this problem are very crucial for practical purposes, and simulated annealing is proved to be effective in state-of-the-art CPP algorithms. However, to make simulated annealing more efficient to solve large-scale CPPs, in this paper, we propose a new iterated simulated annealing algorithm. Several methods are proposed in our algorithm to improve simulated annealing. First, a new configuration checking strategy based on timestamp is presented and incorporated into simulated annealing to avoid search cycles. Afterwards, to enhance the local search ability of simulated annealing and speed up convergence, we combine our simulated annealing with a descent search method to solve the CPP. This method further improves solutions found by simulated annealing, and thus compensates for the local search effect. To further accelerate the convergence speed, we introduce a shrinking factor to decline initial temperature and then propose an iterated local search algorithm based on simulated annealing. Additionally, a restart strategy is adopted when the search procedure converges. Extensive experiments on benchmark instances of the CPP were carried out, and the results suggest that the proposed simulated annealing algorithm outperforms all the existing heuristic algorithms, including five state-of-the-art algorithms. Thus the best-known solutions for 34 instances out of 94 are updated. We also conduct comparative analyses of the proposed strategies and show their effectiveness.
团划分问题(Clique Partitioning Problem, CPP)是图论中一个重要的问题,在图论中有许多重要的应用。由于其np -硬度,求解该问题的有效算法在实际应用中非常重要,模拟退火被证明是最先进的CPP算法中有效的。然而,为了使模拟退火更有效地求解大规模CPPs,本文提出了一种新的迭代模拟退火算法。在我们的算法中提出了几种改进模拟退火的方法。首先,提出了一种新的基于时间戳的组态检查策略,并将其引入模拟退火中以避免搜索循环。然后,为了增强模拟退火的局部搜索能力,加快收敛速度,我们将模拟退火与下降搜索方法相结合来求解CPP。该方法进一步改进了模拟退火法求得的解,从而弥补了局部搜索效应。为了进一步加快收敛速度,我们引入了一个缩小因子来降低初始温度,然后提出了一种基于模拟退火的迭代局部搜索算法。此外,当搜索过程收敛时,采用重新启动策略。在CPP的基准实例上进行了大量的实验,结果表明所提出的模拟退火算法优于所有现有的启发式算法,其中包括五种最先进的算法。因此,94个实例中有34个最著名的解决方案得到了更新。我们还对所提出的策略进行了比较分析,并展示了其有效性。
{"title":"Improving Simulated Annealing for Clique Partitioning Problems","authors":"Jian Gao, Yiqi Lv, Minghao Liu, Shaowei Cai, Feifei Ma","doi":"10.1613/jair.1.13382","DOIUrl":"https://doi.org/10.1613/jair.1.13382","url":null,"abstract":"The Clique Partitioning Problem (CPP) is essential in graph theory with a number of important applications. Due to its NP-hardness, efficient algorithms for solving this problem are very crucial for practical purposes, and simulated annealing is proved to be effective in state-of-the-art CPP algorithms. However, to make simulated annealing more efficient to solve large-scale CPPs, in this paper, we propose a new iterated simulated annealing algorithm. Several methods are proposed in our algorithm to improve simulated annealing. First, a new configuration checking strategy based on timestamp is presented and incorporated into simulated annealing to avoid search cycles. Afterwards, to enhance the local search ability of simulated annealing and speed up convergence, we combine our simulated annealing with a descent search method to solve the CPP. This method further improves solutions found by simulated annealing, and thus compensates for the local search effect. To further accelerate the convergence speed, we introduce a shrinking factor to decline initial temperature and then propose an iterated local search algorithm based on simulated annealing. Additionally, a restart strategy is adopted when the search procedure converges. Extensive experiments on benchmark instances of the CPP were carried out, and the results suggest that the proposed simulated annealing algorithm outperforms all the existing heuristic algorithms, including five state-of-the-art algorithms. Thus the best-known solutions for 34 instances out of 94 are updated. We also conduct comparative analyses of the proposed strategies and show their effectiveness.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"5 1","pages":"1485-1513"},"PeriodicalIF":5.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85775921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Deciding FO-rewritability of Regular Languages and Ontology-Mediated Queries in Linear Temporal Logic 线性时序逻辑中正则语言和本体中介查询的fo -可重写性决定
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-07-13 DOI: 10.1613/jair.1.14061
Agi Kurucz, V. Ryzhikov, Yury Savateev, M. Zakharyaschev
Our concern is the problem of determining the data complexity of answering an ontology-mediated query (OMQ) formulated in linear temporal logic LTL over (Z,<) and deciding whether it is rewritable to an FO(<)-query, possibly with some extra predicates. First, we observe that, in line with the circuit complexity and FO-definability of regular languages, OMQ answering in AC0, ACC0 and NC1 coincides with FO(<,≡)-rewritability using unary predicates x ≡ 0 (mod n), FO(<,MOD)-rewritability, and FO(RPR)-rewritability using relational primitive recursion, respectively. We prove that, similarly to known PSᴘᴀᴄᴇ-completeness of recognising FO(<)-definability of regular languages, deciding FO(<,≡)- and FO(<,MOD)-definability is also PSᴘᴀᴄᴇ-complete (unless ACC0 = NC1). We then use this result to show that deciding FO(<)-, FO(<,≡)- and FO(<,MOD)-rewritability of LTL OMQs is ExᴘSᴘᴀᴄᴇ-complete, and that these problems become PSᴘᴀᴄᴇ-complete for OMQs with a linear Horn ontology and an atomic query, and also a positive query in the cases of FO(<)- and FO(<,≡)-rewritability. Further, we consider FO(<)-rewritability of OMQs with a binary-clause ontology and identify OMQ classes, for which deciding it is PSᴘᴀᴄᴇ-, Π2p- and coNP-complete.
我们关心的问题是确定回答用线性时间逻辑LTL over (Z,<)表述的本体中介查询(OMQ)的数据复杂性,以及确定它是否可重写为FO(<)查询(可能使用一些额外的谓词)。首先,我们观察到,根据正则语言的电路复杂性和FO-可定义性,AC0、ACC0和NC1中的OMQ应答分别符合FO(<,≡)-使用一元谓词x≡0 (mod n)的可重写性、FO(<, mod)-可重写性和FO(RPR)-使用关系原语递归的可重写性。我们证明,类似于已知的识别正则语言的FO(<)-可定义性的PS(<,≡)-的完备性,决定FO(<,≡)-和FO(<,MOD)-可定义性也是PS(<,≡)的完备性(除非ACC0 = NC1)。然后,我们使用该结果表明,决定LTL omq的FO(<,≡)-,FO(<,≡)-和FO(<,MOD)-可重写性是Ex, S, S, S -完备的,并且这些问题对于具有线性Horn本体和原子查询的omq来说是PS, S, S, S -完备的,并且在FO(<)-和FO(<,≡)-可重写性的情况下也是一个正查询。进一步,我们考虑了二元子句本体的OMQ的FO(<)-可重写性,并对OMQ类进行了识别,判定其为PS -、Π2p-和cp -完备。
{"title":"Deciding FO-rewritability of Regular Languages and Ontology-Mediated Queries in Linear Temporal Logic","authors":"Agi Kurucz, V. Ryzhikov, Yury Savateev, M. Zakharyaschev","doi":"10.1613/jair.1.14061","DOIUrl":"https://doi.org/10.1613/jair.1.14061","url":null,"abstract":"Our concern is the problem of determining the data complexity of answering an ontology-mediated query (OMQ) formulated in linear temporal logic LTL over (Z,<) and deciding whether it is rewritable to an FO(<)-query, possibly with some extra predicates. First, we observe that, in line with the circuit complexity and FO-definability of regular languages, OMQ answering in AC0, ACC0 and NC1 coincides with FO(<,≡)-rewritability using unary predicates x ≡ 0 (mod n), FO(<,MOD)-rewritability, and FO(RPR)-rewritability using relational primitive recursion, respectively. We prove that, similarly to known PSᴘᴀᴄᴇ-completeness of recognising FO(<)-definability of regular languages, deciding FO(<,≡)- and FO(<,MOD)-definability is also PSᴘᴀᴄᴇ-complete (unless ACC0 = NC1). We then use this result to show that deciding FO(<)-, FO(<,≡)- and FO(<,MOD)-rewritability of LTL OMQs is ExᴘSᴘᴀᴄᴇ-complete, and that these problems become PSᴘᴀᴄᴇ-complete for OMQs with a linear Horn ontology and an atomic query, and also a positive query in the cases of FO(<)- and FO(<,≡)-rewritability. Further, we consider FO(<)-rewritability of OMQs with a binary-clause ontology and identify OMQ classes, for which deciding it is PSᴘᴀᴄᴇ-, Π2p- and coNP-complete.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"117 1","pages":"645-703"},"PeriodicalIF":5.0,"publicationDate":"2022-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79743005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
HEBO: An Empirical Study of Assumptions in Bayesian Optimisation HEBO:贝叶斯优化假设的实证研究
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-07-11 DOI: 10.1613/jair.1.13643
A. Cowen-Rivers, Wenlong Lyu, Rasul Tutunov, Zhi Wang, Antoine Grosnit, Ryan-Rhys Griffiths, A. Maraval, Jianye Hao, Jun Wang, Jan Peters, Haitham Bou-Ammar
In this work we rigorously analyse assumptions inherent to black-box optimisation hyper-parameter tuning tasks. Our results on the Bayesmark benchmark indicate that heteroscedasticity and non-stationarity pose significant challenges for black-box optimisers. Based on these findings, we propose a Heteroscedastic and Evolutionary Bayesian Optimisation solver (HEBO). HEBO performs non-linear input and output warping, admits exact marginal log-likelihood optimisation and is robust to the values of learned parameters. We demonstrate HEBO’s empirical efficacy on the NeurIPS 2020 Black-Box Optimisation challenge, where HEBO placed first. Upon further analysis, we observe that HEBO significantly outperforms existing black-box optimisers on 108 machine learning hyperparameter tuning tasks comprising the Bayesmark benchmark. Our findings indicate that the majority of hyper-parameter tuning tasks exhibit heteroscedasticity and non-stationarity, multiobjective acquisition ensembles with Pareto front solutions improve queried configurations, and robust acquisition maximisers afford empirical advantages relative to their non-robust counterparts. We hope these findings may serve as guiding principles for practitioners of Bayesian optimisation.
在这项工作中,我们严格分析了黑盒优化超参数调优任务固有的假设。我们在贝叶斯马克基准上的结果表明,异方差和非平稳性对黑盒优化器构成了重大挑战。基于这些发现,我们提出了一个异方差进化贝叶斯优化求解器(HEBO)。HEBO执行非线性输入和输出翘曲,允许精确的边际对数似然优化,并且对学习参数的值具有鲁棒性。我们在NeurIPS 2020黑箱优化挑战中证明了HEBO的经验有效性,其中HEBO排名第一。经过进一步分析,我们观察到HEBO在包含Bayesmark基准的108个机器学习超参数调优任务上显著优于现有的黑盒优化器。我们的研究结果表明,大多数超参数调优任务表现出异方差和非平稳性,具有Pareto前解的多目标采集集成改进了查询配置,并且鲁棒获取最大化器相对于非鲁棒获取最大化器提供了经验优势。我们希望这些发现可以作为贝叶斯优化实践者的指导原则。
{"title":"HEBO: An Empirical Study of Assumptions in Bayesian Optimisation","authors":"A. Cowen-Rivers, Wenlong Lyu, Rasul Tutunov, Zhi Wang, Antoine Grosnit, Ryan-Rhys Griffiths, A. Maraval, Jianye Hao, Jun Wang, Jan Peters, Haitham Bou-Ammar","doi":"10.1613/jair.1.13643","DOIUrl":"https://doi.org/10.1613/jair.1.13643","url":null,"abstract":"In this work we rigorously analyse assumptions inherent to black-box optimisation hyper-parameter tuning tasks. Our results on the Bayesmark benchmark indicate that heteroscedasticity and non-stationarity pose significant challenges for black-box optimisers. Based on these findings, we propose a Heteroscedastic and Evolutionary Bayesian Optimisation solver (HEBO). HEBO performs non-linear input and output warping, admits exact marginal log-likelihood optimisation and is robust to the values of learned parameters. We demonstrate HEBO’s empirical efficacy on the NeurIPS 2020 Black-Box Optimisation challenge, where HEBO placed first. Upon further analysis, we observe that HEBO significantly outperforms existing black-box optimisers on 108 machine learning hyperparameter tuning tasks comprising the Bayesmark benchmark. Our findings indicate that the majority of hyper-parameter tuning tasks exhibit heteroscedasticity and non-stationarity, multiobjective acquisition ensembles with Pareto front solutions improve queried configurations, and robust acquisition maximisers afford empirical advantages relative to their non-robust counterparts. We hope these findings may serve as guiding principles for practitioners of Bayesian optimisation.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"11 1","pages":"1269-1349"},"PeriodicalIF":5.0,"publicationDate":"2022-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78883366","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Evolutionary Dynamics and Phi-Regret Minimization in Games 游戏中的进化动力学和phi -遗憾最小化
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-07-08 DOI: 10.1613/jair.1.13187
G. Piliouras, Mark Rowland, Shayegan Omidshafiei, R. Élie, Daniel Hennes, Jerome T. Connor, K. Tuyls
Regret has been established as a foundational concept in online learning, and likewise has important applications in the analysis of learning dynamics in games. Regret quantifies the difference between a learner’s performance against a baseline in hindsight. It is well known that regret-minimizing algorithms converge to certain classes of equilibria in games; however, traditional forms of regret used in game theory predominantly consider baselines that permit deviations to deterministic actions or strategies. In this paper, we revisit our understanding of regret from the perspective of deviations over partitions of the full mixed strategy space (i.e., probability distributions over pure strategies), under the lens of the previously-established Φ-regret framework, which provides a continuum of stronger regret measures. Importantly, Φ-regret enables learning agents to consider deviations from and to mixed strategies, generalizing several existing notions of regret such as external, internal, and swap regret, and thus broadening the insights gained from regret-based analysis of learning algorithms. We prove here that the well-studied evolutionary learning algorithm of replicator dynamics (RD) seamlessly minimizes the strongest possible form of Φ-regret in generic 2 × 2 games, without any modification of the underlying algorithm itself. We subsequently conduct experiments validating our theoretical results in a suite of 144 2 × 2 games wherein RD exhibits a diverse set of behaviors. We conclude by providing empirical evidence of Φ-regret minimization by RD in some larger games, hinting at further opportunity for Φ-regret based study of such algorithms from both a theoretical and empirical perspective.
遗憾已经成为在线学习的一个基本概念,同样在游戏学习动态分析中也有重要的应用。后悔量化了学习者的表现与后见之明的基线之间的差异。众所周知,遗憾最小化算法收敛于博弈中的某些均衡类;然而,博弈论中使用的传统后悔形式主要考虑允许确定性行动或策略偏差的基线。在本文中,我们在先前建立的Φ-regret框架的透镜下,从完全混合策略空间分区的偏差角度(即纯策略的概率分布)重新审视了我们对后悔的理解,该框架提供了一个连续的更强的后悔措施。重要的是,Φ-regret使学习代理能够考虑与混合策略的偏差,概括了几种现有的后悔概念,如外部、内部和交换后悔,从而拓宽了从基于后悔的学习算法分析中获得的见解。我们在此证明,经过充分研究的复制动力学进化学习算法(RD)无缝地最小化了一般2 × 2游戏中Φ-regret的最强可能形式,而无需对底层算法本身进行任何修改。随后,我们在144个2x2游戏中进行了实验,验证了我们的理论结果,其中RD表现出了一系列不同的行为。最后,我们提供了一些大型游戏中研发Φ-regret最小化的经验证据,暗示了从理论和经验角度对这种算法进行Φ-regret基础研究的进一步机会。
{"title":"Evolutionary Dynamics and Phi-Regret Minimization in Games","authors":"G. Piliouras, Mark Rowland, Shayegan Omidshafiei, R. Élie, Daniel Hennes, Jerome T. Connor, K. Tuyls","doi":"10.1613/jair.1.13187","DOIUrl":"https://doi.org/10.1613/jair.1.13187","url":null,"abstract":"Regret has been established as a foundational concept in online learning, and likewise has important applications in the analysis of learning dynamics in games. Regret quantifies the difference between a learner’s performance against a baseline in hindsight. It is well known that regret-minimizing algorithms converge to certain classes of equilibria in games; however, traditional forms of regret used in game theory predominantly consider baselines that permit deviations to deterministic actions or strategies. In this paper, we revisit our understanding of regret from the perspective of deviations over partitions of the full mixed strategy space (i.e., probability distributions over pure strategies), under the lens of the previously-established Φ-regret framework, which provides a continuum of stronger regret measures. Importantly, Φ-regret enables learning agents to consider deviations from and to mixed strategies, generalizing several existing notions of regret such as external, internal, and swap regret, and thus broadening the insights gained from regret-based analysis of learning algorithms. We prove here that the well-studied evolutionary learning algorithm of replicator dynamics (RD) seamlessly minimizes the strongest possible form of Φ-regret in generic 2 × 2 games, without any modification of the underlying algorithm itself. We subsequently conduct experiments validating our theoretical results in a suite of 144 2 × 2 games wherein RD exhibits a diverse set of behaviors. We conclude by providing empirical evidence of Φ-regret minimization by RD in some larger games, hinting at further opportunity for Φ-regret based study of such algorithms from both a theoretical and empirical perspective.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"99 1","pages":"1125-1158"},"PeriodicalIF":5.0,"publicationDate":"2022-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89541019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Comprehensive Framework for Learning Declarative Action Models 学习陈述性行动模型的综合框架
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-07-07 DOI: 10.1613/jair.1.13073
Diego Aineto, Sergio Jiménez, E. Onaindía
A declarative action model is a compact representation of the state transitions of dynamic systems that generalizes over world objects. The specification of declarative action models is often a complex hand-crafted task. In this paper we formulate declarative action models via state constraints, and present the learning of such models as a combinatorial search. The comprehensive framework presented here allows us to connect the learning of declarative action models to well-known problem solving tasks. In addition, our framework allows us to characterize the existing work in the literature according to four dimensions: (1) the target action models, in terms of the state transitions they define; (2) the available learning examples; (3) the functions used to guide the learning process, and to evaluate the quality of the learned action models; (4) the learning algorithm. Last, the paper lists relevant successful applications of the learning of declarative actions models and discusses some open challenges with the aim of encouraging future research work.
声明性操作模型是动态系统的状态转换的紧凑表示,它概括了整个世界对象。声明性操作模型的规范通常是一项复杂的手工任务。在本文中,我们通过状态约束建立了声明性动作模型,并将这种模型的学习作为组合搜索。这里提供的综合框架允许我们将声明性操作模型的学习与众所周知的问题解决任务联系起来。此外,我们的框架允许我们根据四个维度来描述文献中的现有工作:(1)目标行动模型,根据它们定义的状态转换;(2)可用的学习实例;(3)用于指导学习过程和评价学习行为模型质量的功能;(4)学习算法。最后,本文列举了陈述性行为模型学习的相关成功应用,并讨论了一些有待解决的问题,旨在鼓励未来的研究工作。
{"title":"A Comprehensive Framework for Learning Declarative Action Models","authors":"Diego Aineto, Sergio Jiménez, E. Onaindía","doi":"10.1613/jair.1.13073","DOIUrl":"https://doi.org/10.1613/jair.1.13073","url":null,"abstract":"A declarative action model is a compact representation of the state transitions of dynamic systems that generalizes over world objects. The specification of declarative action models is often a complex hand-crafted task. In this paper we formulate declarative action models via state constraints, and present the learning of such models as a combinatorial search. The comprehensive framework presented here allows us to connect the learning of declarative action models to well-known problem solving tasks. In addition, our framework allows us to characterize the existing work in the literature according to four dimensions: (1) the target action models, in terms of the state transitions they define; (2) the available learning examples; (3) the functions used to guide the learning process, and to evaluate the quality of the learned action models; (4) the learning algorithm. Last, the paper lists relevant successful applications of the learning of declarative actions models and discusses some open challenges with the aim of encouraging future research work.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"22 1","pages":"1091-1123"},"PeriodicalIF":5.0,"publicationDate":"2022-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75708542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Two-phase Multi-document Event Summarization on Core Event Graphs 核心事件图上的两阶段多文档事件摘要
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-07-05 DOI: 10.1613/jair.1.13267
Zengjian Chen, Jin Xu, M. Liao, Tong Xue, Kun He
Succinct event description based on multiple documents is critical to news systems as well as search engines. Different from existing summarization or event tasks, Multi-document Event Summarization (MES) aims at the query-level event sequence generation, which has extra constraints on event expression and conciseness. Identifying and summarizing the key event from a set of related articles is a challenging task that has not been sufficiently studied, mainly because online articles exhibit characteristics of redundancy and sparsity, and a perfect event summarization needs high level information fusion among diverse sentences and articles. To address these challenges, we propose a two-phase framework for the MES task, that first performs event semantic graph construction and dominant event detection via graph-sequence matching, then summarizes the extracted key event by an event-aware pointer generator. For experiments in the new task, we construct two large-scale real-world datasets for training and assessment. Extensive evaluations show that the proposed framework significantly outperforms the related baseline methods, with the most dominant event of the articles effectively identified and correctly summarized.
基于多个文档的简洁事件描述对于新闻系统和搜索引擎都是至关重要的。与现有的摘要或事件任务不同,多文档事件摘要(MES)的目标是查询级的事件序列生成,它对事件的表达和简洁性有额外的约束。从一组相关文章中识别和总结关键事件是一项具有挑战性的任务,研究还不够充分,主要是因为在线文章具有冗余和稀疏的特点,而一个完美的事件总结需要不同句子和文章之间的高水平信息融合。为了解决这些挑战,我们为MES任务提出了一个两阶段框架,首先执行事件语义图构建和通过图序列匹配进行主导事件检测,然后通过事件感知指针生成器总结提取的关键事件。对于新任务中的实验,我们构建了两个大规模的真实世界数据集用于训练和评估。广泛的评估表明,所提出的框架显著优于相关的基线方法,有效识别和正确总结了文章中最主要的事件。
{"title":"Two-phase Multi-document Event Summarization on Core Event Graphs","authors":"Zengjian Chen, Jin Xu, M. Liao, Tong Xue, Kun He","doi":"10.1613/jair.1.13267","DOIUrl":"https://doi.org/10.1613/jair.1.13267","url":null,"abstract":"Succinct event description based on multiple documents is critical to news systems as well as search engines. Different from existing summarization or event tasks, Multi-document Event Summarization (MES) aims at the query-level event sequence generation, which has extra constraints on event expression and conciseness. Identifying and summarizing the key event from a set of related articles is a challenging task that has not been sufficiently studied, mainly because online articles exhibit characteristics of redundancy and sparsity, and a perfect event summarization needs high level information fusion among diverse sentences and articles. To address these challenges, we propose a two-phase framework for the MES task, that first performs event semantic graph construction and dominant event detection via graph-sequence matching, then summarizes the extracted key event by an event-aware pointer generator. For experiments in the new task, we construct two large-scale real-world datasets for training and assessment. Extensive evaluations show that the proposed framework significantly outperforms the related baseline methods, with the most dominant event of the articles effectively identified and correctly summarized.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"4 1","pages":"1037-1057"},"PeriodicalIF":5.0,"publicationDate":"2022-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90044099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
On Dynamics in Structured Argumentation Formalisms 论结构化论证形式主义的动态性
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-07-01 DOI: 10.24963/kr.2022/29
Anna Rapberger, Markus Ulbricht
In this paper we contribute to the investigation of dynamics in assumption-based argumentation (ABA) and investigate situations where a given knowledge base undergoes certain changes. We show that two frequently investigated problems, namely enforcement of a given target atom and deciding strong equivalence of two given ABA frameworks, are intractable in general. Interestingly, these problems are both tractable for abstract argumentation frameworks (AFs) which admit a close correspondence to ABA by constructing semantics-preserving instances. Inspired by this observation, we search for tractable fragments for ABA frameworks by means of the instantiated AFs. We argue that the usual instantiation procedure is not suitable for the investigation of dynamic scenarios since too much information is lost when constructing the AF. We thus consider an extension of AFs, called cvAFs, equipping arguments with conclusions and vulnerabilities in order to better anticipate their role after the underlying knowledge base is extended. We investigate enforcement and strong equivalence for cvAFs and present syntactic conditions to decide them. We show that the correspondence between cvAFs and ABA frameworks is close enough to capture ABA also in dynamic scenarios. This yields the desired tractable ABA fragment. We furthermore discuss consequences for the corresponding problems for logic programs.
在本文中,我们对基于假设的论证(ABA)中的动态进行了研究,并调查了给定知识库经历某些变化的情况。我们证明了两个经常研究的问题,即给定目标原子的强制执行和确定两个给定ABA框架的强等效性,通常是难以解决的。有趣的是,这些问题对于抽象论证框架(AFs)来说都是可处理的,抽象论证框架通过构造语义保留实例承认与ABA密切对应。受到这一观察结果的启发,我们通过实例化的AFs来搜索ABA框架的可处理片段。我们认为,通常的实例化过程不适合动态场景的研究,因为在构建AF时丢失了太多的信息。因此,我们考虑了AFs的扩展,称为cvAFs,为参数配备结论和漏洞,以便在底层知识库扩展后更好地预测它们的作用。我们研究了cvAFs的强制和强等价性,并给出了决定它们的语法条件。我们表明cvAFs和ABA框架之间的对应关系足够紧密,可以在动态场景中捕获ABA。这将产生所需的可处理的ABA片段。我们进一步讨论了逻辑程序相应问题的结果。
{"title":"On Dynamics in Structured Argumentation Formalisms","authors":"Anna Rapberger, Markus Ulbricht","doi":"10.24963/kr.2022/29","DOIUrl":"https://doi.org/10.24963/kr.2022/29","url":null,"abstract":"In this paper we contribute to the investigation of dynamics in assumption-based argumentation (ABA) and investigate situations where a given knowledge base undergoes certain changes. We show that two frequently investigated problems, namely enforcement of a given target atom and deciding strong equivalence of two given ABA frameworks, are intractable in general. Interestingly, these problems are both tractable for abstract argumentation frameworks (AFs) which admit a close correspondence to ABA by constructing semantics-preserving instances. Inspired by this observation, we search for tractable fragments for ABA frameworks by means of the instantiated AFs. We argue that the usual instantiation procedure is not suitable for the investigation of dynamic scenarios since too much information is lost when constructing the AF. We thus consider an extension of AFs, called cvAFs, equipping arguments with conclusions and vulnerabilities in order to better anticipate their role after the underlying knowledge base is extended. We investigate enforcement and strong equivalence for cvAFs and present syntactic conditions to decide them. We show that the correspondence between cvAFs and ABA frameworks is close enough to capture ABA also in dynamic scenarios. This yields the desired tractable ABA fragment. We furthermore discuss consequences for the corresponding problems for logic programs.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"1983 1","pages":"563-643"},"PeriodicalIF":5.0,"publicationDate":"2022-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90303440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Equivalence in Argumentation Frameworks with a Claim-Centric View - Classical Results with Novel Ingredients 以主张为中心的论证框架中的等价性——具有新成分的经典结果
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-06-28 DOI: 10.1609/aaai.v36i5.20486
Ringo Baumann, Anna Rapberger, Markus Ulbricht
A common feature of non-monotonic logics is that the classical notion of equivalence does not preserve the intended meaning in light of additional information. Consequently, the term strong equivalence was coined in the literature and thoroughly investigated. In the present paper, the knowledge representation formalism under consideration are claim-augmented argumentation frameworks (CAFs) which provide a formal basis to analyze conclusion-oriented problems in argumentation by adapting a claim-focused perspective. CAFs extend Dung AFs by associating a claim to each argument representing its conclusion. In this paper, we investigate both ordinary and strong equivalence in CAFs. Thereby, we take the fact into account that one might either be interested in the actual arguments or their claims only. The former point of view naturally yields an extension of strong equivalence for AFs to the claim-based setting while the latter gives rise to a novel equivalence notion which is genuine for CAFs. We tailor, examine and compare these notions and obtain a comprehensive study of this matter for CAFs. We conclude by investigating the computational complexity of naturally arising decision problems.
非单调逻辑的一个共同特征是,经典的等价概念在附加信息的情况下不能保持预期的意义。因此,强等效这一术语在文献中被创造出来并进行了彻底的研究。本文考虑的知识表示形式主义是主张增强的论证框架(CAFs),它采用主张为中心的观点,为分析论证中的结论导向问题提供了形式化基础。通过将声明与表示其结论的每个参数相关联,CAFs扩展了Dung AFs。在本文中,我们研究了一般等价和强等价。因此,我们考虑到一个事实,一个人可能对实际的论点感兴趣,也可能只对它们的主张感兴趣。前一种观点很自然地将af的强等效扩展到基于索赔的设置,而后者则产生了一种新颖的等效概念,这种概念适用于af。我们对这些概念进行了调整、检验和比较,并对CAFs的这一问题进行了全面的研究。我们通过研究自然产生的决策问题的计算复杂性来总结。
{"title":"Equivalence in Argumentation Frameworks with a Claim-Centric View - Classical Results with Novel Ingredients","authors":"Ringo Baumann, Anna Rapberger, Markus Ulbricht","doi":"10.1609/aaai.v36i5.20486","DOIUrl":"https://doi.org/10.1609/aaai.v36i5.20486","url":null,"abstract":"A common feature of non-monotonic logics is that the classical notion of equivalence does not preserve the intended meaning in light of additional information. Consequently, the term strong equivalence was coined in the literature and thoroughly investigated. In the present paper, the knowledge representation formalism under consideration are claim-augmented argumentation frameworks (CAFs) which provide a formal basis to analyze conclusion-oriented problems in argumentation by adapting a claim-focused perspective. CAFs extend Dung AFs by associating a claim to each argument representing its conclusion. In this paper, we investigate both ordinary and strong equivalence in CAFs. Thereby, we take the fact into account that one might either be interested in the actual arguments or their claims only. The former point of view naturally yields an extension of strong equivalence for AFs to the claim-based setting while the latter gives rise to a novel equivalence notion which is genuine for CAFs. We tailor, examine and compare these notions and obtain a comprehensive study of this matter for CAFs. We conclude by investigating the computational complexity of naturally arising decision problems.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"49 1","pages":"891-948"},"PeriodicalIF":5.0,"publicationDate":"2022-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77912140","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Path Counting for Grid-Based Navigation 基于网格导航的路径计数
IF 5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-06-25 DOI: 10.1613/jair.1.13544
Rhys Goldstein, Kean Walmsley, Jacobo Bibliowicz, Alex Tessier, Simon Breslav, Azam Khan
Counting the number of shortest paths on a grid is a simple procedure with close ties to Pascal’s triangle. We show how path counting can be used to select relatively direct grid paths for AI-related applications involving navigation through spatial environments. Typical implementations of Dijkstra’s algorithm and A* prioritize grid moves in an arbitrary manner, producing paths which stray conspicuously far from line-of-sight trajectories. We find that by counting the number of paths which traverse each vertex, then selecting the vertices with the highest counts, one obtains a path that is reasonably direct in practice and can be improved by refining the grid resolution. Central Dijkstra and Central A* are introduced as the basic methods for computing these central grid paths. Theoretical analysis reveals that the proposed grid-based navigation approach is related to an existing grid-based visibility approach, and establishes that central grid paths converge on clear sightlines as the grid spacing approaches zero. A more general property, that central paths converge on direct paths, is formulated as a conjecture.
计算网格上最短路径的数量是一个与帕斯卡三角形密切相关的简单过程。我们展示了路径计数如何用于为涉及空间环境导航的人工智能相关应用选择相对直接的网格路径。Dijkstra算法和A*算法的典型实现以任意方式优先考虑网格移动,产生明显偏离视线轨迹的路径。我们发现,通过计算遍历每个顶点的路径数,然后选择次数最高的顶点,可以得到一条在实践中相当直接的路径,并且可以通过改进网格分辨率来改进。介绍了中央Dijkstra和中央A*作为计算这些中心网格路径的基本方法。理论分析表明,本文提出的基于网格的导航方法与现有的基于网格的可见度方法相关,并确定了当网格间距接近于零时,中心网格路径收敛于清晰的视线。一个更普遍的性质,即中心路径收敛于直接路径,被表述为一个猜想。
{"title":"Path Counting for Grid-Based Navigation","authors":"Rhys Goldstein, Kean Walmsley, Jacobo Bibliowicz, Alex Tessier, Simon Breslav, Azam Khan","doi":"10.1613/jair.1.13544","DOIUrl":"https://doi.org/10.1613/jair.1.13544","url":null,"abstract":"Counting the number of shortest paths on a grid is a simple procedure with close ties to Pascal’s triangle. We show how path counting can be used to select relatively direct grid paths for AI-related applications involving navigation through spatial environments. Typical implementations of Dijkstra’s algorithm and A* prioritize grid moves in an arbitrary manner, producing paths which stray conspicuously far from line-of-sight trajectories. We find that by counting the number of paths which traverse each vertex, then selecting the vertices with the highest counts, one obtains a path that is reasonably direct in practice and can be improved by refining the grid resolution. Central Dijkstra and Central A* are introduced as the basic methods for computing these central grid paths. Theoretical analysis reveals that the proposed grid-based navigation approach is related to an existing grid-based visibility approach, and establishes that central grid paths converge on clear sightlines as the grid spacing approaches zero. A more general property, that central paths converge on direct paths, is formulated as a conjecture.","PeriodicalId":54877,"journal":{"name":"Journal of Artificial Intelligence Research","volume":"21 1","pages":"917-955"},"PeriodicalIF":5.0,"publicationDate":"2022-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89071479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
Journal of Artificial Intelligence Research
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1