首页 > 最新文献

ACM Transactions on Modeling and Computer Simulation最新文献

英文 中文
Reproducibility Report for the Paper: Parallel Simulation of Quantum Networks with Distributed Quantum State Management 论文重现性报告:利用分布式量子态管理并行模拟量子网络
IF 0.9 4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-01-08 DOI: 10.1145/3639704
Andrea Piccione

The examined paper introduces a parallel version of SeQUeNCe, a Discrete Event Simulator for quantum networks. The authors have deposited their artifact on Zenodo, meeting the criteria for long-term preservation required by the Artifacts Available badge. The software within the artifact functions correctly with minor adjustments, aligning with the paper’s relevance and earning the Artifacts Evaluated—Functional badge. Additionally, due to the reasonable quality and customizability of the artifact, the Artifacts Evaluated—Reusable badge has also been awarded. The authors didn’t request the Artifacts Evaluated—Reproduced badge and they did not include the scripts used to generate and display their experimental results. As a result, it has not been possible to replicate the results published in their paper.

这篇论文介绍了量子网络离散事件模拟器 SeQUeNCe 的并行版本。作者已将其人工制品存放在 Zenodo 上,符合人工制品可用徽章所要求的长期保存标准。该人工制品中的软件只需稍作调整即可正常运行,与论文的相关性相符,因此获得了人工制品评估-功能徽章。此外,由于该人工制品的合理质量和可定制性,还获得了 "人工制品评估-可重复使用 "徽章。作者没有申请 "人工制品已评估-再制作 "徽章,也没有提供用于生成和显示实验结果的脚本。因此,我们无法复制他们论文中发表的结果。
{"title":"Reproducibility Report for the Paper: Parallel Simulation of Quantum Networks with Distributed Quantum State Management","authors":"Andrea Piccione","doi":"10.1145/3639704","DOIUrl":"https://doi.org/10.1145/3639704","url":null,"abstract":"<p>The examined paper introduces a parallel version of SeQUeNCe, a Discrete Event Simulator for quantum networks. The authors have deposited their artifact on Zenodo, meeting the criteria for long-term preservation required by the <i>Artifacts Available</i> badge. The software within the artifact functions correctly with minor adjustments, aligning with the paper’s relevance and earning the <i>Artifacts Evaluated—Functional</i> badge. Additionally, due to the reasonable quality and customizability of the artifact, the <i>Artifacts Evaluated—Reusable</i> badge has also been awarded. The authors didn’t request the <i>Artifacts Evaluated—Reproduced</i> badge and they did not include the scripts used to generate and display their experimental results. As a result, it has not been possible to replicate the results published in their paper.</p>","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"10 1","pages":""},"PeriodicalIF":0.9,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139421322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Spatial/Temporal Locality-based Load-sharing in Speculative Discrete Event Simulation on Multi-core Machines 多核计算机上基于空间/时间位置的推测性离散事件仿真中的负载分担
IF 0.9 4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-01-08 DOI: 10.1145/3639703
Federica Montesano, Romolo Marotta, Francesco Quaglia

Shared-memory multi-processor/multi-core machines have become a reference for many application contexts. In particular, the recent literature on speculative parallel discrete event simulation has reshuffled the architectural organization of simulation systems in order to deeply exploit the main features of this type of machines. A core aspect dealt with has been the full sharing of the workload at the level of individual simulation events, which enables keeping the rollback incidence minimal. However, making each worker thread continuously switch its execution between events destined to different simulation objects does not favor locality. This problem appears even more evident in the case of Non-Uniform-Memory-Access (NUMA) machines, where memory accesses generating a cache miss to be served by a far NUMA node give rise to both higher latency and higher traffic at the level of the NUMA interconnection. In this article, we propose a workload-sharing algorithm where the worker threads can have short-term binding with specific simulation objects to favor spatial locality. The new bindings—carried out when a thread decides to switch its execution to other simulation objects—are based on both (a) the timeline according to which the object states have passed through the caching hierarchy and (b) the (dynamic) placement of objects within the NUMA architecture. At the same time, our solution still enables the worker threads to focus their activities on the events to be processed whose timestamps are closer to the simulation commit horizon—hence we exploit temporal locality along virtual time and keep the rollback incidence minimal. In our design we exploit lock-free constructs to support scalable thread synchronization while accessing the shared event pool. Furthermore, we exploit a multi-view approach of the event pool content, which additionally favors local accesses to the parts of the event pool that are currently relevant for the thread activity. Our solution has been released as an integration within the USE (Ultimate-Share-Everything) open source speculative simulation platform available to the community. Furthermore, in this article we report the results of an experimental study that shows the effectiveness of our proposal.

共享内存多处理器/多核机器已成为许多应用环境的参考。特别是最近关于投机并行离散事件仿真的文献,重新调整了仿真系统的架构组织,以便深入利用这类机器的主要特点。其中涉及的一个核心问题是在单个仿真事件的层面上完全分担工作量,从而将回滚发生率降至最低。然而,让每个工作线程在不同仿真对象的事件之间不断切换执行并不利于本地化。在非统一内存访问(NUMA)机器上,这个问题显得更加明显,因为内存访问会产生缓存缺失,需要由较远的 NUMA 节点提供服务,从而导致 NUMA 互联层面的延迟和流量增加。在本文中,我们提出了一种工作负载分担算法,在这种算法中,工作线程可以与特定的仿真对象进行短期绑定,以提高空间位置性。新的绑定--当线程决定将其执行切换到其他仿真对象时进行--基于(a)对象状态通过缓存层级的时间轴和(b)对象在 NUMA 架构中的(动态)位置。同时,我们的解决方案还能让工作线程将其活动集中在时间戳更接近仿真提交范围的待处理事件上,因此我们利用了虚拟时间的时间定位性,并将回滚发生率保持在最低水平。在我们的设计中,我们利用无锁结构来支持可扩展的线程同步,同时访问共享事件池。此外,我们还采用了多视角的事件池内容方法,这更有利于本地访问当前与线程活动相关的事件池部分。我们的解决方案已作为 USE(Ultimate-Share-Everything)开源投机模拟平台的集成发布,供社区使用。此外,我们还在本文中报告了一项实验研究的结果,显示了我们建议的有效性。
{"title":"Spatial/Temporal Locality-based Load-sharing in Speculative Discrete Event Simulation on Multi-core Machines","authors":"Federica Montesano, Romolo Marotta, Francesco Quaglia","doi":"10.1145/3639703","DOIUrl":"https://doi.org/10.1145/3639703","url":null,"abstract":"<p>Shared-memory multi-processor/multi-core machines have become a reference for many application contexts. In particular, the recent literature on speculative parallel discrete event simulation has reshuffled the architectural organization of simulation systems in order to deeply exploit the main features of this type of machines. A core aspect dealt with has been the full sharing of the workload at the level of individual simulation events, which enables keeping the rollback incidence minimal. However, making each worker thread continuously switch its execution between events destined to different simulation objects does not favor locality. This problem appears even more evident in the case of Non-Uniform-Memory-Access (NUMA) machines, where memory accesses generating a cache miss to be served by a far NUMA node give rise to both higher latency and higher traffic at the level of the NUMA interconnection. In this article, we propose a workload-sharing algorithm where the worker threads can have short-term binding with specific simulation objects to favor spatial locality. The new bindings—carried out when a thread decides to switch its execution to other simulation objects—are based on both (a) the timeline according to which the object states have passed through the caching hierarchy and (b) the (dynamic) placement of objects within the NUMA architecture. At the same time, our solution still enables the worker threads to focus their activities on the events to be processed whose timestamps are closer to the simulation commit horizon—hence we exploit temporal locality along virtual time and keep the rollback incidence minimal. In our design we exploit lock-free constructs to support scalable thread synchronization while accessing the shared event pool. Furthermore, we exploit a multi-view approach of the event pool content, which additionally favors local accesses to the parts of the event pool that are currently relevant for the thread activity. Our solution has been released as an integration within the USE (Ultimate-Share-Everything) open source speculative simulation platform available to the community. Furthermore, in this article we report the results of an experimental study that shows the effectiveness of our proposal.</p>","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"4 1","pages":""},"PeriodicalIF":0.9,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139409234","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Knowledge Equivalence in Digital Twins of Intelligent Systems 智能系统数字孪生中的知识等价
IF 0.9 4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-12-05 DOI: 10.1145/3635306
Nan Zhang, Rami Bahsoon, Nikos Tziritas, Georgios Theodoropoulos

A digital twin contains up-to-date data-driven models of the physical world being studied and can use simulation to optimise the physical world. However, the analysis made by the digital twin is valid and reliable only when the model is equivalent to the physical world. Maintaining such an equivalent model is challenging, especially when the physical systems being modelled are intelligent and autonomous. The paper focuses in particular on digital twin models of intelligent systems where the systems are knowledge-aware but with limited capability. The digital twin improves the acting of the physical system at a meta-level by accumulating more knowledge in the simulated environment. The modelling of such an intelligent physical system requires replicating the knowledge-awareness capability in the virtual space. Novel equivalence maintaining techniques are needed, especially in synchronising the knowledge between the model and the physical system. This paper proposes the notion of knowledge equivalence and an equivalence maintaining approach by knowledge comparison and updates. A quantitative analysis of the proposed approach confirms that compared to state equivalence, knowledge equivalence maintenance can tolerate deviation thus reducing unnecessary updates and achieve more Pareto efficient solutions for the trade-off between update overhead and simulation reliability.

数字孪生包含正在研究的物理世界的最新数据驱动模型,并可以使用模拟来优化物理世界。然而,只有当模型与物理世界等效时,数字孪生所做的分析才是有效和可靠的。维护这样一个等效的模型是具有挑战性的,特别是当被建模的物理系统是智能和自治的。本文特别关注智能系统的数字孪生模型,其中系统具有知识感知但能力有限。数字孪生通过在模拟环境中积累更多的知识,在元层面上改进了物理系统的行为。这种智能物理系统的建模需要在虚拟空间中复制知识感知能力。需要新的等效保持技术,特别是在模型和物理系统之间的知识同步方面。本文提出了知识等价的概念,并提出了一种通过知识比较和更新来维护等价的方法。对该方法的定量分析证实,与状态等价相比,知识等价维护可以容忍偏差,从而减少不必要的更新,并在更新开销和仿真可靠性之间实现更多的帕累托有效解决方案。
{"title":"Knowledge Equivalence in Digital Twins of Intelligent Systems","authors":"Nan Zhang, Rami Bahsoon, Nikos Tziritas, Georgios Theodoropoulos","doi":"10.1145/3635306","DOIUrl":"https://doi.org/10.1145/3635306","url":null,"abstract":"<p>A digital twin contains up-to-date data-driven models of the physical world being studied and can use simulation to optimise the physical world. However, the analysis made by the digital twin is valid and reliable only when the model is equivalent to the physical world. Maintaining such an equivalent model is challenging, especially when the physical systems being modelled are intelligent and autonomous. The paper focuses in particular on digital twin models of intelligent systems where the systems are knowledge-aware but with limited capability. The digital twin improves the acting of the physical system at a meta-level by accumulating more knowledge in the simulated environment. The modelling of such an intelligent physical system requires replicating the knowledge-awareness capability in the virtual space. Novel equivalence maintaining techniques are needed, especially in synchronising the knowledge between the model and the physical system. This paper proposes the notion of knowledge equivalence and an equivalence maintaining approach by knowledge comparison and updates. A quantitative analysis of the proposed approach confirms that compared to state equivalence, knowledge equivalence maintenance can tolerate deviation thus reducing unnecessary updates and achieve more Pareto efficient solutions for the trade-off between update overhead and simulation reliability.</p>","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"124 3-4","pages":""},"PeriodicalIF":0.9,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138523759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
VT-IO: A Virtual Time System Enabling High-fidelity Container-based Network Emulation for I/O Intensive Applications VT-IO:为I/O密集型应用程序提供高保真基于容器的网络仿真的虚拟时间系统
IF 0.9 4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-12-05 DOI: 10.1145/3635307
Gong Chen, Zheng Hu, Yanfeng Qu, Dong Jin

Network emulation allows unmodified code execution on lightweight containers to enable accurate and scalable networked application testing. However, such testbeds cannot guarantee fidelity under high workloads, especially when many processes concurrently request resources (e.g., CPU, disk I/O, GPU, and network bandwidth) that are more than the underlying physical machine can offer. A virtual time system enables the emulated hosts to maintain their own notion of virtual time. A container can stop advancing its time when not running (e.g., in an idle or suspended state). The existing virtual time systems focus on precise time management for CPU-intensive applications but are not designed to handle other operations, such as disk I/O, network I/O, and GPU computation. In this paper, we develop a lightweight virtual time system that integrates precise I/O time for container-based network emulation. We model and analyze the temporal error during I/O operations and develop a barrier-based time compensation mechanism in the Linux kernel. We also design and implement Dynamic Load Monitor (DLM) to mitigate the temporal error during I/O resource contention. VT-IO enables accurate virtual time advancement with precise I/O time measurement and compensation. The experimental results demonstrate a significant improvement in temporal error with the introduction of DLM. The temporal error is reduced from 7.889 seconds to 0.074 seconds when utilizing the DLM in the virtual time system. Remarkably, this improvement is achieved with an overall overhead of only 1.36% of the total execution time.

网络仿真允许在轻量级容器上执行未经修改的代码,从而实现准确和可扩展的网络应用程序测试。然而,这样的测试平台不能保证高工作负载下的保真度,特别是当许多进程并发地请求资源(例如,CPU、磁盘I/O、GPU和网络带宽)超过底层物理机器所能提供的资源时。虚拟时间系统使被模拟主机能够保持自己的虚拟时间概念。容器可以在不运行时停止推进时间(例如,处于空闲或挂起状态)。现有的虚拟时间系统专注于cpu密集型应用程序的精确时间管理,而不是设计用于处理其他操作,例如磁盘I/O,网络I/O和GPU计算。在本文中,我们开发了一个轻量级的虚拟时间系统,它集成了基于容器的网络仿真的精确I/O时间。我们对I/O操作期间的时间误差进行建模和分析,并在Linux内核中开发了一种基于屏障的时间补偿机制。我们还设计和实现了动态负载监视器(DLM),以减轻I/O资源争用期间的时间错误。VT-IO使精确的虚拟时间进步与精确的I/O时间测量和补偿。实验结果表明,引入DLM后,时间误差得到了显著改善。在虚拟时间系统中使用DLM时,时间误差从7.889秒减少到0.074秒。值得注意的是,实现这一改进的总开销仅为总执行时间的1.36%。
{"title":"VT-IO: A Virtual Time System Enabling High-fidelity Container-based Network Emulation for I/O Intensive Applications","authors":"Gong Chen, Zheng Hu, Yanfeng Qu, Dong Jin","doi":"10.1145/3635307","DOIUrl":"https://doi.org/10.1145/3635307","url":null,"abstract":"<p>Network emulation allows unmodified code execution on lightweight containers to enable accurate and scalable networked application testing. However, such testbeds cannot guarantee fidelity under high workloads, especially when many processes concurrently request resources (e.g., CPU, disk I/O, GPU, and network bandwidth) that are more than the underlying physical machine can offer. A virtual time system enables the emulated hosts to maintain their own notion of virtual time. A container can stop advancing its time when not running (e.g., in an idle or suspended state). The existing virtual time systems focus on precise time management for CPU-intensive applications but are not designed to handle other operations, such as disk I/O, network I/O, and GPU computation. In this paper, we develop a lightweight virtual time system that integrates precise I/O time for container-based network emulation. We model and analyze the temporal error during I/O operations and develop a barrier-based time compensation mechanism in the Linux kernel. We also design and implement Dynamic Load Monitor (DLM) to mitigate the temporal error during I/O resource contention. VT-IO enables accurate virtual time advancement with precise I/O time measurement and compensation. The experimental results demonstrate a significant improvement in temporal error with the introduction of DLM. The temporal error is reduced from 7.889 seconds to 0.074 seconds when utilizing the DLM in the virtual time system. Remarkably, this improvement is achieved with an overall overhead of only 1.36% of the total execution time.</p>","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"74 1","pages":""},"PeriodicalIF":0.9,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138523753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
LN: A Flexible Algorithmic Framework for Layered Queueing Network Analysis 分层排队网络分析的灵活算法框架
IF 0.9 4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-11-21 DOI: 10.1145/3633457
Giuliano Casale, Yicheng Gao, Zifeng Niu, Lulai Zhu

Layered queueing networks (LQNs) are an extension of ordinary queueing networks useful to model simultaneous resource possession and stochastic call graphs in distributed systems. Existing computational algorithms for LQNs have primarily focused on mean-value analysis. However, other solution paradigms, such as normalizing constant analysis and mean-field approximation, can improve the computation of LQN mean and transient performance metrics, state probabilities, and response time distributions. Motivated by this observation, we propose the first LQN meta-solver, called LN, that allows for the dynamic selection of the performance analysis paradigm to be iteratively applied to the submodels arising from layer decomposition. We report experiments where this added flexibility helps us to reduce the LQN solution errors. We also demonstrate that the meta-solver approach eases the integration of LQNs with other formalisms, such as caching models, enabling the analysis of more general classes of layered stochastic networks. Additionally, to support the accurate evaluation of the LQN submodels, we develop novel algorithms for homogeneous queueing networks consisting of an infinite server node and a set of identical queueing stations. In particular, we propose an exact method of moment algorithms, integration techniques for normalizing constants, and a fast non-iterative mean-value analysis technique.

分层排队网络(LQNs)是对普通排队网络的一种扩展,可用于模拟分布式系统中同时资源占有和随机调用图。现有的lqn计算算法主要集中在均值分析上。然而,其他的解决范例,如正则化常数分析和平均场近似,可以改进LQN平均和瞬态性能度量、状态概率和响应时间分布的计算。受此观察的启发,我们提出了第一个LQN元求解器,称为LN,它允许动态选择性能分析范式,迭代地应用于由层分解产生的子模型。我们报告的实验表明,这种增加的灵活性帮助我们减少了LQN解决方案的错误。我们还证明了元求解器方法简化了lqn与其他形式(如缓存模型)的集成,从而能够分析更一般的分层随机网络类别。此外,为了支持LQN子模型的准确评估,我们开发了由无限服务器节点和一组相同排队站组成的同构排队网络的新算法。特别地,我们提出了一种精确的矩算法方法,一种正则化常数的积分技术,以及一种快速的非迭代均值分析技术。
{"title":"LN: A Flexible Algorithmic Framework for Layered Queueing Network Analysis","authors":"Giuliano Casale, Yicheng Gao, Zifeng Niu, Lulai Zhu","doi":"10.1145/3633457","DOIUrl":"https://doi.org/10.1145/3633457","url":null,"abstract":"<p>Layered queueing networks (LQNs) are an extension of ordinary queueing networks useful to model simultaneous resource possession and stochastic call graphs in distributed systems. Existing computational algorithms for LQNs have primarily focused on mean-value analysis. However, other solution paradigms, such as normalizing constant analysis and mean-field approximation, can improve the computation of LQN mean and transient performance metrics, state probabilities, and response time distributions. Motivated by this observation, we propose the first LQN meta-solver, called LN, that allows for the dynamic selection of the performance analysis paradigm to be iteratively applied to the submodels arising from layer decomposition. We report experiments where this added flexibility helps us to reduce the LQN solution errors. We also demonstrate that the meta-solver approach eases the integration of LQNs with other formalisms, such as caching models, enabling the analysis of more general classes of layered stochastic networks. Additionally, to support the accurate evaluation of the LQN submodels, we develop novel algorithms for homogeneous queueing networks consisting of an infinite server node and a set of identical queueing stations. In particular, we propose an exact method of moment algorithms, integration techniques for normalizing constants, and a fast non-iterative mean-value analysis technique.</p>","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"40 06","pages":""},"PeriodicalIF":0.9,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138523755","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Contextual Ranking and Selection with Gaussian Processes and OCBA 基于高斯过程和OCBA的上下文排序与选择
IF 0.9 4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-11-20 DOI: 10.1145/3633456
Sait Cakmak, Yuhao Wang, Siyang Gao, Enlu Zhou

In many real world problems, we are faced with the problem of selecting the best among a finite number of alternatives, where the best alternative is determined based on context specific information. In this work, we study the contextual Ranking and Selection problem under a finite-alternative-finite-context setting, where we aim to find the best alternative for each context. We use a separate Gaussian process to model the reward for each alternative, and derive the large deviations rate function for both the expected and worst-case contextual probability of correct selection. We propose the GP-C-OCBA sampling policy, which uses the Gaussian process posterior to iteratively allocate observations to maximize the rate function. We prove its consistency and show that it achieves the optimal convergence rate under the assumption of a non-informative prior. Numerical experiments show that our algorithm is highly competitive in terms of sampling efficiency, while having significantly smaller computational overhead.

在现实世界的许多问题中,我们都面临着在有限数量的备选方案中选择最佳方案的问题,其中最佳方案是基于特定于上下文的信息确定的。在这项工作中,我们研究了有限选择-有限上下文设置下的上下文排序和选择问题,我们的目标是为每个上下文找到最佳选择。我们使用一个单独的高斯过程来模拟每种选择的奖励,并推导出正确选择的期望和最坏情况上下文概率的大偏差率函数。我们提出了GP-C-OCBA抽样策略,该策略使用高斯后验过程迭代分配观测值以最大化速率函数。我们证明了它的一致性,并表明在无信息先验假设下,它达到了最优的收敛速度。数值实验表明,该算法在采样效率方面具有很强的竞争力,同时计算开销也显著减少。
{"title":"Contextual Ranking and Selection with Gaussian Processes and OCBA","authors":"Sait Cakmak, Yuhao Wang, Siyang Gao, Enlu Zhou","doi":"10.1145/3633456","DOIUrl":"https://doi.org/10.1145/3633456","url":null,"abstract":"<p>In many real world problems, we are faced with the problem of selecting the best among a finite number of alternatives, where the best alternative is determined based on context specific information. In this work, we study the contextual Ranking and Selection problem under a finite-alternative-finite-context setting, where we aim to find the best alternative for each context. We use a separate Gaussian process to model the reward for each alternative, and derive the large deviations rate function for both the expected and worst-case contextual probability of correct selection. We propose the GP-C-OCBA sampling policy, which uses the Gaussian process posterior to iteratively allocate observations to maximize the rate function. We prove its consistency and show that it achieves the optimal convergence rate under the assumption of a non-informative prior. Numerical experiments show that our algorithm is highly competitive in terms of sampling efficiency, while having significantly smaller computational overhead.</p>","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"33 12","pages":""},"PeriodicalIF":0.9,"publicationDate":"2023-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138523785","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Prescriptive Simulation Framework with Realistic Behavioural Modelling for Emergency Evacuations 具有紧急疏散现实行为模型的规定性模拟框架
IF 0.9 4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-11-18 DOI: 10.1145/3633330
Md. Shalihin Othman, Gary Tan

Emergency and crisis simulations play a pivotal role in equipping authorities worldwide with the necessary tools to minimize the impact of catastrophic events. Various studies have explored the integration of intelligence into Multi-Agent Systems (MAS) for crisis simulation. This involves incorporating psychological behaviours from the social sciences and utilizing data-driven machine learning models with predictive capabilities. A recent advancement in behavioural modelling is the Conscious Movement Model (CMM), designed to modulate an agent’s movement patterns dynamically as the situation unfolds. Complementing this, the model incorporates a Conscious Movement Memory-Attention (CMMA) mechanism, enabling learnability through training on pedestrian trajectories extracted from video data. The CMMA facilitates mapping a pedestrian’s attention to their surroundings and understanding how their past decisions influence their subsequent actions. This study proposes an efficient framework that integrates the trained CMM into a simulation model specifically tailored for emergency evacuations, ensuring realistic outcomes. The resulting simulation framework automates strategy management and planning for diverse emergency evacuation scenarios. A single-objective method is presented for generating prescriptive analytics, offering effective strategy options based on predefined operational rules. To validate the framework’s efficacy, a case study of a theatre evacuation is conducted. In essence, this research establishes a robust simulation framework for crisis management, with a particular emphasis on modelling pedestrians during emergency evacuations. The framework generates prescriptive analytics to aid authorities in executing rescue and evacuation operations effectively.

紧急情况和危机模拟在为世界各国当局提供必要工具以尽量减少灾难性事件的影响方面发挥着关键作用。各种研究都在探索将智能集成到多智能体系统(MAS)中以进行危机模拟。这包括结合社会科学的心理行为,并利用具有预测能力的数据驱动的机器学习模型。行为模型的最新进展是有意识运动模型(CMM),该模型旨在随着情况的发展动态地调节agent的运动模式。除此之外,该模型还结合了有意识运动记忆-注意(CMMA)机制,通过训练从视频数据中提取的行人轨迹来实现可学习性。CMMA有助于绘制行人对周围环境的注意力,并了解他们过去的决定如何影响他们随后的行动。本研究提出了一个有效的框架,将训练有素的CMM集成到专门为紧急疏散量身定制的模拟模型中,以确保实际结果。由此产生的模拟框架使各种紧急疏散情景的战略管理和规划自动化。提出了一种单目标方法来生成规定性分析,基于预定义的操作规则提供有效的策略选择。为了验证该框架的有效性,进行了一个剧院疏散的案例研究。从本质上讲,本研究为危机管理建立了一个强大的模拟框架,特别强调了紧急疏散期间行人的建模。该框架生成规范性分析,以帮助当局有效地执行救援和疏散行动。
{"title":"A Prescriptive Simulation Framework with Realistic Behavioural Modelling for Emergency Evacuations","authors":"Md. Shalihin Othman, Gary Tan","doi":"10.1145/3633330","DOIUrl":"https://doi.org/10.1145/3633330","url":null,"abstract":"<p>Emergency and crisis simulations play a pivotal role in equipping authorities worldwide with the necessary tools to minimize the impact of catastrophic events. Various studies have explored the integration of intelligence into Multi-Agent Systems (MAS) for crisis simulation. This involves incorporating psychological behaviours from the social sciences and utilizing data-driven machine learning models with predictive capabilities. A recent advancement in behavioural modelling is the Conscious Movement Model (CMM), designed to modulate an agent’s movement patterns dynamically as the situation unfolds. Complementing this, the model incorporates a Conscious Movement Memory-Attention (CMMA) mechanism, enabling learnability through training on pedestrian trajectories extracted from video data. The CMMA facilitates mapping a pedestrian’s attention to their surroundings and understanding how their past decisions influence their subsequent actions. This study proposes an efficient framework that integrates the trained CMM into a simulation model specifically tailored for emergency evacuations, ensuring realistic outcomes. The resulting simulation framework automates strategy management and planning for diverse emergency evacuation scenarios. A single-objective method is presented for generating prescriptive analytics, offering effective strategy options based on predefined operational rules. To validate the framework’s efficacy, a case study of a theatre evacuation is conducted. In essence, this research establishes a robust simulation framework for crisis management, with a particular emphasis on modelling pedestrians during emergency evacuations. The framework generates prescriptive analytics to aid authorities in executing rescue and evacuation operations effectively.</p>","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"121 8","pages":""},"PeriodicalIF":0.9,"publicationDate":"2023-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138523752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Stochastic Approximation for Estimating the Price of Stability in Stochastic Nash Games 随机纳什对策稳定性价格估计的随机逼近
4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-11-11 DOI: 10.1145/3632525
Afrooz Jalilzadeh, Farzad Yousefian, Mohammadjavad Ebrahimi
The goal in this paper is to approximate the Price of Stability (PoS) in stochastic Nash games using stochastic approximation (SA) schemes. PoS is amongst the most popular metrics in game theory and provides an avenue for estimating the efficiency of Nash games. In particular, knowing the value of PoS can help with designing efficient networked systems, including transportation networks and power market mechanisms. Motivated by the absence of efficient methods for computing the PoS, first we consider stochastic optimization problems with a nonsmooth and merely convex objective function and a merely monotone stochastic variational inequality (SVI) constraint. This problem appears in the numerator of the PoS ratio. We develop a randomized block-coordinate stochastic extra-(sub)gradient method where we employ a novel iterative penalization scheme to account for the mapping of the SVI in each of the two gradient updates of the algorithm. We obtain an iteration complexity of the order ϵ − 4 that appears to be best known result for this class of constrained stochastic optimization problems, where ϵ denotes an arbitrary bound on suitably defined infeasibility and suboptimality metrics. Second, we develop an SA-based scheme for approximating the PoS and derive lower and upper bounds on the approximation error. To validate the theoretical findings, we provide preliminary simulation results on a networked stochastic Nash Cournot competition.
本文的目标是利用随机逼近(SA)方案来近似随机纳什博弈中的稳定价格(PoS)。PoS是博弈论中最流行的指标之一,为估计纳什博弈的效率提供了一个途径。特别是,了解PoS的价值可以帮助设计高效的网络系统,包括交通网络和电力市场机制。由于缺乏有效的PoS计算方法,我们首先考虑具有非光滑、仅凸目标函数和仅单调随机变分不等式(SVI)约束的随机优化问题。这个问题出现在PoS比例的分子上。我们开发了一种随机块坐标随机额外(次)梯度方法,其中我们采用了一种新的迭代惩罚方案来解释该算法的两次梯度更新中SVI的映射。我们得到了阶λ−4的迭代复杂度,这似乎是这类约束随机优化问题最著名的结果,其中λ表示适当定义的不可行性和次优性度量的任意界。其次,我们开发了一种基于sa的近似方案,并推导了近似误差的下界和上界。为了验证理论发现,我们提供了一个网络随机纳什古诺竞争的初步模拟结果。
{"title":"Stochastic Approximation for Estimating the Price of Stability in Stochastic Nash Games","authors":"Afrooz Jalilzadeh, Farzad Yousefian, Mohammadjavad Ebrahimi","doi":"10.1145/3632525","DOIUrl":"https://doi.org/10.1145/3632525","url":null,"abstract":"The goal in this paper is to approximate the Price of Stability (PoS) in stochastic Nash games using stochastic approximation (SA) schemes. PoS is amongst the most popular metrics in game theory and provides an avenue for estimating the efficiency of Nash games. In particular, knowing the value of PoS can help with designing efficient networked systems, including transportation networks and power market mechanisms. Motivated by the absence of efficient methods for computing the PoS, first we consider stochastic optimization problems with a nonsmooth and merely convex objective function and a merely monotone stochastic variational inequality (SVI) constraint. This problem appears in the numerator of the PoS ratio. We develop a randomized block-coordinate stochastic extra-(sub)gradient method where we employ a novel iterative penalization scheme to account for the mapping of the SVI in each of the two gradient updates of the algorithm. We obtain an iteration complexity of the order ϵ − 4 that appears to be best known result for this class of constrained stochastic optimization problems, where ϵ denotes an arbitrary bound on suitably defined infeasibility and suboptimality metrics. Second, we develop an SA-based scheme for approximating the PoS and derive lower and upper bounds on the approximation error. To validate the theoretical findings, we provide preliminary simulation results on a networked stochastic Nash Cournot competition.","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"16 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135042729","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
An Improved Model of Wavelet Leader Covariance for Estimating Multifractal Properties 一种用于多重分形性质估计的改进小波导协方差模型
4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-11-03 DOI: 10.1145/3631522
Garry Jacyna, Damon Frezza, David M. Slater, James R. Thompson
Complex systems often produce multifractal signals defined by stationary increments that exhibit power law scaling properties. The Legendre transform of the domain-dependent scaling function that defines the power law is known as the multifractal spectrum. The multifractal spectrum can also be defined by a power-series expansion of the scaling function and in practice the first two leading coefficients of that series are estimated from the discrete wavelet transform of the signal. To quantify, validate, and compare simulations of complex systems with data collected empirically from the actual system, practitioners require methods for approximating the variance associated with estimates of these coefficients. In this work, we generalize a previously developed semi-parametric statistical model for the values extracted from a discrete multi-scale wavelet transform to include both within scale and between scale covariance dependencies. We employ multiplicative cascades to simulate multifractals with known parameters to illustrate the necessity for this generalization and to test the precision of our improved model. The combined within and between scale model of covariance results in a more accurate estimate of the expected variance of the coefficients extracted from an empirical data set.
复杂系统经常产生多重分形信号,这些信号由平稳增量定义,具有幂律缩放特性。定义幂律的域相关标度函数的勒让德变换称为多重分形谱。多重分形谱也可以用标度函数的幂级数展开来定义,在实践中,该级数的前两个前导系数是由信号的离散小波变换估计出来的。为了量化、验证和比较复杂系统的模拟与从实际系统中收集的经验数据,从业者需要近似与这些系数的估计相关的方差的方法。在这项工作中,我们推广了先前开发的半参数统计模型,用于从离散多尺度小波变换中提取的值,以包括尺度内和尺度间的协方差依赖关系。我们使用乘法级联来模拟具有已知参数的多重分形,以说明这种泛化的必要性,并测试我们改进模型的精度。结合协方差的尺度内和尺度间模型,可以更准确地估计从经验数据集中提取的系数的期望方差。
{"title":"An Improved Model of Wavelet Leader Covariance for Estimating Multifractal Properties","authors":"Garry Jacyna, Damon Frezza, David M. Slater, James R. Thompson","doi":"10.1145/3631522","DOIUrl":"https://doi.org/10.1145/3631522","url":null,"abstract":"Complex systems often produce multifractal signals defined by stationary increments that exhibit power law scaling properties. The Legendre transform of the domain-dependent scaling function that defines the power law is known as the multifractal spectrum. The multifractal spectrum can also be defined by a power-series expansion of the scaling function and in practice the first two leading coefficients of that series are estimated from the discrete wavelet transform of the signal. To quantify, validate, and compare simulations of complex systems with data collected empirically from the actual system, practitioners require methods for approximating the variance associated with estimates of these coefficients. In this work, we generalize a previously developed semi-parametric statistical model for the values extracted from a discrete multi-scale wavelet transform to include both within scale and between scale covariance dependencies. We employ multiplicative cascades to simulate multifractals with known parameters to illustrate the necessity for this generalization and to test the precision of our improved model. The combined within and between scale model of covariance results in a more accurate estimate of the expected variance of the coefficients extracted from an empirical data set.","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"42 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135818868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Introduction to the Special Issue on QEST 2021 QEST 2021 特刊简介
IF 0.9 4区 计算机科学 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2023-10-31 DOI: 10.1145/3631707
Alessandro Abate, Andrea Marin
The International Conference on Quantitative Evaluation of SysTems (QEST) is the leading forum on evaluation and verification of computer systems and networks, through stochastic models and measurements. QEST covers topics including classic measures involving performance and reliability, as well as quantification of properties that are classically qualitative, such as safety, correctness, and security. QEST welcomes measurement-based studies as well as analytic studies, diversity in the model formalisms and methodologies employed, as well as development of new formalisms and methodologies. In short, QEST aims to encourage all aspects of work centered around creating a sound methodological basis for assessing and designing systems using quantitative means. This special issue consists of five articles extending earlier versions presented at QEST 2021, the 18th edition of the conference, which was hosted in Paris but virtually held August 23 through 27, 2021. A selection of the top-ranked conference papers was chosen by the chairs, and the authors were invited to submit an extended version to this special issue. The journal review process included both members of the QEST program committee and additional reviewers who were not involved in the conference refereeing process. The resulting collection of articles comprises exciting developments in the areas of system verification and performance or reliability analysis. In the contribution titled “Optimizing Reachability Probabilities for a Restricted Class of SHA via Flowpipe Construction,” da Silva, Schupp, and Remke
系统定量评估(QEST)国际会议是通过随机模型和测量对计算机系统和网络进行评估和验证的主要论坛。QEST 涵盖的主题包括涉及性能和可靠性的经典测量方法,以及对安全性、正确性和安全性等经典定性属性的量化。QEST 既欢迎基于测量的研究,也欢迎基于分析的研究,欢迎所采用的模型形式和方法的多样性,也欢迎新形式和新方法的开发。总之,QEST 的目的是鼓励围绕建立健全的方法论基础开展各方面的工作,以便利用定量手段评估和设计系统。本特刊由五篇文章组成,这些文章扩展了在第 18 届 QEST 2021 会议上发表的早期版本,该会议于 2021 年 8 月 23 日至 27 日在巴黎举行。会议主席挑选了一些排名靠前的论文,并邀请作者向本期特刊提交扩展版本。期刊评审过程包括 QEST 项目委员会成员和未参与会议评审过程的其他评审人员。最终收集的文章包括系统验证和性能或可靠性分析领域令人振奋的进展。da Silva、Schupp 和 Remke 在题为 "Optimizing Reachability Probabilities for a Restricted Class of SHA via Flowpipe Construction"(通过流管结构优化受限类 SHA 的可达性概率)的文章中写道
{"title":"Introduction to the Special Issue on QEST 2021","authors":"Alessandro Abate, Andrea Marin","doi":"10.1145/3631707","DOIUrl":"https://doi.org/10.1145/3631707","url":null,"abstract":"The International Conference on Quantitative Evaluation of SysTems (QEST) is the leading forum on evaluation and verification of computer systems and networks, through stochastic models and measurements. QEST covers topics including classic measures involving performance and reliability, as well as quantification of properties that are classically qualitative, such as safety, correctness, and security. QEST welcomes measurement-based studies as well as analytic studies, diversity in the model formalisms and methodologies employed, as well as development of new formalisms and methodologies. In short, QEST aims to encourage all aspects of work centered around creating a sound methodological basis for assessing and designing systems using quantitative means. This special issue consists of five articles extending earlier versions presented at QEST 2021, the 18th edition of the conference, which was hosted in Paris but virtually held August 23 through 27, 2021. A selection of the top-ranked conference papers was chosen by the chairs, and the authors were invited to submit an extended version to this special issue. The journal review process included both members of the QEST program committee and additional reviewers who were not involved in the conference refereeing process. The resulting collection of articles comprises exciting developments in the areas of system verification and performance or reliability analysis. In the contribution titled “Optimizing Reachability Probabilities for a Restricted Class of SHA via Flowpipe Construction,” da Silva, Schupp, and Remke","PeriodicalId":50943,"journal":{"name":"ACM Transactions on Modeling and Computer Simulation","volume":"146 1","pages":"1 - 2"},"PeriodicalIF":0.9,"publicationDate":"2023-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139307560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
ACM Transactions on Modeling and Computer Simulation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1