首页 > 最新文献

2010 Third International Conference on Software Testing, Verification and Validation最新文献

英文 中文
Using Formal Methods and Testability Concepts in the Avionics Systems Validation and Verification (V&V) Process 在航空电子系统验证(V&V)过程中使用形式化方法和可测试性概念
O. Laurent
Airbus has used formal methods for several years to specify avionics systems. Thanks to these methods, formal verification, testability concepts and automatic test case generation were explored and experimented on Airbus systems. This paper depicts the Airbus validation and verification process all along the system development cycle pointing out what kinds of static analysis and dynamic verification and validation activities are conducted. Then, we focus on innovative methods based on testing strategies for traceability purposes, testing design and fault isolation. Some considerations related to automatic test case generation are also discussed.
几年来,空客一直使用正式的方法来指定航空电子系统。利用这些方法,对形式化验证、可测试性概念和自动测试用例生成进行了探索,并在空客系统上进行了实验。本文描述了空客在整个系统开发周期中的验证和验证过程,指出进行了哪些静态分析和动态验证和验证活动。然后,我们重点研究了基于可追溯性测试策略、测试设计和故障隔离的创新方法。还讨论了与自动测试用例生成相关的一些注意事项。
{"title":"Using Formal Methods and Testability Concepts in the Avionics Systems Validation and Verification (V&V) Process","authors":"O. Laurent","doi":"10.1109/ICST.2010.38","DOIUrl":"https://doi.org/10.1109/ICST.2010.38","url":null,"abstract":"Airbus has used formal methods for several years to specify avionics systems. Thanks to these methods, formal verification, testability concepts and automatic test case generation were explored and experimented on Airbus systems. This paper depicts the Airbus validation and verification process all along the system development cycle pointing out what kinds of static analysis and dynamic verification and validation activities are conducted. Then, we focus on innovative methods based on testing strategies for traceability purposes, testing design and fault isolation. Some considerations related to automatic test case generation are also discussed.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115297553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information 利用执行谱信息的动态测试聚类采样策略
Shali Yan, Zhenyu Chen, Zhihong Zhao, Chen Zhang, Yuming Zhou
Cluster filtering is a kind of test selection technique, which saves human efforts for result inspection by reducing test size and finding maximum failures. Cluster sampling strategies play a key role in the cluster filtering technique. A good sampling strategy can greatly improve the failure detection capability. In this paper, we propose a new cluster sampling strategy called execution-spectra-based sampling (ESBS). Different from the existing sampling strategies, ESBS iteratively selects test cases from each cluster. In each iteration process, ESBS selects the test case that has the maximum possibility to be a failed test. For each test, its suspiciousness is computed based on the execution spectra information of previous passed and failed test cases selected from the same cluster. The new sampling strategy ESBS is evaluated experimentally and the results show that it is more effective than existing sampling strategies in most cases.
聚类过滤是一种测试选择技术,它通过减少测试规模和查找最大故障来节省检测结果的人力。聚类采样策略在聚类滤波技术中起着关键作用。一个好的采样策略可以大大提高故障检测能力。本文提出了一种新的集群采样策略,称为基于执行谱的采样(ESBS)。与现有的采样策略不同,ESBS迭代地从每个集群中选择测试用例。在每个迭代过程中,esb选择最有可能成为失败测试的测试用例。对于每个测试,其怀疑度是基于从同一集群中选择的先前通过和失败的测试用例的执行谱信息计算的。实验结果表明,新的ESBS采样策略在大多数情况下比现有的采样策略更有效。
{"title":"A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information","authors":"Shali Yan, Zhenyu Chen, Zhihong Zhao, Chen Zhang, Yuming Zhou","doi":"10.1109/ICST.2010.47","DOIUrl":"https://doi.org/10.1109/ICST.2010.47","url":null,"abstract":"Cluster filtering is a kind of test selection technique, which saves human efforts for result inspection by reducing test size and finding maximum failures. Cluster sampling strategies play a key role in the cluster filtering technique. A good sampling strategy can greatly improve the failure detection capability. In this paper, we propose a new cluster sampling strategy called execution-spectra-based sampling (ESBS). Different from the existing sampling strategies, ESBS iteratively selects test cases from each cluster. In each iteration process, ESBS selects the test case that has the maximum possibility to be a failed test. For each test, its suspiciousness is computed based on the execution spectra information of previous passed and failed test cases selected from the same cluster. The new sampling strategy ESBS is evaluated experimentally and the results show that it is more effective than existing sampling strategies in most cases.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115936707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 40
Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines 软件产品线的自动化和可伸缩的T-wise测试用例生成策略
Gilles Perrouin, S. Sen, Jacques Klein, B. Baudry, Yves Le Traon
Software Product Lines (SPL) are difficult to validate due to combinatorics induced by variability across their features. This leads to combinatorial explosion of the number of derivable products. Exhaustive testing in such a large space of products is infeasible. One possible option is to test SPLs by generating test cases that cover all possible T feature interactions (T-wise). T-wise dramatically reduces the number of test products while ensuring reasonable SPL coverage. However, automatic generation of test cases satisfying T-wise using SAT solvers raises two issues. The encoding of SPL models and T-wise criteria into a set of formulas acceptable by the solver and their satisfaction which fails when processed ``all-at-once''. We propose a scalable toolset using Alloy to automatically generate test cases satisfying T-wise from SPL models. We define strategies to split T-wise combinations into solvable subsets. We design and compute metrics to evaluate strategies on Aspect OPTIMA, a concrete transactional SPL.
软件产品线(SPL)由于其特性的可变性引起的组合而难以验证。这导致了可导乘积数量的组合爆炸。在如此大的产品空间中进行详尽的测试是不可行的。一种可能的选择是通过生成覆盖所有可能的T功能交互(T-wise)的测试用例来测试spc。T-wise大大减少了测试产品的数量,同时确保合理的SPL覆盖。然而,使用SAT求解器自动生成满足T-wise的测试用例会引起两个问题。将SPL模型和t-准则编码为求解器可接受的一组公式,并满足“一次性”处理时无法满足的要求。我们提出了一个可扩展的工具集,使用Alloy从SPL模型自动生成满足T-wise的测试用例。我们定义了将t型组合分割成可解子集的策略。我们设计和计算指标来评估Aspect OPTIMA上的策略,这是一个具体的事务SPL。
{"title":"Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines","authors":"Gilles Perrouin, S. Sen, Jacques Klein, B. Baudry, Yves Le Traon","doi":"10.1109/ICST.2010.43","DOIUrl":"https://doi.org/10.1109/ICST.2010.43","url":null,"abstract":"Software Product Lines (SPL) are difficult to validate due to combinatorics induced by variability across their features. This leads to combinatorial explosion of the number of derivable products. Exhaustive testing in such a large space of products is infeasible. One possible option is to test SPLs by generating test cases that cover all possible T feature interactions (T-wise). T-wise dramatically reduces the number of test products while ensuring reasonable SPL coverage. However, automatic generation of test cases satisfying T-wise using SAT solvers raises two issues. The encoding of SPL models and T-wise criteria into a set of formulas acceptable by the solver and their satisfaction which fails when processed ``all-at-once''. We propose a scalable toolset using Alloy to automatically generate test cases satisfying T-wise from SPL models. We define strategies to split T-wise combinations into solvable subsets. We design and compute metrics to evaluate strategies on Aspect OPTIMA, a concrete transactional SPL.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"348 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123417296","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 241
Industrial Scaled Automated Structural Testing with the Evolutionary Testing Tool 工业规模自动化结构测试与进化测试工具
T. Vos, A. Baars, Felix F. Lindlar, Peter M. Kruse, Andreas Windisch, J. Wegener
Evolutionary testing has been researched and promising results have been presented. However, evolutionary testing has remained predominately a research-based activity not practiced within industry. Although attempts have been made, such as Daimler's Evolutionary Structural Test (EST) prototype, until now, no such tool has been suitable for industrial adoption. The European project EvoTest (IST-33472) team has been working from 2006 till2009 to improve this situation. This paper describes the final version of the Evolutionary Testing Framework (ETF) resulting from the EvoTest project. In specific we will present the EvoTest Structural Testing tool for fully automatic structural testing that has been demonstrated to be suitable within an industrial setting. The paper concentrates on how to use it and interpret the results. The paper starts with introducing the concepts of Evolutionary Testing in general and Structural Testing in specific. Subsequently, the ETF and the EvoTest Structural Testing tool built on-top of it will be described. We will concentrate on the usage, the architecture, and remaining limitations of the tool. The paper concludes describing the results of using the EvoTest Structural Testing tool in practice on real-world systems in an industrial setting.
人们对进化测试进行了研究,并取得了令人鼓舞的成果。然而,进化测试仍然主要是一种基于研究的活动,没有在工业中实践。尽管已经进行了一些尝试,比如戴姆勒的进化结构测试(EST)原型,但到目前为止,还没有这样的工具适合于工业应用。欧洲项目EvoTest (IST-33472)团队从2006年到2009年一直致力于改善这种情况。本文描述了进化测试框架(ETF)的最终版本,该版本由EvoTest项目产生。具体来说,我们将介绍EvoTest结构测试工具,用于全自动结构测试,该工具已被证明适用于工业环境。本文着重讨论了如何使用它和解释结果。本文首先介绍了演化测试的一般概念和结构测试的具体概念。随后,将介绍ETF和在其上构建的EvoTest结构测试工具。我们将集中讨论该工具的用法、体系结构和剩余的限制。本文最后描述了在工业环境中实际系统中使用EvoTest结构测试工具的结果。
{"title":"Industrial Scaled Automated Structural Testing with the Evolutionary Testing Tool","authors":"T. Vos, A. Baars, Felix F. Lindlar, Peter M. Kruse, Andreas Windisch, J. Wegener","doi":"10.1109/ICST.2010.24","DOIUrl":"https://doi.org/10.1109/ICST.2010.24","url":null,"abstract":"Evolutionary testing has been researched and promising results have been presented. However, evolutionary testing has remained predominately a research-based activity not practiced within industry. Although attempts have been made, such as Daimler's Evolutionary Structural Test (EST) prototype, until now, no such tool has been suitable for industrial adoption. The European project EvoTest (IST-33472) team has been working from 2006 till2009 to improve this situation. This paper describes the final version of the Evolutionary Testing Framework (ETF) resulting from the EvoTest project. In specific we will present the EvoTest Structural Testing tool for fully automatic structural testing that has been demonstrated to be suitable within an industrial setting. The paper concentrates on how to use it and interpret the results. The paper starts with introducing the concepts of Evolutionary Testing in general and Structural Testing in specific. Subsequently, the ETF and the EvoTest Structural Testing tool built on-top of it will be described. We will concentrate on the usage, the architecture, and remaining limitations of the tool. The paper concludes describing the results of using the EvoTest Structural Testing tool in practice on real-world systems in an industrial setting.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124619788","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 23
An Application of Six Sigma and Simulation in Software Testing Risk Assessment 六西格玛及模拟在软件测试风险评估中的应用
Vojo Bubevski
The conventional approach to Risk Assessment in Software Testing is based on analytic models and statistical analysis. The analytic models are static, so they don’t account for the inherent variability and uncertainty of the testing process, which is an apparent deficiency. This paper presents an application of Six Sigma and Simulation in Software Testing. DMAIC and simulation are applied to a testing process to assess and mitigate the risk to deliver the product on time, achieving the quality goals. DMAIC is used to improve the process and achieve required (higher) capability. Simulation is used to predict the quality (reliability) and considers the uncertainty and variability, which, in comparison with the analytic models, more accurately models the testing process. Presented experiments are applied on a real project using published data. The results are satisfactorily verified. This enhanced approach is compliant with CMMI® and provides for substantial Software Testing performance-driven improvements.
软件测试中风险评估的传统方法是基于分析模型和统计分析。分析模型是静态的,因此它们不能解释测试过程的内在可变性和不确定性,这是一个明显的缺陷。本文介绍了六西格玛和仿真在软件测试中的应用。DMAIC和仿真应用于测试过程,以评估和降低风险,按时交付产品,实现质量目标。DMAIC用于改进流程并实现所需的(更高的)能力。仿真用于预测质量(可靠性),并考虑了不确定性和可变性,与解析模型相比,它更准确地模拟了测试过程。所提出的实验采用已发表的数据在实际工程中进行了应用。结果得到了满意的验证。这种增强的方法与CMMI®兼容,并提供了实质性的软件测试性能驱动改进。
{"title":"An Application of Six Sigma and Simulation in Software Testing Risk Assessment","authors":"Vojo Bubevski","doi":"10.1109/ICST.2010.23","DOIUrl":"https://doi.org/10.1109/ICST.2010.23","url":null,"abstract":"The conventional approach to Risk Assessment in Software Testing is based on analytic models and statistical analysis. The analytic models are static, so they don’t account for the inherent variability and uncertainty of the testing process, which is an apparent deficiency. This paper presents an application of Six Sigma and Simulation in Software Testing. DMAIC and simulation are applied to a testing process to assess and mitigate the risk to deliver the product on time, achieving the quality goals. DMAIC is used to improve the process and achieve required (higher) capability. Simulation is used to predict the quality (reliability) and considers the uncertainty and variability, which, in comparison with the analytic models, more accurately models the testing process. Presented experiments are applied on a real project using published data. The results are satisfactorily verified. This enhanced approach is compliant with CMMI® and provides for substantial Software Testing performance-driven improvements.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128846514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Prioritizing State-Based Aspect Tests 优先考虑基于状态的方面测试
Dianxiang Xu, Junhua Ding
In aspect-oriented programming, aspects are essentially incremental modifications to their base classes. Therefore aspect-oriented programs can be tested in an incremental fashion – we can first test the base classes and then test the base classes and aspects as a whole. This paper demonstrates that, in this incremental testing paradigm, we can prioritize aspect tests so as to report failure earlier. We explore test prioritization for testing aspect-oriented programs against their state models with transition coverage and round-trip coverage. Aspect tests are generated from woven state models obtained by composing aspect models into their base class models. We prioritize aspect tests by identifying the extent to which an aspect modifies its base classes. The modification is measured by the number of new and changed components in state transitions (start state, event, precondition, postcondition, end state). Transitions with more changes have higher priorities for test generation. We evaluate the impact of aspect test prioritization through mutation analysis of two AspectJ programs, where all aspects and their base classes can be modeled by finite state machines. We create aspect mutants of each AspectJ program according to a comprehensive AspectJ fault model. Then we test each mutant with the test suites generated without prioritization and with prioritization, respectively. Our experiment results show that prioritization of aspect tests has accelerated failure report.
在面向方面的编程中,方面本质上是对其基类的增量修改。因此,面向方面的程序可以以增量方式进行测试——我们可以先测试基类,然后将基类和方面作为一个整体进行测试。本文证明,在这种增量测试范例中,我们可以优先考虑方面测试,以便更早地报告故障。我们探索了测试面向方面的程序的测试优先级,它们的状态模型具有转换覆盖和往返覆盖。方面测试是通过将方面模型组合到其基类模型中获得的编织状态模型生成的。我们通过确定方面修改其基类的程度来确定方面测试的优先级。修改是通过状态转换(开始状态、事件、前提条件、后置条件、结束状态)中新组件和更改组件的数量来度量的。具有更多变更的转换对于测试生成具有更高的优先级。我们通过对两个AspectJ程序的突变分析来评估方面测试优先级的影响,其中所有方面及其基类都可以通过有限状态机建模。我们根据全面的AspectJ故障模型创建每个AspectJ程序的方面突变体。然后我们分别用没有优先级和有优先级生成的测试套件测试每个突变体。实验结果表明,方面测试的优先级提高了故障报告的速度。
{"title":"Prioritizing State-Based Aspect Tests","authors":"Dianxiang Xu, Junhua Ding","doi":"10.1109/ICST.2010.14","DOIUrl":"https://doi.org/10.1109/ICST.2010.14","url":null,"abstract":"In aspect-oriented programming, aspects are essentially incremental modifications to their base classes. Therefore aspect-oriented programs can be tested in an incremental fashion – we can first test the base classes and then test the base classes and aspects as a whole. This paper demonstrates that, in this incremental testing paradigm, we can prioritize aspect tests so as to report failure earlier. We explore test prioritization for testing aspect-oriented programs against their state models with transition coverage and round-trip coverage. Aspect tests are generated from woven state models obtained by composing aspect models into their base class models. We prioritize aspect tests by identifying the extent to which an aspect modifies its base classes. The modification is measured by the number of new and changed components in state transitions (start state, event, precondition, postcondition, end state). Transitions with more changes have higher priorities for test generation. We evaluate the impact of aspect test prioritization through mutation analysis of two AspectJ programs, where all aspects and their base classes can be modeled by finite state machines. We create aspect mutants of each AspectJ program according to a comprehensive AspectJ fault model. Then we test each mutant with the test suites generated without prioritization and with prioritization, respectively. Our experiment results show that prioritization of aspect tests has accelerated failure report.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114186724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
Longer is Better: On the Role of Test Sequence Length in Software Testing 越长越好:论测试序列长度在软件测试中的作用
Andrea Arcuri
In the presence of an internal state, often it is required a sequence of function calls to test software. In fact, to cover a particular branch of the code, a sequence of previous function calls might be required to put the internal state in the appropriate configuration. Internal states are not only present in object-oriented software, but also in procedural software(e.g., static variables in C programs). In the literature, there are many techniques to test this type of software. However, to our best knowledge, the properties related to choosing the length of these sequences have received only little attention in the literature. In this paper, we analyse the role that the length plays in software testing, in particular branch coverage. We show that on “difficult” software testing benchmarks longer test sequences make their testing trivial. Hence, we argue that the choice of the length of the test sequences is very important in software testing.
在存在内部状态的情况下,通常需要一系列函数调用来测试软件。实际上,为了覆盖代码的特定分支,可能需要前面的函数调用序列来将内部状态置于适当的配置中。内部状态不仅存在于面向对象的软件中,也存在于过程软件中。(C程序中的静态变量)。在文献中,有许多技术可以测试这种类型的软件。然而,据我们所知,与选择这些序列长度有关的性质在文献中只受到很少的关注。在本文中,我们分析了长度在软件测试中所起的作用,特别是分支覆盖。我们表明,在“困难的”软件测试基准上,较长的测试序列使它们的测试变得微不足道。因此,我们认为测试序列长度的选择在软件测试中是非常重要的。
{"title":"Longer is Better: On the Role of Test Sequence Length in Software Testing","authors":"Andrea Arcuri","doi":"10.1109/ICST.2010.16","DOIUrl":"https://doi.org/10.1109/ICST.2010.16","url":null,"abstract":"In the presence of an internal state, often it is required a sequence of function calls to test software. In fact, to cover a particular branch of the code, a sequence of previous function calls might be required to put the internal state in the appropriate configuration. Internal states are not only present in object-oriented software, but also in procedural software(e.g., static variables in C programs). In the literature, there are many techniques to test this type of software. However, to our best knowledge, the properties related to choosing the length of these sequences have received only little attention in the literature. In this paper, we analyse the role that the length plays in software testing, in particular branch coverage. We show that on “difficult” software testing benchmarks longer test sequences make their testing trivial. Hence, we argue that the choice of the length of the test sequences is very important in software testing.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"129 5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125686535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 45
A Counter-Example Testing Approach for Orchestrated Services 编排服务的反例测试方法
F. D. Angelis, A. Polini, G. D. Angelis
Service oriented computing is based on a typical combination of features such as very late binding, run-time integration of software elements owned and managed by third parties, run-time changes. These characteristics generally make difficult both static and dynamic verification capabilities of service-centric systems. In this domain verification and testing research communities have to face new issues and revise existing solutions; possibly profiting of the new opportunities that the new paradigm makes available. In this paper, focusing on service orchestrations, we propose an approach to automatic test case generation aiming in particular at checking the behaviour of services participating in a given orchestration. The approach exploits the availability of a runnable model (the BPEL specification) and uses model checking techniques to derive test cases suitable to detect possible integration problems. The approach has been implemented in a plug-in for the Eclipse platform already released for public usage. In this way BPEL developers can easily derive, using a single environment, test suites for each participant service they would like to compose.
面向服务的计算基于一些典型的特性组合,比如非常晚的绑定、第三方拥有和管理的软件元素的运行时集成、运行时更改。这些特征通常使以服务为中心的系统的静态和动态验证能力变得困难。在这一领域,验证和测试研究团体必须面对新的问题,修改现有的解决方案;可能从新范式提供的新机会中获利。在本文中,我们关注服务编排,提出了一种自动生成测试用例的方法,特别针对检查参与给定编排的服务的行为。该方法利用了可运行模型(BPEL规范)的可用性,并使用模型检查技术派生出适合检测可能的集成问题的测试用例。该方法已经在Eclipse平台的插件中实现,该插件已经发布供公众使用。通过这种方式,BPEL开发人员可以使用单个环境轻松地为他们想要组合的每个参与者服务派生测试套件。
{"title":"A Counter-Example Testing Approach for Orchestrated Services","authors":"F. D. Angelis, A. Polini, G. D. Angelis","doi":"10.1109/ICST.2010.27","DOIUrl":"https://doi.org/10.1109/ICST.2010.27","url":null,"abstract":"Service oriented computing is based on a typical combination of features such as very late binding, run-time integration of software elements owned and managed by third parties, run-time changes. These characteristics generally make difficult both static and dynamic verification capabilities of service-centric systems. In this domain verification and testing research communities have to face new issues and revise existing solutions; possibly profiting of the new opportunities that the new paradigm makes available. In this paper, focusing on service orchestrations, we propose an approach to automatic test case generation aiming in particular at checking the behaviour of services participating in a given orchestration. The approach exploits the availability of a runnable model (the BPEL specification) and uses model checking techniques to derive test cases suitable to detect possible integration problems. The approach has been implemented in a plug-in for the Eclipse platform already released for public usage. In this way BPEL developers can easily derive, using a single environment, test suites for each participant service they would like to compose.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131340236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 19
Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization 清除测试套件中的巧合正确性以增强错误定位
Wes Masri, R. A. Assi
Researchers have argued that for failure to be observed the following three conditions must be met: 1) the defect is executed, 2) the program has transitioned into an infectious state, and 3) the infection has propagated to the output. Coincidental correctness arises when the program produces the correct output, while conditions 1) and 2) are met but not 3). In previous work, we showed that coincidental correctness is prevalent and demonstrated that it is a safety reducing factor for coverage-based fault localization. This work aims at cleansing test suites from coincidental correctness to enhance fault localization. Specifically, given a test suite in which each test has been classified as failing or passing, we present three variations of a technique that identify the subset of passing tests that are likely to be coincidentally correct. We evaluated the effectiveness of our techniques by empirically quantifying the following: 1) how accurately did they identify the coincidentally correct tests, 2) how much did they improve the effectiveness of coverage-based fault localization, and 3) how much did coverage decrease as a result of applying them. Using our better performing technique and configuration, the safety and precision of fault-localization was improved for 88% and 61% of the programs, respectively.
研究人员认为,要使失败被观察到,必须满足以下三个条件:1)缺陷被执行,2)程序已经过渡到感染状态,3)感染已经传播到输出。当程序产生正确的输出,而满足条件1)和2)而不满足条件3)时,就会出现巧合正确性。在之前的工作中,我们表明巧合正确性是普遍存在的,并证明它是基于覆盖率的故障定位的安全降低因素。这项工作旨在清除测试套件中的巧合正确性,以增强故障定位。具体地说,给定一个测试套件,其中每个测试都被分类为失败或通过,我们提出了一种技术的三种变体,用于识别通过的测试子集,这些测试子集很可能碰巧是正确的。我们通过以下经验量化来评估我们的技术的有效性:1)它们识别碰巧正确的测试有多准确,2)它们在多大程度上提高了基于覆盖率的故障定位的有效性,以及3)由于应用它们,覆盖率降低了多少。使用我们更好的技术和配置,故障定位的安全性和精度分别提高了88%和61%。
{"title":"Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization","authors":"Wes Masri, R. A. Assi","doi":"10.1109/ICST.2010.22","DOIUrl":"https://doi.org/10.1109/ICST.2010.22","url":null,"abstract":"Researchers have argued that for failure to be observed the following three conditions must be met: 1) the defect is executed, 2) the program has transitioned into an infectious state, and 3) the infection has propagated to the output. Coincidental correctness arises when the program produces the correct output, while conditions 1) and 2) are met but not 3). In previous work, we showed that coincidental correctness is prevalent and demonstrated that it is a safety reducing factor for coverage-based fault localization. This work aims at cleansing test suites from coincidental correctness to enhance fault localization. Specifically, given a test suite in which each test has been classified as failing or passing, we present three variations of a technique that identify the subset of passing tests that are likely to be coincidentally correct. We evaluated the effectiveness of our techniques by empirically quantifying the following: 1) how accurately did they identify the coincidentally correct tests, 2) how much did they improve the effectiveness of coverage-based fault localization, and 3) how much did coverage decrease as a result of applying them. Using our better performing technique and configuration, the safety and precision of fault-localization was improved for 88% and 61% of the programs, respectively.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133625386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 79
Towards an Automated and Dynamically Adaptable Test System for Testing Healthcare Information Systems 面向医疗信息系统测试的自动化动态适应性测试系统
D. Vega
Interoperability is one of the most important requirements for the next generation Healthcare Information Systems (HIS) that permits healthcare institutes to use heterogeneous solutions from different vendors. Introducing standards in eHealth domain, such as Health Level 7 (HL7) used for data representation, and Integrating Healthcare Enterprise (IHE) profiles for describing interactions between actors, is important to support interoperability of healthcare systems. This work addresses the challenges of interoperability testing of different HL7/IHE based HIS systems and introduces a testing methodology and its realization test framework based on TTCN-3 language.
互操作性是下一代医疗保健信息系统(HIS)最重要的需求之一,它允许医疗保健机构使用来自不同供应商的异构解决方案。在电子健康领域引入标准,例如用于数据表示的健康级别7 (HL7)和用于描述参与者之间交互的集成医疗保健企业(IHE)配置文件,对于支持医疗保健系统的互操作性非常重要。本文解决了不同基于HL7/IHE的HIS系统互操作性测试的挑战,并介绍了一种基于TTCN-3语言的测试方法及其实现测试框架。
{"title":"Towards an Automated and Dynamically Adaptable Test System for Testing Healthcare Information Systems","authors":"D. Vega","doi":"10.1109/ICST.2010.67","DOIUrl":"https://doi.org/10.1109/ICST.2010.67","url":null,"abstract":"Interoperability is one of the most important requirements for the next generation Healthcare Information Systems (HIS) that permits healthcare institutes to use heterogeneous solutions from different vendors. Introducing standards in eHealth domain, such as Health Level 7 (HL7) used for data representation, and Integrating Healthcare Enterprise (IHE) profiles for describing interactions between actors, is important to support interoperability of healthcare systems. This work addresses the challenges of interoperability testing of different HL7/IHE based HIS systems and introduces a testing methodology and its realization test framework based on TTCN-3 language.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128761826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
期刊
2010 Third International Conference on Software Testing, Verification and Validation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1