首页 > 最新文献

2010 Third International Conference on Software Testing, Verification and Validation最新文献

英文 中文
Using Formal Methods and Testability Concepts in the Avionics Systems Validation and Verification (V&V) Process 在航空电子系统验证(V&V)过程中使用形式化方法和可测试性概念
O. Laurent
Airbus has used formal methods for several years to specify avionics systems. Thanks to these methods, formal verification, testability concepts and automatic test case generation were explored and experimented on Airbus systems. This paper depicts the Airbus validation and verification process all along the system development cycle pointing out what kinds of static analysis and dynamic verification and validation activities are conducted. Then, we focus on innovative methods based on testing strategies for traceability purposes, testing design and fault isolation. Some considerations related to automatic test case generation are also discussed.
几年来,空客一直使用正式的方法来指定航空电子系统。利用这些方法,对形式化验证、可测试性概念和自动测试用例生成进行了探索,并在空客系统上进行了实验。本文描述了空客在整个系统开发周期中的验证和验证过程,指出进行了哪些静态分析和动态验证和验证活动。然后,我们重点研究了基于可追溯性测试策略、测试设计和故障隔离的创新方法。还讨论了与自动测试用例生成相关的一些注意事项。
{"title":"Using Formal Methods and Testability Concepts in the Avionics Systems Validation and Verification (V&V) Process","authors":"O. Laurent","doi":"10.1109/ICST.2010.38","DOIUrl":"https://doi.org/10.1109/ICST.2010.38","url":null,"abstract":"Airbus has used formal methods for several years to specify avionics systems. Thanks to these methods, formal verification, testability concepts and automatic test case generation were explored and experimented on Airbus systems. This paper depicts the Airbus validation and verification process all along the system development cycle pointing out what kinds of static analysis and dynamic verification and validation activities are conducted. Then, we focus on innovative methods based on testing strategies for traceability purposes, testing design and fault isolation. Some considerations related to automatic test case generation are also discussed.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115297553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines 软件产品线的自动化和可伸缩的T-wise测试用例生成策略
Gilles Perrouin, S. Sen, Jacques Klein, B. Baudry, Yves Le Traon
Software Product Lines (SPL) are difficult to validate due to combinatorics induced by variability across their features. This leads to combinatorial explosion of the number of derivable products. Exhaustive testing in such a large space of products is infeasible. One possible option is to test SPLs by generating test cases that cover all possible T feature interactions (T-wise). T-wise dramatically reduces the number of test products while ensuring reasonable SPL coverage. However, automatic generation of test cases satisfying T-wise using SAT solvers raises two issues. The encoding of SPL models and T-wise criteria into a set of formulas acceptable by the solver and their satisfaction which fails when processed ``all-at-once''. We propose a scalable toolset using Alloy to automatically generate test cases satisfying T-wise from SPL models. We define strategies to split T-wise combinations into solvable subsets. We design and compute metrics to evaluate strategies on Aspect OPTIMA, a concrete transactional SPL.
软件产品线(SPL)由于其特性的可变性引起的组合而难以验证。这导致了可导乘积数量的组合爆炸。在如此大的产品空间中进行详尽的测试是不可行的。一种可能的选择是通过生成覆盖所有可能的T功能交互(T-wise)的测试用例来测试spc。T-wise大大减少了测试产品的数量,同时确保合理的SPL覆盖。然而,使用SAT求解器自动生成满足T-wise的测试用例会引起两个问题。将SPL模型和t-准则编码为求解器可接受的一组公式,并满足“一次性”处理时无法满足的要求。我们提出了一个可扩展的工具集,使用Alloy从SPL模型自动生成满足T-wise的测试用例。我们定义了将t型组合分割成可解子集的策略。我们设计和计算指标来评估Aspect OPTIMA上的策略,这是一个具体的事务SPL。
{"title":"Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines","authors":"Gilles Perrouin, S. Sen, Jacques Klein, B. Baudry, Yves Le Traon","doi":"10.1109/ICST.2010.43","DOIUrl":"https://doi.org/10.1109/ICST.2010.43","url":null,"abstract":"Software Product Lines (SPL) are difficult to validate due to combinatorics induced by variability across their features. This leads to combinatorial explosion of the number of derivable products. Exhaustive testing in such a large space of products is infeasible. One possible option is to test SPLs by generating test cases that cover all possible T feature interactions (T-wise). T-wise dramatically reduces the number of test products while ensuring reasonable SPL coverage. However, automatic generation of test cases satisfying T-wise using SAT solvers raises two issues. The encoding of SPL models and T-wise criteria into a set of formulas acceptable by the solver and their satisfaction which fails when processed ``all-at-once''. We propose a scalable toolset using Alloy to automatically generate test cases satisfying T-wise from SPL models. We define strategies to split T-wise combinations into solvable subsets. We design and compute metrics to evaluate strategies on Aspect OPTIMA, a concrete transactional SPL.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"348 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123417296","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 241
Industrial Scaled Automated Structural Testing with the Evolutionary Testing Tool 工业规模自动化结构测试与进化测试工具
T. Vos, A. Baars, Felix F. Lindlar, Peter M. Kruse, Andreas Windisch, J. Wegener
Evolutionary testing has been researched and promising results have been presented. However, evolutionary testing has remained predominately a research-based activity not practiced within industry. Although attempts have been made, such as Daimler's Evolutionary Structural Test (EST) prototype, until now, no such tool has been suitable for industrial adoption. The European project EvoTest (IST-33472) team has been working from 2006 till2009 to improve this situation. This paper describes the final version of the Evolutionary Testing Framework (ETF) resulting from the EvoTest project. In specific we will present the EvoTest Structural Testing tool for fully automatic structural testing that has been demonstrated to be suitable within an industrial setting. The paper concentrates on how to use it and interpret the results. The paper starts with introducing the concepts of Evolutionary Testing in general and Structural Testing in specific. Subsequently, the ETF and the EvoTest Structural Testing tool built on-top of it will be described. We will concentrate on the usage, the architecture, and remaining limitations of the tool. The paper concludes describing the results of using the EvoTest Structural Testing tool in practice on real-world systems in an industrial setting.
人们对进化测试进行了研究,并取得了令人鼓舞的成果。然而,进化测试仍然主要是一种基于研究的活动,没有在工业中实践。尽管已经进行了一些尝试,比如戴姆勒的进化结构测试(EST)原型,但到目前为止,还没有这样的工具适合于工业应用。欧洲项目EvoTest (IST-33472)团队从2006年到2009年一直致力于改善这种情况。本文描述了进化测试框架(ETF)的最终版本,该版本由EvoTest项目产生。具体来说,我们将介绍EvoTest结构测试工具,用于全自动结构测试,该工具已被证明适用于工业环境。本文着重讨论了如何使用它和解释结果。本文首先介绍了演化测试的一般概念和结构测试的具体概念。随后,将介绍ETF和在其上构建的EvoTest结构测试工具。我们将集中讨论该工具的用法、体系结构和剩余的限制。本文最后描述了在工业环境中实际系统中使用EvoTest结构测试工具的结果。
{"title":"Industrial Scaled Automated Structural Testing with the Evolutionary Testing Tool","authors":"T. Vos, A. Baars, Felix F. Lindlar, Peter M. Kruse, Andreas Windisch, J. Wegener","doi":"10.1109/ICST.2010.24","DOIUrl":"https://doi.org/10.1109/ICST.2010.24","url":null,"abstract":"Evolutionary testing has been researched and promising results have been presented. However, evolutionary testing has remained predominately a research-based activity not practiced within industry. Although attempts have been made, such as Daimler's Evolutionary Structural Test (EST) prototype, until now, no such tool has been suitable for industrial adoption. The European project EvoTest (IST-33472) team has been working from 2006 till2009 to improve this situation. This paper describes the final version of the Evolutionary Testing Framework (ETF) resulting from the EvoTest project. In specific we will present the EvoTest Structural Testing tool for fully automatic structural testing that has been demonstrated to be suitable within an industrial setting. The paper concentrates on how to use it and interpret the results. The paper starts with introducing the concepts of Evolutionary Testing in general and Structural Testing in specific. Subsequently, the ETF and the EvoTest Structural Testing tool built on-top of it will be described. We will concentrate on the usage, the architecture, and remaining limitations of the tool. The paper concludes describing the results of using the EvoTest Structural Testing tool in practice on real-world systems in an industrial setting.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124619788","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 23
An Application of Six Sigma and Simulation in Software Testing Risk Assessment 六西格玛及模拟在软件测试风险评估中的应用
Vojo Bubevski
The conventional approach to Risk Assessment in Software Testing is based on analytic models and statistical analysis. The analytic models are static, so they don’t account for the inherent variability and uncertainty of the testing process, which is an apparent deficiency. This paper presents an application of Six Sigma and Simulation in Software Testing. DMAIC and simulation are applied to a testing process to assess and mitigate the risk to deliver the product on time, achieving the quality goals. DMAIC is used to improve the process and achieve required (higher) capability. Simulation is used to predict the quality (reliability) and considers the uncertainty and variability, which, in comparison with the analytic models, more accurately models the testing process. Presented experiments are applied on a real project using published data. The results are satisfactorily verified. This enhanced approach is compliant with CMMI® and provides for substantial Software Testing performance-driven improvements.
软件测试中风险评估的传统方法是基于分析模型和统计分析。分析模型是静态的,因此它们不能解释测试过程的内在可变性和不确定性,这是一个明显的缺陷。本文介绍了六西格玛和仿真在软件测试中的应用。DMAIC和仿真应用于测试过程,以评估和降低风险,按时交付产品,实现质量目标。DMAIC用于改进流程并实现所需的(更高的)能力。仿真用于预测质量(可靠性),并考虑了不确定性和可变性,与解析模型相比,它更准确地模拟了测试过程。所提出的实验采用已发表的数据在实际工程中进行了应用。结果得到了满意的验证。这种增强的方法与CMMI®兼容,并提供了实质性的软件测试性能驱动改进。
{"title":"An Application of Six Sigma and Simulation in Software Testing Risk Assessment","authors":"Vojo Bubevski","doi":"10.1109/ICST.2010.23","DOIUrl":"https://doi.org/10.1109/ICST.2010.23","url":null,"abstract":"The conventional approach to Risk Assessment in Software Testing is based on analytic models and statistical analysis. The analytic models are static, so they don’t account for the inherent variability and uncertainty of the testing process, which is an apparent deficiency. This paper presents an application of Six Sigma and Simulation in Software Testing. DMAIC and simulation are applied to a testing process to assess and mitigate the risk to deliver the product on time, achieving the quality goals. DMAIC is used to improve the process and achieve required (higher) capability. Simulation is used to predict the quality (reliability) and considers the uncertainty and variability, which, in comparison with the analytic models, more accurately models the testing process. Presented experiments are applied on a real project using published data. The results are satisfactorily verified. This enhanced approach is compliant with CMMI® and provides for substantial Software Testing performance-driven improvements.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128846514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information 利用执行谱信息的动态测试聚类采样策略
Shali Yan, Zhenyu Chen, Zhihong Zhao, Chen Zhang, Yuming Zhou
Cluster filtering is a kind of test selection technique, which saves human efforts for result inspection by reducing test size and finding maximum failures. Cluster sampling strategies play a key role in the cluster filtering technique. A good sampling strategy can greatly improve the failure detection capability. In this paper, we propose a new cluster sampling strategy called execution-spectra-based sampling (ESBS). Different from the existing sampling strategies, ESBS iteratively selects test cases from each cluster. In each iteration process, ESBS selects the test case that has the maximum possibility to be a failed test. For each test, its suspiciousness is computed based on the execution spectra information of previous passed and failed test cases selected from the same cluster. The new sampling strategy ESBS is evaluated experimentally and the results show that it is more effective than existing sampling strategies in most cases.
聚类过滤是一种测试选择技术,它通过减少测试规模和查找最大故障来节省检测结果的人力。聚类采样策略在聚类滤波技术中起着关键作用。一个好的采样策略可以大大提高故障检测能力。本文提出了一种新的集群采样策略,称为基于执行谱的采样(ESBS)。与现有的采样策略不同,ESBS迭代地从每个集群中选择测试用例。在每个迭代过程中,esb选择最有可能成为失败测试的测试用例。对于每个测试,其怀疑度是基于从同一集群中选择的先前通过和失败的测试用例的执行谱信息计算的。实验结果表明,新的ESBS采样策略在大多数情况下比现有的采样策略更有效。
{"title":"A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information","authors":"Shali Yan, Zhenyu Chen, Zhihong Zhao, Chen Zhang, Yuming Zhou","doi":"10.1109/ICST.2010.47","DOIUrl":"https://doi.org/10.1109/ICST.2010.47","url":null,"abstract":"Cluster filtering is a kind of test selection technique, which saves human efforts for result inspection by reducing test size and finding maximum failures. Cluster sampling strategies play a key role in the cluster filtering technique. A good sampling strategy can greatly improve the failure detection capability. In this paper, we propose a new cluster sampling strategy called execution-spectra-based sampling (ESBS). Different from the existing sampling strategies, ESBS iteratively selects test cases from each cluster. In each iteration process, ESBS selects the test case that has the maximum possibility to be a failed test. For each test, its suspiciousness is computed based on the execution spectra information of previous passed and failed test cases selected from the same cluster. The new sampling strategy ESBS is evaluated experimentally and the results show that it is more effective than existing sampling strategies in most cases.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115936707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 40
A Counter-Example Testing Approach for Orchestrated Services 编排服务的反例测试方法
F. D. Angelis, A. Polini, G. D. Angelis
Service oriented computing is based on a typical combination of features such as very late binding, run-time integration of software elements owned and managed by third parties, run-time changes. These characteristics generally make difficult both static and dynamic verification capabilities of service-centric systems. In this domain verification and testing research communities have to face new issues and revise existing solutions; possibly profiting of the new opportunities that the new paradigm makes available. In this paper, focusing on service orchestrations, we propose an approach to automatic test case generation aiming in particular at checking the behaviour of services participating in a given orchestration. The approach exploits the availability of a runnable model (the BPEL specification) and uses model checking techniques to derive test cases suitable to detect possible integration problems. The approach has been implemented in a plug-in for the Eclipse platform already released for public usage. In this way BPEL developers can easily derive, using a single environment, test suites for each participant service they would like to compose.
面向服务的计算基于一些典型的特性组合,比如非常晚的绑定、第三方拥有和管理的软件元素的运行时集成、运行时更改。这些特征通常使以服务为中心的系统的静态和动态验证能力变得困难。在这一领域,验证和测试研究团体必须面对新的问题,修改现有的解决方案;可能从新范式提供的新机会中获利。在本文中,我们关注服务编排,提出了一种自动生成测试用例的方法,特别针对检查参与给定编排的服务的行为。该方法利用了可运行模型(BPEL规范)的可用性,并使用模型检查技术派生出适合检测可能的集成问题的测试用例。该方法已经在Eclipse平台的插件中实现,该插件已经发布供公众使用。通过这种方式,BPEL开发人员可以使用单个环境轻松地为他们想要组合的每个参与者服务派生测试套件。
{"title":"A Counter-Example Testing Approach for Orchestrated Services","authors":"F. D. Angelis, A. Polini, G. D. Angelis","doi":"10.1109/ICST.2010.27","DOIUrl":"https://doi.org/10.1109/ICST.2010.27","url":null,"abstract":"Service oriented computing is based on a typical combination of features such as very late binding, run-time integration of software elements owned and managed by third parties, run-time changes. These characteristics generally make difficult both static and dynamic verification capabilities of service-centric systems. In this domain verification and testing research communities have to face new issues and revise existing solutions; possibly profiting of the new opportunities that the new paradigm makes available. In this paper, focusing on service orchestrations, we propose an approach to automatic test case generation aiming in particular at checking the behaviour of services participating in a given orchestration. The approach exploits the availability of a runnable model (the BPEL specification) and uses model checking techniques to derive test cases suitable to detect possible integration problems. The approach has been implemented in a plug-in for the Eclipse platform already released for public usage. In this way BPEL developers can easily derive, using a single environment, test suites for each participant service they would like to compose.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131340236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 19
Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization 清除测试套件中的巧合正确性以增强错误定位
Wes Masri, R. A. Assi
Researchers have argued that for failure to be observed the following three conditions must be met: 1) the defect is executed, 2) the program has transitioned into an infectious state, and 3) the infection has propagated to the output. Coincidental correctness arises when the program produces the correct output, while conditions 1) and 2) are met but not 3). In previous work, we showed that coincidental correctness is prevalent and demonstrated that it is a safety reducing factor for coverage-based fault localization. This work aims at cleansing test suites from coincidental correctness to enhance fault localization. Specifically, given a test suite in which each test has been classified as failing or passing, we present three variations of a technique that identify the subset of passing tests that are likely to be coincidentally correct. We evaluated the effectiveness of our techniques by empirically quantifying the following: 1) how accurately did they identify the coincidentally correct tests, 2) how much did they improve the effectiveness of coverage-based fault localization, and 3) how much did coverage decrease as a result of applying them. Using our better performing technique and configuration, the safety and precision of fault-localization was improved for 88% and 61% of the programs, respectively.
研究人员认为,要使失败被观察到,必须满足以下三个条件:1)缺陷被执行,2)程序已经过渡到感染状态,3)感染已经传播到输出。当程序产生正确的输出,而满足条件1)和2)而不满足条件3)时,就会出现巧合正确性。在之前的工作中,我们表明巧合正确性是普遍存在的,并证明它是基于覆盖率的故障定位的安全降低因素。这项工作旨在清除测试套件中的巧合正确性,以增强故障定位。具体地说,给定一个测试套件,其中每个测试都被分类为失败或通过,我们提出了一种技术的三种变体,用于识别通过的测试子集,这些测试子集很可能碰巧是正确的。我们通过以下经验量化来评估我们的技术的有效性:1)它们识别碰巧正确的测试有多准确,2)它们在多大程度上提高了基于覆盖率的故障定位的有效性,以及3)由于应用它们,覆盖率降低了多少。使用我们更好的技术和配置,故障定位的安全性和精度分别提高了88%和61%。
{"title":"Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization","authors":"Wes Masri, R. A. Assi","doi":"10.1109/ICST.2010.22","DOIUrl":"https://doi.org/10.1109/ICST.2010.22","url":null,"abstract":"Researchers have argued that for failure to be observed the following three conditions must be met: 1) the defect is executed, 2) the program has transitioned into an infectious state, and 3) the infection has propagated to the output. Coincidental correctness arises when the program produces the correct output, while conditions 1) and 2) are met but not 3). In previous work, we showed that coincidental correctness is prevalent and demonstrated that it is a safety reducing factor for coverage-based fault localization. This work aims at cleansing test suites from coincidental correctness to enhance fault localization. Specifically, given a test suite in which each test has been classified as failing or passing, we present three variations of a technique that identify the subset of passing tests that are likely to be coincidentally correct. We evaluated the effectiveness of our techniques by empirically quantifying the following: 1) how accurately did they identify the coincidentally correct tests, 2) how much did they improve the effectiveness of coverage-based fault localization, and 3) how much did coverage decrease as a result of applying them. Using our better performing technique and configuration, the safety and precision of fault-localization was improved for 88% and 61% of the programs, respectively.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133625386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 79
Towards an Automated and Dynamically Adaptable Test System for Testing Healthcare Information Systems 面向医疗信息系统测试的自动化动态适应性测试系统
D. Vega
Interoperability is one of the most important requirements for the next generation Healthcare Information Systems (HIS) that permits healthcare institutes to use heterogeneous solutions from different vendors. Introducing standards in eHealth domain, such as Health Level 7 (HL7) used for data representation, and Integrating Healthcare Enterprise (IHE) profiles for describing interactions between actors, is important to support interoperability of healthcare systems. This work addresses the challenges of interoperability testing of different HL7/IHE based HIS systems and introduces a testing methodology and its realization test framework based on TTCN-3 language.
互操作性是下一代医疗保健信息系统(HIS)最重要的需求之一,它允许医疗保健机构使用来自不同供应商的异构解决方案。在电子健康领域引入标准,例如用于数据表示的健康级别7 (HL7)和用于描述参与者之间交互的集成医疗保健企业(IHE)配置文件,对于支持医疗保健系统的互操作性非常重要。本文解决了不同基于HL7/IHE的HIS系统互操作性测试的挑战,并介绍了一种基于TTCN-3语言的测试方法及其实现测试框架。
{"title":"Towards an Automated and Dynamically Adaptable Test System for Testing Healthcare Information Systems","authors":"D. Vega","doi":"10.1109/ICST.2010.67","DOIUrl":"https://doi.org/10.1109/ICST.2010.67","url":null,"abstract":"Interoperability is one of the most important requirements for the next generation Healthcare Information Systems (HIS) that permits healthcare institutes to use heterogeneous solutions from different vendors. Introducing standards in eHealth domain, such as Health Level 7 (HL7) used for data representation, and Integrating Healthcare Enterprise (IHE) profiles for describing interactions between actors, is important to support interoperability of healthcare systems. This work addresses the challenges of interoperability testing of different HL7/IHE based HIS systems and introduces a testing methodology and its realization test framework based on TTCN-3 language.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128761826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
An Empirical Evaluation of Regression Testing Based on Fix-Cache Recommendations 基于Fix-Cache建议的回归检验实证评价
Emelie Engström, P. Runeson, Greger Wikstrand
Background: The fix-cache approach to regression test selection was proposed to identify the most fault-prone files and corresponding test cases through analysis of fixed defect reports. Aim: The study aims at evaluating the efficiency of this approach, compared to the previous regression test selection strategy in a major corporation, developing embedded systems. Method: We launched a post-hoc case study applying the fix-cache selection method during six iterations of development of a multi-million LOC product. The test case execution was monitored through the test management and defect reporting systems of the company. Results: From the observations, we conclude that the fix-cache method is more efficient in four iterations. The difference is statistically significant at alpha = 0.05. Conclusions: The new method is significantly more efficient in our case study. The study will be replicated in an environment with better control of the test execution.
背景:提出回归测试选择的fix-cache方法,通过对修复缺陷报告的分析,识别出最容易出错的文件和相应的测试用例。目的:本研究的目的是评估这种方法的效率,比较以前的回归测试选择策略在一个大公司,开发嵌入式系统。方法:我们在开发数百万LOC产品的六次迭代中应用固定缓存选择方法启动了一个事后案例研究。测试用例的执行是通过公司的测试管理和缺陷报告系统进行监控的。结果:通过观察,我们得出固定缓存方法在四次迭代中效率更高的结论。差异有统计学意义,alpha = 0.05。结论:在我们的案例研究中,新方法的效率显著提高。研究将在一个更好地控制测试执行的环境中被复制。
{"title":"An Empirical Evaluation of Regression Testing Based on Fix-Cache Recommendations","authors":"Emelie Engström, P. Runeson, Greger Wikstrand","doi":"10.1109/ICST.2010.40","DOIUrl":"https://doi.org/10.1109/ICST.2010.40","url":null,"abstract":"Background: The fix-cache approach to regression test selection was proposed to identify the most fault-prone files and corresponding test cases through analysis of fixed defect reports. Aim: The study aims at evaluating the efficiency of this approach, compared to the previous regression test selection strategy in a major corporation, developing embedded systems. Method: We launched a post-hoc case study applying the fix-cache selection method during six iterations of development of a multi-million LOC product. The test case execution was monitored through the test management and defect reporting systems of the company. Results: From the observations, we conclude that the fix-cache method is more efficient in four iterations. The difference is statistically significant at alpha = 0.05. Conclusions: The new method is significantly more efficient in our case study. The study will be replicated in an environment with better control of the test execution.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122821066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
The Effectiveness of Regression Testing Techniques in Reducing the Occurrence of Residual Defects 回归测试技术在减少残余缺陷发生方面的有效性
Panduka Nagahawatte, Hyunsook Do
Regression testing is a necessary maintenance activity that can ensure high quality of the modified software system, and a great deal of research on regression testing has been performed. Most of the studies performed to date, however, have evaluated regression testing techniques under the limited context, such as a short-term assessment, which do not fully account for system evolution or industrial circumstances. One important issue associated with a system lifetime view that we have overlooked in past years is the effects of residual defects -- defects that persist undetected -- across several releases of a system. Depending on an organization's business goals and the type of system being built, residual defects might affect the level of success of the software products. In this paper, we conducted an empirical study to investigate whether regression testing techniques are effective in reducing the occurrence and persistence of residual defects across a system's lifetime, in particular, considering test case prioritization techniques. Our results show that heuristics can be effective in reducing both the occurrence of residual defects and their age. Our results also indicate that residual defects and their age have a strong impact on the cost-benefits of test case prioritization techniques.
回归测试是保证修改后软件系统高质量的必要维护活动,人们对回归测试进行了大量的研究。然而,迄今为止进行的大多数研究都是在有限的背景下评估回归测试技术,例如短期评估,它不能完全解释系统演变或工业环境。与系统生命周期视图相关的一个重要问题是,我们在过去的几年中忽略了残留缺陷的影响——未被检测到的持续存在的缺陷——跨越系统的几个版本。根据组织的业务目标和正在构建的系统类型,剩余缺陷可能会影响软件产品的成功程度。在本文中,我们进行了一项实证研究,以调查回归测试技术在减少系统生命周期中残余缺陷的发生和持久性方面是否有效,特别是考虑到测试用例优先化技术。我们的结果表明,启发式可以有效地减少残余缺陷的发生和它们的年龄。我们的结果还表明,残余缺陷和它们的年龄对测试用例优先化技术的成本收益有很大的影响。
{"title":"The Effectiveness of Regression Testing Techniques in Reducing the Occurrence of Residual Defects","authors":"Panduka Nagahawatte, Hyunsook Do","doi":"10.1109/ICST.2010.57","DOIUrl":"https://doi.org/10.1109/ICST.2010.57","url":null,"abstract":"Regression testing is a necessary maintenance activity that can ensure high quality of the modified software system, and a great deal of research on regression testing has been performed. Most of the studies performed to date, however, have evaluated regression testing techniques under the limited context, such as a short-term assessment, which do not fully account for system evolution or industrial circumstances. One important issue associated with a system lifetime view that we have overlooked in past years is the effects of residual defects -- defects that persist undetected -- across several releases of a system. Depending on an organization's business goals and the type of system being built, residual defects might affect the level of success of the software products. In this paper, we conducted an empirical study to investigate whether regression testing techniques are effective in reducing the occurrence and persistence of residual defects across a system's lifetime, in particular, considering test case prioritization techniques. Our results show that heuristics can be effective in reducing both the occurrence of residual defects and their age. Our results also indicate that residual defects and their age have a strong impact on the cost-benefits of test case prioritization techniques.","PeriodicalId":192678,"journal":{"name":"2010 Third International Conference on Software Testing, Verification and Validation","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129848264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
期刊
2010 Third International Conference on Software Testing, Verification and Validation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1