Performance is an important attribute of a software system. To develop a software system of acceptable performance, the team needs to specify precise performance requirements, design appropriate test cases, and use suitable techniques to analyze the performance characteristics. However, the lack of a structured framework for performance engineering may impair the effectiveness of the techniques. We propose the Performance Refinement and Evolution Model (PREM) as a performance management framework. Based on the specification of quantitative measurement and workloads, PREM classifies performance requirements specification, analysis activities, and testing into four levels. In this paper, we provide an overview of this model.
{"title":"Developing software performance with the performance refinement and evolution model","authors":"C. Ho, L. Williams","doi":"10.1145/1216993.1217016","DOIUrl":"https://doi.org/10.1145/1216993.1217016","url":null,"abstract":"Performance is an important attribute of a software system. To develop a software system of acceptable performance, the team needs to specify precise performance requirements, design appropriate test cases, and use suitable techniques to analyze the performance characteristics. However, the lack of a structured framework for performance engineering may impair the effectiveness of the techniques. We propose the Performance Refinement and Evolution Model (PREM) as a performance management framework. Based on the specification of quantitative measurement and workloads, PREM classifies performance requirements specification, analysis activities, and testing into four levels. In this paper, we provide an overview of this model.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"90 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132798843","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Distributed applications are rapidly converging towards the adoption of a computing paradigm based on service-oriented architectures (SOA), according to which an application results from the composition of a set of services in execution on networked server hosts. In a SOA context, service providers are strategically interested both to describe the performance characteristics of offered services, to better qualify their offer and gain a significant advantage in the global marketplace, and to predict the level of performance that can be offered to service consumers when building composite web services that make use of services managed by various service providers. This paper introduces a model-driven approach for integrating performance prediction into service composition processes carried out by use of BPEL (Business Process Execution Language for Web Services). The proposed approach is founded on P-WSDL (Performance-enabled WSDL), a performance-oriented extension of WSDL, the language for describing the information about service capabilities and invocation mechanisms. P-WSDL is a lightweight WSDL extension for the description of performance characteristics of a web service. The approach is illustrated by use of an example application to a composite web service for travel planning.
{"title":"A model-driven approach to describe and predict the performance of composite services","authors":"A. D’Ambrogio, Paolo Bocciarelli","doi":"10.1145/1216993.1217008","DOIUrl":"https://doi.org/10.1145/1216993.1217008","url":null,"abstract":"Distributed applications are rapidly converging towards the adoption of a computing paradigm based on service-oriented architectures (SOA), according to which an application results from the composition of a set of services in execution on networked server hosts. In a SOA context, service providers are strategically interested both to describe the performance characteristics of offered services, to better qualify their offer and gain a significant advantage in the global marketplace, and to predict the level of performance that can be offered to service consumers when building composite web services that make use of services managed by various service providers. This paper introduces a model-driven approach for integrating performance prediction into service composition processes carried out by use of BPEL (Business Process Execution Language for Web Services). The proposed approach is founded on P-WSDL (Performance-enabled WSDL), a performance-oriented extension of WSDL, the language for describing the information about service capabilities and invocation mechanisms. P-WSDL is a lightweight WSDL extension for the description of performance characteristics of a web service. The approach is illustrated by use of an example application to a composite web service for travel planning.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130457119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Service-Level Agreements (SLAs) mitigate the risks of a service-provision scenario by associating financial penalties with aberrant service behaviour. SLAs are useless if their provisions can be unilaterally ignored by a party without incurring any liability. To avoid this, it is necessary to ensure that each party's conformance to its obligations can be monitored by the other parties. We introduce a technique for analysing systems of SLAs to determine the degree of monitorability possible. We apply this technique to identify the most monitorable system of SLAs including timeliness constraints for a three-role Application-Service Provision (ASP) scenario. The system contains SLAs that are at best mutually monitorable, implying the requirement for reconciliation of monitoring data between the parties, and hence the need to constrain the parties to report honestly while accommodating unavoidable measurement error. We describe the design of a fair constraint on the precision and accuracy of reported measurements, and its approximate monitorability using a statistical hypothesis test.
{"title":"The monitorability of service-level agreements for application-service provision","authors":"J. Skene, A. Skene, J. Crampton, W. Emmerich","doi":"10.1145/1216993.1216997","DOIUrl":"https://doi.org/10.1145/1216993.1216997","url":null,"abstract":"Service-Level Agreements (SLAs) mitigate the risks of a service-provision scenario by associating financial penalties with aberrant service behaviour. SLAs are useless if their provisions can be unilaterally ignored by a party without incurring any liability. To avoid this, it is necessary to ensure that each party's conformance to its obligations can be monitored by the other parties. We introduce a technique for analysing systems of SLAs to determine the degree of monitorability possible. We apply this technique to identify the most monitorable system of SLAs including timeliness constraints for a three-role Application-Service Provision (ASP) scenario. The system contains SLAs that are at best mutually monitorable, implying the requirement for reconciliation of monitoring data between the parties, and hence the need to constrain the parties to report honestly while accommodating unavoidable measurement error. We describe the design of a fair constraint on the precision and accuracy of reported measurements, and its approximate monitorability using a statistical hypothesis test.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114263543","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The synthesis of increased global competitiveness and the acceptance of commercially available multi purpose database management systems (DBMS) for decision support applications requires an ever more critical system evaluation and selection to be completed in a progressively short period of time. Designers of standard benchmarks, individual customer benchmarks and system stress tests alike are struggling to mastermind queries that are both representative to the real world and execute in a reasonable time. Additionally, the enriched functionality of every new DBMS release amplifies the complexity of today's decision support systems calling for a novel approach in query generation for benchmarks. This paper proposes a framework of so called query evolution rules that can be applied to typical decision support queries, written in SQL92. Deployed in combination with QGEN2, the query generator developed by the TPC for TPC-DS ?[13], these rules quickly turn a small set of queries into a large set of semantically similar queries for ad-hoc benchmarking purposes or they can be used to generate thousands of queries quickly to stress test optimizers or query execution engines without much user intervention.
{"title":"Controlled SQL query evolution for decision support benchmarks","authors":"Meikel Pöss","doi":"10.1145/1216993.1217001","DOIUrl":"https://doi.org/10.1145/1216993.1217001","url":null,"abstract":"The synthesis of increased global competitiveness and the acceptance of commercially available multi purpose database management systems (DBMS) for decision support applications requires an ever more critical system evaluation and selection to be completed in a progressively short period of time. Designers of standard benchmarks, individual customer benchmarks and system stress tests alike are struggling to mastermind queries that are both representative to the real world and execute in a reasonable time. Additionally, the enriched functionality of every new DBMS release amplifies the complexity of today's decision support systems calling for a novel approach in query generation for benchmarks. This paper proposes a framework of so called query evolution rules that can be applied to typical decision support queries, written in SQL92. Deployed in combination with QGEN2, the query generator developed by the TPC for TPC-DS ?[13], these rules quickly turn a small set of queries into a large set of semantically similar queries for ad-hoc benchmarking purposes or they can be used to generate thousands of queries quickly to stress test optimizers or query execution engines without much user intervention.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132340510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lukas Pustina, Simon Schwarzer, M. Gerharz, P. Martini, V. Deichmann
In this experience report, we present experiences we have gained in applying performance engineering techniques during the design of a DVB-H enabled handheld device. The modelling methodology we applied uses UML 2.0 to model the system following a strict separation of architectural and behavioural aspects of the systems. From sequence diagrams and composite structure diagrams, a queueing network is generated for the analysis of the system performance. The configuration of the hardware resources and the resource demands is done using the standard SPT-profile. We describe our implementation and its seamless integration into a UML 2.0 CASE tool. Finally, the paper outlines lessons learnt during the design process which may be used to enhance the methodology.
{"title":"Performance evaluation of a DVB-H enabled mobile device system model","authors":"Lukas Pustina, Simon Schwarzer, M. Gerharz, P. Martini, V. Deichmann","doi":"10.1145/1216993.1217022","DOIUrl":"https://doi.org/10.1145/1216993.1217022","url":null,"abstract":"In this experience report, we present experiences we have gained in applying performance engineering techniques during the design of a DVB-H enabled handheld device. The modelling methodology we applied uses UML 2.0 to model the system following a strict separation of architectural and behavioural aspects of the systems. From sequence diagrams and composite structure diagrams, a queueing network is generated for the analysis of the system performance. The configuration of the hardware resources and the resource demands is done using the standard SPT-profile. We describe our implementation and its seamless integration into a UML 2.0 CASE tool. Finally, the paper outlines lessons learnt during the design process which may be used to enhance the methodology.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122645783","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this talk we will discuss next generation data centers and the important impact they will have upon enterprise applications. Specifically, we will discuss the technical and economical trends motivating the move towards large scale distributed data centers consisting of tens of thousands of servers and hundreds of petabytes of storage. We will explain the roles and advantages of virtual machines and other virtualization technologies in these environments and also explore how they exacerbate the complexity of management and achieving predictable application behavior.To better illustrate issues emerging in such environments we will describe early experiments we conducted with a 1000-processor utility rendering service created for DreamWorks Animation that was used to render the films Shrek II and Madagascar. We will discuss the lessons learned from this experience.Next, we consider the trend towards service oriented architectures for enterprise application platforms. Service orientation provides for more flexible and agile information technology systems but further increases the complexity of management and behavior. We will explore the implications of composing services dynamically using an SOA approach.These trends for enterprise application platforms and the trends towards next generation data centers have helped to drive our current research agenda. Our goal is to enable the flexibility and agility offered by these new technologies while enabling cost effective management, predictable behavior and improved quality of service. We will give an overview of our research on model driven design for enterprise application infrastructure, automated deployment, and operations of distributed application services executing in a virtualized, shared resource pool within these next generation data centers.Finally, we will summarize the implications, challenges, and opportunities posed by these trends on academic and industrial research. In particular, we consider the impact on software performance and software performance engineering and pose important unanswered questions.
{"title":"Next generation data centers: trends and implications","authors":"R. Friedrich, J. Rolia","doi":"10.1145/1216993.1216994","DOIUrl":"https://doi.org/10.1145/1216993.1216994","url":null,"abstract":"In this talk we will discuss next generation data centers and the important impact they will have upon enterprise applications. Specifically, we will discuss the technical and economical trends motivating the move towards large scale distributed data centers consisting of tens of thousands of servers and hundreds of petabytes of storage. We will explain the roles and advantages of virtual machines and other virtualization technologies in these environments and also explore how they exacerbate the complexity of management and achieving predictable application behavior.To better illustrate issues emerging in such environments we will describe early experiments we conducted with a 1000-processor utility rendering service created for DreamWorks Animation that was used to render the films Shrek II and Madagascar. We will discuss the lessons learned from this experience.Next, we consider the trend towards service oriented architectures for enterprise application platforms. Service orientation provides for more flexible and agile information technology systems but further increases the complexity of management and behavior. We will explore the implications of composing services dynamically using an SOA approach.These trends for enterprise application platforms and the trends towards next generation data centers have helped to drive our current research agenda. Our goal is to enable the flexibility and agility offered by these new technologies while enabling cost effective management, predictable behavior and improved quality of service. We will give an overview of our research on model driven design for enterprise application infrastructure, automated deployment, and operations of distributed application services executing in a virtualized, shared resource pool within these next generation data centers.Finally, we will summarize the implications, challenges, and opportunities posed by these trends on academic and industrial research. In particular, we consider the impact on software performance and software performance engineering and pose important unanswered questions.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"132 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120922261","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Caporuscio, Damien Charlet, V. Issarny, A. Navarra
Wireless devices now hold multiple radio interfaces, allowing to switch from one network to another according to required connectivity and related quality. Still, the selection of the best radio interface for a specific connection is under the responsibility of the end-user in most cases. Integrated multi-radio network management so as to improve the overall performance of the network(s) up to the software application layer, has led to a number of research efforts over the last few years. However, several challenges remain due to the inherent complexity of the problem. This paper specifically concentrates on the comprehensive analysis of energy-efficient multi-radio networking for pervasive computing. Building upon the service oriented architectural style, we consider pervasive networks of software services, which are deployed on the various networked nodes. The issue is then to optimize the energetic performance of the pervasive network through careful selection of the radio link over which service access should be realized for each such access. By considering the most common wireless interfaces in use today (Bluetooth, WiFi and GPRS), we introduce a formal model of service-oriented multi-radio networks. The proposed model enables characterizing the optimal network configuration in terms of energetic performance, which is shown to be a NP-hard problem and thus requires adequate approximation.
{"title":"Energetic performance of service-oriented multi-radio networks: issues and perspectives","authors":"M. Caporuscio, Damien Charlet, V. Issarny, A. Navarra","doi":"10.1145/1216993.1217002","DOIUrl":"https://doi.org/10.1145/1216993.1217002","url":null,"abstract":"Wireless devices now hold multiple radio interfaces, allowing to switch from one network to another according to required connectivity and related quality. Still, the selection of the best radio interface for a specific connection is under the responsibility of the end-user in most cases. Integrated multi-radio network management so as to improve the overall performance of the network(s) up to the software application layer, has led to a number of research efforts over the last few years. However, several challenges remain due to the inherent complexity of the problem. This paper specifically concentrates on the comprehensive analysis of energy-efficient multi-radio networking for pervasive computing. Building upon the service oriented architectural style, we consider pervasive networks of software services, which are deployed on the various networked nodes. The issue is then to optimize the energetic performance of the pervasive network through careful selection of the radio link over which service access should be realized for each such access. By considering the most common wireless interfaces in use today (Bluetooth, WiFi and GPRS), we introduce a formal model of service-oriented multi-radio networks. The proposed model enables characterizing the optimal network configuration in terms of energetic performance, which is shown to be a NP-hard problem and thus requires adequate approximation.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122423812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This panel session discusses performance engineering practices in industry. Presentations in the session will explore the use of lightweight techniques and approaches in order to permit the cost effective and rapid adoption of performance modeling research by large industrial software systems.
{"title":"Performance engineering in industry: current practices and adoption challenges","authors":"A. Hassan, P. Flora","doi":"10.1145/1216993.1217029","DOIUrl":"https://doi.org/10.1145/1216993.1217029","url":null,"abstract":"This panel session discusses performance engineering practices in industry. Presentations in the session will explore the use of lightweight techniques and approaches in order to permit the cost effective and rapid adoption of performance modeling research by large industrial software systems.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126736465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pere P. Sancho, C. Juiz, R. Puigjaner, L. Chung, N. Subramanian
In this article we intend to make an attempt to formalize the Software Performance Engineering Body of Knowledge (SPEBoK) by means of the formal semantics of an ontology written in OWL. We do not claim that our SPEBoK is complete nor the information contained correct. Rather we propose the structure of an ontological database to contain it. This structure allows the Performance Engineering issues to be related among themselves and even to other non-functional requirements with which they may interact. Our work uses the NFR Framework.
{"title":"An approach to ontology-aided performance engineering through NFR framework","authors":"Pere P. Sancho, C. Juiz, R. Puigjaner, L. Chung, N. Subramanian","doi":"10.1145/1216993.1217014","DOIUrl":"https://doi.org/10.1145/1216993.1217014","url":null,"abstract":"In this article we intend to make an attempt to formalize the Software Performance Engineering Body of Knowledge (SPEBoK) by means of the formal semantics of an ontology written in OWL. We do not claim that our SPEBoK is complete nor the information contained correct. Rather we propose the structure of an ontological database to contain it. This structure allows the Performance Engineering issues to be related among themselves and even to other non-functional requirements with which they may interact. Our work uses the NFR Framework.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"32 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128598203","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The market of portable computational devices is expanding more and more rapidly. The systems created by the interactions of these devices among themselves and with the surrounding infrastructure result in being quite different from existing traditional systems in terms of connectivity, dynamicity and resource availability. As a consequence, existing performance evaluation and prediction techniques appear to be inadequate to the application to mobile systems. While some adaptations have been proposed for systems presenting some logical mobility (i.e., software mobility), very little has been attempted to provide useful performance prediction methodologies for physically mobile systems.In this paper we present a methodology for modeling performance of physically mobile systems: our aim is to provide guidelines for the designer of the system on how particular physical mobility patterns affect the system performance and on how these measures can be taken into account in the early stages of the system development.
{"title":"Performance analysis and prediction of physically mobile systems","authors":"A. Marco, C. Mascolo","doi":"10.1145/1216993.1217015","DOIUrl":"https://doi.org/10.1145/1216993.1217015","url":null,"abstract":"The market of portable computational devices is expanding more and more rapidly. The systems created by the interactions of these devices among themselves and with the surrounding infrastructure result in being quite different from existing traditional systems in terms of connectivity, dynamicity and resource availability. As a consequence, existing performance evaluation and prediction techniques appear to be inadequate to the application to mobile systems. While some adaptations have been proposed for systems presenting some logical mobility (i.e., software mobility), very little has been attempted to provide useful performance prediction methodologies for physically mobile systems.In this paper we present a methodology for modeling performance of physically mobile systems: our aim is to provide guidelines for the designer of the system on how particular physical mobility patterns affect the system performance and on how these measures can be taken into account in the early stages of the system development.","PeriodicalId":235512,"journal":{"name":"Workshop on Software and Performance","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122164640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：