Execution of a Test Program like a Military Campaign

Abstract

The test strategy developed for a program has many similarities to the development of a military strategy. Both need a strong central leader to drive decisions and maintain focus on the end goal. In the military, the commanding General defines and drives the military strategy; likewise, on a product development program, the Test Architect defines and drives the test strategy. Ultimately, the success of that program is decisively determined by the program test strategy robustness. The test strategy is a living document that defines all test activities across the product lifecycle required to meet a defined end-state. Consequently, the effective design verification and validation of a new product in the market is wholly dependent on the careful planning and execution of the test strategy. But what defines a good test strategy and how does that drive a successful test program? This paper discusses how test tenets, like a set of fundamental military principles of war, must first be defined as part of the test strategy. These tenets establish the rules for test program execution such that no matter how the test program may evolve, the tenets can never be broken, else additional cost and schedule occur. Additionally, test goals must be identified to constrain and bound the scope of the test program. Each test goal should have a set of key processes, or tactics as defined in the military vernacular, and associated metrics to drive the execution of the test strategy and provide status. Test strategy execution, from defining test tenets to identifying processes and metrics, drive successful test program execution and ensure that the delivered product is fully verified and validated. Establishing the test strategy early on in the product development lifecycle ensures that all the key stakeholders are aligned and remain focused on the outcome of the test program and guarantees successful delivery of the product to the and guarantees successful delivery of the product to the Customer.