Test Automation ROI Methodology
上一篇 /
下一篇 2011-10-21 16:00:11
/ 个人分类:自动化测试框架
ROI Methodology
ROI can be calculated as Total benefit derived from automation / Total cost of automation. The benefits matrix below depicts the distribution of direct and indirect benefits across people, process, and technology drivers, which can be translated to customer benefits.
Benefits of Automation
Automated testing tools are capable of running continuously without any productivity loss or fatigue, with minimal or no manual intervention. This implies that organizations can plan testing activities beyond the traditional eight-hour work shift, reducing the elapsed duration for testing by as much as two-thirds of the time required for manual testing.
Test automation enables organizations to redeploy engineers for specialized tasks that cannot be accomplished through automation testing.
These tasks include interoperability testing involving external systems, testing for event driven processes in real time, intuitive testing, and more.
Costs of Automation
Fixed costs of automation include one-time investments to establish the automation environment. Recurring costs are incurred during the testing lifecycle. The below cost matrix depicts the distribution of fixed and recurring costs across people, process, and technology drivers.
A Case in Point
In this section, we illustrate savings in test execution time for automation.
Benefits
We assume a sample size of 500 test cases per test cycle. Benefit of automation for each test cycle is given by:
TS = TM - TA
Where,
TS = Time saved due to test automation
White Paper: ROI on Test Automation
calculations for the following frequencies of execution:18 test cycles/ year
•30 test cycles/ year
•50 test
•cycles/ yearAs evident from the graph above, ROI for test automation increases with increasing
Automation Frameworks
Software organizations with an independent testing practice can enhance the benefits of automation further through the use of automation frameworks. Automation Frameworks can provide reusable code bases which support the deployment of the testing tool into the engagement.
In the following section, we detail the salient features of our automation framework, illustrating ROI enhancements over standard test automation approaches.
Multi-platform. support (Windows,
•Java, etc.) –so that scripts can be ported across platforms with minor changesTM = Time taken for manual testing
TA = Time taken for automated testing
Cost of Automation
Cost of automation is given by:
CA = CHS + CDM+ CT
Where,
CA = Cost of automation
CHS = Cost of hardware and software (this can be apportioned over many testing engagements)
CDM = Cost of developing and maintaining automation script
CT = Cost of training staff on automation tools (this can be apportioned over many testing engagements)
收藏
举报
TAG: