Test Automation ROI Methodology

上一篇 / 下一篇  2011-10-21 16:00:11 / 个人分类:自动化测试框架

ROI Methodology

ROI can be calculated as Total benefit derived from automation / Total cost of automation. The benefits matrix below depicts the distribution of direct and indirect benefits across people, process, and technology drivers, which can be translated to customer benefits.

Benefits of Automation

Automated testing tools are capable of running continuously without any productivity loss or fatigue, with minimal or no manual intervention. This implies that organizations can plan testing activities beyond the traditional eight-hour work shift, reducing the elapsed duration for testing by as much as two-thirds of the time required for manual testing.

Test automation enables organizations to redeploy engineers for specialized tasks that cannot be accomplished through automation testing.

These tasks include interoperability testing involving external systems, testing for event driven processes in real time, intuitive testing, and more.

Costs of Automation

Fixed costs of automation include one-time investments to establish the automation environment. Recurring costs are incurred during the testing lifecycle. The below cost matrix depicts the distribution of fixed and recurring costs across people, process, and technology drivers.

A Case in Point

In this section, we illustrate savings in test execution time for automation.


We assume a sample size of 500 test cases per test cycle. Benefit of automation for each test cycle is given by:

TS = TM - TA


TS = Time saved due to test automation

White Paper: ROI on Test Automationcalculations for the following frequencies of execution:

18 test cycles/ year

30 test cycles/ year

50 testcycles/ year

As evident from the graph above, ROI for test automation increases with increasing

Automation Frameworks

Software organizations with an independent testing practice can enhance the benefits of automation further through the use of automation frameworks. Automation Frameworks can provide reusable code bases which support the deployment of the testing tool into the engagement.

In the following section, we detail the salient features of our automation framework, illustrating ROI enhancements over standard test automation approaches.

Multi-platform. support (Windows,Java, etc.) –so that scripts can be ported across platforms with minor changes

TM = Time taken for manual testing

TA = Time taken for automated testing

Cost of Automation

Cost of automation is given by:



CA = Cost of automation

CHS = Cost of hardware and software (this can be apportioned over many testing engagements)

CDM = Cost of developing and maintaining automation script

CT = Cost of training staff on automation tools (this can be apportioned over many testing engagements)





Open Toolbar