测试未来的预测

Sh,H$A!{0

eTq*yW:l0 “预测是件很难的事情，尤其是预测未来” —Yogi Berra

wd0ij6k\0G:n0

   每年十二月，小报的“未来预测者”们会向大家切揭示即将到来的一年将要发生的事情：“麦丹娜将要乘坐航天飞机”，“美国将迁都 Wichita”，等等。我将加入这个潮流，对软件测试何去何从做一个我自己的预测。并且我希望，我的预测费用能够比我的那些值得尊敬的小报同事更高些。

Un
k$SH X Zg051Testing软件测试网o7Sp.c| e3| nd$_

;v1Lx)l:V2d5`Pv0   我的主要预测就是，将来的软件测试与现在的软件测试看起来很不一样。原因很直接：今天的软件测试很大程度上是臭名昭著的：软件测试参与到项目中的时间太 晚、贡献太少、花费太高。如果我们关心我们产品的质量以及我们的账本底线的话，我们就需要重新思考测试和质量的方法。51Testing软件测试网1q)w z[
L

7~5F@v9R/m-l051Testing软件测试网(?T_?`)@

   即使遭到一致反对，我也要说：更好的方法，对测试人员更好的培训、更好的欣赏将改革软件产业。具体地说，诸如可执行的说明书、基于模型的测试产生、BUG预防、系统模拟这些技术，将在这场演变过程中扮演重要的角色。

51Testing软件测试网)wL(KLz2Bp2_W

   下面就是我们在将来的几年里可能看到的情形。事实上，某些趋势已经开始了。

   测试人员，需求撰写人员和开发人员，都将看到自己是其中的一份子。51Testing软件测试网4r6D4C/W B.{+c

51Testing软件测试网:w7{ReSKa+[Z!U

   测试人员帮助需求撰写人员51Testing软件测试网QS
t(^h

'j
D,S
`J1|&D0   测试人员与需求撰写人员共同工作，在需求完成以后，审查以及理解需求。早期的审查以及建模可以暴露很多关于一致性、完整性和模糊性的BUG，这个时候修补这些BUG付出的代价还十分小。

ks
x-S^f,p0

6ubS5Hg0   需求撰写人员帮助测试人员

   测试小组建造模型，用于产生对其产品行为的测试。需求撰写人员审查模型，以确保他们充分覆盖了产品特征集。这样产生的测试模块将成为一个“可执行需求”。

M\ yMSF051Testing软件测试网}6An*^0bb*cB8b

   测试人员帮助开发人员51Testing软件测试网ac']5`cMC

@1m#YI?%f)A(XRX+a0   因为需求清楚，毫不含糊，开发人员更好的理解了他们的代码将要完成什么。

|Ra5|1d1YC$c0   在正式的将代码提交做测试之前，测试人员提供给开发人员一些模型，以便开发人员可以在自己的代码中实现它们。

E_;y@ AA051Testing软件测试网U$]5U9{'A/LW)v^j

aE+vL;Faq~a*v0   开发人员帮助测试人员

   基于”特征对特征”这样的方式(防止以往的“后期才介入开发,一股脑找出产品问题”的方式),开发人员和测试人员共同保证代码易于实施自动测试.开发人员的代码中处处都是易测试性的开关,使得错误检测更加容易.

%k}~ S'u)D4J&S]\+v G8M0   测试人员帮助测试人员

*?Em]Xj0   测试用一种高级语言来模拟,因此别的特征的测试小组(甚至别的产品的测试小组)可以复查和改进测试模型.这就形成了一个测试专家的共同体.51Testing软件测试网t.Fy`%{

   方法日趋完善

   BUG预防和早期检测

&|/Uxq? q]QF0   因为现在把重点放在产品交付的质量上来了(而不是在于找到了多少BUG), 预防实践和静态分析仪这样的检测工具将成为主流.

51Testing软件测试网'_V{ mO1F Dc

   仿真测试51Testing软件测试网#z/Pky5j)s

   仿真工具变得很普遍,使得仿造计算机环境变得容易起来.在开发过程的早期就可以进行意外和错误流程的测试.代码稳定后,再用真实环境验证仿真是否准确无误.51Testing软件测试网qe^5kU.Q.my

51Testing软件测试网 o.iO9N\C ?G:Jc

   及时的测试用例

   庞大的测试用例管理系统将成为昔日的东西,大量的测试用例生成了却没有被使用.测试用例将不再像腐烂的存货一样被收藏起来,因此,让测试用例保持最新变得容易起来.51Testing软件测试网]*eW,m~\"_

51Testing软件测试网/|7iit+W"Q

   积极的方法51Testing软件测试网\O
Dc\g4M E

   误导人的方法,比如计算BUG的数量、计算测试用例的数量,将不复存在.有用的方法,比如需求覆盖、模型覆盖、代码覆盖将驱动项目开发.

   更少更精的测试人员

   机器将代替测试人员做大部分他们以往创建测试所做的繁琐工作,测试小组需要比以往更少的测试人员,留下来的测试人员将是经过更多高度培训过的.他们所做的工作将更加有趣,因为在测试中他们将致力于更大的问题,而不是在抱怨中艰难地开展工作.51Testing软件测试网?!_Am;W&Ztv

    更多更好的测试

    测试人员将可以在一天中进行成千上万的测试,所以,如何首先运行最有用的测试将成为一大挑战.相关的工具将允许测试人员为他们的测试区分优先级,以及将测试目标放在那些最易出现重大BUG的地方.51Testing软件测试网AaP2|%r+]W(~S

51Testing软件测试网LOf2Y0y,J7F

    测试人员的角色更换51Testing软件测试网)D;zF a!x

+W0^u y ]0

0C*[$i}OZ
L0    测试中界限模糊51Testing软件测试网\y[)c!f8@!r-k

    在测试领域工作使得专职测试的人员和专职创建测试工具的人员界限模糊,一个既是“通过程序破坏事物的测试员”又是”创建程序用于破坏事物的程序员”的专业出现了,――关于如何称呼这个新的专业，新闻圈内的人们还在进行着无休止的争论。51Testing软件测试网5S"R.Jo FKj.b*ed2J
@5e

51Testing软件测试网 T+B${(e:E[1{&N9n8R

%`3S5Jts&k-a[i0    测试与开发界限模糊51Testing软件测试网r"U5T
?H?A

    测试人员与开发人员一前一后，共同创造可测试的、高质量的代码。测试人员帮助开发人员消除需求中的问题，使得开发人员的工作更易完成，同时，开发人员写出更清晰、可测性更高的代码，使得测试人员的工作更易完成。

e1|u:Uv4l%zB x051Testing软件测试网/nH6Q,I$_)AZO6\+W%U

5U!v l,[:w$Dxj&A%n6JY0    顾客反馈与测试合为一体

    交付的产品质量更高。测试人员进行根本原因的分析，我们会问比如“我们怎么会遗漏了这个BUG呢？”或者“我们将来如何防止这类BUG？”这些问题，我们的工作就是使顾客满意。51Testing软件测试网 VA6sTig

9Si;f&L0cW-z$D051Testing软件测试网&p`nJ Z.Y)_

    新的挑战出现51Testing软件测试网H b z!lK1gZ(Q A/Q

    复杂和相互关联的计算机世界使得了测试安全这一类的新问题让测试人员不断努力工作，但这没关系――因为这些挑战使测试人员精力充沛。51Testing软件测试网1~*Cg
V+Z

'N/u |G"HM x.TZ
NS~0

    测试人员获得尊重51Testing软件测试网0k9~ m'nsknZ

ajM0}i ] x0    测试人员将不再是在最后时刻才被叫来“对产品狂轰烂炸”，他们将在整个软件开发过程中提供一个可见的、重要的、增值的服务。人们意识到，测试是有益的、有趣的甚至富有乐趣。

51Testing软件测试网l TD^1}#m

    测试变得流行51Testing软件测试网[1R.H'Aj

Pt+XV8G'Ej0    软件测试人员开始扬眉吐气，而且，由于破坏事物至少可以带来创建事物一样的乐趣，人们开始在开发和测试角色之间转换，所有的人将学到更多关于如何得到良好代码的知识。51Testing软件测试网 |"L)aN1[_*Qj

51Testing软件测试网
jz1h!j+e/UCy

hEawb$X?7S0    激情“吸毒者”继续存在

o4}#GY_c6EC6BR;ZS0    新的过程运行得如此良好，使得需求撰写者，开发人员以及测试人员不再具有生命力，这就使得那些在激情掌控的世界被提升的人惶惶不可终日，那样的世界意味着 工作到深夜、最后一刻测试才参与，以及如同交战开火般的会议。而这些人对于那些还没有受新的运行过程控制的公司来说还具有吸引力。51Testing软件测试网 X)Z ZvN"b^

B~}${v`"\d0

0DK/H c(v0    Elvis Presley是一个软件测试员51Testing软件测试网wv@5Ey+?vCj A

Gl\ J"wG0    他的会议发放材料的标题就是：“软件质量：就是现在，否则永远不可能”51Testing软件测试网'E5M9Jv![|aRF

,C v]hJ| W051Testing软件测试网Z4SMp!@j;}'V ]

2zf\)?1o.?051Testing软件测试网"e h*?eU

4Gnx@ K|0    今天就为将来准备51Testing软件测试网,S/t0s { xqw7c

;ayZ}C$r%CI&U0    不管我的预测是否成为现实，未来也会按照它自己的方式到来，下面就是如何准备面临未来的五个意见：

    1．积极地不满于现状

    不要接受测试的现状，四处看看，并且思考“我们在做些什么毫无意义的事情？”

/J1RFw1j
I'^051Testing软件测试网FNYbn `vkH

    2．抛开人与人之间的封闭

5lZkQSh6|W0    领悟如何更好的测试，并且分享这些知识。只有每一个人都试图使他所写的代码达到最佳状态时，整体质量才会改进。

2in4S5^ m7S7O0

    3．学习更多关于测试的东西51Testing软件测试网)d {H.eNTf,Smnud

r6r@'^[j P0    如今，行业受软件测试的创新思维激发。用参加会议，加入邮件列表，网上冲浪，这些方式来解在测试前沿发生的一切。51Testing软件测试网 ^K:?ZU.Fg+?

2w@/H4d!c(C,\
f0    4．学习更多关于开发的东西51Testing软件测试网r)\'kdc
lB

    参加一个编程学习班，即使你不打算编写大量的代码。将学习班当作是在BUG领土上的一次侦察飞行。51Testing软件测试网1F8S8Z#C5L HRH

z*w(^Qx}S0

2rf5gp` Fb0    5．挑战世界

2mt0b k%` H0    正如PC先驱Alan Kay所言：“预测未来的最好方式就是开创未来”

_A$LU3N.t0C0 51Testing软件测试网1f} r3Rk%W+gv/Q|J;w

&N|:X4W4WY;O0Pl!_0Predicting the Future ofTesting51Testing软件测试网 WU6W#lXo$T

mOC!r_ [)z Y0By Harry Robinson51Testing软件测试网
G0K5Bk~#wU

C.P"wXF{#f0Summary: As the end of the year approaches, psychics and pundits alike will start making their predictions about what's in store for us in 2004 and beyond. In this week's column, industry veteran Harry Robinson gives us his forecast on the future of software testing.51Testing软件测试网"`J^mW,u+n

P$^2~dn0"It is tough to make predictions, especially about the future."—Yogi Berra

[ |!G M%W3`dmg\O0Every December, tabloid fortune-tellers reveal what will happen in the coming year: “Madonna will fly on the space shuttle,” “the U.S. capital will move to Wichita, Kansas” and so forth. I’d like to jump on that bandwagon and make a few predictions of my own about where software testing is going in the next few years. And I can only hope my prophecies fare better than those of my esteemed tabloid colleagues!

My main prediction is that software testing in the future will look very different than it does today. My reasoning is straightforward: Software testing largely stinks today. It comes into a project too late, contributes too little, and costs too much. If we care about the quality of our products and the health of our bottom lines, we need to re-think our approach to testing and quality.

%c Lw%C4j0I will even go out on a limb and say that better methods, better training and a better appreciation for testers will revolutionize the software industry. To be specific, technologies such as executable specifications, model-based test generation, bug prevention, and system simulation will play important roles in the unfolding drama.51Testing软件测试网"[#\:@$lb&w

7\0j$Q6C&b/Q$R8_0Here are some scenes we will see in the industry over the next few years. In fact, some of these trends are starting to emerge already.

Testers, Spec Writers, and Developers See Themselves as Partners51Testing软件测试网%Y}u2PU wO9lE

'`v5g iH'B;WI0Testers Help Spec Writers 

Testers work with spec writers to review and understand the spec as it is being written. Early review and modeling exposes many consistency, completeness, and ambiguity bugs while they are still cheap to fix.51Testing软件测试网'r!_,G&rJ

5jN6l,g,tC z0Spec Writers Help Testers

gnI{
\,i0The test team creates models to generate tests of its applications' behavīors. Spec writers review the models to ensure that they adequately cover the feature set. The resulting test model becomes an "executable spec."51Testing软件测试网f.K&U+T)XJu

Testers Help Developers51Testing软件测试网D}dR-csq&K D

i'D N;PyWyzsS0Because the spec is clean and unambiguous, the developers understand better what their code should accomplish. Testers provide lightweight models that developers can run against their code before they officially hand it over for testing. 

Developers Help Testers51Testing软件测试网XP)A.D+oZ-?#x

Proceeding on a feature-by-feature basis (to avoid the late-in-the-cycle, product-pounding approach of the past), developers and testers ensure that the code is easy to test with automated methods. Developer's code is now full of testability hooks, making errors more detectable.51Testing软件测试网.q vo7gV8QYN:@7I

#xAB-C*K0Testers Help Testers

O
tR(|9i8w5wz0Tests are now modeled in a high-level language, so teams working on other features (and even other products) can help review and improve the test models. This creates a community of test generation experts.51Testing软件测试网T ^JK:u%s
G

]2i o_!m"V{E Bxi0Methods and Metrics Get Better

gLs/\H-o%C(U0Bug Prevention and Early Detection51Testing软件测试网@+l)^&o9Z;Hs$^7F

9J5L6r(q.b$ctm$Q s0Because the emphasis is now on the quality of the deliverable (and not on how many bugs you found along the way), prevention practices and detection tools, such as static analyzers, are mainstream.

xBli-h7z1TYog0Simulation in Testing

Simulation tools become common, making it easy to “fake” computer environments. Testing for exceptions and error paths now happens early in the development process. After the code has stabilized, real environments verify that the simulations were accurate.

Zjg*~q/do n0Just-in-time Test Cases51Testing软件测试网-d2tC/v qYD)oL

Massive test case management systems are a thing of the past. Most tests are generated on the fly. Test cases are no longer stored away like rotting inventory, so it is easy to keep tests up to date. 

Positive Metrics

Misleading metrics, such as bug counts and test case counts, are dead. Useful metrics, such as spec coverage, model coverage, and code coverage, drive the projects.51Testing软件测试网@h'|6RUN im

Fewer Testers, Better Testers51Testing软件测试网:r._(ydO:{

rKH0Q^L;LxQ0Machines now perform much of the mundane work that testers previously did creating tests. Teams require fewer testers, and the testers who remain are more highly trained. Their work is more interesting to them because they are focused on bigger issues in their tests rather than slogging through grunt work.51Testing软件测试网N!o"NLQ m3\D

More Tests, Better Tests

Testers can now generate millions of tests on any day, so the challenge becomes how to run the most useful tests first. Combinatorial tools allow testers to prioritize their testing and aim their test runs at the areas most likely to have significant bugs.51Testing软件测试网"d_ |IC

l['n\\FNit0Roles Will Change for Testers

TT"F#^ To:I \0Distinctions Blur in Testing51Testing软件测试网 ?8ZS&o0uw]

Work in the testing field blurs the line between people who only specialize in hands-on testing and those who only create test tools. A new specialty emerges that encompasses both "testers who like to break things via programs" and "programmers who like to create programs that break things" – people in newsgroups debate endlessly about what to call the new specialty.51Testing软件测试网1j(A4O$J6Q9P*|sh

Boundaries Blur Between Testing and Development

$e`"qQ(`3J/D^-Qq,l0Testers and developers work in tandem to produce testable, high-quality code. Testers help iron out spec issues to make the developer's job easier, and developers create cleaner, more testable code to make the tester's job easier.51Testing软件测试网{8n%O"f$m?

qK3lK4cnN0Feedback from Customers Becomes Integrated with Testing

The quality of deliverables becomes higher. Testers routinely conduct root cause analyses. We ask questions such as "How did we miss this bug?" and "How can we prevent this type of bug in the future?" We work to delight our customers.

New Challenges Emerge

v!o8z
q"G1}0The sophisticated and interconnected environment of the computing world guarantees that new problems such as security testing continue to keep testers running hard. This is OK—testers find these challenges invigorating.51Testing软件测试网,I+\$vTA

Testers Get Respect

Testers are no longer called in at the last moment to "pound on the product." They provide a visible, vital, value-added service throughout the software development process. People realize that testing can be rewarding, interesting, and even fun. 

9uHZ+Fy0Testing Gets Trendy

JP/VV+l5G0Software testers start to hold their heads high. And, because breaking stuff is at least as much fun as building it, people begin to rotate between positions in development and testing. Everyone learns more about what makes good code.

Adrenaline Junkies Move On51Testing软件测试网 SMhYGI6B

The new process works so well that spec writers, developers, and testers end up having lives. This is disconcerting to some who were raised in the adrenaline-charged world of late-night, last-minute, firefighting sessions. These people gravitate to companies that remain out of control.

O s%g8C*k,Q3z0Elvis Presley Is Discovered Working as a Software Tester51Testing软件测试网U
I0O@:?${0x.q

5ta.GC~:E0The giveaway is his conference paper titled “Software Quality: It’s Now or Never”. 51Testing软件测试网m.qQ1H n?

X@`t g[`X}0Prepare for the future today51Testing软件测试网(sVml\OwN

Whether or not my predictions come true, the future is on its way. Here are five ideas for how you can prepare to meet it:51Testing软件测试网B:[:k([)HX k)D"{6s

1. Get Actively Dissatisfied51Testing软件测试网O5UnA[$W.^R9}a{

QjL*a)Ym0Don't accept the current state of testing. Look around and think, "What are we doing that makes no sense?"51Testing软件测试网:lb]w|/\0C

:nd;@1K-{_-T2`02. Push the Envelope

Figure out how to test better and share that knowledge. Overall quality will improve only if everyone seeks to make the code they are working on the best it can be.51Testing软件测试网7G$T1KbrD

TOI'cp9A){&R03. Learn More about Testing51Testing软件测试网6O5t};]g*zl.S Z

`Q0w4?"_:|0At this moment, the industry is exploding with innovative software testing ideas. Go to conferences, join mailing lists, and scour the Web to see what is happening on the cutting edge of testing.51Testing软件测试网1d~&QXN

8Ao2AE1I'x04. Learn More about Development51Testing软件测试网7d:y7E EI!p$i

Take a programming class. Even if you don't plan to write significant amounts of code, view the class as a reconnaissance flight over bug territory.51Testing软件测试网~U)|zd9A)\

5. Change the World!51Testing软件测试网&lT!rt$X[)UPY&bWs

g/gEc:^r*Mml0As PC pioneer Alan Kay said: "The best way to predict the future is to invent it."

For more info:51Testing软件测试网;u8mS"}(Qv e

On executable specs: “Executable Specifications: Creating Testable, Enforceable Designs”51Testing软件测试网am$O1Z*Qm p

*\OSvV6@? S0On model-based testing: “Intelligent Test Automation”

YEN+S%f4g0On system simulation: “Software’s Invisible Users”51Testing软件测试网)sK#s%T:n(k)d}rJL

%_1bue
KB/^ p0About the Author Harry Robinson is Test Architect for Microsoft's Enterprise Management Division. In addition to his day job, he teaches classes on advanced software test automation and is a driving force behind Microsoft's model-based testing initiative. He has been at Microsoft for five years and has a Bachelors and Masters in Electrical Engineering. You can reach him atharryr@microsoft.com.51Testing软件测试网 Yo4k L(\$OR F
V