1. 总体需求
由于性能测试中涉及的查询接口多，版本迭代频繁，版本更新后自动跑一轮查询业务的性能，可以及时发现一些开发修复bug触发的非预期的bug，利用晚上时间快速重测性能接口可以解放人工测试的时间，让测试人员可以把精力集中在测试复杂接口，调优分析性能瓶颈上。
2. 实现流程
自动化的场景模拟真实手工测试，操作步骤和手工测试一样。
3.准备工作
准备软件：
系统环境：CentOS release 6.7 (Final)
内核版本：Linux localhost 2.6.32-573.7.1.el6.x86_64
测试工具：apache-jmeter-2.13 http://jmeter.apache.org/download_jmeter.cgi
运行JDK环境：http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
python环境：Python 2.6.6
服务器监控nmon：http://nmon.sourceforge.net/pmwiki.php?n=Site.Download
4.具体实现
4.1用例执行
Jmeter的执行支持命令行的方式执行，并且会有一个粗略报告，我们取这个报告里面的执行结果并保存下来
Jmeter的执行结果：
root@localhostbin]#./jmeter-n-tsingin.jmx Creatingsummariser<summary> Createdthetreesuccessfullyusingsingin.jmx Startingthetest@MonDec1416:42:33CST2015(1450082553651) Waitingforpossibleshutdownmessageonport4445 summary+1in1s=1.3/sAvg:268Min:268Max:268Err:0(0.00%)Active:1Started:1Finished:0 summary+2in0s=50.0/sAvg:17Min:14Max:20Err:0(0.00%)Active:0Started:1Finished:1 summary=3in1s=3.7/sAvg:100Min:14Max:268Err:0(0.00%) Tidyingup...@MonDec1416:42:34CST2015(1450082554551) ...endofrun |
由sumary统计行可以得到我们需要收集的测试结果：
主流程脚本
#/bin/bash source/etc/profile Jmeter_Home='/usr/local/apache-jmeter-2.13' TestReport='/data/loadtest/report' LogDIR='/data/loadtest/log' Date=`date+"%F"` cd/data/loadtest/ >summary.txt |
#清理上次执行结果
run_test() { #获取测试用例 foriin`find./testcase/-name*.jmx|awk-F'.''{print$2}'` do casename=`echo"$i"|awk-F'/''{print$4}'` >log/${casename}.txt echo-n"$i ">>summary.txt |
#发起监控
ssh10.1.30.54'tail-n300/data/logs/fcuh-user/catalina.out'>${LogDIR}${i}.log done } run_test sleep3 ./monitor.sh>/dev/null2>&1& #开始执行测试 $Jmeter_Home/bin/jmeter-n-t/data/loadtest${i}.jmx>>log/${casename}.txt& sleep310 #如果执行310s还未结束，强制终止执行 ps-ef|grepjava|grep-vgrep|awk'{print$2}'|xargskill-9 sleep3 #提取结果 grep'summary='log/${casename}.txt|tail-1|awk-F'[\t/(]+' '{if($7>10000&&$17<10.00){printf("%s %d %d %d %.2f% pass ",$7,$10,$3,$16,100-$17)}else{printf("%s %d %d %d %.2f%% fail ",$7,$10,$3,$16,100-$17)}}'>>summary.txtcatmonitor.txt>>summary.txt echo''>>summary.txt #获取关键日志 #生成html报告 shgenHTML.sh sleep1 #发送邮件 pythonsendmail.py |
4.2服务器监控
服务器资源收集方面，选用的是nmon监控工具，因为它可以后台收集结果保存到文件。由于每个用例测试5分钟，所以只需要监控300秒，每5s监控一次，对应命令：
nmon-f-t-s5-c60-F/data/test.nmon
测试用例跑完再读取这个结果文件，获取有用的信息
当前只统计了磁盘io和cpu的占用率信息，原始文件保存在本地目录，如果需要，可以手动查看到。
监控脚本：
#!/bin/bash
#读取监控服务器列表
SERVERLIST=`cat serverlist` DATE=`date +'%F'` mkdir -p /data/loadtest/monitor/$DATE TIME=`date +'%T'` |
#发起监控
for i in $SERVERLIST do ssh $i 'nmon -f -t -s5 -c60 -F /data/test.nmon >/dev/null 2>&1 &' done |
#监控5分钟
sleep 303 >monitor.txt |
#收集监控结果，保存到monitor.txt
for i in $SERVERLIST do scp $i:/data/test.nmon /data/loadtest/monitor/$DATE/${i}_${TIME}.nmon io=`cat /data/loadtest/monitor/$DATE/${i}_${TIME}.nmon|grep "DISKBUSY,T" | awk -F ',' '{sum+=$3} END {printf("%.2f%",sum/NR)}'` cpu=`cat /data/loadtest/monitor/$DATE/${i}_${TIME}.nmon|grep "CPU_ALL,T" | awk -F ',' '{sum+=$6} END {printf("%.2f%",100-sum/NR)}'` #net=`cat /data/loadtest/monitor/$DATE/${i}_${TIME}.nmon|grep "NET,T"|awk -F ',' '{sum_r+=$4}{sum_w+=$6} END {print sum_r/NR,sum_w/NR}'` echo -n "${cpu} ${io} ">>monitor.txt done |
将用例执行结果和监控结果都汇总到summary.txt里
生成的格式如下，方便后面生成html格式的报告
[root@localhostloadtest]#catsummary.txt
/testcase/user/获取用户自己的信息
| 10748.6832252960100.00%pass32.87%5.34%81.59%2.12%0.15%1.78%12.13%32.83%17.18%6.14% |
/testcase/user/未读消息数
| 11487.4734469600100.00%pass32.33%12.57%69.02%1.86%0.18%1.74%13.55%35.85%18.56%7.65% |
服务器监控脚本
#!/bin/bash SERVERLIST=`cat serverlist` DATE=`date +'%F'` mkdir -p /data/loadtest/monitor/$DATE TIME=`date +'%T'` for i in $SERVERLIST do ssh $i 'nmon -f -t -s5 -c60 -F /data/test.nmon >/dev/null 2>&1 &' done sleep 303 >monitor.txt for i in $SERVERLIST do io=`cat /data/loadtest/monitor/$DATE/${i}_${TIME}.nmon|grep "DISKBUSY,T" | awk -F ',' '{sum+=$3} END {printf("%.2f%",sum/NR)}'` cpu=`cat /data/loadtest/monitor/$DATE/${i}_${TIME}.nmon|grep "CPU_ALL,T" | awk -F ',' '{sum+=$6} END {printf("%.2f%",100-sum/NR)}'` echo -n "${cpu} ${io} ">>monitor.txt done |
4.3生成html报告
#!/bin/sh >index.html |
echo "用户端自动化性能测试报告">>index.html
echo `cat style.css`>>index.html ( cat < function show_detail(detail){ if(detail.style.display=="none"){ detail.style.display=""; } else{ detail.style.display="none"; } } EOF )>>index.html echo " |
用户端自动化性能测试报告
">>index.html sum=`cat summary.txt | wc -l` sucess=`cat summary.txt|grep pass |grep -v grep|wc -l` fail=`expr $sum - $sucess` rate=`echo "$sucess $sum"|awk '{printf("%.2f%%",$1/$2*100)}'` ( cat < |
结果汇总
总接口数成功接口数失败接口数测试通过率
$sum$sucess$fail$rate EOF )>>index.html ( cat < |
概要结果
测试接口每秒请求数(tps)平均响应时间(ms)总事务数失败事务数事务成功率测试结果
EOF )>>index.html cat summary.txt |while read line do echo $line | awk '{if($7=="pass"){print ""$1""$2""$3""$4""$5""$6""$7""}else{print ""$1""$2""$3""$4""$5""$6""$7""}}'>>index.html done echo "">>index.html |
echo "测试结果pass标准：tps>10000且事务成功率>90%
详细结果查看附件
">>index.html #echo " ">>index.html ( cat < |
测试接口每秒请求数tps平均响应时间(ms)总事务数失败事务数成功率测试结果nginx服务器cpunginx服务器ioweb服务器cpuweb服务器ioservice服务器cpuservice服务器io主数据库服务器cpu主数据库服务器io从数据库服务器cpu从数据库服务器io
EOF )>>index.html j=1 for i in `cat summary.txt` do if [ `expr $j % 17 ` != 0 ]; then echo ''$i''>>index.html else echo ''$i''>>index.html fi j=`expr $j + 1` done echo "">>index.html html样式表 <styletype="text/css"> body{ font:normal68%verdana,arial,helvetica; color:#000000; } tabletrtd,tabletrth{ font-size:78%; } table.detailstrth{ color:#ffffff; font-weight:bold; text-align:center; background:#2674a6; white-space:nowrap; } table.detailstrtd{ background:#eeeee0; white-space:nowrap; } h1{ margin:0px0px5px;font:265%verdana,arial,helvetica } h2{ margin-top:1em;margin-bottom:0.5em;font:bold185%verdana,arial,helvetica } h3{ margin-bottom:0.5em;font:bold115%verdana,arial,helvetica } Failure{ font-weight:bold;color:red; } .Pass{ font-weight:bold;color:green; } </style> |
4.4发送测试结果邮件
发邮件脚本
#!/usr/bin/env python #coding: utf-8 import string import smtplib import os import datetime from email.mime.multipart import MIMEMultipart from email.mime.text import MIMEText from email.mime.base import MIMEBase from email.header import Header today = datetime.date.today() sender = 'xx@xx.com' receiverlist = ["a@a.com","b@b.com","c@c.com"] subject = '%s %s' % ('用户端自动化性能测试报告',today) smtpserver = 'smtp.exmail.qq.com' username = 'xx@xx.com' password = 'xxx' f = open('index.html',"r") content = f.read() #msg = MIMEText(content,'html','utf-8') msg = MIMEMultipart() msg.attach(MIMEText(content,'html','utf-8')) msg['From'] = 'xx@xx.com' msg['to'] = ','.join(receiverlist) msg['Subject'] = subject att=MIMEText(open('index.html','rb').read(),'base64','gb2312') att["Conten-Type"]='application/octet-stream' att["Content-Disposition"]='attachment;filename="Load test result.html"' msg.attach(att) smtp = smtplib.SMTP() smtp.connect(smtpserver) smtp.ehlo() smtp.starttls() smtp.ehlo() #smtp.set_debuglevel(1) smtp.login(username, password) smtp.sendmail(msg['From'],msg['to'],msg.as_string()) smtp.quit() |
测试结果截图：
上文内容不用于商业目的，如涉及知识产权问题，请权利人联系博为峰小编(021-64471599-8017)，我们将立即处理。
