发布新日志

  • jedispool 连 redis 高并发卡死

    2018-02-11 16:12:06

    https://www.2cto.com/kf/201504/395403.html


    java端在使用jedispool 连接redis的时候,在高并发的时候经常卡死,或报连接异常,JedisConnectionException,或者getResource 异常等各种问题

    在使用jedispool 的时候一定要注意两点

    1。 在获取 jedisPool和jedis的时候加上线程同步,保证不要创建过多的jedispool 和 jedis

    2。 用完Jedis实例后需要返还给JedisPool

    整理了一下redis工具类,通过大量测试和高并发测试的

    package com.caspar.util;
     
    import org.apache.log4j.Logger;
     
    import redis.clients.jedis.Jedis;
    import redis.clients.jedis.JedisPool;
    import redis.clients.jedis.JedisPoolConfig;
     
    /**
     * Redis 工具类
     * @author caspar
     */
    public class RedisUtil {
         
        protected static Logger logger = Logger.getLogger(RedisUtil.class);
         
        //Redis服务器IP
        private static String ADDR_ARRAY = FileUtil.getPropertyValue("/properties/redis.properties", "server");
         
        //Redis的端口号
        private static int PORT = FileUtil.getPropertyValueInt("/properties/redis.properties", "port");
         
        //访问密码
    //    private static String AUTH = FileUtil.getPropertyValue("/properties/redis.properties", "auth");
         
        //可用连接实例的最大数目,默认值为8;
        //如果赋值为-1,则表示不限制;如果pool已经分配了maxActive个jedis实例,则此时pool的状态为exhausted(耗尽)。
        private static int MAX_ACTIVE = FileUtil.getPropertyValueInt("/properties/redis.properties", "max_active");;
         
        //控制一个pool最多有多少个状态为idle(空闲的)的jedis实例,默认值也是8。
        private static int MAX_IDLE = FileUtil.getPropertyValueInt("/properties/redis.properties", "max_idle");;
         
        //等待可用连接的最大时间,单位毫秒,默认值为-1,表示永不超时。如果超过等待时间,则直接抛出JedisConnectionException;
        private static int MAX_WAIT = FileUtil.getPropertyValueInt("/properties/redis.properties", "max_wait");;
     
        //超时时间
        private static int TIMEOUT = FileUtil.getPropertyValueInt("/properties/redis.properties", "timeout");;
         
        //在borrow一个jedis实例时,是否提前进行validate操作;如果为true,则得到的jedis实例均是可用的;
        private static boolean TEST_ON_BORROW = FileUtil.getPropertyValueBoolean("/properties/redis.properties", "test_on_borrow");;
         
        private static JedisPool jedisPool = null;
         
        /**
         * redis过期时间,以秒为单位
         */
        public final static int EXRP_HOUR = 60*60;          //一小时
        public final static int EXRP_DAY = 60*60*24;        //一天
        public final static int EXRP_MONTH = 60*60*24*30;   //一个月
         
        /**
         * 初始化Redis连接池
         */
        private static void initialPool(){
            try {
                JedisPoolConfig config = new JedisPoolConfig();
                config.setMaxTotal(MAX_ACTIVE);
                config.setMaxIdle(MAX_IDLE);
                config.setMaxWaitMillis(MAX_WAIT);
                config.setTestOnBorrow(TEST_ON_BORROW);
                jedisPool = new JedisPool(config, ADDR_ARRAY.split(",")[0], PORT, TIMEOUT);
            } catch (Exception e) {
                logger.error("First create JedisPool error : "+e);
                try{
                    //如果第一个IP异常,则访问第二个IP
                    JedisPoolConfig config = new JedisPoolConfig();
                    config.setMaxTotal(MAX_ACTIVE);
                    config.setMaxIdle(MAX_IDLE);
                    config.setMaxWaitMillis(MAX_WAIT);
                    config.setTestOnBorrow(TEST_ON_BORROW);
                    jedisPool = new JedisPool(config, ADDR_ARRAY.split(",")[1], PORT, TIMEOUT);
                }catch(Exception e2){
                    logger.error("Second create JedisPool error : "+e2);
                }
            }
        }
         
         
        /**
         * 在多线程环境同步初始化
         */
        private static synchronized void poolInit() {
            if (jedisPool == null) { 
                initialPool();
            }
        }
     
         
        /**
         * 同步获取Jedis实例
         * @return Jedis
         */
        public synchronized static Jedis getJedis() { 
            if (jedisPool == null) { 
                poolInit();
            }
            Jedis jedis = null;
            try
                if (jedisPool != null) { 
                    jedis = jedisPool.getResource();
                }
            } catch (Exception e) { 
                logger.error("Get jedis error : "+e);
            }finally{
                returnResource(jedis);
            }
            return jedis;
        
         
         
        /**
         * 释放jedis资源
         * @param jedis
         */
        public static void returnResource(final Jedis jedis) {
            if (jedis != null && jedisPool !=null) {
                jedisPool.returnResource(jedis);
            }
        }
         
         
        /**
         * 设置 String
         * @param key
         * @param value
         */
        public static void setString(String key ,String value){
            try {
                value = StringUtil.isEmpty(value) ? "" : value;
                getJedis().set(key,value);
            } catch (Exception e) {
                logger.error("Set key error : "+e);
            }
        }
         
        /**
         * 设置 过期时间
         * @param key
         * @param seconds 以秒为单位
         * @param value
         */
        public static void setString(String key ,int seconds,String value){
            try {
                value = StringUtil.isEmpty(value) ? "" : value;
                getJedis().setex(key, seconds, value);
            } catch (Exception e) {
                logger.error("Set keyex error : "+e);
            }
        }
         
        /**
         * 获取String值
         * @param key
         * @return value
         */
        public static String getString(String key){
            if(getJedis() == null || !getJedis().exists(key)){
                return null;
            }
            return getJedis().get(key);
        }
         
    }


  • Ant将Jmeter的jtl文件转为html文件报“前言中不允许有内容”

    2018-02-07 09:58:49

    1. 在JMeter的bin目录中找到jmeter.properties;
    2. 将文件中#jmeter.save.saveservice.output_format=csv改为jmeter.save.saveservice.output_format=xml
      注意:去掉前面的#号,后面的xml要小写
  • Jmeter Random Variable配置项可以为每个线程生成随机变量

    2018-02-05 11:35:44

    配置元件Random Variable可以配置生成随机数,自定义输出格式,最大最小值,以及是否为每个线程单独生成:

    复制代码
    Variable Name:     uuid
    Output Format:     12345678-1234-4444-a123-000000000000
    Minimum Value:     111111111111
    Maximum Value:     999999999999
    Seed for Random function:${__Random(1,10,)} //如果指定为一个固定值,则每次迭代,各个线程得到的随机值都会相同
    Per Thread (User): True  //每个线程生成一个随机数
    复制代码
    复制代码
    iteration: 1
        thread: 1
            sampler 1: VALUE_1-1
            sampler 2: VALUE_1-1
            ...
        thread: 2
            sampler 1: VALUE_2-1
            sampler 2: VALUE_2-1
            ...
        ...
    iteration: 2
        thread: 1
            sampler 1: VALUE_1-2
            sampler 2: VALUE_1-2
            ...
        thread: 2
            sampler 1: VALUE_2-2
            sampler 2: VALUE_2-2
            ...
        ...
    复制代码
  • (JMeter/Ant/Jenkins)自动化接口测试的部署 及 部署过程中的坑

    2018-02-01 10:43:07

Open Toolbar