RocksDB存储引擎测试

一:安装搭建(两个节点都要安装)

 1 yum install http://www.percona.com/downloads/percona-release/redhat/0.1-4/percona-release-0.1-4.noarch.rpm
 2
 3 percona-release-1.0-11.noarch
 4
 5 yum update percona-release
 6
 7 yum install Percona-Server-rocksdb-57.x86_64
 8
 9 service mysqld start
10
11 cat /var/log/mysqld.log | grep "A temporary password" | awk -F " " ‘{print$11}‘
12
13 mysql -uroot -p
14
15 alter user ‘root‘@‘localhost‘ identified by ‘rooT_258‘;

二:my.cnf配置(两个节点都要安装)

 1 server-id = 189
 2
 3 #Binary Logging.
 4 log-bin=mysql-bin
 5 binlog-format=row
 6
 7 #Gtid Mode
 8 gtid-mode=ON
 9 enforce-gtid-consistency
10
11 default-storage-engine=INNODB
12
13 default-storage-engine=ROCKSDB

三:安装插件(两个节点都要安装)

 1 # ps-admin --enable-rocksdb -u root -prooT_258 -P 3306 -h 192.168.202.189
 2
 3 [[email protected] ~]# ps-admin --enable-rocksdb -u root -prooT_258 -P 3306 -h 192.168.202.189
 4 Checking if RocksDB plugin is available for installation ...
 5 INFO: ha_rocksdb.so library for RocksDB found at /usr/lib64/mysql/plugin/ha_rocksdb.so.
 6
 7 Checking RocksDB engine plugin status...
 8 INFO: RocksDB engine plugin is not installed.
 9
10 Installing RocksDB engine...
11 INFO: Successfully installed RocksDB engine plugin.

四:主从搭建

1 GRANT REPLICATION SLAVE ON *.* TO ‘repl‘@‘192.168.202.190‘ IDENTIFIED BY ‘rooT_258‘;
2 CHANGE MASTER TO MASTER_HOST=‘192.168.202.189‘, MASTER_USER=‘repl‘, MASTER_PASSWORD=‘rooT_258‘, master_auto_position=1;

五:sysbench安装

 1 cd /usr/local/src
 2 wget https://codeload.github.com/akopytov/sysbench/tar.gz/1.0.17
 3 mv /usr/local/src/1.0.17 /usr/local/src/sysbench-1.0.17.tar.gz
 4 tar -xzvf /usr/local/src/sysbench-1.0.17.tar.gz -C /usr/local/
 5
 6 cd /usr/local/sysbench-1.0.17
 7
 8 yum -y install make automake libtool pkgconfig libaio-devel
 9 yum -y install Percona-Server-devel-57.x86_64 openssl-devel
10
11
12 ##Build and Install
13 ./autogen.sh
14 # Add --with-pgsql to build with PostgreSQL support
15 ./configure
16 make -j
17 make install
18
19 sysbench --version

六:sysbench测试

准备数据:

sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua \
--mysql-host=localhost \
--mysql-port=3306 \
--mysql-user=root \
--mysql-password=rooT_258 \
--mysql-db=tt \
--oltp-tables-count=10 \
--oltp-table-size=1000000 \
--oltp-dist-type=uniform \
--oltp-read-only=off \
--oltp-test-mode=complex \
--rand-init=on \
--db-driver=mysql \
prepare

sysbench --test=/usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua \
--mysql-db=sbtest \
--oltp-tables-count=10 \
--oltp-table-size=1000000 \
--oltp-read-only=off \
--init-rng=on \
--num-threads=16 \
--max-requests=0 \
--oltp-dist-type=uniform \
--max-time=1800 \
--mysql-user=root \
--mysql-socket=/var/lib/mysql/mysql.sock \
--mysql-password=rooT_258 \
--db-driver=mysql \
--mysql-table-engine=rocksdb \
--oltp-test-mode=complex \
prepare

Innodb读写测试

 1 [[email protected] sysbench-1.0.17]# sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua  2 > --mysql-host=localhost  3 > --mysql-port=3306  4 > --mysql-user=root  5 > --mysql-password=rooT_258  6 > --mysql-db=tt  7 > --oltp-tables-count=10  8 > --oltp-table-size=10000000  9 > --oltp-dist-type=uniform 10 > --oltp-read-only=off 11 > --oltp-test-mode=complex 12 > --rand-init=on 13 > --db-driver=mysql 14 > --report-interval=10 15 > --threads=16 16 > --time=120 17 > run
18 sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
19
20 Running the test with following options:
21 Number of threads: 16
22 Report intermediate results every 10 second(s)
23 Initializing random number generator from current time
24
25
26 Initializing worker threads...
27
28 Threads started!
29
30 [ 10s ] thds: 16 tps: 343.03 qps: 6959.41 (r/w/o: 4878.02/345.83/1735.55) lat (ms,95%): 101.13 err/s: 3.80 reconn/s: 0.00
31 [ 20s ] thds: 16 tps: 355.71 qps: 7110.18 (r/w/o: 4978.39/359.01/1772.77) lat (ms,95%): 94.10 err/s: 0.20 reconn/s: 0.00
32 [ 30s ] thds: 16 tps: 419.20 qps: 8377.29 (r/w/o: 5863.30/428.40/2085.60) lat (ms,95%): 58.92 err/s: 0.00 reconn/s: 0.00
33 [ 40s ] thds: 16 tps: 416.99 qps: 8346.96 (r/w/o: 5843.30/429.49/2074.17) lat (ms,95%): 57.87 err/s: 0.10 reconn/s: 0.00
34 [ 50s ] thds: 16 tps: 368.01 qps: 7371.01 (r/w/o: 5159.38/383.60/1828.03) lat (ms,95%): 73.13 err/s: 0.10 reconn/s: 0.00
35 [ 60s ] thds: 16 tps: 394.21 qps: 7875.75 (r/w/o: 5512.58/414.42/1948.76) lat (ms,95%): 70.55 err/s: 0.00 reconn/s: 0.00
36 [ 70s ] thds: 16 tps: 406.79 qps: 8139.10 (r/w/o: 5699.26/427.48/2012.36) lat (ms,95%): 63.32 err/s: 0.10 reconn/s: 0.00
37 [ 80s ] thds: 16 tps: 405.22 qps: 8098.23 (r/w/o: 5670.00/431.43/1996.80) lat (ms,95%): 69.29 err/s: 0.00 reconn/s: 0.00
38 [ 90s ] thds: 16 tps: 406.39 qps: 8136.07 (r/w/o: 5694.94/437.29/2003.84) lat (ms,95%): 55.82 err/s: 0.10 reconn/s: 0.00
39 [ 100s ] thds: 16 tps: 405.39 qps: 8105.84 (r/w/o: 5675.19/438.59/1992.06) lat (ms,95%): 57.87 err/s: 0.00 reconn/s: 0.00
40 [ 110s ] thds: 16 tps: 421.30 qps: 8429.48 (r/w/o: 5899.49/460.40/2069.59) lat (ms,95%): 53.85 err/s: 0.10 reconn/s: 0.00
41 [ 120s ] thds: 16 tps: 418.51 qps: 8367.62 (r/w/o: 5858.55/463.61/2045.45) lat (ms,95%): 53.85 err/s: 0.00 reconn/s: 0.00
42 SQL statistics:
43     queries performed:
44         read:                            667380
45         write:                           50214
46         other:                           235716
47         total:                           953310
48     transactions:                        47625  (396.78 per sec.)
49     queries:                             953310 (7942.43 per sec.)
50     ignored errors:                      45     (0.37 per sec.)
51     reconnects:                          0      (0.00 per sec.)
52
53 General statistics:
54     total time:                          120.0261s
55     total number of events:              47625
56
57 Latency (ms):
58          min:                                    4.10
59          avg:                                   40.32
60          max:                                  970.72
61          95th percentile:                       63.32
62          sum:                              1920083.95
63
64 Threads fairness:
65     events (avg/stddev):           2976.5625/17.56
66     execution time (avg/stddev):   120.0052/0.00

Innodb只读测试

 1 [[email protected] sysbench-1.0.17]# sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua  2 > --mysql-host=localhost  3 > --mysql-port=3306  4 > --mysql-user=root  5 > --mysql-password=rooT_258  6 > --mysql-db=tt  7 > --oltp-tables-count=10  8 > --oltp-table-size=10000000  9 > --oltp-dist-type=uniform 10 > --oltp-read-only=on 11 > --oltp-test-mode=nontrx  12 > --oltp-nontrx-mode=select 13 > --rand-init=on 14 > --db-driver=mysql 15 > --report-interval=10 16 > --threads=16 17 > --time=120 18 > run
19 sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
20
21 Running the test with following options:
22 Number of threads: 16
23 Report intermediate results every 10 second(s)
24 Initializing random number generator from current time
25
26
27 Initializing worker threads...
28
29 Threads started!
30
31 [ 10s ] thds: 16 tps: 744.45 qps: 11923.36 (r/w/o: 10432.95/0.00/1490.41) lat (ms,95%): 26.68 err/s: 0.00 reconn/s: 0.00
32 [ 20s ] thds: 16 tps: 739.11 qps: 11827.06 (r/w/o: 10348.74/0.00/1478.32) lat (ms,95%): 26.68 err/s: 0.00 reconn/s: 0.00
33 [ 30s ] thds: 16 tps: 751.78 qps: 12027.51 (r/w/o: 10524.04/0.00/1503.46) lat (ms,95%): 25.74 err/s: 0.00 reconn/s: 0.00
34 [ 40s ] thds: 16 tps: 753.45 qps: 12060.75 (r/w/o: 10553.76/0.00/1506.99) lat (ms,95%): 26.68 err/s: 0.00 reconn/s: 0.00
35 [ 50s ] thds: 16 tps: 781.27 qps: 12501.24 (r/w/o: 10938.81/0.00/1562.43) lat (ms,95%): 24.38 err/s: 0.00 reconn/s: 0.00
36 [ 60s ] thds: 16 tps: 787.14 qps: 12590.15 (r/w/o: 11015.77/0.00/1574.38) lat (ms,95%): 24.38 err/s: 0.00 reconn/s: 0.00
37 [ 70s ] thds: 16 tps: 771.21 qps: 12335.20 (r/w/o: 10792.89/0.00/1542.31) lat (ms,95%): 25.28 err/s: 0.00 reconn/s: 0.00
38 [ 80s ] thds: 16 tps: 761.03 qps: 12180.13 (r/w/o: 10657.97/0.00/1522.15) lat (ms,95%): 24.83 err/s: 0.00 reconn/s: 0.00
39 [ 90s ] thds: 16 tps: 787.41 qps: 12597.36 (r/w/o: 11022.54/0.00/1574.82) lat (ms,95%): 24.38 err/s: 0.00 reconn/s: 0.00
40 [ 100s ] thds: 16 tps: 768.70 qps: 12301.62 (r/w/o: 10764.22/0.00/1537.40) lat (ms,95%): 25.28 err/s: 0.00 reconn/s: 0.00
41 [ 110s ] thds: 16 tps: 783.80 qps: 12536.26 (r/w/o: 10968.65/0.00/1567.61) lat (ms,95%): 24.38 err/s: 0.00 reconn/s: 0.00
42 [ 120s ] thds: 16 tps: 781.75 qps: 12509.80 (r/w/o: 10946.30/0.00/1563.50) lat (ms,95%): 24.83 err/s: 0.00 reconn/s: 0.00
43 SQL statistics:
44     queries performed:
45         read:                            1289792
46         write:                           0
47         other:                           184256
48         total:                           1474048
49     transactions:                        92128  (767.60 per sec.)
50     queries:                             1474048 (12281.53 per sec.)
51     ignored errors:                      0      (0.00 per sec.)
52     reconnects:                          0      (0.00 per sec.)
53
54 General statistics:
55     total time:                          120.0202s
56     total number of events:              92128
57
58 Latency (ms):
59          min:                                    1.03
60          avg:                                   20.84
61          max:                                 3263.49
62          95th percentile:                       25.28
63          sum:                              1919661.87
64
65 Threads fairness:
66     events (avg/stddev):           5758.0000/427.33
67     execution time (avg/stddev):   119.9789/0.01

rocksdb读写测试

 1 [[email protected] sysbench-1.0.17]# sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua  2 > --mysql-host=localhost  3 > --mysql-port=3306  4 > --mysql-user=root  5 > --mysql-password=rooT_258  6 > --mysql-db=sbtest  7 > --oltp-tables-count=10  8 > --oltp-table-size=10000000  9 > --oltp-dist-type=uniform 10 > --oltp-read-only=off 11 > --oltp-test-mode=complex 12 > --rand-init=on 13 > --db-driver=mysql 14 > --report-interval=10 15 > --threads=16 16 > --time=120 17 > run
18 sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
19
20 Running the test with following options:
21 Number of threads: 16
22 Report intermediate results every 10 second(s)
23 Initializing random number generator from current time
24
25
26 Initializing worker threads...
27
28 Threads started!
29
30 [ 10s ] thds: 16 tps: 306.75 qps: 6154.40 (r/w/o: 4311.00/308.15/1535.25) lat (ms,95%): 78.60 err/s: 0.00 reconn/s: 0.00
31 [ 20s ] thds: 16 tps: 319.19 qps: 6392.81 (r/w/o: 4473.17/325.29/1594.35) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00
32 [ 30s ] thds: 16 tps: 316.99 qps: 6333.45 (r/w/o: 4436.32/321.99/1575.14) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00
33 [ 40s ] thds: 16 tps: 324.53 qps: 6488.83 (r/w/o: 4540.17/332.63/1616.03) lat (ms,95%): 69.29 err/s: 0.10 reconn/s: 0.00
34 [ 50s ] thds: 16 tps: 321.39 qps: 6435.15 (r/w/o: 4505.53/333.69/1595.94) lat (ms,95%): 75.82 err/s: 0.00 reconn/s: 0.00
35 [ 60s ] thds: 16 tps: 306.11 qps: 6110.35 (r/w/o: 4276.00/319.11/1515.24) lat (ms,95%): 81.48 err/s: 0.00 reconn/s: 0.00
36 [ 70s ] thds: 16 tps: 320.90 qps: 6423.65 (r/w/o: 4496.83/337.10/1589.71) lat (ms,95%): 71.83 err/s: 0.00 reconn/s: 0.00
37 [ 80s ] thds: 16 tps: 298.00 qps: 5965.01 (r/w/o: 4177.04/314.40/1473.58) lat (ms,95%): 84.47 err/s: 0.10 reconn/s: 0.00
38 [ 90s ] thds: 16 tps: 308.90 qps: 6172.84 (r/w/o: 4319.96/326.00/1526.88) lat (ms,95%): 78.60 err/s: 0.00 reconn/s: 0.00
39 [ 100s ] thds: 16 tps: 314.10 qps: 6286.15 (r/w/o: 4402.14/337.00/1547.01) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00
40 [ 110s ] thds: 16 tps: 320.60 qps: 6404.45 (r/w/o: 4481.94/345.00/1577.51) lat (ms,95%): 70.55 err/s: 0.00 reconn/s: 0.00
41 [ 120s ] thds: 16 tps: 313.70 qps: 6289.50 (r/w/o: 4401.27/342.61/1545.62) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00
42 SQL statistics:
43     queries performed:
44         read:                            528220
45         write:                           39430
46         other:                           186941
47         total:                           754591
48     transactions:                        37728  (314.36 per sec.)
49     queries:                             754591 (6287.44 per sec.)
50     ignored errors:                      2      (0.02 per sec.)
51     reconnects:                          0      (0.00 per sec.)
52
53 General statistics:
54     total time:                          120.0142s
55     total number of events:              37728
56
57 Latency (ms):
58          min:                                    6.91
59          avg:                                   50.89
60          max:                                  541.98
61          95th percentile:                       74.46
62          sum:                              1919973.66
63
64 Threads fairness:
65     events (avg/stddev):           2358.0000/62.04
66     execution time (avg/stddev):   119.9984/0.00

rocksdb只读测试

 1 [[email protected] sysbench-1.0.17]# sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua  2 > --mysql-host=localhost  3 > --mysql-port=3306  4 > --mysql-user=root  5 > --mysql-password=rooT_258  6 > --mysql-db=sbtest  7 > --oltp-tables-count=10  8 > --oltp-table-size=10000000  9 > --oltp-dist-type=uniform 10 > --oltp-read-only=on 11 > --oltp-test-mode=nontrx  12 > --oltp-nontrx-mode=select 13 > --rand-init=on 14 > --db-driver=mysql 15 > --report-interval=10 16 > --threads=16 17 > --time=120 18 > run
19 sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
20
21 Running the test with following options:
22 Number of threads: 16
23 Report intermediate results every 10 second(s)
24 Initializing random number generator from current time
25
26
27 Initializing worker threads...
28
29 Threads started!
30
31 [ 10s ] thds: 16 tps: 496.85 qps: 7967.30 (r/w/o: 6972.01/0.00/995.29) lat (ms,95%): 41.10 err/s: 0.00 reconn/s: 0.00
32 [ 20s ] thds: 16 tps: 486.83 qps: 7788.72 (r/w/o: 6815.05/0.00/973.66) lat (ms,95%): 42.61 err/s: 0.00 reconn/s: 0.00
33 [ 30s ] thds: 16 tps: 491.92 qps: 7864.35 (r/w/o: 6880.51/0.00/983.84) lat (ms,95%): 41.85 err/s: 0.00 reconn/s: 0.00
34 [ 40s ] thds: 16 tps: 480.90 qps: 7702.69 (r/w/o: 6740.99/0.00/961.70) lat (ms,95%): 43.39 err/s: 0.00 reconn/s: 0.00
35 [ 50s ] thds: 16 tps: 492.40 qps: 7873.26 (r/w/o: 6888.37/0.00/984.90) lat (ms,95%): 41.85 err/s: 0.00 reconn/s: 0.00
36 [ 60s ] thds: 16 tps: 491.01 qps: 7858.11 (r/w/o: 6876.20/0.00/981.91) lat (ms,95%): 42.61 err/s: 0.00 reconn/s: 0.00
37 [ 70s ] thds: 16 tps: 507.61 qps: 8120.91 (r/w/o: 7105.80/0.00/1015.11) lat (ms,95%): 38.94 err/s: 0.00 reconn/s: 0.00
38 [ 80s ] thds: 16 tps: 492.30 qps: 7875.69 (r/w/o: 6890.99/0.00/984.70) lat (ms,95%): 41.10 err/s: 0.00 reconn/s: 0.00
39 [ 90s ] thds: 16 tps: 497.10 qps: 7952.73 (r/w/o: 6958.42/0.00/994.30) lat (ms,95%): 40.37 err/s: 0.00 reconn/s: 0.00
40 [ 100s ] thds: 16 tps: 503.09 qps: 8046.67 (r/w/o: 7040.50/0.00/1006.17) lat (ms,95%): 39.65 err/s: 0.00 reconn/s: 0.00
41 [ 110s ] thds: 16 tps: 433.50 qps: 6941.71 (r/w/o: 6074.71/0.00/867.00) lat (ms,95%): 55.82 err/s: 0.00 reconn/s: 0.00
42 [ 120s ] thds: 16 tps: 370.69 qps: 5930.89 (r/w/o: 5189.80/0.00/741.09) lat (ms,95%): 80.03 err/s: 0.00 reconn/s: 0.00
43 SQL statistics:
44     queries performed:
45         read:                            804454
46         write:                           0
47         other:                           114922
48         total:                           919376
49     transactions:                        57461  (478.73 per sec.)
50     queries:                             919376 (7659.72 per sec.)
51     ignored errors:                      0      (0.00 per sec.)
52     reconnects:                          0      (0.00 per sec.)
53
54 General statistics:
55     total time:                          120.0260s
56     total number of events:              57461
57
58 Latency (ms):
59          min:                                    2.97
60          avg:                                   33.41
61          max:                                  484.33
62          95th percentile:                       44.98
63          sum:                              1919958.53
64
65 Threads fairness:
66     events (avg/stddev):           3591.3125/134.95
67     execution time (avg/stddev):   119.9974/0.01

innodb压缩读写测试

 1 [[email protected] sysbench-1.0.17]# sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua  2 > --mysql-host=localhost  3 > --mysql-port=3306  4 > --mysql-user=root  5 > --mysql-password=rooT_258  6 > --mysql-db=tt  7 > --oltp-tables-count=10  8 > --oltp-table-size=10000000  9 > --oltp-dist-type=uniform 10 > --oltp-read-only=off 11 > --oltp-test-mode=complex 12 > --rand-init=on 13 > --db-driver=mysql 14 > --report-interval=10 15 > --threads=16 16 > --time=120 17 > run
18 sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
19
20 Running the test with following options:
21 Number of threads: 16
22 Report intermediate results every 10 second(s)
23 Initializing random number generator from current time
24
25
26 Initializing worker threads...
27
28 Threads started!
29
30 [ 10s ] thds: 16 tps: 255.24 qps: 5128.94 (r/w/o: 3593.68/286.50/1248.76) lat (ms,95%): 170.48 err/s: 0.10 reconn/s: 0.00
31 [ 20s ] thds: 16 tps: 344.91 qps: 6898.00 (r/w/o: 4828.47/382.51/1687.03) lat (ms,95%): 97.55 err/s: 0.00 reconn/s: 0.00
32 [ 30s ] thds: 16 tps: 368.50 qps: 7369.58 (r/w/o: 5159.16/413.30/1797.12) lat (ms,95%): 71.83 err/s: 0.00 reconn/s: 0.00
33 [ 40s ] thds: 16 tps: 390.00 qps: 7801.68 (r/w/o: 5459.98/442.40/1899.29) lat (ms,95%): 62.19 err/s: 0.00 reconn/s: 0.00
34 [ 50s ] thds: 16 tps: 367.00 qps: 7341.67 (r/w/o: 5138.88/422.10/1780.69) lat (ms,95%): 63.32 err/s: 0.00 reconn/s: 0.00
35 [ 60s ] thds: 16 tps: 376.29 qps: 7524.41 (r/w/o: 5267.66/430.39/1826.35) lat (ms,95%): 64.47 err/s: 0.00 reconn/s: 0.00
36 [ 70s ] thds: 16 tps: 366.12 qps: 7329.02 (r/w/o: 5128.72/422.52/1777.78) lat (ms,95%): 68.05 err/s: 0.00 reconn/s: 0.00
37 [ 80s ] thds: 16 tps: 358.79 qps: 7169.39 (r/w/o: 5019.82/422.19/1727.37) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00
38 [ 90s ] thds: 16 tps: 378.09 qps: 7562.00 (r/w/o: 5293.86/444.39/1823.75) lat (ms,95%): 61.08 err/s: 0.00 reconn/s: 0.00
39 [ 100s ] thds: 16 tps: 322.91 qps: 6459.89 (r/w/o: 4521.60/384.42/1553.87) lat (ms,95%): 81.48 err/s: 0.00 reconn/s: 0.00
40 [ 110s ] thds: 16 tps: 264.69 qps: 5295.37 (r/w/o: 3706.31/314.99/1274.07) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
41 [ 120s ] thds: 16 tps: 166.48 qps: 3332.88 (r/w/o: 2332.08/197.88/802.92) lat (ms,95%): 277.21 err/s: 0.00 reconn/s: 0.00
42 SQL statistics:
43     queries performed:
44         read:                            554554
45         write:                           45640
46         other:                           192024
47         total:                           792218
48     transactions:                        39610  (328.39 per sec.)
49     queries:                             792218 (6567.99 per sec.)
50     ignored errors:                      1      (0.01 per sec.)
51     reconnects:                          0      (0.00 per sec.)
52
53 General statistics:
54     total time:                          120.6141s
55     total number of events:              39610
56
57 Latency (ms):
58          min:                                    3.01
59          avg:                                   48.55
60          max:                                 1218.59
61          95th percentile:                       87.56
62          sum:                              1923115.64
63
64 Threads fairness:
65     events (avg/stddev):           2475.6250/139.67
66     execution time (avg/stddev):   120.1947/0.19

innodb压缩只读测试

 1 [[email protected] sysbench-1.0.17]# sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua  2 > --mysql-host=localhost  3 > --mysql-port=3306  4 > --mysql-user=root  5 > --mysql-password=rooT_258  6 > --mysql-db=tt  7 > --oltp-tables-count=10  8 > --oltp-table-size=10000000  9 > --oltp-dist-type=uniform 10 > --oltp-read-only=on 11 > --oltp-test-mode=nontrx  12 > --oltp-nontrx-mode=select 13 > --rand-init=on 14 > --db-driver=mysql 15 > --report-interval=10 16 > --threads=16 17 > --time=120 18 > run
19 sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
20
21 Running the test with following options:
22 Number of threads: 16
23 Report intermediate results every 10 second(s)
24 Initializing random number generator from current time
25
26
27 Initializing worker threads...
28
29 Threads started!
30
31 [ 10s ] thds: 16 tps: 756.04 qps: 12107.14 (r/w/o: 10593.68/0.00/1513.47) lat (ms,95%): 25.28 err/s: 0.00 reconn/s: 0.00
32 [ 20s ] thds: 16 tps: 758.47 qps: 12137.94 (r/w/o: 10620.90/0.00/1517.04) lat (ms,95%): 25.28 err/s: 0.00 reconn/s: 0.00
33 [ 30s ] thds: 16 tps: 713.78 qps: 11423.93 (r/w/o: 9996.26/0.00/1427.67) lat (ms,95%): 27.66 err/s: 0.00 reconn/s: 0.00
34 [ 40s ] thds: 16 tps: 736.63 qps: 11781.92 (r/w/o: 10308.66/0.00/1473.25) lat (ms,95%): 25.74 err/s: 0.00 reconn/s: 0.00
35 [ 50s ] thds: 16 tps: 741.59 qps: 11864.27 (r/w/o: 10381.09/0.00/1483.18) lat (ms,95%): 25.74 err/s: 0.00 reconn/s: 0.00
36 [ 60s ] thds: 16 tps: 727.88 qps: 11647.00 (r/w/o: 10191.44/0.00/1455.56) lat (ms,95%): 26.68 err/s: 0.00 reconn/s: 0.00
37 [ 70s ] thds: 16 tps: 750.52 qps: 12009.86 (r/w/o: 10508.62/0.00/1501.25) lat (ms,95%): 25.74 err/s: 0.00 reconn/s: 0.00
38 [ 80s ] thds: 16 tps: 765.05 qps: 12243.64 (r/w/o: 10713.63/0.00/1530.00) lat (ms,95%): 24.83 err/s: 0.00 reconn/s: 0.00
39 [ 90s ] thds: 16 tps: 768.50 qps: 12292.47 (r/w/o: 10755.46/0.00/1537.01) lat (ms,95%): 24.83 err/s: 0.00 reconn/s: 0.00
40 [ 100s ] thds: 16 tps: 750.12 qps: 12005.80 (r/w/o: 10505.55/0.00/1500.25) lat (ms,95%): 25.28 err/s: 0.00 reconn/s: 0.00
41 [ 110s ] thds: 16 tps: 742.02 qps: 11872.50 (r/w/o: 10388.36/0.00/1484.14) lat (ms,95%): 25.74 err/s: 0.00 reconn/s: 0.00
42 SQL statistics:
43     queries performed:
44         read:                            1256206
45         write:                           0
46         other:                           179458
47         total:                           1435664
48     transactions:                        89729  (747.62 per sec.)
49     queries:                             1435664 (11961.89 per sec.)
50     ignored errors:                      0      (0.00 per sec.)
51     reconnects:                          0      (0.00 per sec.)
52
53 General statistics:
54     total time:                          120.0185s
55     total number of events:              89729
56
57 Latency (ms):
58          min:                                    2.07
59          avg:                                   21.39
60          max:                                  609.74
61          95th percentile:                       25.74
62          sum:                              1919493.65
63
64 Threads fairness:
65     events (avg/stddev):           5608.0625/157.07
66     execution time (avg/stddev):   119.9684/0.03

rocksdb压缩读写测试

 1 [[email protected] sysbench-1.0.17]# sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua  2 > --mysql-host=localhost  3 > --mysql-port=3306  4 > --mysql-user=root  5 > --mysql-password=rooT_258  6 > --mysql-db=sbtest  7 > --oltp-tables-count=10  8 > --oltp-table-size=10000000  9 > --oltp-dist-type=uniform 10 > --oltp-read-only=off 11 > --oltp-test-mode=complex 12 > --rand-init=on 13 > --db-driver=mysql 14 > --report-interval=10 15 > --threads=16 16 > --time=120 17 > run
18
19 sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
20
21 Running the test with following options:
22 Number of threads: 16
23 Report intermediate results every 10 second(s)
24 Initializing random number generator from current time
25
26
27 Initializing worker threads...
28
29 Threads started!
30
31 [ 10s ] thds: 16 tps: 0.50 qps: 29.64 (r/w/o: 23.55/0.80/5.29) lat (ms,95%): 9118.47 err/s: 0.00 reconn/s: 0.00
32 [ 20s ] thds: 16 tps: 4.71 qps: 100.40 (r/w/o: 69.14/5.71/25.55) lat (ms,95%): 11317.84 err/s: 0.00 reconn/s: 0.00
33 [ 30s ] thds: 16 tps: 11.90 qps: 232.10 (r/w/o: 162.00/12.70/57.40) lat (ms,95%): 4055.23 err/s: 0.00 reconn/s: 0.00
34 [ 40s ] thds: 16 tps: 76.00 qps: 1530.41 (r/w/o: 1071.21/83.40/375.80) lat (ms,95%): 484.44 err/s: 0.00 reconn/s: 0.00
35 [ 50s ] thds: 16 tps: 69.20 qps: 1384.02 (r/w/o: 968.81/75.30/339.90) lat (ms,95%): 442.73 err/s: 0.00 reconn/s: 0.00
36 [ 60s ] thds: 16 tps: 95.30 qps: 1905.97 (r/w/o: 1334.18/103.90/467.89) lat (ms,95%): 397.39 err/s: 0.00 reconn/s: 0.00
37 [ 70s ] thds: 16 tps: 75.70 qps: 1510.76 (r/w/o: 1058.94/81.30/370.51) lat (ms,95%): 612.21 err/s: 0.00 reconn/s: 0.00
38 [ 80s ] thds: 16 tps: 122.40 qps: 2449.34 (r/w/o: 1713.06/134.00/602.29) lat (ms,95%): 376.49 err/s: 0.00 reconn/s: 0.00
39 [ 90s ] thds: 16 tps: 142.39 qps: 2849.79 (r/w/o: 1994.92/156.09/698.77) lat (ms,95%): 287.38 err/s: 0.00 reconn/s: 0.00
40 [ 100s ] thds: 16 tps: 205.70 qps: 4110.81 (r/w/o: 2877.51/227.20/1006.10) lat (ms,95%): 173.58 err/s: 0.00 reconn/s: 0.00
41 [ 110s ] thds: 16 tps: 254.10 qps: 5079.68 (r/w/o: 3557.19/280.10/1242.39) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
42 [ 120s ] thds: 16 tps: 248.70 qps: 4975.77 (r/w/o: 3481.55/276.80/1217.42) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
43 SQL statistics:
44     queries performed:
45         read:                            183120
46         write:                           14373
47         other:                           64107
48         total:                           261600
49     transactions:                        13080  (108.99 per sec.)
50     queries:                             261600 (2179.76 per sec.)
51     ignored errors:                      0      (0.00 per sec.)
52     reconnects:                          0      (0.00 per sec.)
53
54 General statistics:
55     total time:                          120.0119s
56     total number of events:              13080
57
58 Latency (ms):
59          min:                                   11.59
60          avg:                                  146.79
61          max:                                11455.56
62          95th percentile:                      383.33
63          sum:                              1920021.31
64
65 Threads fairness:
66     events (avg/stddev):           817.5000/14.68
67     execution time (avg/stddev):   120.0013/0.00

rocksdb压缩只读测试

 1 [[email protected] sysbench-1.0.17]# sysbench /usr/local/share/sysbench/tests/include/oltp_legacy/oltp.lua  2 > --mysql-host=localhost  3 > --mysql-port=3306  4 > --mysql-user=root  5 > --mysql-password=rooT_258  6 > --mysql-db=sbtest  7 > --oltp-tables-count=10  8 > --oltp-table-size=10000000  9 > --oltp-dist-type=uniform 10 > --oltp-read-only=on 11 > --oltp-test-mode=nontrx  12 > --oltp-nontrx-mode=select 13 > --rand-init=on 14 > --db-driver=mysql 15 > --report-interval=10 16 > --threads=16 17 > --time=120 18 > run
19 sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
20
21 Running the test with following options:
22 Number of threads: 16
23 Report intermediate results every 10 second(s)
24 Initializing random number generator from current time
25
26
27 Initializing worker threads...
28
29 Threads started!
30
31 [ 10s ] thds: 16 tps: 525.60 qps: 8424.02 (r/w/o: 7371.23/0.00/1052.79) lat (ms,95%): 36.89 err/s: 0.00 reconn/s: 0.00
32 [ 20s ] thds: 16 tps: 539.48 qps: 8630.07 (r/w/o: 7551.11/0.00/1078.96) lat (ms,95%): 36.24 err/s: 0.00 reconn/s: 0.00
33 [ 30s ] thds: 16 tps: 496.22 qps: 7939.31 (r/w/o: 6946.87/0.00/992.44) lat (ms,95%): 36.89 err/s: 0.00 reconn/s: 0.00
34 [ 40s ] thds: 16 tps: 544.86 qps: 8718.11 (r/w/o: 7628.38/0.00/1089.73) lat (ms,95%): 35.59 err/s: 0.00 reconn/s: 0.00
35 [ 50s ] thds: 16 tps: 472.71 qps: 7566.72 (r/w/o: 6621.30/0.00/945.43) lat (ms,95%): 38.94 err/s: 0.00 reconn/s: 0.00
36 [ 60s ] thds: 16 tps: 539.92 qps: 8637.35 (r/w/o: 7557.51/0.00/1079.84) lat (ms,95%): 36.24 err/s: 0.00 reconn/s: 0.00
37 [ 70s ] thds: 16 tps: 522.27 qps: 8354.16 (r/w/o: 7309.63/0.00/1044.53) lat (ms,95%): 38.94 err/s: 0.00 reconn/s: 0.00
38 [ 80s ] thds: 16 tps: 520.55 qps: 8328.93 (r/w/o: 7287.94/0.00/1040.99) lat (ms,95%): 39.65 err/s: 0.00 reconn/s: 0.00
39 [ 90s ] thds: 16 tps: 529.17 qps: 8470.67 (r/w/o: 7412.22/0.00/1058.45) lat (ms,95%): 40.37 err/s: 0.00 reconn/s: 0.00
40 [ 100s ] thds: 16 tps: 521.31 qps: 8341.12 (r/w/o: 7298.61/0.00/1042.52) lat (ms,95%): 38.94 err/s: 0.00 reconn/s: 0.00
41 [ 110s ] thds: 16 tps: 531.61 qps: 8506.08 (r/w/o: 7442.76/0.00/1063.32) lat (ms,95%): 39.65 err/s: 0.00 reconn/s: 0.00
42 [ 120s ] thds: 15 tps: 542.14 qps: 8658.39 (r/w/o: 7575.60/0.00/1082.79) lat (ms,95%): 37.56 err/s: 0.00 reconn/s: 0.00
43 SQL statistics:
44     queries performed:
45         read:                            880348
46         write:                           0
47         other:                           125764
48         total:                           1006112
49     transactions:                        62882  (523.82 per sec.)
50     queries:                             1006112 (8381.12 per sec.)
51     ignored errors:                      0      (0.00 per sec.)
52     reconnects:                          0      (0.00 per sec.)
53
54 General statistics:
55     total time:                          120.0437s
56     total number of events:              62882
57
58 Latency (ms):
59          min:                                   16.98
60          avg:                                   30.52
61          max:                                 1116.95
62          95th percentile:                       38.25
63          sum:                              1919341.74
64
65 Threads fairness:
66     events (avg/stddev):           3930.1250/150.59
67     execution time (avg/stddev):   119.9589/0.03

参考资料:

将MySQL去重操作优化到极致之三弹连发(三):用rocksdb替代innodb :https://www.cnblogs.com/liuyu124/p/7333471.html

MySQL VS RocksDB VS TiDB 完全版性能测试  : http://liky.farbox.com/post/tidb

mysql rocksdb使用报告 :https://www.jianshu.com/p/50aed4f00215

Linux下Mysql数据库的压力测试: https://blog.csdn.net/qq_42303254/article/details/88189503

Percona Server MySQL 5.7新引擎MyRocks性能基准测试:http://baijiahao.baidu.com/s?id=1599227245729254474&wfr=spider&for=pc

MyRocks DDL原理:https://www.cnblogs.com/cchust/p/6716823.html

原文地址:https://www.cnblogs.com/EikiXu/p/10882818.html

时间: 2024-07-29 22:04:05

RocksDB存储引擎测试的相关文章

[MySQL Reference Manual]14 InnoDB存储引擎

14 InnoDB存储引擎 14 InnoDB存储引擎... 1 14.1 InnoDB说明... 5 14.1.1 InnoDB作为默认存储引擎... 5 14.1.1.1 存储引擎的趋势... 5 14.1.1.2 InnoDB变成默认存储引擎之后... 5 14.1.1.3 InnoDB表好处... 6 14.1.1.4 InnoDB表最佳实践... 6 14.1.1.5 InnoDB表提升... 6 14.1.1.6 InnoDB作为默认存储引擎测试... 6 14.1.1.7 验证In

mongodb三种存储引擎高并发更新性能专题测试

背景说明 近期北京理财频道反馈用来存放股市实时数据的MongoDB数据库写响应请求很慢,难以跟上业务写入速度水平.我们分析了线上现场的情况,发现去年升级到SSD磁盘后,数据持久化的磁盘IO开销已经不是瓶颈.通过日志分析,线上单次写入(更新)请求大多在数十毫秒这个级别,数据库端观察几个主要的db在繁忙时通常有95%以上的时间在进行锁等待.线上数据库并发很高,接近1000个连接,所以怀疑是并发争用表锁导致性能不足. 我们知道MongoDB的mmap存储引擎一直是库/表级锁,因此任何写操作并发越高锁争

淘宝分布式 key/value 存储引擎Tair安装部署过程及Java客户端测试一例

目录 1. 简介 2. 安装步骤及问题小记 3. 部署配置 4. Java客户端测试 5. 参考资料 声明 1. 下面的安装部署基于Linux系统环境:centos 6(64位),其它Linux版本可能有所差异. 2. 网上有人说tair安装失败可能是因为gcc版本问题,高版本的gcc可能不支持某些特性导致安装失败,经过实验证明,该说法是错误的,tair安装失败有各种可能的原因但绝对与gcc版本无关,比如我的gcc开始版本为4.4.7,后来tair安装失败,我重新编译低版本的gcc(gcc4.1

对LevelDB的“升级版”存储引擎RocksDB的调研成果

Google的leveldb是个很优秀的存储引擎,但还是有一些不尽人意的地方,比如leveldb不支持多线程合并,对key范围查找的支持还很简单,未做优化措施,等等.而Facebook的RocksDB是个更彪悍的引擎,实际上是在LevelDB之上做的改进,在用法上与LevelDB非常的相似,两者的对比可以参考下面的参考资料1. 这里之所以要调研rocksdb是因为rocksdb中加入了prefix bloomfilter的实现,能够支持对范围查找的优化,对我目前的项目很有参考意义,下面是我调研和

Ceph Newstore存储引擎介绍

在Ceph被越来越多地应用于各项存储业务过程中,其性能及调优策略也成为用户密切关注讨论的话题,影响性能表现关键因素之一即OSD存储引擎实现:Ceph基础组件RADOS是强一致.对象存储系统,其OSD底层支持的存储引擎如下图所示: 其中,ObjectStore层封装了下层存储引擎的所有IO操作,向上层提供对象(object).事务(Transaction)语义的接口,MemStore为基于内存的实现:KeyValueStore主要基于KV数据库(如leveldb, rocksdb等)实现接口功能,

MongoDB 3.2版WiredTiger存储引擎性能测试

MongoDB 3.2版WiredTiger存储引擎性能测试 作者:chszs,未经博主允许不得转载.经许可的转载需注明作者和博客主页:http://blog.csdn.net/chszs MongoDB 3.2于最近发布了,它使用WiredTiger作为其默认的存储引擎.这五年来,MongoDB从诞生到流行,发展可谓是相当迅猛. MongoDB 3.0就开始支持"可插拔的存储引擎"功能,因此在3.2版使用WiredTiger也在情理之中.WiredTiger引擎基于B-Tree算法,

tair ldb存储引擎性能测试方案

1. 性能测试环境 在单机环境(一台dataserver)和分布式环境(多台dataserver)下分别进行测试,或只在分布式环境下进行测试. 2. 性能测试指标 主要考量两个指标 (1)服务端的极限QPS (2)单个操作的响应时间rt 当然其实还有其它不少指标,例如服务端的资源消耗情况.并发数等等. 3. 性能测试方法 主要针对tair ldb存储引擎在缓存了不同级别数据的前提下,添加了范围Bloomfilter支持的前后对 get_range接口测试的性能对比情况.考虑到网络方面的负载,每次

Innodb存储引擎

特点:支持事务.锁定机制的改进,Innodb改变了MylSAM的锁机制,实现了行锁.实现外键..frm文件来存放结构定义相关的元数据,但是表数据和索引数据是存在一起的,每个表单独存放还是表存放在一起,完全由用户来决定. 理论:Innodb的物理结构分为两大部分 数据文件(表数据和索引数据) 存放表中的数据和所有的索引数据,包括主键和其他普通索引.Innodb中,存在了表空间这样的概念,和oracle的表空间又有较大的不同.Innodb的表空间分为两种形式.一种是共享表空间,就是所有表和索引数据存

Tair ldb(leveldb存储引擎)实现介绍

简介 tair 是淘宝自己开发的一个分布式 key/value 存储引擎. tair 分为持久化和非持久化两种使用方式. 非持久化的 tair 可以看成是一个分布式缓存. 持久化的 tair 将数据存放于磁盘中. 为了解决磁盘损坏导致数据丢失, tair 可以配置数据的备份数目, tair 自动将一份数据的不同备份放到不同的主机上, 当有主机发生异常, 无法正常提供服务的时候, 其于的备份会继续提供服务. tair 的总体结构 tair 作为一个分布式系统, 是由一个中心控制节点和一系列的服务节