root@ceph-1:/var/lib/ceph/osd# rados -p rbd bench 60 write
Maintaining 16 concurrent writes of 4194304 bytes for up to 60 seconds or 0 objects
Object prefix: benchmark_data_ceph-1_22471
sec Cur ops started finished avg MB/s cur MB/s last lat avg lat
0 0 0 0 0 0 - 0
1 16 22 6 23.9948 24 0.566451 0.340223
2 16 25 9 17.9968 12 0.499876 0.488969
3 16 27 11 14.6642 8 0.505307 0.481886
4 16 28 12 11.9981 4 3.61413 0.742907
5 16 28 12 9.59853 0 - 0.742907
6 16 29 13 8.66535 2 5.76612 1.12931
7 16 29 13 7.42745 0 - 1.12931
8 16 29 13 6.49902 0 - 1.12931
9 16 29 13 5.77691 0 - 1.12931
10 16 30 14 5.59916 1 9.55644 1.73125
11 16 32 16 5.8173 8 0.359206 2.19009
12 16 32 16 5.33253 0 - 2.19009
13 16 33 17 5.22999 2 12.6456 2.80512
14 16 37 21 5.99911 16 0.691131 3.29266
15 16 39 23 6.13241 8 0.398395 3.65242
16 16 41 25 6.24906 8 0.166032 3.38248
17 16 42 26 6.11672 4 16.2661 3.878
18 16 43 27 5.99909 4 16.5144 4.34601
19 16 44 28 5.89385 4 18.8451 4.86384
2014-03-17 11:55:41.083386min lat: 0.166032 max lat: 18.8451 avg lat: 4.86384
sec Cur ops started finished avg MB/s cur MB/s last lat avg lat
20 16 44 28 5.59915 0 - 4.86384
21 16 44 28 5.33253 0 - 4.86384
22 16 47 31 5.63552 4 0.169082 4.75088
23 16 51 35 6.08605 16 0.412576 5.05486
24 16 53 37 6.16576 8 9.88939 5.07936
25 16 53 37 5.91913 0 - 5.07936
26 16 54 38 5.8453 2 25.1247 5.60687
27 16 54 38 5.62881 0 - 5.60687
28 16 56 40 5.71346 4 12.0391 5.84038
29 16 56 40 5.51645 0 - 5.84038
30 16 58 42 5.5992 4 7.30473 6.4468
31 16 59 43 5.5476 4 0.200851 6.30154
32 16 59 43 5.37423 0 - 6.30154
33 16 61 45 5.45376 4 5.29574 6.29662
34 16 61 45 5.29336 0 - 6.29662
35 16 61 45 5.14212 0 - 6.29662
36 16 61 45 4.99928 0 - 6.29662
37 16 62 46 4.97226 1 36.4597 6.95234
38 16 64 48 5.05191 8 0.193404 6.68175
39 16 65 49 5.02492 4 0.460932 6.5548
2014-03-17 11:56:01.086113min lat: 0.166032 max lat: 36.4597 avg lat: 6.47299
sec Cur ops started finished avg MB/s cur MB/s last lat avg lat
40 16 70 54 5.39922 20 0.353678 6.47299
41 16 70 54 5.26753 0 - 6.47299
42 16 71 55 5.23734 2 41.4863 7.10959
43 16 71 55 5.11554 0 - 7.10959
44 16 71 55 4.99929 0 - 7.10959
45 16 71 55 4.88819 0 - 7.10959
46 16 74 58 5.04276 3 7.53975 7.64292
47 16 75 59 5.02057 4 16.8443 7.79888
48 16 76 60 4.9993 4 0.261244 7.67325
49 16 78 62 5.06052 8 0.424008 7.47922
50 16 79 63 5.0393 4 0.722333 7.37197
51 16 79 63 4.94049 0 - 7.37197
52 16 79 63 4.84548 0 - 7.37197
53 16 82 66 4.98044 4 49.3672 7.9934
54 16 84 68 5.03634 8 0.391436 7.76576
55 16 84 68 4.94477 0 - 7.76576
56 16 84 68 4.85647 0 - 7.76576
57 16 84 68 4.77128 0 - 7.76576
58 16 86 70 4.82692 2 48.2878 8.59735
59 16 87 71 4.8129 4 0.347187 8.48115
2014-03-17 11:56:21.088618min lat: 0.116339 max lat: 49.3672 avg lat: 8.48115
sec Cur ops started finished avg MB/s cur MB/s last lat avg lat
60 16 87 71 4.73268 0 - 8.48115
61 16 87 71 4.65509 0 - 8.48115
62 16 88 72 4.64452 1.33333 48.682 9.0395
63 15 88 73 4.63428 4 23.2528 9.2342
64 15 88 73 4.56187 0 - 9.2342
65 15 88 73 4.49169 0 - 9.2342
66 15 88 73 4.42363 0 - 9.2342
67 15 88 73 4.35761 0 - 9.2342
68 15 88 73 4.29353 0 - 9.2342
69 14 88 74 4.28926 0.666667 51.7766 9.8091
70 14 88 74 4.22799 0 - 9.8091
71 14 88 74 4.16844 0 - 9.8091
72 13 88 75 4.1661 1.33333 25.3822 10.0167
73 13 88 75 4.10903 0 - 10.0167
74 13 88 75 4.0535 0 - 10.0167
75 13 88 75 3.99946 0 - 10.0167
76 13 88 75 3.94683 0 - 10.0167
77 13 88 75 3.89558 0 - 10.0167
78 13 88 75 3.84563 0 - 10.0167
79 13 88 75 3.79695 0 - 10.0167
2014-03-17 11:56:41.091170min lat: 0.116339 max lat: 51.7766 avg lat: 10.0167
sec Cur ops started finished avg MB/s cur MB/s last lat avg lat
80 13 88 75 3.74949 0 - 10.0167
81 13 88 75 3.7032 0 - 10.0167
82 13 88 75 3.65804 0 - 10.0167
83 13 88 75 3.61397 0 - 10.0167
84 13 88 75 3.57095 0 - 10.0167
85 13 88 75 3.52893 0 - 10.0167
86 13 88 75 3.4879 0 - 10.0167
87 13 88 75 3.44781 0 - 10.0167
88 13 88 75 3.40863 0 - 10.0167
89 13 88 75 3.37033 0 - 10.0167
90 13 88 75 3.33288 0 - 10.0167
91 13 88 75 3.29626 0 - 10.0167
92 13 88 75 3.26043 0 - 10.0167
93 13 88 75 3.22537 0 - 10.0167
94 13 88 75 3.19106 0 - 10.0167
95 13 88 75 3.15747 0 - 10.0167
96 10 88 78 3.24956 0.5 46.0149 11.3223
97 10 88 78 3.21606 0 - 11.3223
98 10 88 78 3.18324 0 - 11.3223
Total time run: 98.563039
Total writes made: 88
Write size: 4194304
Bandwidth (MB/sec): 3.571
Stddev Bandwidth: 4.37783
Max bandwidth (MB/sec): 24
Min bandwidth (MB/sec): 0
Average Latency: 16.7451
Stddev Latency: 21.5368
Max latency: 81.002
Min latency: 0.116339
