[START TIME] 2019-07-16 20:11:45-04:00 [IOR EASY WRITE] time: 1563322305.844964180 IOR-3.2.0: MPI Coordinated Test of Parallel I/O Began : Tue Jul 16 20:11:46 2019 Command line : ./bin//ior --posix.odirect -t 1m -b 20000m -F -w -C -Q 1 -g -G 27 -k -e -o ./datadir_10sl//ior_easy/ior_file_easy -O stoneWallingStatusFile=./datadir_10sl//ior_easy/stonewall -O stoneWallingWearOut=1 -D 300 Machine : Linux e10u22.int.janelia.org TestID : 0 StartTime : Tue Jul 16 20:11:46 2019 Path : /misc/weka/wekaFS_1/io-500-script/datadir_10sl/ior_easy FS : 50.0 TiB Used FS: 1.8% Inodes: 858.3 Mi Used Inodes: 0.1% Options: api : POSIX apiVersion : test filename : ./datadir_10sl//ior_easy/ior_file_easy access : file-per-process type : independent segments : 1 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 tasks : 480 clients per node : 48 repetitions : 1 xfersize : 1 MiB blocksize : 19.53 GiB aggregate filesize : 9.16 TiB stonewallingTime : 300 stoneWallingWearOut : 1 Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- stonewalling pairs accessed min: 7481 max: 8828 -- min data: 7.3 GiB mean data: 8.0 GiB time: 300.0s WARNING: Expected aggregate file size = 10066329600000. WARNING: Stat() of aggregate file size = 4443277885440. WARNING: Using actual aggregate bytes moved = 4443277885440. WARNING: maybe caused by deadlineForStonewalling write 12121 20480000 1024.00 0.143948 349.41 0.044167 349.59 0 Max Write: 12121.04 MiB/sec (12709.83 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum write 12121.04 12121.04 12121.04 0.00 12121.04 12121.04 12121.04 0.00 349.59382 0 480 48 1 1 1 1 0 0 1 20971520000 1048576 4237440.0 POSIX 0 Finished : Tue Jul 16 20:17:36 2019 [MDTEST EASY WRITE] time: 1563322656.715846712 -- started at 07/16/2019 20:17:37 -- mdtest-1.9.3 was launched with 480 total task(s) on 10 node(s) Command line used: ./bin//mdtest "--posix.odirect" "-n" "50000" "-u" "-L" "-N=48" "-C" "-F" "-d" "./datadir_10sl//mdt_easy" "-x" "./datadir_10sl//mdt_easy-stonewall" "-W" "300" Path: /misc/weka/wekaFS_1/io-500-script/datadir_10sl FS: 50.0 TiB Used FS: 9.9% Inodes: 858.3 Mi Used Inodes: 0.6% 480 tasks, 24000000 files Continue stonewall hit min: 22367 max: 50000 avg: 37448.5 SUMMARY rate: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 38862.487 38862.366 38862.398 0.030 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 0.000 0.000 0.000 0.000 Tree creation : 6.933 6.933 6.933 0.000 Tree removal : 0.000 0.000 0.000 0.000 -- finished at 07/16/2019 20:27:55 -- [CREATING TIMESTAMP] time: 1563323275.576012162 [IOR HARD WRITE] time: 1563323275.583189016 IOR-3.2.0: MPI Coordinated Test of Parallel I/O Began : Tue Jul 16 20:27:56 2019 Command line : ./bin//ior --posix.odirect -s 60000 -w -C -Q 1 -g -G 27 -k -e -t 47008 -b 47008 -o ./datadir_10sl//ior_hard/IOR_file -O stoneWallingStatusFile=./datadir_10sl//ior_hard/stonewall -O stoneWallingWearOut=1 -D 300 Machine : Linux e10u22.int.janelia.org TestID : 0 StartTime : Tue Jul 16 20:27:56 2019 Path : /misc/weka/wekaFS_1/io-500-script/datadir_10sl/ior_hard FS : 50.0 TiB Used FS: 10.1% Inodes: 858.3 Mi Used Inodes: 3.6% Options: api : POSIX apiVersion : test filename : ./datadir_10sl//ior_hard/IOR_file access : single-shared-file type : independent segments : 60000 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 tasks : 480 clients per node : 48 repetitions : 1 xfersize : 47008 bytes blocksize : 47008 bytes aggregate filesize : 1.23 TiB stonewallingTime : 300 stoneWallingWearOut : 1 Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- stonewalling pairs accessed min: 39425 max: 60000 -- min data: 1.7 GiB mean data: 2.6 GiB time: 300.0s write 4073 45.91 45.91 0.010743 316.97 0.004867 316.98 0 Max Write: 4073.12 MiB/sec (4270.98 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum write 4073.12 4073.12 4073.12 0.00 90856.44 90856.44 90856.44 0.00 316.98360 0 480 48 1 0 1 1 0 0 60000 47008 47008 1291113.2 POSIX 0 Finished : Tue Jul 16 20:33:13 2019 [MDTEST HARD WRITE] time: 1563323593.630319494 -- started at 07/16/2019 20:33:14 -- mdtest-1.9.3 was launched with 480 total task(s) on 10 node(s) Command line used: ./bin//mdtest "--posix.odirect" "-N=48" "-n" "50000" "-C" "-t" "-F" "-w" "3901" "-e" "3901" "-d" "./datadir_10sl//mdt_hard" "-x" "./datadir_10sl//mdt_hard-stonewall" "-W" "300" Path: /misc/weka/wekaFS_1/io-500-script/datadir_10sl FS: 50.0 TiB Used FS: 12.6% Inodes: 858.3 Mi Used Inodes: 3.7% 480 tasks, 24000000 files Continue stonewall hit min: 2437 max: 2485 avg: 2462.2 SUMMARY rate: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 3920.517 3920.506 3920.509 0.003 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 0.000 0.000 0.000 0.000 Tree creation : 338.633 338.633 338.633 0.000 Tree removal : 0.000 0.000 0.000 0.000 -- finished at 07/16/2019 20:38:18 -- [PFIND EASY] time: 1563323899.010295975 [6] rate: 2.746 kiops time: 35.8s found: 540 (scanned 98170 files, scanned dirents: 100000, unknown dirents: 0) [23] rate: 1.418 kiops time: 35.8s found: 421 (scanned 50706 files, scanned dirents: 50000, unknown dirents: 0) [11] rate: 5.456 kiops time: 35.8s found: 404 (scanned 195129 files, scanned dirents: 200000, unknown dirents: 0) [16] rate: 1.432 kiops time: 35.8s found: 639 (scanned 51206 files, scanned dirents: 50000, unknown dirents: 0) [22] rate: 0.080 kiops time: 35.8s found: 442 (scanned 2852 files, scanned dirents: 0, unknown dirents: 0) [5] rate: 0.062 kiops time: 35.8s found: 590 (scanned 2223 files, scanned dirents: 0, unknown dirents: 0) [7] rate: 1.413 kiops time: 35.8s found: 524 (scanned 50525 files, scanned dirents: 50000, unknown dirents: 0) [13] rate: 5.462 kiops time: 35.8s found: 591 (scanned 195320 files, scanned dirents: 200000, unknown dirents: 0) [14] rate: 0.073 kiops time: 35.8s found: 536 (scanned 2612 files, scanned dirents: 0, unknown dirents: 0) [15] rate: 0.071 kiops time: 35.8s found: 580 (scanned 2528 files, scanned dirents: 0, unknown dirents: 0) [17] rate: 0.069 kiops time: 35.8s found: 514 (scanned 2484 files, scanned dirents: 0, unknown dirents: 0) [18] rate: 2.752 kiops time: 35.8s found: 598 (scanned 98428 files, scanned dirents: 100000, unknown dirents: 0) [21] rate: 2.747 kiops time: 35.8s found: 256 (scanned 98240 files, scanned dirents: 100000, unknown dirents: 0) [0] rate: 35.256 kiops time: 35.8s found: 0 (scanned 1260833 files, scanned dirents: 1293772, unknown dirents: 0) [8] rate: 2.759 kiops time: 35.8s found: 591 (scanned 98664 files, scanned dirents: 100000, unknown dirents: 0) [20] rate: 1.403 kiops time: 35.8s found: 387 (scanned 50178 files, scanned dirents: 50000, unknown dirents: 0) [2] rate: 4.102 kiops time: 35.8s found: 659 (scanned 146711 files, scanned dirents: 150000, unknown dirents: 0) [12] rate: 1.413 kiops time: 35.8s found: 645 (scanned 50546 files, scanned dirents: 50002, unknown dirents: 0) [27] rate: 0.058 kiops time: 35.8s found: 275 (scanned 2092 files, scanned dirents: 0, unknown dirents: 0) [34] rate: 4.092 kiops time: 35.8s found: 288 (scanned 146356 files, scanned dirents: 150000, unknown dirents: 0) [1] rate: 1.427 kiops time: 35.8s found: 815 (scanned 51027 files, scanned dirents: 50000, unknown dirents: 0) [19] rate: 0.072 kiops time: 35.8s found: 431 (scanned 2589 files, scanned dirents: 0, unknown dirents: 0) [3] rate: 2.766 kiops time: 35.8s found: 612 (scanned 98919 files, scanned dirents: 100000, unknown dirents: 0) [4] rate: 1.412 kiops time: 35.8s found: 556 (scanned 50507 files, scanned dirents: 50000, unknown dirents: 0) [9] rate: 2.756 kiops time: 35.8s found: 490 (scanned 98545 files, scanned dirents: 100000, unknown dirents: 0) [10] rate: 2.753 kiops time: 35.8s found: 558 (scanned 98445 files, scanned dirents: 100000, unknown dirents: 0) [26] rate: 0.063 kiops time: 35.8s found: 290 (scanned 2263 files, scanned dirents: 0, unknown dirents: 0) [42] rate: 5.450 kiops time: 35.8s found: 131 (scanned 194888 files, scanned dirents: 200000, unknown dirents: 0) [35] rate: 0.058 kiops time: 35.8s found: 233 (scanned 2079 files, scanned dirents: 0, unknown dirents: 0) [41] rate: 1.414 kiops time: 35.8s found: 189 (scanned 50559 files, scanned dirents: 50000, unknown dirents: 0) [24] rate: 0.066 kiops time: 35.8s found: 288 (scanned 2370 files, scanned dirents: 0, unknown dirents: 0) [45] rate: 0.049 kiops time: 35.8s found: 135 (scanned 1750 files, scanned dirents: 0, unknown dirents: 0) [47] rate: 0.044 kiops time: 35.8s found: 97 (scanned 1585 files, scanned dirents: 0, unknown dirents: 0) [37] rate: 0.072 kiops time: 35.8s found: 245 (scanned 2585 files, scanned dirents: 0, unknown dirents: 0) [28] rate: 0.072 kiops time: 35.8s found: 226 (scanned 2589 files, scanned dirents: 0, unknown dirents: 0) [31] rate: 2.749 kiops time: 35.8s found: 296 (scanned 98324 files, scanned dirents: 100000, unknown dirents: 0) [38] rate: 2.738 kiops time: 35.8s found: 196 (scanned 97890 files, scanned dirents: 100000, unknown dirents: 0) [25] rate: 2.745 kiops time: 35.8s found: 288 (scanned 98170 files, scanned dirents: 100000, unknown dirents: 0) [43] rate: 0.055 kiops time: 35.8s found: 219 (scanned 1980 files, scanned dirents: 0, unknown dirents: 0) [30] rate: 0.054 kiops time: 35.8s found: 238 (scanned 1947 files, scanned dirents: 0, unknown dirents: 0) [33] rate: 5.476 kiops time: 35.8s found: 646 (scanned 195856 files, scanned dirents: 200000, unknown dirents: 0) [36] rate: 0.052 kiops time: 35.8s found: 248 (scanned 1845 files, scanned dirents: 0, unknown dirents: 0) [40] rate: 2.736 kiops time: 35.8s found: 158 (scanned 97833 files, scanned dirents: 100000, unknown dirents: 0) [29] rate: 0.057 kiops time: 35.8s found: 186 (scanned 2040 files, scanned dirents: 0, unknown dirents: 0) [32] rate: 2.754 kiops time: 35.8s found: 351 (scanned 98486 files, scanned dirents: 100000, unknown dirents: 0) [39] rate: 0.078 kiops time: 35.8s found: 176 (scanned 2773 files, scanned dirents: 0, unknown dirents: 0) [44] rate: 4.095 kiops time: 35.8s found: 165 (scanned 146457 files, scanned dirents: 150000, unknown dirents: 0) [46] rate: 0.071 kiops time: 35.8s found: 149 (scanned 2522 files, scanned dirents: 0, unknown dirents: 0) [49] rate: 2.756 kiops time: 35.8s found: 14 (scanned 98560 files, scanned dirents: 100000, unknown dirents: 0) [62] rate: 4.086 kiops time: 35.8s found: 52 (scanned 146136 files, scanned dirents: 150000, unknown dirents: 0) [48] rate: 2.751 kiops time: 35.8s found: 11 (scanned 98397 files, scanned dirents: 100000, unknown dirents: 0) [52] rate: 0.062 kiops time: 35.8s found: 30 (scanned 2206 files, scanned dirents: 0, unknown dirents: 0) [53] rate: 0.037 kiops time: 35.8s found: 12 (scanned 1321 files, scanned dirents: 0, unknown dirents: 0) [54] rate: 1.402 kiops time: 35.8s found: 26 (scanned 50121 files, scanned dirents: 50000, unknown dirents: 0) [59] rate: 0.048 kiops time: 35.8s found: 25 (scanned 1718 files, scanned dirents: 0, unknown dirents: 0) [56] rate: 0.063 kiops time: 35.8s found: 13 (scanned 2241 files, scanned dirents: 0, unknown dirents: 0) [67] rate: 0.060 kiops time: 35.8s found: 20 (scanned 2159 files, scanned dirents: 0, unknown dirents: 0) [68] rate: 0.053 kiops time: 35.8s found: 96 (scanned 1911 files, scanned dirents: 0, unknown dirents: 0) [71] rate: 0.061 kiops time: 35.8s found: 59 (scanned 2195 files, scanned dirents: 0, unknown dirents: 0) [50] rate: 2.741 kiops time: 35.8s found: 35 (scanned 98013 files, scanned dirents: 100000, unknown dirents: 0) [69] rate: 2.759 kiops time: 35.8s found: 41 (scanned 98690 files, scanned dirents: 100000, unknown dirents: 0) [76] rate: 0.062 kiops time: 35.8s found: 14 (scanned 2232 files, scanned dirents: 0, unknown dirents: 0) [58] rate: 0.047 kiops time: 35.8s found: 14 (scanned 1666 files, scanned dirents: 0, unknown dirents: 0) [61] rate: 0.049 kiops time: 35.8s found: 22 (scanned 1762 files, scanned dirents: 0, unknown dirents: 0) [65] rate: 1.395 kiops time: 35.8s found: 47 (scanned 49897 files, scanned dirents: 50000, unknown dirents: 0) [51] rate: 2.732 kiops time: 35.8s found: 14 (scanned 97714 files, scanned dirents: 100000, unknown dirents: 0) [60] rate: 5.447 kiops time: 35.8s found: 47 (scanned 194810 files, scanned dirents: 200000, unknown dirents: 0) [63] rate: 0.054 kiops time: 35.8s found: 112 (scanned 1924 files, scanned dirents: 0, unknown dirents: 0) [55] rate: 1.385 kiops time: 35.8s found: 25 (scanned 49539 files, scanned dirents: 50000, unknown dirents: 0) [57] rate: 1.406 kiops time: 35.8s found: 14 (scanned 50287 files, scanned dirents: 50000, unknown dirents: 0) [64] rate: 1.400 kiops time: 35.8s found: 85 (scanned 50084 files, scanned dirents: 50000, unknown dirents: 0) [66] rate: 4.088 kiops time: 35.8s found: 68 (scanned 146211 files, scanned dirents: 150000, unknown dirents: 0) [70] rate: 4.083 kiops time: 35.8s found: 23 (scanned 145985 files, scanned dirents: 150000, unknown dirents: 0) [85] rate: 0.046 kiops time: 35.8s found: 76 (scanned 1653 files, scanned dirents: 0, unknown dirents: 0) [80] rate: 0.046 kiops time: 35.8s found: 20 (scanned 1642 files, scanned dirents: 0, unknown dirents: 0) [92] rate: 2.759 kiops time: 35.8s found: 106 (scanned 98664 files, scanned dirents: 100000, unknown dirents: 0) [94] rate: 1.401 kiops time: 35.8s found: 27 (scanned 50099 files, scanned dirents: 50000, unknown dirents: 0) [84] rate: 0.066 kiops time: 35.8s found: 19 (scanned 2369 files, scanned dirents: 0, unknown dirents: 0) [87] rate: 1.390 kiops time: 35.8s found: 25 (scanned 49710 files, scanned dirents: 50000, unknown dirents: 0) [83] rate: 2.757 kiops time: 35.8s found: 102 (scanned 98599 files, scanned dirents: 100000, unknown dirents: 0) [88] rate: 1.390 kiops time: 35.8s found: 22 (scanned 49714 files, scanned dirents: 50000, unknown dirents: 0) [74] rate: 4.086 kiops time: 35.8s found: 30 (scanned 146117 files, scanned dirents: 150000, unknown dirents: 0) [90] rate: 2.748 kiops time: 35.8s found: 24 (scanned 98277 files, scanned dirents: 100000, unknown dirents: 0) [91] rate: 0.052 kiops time: 35.8s found: 21 (scanned 1854 files, scanned dirents: 0, unknown dirents: 0) [96] rate: 2.746 kiops time: 35.8s found: 17 (scanned 98211 files, scanned dirents: 100000, unknown dirents: 0) [75] rate: 1.422 kiops time: 35.8s found: 21 (scanned 50845 files, scanned dirents: 50000, unknown dirents: 0) [81] rate: 1.419 kiops time: 35.8s found: 39 (scanned 50735 files, scanned dirents: 50000, unknown dirents: 0) [82] rate: 1.397 kiops time: 35.8s found: 31 (scanned 49959 files, scanned dirents: 50000, unknown dirents: 0) [93] rate: 0.046 kiops time: 35.8s found: 29 (scanned 1663 files, scanned dirents: 0, unknown dirents: 0) [72] rate: 4.101 kiops time: 35.8s found: 15 (scanned 146655 files, scanned dirents: 150000, unknown dirents: 0) [79] rate: 0.054 kiops time: 35.8s found: 19 (scanned 1933 files, scanned dirents: 0, unknown dirents: 0) [73] rate: 2.733 kiops time: 35.8s found: 12 (scanned 97754 files, scanned dirents: 100000, unknown dirents: 0) [77] rate: 0.042 kiops time: 35.8s found: 18 (scanned 1486 files, scanned dirents: 0, unknown dirents: 0) [86] rate: 2.734 kiops time: 35.8s found: 7 (scanned 97770 files, scanned dirents: 100000, unknown dirents: 0) [78] rate: 0.044 kiops time: 35.8s found: 24 (scanned 1577 files, scanned dirents: 0, unknown dirents: 0) [89] rate: 0.062 kiops time: 35.8s found: 25 (scanned 2202 files, scanned dirents: 0, unknown dirents: 0) [95] rate: 2.738 kiops time: 35.8s found: 22 (scanned 97916 files, scanned dirents: 100000, unknown dirents: 0) [105] rate: 2.759 kiops time: 35.8s found: 24 (scanned 98687 files, scanned dirents: 100000, unknown dirents: 0) [122] rate: 0.082 kiops time: 35.8s found: 27 (scanned 2937 files, scanned dirents: 0, unknown dirents: 0) [102] rate: 0.073 kiops time: 35.8s found: 25 (scanned 2604 files, scanned dirents: 0, unknown dirents: 0) [103] rate: 0.076 kiops time: 35.8s found: 17 (scanned 2729 files, scanned dirents: 0, unknown dirents: 0) [104] rate: 1.431 kiops time: 35.8s found: 21 (scanned 51163 files, scanned dirents: 50000, unknown dirents: 0) [101] rate: 1.436 kiops time: 35.8s found: 27 (scanned 51358 files, scanned dirents: 50000, unknown dirents: 0) [107] rate: 2.768 kiops time: 35.8s found: 18 (scanned 98995 files, scanned dirents: 100000, unknown dirents: 0) [113] rate: 2.771 kiops time: 35.8s found: 40 (scanned 99111 files, scanned dirents: 100000, unknown dirents: 0) [106] rate: 0.067 kiops time: 35.8s found: 16 (scanned 2401 files, scanned dirents: 0, unknown dirents: 0) [114] rate: 0.061 kiops time: 35.8s found: 26 (scanned 2199 files, scanned dirents: 0, unknown dirents: 0) [97] rate: 0.072 kiops time: 35.8s found: 24 (scanned 2575 files, scanned dirents: 0, unknown dirents: 0) [98] rate: 0.053 kiops time: 35.8s found: 30 (scanned 1912 files, scanned dirents: 0, unknown dirents: 0) [99] rate: 0.074 kiops time: 35.8s found: 35 (scanned 2634 files, scanned dirents: 0, unknown dirents: 0) [108] rate: 5.449 kiops time: 35.8s found: 14 (scanned 194871 files, scanned dirents: 200000, unknown dirents: 0) [111] rate: 0.070 kiops time: 35.8s found: 22 (scanned 2520 files, scanned dirents: 0, unknown dirents: 0) [110] rate: 0.075 kiops time: 35.8s found: 20 (scanned 2686 files, scanned dirents: 0, unknown dirents: 0) [118] rate: 0.090 kiops time: 35.8s found: 25 (scanned 3213 files, scanned dirents: 0, unknown dirents: 0) [112] rate: 0.094 kiops time: 35.8s found: 17 (scanned 3360 files, scanned dirents: 0, unknown dirents: 0) [100] rate: 2.737 kiops time: 35.8s found: 13 (scanned 97896 files, scanned dirents: 150000, unknown dirents: 0) [109] rate: 5.449 kiops time: 35.8s found: 31 (scanned 194890 files, scanned dirents: 200000, unknown dirents: 0) [115] rate: 4.097 kiops time: 35.8s found: 52 (scanned 146538 files, scanned dirents: 150000, unknown dirents: 0) [116] rate: 0.066 kiops time: 35.8s found: 29 (scanned 2374 files, scanned dirents: 0, unknown dirents: 0) [132] rate: 2.752 kiops time: 35.8s found: 13 (scanned 98429 files, scanned dirents: 100000, unknown dirents: 0) [117] rate: 0.073 kiops time: 35.8s found: 26 (scanned 2618 files, scanned dirents: 0, unknown dirents: 0) [119] rate: 0.079 kiops time: 35.8s found: 15 (scanned 2837 files, scanned dirents: 0, unknown dirents: 0) [121] rate: 0.095 kiops time: 35.8s found: 22 (scanned 3403 files, scanned dirents: 0, unknown dirents: 0) [129] rate: 0.084 kiops time: 35.8s found: 23 (scanned 3011 files, scanned dirents: 0, unknown dirents: 0) [134] rate: 1.435 kiops time: 35.8s found: 19 (scanned 51322 files, scanned dirents: 50000, unknown dirents: 0) [120] rate: 0.061 kiops time: 35.8s found: 18 (scanned 2182 files, scanned dirents: 0, unknown dirents: 0) [123] rate: 2.780 kiops time: 35.8s found: 9 (scanned 99442 files, scanned dirents: 100000, unknown dirents: 0) [136] rate: 2.769 kiops time: 35.8s found: 30 (scanned 99031 files, scanned dirents: 100000, unknown dirents: 0) [139] rate: 2.766 kiops time: 35.8s found: 24 (scanned 98934 files, scanned dirents: 100000, unknown dirents: 0) [128] rate: 4.102 kiops time: 35.8s found: 146 (scanned 146710 files, scanned dirents: 150000, unknown dirents: 0) [125] rate: 1.422 kiops time: 35.8s found: 21 (scanned 50843 files, scanned dirents: 50000, unknown dirents: 0) [127] rate: 0.107 kiops time: 35.8s found: 37 (scanned 3811 files, scanned dirents: 0, unknown dirents: 0) [133] rate: 0.076 kiops time: 35.8s found: 16 (scanned 2722 files, scanned dirents: 0, unknown dirents: 0) [141] rate: 0.088 kiops time: 35.8s found: 22 (scanned 3154 files, scanned dirents: 0, unknown dirents: 0) [143] rate: 0.086 kiops time: 35.8s found: 13 (scanned 3091 files, scanned dirents: 0, unknown dirents: 0) [131] rate: 2.756 kiops time: 35.8s found: 30 (scanned 98557 files, scanned dirents: 100000, unknown dirents: 0) [135] rate: 4.108 kiops time: 35.8s found: 29 (scanned 146886 files, scanned dirents: 150000, unknown dirents: 0) [124] rate: 1.398 kiops time: 35.8s found: 17 (scanned 49988 files, scanned dirents: 50000, unknown dirents: 0) [126] rate: 2.768 kiops time: 35.8s found: 17 (scanned 98991 files, scanned dirents: 100000, unknown dirents: 0) [142] rate: 1.413 kiops time: 35.8s found: 28 (scanned 50542 files, scanned dirents: 50000, unknown dirents: 0) [130] rate: 0.058 kiops time: 35.8s found: 30 (scanned 2073 files, scanned dirents: 0, unknown dirents: 0) [137] rate: 1.424 kiops time: 35.8s found: 28 (scanned 50920 files, scanned dirents: 50000, unknown dirents: 0) [138] rate: 2.742 kiops time: 35.8s found: 34 (scanned 98070 files, scanned dirents: 100000, unknown dirents: 0) [140] rate: 2.750 kiops time: 35.8s found: 43 (scanned 98359 files, scanned dirents: 100000, unknown dirents: 0) [155] rate: 0.056 kiops time: 35.8s found: 12 (scanned 2011 files, scanned dirents: 0, unknown dirents: 0) [156] rate: 0.060 kiops time: 35.8s found: 23 (scanned 2147 files, scanned dirents: 0, unknown dirents: 0) [162] rate: 0.084 kiops time: 35.8s found: 25 (scanned 3015 files, scanned dirents: 0, unknown dirents: 0) [149] rate: 1.408 kiops time: 35.8s found: 10 (scanned 50344 files, scanned dirents: 50000, unknown dirents: 0) [163] rate: 2.769 kiops time: 35.8s found: 31 (scanned 99043 files, scanned dirents: 100000, unknown dirents: 0) [144] rate: 0.075 kiops time: 35.8s found: 10 (scanned 2694 files, scanned dirents: 0, unknown dirents: 0) [159] rate: 1.410 kiops time: 35.8s found: 62 (scanned 50419 files, scanned dirents: 50000, unknown dirents: 0) [165] rate: 1.393 kiops time: 35.8s found: 10 (scanned 49821 files, scanned dirents: 50000, unknown dirents: 0) [148] rate: 0.052 kiops time: 35.8s found: 20 (scanned 1852 files, scanned dirents: 0, unknown dirents: 0) [192] rate: 0.075 kiops time: 35.8s found: 31 (scanned 2699 files, scanned dirents: 0, unknown dirents: 0) [160] rate: 2.751 kiops time: 35.8s found: 22 (scanned 98402 files, scanned dirents: 100000, unknown dirents: 0) [152] rate: 0.051 kiops time: 35.8s found: 8 (scanned 1842 files, scanned dirents: 0, unknown dirents: 0) [154] rate: 0.061 kiops time: 35.8s found: 23 (scanned 2195 files, scanned dirents: 0, unknown dirents: 0) [151] rate: 2.742 kiops time: 35.8s found: 22 (scanned 98070 files, scanned dirents: 100000, unknown dirents: 0) [194] rate: 5.447 kiops time: 35.8s found: 28 (scanned 194815 files, scanned dirents: 200000, unknown dirents: 0) [164] rate: 0.061 kiops time: 35.8s found: 44 (scanned 2194 files, scanned dirents: 0, unknown dirents: 0) [211] rate: 0.064 kiops time: 35.8s found: 35 (scanned 2278 files, scanned dirents: 0, unknown dirents: 0) [166] rate: 5.442 kiops time: 35.8s found: 19 (scanned 194628 files, scanned dirents: 200000, unknown dirents: 0) [195] rate: 0.073 kiops time: 35.8s found: 31 (scanned 2628 files, scanned dirents: 0, unknown dirents: 0) [167] rate: 4.119 kiops time: 35.8s found: 17 (scanned 147317 files, scanned dirents: 150000, unknown dirents: 0) [205] rate: 0.067 kiops time: 35.8s found: 25 (scanned 2408 files, scanned dirents: 0, unknown dirents: 0) [147] rate: 2.738 kiops time: 35.8s found: 24 (scanned 97933 files, scanned dirents: 100000, unknown dirents: 0) [200] rate: 0.068 kiops time: 35.8s found: 26 (scanned 2429 files, scanned dirents: 0, unknown dirents: 0) [157] rate: 0.088 kiops time: 35.8s found: 50 (scanned 3143 files, scanned dirents: 0, unknown dirents: 0) [193] rate: 2.766 kiops time: 35.8s found: 22 (scanned 98946 files, scanned dirents: 100000, unknown dirents: 0) [170] rate: 1.399 kiops time: 35.8s found: 27 (scanned 50039 files, scanned dirents: 50000, unknown dirents: 0) [197] rate: 1.412 kiops time: 35.8s found: 13 (scanned 50492 files, scanned dirents: 50000, unknown dirents: 0) [145] rate: 0.069 kiops time: 35.8s found: 26 (scanned 2472 files, scanned dirents: 0, unknown dirents: 0) [204] rate: 0.067 kiops time: 35.8s found: 40 (scanned 2406 files, scanned dirents: 0, unknown dirents: 0) [150] rate: 0.062 kiops time: 35.8s found: 26 (scanned 2213 files, scanned dirents: 0, unknown dirents: 0) [213] rate: 0.099 kiops time: 35.8s found: 21 (scanned 3525 files, scanned dirents: 0, unknown dirents: 0) [153] rate: 4.087 kiops time: 35.8s found: 9 (scanned 146191 files, scanned dirents: 150000, unknown dirents: 0) [207] rate: 0.062 kiops time: 35.8s found: 32 (scanned 2204 files, scanned dirents: 0, unknown dirents: 0) [161] rate: 1.414 kiops time: 35.8s found: 18 (scanned 50592 files, scanned dirents: 50000, unknown dirents: 0) [214] rate: 1.411 kiops time: 35.8s found: 18 (scanned 50446 files, scanned dirents: 50000, unknown dirents: 0) [182] rate: 4.099 kiops time: 35.8s found: 28 (scanned 146601 files, scanned dirents: 150000, unknown dirents: 0) [198] rate: 0.066 kiops time: 35.8s found: 35 (scanned 2354 files, scanned dirents: 0, unknown dirents: 0) [146] rate: 0.059 kiops time: 35.8s found: 20 (scanned 2102 files, scanned dirents: 0, unknown dirents: 0) [215] rate: 0.073 kiops time: 35.8s found: 12 (scanned 2602 files, scanned dirents: 0, unknown dirents: 0) [158] rate: 1.414 kiops time: 35.8s found: 72 (scanned 50578 files, scanned dirents: 50000, unknown dirents: 0) [206] rate: 0.079 kiops time: 35.8s found: 47 (scanned 2820 files, scanned dirents: 0, unknown dirents: 0) [177] rate: 0.080 kiops time: 35.8s found: 46 (scanned 2848 files, scanned dirents: 0, unknown dirents: 0) [199] rate: 0.080 kiops time: 35.8s found: 20 (scanned 2877 files, scanned dirents: 0, unknown dirents: 0) [188] rate: 2.760 kiops time: 35.8s found: 23 (scanned 98736 files, scanned dirents: 100000, unknown dirents: 0) [208] rate: 0.070 kiops time: 35.8s found: 23 (scanned 2508 files, scanned dirents: 0, unknown dirents: 0) [169] rate: 0.044 kiops time: 35.8s found: 18 (scanned 1567 files, scanned dirents: 0, unknown dirents: 0) [209] rate: 2.777 kiops time: 35.8s found: 32 (scanned 99333 files, scanned dirents: 100000, unknown dirents: 0) [172] rate: 0.064 kiops time: 35.8s found: 18 (scanned 2296 files, scanned dirents: 0, unknown dirents: 0) [196] rate: 4.092 kiops time: 35.8s found: 33 (scanned 146365 files, scanned dirents: 150000, unknown dirents: 0) [179] rate: 0.071 kiops time: 35.8s found: 38 (scanned 2525 files, scanned dirents: 0, unknown dirents: 0) [201] rate: 1.398 kiops time: 35.8s found: 22 (scanned 50010 files, scanned dirents: 50000, unknown dirents: 0) [181] rate: 1.388 kiops time: 35.8s found: 27 (scanned 49631 files, scanned dirents: 50000, unknown dirents: 0) [186] rate: 1.402 kiops time: 35.8s found: 22 (scanned 50130 files, scanned dirents: 50000, unknown dirents: 0) [202] rate: 0.078 kiops time: 35.8s found: 23 (scanned 2782 files, scanned dirents: 0, unknown dirents: 0) [168] rate: 0.048 kiops time: 35.8s found: 29 (scanned 1725 files, scanned dirents: 0, unknown dirents: 0) [203] rate: 0.071 kiops time: 35.8s found: 26 (scanned 2542 files, scanned dirents: 0, unknown dirents: 0) [180] rate: 4.119 kiops time: 35.8s found: 29 (scanned 147342 files, scanned dirents: 150000, unknown dirents: 0) [210] rate: 0.070 kiops time: 35.8s found: 39 (scanned 2521 files, scanned dirents: 0, unknown dirents: 0) [190] rate: 0.043 kiops time: 35.8s found: 17 (scanned 1528 files, scanned dirents: 0, unknown dirents: 0) [212] rate: 1.424 kiops time: 35.8s found: 22 (scanned 50930 files, scanned dirents: 50000, unknown dirents: 0) [176] rate: 0.050 kiops time: 35.8s found: 34 (scanned 1795 files, scanned dirents: 0, unknown dirents: 0) [220] rate: 5.447 kiops time: 35.8s found: 17 (scanned 194844 files, scanned dirents: 200000, unknown dirents: 0) [187] rate: 2.755 kiops time: 35.8s found: 6 (scanned 98545 files, scanned dirents: 100000, unknown dirents: 0) [174] rate: 2.738 kiops time: 35.8s found: 22 (scanned 97930 files, scanned dirents: 100000, unknown dirents: 0) [183] rate: 0.044 kiops time: 35.8s found: 19 (scanned 1562 files, scanned dirents: 0, unknown dirents: 0) [231] rate: 4.092 kiops time: 35.8s found: 33 (scanned 146329 files, scanned dirents: 150000, unknown dirents: 0) [189] rate: 0.070 kiops time: 35.8s found: 33 (scanned 2488 files, scanned dirents: 0, unknown dirents: 0) [235] rate: 1.403 kiops time: 35.8s found: 49 (scanned 50180 files, scanned dirents: 50000, unknown dirents: 0) [175] rate: 0.052 kiops time: 35.8s found: 32 (scanned 1872 files, scanned dirents: 0, unknown dirents: 0) [229] rate: 0.065 kiops time: 35.8s found: 15 (scanned 2336 files, scanned dirents: 0, unknown dirents: 0) [264] rate: 1.387 kiops time: 35.8s found: 8 (scanned 49606 files, scanned dirents: 50000, unknown dirents: 0) [178] rate: 1.404 kiops time: 35.8s found: 36 (scanned 50216 files, scanned dirents: 50000, unknown dirents: 0) [232] rate: 1.410 kiops time: 35.8s found: 36 (scanned 50425 files, scanned dirents: 50000, unknown dirents: 0) [184] rate: 1.398 kiops time: 35.8s found: 31 (scanned 49994 files, scanned dirents: 50000, unknown dirents: 0) [225] rate: 0.067 kiops time: 35.8s found: 24 (scanned 2413 files, scanned dirents: 0, unknown dirents: 0) [171] rate: 0.060 kiops time: 35.8s found: 17 (scanned 2156 files, scanned dirents: 0, unknown dirents: 0) [224] rate: 0.064 kiops time: 35.8s found: 21 (scanned 2289 files, scanned dirents: 0, unknown dirents: 0) [173] rate: 1.395 kiops time: 35.8s found: 16 (scanned 49910 files, scanned dirents: 50000, unknown dirents: 0) [227] rate: 1.420 kiops time: 35.8s found: 24 (scanned 50780 files, scanned dirents: 50000, unknown dirents: 0) [185] rate: 0.065 kiops time: 35.8s found: 8 (scanned 2315 files, scanned dirents: 0, unknown dirents: 0) [219] rate: 1.427 kiops time: 35.8s found: 11 (scanned 51046 files, scanned dirents: 50000, unknown dirents: 0) [191] rate: 0.058 kiops time: 35.8s found: 20 (scanned 2090 files, scanned dirents: 0, unknown dirents: 0) [228] rate: 0.077 kiops time: 35.8s found: 25 (scanned 2764 files, scanned dirents: 0, unknown dirents: 0) [223] rate: 1.394 kiops time: 35.8s found: 18 (scanned 49849 files, scanned dirents: 50000, unknown dirents: 0) [230] rate: 0.053 kiops time: 35.8s found: 31 (scanned 1882 files, scanned dirents: 0, unknown dirents: 0) [237] rate: 2.737 kiops time: 35.8s found: 13 (scanned 97914 files, scanned dirents: 100000, unknown dirents: 0) [217] rate: 1.411 kiops time: 35.8s found: 24 (scanned 50471 files, scanned dirents: 50000, unknown dirents: 0) [226] rate: 5.456 kiops time: 35.8s found: 65 (scanned 195146 files, scanned dirents: 200000, unknown dirents: 0) [239] rate: 1.407 kiops time: 35.8s found: 11 (scanned 50328 files, scanned dirents: 50000, unknown dirents: 0) [216] rate: 2.756 kiops time: 35.8s found: 22 (scanned 98572 files, scanned dirents: 100000, unknown dirents: 0) [221] rate: 0.079 kiops time: 35.8s found: 20 (scanned 2829 files, scanned dirents: 0, unknown dirents: 0) [222] rate: 1.405 kiops time: 35.8s found: 15 (scanned 50271 files, scanned dirents: 50000, unknown dirents: 0) [233] rate: 2.752 kiops time: 35.8s found: 53 (scanned 98450 files, scanned dirents: 100000, unknown dirents: 0) [234] rate: 0.083 kiops time: 35.8s found: 38 (scanned 2961 files, scanned dirents: 0, unknown dirents: 0) [238] rate: 0.069 kiops time: 35.8s found: 54 (scanned 2452 files, scanned dirents: 0, unknown dirents: 0) [245] rate: 0.037 kiops time: 35.8s found: 15 (scanned 1335 files, scanned dirents: 0, unknown dirents: 0) [218] rate: 1.402 kiops time: 35.8s found: 23 (scanned 50164 files, scanned dirents: 50000, unknown dirents: 0) [262] rate: 0.068 kiops time: 35.8s found: 10 (scanned 2448 files, scanned dirents: 0, unknown dirents: 0) [236] rate: 0.086 kiops time: 35.8s found: 46 (scanned 3086 files, scanned dirents: 0, unknown dirents: 0) [249] rate: 5.456 kiops time: 35.8s found: 12 (scanned 195165 files, scanned dirents: 200000, unknown dirents: 0) [242] rate: 1.393 kiops time: 35.8s found: 16 (scanned 49836 files, scanned dirents: 50000, unknown dirents: 0) [256] rate: 0.061 kiops time: 35.8s found: 169 (scanned 2168 files, scanned dirents: 0, unknown dirents: 0) [240] rate: 0.043 kiops time: 35.8s found: 27 (scanned 1544 files, scanned dirents: 0, unknown dirents: 0) [252] rate: 1.392 kiops time: 35.8s found: 29 (scanned 49787 files, scanned dirents: 50000, unknown dirents: 0) [263] rate: 1.393 kiops time: 35.8s found: 19 (scanned 49811 files, scanned dirents: 50000, unknown dirents: 0) [257] rate: 2.731 kiops time: 35.8s found: 24 (scanned 97704 files, scanned dirents: 100000, unknown dirents: 0) [258] rate: 1.410 kiops time: 35.8s found: 36 (scanned 50453 files, scanned dirents: 50000, unknown dirents: 0) [259] rate: 1.414 kiops time: 35.8s found: 40 (scanned 50572 files, scanned dirents: 50000, unknown dirents: 0) [261] rate: 1.391 kiops time: 35.8s found: 29 (scanned 49767 files, scanned dirents: 50000, unknown dirents: 0) [248] rate: 1.397 kiops time: 35.8s found: 35 (scanned 49985 files, scanned dirents: 50000, unknown dirents: 0) [250] rate: 0.063 kiops time: 35.8s found: 18 (scanned 2263 files, scanned dirents: 0, unknown dirents: 0) [244] rate: 0.045 kiops time: 35.8s found: 19 (scanned 1619 files, scanned dirents: 0, unknown dirents: 0) [253] rate: 1.417 kiops time: 35.8s found: 42 (scanned 50673 files, scanned dirents: 50000, unknown dirents: 0) [241] rate: 0.052 kiops time: 35.8s found: 27 (scanned 1869 files, scanned dirents: 0, unknown dirents: 0) [243] rate: 4.086 kiops time: 35.8s found: 26 (scanned 146151 files, scanned dirents: 150000, unknown dirents: 0) [254] rate: 1.398 kiops time: 35.8s found: 17 (scanned 50013 files, scanned dirents: 50000, unknown dirents: 0) [255] rate: 1.387 kiops time: 35.8s found: 24 (scanned 49597 files, scanned dirents: 50000, unknown dirents: 0) [246] rate: 0.048 kiops time: 35.8s found: 14 (scanned 1700 files, scanned dirents: 0, unknown dirents: 0) [247] rate: 5.469 kiops time: 35.8s found: 26 (scanned 195577 files, scanned dirents: 200000, unknown dirents: 0) [251] rate: 0.057 kiops time: 35.8s found: 17 (scanned 2047 files, scanned dirents: 0, unknown dirents: 0) [260] rate: 0.040 kiops time: 35.8s found: 20 (scanned 1418 files, scanned dirents: 0, unknown dirents: 0) [283] rate: 0.051 kiops time: 35.8s found: 29 (scanned 1840 files, scanned dirents: 0, unknown dirents: 0) [274] rate: 2.739 kiops time: 35.8s found: 23 (scanned 98021 files, scanned dirents: 100000, unknown dirents: 0) [303] rate: 0.094 kiops time: 35.8s found: 78 (scanned 3356 files, scanned dirents: 0, unknown dirents: 0) [270] rate: 2.739 kiops time: 35.8s found: 19 (scanned 98007 files, scanned dirents: 100000, unknown dirents: 0) [267] rate: 1.375 kiops time: 35.8s found: 11 (scanned 49209 files, scanned dirents: 50000, unknown dirents: 0) [287] rate: 1.400 kiops time: 35.8s found: 10 (scanned 50106 files, scanned dirents: 50000, unknown dirents: 0) [269] rate: 0.052 kiops time: 35.8s found: 39 (scanned 1873 files, scanned dirents: 0, unknown dirents: 0) [272] rate: 0.045 kiops time: 35.8s found: 15 (scanned 1599 files, scanned dirents: 0, unknown dirents: 0) [282] rate: 2.754 kiops time: 35.8s found: 33 (scanned 98528 files, scanned dirents: 100000, unknown dirents: 0) [278] rate: 0.059 kiops time: 35.8s found: 23 (scanned 2095 files, scanned dirents: 0, unknown dirents: 0) [280] rate: 4.091 kiops time: 35.8s found: 24 (scanned 146399 files, scanned dirents: 150000, unknown dirents: 0) [284] rate: 2.744 kiops time: 35.8s found: 33 (scanned 98174 files, scanned dirents: 100000, unknown dirents: 0) [296] rate: 1.415 kiops time: 35.8s found: 24 (scanned 50642 files, scanned dirents: 50000, unknown dirents: 0) [265] rate: 0.024 kiops time: 35.8s found: 18 (scanned 841 files, scanned dirents: 0, unknown dirents: 0) [281] rate: 5.444 kiops time: 35.8s found: 24 (scanned 194792 files, scanned dirents: 200000, unknown dirents: 0) [268] rate: 4.090 kiops time: 35.8s found: 15 (scanned 146343 files, scanned dirents: 150000, unknown dirents: 0) [291] rate: 0.106 kiops time: 35.8s found: 17 (scanned 3779 files, scanned dirents: 0, unknown dirents: 0) [277] rate: 0.049 kiops time: 35.8s found: 46 (scanned 1747 files, scanned dirents: 0, unknown dirents: 0) [286] rate: 2.742 kiops time: 35.8s found: 20 (scanned 98115 files, scanned dirents: 100000, unknown dirents: 0) [305] rate: 2.737 kiops time: 35.8s found: 32 (scanned 97929 files, scanned dirents: 100000, unknown dirents: 0) [271] rate: 0.052 kiops time: 35.8s found: 41 (scanned 1853 files, scanned dirents: 0, unknown dirents: 0) [276] rate: 0.052 kiops time: 35.8s found: 27 (scanned 1849 files, scanned dirents: 0, unknown dirents: 0) [288] rate: 0.131 kiops time: 35.8s found: 28 (scanned 4689 files, scanned dirents: 0, unknown dirents: 0) [285] rate: 0.061 kiops time: 35.8s found: 13 (scanned 2166 files, scanned dirents: 0, unknown dirents: 0) [266] rate: 0.048 kiops time: 35.8s found: 24 (scanned 1703 files, scanned dirents: 0, unknown dirents: 0) [302] rate: 2.737 kiops time: 35.8s found: 17 (scanned 97923 files, scanned dirents: 100000, unknown dirents: 0) [273] rate: 2.746 kiops time: 35.8s found: 39 (scanned 98265 files, scanned dirents: 100000, unknown dirents: 0) [279] rate: 0.040 kiops time: 35.8s found: 15 (scanned 1429 files, scanned dirents: 0, unknown dirents: 0) [275] rate: 0.059 kiops time: 35.8s found: 12 (scanned 2102 files, scanned dirents: 0, unknown dirents: 0) [290] rate: 0.126 kiops time: 35.8s found: 16 (scanned 4518 files, scanned dirents: 0, unknown dirents: 0) [311] rate: 0.115 kiops time: 35.8s found: 17 (scanned 4132 files, scanned dirents: 0, unknown dirents: 0) [289] rate: 0.137 kiops time: 35.8s found: 15 (scanned 4902 files, scanned dirents: 0, unknown dirents: 0) [307] rate: 2.737 kiops time: 35.8s found: 43 (scanned 97945 files, scanned dirents: 100000, unknown dirents: 0) [299] rate: 5.442 kiops time: 35.8s found: 14 (scanned 194720 files, scanned dirents: 200000, unknown dirents: 0) [300] rate: 2.738 kiops time: 35.8s found: 25 (scanned 97968 files, scanned dirents: 100000, unknown dirents: 0) [292] rate: 0.142 kiops time: 35.8s found: 15 (scanned 5077 files, scanned dirents: 0, unknown dirents: 0) [293] rate: 0.117 kiops time: 35.8s found: 9 (scanned 4194 files, scanned dirents: 0, unknown dirents: 0) [308] rate: 1.469 kiops time: 35.8s found: 30 (scanned 52561 files, scanned dirents: 50000, unknown dirents: 0) [295] rate: 0.157 kiops time: 35.8s found: 30 (scanned 5617 files, scanned dirents: 0, unknown dirents: 0) [301] rate: 0.110 kiops time: 35.8s found: 53 (scanned 3940 files, scanned dirents: 0, unknown dirents: 0) [304] rate: 1.447 kiops time: 35.8s found: 30 (scanned 51786 files, scanned dirents: 50000, unknown dirents: 0) [309] rate: 0.135 kiops time: 35.8s found: 32 (scanned 4827 files, scanned dirents: 0, unknown dirents: 0) [298] rate: 2.777 kiops time: 35.8s found: 17 (scanned 99360 files, scanned dirents: 100000, unknown dirents: 0) [310] rate: 0.132 kiops time: 35.8s found: 26 (scanned 4731 files, scanned dirents: 0, unknown dirents: 0) [317] rate: 0.111 kiops time: 35.8s found: 20 (scanned 3963 files, scanned dirents: 0, unknown dirents: 0) [294] rate: 0.111 kiops time: 35.8s found: 37 (scanned 3980 files, scanned dirents: 0, unknown dirents: 0) [297] rate: 1.440 kiops time: 35.8s found: 35 (scanned 51519 files, scanned dirents: 50000, unknown dirents: 0) [324] rate: 4.089 kiops time: 35.8s found: 9 (scanned 146330 files, scanned dirents: 150000, unknown dirents: 0) [313] rate: 2.767 kiops time: 35.8s found: 37 (scanned 99002 files, scanned dirents: 100000, unknown dirents: 0) [331] rate: 0.125 kiops time: 35.8s found: 47 (scanned 4481 files, scanned dirents: 0, unknown dirents: 0) [335] rate: 0.101 kiops time: 35.8s found: 17 (scanned 3599 files, scanned dirents: 0, unknown dirents: 0) [306] rate: 1.431 kiops time: 35.8s found: 46 (scanned 51222 files, scanned dirents: 100000, unknown dirents: 0) [312] rate: 0.095 kiops time: 35.8s found: 16 (scanned 3392 files, scanned dirents: 0, unknown dirents: 0) [322] rate: 0.105 kiops time: 35.8s found: 29 (scanned 3742 files, scanned dirents: 0, unknown dirents: 0) [327] rate: 0.102 kiops time: 35.8s found: 18 (scanned 3654 files, scanned dirents: 0, unknown dirents: 0) [326] rate: 1.469 kiops time: 35.8s found: 13 (scanned 52549 files, scanned dirents: 50000, unknown dirents: 0) [318] rate: 1.457 kiops time: 35.8s found: 11 (scanned 52138 files, scanned dirents: 50000, unknown dirents: 0) [330] rate: 2.734 kiops time: 35.8s found: 15 (scanned 97830 files, scanned dirents: 100000, unknown dirents: 0) [325] rate: 5.444 kiops time: 35.8s found: 35 (scanned 194795 files, scanned dirents: 200000, unknown dirents: 0) [333] rate: 0.103 kiops time: 35.8s found: 15 (scanned 3702 files, scanned dirents: 0, unknown dirents: 0) [321] rate: 1.416 kiops time: 35.8s found: 43 (scanned 50675 files, scanned dirents: 50000, unknown dirents: 0) [329] rate: 0.123 kiops time: 35.8s found: 72 (scanned 4393 files, scanned dirents: 0, unknown dirents: 0) [314] rate: 1.412 kiops time: 35.8s found: 27 (scanned 50541 files, scanned dirents: 50000, unknown dirents: 0) [316] rate: 4.106 kiops time: 35.8s found: 29 (scanned 146922 files, scanned dirents: 150000, unknown dirents: 0) [320] rate: 5.446 kiops time: 35.8s found: 25 (scanned 194876 files, scanned dirents: 200000, unknown dirents: 0) [315] rate: 2.817 kiops time: 35.8s found: 20 (scanned 100792 files, scanned dirents: 100000, unknown dirents: 0) [319] rate: 0.098 kiops time: 35.8s found: 12 (scanned 3523 files, scanned dirents: 0, unknown dirents: 0) [328] rate: 4.092 kiops time: 35.8s found: 26 (scanned 146430 files, scanned dirents: 150000, unknown dirents: 0) [332] rate: 2.752 kiops time: 35.8s found: 19 (scanned 98460 files, scanned dirents: 100000, unknown dirents: 0) [334] rate: 1.427 kiops time: 35.8s found: 29 (scanned 51056 files, scanned dirents: 50000, unknown dirents: 0) [323] rate: 1.389 kiops time: 35.8s found: 22 (scanned 49718 files, scanned dirents: 100000, unknown dirents: 0) [341] rate: 2.724 kiops time: 35.8s found: 15 (scanned 97492 files, scanned dirents: 100000, unknown dirents: 0) [344] rate: 0.038 kiops time: 35.8s found: 22 (scanned 1374 files, scanned dirents: 0, unknown dirents: 0) [338] rate: 0.036 kiops time: 35.8s found: 12 (scanned 1281 files, scanned dirents: 0, unknown dirents: 0) [342] rate: 0.041 kiops time: 35.8s found: 12 (scanned 1466 files, scanned dirents: 0, unknown dirents: 0) [348] rate: 0.057 kiops time: 35.8s found: 37 (scanned 2050 files, scanned dirents: 0, unknown dirents: 0) [358] rate: 1.388 kiops time: 35.8s found: 24 (scanned 49642 files, scanned dirents: 50000, unknown dirents: 0) [359] rate: 0.037 kiops time: 35.8s found: 13 (scanned 1321 files, scanned dirents: 0, unknown dirents: 0) [353] rate: 0.047 kiops time: 35.8s found: 22 (scanned 1672 files, scanned dirents: 0, unknown dirents: 0) [356] rate: 2.731 kiops time: 35.8s found: 40 (scanned 97730 files, scanned dirents: 100000, unknown dirents: 0) [350] rate: 2.740 kiops time: 35.8s found: 24 (scanned 98057 files, scanned dirents: 100000, unknown dirents: 0) [354] rate: 2.726 kiops time: 35.8s found: 11 (scanned 97550 files, scanned dirents: 100000, unknown dirents: 0) [347] rate: 5.442 kiops time: 35.8s found: 20 (scanned 194725 files, scanned dirents: 200000, unknown dirents: 0) [345] rate: 1.385 kiops time: 35.8s found: 22 (scanned 49556 files, scanned dirents: 50000, unknown dirents: 0) [349] rate: 4.078 kiops time: 35.8s found: 35 (scanned 145935 files, scanned dirents: 150000, unknown dirents: 0) [357] rate: 0.042 kiops time: 35.8s found: 19 (scanned 1519 files, scanned dirents: 0, unknown dirents: 0) [362] rate: 1.393 kiops time: 35.8s found: 10 (scanned 49843 files, scanned dirents: 50000, unknown dirents: 0) [336] rate: 0.058 kiops time: 35.8s found: 23 (scanned 2090 files, scanned dirents: 0, unknown dirents: 0) [339] rate: 0.045 kiops time: 35.8s found: 13 (scanned 1622 files, scanned dirents: 0, unknown dirents: 0) [343] rate: 0.033 kiops time: 35.8s found: 21 (scanned 1193 files, scanned dirents: 0, unknown dirents: 0) [351] rate: 0.038 kiops time: 35.8s found: 31 (scanned 1342 files, scanned dirents: 0, unknown dirents: 0) [355] rate: 1.404 kiops time: 35.8s found: 38 (scanned 50226 files, scanned dirents: 50000, unknown dirents: 0) [337] rate: 0.063 kiops time: 35.8s found: 30 (scanned 2256 files, scanned dirents: 0, unknown dirents: 0) [340] rate: 2.735 kiops time: 35.8s found: 17 (scanned 97857 files, scanned dirents: 100000, unknown dirents: 0) [352] rate: 2.739 kiops time: 35.8s found: 42 (scanned 98030 files, scanned dirents: 100000, unknown dirents: 0) [346] rate: 0.045 kiops time: 35.8s found: 23 (scanned 1615 files, scanned dirents: 0, unknown dirents: 0) [366] rate: 2.749 kiops time: 35.8s found: 30 (scanned 98385 files, scanned dirents: 100000, unknown dirents: 0) [370] rate: 0.030 kiops time: 35.8s found: 22 (scanned 1071 files, scanned dirents: 0, unknown dirents: 0) [365] rate: 2.736 kiops time: 35.8s found: 19 (scanned 97892 files, scanned dirents: 100000, unknown dirents: 0) [369] rate: 2.760 kiops time: 35.8s found: 133 (scanned 98779 files, scanned dirents: 100000, unknown dirents: 0) [380] rate: 2.736 kiops time: 35.8s found: 11 (scanned 97887 files, scanned dirents: 100000, unknown dirents: 0) [374] rate: 1.395 kiops time: 35.8s found: 23 (scanned 49910 files, scanned dirents: 50000, unknown dirents: 0) [376] rate: 0.057 kiops time: 35.8s found: 28 (scanned 2030 files, scanned dirents: 0, unknown dirents: 0) [364] rate: 0.047 kiops time: 35.8s found: 17 (scanned 1694 files, scanned dirents: 0, unknown dirents: 0) [372] rate: 0.063 kiops time: 35.8s found: 41 (scanned 2267 files, scanned dirents: 0, unknown dirents: 0) [361] rate: 2.733 kiops time: 35.8s found: 18 (scanned 97802 files, scanned dirents: 100000, unknown dirents: 0) [363] rate: 0.035 kiops time: 35.8s found: 16 (scanned 1260 files, scanned dirents: 0, unknown dirents: 0) [394] rate: 5.442 kiops time: 35.8s found: 20 (scanned 194745 files, scanned dirents: 200000, unknown dirents: 0) [378] rate: 1.410 kiops time: 35.8s found: 174 (scanned 50445 files, scanned dirents: 50000, unknown dirents: 0) [399] rate: 1.405 kiops time: 35.8s found: 20 (scanned 50281 files, scanned dirents: 50000, unknown dirents: 0) [379] rate: 4.083 kiops time: 35.8s found: 129 (scanned 146123 files, scanned dirents: 150000, unknown dirents: 0) [395] rate: 0.071 kiops time: 35.8s found: 27 (scanned 2558 files, scanned dirents: 0, unknown dirents: 0) [383] rate: 0.049 kiops time: 35.8s found: 30 (scanned 1752 files, scanned dirents: 0, unknown dirents: 0) [360] rate: 0.024 kiops time: 35.8s found: 28 (scanned 847 files, scanned dirents: 0, unknown dirents: 0) [388] rate: 0.078 kiops time: 35.8s found: 28 (scanned 2786 files, scanned dirents: 0, unknown dirents: 0) [371] rate: 0.050 kiops time: 35.8s found: 36 (scanned 1788 files, scanned dirents: 0, unknown dirents: 0) [385] rate: 0.064 kiops time: 35.8s found: 22 (scanned 2281 files, scanned dirents: 0, unknown dirents: 0) [375] rate: 0.044 kiops time: 35.8s found: 32 (scanned 1571 files, scanned dirents: 0, unknown dirents: 0) [387] rate: 2.755 kiops time: 35.8s found: 14 (scanned 98590 files, scanned dirents: 100000, unknown dirents: 0) [381] rate: 2.747 kiops time: 35.8s found: 27 (scanned 98284 files, scanned dirents: 100000, unknown dirents: 0) [367] rate: 2.733 kiops time: 35.8s found: 17 (scanned 97787 files, scanned dirents: 100000, unknown dirents: 0) [368] rate: 0.048 kiops time: 35.8s found: 24 (scanned 1720 files, scanned dirents: 0, unknown dirents: 0) [390] rate: 0.060 kiops time: 35.8s found: 47 (scanned 2163 files, scanned dirents: 0, unknown dirents: 0) [373] rate: 4.077 kiops time: 35.8s found: 8 (scanned 145905 files, scanned dirents: 150000, unknown dirents: 0) [384] rate: 0.060 kiops time: 35.8s found: 32 (scanned 2156 files, scanned dirents: 0, unknown dirents: 0) [377] rate: 1.397 kiops time: 35.8s found: 104 (scanned 49999 files, scanned dirents: 50000, unknown dirents: 0) [413] rate: 0.056 kiops time: 35.8s found: 25 (scanned 1990 files, scanned dirents: 0, unknown dirents: 0) [382] rate: 0.050 kiops time: 35.8s found: 27 (scanned 1793 files, scanned dirents: 0, unknown dirents: 0) [393] rate: 0.084 kiops time: 35.8s found: 24 (scanned 3018 files, scanned dirents: 0, unknown dirents: 0) [392] rate: 0.082 kiops time: 35.8s found: 18 (scanned 2940 files, scanned dirents: 0, unknown dirents: 0) [402] rate: 0.073 kiops time: 35.8s found: 62 (scanned 2597 files, scanned dirents: 0, unknown dirents: 0) [407] rate: 1.414 kiops time: 35.8s found: 23 (scanned 50578 files, scanned dirents: 50000, unknown dirents: 0) [409] rate: 2.745 kiops time: 35.8s found: 19 (scanned 98229 files, scanned dirents: 100000, unknown dirents: 0) [397] rate: 0.068 kiops time: 35.8s found: 20 (scanned 2450 files, scanned dirents: 0, unknown dirents: 0) [410] rate: 5.446 kiops time: 35.8s found: 12 (scanned 194895 files, scanned dirents: 200000, unknown dirents: 0) [401] rate: 5.440 kiops time: 35.8s found: 28 (scanned 194680 files, scanned dirents: 200000, unknown dirents: 0) [405] rate: 1.418 kiops time: 35.8s found: 17 (scanned 50745 files, scanned dirents: 50000, unknown dirents: 0) [389] rate: 2.764 kiops time: 35.8s found: 15 (scanned 98900 files, scanned dirents: 100000, unknown dirents: 0) [391] rate: 1.403 kiops time: 35.8s found: 24 (scanned 50201 files, scanned dirents: 50000, unknown dirents: 0) [404] rate: 1.405 kiops time: 35.8s found: 50 (scanned 50297 files, scanned dirents: 50000, unknown dirents: 0) [411] rate: 0.063 kiops time: 35.8s found: 11 (scanned 2263 files, scanned dirents: 0, unknown dirents: 0) [416] rate: 0.061 kiops time: 35.8s found: 28 (scanned 2191 files, scanned dirents: 0, unknown dirents: 0) [420] rate: 0.056 kiops time: 35.8s found: 22 (scanned 2008 files, scanned dirents: 0, unknown dirents: 0) [398] rate: 5.440 kiops time: 35.8s found: 58 (scanned 194694 files, scanned dirents: 200000, unknown dirents: 0) [403] rate: 1.405 kiops time: 35.8s found: 47 (scanned 50274 files, scanned dirents: 50000, unknown dirents: 0) [419] rate: 0.066 kiops time: 35.8s found: 17 (scanned 2345 files, scanned dirents: 0, unknown dirents: 0) [423] rate: 1.401 kiops time: 35.8s found: 15 (scanned 50113 files, scanned dirents: 50000, unknown dirents: 0) [426] rate: 1.427 kiops time: 35.8s found: 25 (scanned 51075 files, scanned dirents: 50000, unknown dirents: 0) [386] rate: 2.761 kiops time: 35.8s found: 13 (scanned 98801 files, scanned dirents: 100000, unknown dirents: 0) [396] rate: 1.422 kiops time: 35.8s found: 42 (scanned 50886 files, scanned dirents: 50000, unknown dirents: 0) [400] rate: 5.453 kiops time: 35.8s found: 50 (scanned 195150 files, scanned dirents: 200000, unknown dirents: 0) [406] rate: 0.072 kiops time: 35.8s found: 18 (scanned 2570 files, scanned dirents: 0, unknown dirents: 0) [429] rate: 0.065 kiops time: 35.8s found: 29 (scanned 2327 files, scanned dirents: 0, unknown dirents: 0) [428] rate: 0.061 kiops time: 35.8s found: 18 (scanned 2173 files, scanned dirents: 0, unknown dirents: 0) [431] rate: 0.067 kiops time: 35.8s found: 31 (scanned 2407 files, scanned dirents: 0, unknown dirents: 0) [421] rate: 0.084 kiops time: 35.8s found: 35 (scanned 3000 files, scanned dirents: 0, unknown dirents: 0) [408] rate: 2.752 kiops time: 35.8s found: 22 (scanned 98491 files, scanned dirents: 100000, unknown dirents: 0) [414] rate: 1.410 kiops time: 35.8s found: 14 (scanned 50445 files, scanned dirents: 50000, unknown dirents: 0) [418] rate: 5.458 kiops time: 35.8s found: 25 (scanned 195340 files, scanned dirents: 200000, unknown dirents: 0) [425] rate: 0.068 kiops time: 35.8s found: 22 (scanned 2439 files, scanned dirents: 0, unknown dirents: 0) [424] rate: 0.057 kiops time: 35.8s found: 18 (scanned 2036 files, scanned dirents: 0, unknown dirents: 0) [412] rate: 0.051 kiops time: 35.8s found: 20 (scanned 1808 files, scanned dirents: 0, unknown dirents: 0) [417] rate: 0.062 kiops time: 35.8s found: 19 (scanned 2227 files, scanned dirents: 0, unknown dirents: 0) [422] rate: 1.411 kiops time: 35.8s found: 19 (scanned 50501 files, scanned dirents: 50000, unknown dirents: 0) [427] rate: 4.106 kiops time: 35.8s found: 16 (scanned 146937 files, scanned dirents: 150000, unknown dirents: 0) [430] rate: 0.065 kiops time: 35.8s found: 18 (scanned 2335 files, scanned dirents: 0, unknown dirents: 0) [415] rate: 1.407 kiops time: 35.8s found: 19 (scanned 50358 files, scanned dirents: 50000, unknown dirents: 0) [434] rate: 4.105 kiops time: 35.8s found: 28 (scanned 146906 files, scanned dirents: 150000, unknown dirents: 0) [444] rate: 0.081 kiops time: 35.8s found: 20 (scanned 2883 files, scanned dirents: 0, unknown dirents: 0) [435] rate: 0.074 kiops time: 35.8s found: 9 (scanned 2634 files, scanned dirents: 0, unknown dirents: 0) [432] rate: 1.427 kiops time: 35.8s found: 28 (scanned 51065 files, scanned dirents: 50000, unknown dirents: 0) [445] rate: 0.070 kiops time: 35.8s found: 22 (scanned 2523 files, scanned dirents: 0, unknown dirents: 0) [446] rate: 1.435 kiops time: 35.8s found: 35 (scanned 51365 files, scanned dirents: 50000, unknown dirents: 0) [437] rate: 0.092 kiops time: 35.8s found: 27 (scanned 3284 files, scanned dirents: 0, unknown dirents: 0) [449] rate: 5.438 kiops time: 35.8s found: 33 (scanned 194616 files, scanned dirents: 200000, unknown dirents: 0) [467] rate: 1.405 kiops time: 35.8s found: 11 (scanned 50258 files, scanned dirents: 50000, unknown dirents: 0) [457] rate: 1.427 kiops time: 35.8s found: 20 (scanned 51073 files, scanned dirents: 50000, unknown dirents: 0) [436] rate: 0.080 kiops time: 35.8s found: 30 (scanned 2861 files, scanned dirents: 0, unknown dirents: 0) [439] rate: 0.060 kiops time: 35.8s found: 28 (scanned 2140 files, scanned dirents: 0, unknown dirents: 0) [454] rate: 0.067 kiops time: 35.8s found: 20 (scanned 2388 files, scanned dirents: 0, unknown dirents: 0) [455] rate: 0.087 kiops time: 35.8s found: 33 (scanned 3112 files, scanned dirents: 0, unknown dirents: 0) [441] rate: 1.416 kiops time: 35.8s found: 33 (scanned 50691 files, scanned dirents: 50000, unknown dirents: 0) [447] rate: 0.097 kiops time: 35.8s found: 26 (scanned 3468 files, scanned dirents: 0, unknown dirents: 0) [448] rate: 0.067 kiops time: 35.8s found: 9 (scanned 2385 files, scanned dirents: 0, unknown dirents: 0) [433] rate: 2.768 kiops time: 35.8s found: 34 (scanned 99066 files, scanned dirents: 100000, unknown dirents: 0) [443] rate: 4.088 kiops time: 35.8s found: 24 (scanned 146296 files, scanned dirents: 150000, unknown dirents: 0) [450] rate: 1.422 kiops time: 35.8s found: 42 (scanned 50908 files, scanned dirents: 50000, unknown dirents: 0) [453] rate: 1.408 kiops time: 35.8s found: 35 (scanned 50397 files, scanned dirents: 50000, unknown dirents: 0) [438] rate: 1.428 kiops time: 35.8s found: 27 (scanned 51090 files, scanned dirents: 50000, unknown dirents: 0) [474] rate: 0.075 kiops time: 35.8s found: 34 (scanned 2685 files, scanned dirents: 0, unknown dirents: 0) [442] rate: 0.080 kiops time: 35.8s found: 30 (scanned 2869 files, scanned dirents: 0, unknown dirents: 0) [451] rate: 1.417 kiops time: 35.8s found: 35 (scanned 50710 files, scanned dirents: 50000, unknown dirents: 0) [452] rate: 1.411 kiops time: 35.8s found: 39 (scanned 50515 files, scanned dirents: 50000, unknown dirents: 0) [479] rate: 2.769 kiops time: 35.8s found: 694 (scanned 99106 files, scanned dirents: 100000, unknown dirents: 0) [464] rate: 2.780 kiops time: 35.8s found: 76 (scanned 99481 files, scanned dirents: 100000, unknown dirents: 0) [440] rate: 1.419 kiops time: 35.8s found: 23 (scanned 50773 files, scanned dirents: 50000, unknown dirents: 0) [456] rate: 0.078 kiops time: 35.8s found: 26 (scanned 2785 files, scanned dirents: 0, unknown dirents: 0) [469] rate: 1.425 kiops time: 35.8s found: 17 (scanned 50988 files, scanned dirents: 50000, unknown dirents: 0) [462] rate: 1.418 kiops time: 35.8s found: 21 (scanned 50755 files, scanned dirents: 50000, unknown dirents: 0) [476] rate: 2.745 kiops time: 35.8s found: 13 (scanned 98257 files, scanned dirents: 100000, unknown dirents: 0) [468] rate: 2.770 kiops time: 35.8s found: 56 (scanned 99132 files, scanned dirents: 100000, unknown dirents: 0) [471] rate: 2.766 kiops time: 35.8s found: 21 (scanned 98993 files, scanned dirents: 100000, unknown dirents: 0) [458] rate: 0.070 kiops time: 35.8s found: 14 (scanned 2492 files, scanned dirents: 0, unknown dirents: 0) [466] rate: 0.089 kiops time: 35.8s found: 26 (scanned 3190 files, scanned dirents: 0, unknown dirents: 0) [478] rate: 0.077 kiops time: 35.8s found: 18 (scanned 2773 files, scanned dirents: 0, unknown dirents: 0) [461] rate: 0.057 kiops time: 35.8s found: 19 (scanned 2052 files, scanned dirents: 0, unknown dirents: 0) [465] rate: 2.768 kiops time: 35.8s found: 39 (scanned 99074 files, scanned dirents: 100000, unknown dirents: 0) [470] rate: 1.426 kiops time: 35.8s found: 31 (scanned 51019 files, scanned dirents: 100000, unknown dirents: 0) [475] rate: 0.062 kiops time: 35.8s found: 27 (scanned 2228 files, scanned dirents: 0, unknown dirents: 0) [459] rate: 0.080 kiops time: 35.8s found: 30 (scanned 2848 files, scanned dirents: 0, unknown dirents: 0) [460] rate: 0.085 kiops time: 35.8s found: 14 (scanned 3050 files, scanned dirents: 0, unknown dirents: 0) [463] rate: 0.072 kiops time: 35.8s found: 20 (scanned 2564 files, scanned dirents: 0, unknown dirents: 0) [472] rate: 0.108 kiops time: 35.8s found: 29 (scanned 3861 files, scanned dirents: 0, unknown dirents: 0) [473] rate: 2.758 kiops time: 35.8s found: 18 (scanned 98717 files, scanned dirents: 100000, unknown dirents: 0) [477] rate: 2.768 kiops time: 35.8s found: 22 (scanned 99057 files, scanned dirents: 100000, unknown dirents: 0) [DONE] rate: 706.735 kiops time: 35.8s found: 30886 (scanned 25293284 files, scanned dirents: 25293774, unknown dirents: 0) MATCHED 30886/25293284 time: 1563323941.405956615 [IOR EASY READ] time: 1563323941.407197207 IOR-3.2.0: MPI Coordinated Test of Parallel I/O Began : Tue Jul 16 20:39:02 2019 Command line : ./bin//ior --posix.odirect -t 1m -b 20000m -F -r -R -C -Q 1 -g -G 27 -k -e -o ./datadir_10sl//ior_easy/ior_file_easy -O stoneWallingStatusFile=./datadir_10sl//ior_easy/stonewall Machine : Linux e10u22.int.janelia.org TestID : 0 StartTime : Tue Jul 16 20:39:02 2019 Path : /misc/weka/wekaFS_1/io-500-script/datadir_10sl/ior_easy FS : 50.0 TiB Used FS: 12.6% Inodes: 858.3 Mi Used Inodes: 3.9% Options: api : POSIX apiVersion : test filename : ./datadir_10sl//ior_easy/ior_file_easy access : file-per-process type : independent segments : 1 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 tasks : 480 clients per node : 48 repetitions : 1 xfersize : 1 MiB blocksize : 19.53 GiB aggregate filesize : 9.16 TiB Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- WARNING: Expected aggregate file size = 10066329600000. WARNING: Stat() of aggregate file size = 4443277885440. WARNING: Using actual aggregate bytes moved = 4443277885440. read 12153 20480000 1024.00 0.031221 348.65 0.001362 348.68 0 Max Read: 12152.81 MiB/sec (12743.15 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum read 12152.81 12152.81 12152.81 0.00 12152.81 12152.81 12152.81 0.00 348.67975 0 480 48 1 1 1 1 0 0 1 20971520000 1048576 4237440.0 POSIX 0 Finished : Tue Jul 16 20:44:50 2019 [MDTEST EASY STAT] time: 1563324291.085552101 -- started at 07/16/2019 20:44:51 -- mdtest-1.9.3 was launched with 480 total task(s) on 10 node(s) Command line used: ./bin//mdtest "--posix.odirect" "-n" "50000" "-u" "-L" "-N=48" "-T" "-F" "-d" "./datadir_10sl//mdt_easy" "-x" "./datadir_10sl//mdt_easy-stonewall" Path: /misc/weka/wekaFS_1/io-500-script/datadir_10sl FS: 50.0 TiB Used FS: 12.6% Inodes: 858.3 Mi Used Inodes: 3.9% 480 tasks, 24000000 files SUMMARY rate: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 0.000 0.000 0.000 0.000 File stat : 761299.902 761298.094 761298.992 0.452 File read : 0.000 0.000 0.000 0.000 File removal : 0.000 0.000 0.000 0.000 Tree creation : 0.000 0.000 0.000 0.000 Tree removal : 0.000 0.000 0.000 0.000 -- finished at 07/16/2019 20:45:23 -- [IOR HARD READ] time: 1563324323.516120919 IOR-3.2.0: MPI Coordinated Test of Parallel I/O Began : Tue Jul 16 20:45:24 2019 Command line : ./bin//ior --posix.odirect -s 60000 -r -R -C -Q 1 -g -G 27 -k -e -t 47008 -b 47008 -s 60000 --posix.odirect -o ./datadir_10sl//ior_hard/IOR_file -O stoneWallingStatusFile=./datadir_10sl//ior_hard/stonewall Machine : Linux e10u22.int.janelia.org TestID : 0 StartTime : Tue Jul 16 20:45:24 2019 Path : /misc/weka/wekaFS_1/io-500-script/datadir_10sl/ior_hard FS : 50.0 TiB Used FS: 12.6% Inodes: 858.3 Mi Used Inodes: 3.9% Options: api : POSIX apiVersion : test filename : ./datadir_10sl//ior_hard/IOR_file access : single-shared-file type : independent segments : 60000 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 tasks : 480 clients per node : 48 repetitions : 1 xfersize : 47008 bytes blocksize : 47008 bytes aggregate filesize : 1.23 TiB Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- read 6623 45.91 45.91 0.003464 194.94 0.000745 194.94 0 Max Read: 6623.08 MiB/sec (6944.81 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum read 6623.08 6623.08 6623.08 0.00 147736.67 147736.67 147736.67 0.00 194.94144 0 480 48 1 0 1 1 0 0 60000 47008 47008 1291113.2 POSIX 0 Finished : Tue Jul 16 20:48:38 2019 [MDTEST HARD STAT] time: 1563324519.187889804 -- started at 07/16/2019 20:48:40 -- mdtest-1.9.3 was launched with 480 total task(s) on 10 node(s) Command line used: ./bin//mdtest "--posix.odirect" "-N=48" "-n" "50000" "-T" "-t" "-F" "-w" "3901" "-e" "3901" "-d" "./datadir_10sl//mdt_hard" "-x" "./datadir_10sl//mdt_hard-stonewall" Path: /misc/weka/wekaFS_1/io-500-script/datadir_10sl FS: 50.0 TiB Used FS: 12.6% Inodes: 858.3 Mi Used Inodes: 3.9% 480 tasks, 24000000 files SUMMARY rate: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 0.000 0.000 0.000 0.000 File stat : 25679.779 25655.635 25675.931 0.997 File read : 0.000 0.000 0.000 0.000 File removal : 0.000 0.000 0.000 0.000 Tree creation : 0.000 0.000 0.000 0.000 Tree removal : 0.000 0.000 0.000 0.000 -- finished at 07/16/2019 20:49:26 -- [MDTEST EASY DELETE] time: 1563324566.582892748 -- started at 07/16/2019 20:49:27 -- mdtest-1.9.3 was launched with 480 total task(s) on 10 node(s) Command line used: ./bin//mdtest "--posix.odirect" "-n" "50000" "-u" "-L" "-N=48" "-r" "-F" "-d" "./datadir_10sl//mdt_easy" "-x" "./datadir_10sl//mdt_easy-stonewall" Path: /misc/weka/wekaFS_1/io-500-script/datadir_10sl FS: 50.0 TiB Used FS: 12.6% Inodes: 858.3 Mi Used Inodes: 3.9% 480 tasks, 24000000 files SUMMARY rate: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 0.000 0.000 0.000 0.000 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 38875.761 38874.432 38875.717 0.092 Tree creation : 0.000 0.000 0.000 0.000 Tree removal : 0.677 0.677 0.677 0.000 -- finished at 07/16/2019 20:59:48 -- [MDTEST HARD READ] time: 1563325188.451759610 -- started at 07/16/2019 20:59:49 -- mdtest-1.9.3 was launched with 480 total task(s) on 10 node(s) Command line used: ./bin//mdtest "--posix.odirect" "-N=48" "-n" "50000" "-E" "-t" "-F" "-w" "3901" "-e" "3901" "-d" "./datadir_10sl//mdt_hard" "-x" "./datadir_10sl//mdt_hard-stonewall" Path: /misc/weka/wekaFS_1/io-500-script/datadir_10sl FS: 50.0 TiB Used FS: 12.4% Inodes: 858.3 Mi Used Inodes: 0.9% 480 tasks, 24000000 files SUMMARY rate: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 0.000 0.000 0.000 0.000 File stat : 0.000 0.000 0.000 0.000 File read : 32920.174 32911.778 32920.077 0.381 File removal : 0.000 0.000 0.000 0.000 Tree creation : 0.000 0.000 0.000 0.000 Tree removal : 0.000 0.000 0.000 0.000 -- finished at 07/16/2019 21:00:25 -- [MDTEST HARD DELETE] time: 1563325225.640436066 -- started at 07/16/2019 21:00:26 -- mdtest-1.9.3 was launched with 480 total task(s) on 10 node(s) Command line used: ./bin//mdtest "--posix.odirect" "-N=48" "-n" "50000" "-r" "-t" "-F" "-w" "3901" "-e" "3901" "-d" "./datadir_10sl//mdt_hard" "-x" "./datadir_10sl//mdt_hard-stonewall" Path: /misc/weka/wekaFS_1/io-500-script/datadir_10sl FS: 50.0 TiB Used FS: 12.4% Inodes: 858.3 Mi Used Inodes: 0.9% 480 tasks, 24000000 files SUMMARY rate: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 0.000 0.000 0.000 0.000 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 3676.182 3676.102 3676.175 0.007 Tree creation : 0.000 0.000 0.000 0.000 Tree removal : 1.307 1.307 1.307 0.000 -- finished at 07/16/2019 21:05:51 -- Deleting IO-500 ./datadir_10sl/ time: 1563325551.616956284 [END TIME] 2019-07-16 21:06:08-04:00 [IO-500 COMPLETED] Result also in config-10sl-result-1563322305.txt; Now use io-500-score.sh to compute the score