- ior_easy_read
-
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began : Fri Jul 10 17:29:02 2020
Command line : /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/ior -r -R -a POSIX -t 4m -v -b 992000m -F -i 1 -C -Q 1 -g -G 27 -k -e -o ./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_easy/ior_file_easy -O stoneWallingStatusFile=./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_easy/stonewall
Machine : Linux sdumont5000
Start time skew across all tasks: 0.00 sec
TestID : 0
StartTime : Fri Jul 10 17:29:02 2020
Path : /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_easy
FS : 1680.3 TiB Used FS: 46.2% Inodes: 1737.3 Mi Used Inodes: 51.9%
Participating tasks: 240
Using reorderTasks '-C' (useful to avoid read cache in client)
Options:
api : POSIX
apiVersion :
test filename : ./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_easy/ior_file_easy
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : constant task offset
task offset : 1
nodes : 10
tasks : 240
clients per node : 24
repetitions : 1
xfersize : 4 MiB
blocksize : 968.75 GiB
aggregate filesize : 227.05 TiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
Commencing read performance test: Fri Jul 10 17:29:02 2020
WARNING: Expected aggregate file size = 249644974080000.
WARNING: Stat() of aggregate file size = 41060558438400.
WARNING: Using actual aggregate bytes moved = 41060558438400.
read 14898 3725 0.010598 1015808000 4096 0.017396 2628.36 0.011767 2628.39 0
Max Read: 14898.26 MiB/sec (15621.95 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
read 14898.26 14898.26 14898.26 0.00 3724.56 3724.56 3724.56 0.00 2628.38797 NA NA 0 240 24 1 1 1 1 0 0 1 1040187392000 4194304 39158400.0 POSIX 0
Finished : Fri Jul 10 18:12:50 2020
- ior_easy_write
-
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began : Fri Jul 10 16:19:06 2020
Command line : /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/ior -w -a POSIX -t 4m -v -b 992000m -F -i 1 -C -Q 1 -g -G 27 -k -e -o ./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_easy/ior_file_easy -O stoneWallingStatusFile=./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_easy/stonewall -O stoneWallingWearOut=1 -D 300
Machine : Linux sdumont5000
Start time skew across all tasks: 0.00 sec
TestID : 0
StartTime : Fri Jul 10 16:19:06 2020
Path : /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_easy
FS : 1680.3 TiB Used FS: 44.0% Inodes: 1738.4 Mi Used Inodes: 51.9%
Participating tasks: 240
Using reorderTasks '-C' (useful to avoid read cache in client)
Options:
api : POSIX
apiVersion :
test filename : ./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_easy/ior_file_easy
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : constant task offset
task offset : 1
nodes : 10
tasks : 240
clients per node : 24
repetitions : 1
xfersize : 4 MiB
blocksize : 968.75 GiB
aggregate filesize : 227.05 TiB
stonewallingTime : 300
stoneWallingWearOut : 1
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
Commencing write performance test: Fri Jul 10 16:19:06 2020
3: stonewalling pairs accessed: 5316
7: stonewalling pairs accessed: 5682
8: stonewalling pairs accessed: 5474
220: stonewalling pairs accessed: 5770
149: stonewalling pairs accessed: 5409
24: stonewalling pairs accessed: 5714
101: stonewalling pairs accessed: 5437
72: stonewalling pairs accessed: 5572
50: stonewalling pairs accessed: 5387
120: stonewalling pairs accessed: 5705
174: stonewalling pairs accessed: 5818
194: stonewalling pairs accessed: 5912
11: stonewalling pairs accessed: 5421
16: stonewalling pairs accessed: 5387
19: stonewalling pairs accessed: 4979
22: stonewalling pairs accessed: 5464
13: stonewalling pairs accessed: 5661
9: stonewalling pairs accessed: 5442
15: stonewalling pairs accessed: 5500
1: stonewalling pairs accessed: 5314
26: stonewalling pairs accessed: 4948
29: stonewalling pairs accessed: 5540
30: stonewalling pairs accessed: 5543
31: stonewalling pairs accessed: 5412
153: stonewalling pairs accessed: 5498
32: stonewalling pairs accessed: 5375
157: stonewalling pairs accessed: 5459
34: stonewalling pairs accessed: 5400
165: stonewalling pairs accessed: 5586
35: stonewalling pairs accessed: 5326
166: stonewalling pairs accessed: 5531
39: stonewalling pairs accessed: 5355
145: stonewalling pairs accessed: 5728
40: stonewalling pairs accessed: 5312
146: stonewalling pairs accessed: 5538
45: stonewalling pairs accessed: 5329
152: stonewalling pairs accessed: 5490
46: stonewalling pairs accessed: 5306
161: stonewalling pairs accessed: 5498
47: stonewalling pairs accessed: 5217
162: stonewalling pairs accessed: 4559
36: stonewalling pairs accessed: 5359
156: stonewalling pairs accessed: 5418
41: stonewalling pairs accessed: 5235
158: stonewalling pairs accessed: 5496
42: stonewalling pairs accessed: 5329
27: stonewalling pairs accessed: 5537
28: stonewalling pairs accessed: 5584
33: stonewalling pairs accessed: 5374
38: stonewalling pairs accessed: 5347
43: stonewalling pairs accessed: 5282
25: stonewalling pairs accessed: 5546
37: stonewalling pairs accessed: 5310
176: stonewalling pairs accessed: 5447
44: stonewalling pairs accessed: 5309
169: stonewalling pairs accessed: 5595
163: stonewalling pairs accessed: 5517
164: stonewalling pairs accessed: 5500
236: stonewalling pairs accessed: 5651
217: stonewalling pairs accessed: 5688
122: stonewalling pairs accessed: 5890
124: stonewalling pairs accessed: 34100
128: stonewalling pairs accessed: 5516
129: stonewalling pairs accessed: 5556
106: stonewalling pairs accessed: 5269
130: stonewalling pairs accessed: 5753
115: stonewalling pairs accessed: 5447
131: stonewalling pairs accessed: 5946
119: stonewalling pairs accessed: 5349
132: stonewalling pairs accessed: 5883
96: stonewalling pairs accessed: 5423
136: stonewalling pairs accessed: 5727
104: stonewalling pairs accessed: 5271
125: stonewalling pairs accessed: 5539
141: stonewalling pairs accessed: 5991
127: stonewalling pairs accessed: 5640
142: stonewalling pairs accessed: 5846
126: stonewalling pairs accessed: 5641
140: stonewalling pairs accessed: 5819
135: stonewalling pairs accessed: 5848
138: stonewalling pairs accessed: 5826
139: stonewalling pairs accessed: 5386
134: stonewalling pairs accessed: 5837
137: stonewalling pairs accessed: 5932
123: stonewalling pairs accessed: 5596
55: stonewalling pairs accessed: 5698
56: stonewalling pairs accessed: 5613
58: stonewalling pairs accessed: 5532
63: stonewalling pairs accessed: 5700
67: stonewalling pairs accessed: 5653
65: stonewalling pairs accessed: 5552
52: stonewalling pairs accessed: 5724
49: stonewalling pairs accessed: 5565
54: stonewalling pairs accessed: 5830
197: stonewalling pairs accessed: 6088
199: stonewalling pairs accessed: 5923
201: stonewalling pairs accessed: 6031
214: stonewalling pairs accessed: 40790
215: stonewalling pairs accessed: 5679
209: stonewalling pairs accessed: 5580
193: stonewalling pairs accessed: 6100
196: stonewalling pairs accessed: 6172
192: stonewalling pairs accessed: 6111
205: stonewalling pairs accessed: 5729
210: stonewalling pairs accessed: 5645
74: stonewalling pairs accessed: 5034
75: stonewalling pairs accessed: 5339
73: stonewalling pairs accessed: 5459
77: stonewalling pairs accessed: 5369
80: stonewalling pairs accessed: 5306
84: stonewalling pairs accessed: 5574
87: stonewalling pairs accessed: 5653
89: stonewalling pairs accessed: 5486
90: stonewalling pairs accessed: 5531
91: stonewalling pairs accessed: 5560
92: stonewalling pairs accessed: 5572
14: stonewalling pairs accessed: 5433
17: stonewalling pairs accessed: 5568
181: stonewalling pairs accessed: 5515
219: stonewalling pairs accessed: 5708
226: stonewalling pairs accessed: 5655
110: stonewalling pairs accessed: 5331
118: stonewalling pairs accessed: 5347
203: stonewalling pairs accessed: 5848
88: stonewalling pairs accessed: 5453
211: stonewalling pairs accessed: 5771
212: stonewalling pairs accessed: 5724
4: stonewalling pairs accessed: 5389
6: stonewalling pairs accessed: 5484
0: stonewalling pairs accessed: 5768
12: stonewalling pairs accessed: 5066
23: stonewalling pairs accessed: 5618
5: stonewalling pairs accessed: 5221
18: stonewalling pairs accessed: 5396
48: stonewalling pairs accessed: 5594
64: stonewalling pairs accessed: 5654
61: stonewalling pairs accessed: 5555
62: stonewalling pairs accessed: 5653
70: stonewalling pairs accessed: 5520
71: stonewalling pairs accessed: 5617
69: stonewalling pairs accessed: 5783
57: stonewalling pairs accessed: 5403
21: stonewalling pairs accessed: 5440
2: stonewalling pairs accessed: 5409
10: stonewalling pairs accessed: 5566
20: stonewalling pairs accessed: 5358
179: stonewalling pairs accessed: 5584
183: stonewalling pairs accessed: 5653
202: stonewalling pairs accessed: 5965
208: stonewalling pairs accessed: 5615
206: stonewalling pairs accessed: 5572
195: stonewalling pairs accessed: 5864
207: stonewalling pairs accessed: 5656
204: stonewalling pairs accessed: 5181
173: stonewalling pairs accessed: 5364
185: stonewalling pairs accessed: 5638
175: stonewalling pairs accessed: 5510
221: stonewalling pairs accessed: 5871
225: stonewalling pairs accessed: 5619
231: stonewalling pairs accessed: 5594
234: stonewalling pairs accessed: 5555
222: stonewalling pairs accessed: 5969
227: stonewalling pairs accessed: 5666
229: stonewalling pairs accessed: 5691
97: stonewalling pairs accessed: 5451
111: stonewalling pairs accessed: 5296
108: stonewalling pairs accessed: 5324
99: stonewalling pairs accessed: 5453
112: stonewalling pairs accessed: 5389
116: stonewalling pairs accessed: 5330
51: stonewalling pairs accessed: 5608
154: stonewalling pairs accessed: 5675
167: stonewalling pairs accessed: 5601
148: stonewalling pairs accessed: 5692
147: stonewalling pairs accessed: 5611
160: stonewalling pairs accessed: 5484
100: stonewalling pairs accessed: 5307
113: stonewalling pairs accessed: 5304
102: stonewalling pairs accessed: 5418
114: stonewalling pairs accessed: 5379
95: stonewalling pairs accessed: 5525
85: stonewalling pairs accessed: 5598
98: stonewalling pairs accessed: 5550
103: stonewalling pairs accessed: 4910
150: stonewalling pairs accessed: 5612
76: stonewalling pairs accessed: 5485
81: stonewalling pairs accessed: 5586
155: stonewalling pairs accessed: 5555
159: stonewalling pairs accessed: 5573
151: stonewalling pairs accessed: 5565
79: stonewalling pairs accessed: 5752
144: stonewalling pairs accessed: 5776
168: stonewalling pairs accessed: 5530
177: stonewalling pairs accessed: 5366
59: stonewalling pairs accessed: 5981
60: stonewalling pairs accessed: 5607
66: stonewalling pairs accessed: 5613
68: stonewalling pairs accessed: 5659
53: stonewalling pairs accessed: 5697
198: stonewalling pairs accessed: 6033
200: stonewalling pairs accessed: 5925
78: stonewalling pairs accessed: 5405
82: stonewalling pairs accessed: 5414
83: stonewalling pairs accessed: 5526
86: stonewalling pairs accessed: 5495
93: stonewalling pairs accessed: 5496
94: stonewalling pairs accessed: 5603
213: stonewalling pairs accessed: 5783
105: stonewalling pairs accessed: 5479
107: stonewalling pairs accessed: 5304
109: stonewalling pairs accessed: 5325
117: stonewalling pairs accessed: 5411
121: stonewalling pairs accessed: 5519
133: stonewalling pairs accessed: 5858
143: stonewalling pairs accessed: 5797
216: stonewalling pairs accessed: 5837
223: stonewalling pairs accessed: 5361
224: stonewalling pairs accessed: 5723
233: stonewalling pairs accessed: 5120
235: stonewalling pairs accessed: 5651
239: stonewalling pairs accessed: 5636
188: stonewalling pairs accessed: 5515
178: stonewalling pairs accessed: 5609
182: stonewalling pairs accessed: 5497
237: stonewalling pairs accessed: 5624
228: stonewalling pairs accessed: 5608
230: stonewalling pairs accessed: 5633
232: stonewalling pairs accessed: 5527
238: stonewalling pairs accessed: 5567
218: stonewalling pairs accessed: 5744
180: stonewalling pairs accessed: 5513
184: stonewalling pairs accessed: 5523
191: stonewalling pairs accessed: 5504
171: stonewalling pairs accessed: 5512
186: stonewalling pairs accessed: 5548
187: stonewalling pairs accessed: 5557
189: stonewalling pairs accessed: 5536
172: stonewalling pairs accessed: 5448
190: stonewalling pairs accessed: 5446
170: stonewalling pairs accessed: 5582
stonewalling pairs accessed min: 4559 max: 40790 -- min data: 17.8 GiB mean data: 22.7 GiB time: 300.3s
WARNING: Expected aggregate file size = 249644974080000.
WARNING: Stat() of aggregate file size = 41060558438400.
WARNING: Using actual aggregate bytes moved = 41060558438400.
WARNING: maybe caused by deadlineForStonewalling
write 17298 4325 0.008887 1015808000 4096 0.020977 2263.72 0.010005 2263.75 0
Max Write: 17298.01 MiB/sec (18138.28 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 17298.01 17298.01 17298.01 0.00 4324.50 4324.50 4324.50 0.00 2263.75174 300.35 18596.44 0 240 24 1 1 1 1 0 0 1 1040187392000 4194304 39158400.0 POSIX 0
Finished : Fri Jul 10 16:56:50 2020
- ior_hard_read
-
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began : Fri Jul 10 18:13:20 2020
Command line : /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/ior -r -R -s 8000 -a POSIX -v -i 1 -C -Q 1 -g -G 27 -k -e -t 47008 -b 47008 -o ./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_hard/IOR_file -O stoneWallingStatusFile=./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_hard/stonewall
Machine : Linux sdumont5000
Start time skew across all tasks: 0.00 sec
TestID : 0
StartTime : Fri Jul 10 18:13:20 2020
Path : /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_hard
FS : 1680.3 TiB Used FS: 46.2% Inodes: 1737.3 Mi Used Inodes: 51.9%
Participating tasks: 240
Using reorderTasks '-C' (useful to avoid read cache in client)
Options:
api : POSIX
apiVersion :
test filename : ./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_hard/IOR_file
access : single-shared-file
type : independent
segments : 8000
ordering in a file : sequential
ordering inter file : constant task offset
task offset : 1
nodes : 10
tasks : 240
clients per node : 24
repetitions : 1
xfersize : 47008 bytes
blocksize : 47008 bytes
aggregate filesize : 84.06 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
Commencing read performance test: Fri Jul 10 18:13:20 2020
read 1596.67 35630 53.89 45.91 45.91 0.009558 53.89 0.012140 53.91 0
Max Read: 1596.67 MiB/sec (1674.23 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
read 1596.67 1596.67 1596.67 0.00 35615.92 35615.92 35615.92 0.00 53.90847 NA NA 0 240 24 1 0 1 1 0 0 8000 47008 47008 86074.2 POSIX 0
Finished : Fri Jul 10 18:14:14 2020
- ior_hard_write
-
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began : Fri Jul 10 17:04:18 2020
Command line : /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/ior -w -s 8000 -a POSIX -v -i 1 -C -Q 1 -g -G 27 -k -e -t 47008 -b 47008 -o ./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_hard/IOR_file -O stoneWallingStatusFile=./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_hard/stonewall -O stoneWallingWearOut=1 -D 300
Machine : Linux sdumont5000
Start time skew across all tasks: 0.00 sec
TestID : 0
StartTime : Fri Jul 10 17:04:18 2020
Path : /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_hard
FS : 1680.3 TiB Used FS: 46.2% Inodes: 1737.8 Mi Used Inodes: 51.9%
Participating tasks: 240
Using reorderTasks '-C' (useful to avoid read cache in client)
Options:
api : POSIX
apiVersion :
test filename : ./posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/ior_hard/IOR_file
access : single-shared-file
type : independent
segments : 8000
ordering in a file : sequential
ordering inter file : constant task offset
task offset : 1
nodes : 10
tasks : 240
clients per node : 24
repetitions : 1
xfersize : 47008 bytes
blocksize : 47008 bytes
aggregate filesize : 84.06 GiB
stonewallingTime : 300
stoneWallingWearOut : 1
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
Commencing write performance test: Fri Jul 10 17:04:18 2020
140: stonewalling pairs accessed: 8000
141: stonewalling pairs accessed: 8000
143: stonewalling pairs accessed: 8000
231: stonewalling pairs accessed: 8000
233: stonewalling pairs accessed: 8000
234: stonewalling pairs accessed: 8000
221: stonewalling pairs accessed: 8000
222: stonewalling pairs accessed: 8000
229: stonewalling pairs accessed: 8000
225: stonewalling pairs accessed: 8000
226: stonewalling pairs accessed: 8000
227: stonewalling pairs accessed: 8000
236: stonewalling pairs accessed: 8000
237: stonewalling pairs accessed: 8000
238: stonewalling pairs accessed: 8000
239: stonewalling pairs accessed: 8000
219: stonewalling pairs accessed: 8000
235: stonewalling pairs accessed: 8000
232: stonewalling pairs accessed: 8000
142: stonewalling pairs accessed: 2342
212: stonewalling pairs accessed: 2252
152: stonewalling pairs accessed: 2312
15: stonewalling pairs accessed: 2235
64: stonewalling pairs accessed: 1309
3: stonewalling pairs accessed: 1354
5: stonewalling pairs accessed: 6964
10: stonewalling pairs accessed: 6964
6: stonewalling pairs accessed: 6964
7: stonewalling pairs accessed: 6964
8: stonewalling pairs accessed: 6964
198: stonewalling pairs accessed: 1591
202: stonewalling pairs accessed: 1576
21: stonewalling pairs accessed: 4666
145: stonewalling pairs accessed: 1067
164: stonewalling pairs accessed: 2312
166: stonewalling pairs accessed: 2312
167: stonewalling pairs accessed: 2312
122: stonewalling pairs accessed: 2213
123: stonewalling pairs accessed: 2213
98: stonewalling pairs accessed: 1373
150: stonewalling pairs accessed: 1333
67: stonewalling pairs accessed: 2301
58: stonewalling pairs accessed: 1580
208: stonewalling pairs accessed: 2252
163: stonewalling pairs accessed: 2033
62: stonewalling pairs accessed: 2300
204: stonewalling pairs accessed: 2251
68: stonewalling pairs accessed: 2301
209: stonewalling pairs accessed: 2252
144: stonewalling pairs accessed: 1820
148: stonewalling pairs accessed: 1597
63: stonewalling pairs accessed: 2300
69: stonewalling pairs accessed: 2301
87: stonewalling pairs accessed: 1984
70: stonewalling pairs accessed: 2301
37: stonewalling pairs accessed: 2181
128: stonewalling pairs accessed: 2210
132: stonewalling pairs accessed: 1764
216: stonewalling pairs accessed: 2165
218: stonewalling pairs accessed: 2165
223: stonewalling pairs accessed: 2165
228: stonewalling pairs accessed: 2165
230: stonewalling pairs accessed: 2165
108: stonewalling pairs accessed: 1783
115: stonewalling pairs accessed: 2233
33: stonewalling pairs accessed: 2159
90: stonewalling pairs accessed: 1790
160: stonewalling pairs accessed: 1680
124: stonewalling pairs accessed: 1617
66: stonewalling pairs accessed: 1688
154: stonewalling pairs accessed: 1799
28: stonewalling pairs accessed: 1175
118: stonewalling pairs accessed: 1275
35: stonewalling pairs accessed: 2179
42: stonewalling pairs accessed: 2744
171: stonewalling pairs accessed: 1855
138: stonewalling pairs accessed: 2339
116: stonewalling pairs accessed: 2365
61: stonewalling pairs accessed: 1685
9: stonewalling pairs accessed: 2113
32: stonewalling pairs accessed: 1172
139: stonewalling pairs accessed: 2339
194: stonewalling pairs accessed: 1759
203: stonewalling pairs accessed: 1759
168: stonewalling pairs accessed: 1852
172: stonewalling pairs accessed: 1417
134: stonewalling pairs accessed: 1783
129: stonewalling pairs accessed: 1757
41: stonewalling pairs accessed: 2326
51: stonewalling pairs accessed: 1393
54: stonewalling pairs accessed: 2155
56: stonewalling pairs accessed: 1906
121: stonewalling pairs accessed: 1166
176: stonewalling pairs accessed: 1623
97: stonewalling pairs accessed: 1378
190: stonewalling pairs accessed: 1251
73: stonewalling pairs accessed: 1300
100: stonewalling pairs accessed: 1311
81: stonewalling pairs accessed: 2285
195: stonewalling pairs accessed: 2253
74: stonewalling pairs accessed: 1016
187: stonewalling pairs accessed: 1681
4: stonewalling pairs accessed: 2087
26: stonewalling pairs accessed: 1522
205: stonewalling pairs accessed: 1447
30: stonewalling pairs accessed: 4604
191: stonewalling pairs accessed: 1328
43: stonewalling pairs accessed: 4604
27: stonewalling pairs accessed: 4604
125: stonewalling pairs accessed: 2213
120: stonewalling pairs accessed: 2213
31: stonewalling pairs accessed: 4604
133: stonewalling pairs accessed: 2213
44: stonewalling pairs accessed: 4604
130: stonewalling pairs accessed: 2213
57: stonewalling pairs accessed: 2147
29: stonewalling pairs accessed: 1675
135: stonewalling pairs accessed: 2329
196: stonewalling pairs accessed: 1470
161: stonewalling pairs accessed: 1957
102: stonewalling pairs accessed: 1474
59: stonewalling pairs accessed: 2292
55: stonewalling pairs accessed: 1582
17: stonewalling pairs accessed: 4705
185: stonewalling pairs accessed: 1983
215: stonewalling pairs accessed: 1139
192: stonewalling pairs accessed: 1455
175: stonewalling pairs accessed: 1351
183: stonewalling pairs accessed: 1760
60: stonewalling pairs accessed: 1327
111: stonewalling pairs accessed: 2100
181: stonewalling pairs accessed: 1702
75: stonewalling pairs accessed: 1301
126: stonewalling pairs accessed: 1836
88: stonewalling pairs accessed: 2167
127: stonewalling pairs accessed: 1866
199: stonewalling pairs accessed: 1676
12: stonewalling pairs accessed: 6967
206: stonewalling pairs accessed: 1568
16: stonewalling pairs accessed: 6967
18: stonewalling pairs accessed: 6967
20: stonewalling pairs accessed: 6967
22: stonewalling pairs accessed: 6967
156: stonewalling pairs accessed: 1940
23: stonewalling pairs accessed: 6967
165: stonewalling pairs accessed: 2044
197: stonewalling pairs accessed: 2252
213: stonewalling pairs accessed: 1096
25: stonewalling pairs accessed: 1186
1: stonewalling pairs accessed: 6967
136: stonewalling pairs accessed: 1851
117: stonewalling pairs accessed: 1260
146: stonewalling pairs accessed: 1338
153: stonewalling pairs accessed: 1494
147: stonewalling pairs accessed: 1821
83: stonewalling pairs accessed: 2286
157: stonewalling pairs accessed: 2312
80: stonewalling pairs accessed: 1513
162: stonewalling pairs accessed: 2312
92: stonewalling pairs accessed: 2286
93: stonewalling pairs accessed: 2286
84: stonewalling pairs accessed: 2286
158: stonewalling pairs accessed: 2312
85: stonewalling pairs accessed: 2286
159: stonewalling pairs accessed: 2312
94: stonewalling pairs accessed: 2286
95: stonewalling pairs accessed: 2286
48: stonewalling pairs accessed: 1084
52: stonewalling pairs accessed: 2151
169: stonewalling pairs accessed: 1403
224: stonewalling pairs accessed: 7924
72: stonewalling pairs accessed: 1069
170: stonewalling pairs accessed: 1749
86: stonewalling pairs accessed: 1701
46: stonewalling pairs accessed: 4601
89: stonewalling pairs accessed: 2277
96: stonewalling pairs accessed: 1344
104: stonewalling pairs accessed: 1608
105: stonewalling pairs accessed: 1779
119: stonewalling pairs accessed: 1303
151: stonewalling pairs accessed: 1604
155: stonewalling pairs accessed: 2314
47: stonewalling pairs accessed: 4601
71: stonewalling pairs accessed: 1042
220: stonewalling pairs accessed: 7105
101: stonewalling pairs accessed: 1317
177: stonewalling pairs accessed: 2283
186: stonewalling pairs accessed: 2283
24: stonewalling pairs accessed: 1177
193: stonewalling pairs accessed: 1191
178: stonewalling pairs accessed: 1853
49: stonewalling pairs accessed: 2151
99: stonewalling pairs accessed: 1779
103: stonewalling pairs accessed: 1779
113: stonewalling pairs accessed: 2225
131: stonewalling pairs accessed: 1645
137: stonewalling pairs accessed: 1935
50: stonewalling pairs accessed: 2151
13: stonewalling pairs accessed: 6942
45: stonewalling pairs accessed: 4072
207: stonewalling pairs accessed: 1967
65: stonewalling pairs accessed: 1384
82: stonewalling pairs accessed: 1551
2: stonewalling pairs accessed: 1347
179: stonewalling pairs accessed: 2283
14: stonewalling pairs accessed: 1581
180: stonewalling pairs accessed: 2283
214: stonewalling pairs accessed: 1108
210: stonewalling pairs accessed: 2175
110: stonewalling pairs accessed: 1484
200: stonewalling pairs accessed: 2246
201: stonewalling pairs accessed: 2246
112: stonewalling pairs accessed: 7001
188: stonewalling pairs accessed: 1993
109: stonewalling pairs accessed: 7005
19: stonewalling pairs accessed: 4916
149: stonewalling pairs accessed: 2313
39: stonewalling pairs accessed: 3083
91: stonewalling pairs accessed: 2001
36: stonewalling pairs accessed: 4600
53: stonewalling pairs accessed: 1410
38: stonewalling pairs accessed: 4596
0: stonewalling pairs accessed: 1979
173: stonewalling pairs accessed: 2283
182: stonewalling pairs accessed: 2283
184: stonewalling pairs accessed: 2283
189: stonewalling pairs accessed: 2283
211: stonewalling pairs accessed: 2190
34: stonewalling pairs accessed: 4600
40: stonewalling pairs accessed: 4596
174: stonewalling pairs accessed: 2283
217: stonewalling pairs accessed: 1086
106: stonewalling pairs accessed: 7005
114: stonewalling pairs accessed: 7001
11: stonewalling pairs accessed: 2202
76: stonewalling pairs accessed: 2280
107: stonewalling pairs accessed: 7005
77: stonewalling pairs accessed: 2280
78: stonewalling pairs accessed: 2280
79: stonewalling pairs accessed: 2280
stonewalling pairs accessed min: 1016 max: 8000 -- min data: 0.0 GiB mean data: 0.1 GiB time: 301.5s
write 77.83 1736.15 851.38 45.91 45.91 0.005079 1105.90 0.006931 1105.91 0
Max Write: 77.83 MiB/sec (81.61 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 77.83 77.83 77.83 0.00 1736.13 1736.13 1736.13 0.00 1105.90756 301.53 105.66 0 240 24 1 0 1 1 0 0 8000 47008 47008 86074.2 POSIX 0
Finished : Fri Jul 10 17:22:44 2020
- mdtest_easy_delete
-
-- started at 07/10/2020 18:14:34 --
mdtest-3.3.0+dev was launched with 240 total task(s) on 10 node(s)
Command line used: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/mdtest '-r' '-F' '-P' '-d' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_easy' '-n' '10000' '-u' '-L' '-a' 'POSIX' '-x' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_easy-stonewall' '-N' '1'
Path: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr
FS: 1680.3 TiB Used FS: 46.2% Inodes: 1737.3 Mi Used Inodes: 51.9%
Nodemap: 111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 24 for each phase.
240 tasks, 2400000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 21988.015 21987.342 21987.737 0.194
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 42.927 42.927 42.927 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 3.209 3.209 3.209 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.023 0.023 0.023 0.000
-- finished at 07/10/2020 18:14:37 --
- mdtest_easy_stat
-
-- started at 07/10/2020 18:13:09 --
mdtest-3.3.0+dev was launched with 240 total task(s) on 10 node(s)
Command line used: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/mdtest '-T' '-F' '-P' '-d' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_easy' '-n' '10000' '-u' '-L' '-a' 'POSIX' '-x' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_easy-stonewall' '-N' '1'
Path: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr
FS: 1680.3 TiB Used FS: 46.2% Inodes: 1737.3 Mi Used Inodes: 51.9%
Nodemap: 111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 24 for each phase.
240 tasks, 2400000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 13586.551 13586.316 13586.437 0.061
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 5.193 5.193 5.193 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/10/2020 18:13:14 --
- mdtest_easy_write
-
-- started at 07/10/2020 16:57:09 --
mdtest-3.3.0+dev was launched with 240 total task(s) on 10 node(s)
Command line used: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/mdtest '-Y' '-C' '-F' '-P' '-d' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_easy' '-n' '10000' '-u' '-L' '-a' 'POSIX' '-x' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_easy-stonewall' '-N' '1' '-W' '300'
Path: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr
FS: 1680.3 TiB Used FS: 46.2% Inodes: 1738.4 Mi Used Inodes: 51.9%
Nodemap: 111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 24 for each phase.
240 tasks, 2400000 files
Continue stonewall hit min: 159 max: 294 avg: 199.3
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 166.891 166.891 166.891 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
File create (stonewall) : NA NA 159.368 NA
Tree creation : 41.785 41.785 41.785 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 422.790 422.790 422.790 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
File create (stonewall) : NA NA 300.097 NA
Tree creation : 0.024 0.024 0.024 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/10/2020 17:04:12 --
- mdtest_hard_delete
-
-- started at 07/10/2020 18:15:00 --
mdtest-3.3.0+dev was launched with 240 total task(s) on 10 node(s)
Command line used: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/mdtest '-r' '-t' '-F' '-P' '-w' '3901' '-e' '3901' '-d' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_hard' '-n' '10000' '-x' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_hard-stonewall' '-a' 'POSIX' '-N' '1'
Path: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr
FS: 1680.3 TiB Used FS: 46.2% Inodes: 1737.3 Mi Used Inodes: 51.9%
Nodemap: 111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 24 for each phase.
240 tasks, 2400000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 8111.931 8111.846 8111.900 0.020
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 67.649 67.649 67.649 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 7.397 7.397 7.397 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.015 0.015 0.015 0.000
-- finished at 07/10/2020 18:15:07 --
- mdtest_hard_read
-
-- started at 07/10/2020 18:14:43 --
mdtest-3.3.0+dev was launched with 240 total task(s) on 10 node(s)
Command line used: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/mdtest '-X' '-E' '-t' '-F' '-P' '-w' '3901' '-e' '3901' '-d' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_hard' '-n' '10000' '-x' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_hard-stonewall' '-a' 'POSIX' '-N' '1'
Path: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr
FS: 1680.3 TiB Used FS: 46.2% Inodes: 1737.2 Mi Used Inodes: 51.9%
Nodemap: 111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 24 for each phase.
240 tasks, 2400000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 5277.768 5277.741 5277.756 0.005
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 11.368 11.368 11.368 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/10/2020 18:14:54 --
- mdtest_hard_stat
-
-- started at 07/10/2020 18:14:24 --
mdtest-3.3.0+dev was launched with 240 total task(s) on 10 node(s)
Command line used: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/mdtest '-T' '-t' '-F' '-P' '-w' '3901' '-e' '3901' '-d' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_hard' '-n' '10000' '-x' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_hard-stonewall' '-a' 'POSIX' '-N' '1'
Path: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr
FS: 1680.3 TiB Used FS: 46.2% Inodes: 1737.3 Mi Used Inodes: 51.9%
Nodemap: 111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 24 for each phase.
240 tasks, 2400000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 15359.237 15358.796 15359.151 0.049
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 3.907 3.906 3.906 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/10/2020 18:14:28 --
- mdtest_hard_write
-
-- started at 07/10/2020 17:22:52 --
mdtest-3.3.0+dev was launched with 240 total task(s) on 10 node(s)
Command line used: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/bin/mdtest '-Y' '-C' '-t' '-F' '-P' '-w' '3901' '-e' '3901' '-d' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_hard' '-n' '10000' '-x' './posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr/mdt_hard-stonewall' '-a' 'POSIX' '-N' '1' '-W' '300'
Path: /scratch/prjssisd/andrercsd/teste-parallel-io/io-500/2020/io500-app.intel.2018/posix+striping+4mb_tx_easy/datafiles/2020.07.10-16.18.50-scr
FS: 1680.3 TiB Used FS: 46.2% Inodes: 1737.8 Mi Used Inodes: 51.9%
Nodemap: 111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 24 for each phase.
240 tasks, 2400000 files
Continue stonewall hit min: 202 max: 250 avg: 220.8
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 170.430 170.430 170.430 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
File create (stonewall) : NA NA 173.227 NA
Tree creation : 1189.199 1189.199 1189.199 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 352.051 352.051 352.051 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
File create (stonewall) : NA NA 305.842 NA
Tree creation : 0.001 0.001 0.001 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/10/2020 17:28:44 --
- result_summary
-
[RESULT] BW phase 1 ior_easy_write 16.893 GiB/s : time 2263.72 seconds
[RESULT] IOPS phase 1 mdtest_easy_write 0.167 kiops : time 422.79 seconds
[RESULT] BW phase 2 ior_hard_write 0.076 GiB/s : time 1105.90 seconds
[RESULT] IOPS phase 2 mdtest_hard_write 0.170 kiops : time 352.05 seconds
[RESULT] IOPS phase 3 find 12.280 kiops : time 10.65 seconds
[RESULT] BW phase 3 ior_easy_read 14.549 GiB/s : time 2628.36 seconds
[RESULT] IOPS phase 4 mdtest_easy_stat 13.587 kiops : time 5.19 seconds
[RESULT] BW phase 4 ior_hard_read 1.559 GiB/s : time 53.89 seconds
[RESULT] IOPS phase 5 mdtest_hard_stat 15.359 kiops : time 3.91 seconds
[RESULT] IOPS phase 6 mdtest_easy_delete 21.988 kiops : time 3.21 seconds
[RESULT] IOPS phase 7 mdtest_hard_read 5.278 kiops : time 11.37 seconds
[RESULT] IOPS phase 8 mdtest_hard_delete 8.112 kiops : time 13.35 seconds
[SCORE] Bandwidth 2.32312 GiB/s : IOPS 4.02302 kiops : TOTAL 3.05712