AI400X

Institution DDN
Client Procs Per Node
Client Operating System CentOS
Client Operating System Version 8.1
Client Kernel Version 4.18.0-147.8.1.el8_1.x86_64

DATA SERVER

Storage Type NVMe
Volatile Memory 3.84TB
Storage Interface NVMe
Network IB-EDR
Software Version 2.13.53
OS Version CentOS7.7

INFORMATION

Client Nodes 10
Client Total Procs 160

METADATA

Easy Write 150.40 kIOP/s
Easy Stat 451.93 kIOP/s
Easy Delete 140.70 kIOP/s
Hard Write 87.25 kIOP/s
Hard Read 155.17 kIOP/s
Hard Stat 457.30 kIOP/s
Hard Delete 73.09 kIOP/s

Submitted Files

ior-easy-read
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Mon Jul 13 09:00:45 2020
Command line        : ./ior -C -Q 1 -g -G 271 -k -e -o /ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=/ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/stonewall -t 16m -b 78000m -F -r -R -a POSIX --posix.odirect
Machine             : Linux ec01
TestID              : 0
StartTime           : Mon Jul 13 09:00:45 2020
Path                : /ai400/datafiles/2020.07.13-07.46.20-app/ior-easy
FS                  : 47.4 TiB   Used FS: 54.5%   Inodes: 466.4 Mi   Used Inodes: 17.7%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/ior_file_easy
access              : file-per-process
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 160
clients per node    : 16
repetitions         : 1
xfersize            : 16 MiB
blocksize           : 76.17 GiB
aggregate filesize  : 11.90 TiB

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
read      46595      2912.24    0.054941    79872000   16384      0.002087   267.84     0.005153   267.84     0   
Max Read:  46594.57 MiB/sec (48857.95 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
read        46594.57   46594.57   46594.57       0.00    2912.16    2912.16    2912.16       0.00  267.84237         NA            NA     0    160  16    1   1     1        1         0    0      1 81788928000 16777216 12480000.0 POSIX      0
Finished            : Mon Jul 13 09:05:13 2020
ior-easy-write
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Mon Jul 13 08:35:33 2020
Command line        : ./ior -C -Q 1 -g -G 271 -k -e -o /ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=/ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/stonewall -t 16m -b 78000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX --posix.odirect
Machine             : Linux ec01
TestID              : 0
StartTime           : Mon Jul 13 08:35:33 2020
Path                : /ai400/datafiles/2020.07.13-07.46.20-app/ior-easy
FS                  : 47.4 TiB   Used FS: 27.3%   Inodes: 384.0 Mi   Used Inodes: 0.0%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/ior_file_easy
access              : file-per-process
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 160
clients per node    : 16
repetitions         : 1
xfersize            : 16 MiB
blocksize           : 76.17 GiB
aggregate filesize  : 11.90 TiB
stonewallingTime    : 300
stoneWallingWearOut : 1

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 4075 max: 4875 -- min data: 63.7 GiB mean data: 70.3 GiB time: 300.1s
write     37603      2350.24    0.067398    79872000   16384      0.006333   331.88     0.000920   331.89     0   
Max Write: 37602.98 MiB/sec (39429.58 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
write       37602.98   37602.98   37602.98       0.00    2350.19    2350.19    2350.19       0.00  331.88858     300.06      38373.95     0    160  16    1   1     1        1         0    0      1 81788928000 16777216 12480000.0 POSIX      0
Finished            : Mon Jul 13 08:41:04 2020
ior-hard-read
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Mon Jul 13 09:07:17 2020
Command line        : ./ior -C -Q 1 -g -G 27 -k -e -o /ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/file -O stoneWallingStatusFile=/ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 150000 -r -R -a POSIX
Machine             : Linux ec01
TestID              : 0
StartTime           : Mon Jul 13 09:07:17 2020
Path                : /ai400/datafiles/2020.07.13-07.46.20-app/ior-hard
FS                  : 47.4 TiB   Used FS: 54.5%   Inodes: 466.4 Mi   Used Inodes: 17.7%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/file
access              : single-shared-file
type                : independent
segments            : 150000
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 160
clients per node    : 16
repetitions         : 1
xfersize            : 47008 bytes
blocksize           : 47008 bytes
aggregate filesize  : 1.03 TiB

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 150000 max: 150000 -- min data: 6.6 GiB mean data: 6.6 GiB time: 42.2s
read      23905      533535     44.98       45.91      45.91      0.023452   44.98      0.002131   45.01      0   
Max Read:  23905.09 MiB/sec (25066.31 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
read        23905.09   23905.09   23905.09       0.00  533234.92  533234.92  533234.92       0.00   45.00831      42.20      25494.16     0    160  16    1   0     1        1         0    0 150000    47008    47008 1075927.8 POSIX      0
Finished            : Mon Jul 13 09:08:02 2020
ior-hard-write
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Mon Jul 13 08:47:17 2020
Command line        : ./ior -C -Q 1 -g -G 27 -k -e -o /ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/file -O stoneWallingStatusFile=/ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 150000 -w -D 300 -a POSIX
Machine             : Linux ec01
TestID              : 0
StartTime           : Mon Jul 13 08:47:17 2020
Path                : /ai400/datafiles/2020.07.13-07.46.20-app/ior-hard
FS                  : 47.4 TiB   Used FS: 52.4%   Inodes: 437.4 Mi   Used Inodes: 12.2%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/file
access              : single-shared-file
type                : independent
segments            : 150000
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 160
clients per node    : 16
repetitions         : 1
xfersize            : 47008 bytes
blocksize           : 47008 bytes
aggregate filesize  : 1.03 TiB
stonewallingTime    : 300
stoneWallingWearOut : 1

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 94991 max: 150000 -- min data: 4.2 GiB mean data: 5.0 GiB time: 300.0s
write     2629.27    58652      375.66      45.91      45.91      0.020010   409.19     0.001018   409.21     0   
Max Write: 2629.27 MiB/sec (2756.98 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
write        2629.27    2629.27    2629.27       0.00   58649.27   58649.27   58649.27       0.00  409.21227     300.00       2743.90     0    160  16    1   0     1        1         0    0 150000    47008    47008 1075927.8 POSIX      0
Finished            : Mon Jul 13 08:54:06 2020
mdtest-easy-delete
-- started at 07/13/2020 09:09:08 --

mdtest-3.3.0+dev was launched with 160 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '350000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy' '-x' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy-stonewall' '-r' '-a' 'POSIX'
Path: /ai400/datafiles/2020.07.13-07.46.20-app
FS: 47.4 TiB   Used FS: 54.5%   Inodes: 466.4 Mi   Used Inodes: 17.7%

Nodemap: 1111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 16 for each phase.
160 tasks, 56000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :     140698.821     140698.779     140698.808          0.011
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          6.252          6.252          6.252          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :        398.013        398.013        398.013          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.160          0.160          0.160          0.000
-- finished at 07/13/2020 09:15:46 --

mdtest-easy-stat
-- started at 07/13/2020 09:05:13 --

mdtest-3.3.0+dev was launched with 160 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '350000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy' '-x' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy-stonewall' '-T' '-a' 'POSIX'
Path: /ai400/datafiles/2020.07.13-07.46.20-app
FS: 47.4 TiB   Used FS: 54.5%   Inodes: 466.4 Mi   Used Inodes: 17.7%

Nodemap: 1111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 16 for each phase.
160 tasks, 56000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :     451928.832     451928.689     451928.751          0.036
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :        123.913        123.913        123.913          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/13/2020 09:07:17 --

mdtest-easy-write
-- started at 07/13/2020 08:41:04 --

mdtest-3.3.0+dev was launched with 160 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '350000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy' '-x' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy-stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /ai400/datafiles/2020.07.13-07.46.20-app
FS: 47.4 TiB   Used FS: 52.3%   Inodes: 384.0 Mi   Used Inodes: 0.0%

Nodemap: 1111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 16 for each phase.
160 tasks, 56000000 files
Continue stonewall hit min: 291269 max: 350000 avg: 309809.6 


SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :     150395.944     150395.898     150395.917          0.012
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA     165387.235             NA
   Tree creation             :          3.563          3.563          3.563          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :        372.351        372.350        372.351          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA        299.718             NA
   Tree creation             :          0.281          0.281          0.281          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/13/2020 08:47:17 --

mdtest-hard-delete
-- started at 07/13/2020 09:19:02 --

mdtest-3.3.0+dev was launched with 160 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '190000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard' '-x' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard-stonewall' '-r' '-a' 'POSIX'
Path: /ai400/datafiles/2020.07.13-07.46.20-app
FS: 47.4 TiB   Used FS: 54.5%   Inodes: 413.0 Mi   Used Inodes: 7.0%

Nodemap: 1111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 16 for each phase.
160 tasks, 30400000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :      73091.418      73091.389      73091.411          0.008
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.705          0.705          0.705          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :        415.918        415.918        415.918          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          1.418          1.418          1.418          0.000
-- finished at 07/13/2020 09:26:00 --

mdtest-hard-read
-- started at 07/13/2020 09:15:46 --

mdtest-3.3.0+dev was launched with 160 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '190000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard' '-x' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard-stonewall' '-E' '-X' '-a' 'POSIX'
Path: /ai400/datafiles/2020.07.13-07.46.20-app
FS: 47.4 TiB   Used FS: 54.5%   Inodes: 413.1 Mi   Used Inodes: 7.1%

Nodemap: 1111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 16 for each phase.
160 tasks, 30400000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :     155174.154     155174.082     155174.112          0.020
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :        195.909        195.909        195.909          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/13/2020 09:19:02 --

mdtest-hard-stat
-- started at 07/13/2020 09:08:02 --

mdtest-3.3.0+dev was launched with 160 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '190000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard' '-x' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard-stonewall' '-T' '-a' 'POSIX'
Path: /ai400/datafiles/2020.07.13-07.46.20-app
FS: 47.4 TiB   Used FS: 54.5%   Inodes: 466.4 Mi   Used Inodes: 17.7%

Nodemap: 1111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 16 for each phase.
160 tasks, 30400000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :     457296.427     457296.239     457296.332          0.046
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :         66.478         66.478         66.478          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/13/2020 09:09:08 --

mdtest-hard-write
-- started at 07/13/2020 08:54:06 --

mdtest-3.3.0+dev was launched with 160 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '190000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard' '-x' '/ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard-stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /ai400/datafiles/2020.07.13-07.46.20-app
FS: 47.4 TiB   Used FS: 54.5%   Inodes: 437.4 Mi   Used Inodes: 12.2%

Nodemap: 1111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 16 for each phase.
160 tasks, 30400000 files
Continue stonewall hit min: 165185 max: 190000 avg: 173994.5 


SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :      87249.977      87249.943      87249.961          0.008
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA      92926.290             NA
   Tree creation             :          2.401          2.401          2.401          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :        348.424        348.424        348.424          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA        299.583             NA
   Tree creation             :          0.416          0.416          0.416          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/13/2020 08:59:55 --

result
version         = io500-isc20_v4-2-g20efd247106c
config-hash     = 650D0B6E
result-dir      = ./results/2020.07.13-07.46.20-app
; START 2020-07-13 08:35:33


[ior-easy-write]
t_start         = 2020-07-13 08:35:33
exe             = ./ior -C -Q 1 -g -G 271 -k -e -o /ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=/ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/stonewall -t 16m -b 78000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX --posix.odirect
throughput-stonewall = 5420.86
score           = 36.721661
t_delta         = 331.9086
t_end           = 2020-07-13 08:41:04

[mdtest-easy-write]
t_start         = 2020-07-13 08:41:04
exe             = ./mdtest -n 350000 -u -L -F -P -N 1 -d /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy -x /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy-stonewall -C -Y -W 300 -a POSIX
rate-stonewall  = 165.387235
score           = 150.395911
t_delta         = 372.6528
t_end           = 2020-07-13 08:47:17

[timestamp]
t_start         = 2020-07-13 08:47:17
t_delta         = 0.0043
t_end           = 2020-07-13 08:47:17

[ior-hard-write]
t_start         = 2020-07-13 08:47:17
exe             = ./ior -C -Q 1 -g -G 27 -k -e -o /ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/file -O stoneWallingStatusFile=/ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 150000 -w -D 300 -a POSIX
throughput-stonewall = 314.32
score           = 2.567642
t_delta         = 409.2944
t_end           = 2020-07-13 08:54:06

[mdtest-hard-write]
t_start         = 2020-07-13 08:54:06
exe             = ./mdtest -n 190000 -t -w 3901 -e 3901 -P -N 1 -F -d /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard -x /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard-stonewall -C -Y -W 300 -a POSIX
rate-stonewall  = 92.926290
score           = 87.249946
t_delta         = 348.8653
t_end           = 2020-07-13 08:59:55

[find]
t_start         = 2020-07-13 08:59:55
exe             = ./pfind /ai400/datafiles/2020.07.13-07.46.20-app -newer /ai400/datafiles/2020.07.13-07.46.20-app/timestampfile -size 3901c -name *01* -C -q 10000
found           = 1231609
total-files     = 86400166
score           = 1747.945166
t_delta         = 49.4333
t_end           = 2020-07-13 09:00:45

[ior-easy-read]
t_start         = 2020-07-13 09:00:45
exe             = ./ior -C -Q 1 -g -G 271 -k -e -o /ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=/ai400/datafiles/2020.07.13-07.46.20-app/ior-easy/stonewall -t 16m -b 78000m -F -r -R -a POSIX --posix.odirect
score           = 45.502510
t_delta         = 267.8895
t_end           = 2020-07-13 09:05:13

[mdtest-easy-stat]
t_start         = 2020-07-13 09:05:13
exe             = ./mdtest -n 350000 -u -L -F -P -N 1 -d /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy -x /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy-stonewall -T -a POSIX
score           = 451.928703
t_delta         = 123.9182
t_end           = 2020-07-13 09:07:17

[ior-hard-read]
t_start         = 2020-07-13 09:07:17
exe             = ./ior -C -Q 1 -g -G 27 -k -e -o /ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/file -O stoneWallingStatusFile=/ai400/datafiles/2020.07.13-07.46.20-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 150000 -r -R -a POSIX
score           = 23.344818
t_delta         = 45.0999
t_end           = 2020-07-13 09:08:02

[mdtest-hard-stat]
t_start         = 2020-07-13 09:08:02
exe             = ./mdtest -n 190000 -t -w 3901 -e 3901 -P -N 1 -F -d /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard -x /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard-stonewall -T -a POSIX
score           = 457.296293
t_delta         = 66.5060
t_end           = 2020-07-13 09:09:08

[mdtest-easy-delete]
t_start         = 2020-07-13 09:09:08
exe             = ./mdtest -n 350000 -u -L -F -P -N 1 -d /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy -x /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-easy-stonewall -r -a POSIX
score           = 140.698782
t_delta         = 398.2803
t_end           = 2020-07-13 09:15:46

[mdtest-hard-read]
t_start         = 2020-07-13 09:15:46
exe             = ./mdtest -n 190000 -t -w 3901 -e 3901 -P -N 1 -F -d /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard -x /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard-stonewall -E -X -a POSIX
score           = 155.174152
t_delta         = 195.9149
t_end           = 2020-07-13 09:19:02

[mdtest-hard-delete]
t_start         = 2020-07-13 09:19:02
exe             = ./mdtest -n 190000 -t -w 3901 -e 3901 -P -N 1 -F -d /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard -x /ai400/datafiles/2020.07.13-07.46.20-app/mdtest-hard-stonewall -r -a POSIX
score           = 73.091411
t_delta         = 417.3655
t_end           = 2020-07-13 09:26:00

[SCORE]
MD              = 229.005854
BW              = 17.789784
SCORE           = 63.827616 
hash            = 7F913063
; END 2020-07-13 09:26:00
result_summary
IO500 version io500-isc20_v4-2-g20efd247106c
[RESULT]       ior-easy-write       36.721661 GiB/s  : time 331.909 seconds
[RESULT]    mdtest-easy-write      150.395911 kIOPS : time 372.653 seconds
[RESULT]       ior-hard-write        2.567642 GiB/s  : time 409.294 seconds
[RESULT]    mdtest-hard-write       87.249946 kIOPS : time 348.865 seconds
[RESULT]                 find     1747.945166 kIOPS : time 49.433 seconds
[RESULT]        ior-easy-read       45.502510 GiB/s  : time 267.890 seconds
[RESULT]     mdtest-easy-stat      451.928703 kIOPS : time 123.918 seconds
[RESULT]        ior-hard-read       23.344818 GiB/s  : time 45.100 seconds
[RESULT]     mdtest-hard-stat      457.296293 kIOPS : time 66.506 seconds
[RESULT]   mdtest-easy-delete      140.698782 kIOPS : time 398.280 seconds
[RESULT]     mdtest-hard-read      155.174152 kIOPS : time 195.915 seconds
[RESULT]   mdtest-hard-delete       73.091411 kIOPS : time 417.366 seconds
[SCORE] Bandwidth 17.789784 GB/s : IOPS 229.005854 kiops : TOTAL 63.827616