NextGENIO

Institution EPCC
Client Procs Per Node
Client Operating System CentOS
Client Operating System Version
Client Kernel Version 3.10.0-862.14.4.el7.x86_64

DATA SERVER

Storage Type 3DXPNVMeSSD
Volatile Memory 2
Storage Interface NVMe
Network Omnipath
Software Version 0.8dev
OS Version

INFORMATION

Client Nodes 10
Client Total Procs 280
Metadata Nodes 28
Metadata Storage Devices 2
Data Nodes 28
Data Storage Devices 2

METADATA

Easy Write 1,897.67 kIOP/s
Easy Stat 1,940.82 kIOP/s
Easy Delete 999.77 kIOP/s
Hard Write 143.74 kIOP/s
Hard Read 544.19 kIOP/s
Hard Stat 1,730.11 kIOP/s
Hard Delete 279.78 kIOP/s

Submitted Files

ior-easy-read
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Tue Jul 14 10:13:55 2020
Command line        : ./ior -C -Q 1 -g -G 271 -k -e -o /tmp/r/io500-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=/tmp/r/io500-app/ior-easy/stonewall -t 512kb -b 9920000m -F -r -R -a POSIX
Machine             : Linux nextgenio-cn01
TestID              : 0
StartTime           : Tue Jul 14 10:13:55 2020
Path                : /tmp/r/io500-app/ior-easy
FS                  : 50.8 TiB   Used FS: 50.1%   Inodes: 0.0 Mi   Used Inodes: -nan%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /tmp/r/io500-app/ior-easy/ior_file_easy
access              : file-per-process
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 280
clients per node    : 28
repetitions         : 1
xfersize            : 524288 bytes
blocksize           : 9.46 TiB
aggregate filesize  : 2648.93 TiB

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
WARNING: Expected aggregate file size       = 2912524697600000.
WARNING: Stat() of aggregate file size      = 23604808908800.
WARNING: Using actual aggregate bytes moved = 23604808908800.
read      73696      147396     0.000015    10158080000 512.00     0.013123   305.45     0.007849   305.46     0   
Max Read:  73695.59 MiB/sec (77275.42 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
read        73695.59   73695.59   73695.59       0.00  147391.17  147391.17  147391.17       0.00  305.46334         NA            NA     0    280  28    1   1     1        1         0    0      1 10401873920000   524288 22511300.0 POSIX      0
Finished            : Tue Jul 14 10:19:00 2020
ior-easy-write
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Tue Jul 14 09:47:11 2020
Command line        : ./ior -C -Q 1 -g -G 271 -k -e -o /tmp/r/io500-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=/tmp/r/io500-app/ior-easy/stonewall -t 512kb -b 9920000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX
Machine             : Linux nextgenio-cn01
TestID              : 0
StartTime           : Tue Jul 14 09:47:11 2020
Path                : /tmp/r/io500-app/ior-easy
FS                  : 50.8 TiB   Used FS: 5.2%   Inodes: 0.0 Mi   Used Inodes: -nan%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /tmp/r/io500-app/ior-easy/ior_file_easy
access              : file-per-process
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 280
clients per node    : 28
repetitions         : 1
xfersize            : 524288 bytes
blocksize           : 9.46 TiB
aggregate filesize  : 2648.93 TiB
stonewallingTime    : 300
stoneWallingWearOut : 1

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 133474 max: 160795 -- min data: 65.2 GiB mean data: 72.5 GiB time: 300.1s
WARNING: Expected aggregate file size       = 2912524697600000.
WARNING: Stat() of aggregate file size      = 23604808908800.
WARNING: Using actual aggregate bytes moved = 23604808908800.
WARNING: maybe caused by deadlineForStonewalling
write     64824      129654     0.000016    10158080000 512.00     0.012016   347.25     0.002892   347.27     0   
Max Write: 64824.23 MiB/sec (67973.13 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
write       64824.23   64824.23   64824.23       0.00  129648.45  129648.45  129648.45       0.00  347.26677     300.12      69257.49     0    280  28    1   1     1        1         0    0      1 10401873920000   524288 22511300.0 POSIX      0
Finished            : Tue Jul 14 09:52:58 2020
ior-hard-read
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Tue Jul 14 10:24:18 2020
Command line        : ./ior -C -Q 1 -g -G 27 -k -e -o /tmp/r/io500-app/ior-hard/file -O stoneWallingStatusFile=/tmp/r/io500-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 10000000 -r -R -a POSIX
Machine             : Linux nextgenio-cn01
TestID              : 0
StartTime           : Tue Jul 14 10:24:18 2020
Path                : /tmp/r/io500-app/ior-hard
FS                  : 50.8 TiB   Used FS: 50.1%   Inodes: 0.0 Mi   Used Inodes: -nan%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /tmp/r/io500-app/ior-hard/file
access              : single-shared-file
type                : independent
segments            : 10000000
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 280
clients per node    : 28
repetitions         : 1
xfersize            : 47008 bytes
blocksize           : 47008 bytes
aggregate filesize  : 119.71 TiB

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 81541 max: 81541 -- min data: 3.6 GiB mean data: 3.6 GiB time: 39.0s
WARNING: Expected aggregate file size       = 131622400000000.
WARNING: Stat() of aggregate file size      = 1073262211840.
WARNING: Using actual aggregate bytes moved = 1073262211840.
read      26159      583617     39.09       45.91      45.91      0.012379   39.12      0.008168   39.13      0   
Max Read:  26159.33 MiB/sec (27430.05 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
read        26159.33   26159.33   26159.33       0.00  583518.77  583518.77  583518.77       0.00   39.12724      39.05      26212.03     0    280  28    1   0     1        1         0    0 10000000    47008    47008 1023542.6 POSIX      0
Finished            : Tue Jul 14 10:24:58 2020
ior-hard-write
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Tue Jul 14 09:58:40 2020
Command line        : ./ior -C -Q 1 -g -G 27 -k -e -o /tmp/r/io500-app/ior-hard/file -O stoneWallingStatusFile=/tmp/r/io500-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 10000000 -w -D 300 -a POSIX
Machine             : Linux nextgenio-cn01
TestID              : 0
StartTime           : Tue Jul 14 09:58:40 2020
Path                : /tmp/r/io500-app/ior-hard
FS                  : 50.8 TiB   Used FS: 47.4%   Inodes: 0.0 Mi   Used Inodes: -nan%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /tmp/r/io500-app/ior-hard/file
access              : single-shared-file
type                : independent
segments            : 10000000
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 280
clients per node    : 28
repetitions         : 1
xfersize            : 47008 bytes
blocksize           : 47008 bytes
aggregate filesize  : 119.71 TiB
stonewallingTime    : 300
stoneWallingWearOut : 1

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 80738 max: 81541 -- min data: 3.5 GiB mean data: 3.5 GiB time: 300.0s
WARNING: Expected aggregate file size       = 131622400000000.
WARNING: Stat() of aggregate file size      = 1073262211840.
WARNING: Using actual aggregate bytes moved = 1073262211840.
WARNING: maybe caused by deadlineForStonewalling
write     3389.29    75605      301.88      45.91      45.91      0.010626   301.98     0.005348   301.99     0   
Max Write: 3389.29 MiB/sec (3553.93 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
write        3389.29    3389.29    3389.29       0.00   75602.70   75602.70   75602.70       0.00  301.99291     300.03       3389.24     0    280  28    1   0     1        1         0    0 10000000    47008    47008 1023542.6 POSIX      0
Finished            : Tue Jul 14 10:03:42 2020
mdtest-easy-delete
-- started at 07/14/2020 10:25:27 --

mdtest-3.3.0+dev was launched with 280 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '5000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/tmp/r/io500-app/mdtest-easy' '-x' '/tmp/r/io500-app/mdtest-easy-stonewall' '-r' '-a' 'POSIX'
Path: /tmp/r/io500-app
FS: 50.8 TiB   Used FS: 50.1%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 1111111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 28 for each phase.
280 tasks, 1400000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :     999770.733     999762.572     999766.134          1.609
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.054          0.054          0.054          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :        617.397        617.392        617.395          0.001
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :         18.444         18.444         18.444          0.000
-- finished at 07/14/2020 10:36:04 --

mdtest-easy-stat
-- started at 07/14/2020 10:19:00 --

mdtest-3.3.0+dev was launched with 280 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '5000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/tmp/r/io500-app/mdtest-easy' '-x' '/tmp/r/io500-app/mdtest-easy-stonewall' '-T' '-a' 'POSIX'
Path: /tmp/r/io500-app
FS: 50.8 TiB   Used FS: 50.1%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 1111111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 28 for each phase.
280 tasks, 1400000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :    1940829.135    1940813.142    1940820.112          3.131
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :        318.037        318.035        318.036          0.001
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/14/2020 10:24:18 --

mdtest-easy-write
-- started at 07/14/2020 09:52:58 --

mdtest-3.3.0+dev was launched with 280 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '5000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/tmp/r/io500-app/mdtest-easy' '-x' '/tmp/r/io500-app/mdtest-easy-stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /tmp/r/io500-app
FS: 50.8 TiB   Used FS: 47.4%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 1111111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 28 for each phase.
280 tasks, 1400000000 files
Continue stonewall hit min: 2055869 max: 2204467 avg: 2134122.2 


SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :    1897671.745    1897655.931    1897662.825          3.067
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA    1991923.910             NA
   Tree creation             :         54.364         54.364         54.364          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :        325.270        325.267        325.269          0.001
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA        299.988             NA
   Tree creation             :          0.018          0.018          0.018          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/14/2020 09:58:40 --

mdtest-hard-delete
-- started at 07/14/2020 10:37:38 --

mdtest-3.3.0+dev was launched with 280 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '1000000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/tmp/r/io500-app/mdtest-hard' '-x' '/tmp/r/io500-app/mdtest-hard-stonewall' '-r' '-a' 'POSIX'
Path: /tmp/r/io500-app
FS: 50.8 TiB   Used FS: 50.1%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 1111111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 28 for each phase.
280 tasks, 280000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :     279775.967     279773.682     279774.680          0.450
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          1.839          1.839          1.839          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :        183.447        183.446        183.447          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.544          0.544          0.544          0.000
-- finished at 07/14/2020 10:40:43 --

mdtest-hard-read
-- started at 07/14/2020 10:36:04 --

mdtest-3.3.0+dev was launched with 280 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '1000000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/tmp/r/io500-app/mdtest-hard' '-x' '/tmp/r/io500-app/mdtest-hard-stonewall' '-E' '-X' '-a' 'POSIX'
Path: /tmp/r/io500-app
FS: 50.8 TiB   Used FS: 50.1%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 1111111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 28 for each phase.
280 tasks, 280000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :     544195.297     544190.803     544192.762          0.879
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :         94.312         94.311         94.312          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/14/2020 10:37:38 --

mdtest-hard-stat
-- started at 07/14/2020 10:24:58 --

mdtest-3.3.0+dev was launched with 280 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '1000000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/tmp/r/io500-app/mdtest-hard' '-x' '/tmp/r/io500-app/mdtest-hard-stonewall' '-T' '-a' 'POSIX'
Path: /tmp/r/io500-app
FS: 50.8 TiB   Used FS: 50.1%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 1111111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 28 for each phase.
280 tasks, 280000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :    1730116.539    1730102.423    1730108.626          2.781
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :         29.665         29.665         29.665          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/14/2020 10:25:27 --

mdtest-hard-write
-- started at 07/14/2020 10:03:42 --

mdtest-3.3.0+dev was launched with 280 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '1000000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/tmp/r/io500-app/mdtest-hard' '-x' '/tmp/r/io500-app/mdtest-hard-stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /tmp/r/io500-app
FS: 50.8 TiB   Used FS: 49.4%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 1111111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 28 for each phase.
280 tasks, 280000000 files
Continue stonewall hit min: 168982 max: 183299 avg: 177256.3 


SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :     143742.325     143741.140     143741.657          0.232
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA     165433.722             NA
   Tree creation             :       2636.679       2636.679       2636.679          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :        357.057        357.054        357.055          0.001
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA        300.010             NA
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/14/2020 10:10:22 --

result
version         = io500-isc20_v4
config-hash     = 718463FF
result-dir      = ./results_run/2020.07.14-08.49.39-app
; START 2020-07-14 09:47:11


[ior-easy-write]
t_start         = 2020-07-14 09:47:11
exe             = ./ior -C -Q 1 -g -G 271 -k -e -o /tmp/r/io500-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=/tmp/r/io500-app/ior-easy/stonewall -t 512kb -b 9920000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX
throughput-stonewall = 16366.57
score           = 63.304909
t_delta         = 347.3351
t_end           = 2020-07-14 09:52:58

[mdtest-easy-write]
t_start         = 2020-07-14 09:52:58
exe             = ./mdtest -n 5000000 -u -L -F -P -N 1 -d /tmp/r/io500-app/mdtest-easy -x /tmp/r/io500-app/mdtest-easy-stonewall -C -Y -W 300 -a POSIX
rate-stonewall  = 1991.923910
score           = 1897.665897
t_delta         = 341.3040
t_end           = 2020-07-14 09:58:40

[timestamp]
t_start         = 2020-07-14 09:58:40
t_delta         = 0.0007
t_end           = 2020-07-14 09:58:40

[ior-hard-write]
t_start         = 2020-07-14 09:58:40
exe             = ./ior -C -Q 1 -g -G 27 -k -e -o /tmp/r/io500-app/ior-hard/file -O stoneWallingStatusFile=/tmp/r/io500-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 10000000 -w -D 300 -a POSIX
throughput-stonewall = 920.72
score           = 3.309857
t_delta         = 302.0674
t_end           = 2020-07-14 10:03:42

[mdtest-hard-write]
t_start         = 2020-07-14 10:03:42
exe             = ./mdtest -n 1000000 -t -w 3901 -e 3901 -P -N 1 -F -d /tmp/r/io500-app/mdtest-hard -x /tmp/r/io500-app/mdtest-hard-stonewall -C -Y -W 300 -a POSIX
rate-stonewall  = 165.433722
score           = 143.741881
t_delta         = 400.7230
t_end           = 2020-07-14 10:10:22

[find]
t_start         = 2020-07-14 10:10:22
exe             =  ./bin/pfind.sh  /tmp/r/io500-app -newer /tmp/r/io500-app/timestampfile -size 3901c -name "*01*"
last-output     = "MATCHED 2152470/668574766"
total-files     = 668574766
found           = 2152470
score           = 3146.101878
t_delta         = 212.5118
t_end           = 2020-07-14 10:13:55

[ior-easy-read]
t_start         = 2020-07-14 10:13:55
exe             = ./ior -C -Q 1 -g -G 271 -k -e -o /tmp/r/io500-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=/tmp/r/io500-app/ior-easy/stonewall -t 512kb -b 9920000m -F -r -R -a POSIX
score           = 71.968346
t_delta         = 305.4883
t_end           = 2020-07-14 10:19:00

[mdtest-easy-stat]
t_start         = 2020-07-14 10:19:00
exe             = ./mdtest -n 5000000 -u -L -F -P -N 1 -d /tmp/r/io500-app/mdtest-easy -x /tmp/r/io500-app/mdtest-easy-stonewall -T -a POSIX
score           = 1940.823287
t_delta         = 318.0524
t_end           = 2020-07-14 10:24:18

[ior-hard-read]
t_start         = 2020-07-14 10:24:18
exe             = ./ior -C -Q 1 -g -G 27 -k -e -o /tmp/r/io500-app/ior-hard/file -O stoneWallingStatusFile=/tmp/r/io500-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 10000000 -r -R -a POSIX
score           = 25.546225
t_delta         = 39.1432
t_end           = 2020-07-14 10:24:58

[mdtest-hard-stat]
t_start         = 2020-07-14 10:24:58
exe             = ./mdtest -n 1000000 -t -w 3901 -e 3901 -P -N 1 -F -d /tmp/r/io500-app/mdtest-hard -x /tmp/r/io500-app/mdtest-hard-stonewall -T -a POSIX
score           = 1730.111400
t_delta         = 29.6790
t_end           = 2020-07-14 10:25:27

[mdtest-easy-delete]
t_start         = 2020-07-14 10:25:27
exe             = ./mdtest -n 5000000 -u -L -F -P -N 1 -d /tmp/r/io500-app/mdtest-easy -x /tmp/r/io500-app/mdtest-easy-stonewall -r -a POSIX
score           = 999.767769
t_delta         = 636.7071
t_end           = 2020-07-14 10:36:04

[mdtest-hard-read]
t_start         = 2020-07-14 10:36:04
exe             = ./mdtest -n 1000000 -t -w 3901 -e 3901 -P -N 1 -F -d /tmp/r/io500-app/mdtest-hard -x /tmp/r/io500-app/mdtest-hard-stonewall -E -X -a POSIX
score           = 544.193603
t_delta         = 94.3239
t_end           = 2020-07-14 10:37:38

[mdtest-hard-delete]
t_start         = 2020-07-14 10:37:38
exe             = ./mdtest -n 1000000 -t -w 3901 -e 3901 -P -N 1 -F -d /tmp/r/io500-app/mdtest-hard -x /tmp/r/io500-app/mdtest-hard-stonewall -r -a POSIX
score           = 279.775122
t_delta         = 184.5591
t_end           = 2020-07-14 10:40:43

[SCORE]
MD              = 902.115609
BW              = 24.913154
SCORE           = 149.915127 
hash            = DA34C8F1
; END 2020-07-14 10:42:31
result_summary
IO500 version io500-isc20_v4
[RESULT]       ior-easy-write       63.304909 GiB/s  : time 347.335 seconds
[RESULT]    mdtest-easy-write     1897.665897 kIOPS : time 341.304 seconds
[RESULT]       ior-hard-write        3.309857 GiB/s  : time 302.067 seconds
[RESULT]    mdtest-hard-write      143.741881 kIOPS : time 400.723 seconds
[RESULT]                 find     3146.101878 kIOPS : time 212.512 seconds
[RESULT]        ior-easy-read       71.968346 GiB/s  : time 305.488 seconds
[RESULT]     mdtest-easy-stat     1940.823287 kIOPS : time 318.052 seconds
[RESULT]        ior-hard-read       25.546225 GiB/s  : time 39.143 seconds
[RESULT]     mdtest-hard-stat     1730.111400 kIOPS : time 29.679 seconds
[RESULT]   mdtest-easy-delete      999.767769 kIOPS : time 636.707 seconds
[RESULT]     mdtest-hard-read      544.193603 kIOPS : time 94.324 seconds
[RESULT]   mdtest-hard-delete      279.775122 kIOPS : time 184.559 seconds
[SCORE] Bandwidth 24.913154 GB/s : IOPS 902.115609 kiops : TOTAL 149.915127