Archer 2 (test system)

Institution EPCC
Client Procs Per Node
Client Operating System SUSE
Client Operating System Version 15.1
Client Kernel Version 4.12.14-197.51_9.1.42-cray_shasta_c

DATA SERVER

Storage Type HDD
Volatile Memory
Storage Interface
Network
Software Version
OS Version

INFORMATION

Client Nodes 10
Client Total Procs 80
Metadata Nodes 2
Metadata Storage Devices 0
Data Nodes 12
Data Storage Devices 0

METADATA

Easy Write 44.54 kIOP/s
Easy Stat 125.16 kIOP/s
Easy Delete 34.79 kIOP/s
Hard Write 21.21 kIOP/s
Hard Read 56.74 kIOP/s
Hard Stat 129.94 kIOP/s
Hard Delete 13.10 kIOP/s

Submitted Files

ior-easy-read
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Fri Oct 30 11:31:30 2020
Command line        : ./ior -C -Q 1 -g -G 271 -k -e -o /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-easy/ior_file_easy -O stoneWallingStatusFile=./results/2020.10.30-10.30.19/ior-easy.stonewall -t 2m -b 9920000m -F -r -R -a POSIX
Machine             : Linux nid001904
TestID              : 0
StartTime           : Fri Oct 30 11:31:30 2020
Path                : /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-easy/ior_file_easy.00000000
FS                  : 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 1.4%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-easy/ior_file_easy
access              : file-per-process
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 80
clients per node    : 8
repetitions         : 1
xfersize            : 2 MiB
blocksize           : 9.46 TiB
aggregate filesize  : 756.84 TiB

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
WARNING: Expected aggregate file size       = 832149913600000
WARNING: Stat() of aggregate file size      = 23155745751040
WARNING: Using actual aggregate bytes moved = 23155745751040
read      12204      6102       0.000365    10158080000 2048.00    0.052152   1809.41    0.001937   1809.47    0   
ior-easy-write
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Fri Oct 30 10:30:23 2020
Command line        : ./ior -C -Q 1 -g -G 271 -k -e -o /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-easy/ior_file_easy -O stoneWallingStatusFile=./results/2020.10.30-10.30.19/ior-easy.stonewall -t 2m -b 9920000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX
Machine             : Linux nid001904
TestID              : 0
StartTime           : Fri Oct 30 10:30:23 2020
Path                : /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-easy/ior_file_easy.00000000
FS                  : 3336.2 TiB   Used FS: 1.1%   Inodes: 3364.6 Mi   Used Inodes: 1.0%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-easy/ior_file_easy
access              : file-per-process
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 80
clients per node    : 8
repetitions         : 1
xfersize            : 2 MiB
blocksize           : 9.46 TiB
aggregate filesize  : 756.84 TiB
stonewallingTime    : 300
stoneWallingWearOut : 1

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 35905 max: 138019 -- min data: 70.1 GiB mean data: 170.8 GiB time: 300.0s
WARNING: Expected aggregate file size       = 832149913600000
WARNING: Stat() of aggregate file size      = 23155745751040
WARNING: Using actual aggregate bytes moved = 23155745751040
WARNING: Maybe caused by deadlineForStonewalling
write     33856      16928      0.000090    10158080000 2048.00    0.002626   652.27     0.001096   652.27     0   
ior-hard-read
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Fri Oct 30 12:03:47 2020
Command line        : ./ior -C -Q 1 -g -G 27 -k -e -o /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-hard/file -O stoneWallingStatusFile=./results/2020.10.30-10.30.19/ior-hard.stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 50000 -r -R -a POSIX
Machine             : Linux nid001904
TestID              : 0
StartTime           : Fri Oct 30 12:03:47 2020
Path                : /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-hard/file
FS                  : 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 1.4%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-hard/file
access              : single-shared-file
type                : independent
segments            : 50000
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 80
clients per node    : 8
repetitions         : 1
xfersize            : 47008 bytes
blocksize           : 47008 bytes
aggregate filesize  : 175.12 GiB

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 50000 max: 50000 -- min data: 2.2 GiB mean data: 2.2 GiB time: 153.1s
read      1170.66    26121      153.13      45.91      45.91      0.044285   153.13     0.000881   153.18     0   
ior-hard-write
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Fri Oct 30 10:47:11 2020
Command line        : ./ior -C -Q 1 -g -G 27 -k -e -o /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-hard/file -O stoneWallingStatusFile=./results/2020.10.30-10.30.19/ior-hard.stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 50000 -w -D 300 -a POSIX
Machine             : Linux nid001904
TestID              : 0
StartTime           : Fri Oct 30 10:47:11 2020
Path                : /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-hard/file
FS                  : 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 1.3%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-hard/file
access              : single-shared-file
type                : independent
segments            : 50000
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 10
tasks               : 80
clients per node    : 8
repetitions         : 1
xfersize            : 47008 bytes
blocksize           : 47008 bytes
aggregate filesize  : 175.12 GiB
stonewallingTime    : 300
stoneWallingWearOut : 1

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 7332 max: 50000 -- min data: 0.3 GiB mean data: 0.8 GiB time: 300.2s
write     108.10     2411.29    1525.48     45.91      45.91      0.010913   1658.87    0.019083   1658.90    0   
mdtest-easy-delete
-- started at 10/30/2020 12:07:10 --

mdtest-3.4.0+dev was launched with 80 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '1000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-easy' '-x' './results/2020.10.30-10.30.19/mdtest-easy.stonewall' '-r' '-a' 'POSIX'
Path: /lus/cls01095/work/n02/n02/kunkel/data/2020.10.30-10.30.19
FS: 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 1.4%

Nodemap: 11111111000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2216 Shifting ranks by 8 for each phase.
80 tasks, 80000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :      34787.501      34787.498      34787.499          0.001
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          1.725          1.725          1.725          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :        456.019        456.019        456.019          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.580          0.580          0.580          0.000
-- finished at 10/30/2020 12:14:48 --

mdtest-easy-stat
-- started at 10/30/2020 12:01:40 --

mdtest-3.4.0+dev was launched with 80 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '1000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-easy' '-x' './results/2020.10.30-10.30.19/mdtest-easy.stonewall' '-T' '-a' 'POSIX'
Path: /lus/cls01095/work/n02/n02/kunkel/data/2020.10.30-10.30.19
FS: 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 1.4%

Nodemap: 11111111000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2216 Shifting ranks by 8 for each phase.
80 tasks, 80000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :     125161.536     125161.482     125161.514          0.010
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :        126.746        126.746        126.746          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 10/30/2020 12:03:47 --

mdtest-easy-write
-- started at 10/30/2020 10:41:15 --

mdtest-3.4.0+dev was launched with 80 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '1000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' '/work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-easy' '-x' './results/2020.10.30-10.30.19/mdtest-easy.stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /lus/cls01095/work/n02/n02/kunkel/data/2020.10.30-10.30.19
FS: 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 0.9%

Nodemap: 11111111000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2216 Shifting ranks by 8 for each phase.
80 tasks, 80000000 files
Continue stonewall hit min: 161885 max: 198297 avg: 175600.0 


SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :      44538.546      44538.537      44538.542          0.003
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA      46826.513             NA
   Tree creation             :        320.911        320.911        320.911          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :        356.181        356.180        356.180          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA        300.001             NA
   Tree creation             :          0.003          0.003          0.003          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 10/30/2020 10:47:11 --

mdtest-hard-delete
-- started at 10/30/2020 12:16:41 --

mdtest-3.4.0+dev was launched with 80 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '80000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-hard' '-x' './results/2020.10.30-10.30.19/mdtest-hard.stonewall' '-r' '-a' 'POSIX'
Path: /lus/cls01095/work/n02/n02/kunkel/data/2020.10.30-10.30.19
FS: 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 1.0%

Nodemap: 11111111000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2216 Shifting ranks by 8 for each phase.
80 tasks, 6400000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :      13096.031      13095.511      13095.896          0.207
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.767          0.767          0.767          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :        488.717        488.698        488.703          0.008
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          1.304          1.304          1.304          0.000
-- finished at 10/30/2020 12:24:51 --

mdtest-hard-read
-- started at 10/30/2020 12:14:48 --

mdtest-3.4.0+dev was launched with 80 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '80000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-hard' '-x' './results/2020.10.30-10.30.19/mdtest-hard.stonewall' '-E' '-X' '-a' 'POSIX'
Path: /lus/cls01095/work/n02/n02/kunkel/data/2020.10.30-10.30.19
FS: 3336.2 TiB   Used FS: 1.7%   Inodes: 3363.0 Mi   Used Inodes: 1.0%

Nodemap: 11111111000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2216 Shifting ranks by 8 for each phase.
80 tasks, 6400000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :      56743.195      56743.177      56743.187          0.004
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :        112.789        112.789        112.789          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 10/30/2020 12:16:41 --

mdtest-hard-stat
-- started at 10/30/2020 12:06:20 --

mdtest-3.4.0+dev was launched with 80 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '80000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-hard' '-x' './results/2020.10.30-10.30.19/mdtest-hard.stonewall' '-T' '-a' 'POSIX'
Path: /lus/cls01095/work/n02/n02/kunkel/data/2020.10.30-10.30.19
FS: 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 1.4%

Nodemap: 11111111000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2216 Shifting ranks by 8 for each phase.
80 tasks, 6400000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :     129937.749     129937.607     129937.668          0.038
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :         49.254         49.254         49.254          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 10/30/2020 12:07:10 --

mdtest-hard-write
-- started at 10/30/2020 11:14:50 --

mdtest-3.4.0+dev was launched with 80 total task(s) on 10 node(s)
Command line used: ./mdtest '-n' '80000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' '/work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-hard' '-x' './results/2020.10.30-10.30.19/mdtest-hard.stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /lus/cls01095/work/n02/n02/kunkel/data/2020.10.30-10.30.19
FS: 3336.2 TiB   Used FS: 1.7%   Inodes: 3364.6 Mi   Used Inodes: 1.2%

Nodemap: 11111111000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2216 Shifting ranks by 8 for each phase.
80 tasks, 6400000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :      21207.353      21207.346      21207.351          0.002
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA      31773.569             NA
   Tree creation             :        868.206        868.206        868.206          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :        301.782        301.782        301.782          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA        201.425             NA
   Tree creation             :          0.001          0.001          0.001          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 10/30/2020 11:19:52 --

result
version         = io500-sc20_v3
config-hash     = 959E5BB
result-dir      = ./results/2020.10.30-10.30.19
; START 2020-10-30 10:30:23


[ior-easy-write]
t_start         = 2020-10-30 10:30:23
exe             = ./ior -C -Q 1 -g -G 271 -k -e -o /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-easy/ior_file_easy -O stoneWallingStatusFile=./results/2020.10.30-10.30.19/ior-easy.stonewall -t 2m -b 9920000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX
throughput-stonewall = 1675.77
score           = 33.062243
t_delta         = 652.4004
t_end           = 2020-10-30 10:41:15

[mdtest-easy-write]
t_start         = 2020-10-30 10:41:15
exe             = ./mdtest -n 1000000 -u -L -F -P -N 1 -d /work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-easy -x ./results/2020.10.30-10.30.19/mdtest-easy.stonewall -C -Y -W 300 -a POSIX
rate-stonewall  = 46.826513
score           = 44.538543
t_delta         = 356.2818
t_end           = 2020-10-30 10:47:11

[timestamp]
t_start         = 2020-10-30 10:47:11
t_delta         = 0.0099
t_end           = 2020-10-30 10:47:11

[ior-hard-write]
t_start         = 2020-10-30 10:47:11
exe             = ./ior -C -Q 1 -g -G 27 -k -e -o /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-hard/file -O stoneWallingStatusFile=./results/2020.10.30-10.30.19/ior-hard.stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 50000 -w -D 300 -a POSIX
throughput-stonewall = 3.19
score           = 0.105563
t_delta         = 1659.0789
t_end           = 2020-10-30 11:14:50

[mdtest-hard-write]
t_start         = 2020-10-30 11:14:50
exe             = ./mdtest -n 80000 -t -w 3901 -e 3901 -P -N 1 -F -d /work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-hard -x ./results/2020.10.30-10.30.19/mdtest-hard.stonewall -C -Y -W 300 -a POSIX
rate-stonewall  = 31.773569
score           = 21.207352
t_delta         = 301.8331
t_end           = 2020-10-30 11:19:52

[find]
t_start         = 2020-10-30 11:19:52
exe             = ./pfind /work/n02/n02/kunkel/data//2020.10.30-10.30.19 -newer ./results/2020.10.30-10.30.19/timestampfile -size 3901c -name *01* -C -q 10000
nproc           = 1
found           = 182560
total-files     = 22263841
score           = 31.900553
t_delta         = 697.9217
t_end           = 2020-10-30 11:31:30

[ior-easy-read]
t_start         = 2020-10-30 11:31:30
exe             = ./ior -C -Q 1 -g -G 271 -k -e -o /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-easy/ior_file_easy -O stoneWallingStatusFile=./results/2020.10.30-10.30.19/ior-easy.stonewall -t 2m -b 9920000m -F -r -R -a POSIX
score           = 11.918133
t_delta         = 1809.6594
t_end           = 2020-10-30 12:01:40

[mdtest-easy-stat]
t_start         = 2020-10-30 12:01:40
exe             = ./mdtest -n 1000000 -u -L -F -P -N 1 -d /work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-easy -x ./results/2020.10.30-10.30.19/mdtest-easy.stonewall -T -a POSIX
score           = 125.161518
t_delta         = 126.8130
t_end           = 2020-10-30 12:03:47

[ior-hard-read]
t_start         = 2020-10-30 12:03:47
exe             = ./ior -C -Q 1 -g -G 27 -k -e -o /work/n02/n02/kunkel/data//2020.10.30-10.30.19/ior-hard/file -O stoneWallingStatusFile=./results/2020.10.30-10.30.19/ior-hard.stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 50000 -r -R -a POSIX
score           = 1.143227
t_delta         = 153.6589
t_end           = 2020-10-30 12:06:20

[mdtest-hard-stat]
t_start         = 2020-10-30 12:06:20
exe             = ./mdtest -n 80000 -t -w 3901 -e 3901 -P -N 1 -F -d /work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-hard -x ./results/2020.10.30-10.30.19/mdtest-hard.stonewall -T -a POSIX
score           = 129.937693
t_delta         = 49.3339
t_end           = 2020-10-30 12:07:10

[mdtest-easy-delete]
t_start         = 2020-10-30 12:07:10
exe             = ./mdtest -n 1000000 -u -L -F -P -N 1 -d /work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-easy -x ./results/2020.10.30-10.30.19/mdtest-easy.stonewall -r -a POSIX
score           = 34.787501
t_delta         = 458.2629
t_end           = 2020-10-30 12:14:48

[mdtest-hard-read]
t_start         = 2020-10-30 12:14:48
exe             = ./mdtest -n 80000 -t -w 3901 -e 3901 -P -N 1 -F -d /work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-hard -x ./results/2020.10.30-10.30.19/mdtest-hard.stonewall -E -X -a POSIX
score           = 56.743186
t_delta         = 112.8000
t_end           = 2020-10-30 12:16:41

[mdtest-hard-delete]
t_start         = 2020-10-30 12:16:41
exe             = ./mdtest -n 80000 -t -w 3901 -e 3901 -P -N 1 -F -d /work/n02/n02/kunkel/data//2020.10.30-10.30.19/mdtest-hard -x ./results/2020.10.30-10.30.19/mdtest-hard.stonewall -r -a POSIX
score           = 13.096031
t_delta         = 490.0292
t_end           = 2020-10-30 12:24:51

[SCORE]
MD              = 43.434808
BW              = 2.626010
SCORE           = 10.679899 
hash            = 97F678C0
; END 2020-10-30 12:25:16
result_summary
IO500 version io500-sc20_v3
[RESULT]       ior-easy-write       33.062243 GiB/s : time 652.400 seconds
[RESULT]    mdtest-easy-write       44.538543 kIOPS : time 356.282 seconds
[RESULT]       ior-hard-write        0.105563 GiB/s : time 1659.079 seconds
[RESULT]    mdtest-hard-write       21.207352 kIOPS : time 301.833 seconds
[RESULT]                 find       31.900553 kIOPS : time 697.922 seconds
[RESULT]        ior-easy-read       11.918133 GiB/s : time 1809.659 seconds
[RESULT]     mdtest-easy-stat      125.161518 kIOPS : time 126.813 seconds
[RESULT]        ior-hard-read        1.143227 GiB/s : time 153.659 seconds
[RESULT]     mdtest-hard-stat      129.937693 kIOPS : time 49.334 seconds
[RESULT]   mdtest-easy-delete       34.787501 kIOPS : time 458.263 seconds
[RESULT]     mdtest-hard-read       56.743186 kIOPS : time 112.800 seconds
[RESULT]   mdtest-hard-delete       13.096031 kIOPS : time 490.029 seconds
[SCORE] Bandwidth 2.626010 GiB/s : IOPS 43.434808 kiops : TOTAL 10.679899