BeeGFS on Oracle Cloud

Institution Oracle Cloud Infrastructure
Client Procs Per Node
Client Operating System Oracle Linux UEK
Client Operating System Version 7.7
Client Kernel Version 4.14.35-1902.6.6.el7uek.x86_64

DATA SERVER

Storage Type NVMe
Volatile Memory 384 GB
Storage Interface NVMe
Network Ethernet
Software Version 7.1.5
OS Version OracleLinuxUEK77

INFORMATION

Client Nodes 170
Client Total Procs 2,040
Metadata Nodes 150
Metadata Storage Devices 1
Data Nodes 170
Data Storage Devices 1

METADATA

Easy Write 1,910.52 kIOP/s
Easy Stat 8,595.73 kIOP/s
Easy Delete 2,021.91 kIOP/s
Hard Write 2.33 kIOP/s
Hard Read 17.79 kIOP/s
Hard Stat 24.39 kIOP/s
Hard Delete 7.05 kIOP/s

Submitted Files

ior-easy-read
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Mon Jul  6 19:56:08 2020
Command line        : ./ior -C -Q 1 -g -G 271 -k -e -o ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-easy/stonewall -t 1m -b 200000m -F -r -R -a POSIX
Machine             : Linux inst-0ne1g-guided-louse
TestID              : 0
StartTime           : Mon Jul  6 19:56:08 2020
Path                : /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app/ior-easy
FS                  : 989.4 TiB   Used FS: 41.9%   Inodes: 0.0 Mi   Used Inodes: -nan%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy
access              : file-per-process
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 170
tasks               : 2040
clients per node    : 12
repetitions         : 1
xfersize            : 1 MiB
blocksize           : 195.31 GiB
aggregate filesize  : 389.10 TiB

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
WARNING: Expected aggregate file size       = 427819008000000.
WARNING: Stat() of aggregate file size      = 217995175526400.
WARNING: Using actual aggregate bytes moved = 217995175526400.
read      485326     485827     0.002140    204800000  1024.00    0.180552   427.92     0.262658   428.36     0   
Max Read:  485325.83 MiB/sec (508901.02 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
read       485325.83  485325.83  485325.83       0.00  485325.83  485325.83  485325.83       0.00  428.36459         NA            NA     0   2040  12    1   1     1        1         0    0      1 209715200000  1048576 207896400.0 POSIX      0
Finished            : Mon Jul  6 20:03:17 2020
ior-easy-write
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Mon Jul  6 19:05:45 2020
Command line        : ./ior -C -Q 1 -g -G 271 -k -e -o ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-easy/stonewall -t 1m -b 200000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX
Machine             : Linux inst-0ne1g-guided-louse
TestID              : 0
StartTime           : Mon Jul  6 19:05:45 2020
Path                : /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app/ior-easy
FS                  : 989.4 TiB   Used FS: 21.1%   Inodes: 0.0 Mi   Used Inodes: -nan%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy
access              : file-per-process
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 170
tasks               : 2040
clients per node    : 12
repetitions         : 1
xfersize            : 1 MiB
blocksize           : 195.31 GiB
aggregate filesize  : 389.10 TiB
stonewallingTime    : 300
stoneWallingWearOut : 1

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 56163 max: 101910 -- min data: 54.8 GiB mean data: 83.5 GiB time: 300.1s
WARNING: Expected aggregate file size       = 427819008000000.
WARNING: Stat() of aggregate file size      = 217995175526400.
WARNING: Using actual aggregate bytes moved = 217995175526400.
WARNING: maybe caused by deadlineForStonewalling
write     358973     447187     0.002144    204800000  1024.00    114.00     464.90     0.242540   579.14     0   
Max Write: 358972.86 MiB/sec (376410.33 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
write      358972.86  358972.86  358972.86       0.00  358972.86  358972.86  358972.86       0.00  579.14238     300.10     581010.04     0   2040  12    1   1     1        1         0    0      1 209715200000  1048576 207896400.0 POSIX      0
Finished            : Mon Jul  6 19:17:00 2020
ior-hard-read
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Mon Jul  6 20:05:44 2020
Command line        : ./ior -C -Q 1 -g -G 27 -k -e -o ./out//2020.07.06-17.56.35-app/ior-hard/file -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 1600000 -r -R -a POSIX
Machine             : Linux inst-0ne1g-guided-louse
TestID              : 0
StartTime           : Mon Jul  6 20:05:44 2020
Path                : /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app/ior-hard
FS                  : 989.4 TiB   Used FS: 41.9%   Inodes: 0.0 Mi   Used Inodes: -nan%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : ./out//2020.07.06-17.56.35-app/ior-hard/file
access              : single-shared-file
type                : independent
segments            : 1600000
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 170
tasks               : 2040
clients per node    : 12
repetitions         : 1
xfersize            : 47008 bytes
blocksize           : 47008 bytes
aggregate filesize  : 139.55 TiB

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 20837 max: 20837 -- min data: 0.9 GiB mean data: 0.9 GiB time: 170.8s
WARNING: Expected aggregate file size       = 153434112000000.
WARNING: Stat() of aggregate file size      = 1998191619840.
WARNING: Using actual aggregate bytes moved = 1998191619840.
read      11143      248795     170.85      45.91      45.91      0.154515   170.85     0.010689   171.02     0   
Max Read:  11142.88 MiB/sec (11684.16 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
read        11142.88   11142.88   11142.88       0.00  248556.85  248556.85  248556.85       0.00  171.01713     170.76      11159.76     0   2040  12    1   0     1        1         0    0 1600000    47008    47008 1905624.0 POSIX      0
Finished            : Mon Jul  6 20:08:35 2020
ior-hard-write
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began               : Mon Jul  6 19:28:02 2020
Command line        : ./ior -C -Q 1 -g -G 27 -k -e -o ./out//2020.07.06-17.56.35-app/ior-hard/file -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 1600000 -w -D 300 -a POSIX
Machine             : Linux inst-0ne1g-guided-louse
TestID              : 0
StartTime           : Mon Jul  6 19:28:02 2020
Path                : /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app/ior-hard
FS                  : 989.4 TiB   Used FS: 41.7%   Inodes: 0.0 Mi   Used Inodes: -nan%

Options: 
api                 : POSIX
apiVersion          : 
test filename       : ./out//2020.07.06-17.56.35-app/ior-hard/file
access              : single-shared-file
type                : independent
segments            : 1600000
ordering in a file  : sequential
ordering inter file : constant task offset
task offset         : 1
nodes               : 170
tasks               : 2040
clients per node    : 12
repetitions         : 1
xfersize            : 47008 bytes
blocksize           : 47008 bytes
aggregate filesize  : 139.55 TiB
stonewallingTime    : 300
stoneWallingWearOut : 1

Results: 

access    bw(MiB/s)  IOPS       Latency(s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ----       ----------  ---------- ---------  --------   --------   --------   --------   ----
stonewalling pairs accessed min: 3627 max: 20837 -- min data: 0.2 GiB mean data: 0.3 GiB time: 316.5s
WARNING: Expected aggregate file size       = 153434112000000.
WARNING: Stat() of aggregate file size      = 1998191619840.
WARNING: Using actual aggregate bytes moved = 1998191619840.
WARNING: maybe caused by deadlineForStonewalling
write     1874.10    42823      833.60      45.91      45.91      24.17      992.64     0.010346   1016.82    0   
Max Write: 1874.10 MiB/sec (1965.14 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
write        1874.10    1874.10    1874.10       0.00   41804.37   41804.37   41804.37       0.00 1016.81898     316.49       2240.72     0   2040  12    1   0     1        1         0    0 1600000    47008    47008 1905624.0 POSIX      0
Finished            : Mon Jul  6 19:46:53 2020
mdtest-easy-delete
-- started at 07/06/2020 20:09:15 --

mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '2000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' './out//2020.07.06-17.56.35-app/mdtest-easy' '-x' './out//2020.07.06-17.56.35-app/mdtest-easy-stonewall' '-r' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB   Used FS: 41.9%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 12 for each phase.
2040 tasks, 4080000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :    2021913.713    2021911.471    2021912.344          0.398
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.043          0.043          0.043          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :        624.267        624.267        624.267          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :         23.066         23.066         23.066          0.000
-- finished at 07/06/2020 20:20:07 --

mdtest-easy-stat
-- started at 07/06/2020 20:03:17 --

mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '2000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' './out//2020.07.06-17.56.35-app/mdtest-easy' '-x' './out//2020.07.06-17.56.35-app/mdtest-easy-stonewall' '-T' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB   Used FS: 41.9%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 12 for each phase.
2040 tasks, 4080000000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :    8595744.958    8595718.060    8595729.798          3.257
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :        146.842        146.842        146.842          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/06/2020 20:05:44 --

mdtest-easy-write
-- started at 07/06/2020 19:17:00 --

mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '2000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' './out//2020.07.06-17.56.35-app/mdtest-easy' '-x' './out//2020.07.06-17.56.35-app/mdtest-easy-stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB   Used FS: 41.2%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 12 for each phase.
2040 tasks, 4080000000 files
Continue stonewall hit min: 251075 max: 618732 avg: 418224.1 


SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :    1910524.496    1910518.925    1910521.757          1.255
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA    2820824.311             NA
   Tree creation             :          3.609          3.609          3.609          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :        660.665        660.663        660.664          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA        302.457             NA
   Tree creation             :          0.277          0.277          0.277          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/06/2020 19:28:02 --

mdtest-hard-delete
-- started at 07/06/2020 20:21:01 --

mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '130000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' './out//2020.07.06-17.56.35-app/mdtest-hard' '-x' './out//2020.07.06-17.56.35-app/mdtest-hard-stonewall' '-r' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB   Used FS: 41.3%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 12 for each phase.
2040 tasks, 265200000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :       7052.961       7052.935       7052.951          0.003
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.925          0.925          0.925          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :        138.257        138.257        138.257          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          1.081          1.081          1.081          0.000
-- finished at 07/06/2020 20:23:21 --

mdtest-hard-read
-- started at 07/06/2020 20:20:07 --

mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '130000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' './out//2020.07.06-17.56.35-app/mdtest-hard' '-x' './out//2020.07.06-17.56.35-app/mdtest-hard-stonewall' '-E' '-X' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB   Used FS: 41.3%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 12 for each phase.
2040 tasks, 265200000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :      17786.036      17785.968      17786.001          0.009
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :         54.825         54.825         54.825          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/06/2020 20:21:01 --

mdtest-hard-stat
-- started at 07/06/2020 20:08:35 --

mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '130000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' './out//2020.07.06-17.56.35-app/mdtest-hard' '-x' './out//2020.07.06-17.56.35-app/mdtest-hard-stonewall' '-T' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB   Used FS: 41.9%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 12 for each phase.
2040 tasks, 265200000 files

SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :      24385.426      24385.287      24385.333          0.016
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :          0.000          0.000          0.000          0.000
   File stat                 :         39.988         39.988         39.988          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   Tree creation             :          0.000          0.000          0.000          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/06/2020 20:09:15 --

mdtest-hard-write
-- started at 07/06/2020 19:46:53 --

mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '130000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' './out//2020.07.06-17.56.35-app/mdtest-hard' '-x' './out//2020.07.06-17.56.35-app/mdtest-hard-stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB   Used FS: 41.9%   Inodes: 0.0 Mi   Used Inodes: -nan%

Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank   0 Line  2166 Shifting ranks by 12 for each phase.
2040 tasks, 265200000 files
Continue stonewall hit min: 441 max: 478 avg: 448.9 


SUMMARY rate: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :       2333.364       2333.361       2333.363          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA       3042.889             NA
   Tree creation             :        137.120        137.120        137.120          0.000
   Tree removal              :          0.000          0.000          0.000          0.000

SUMMARY time: (of 1 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   File creation             :        417.904        417.903        417.903          0.000
   File stat                 :          0.000          0.000          0.000          0.000
   File read                 :          0.000          0.000          0.000          0.000
   File removal              :          0.000          0.000          0.000          0.000
   File create (stonewall)   :             NA             NA        300.918             NA
   Tree creation             :          0.007          0.007          0.007          0.000
   Tree removal              :          0.000          0.000          0.000          0.000
-- finished at 07/06/2020 19:53:52 --

result
version         = io500-isc20_v4
config-hash     = 65076E74
result-dir      = ./results//2020.07.06-17.56.35-app
; START 2020-07-06 19:05:45
; WARNING Using internal pfind, will ignore any arguments to the external script


[ior-easy-write]
t_start         = 2020-07-06 19:05:45
exe             = ./ior -C -Q 1 -g -G 271 -k -e -o ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-easy/stonewall -t 1m -b 200000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX
throughput-stonewall = 599774.45
score           = 350.559438
t_delta         = 674.2191
t_end           = 2020-07-06 19:17:00

[mdtest-easy-write]
t_start         = 2020-07-06 19:17:00
exe             = ./mdtest -n 2000000 -u -L -F -P -N 1 -d ./out//2020.07.06-17.56.35-app/mdtest-easy -x ./out//2020.07.06-17.56.35-app/mdtest-easy-stonewall -C -Y -W 300 -a POSIX
rate-stonewall  = 2820.824311
score           = 1910.521400
t_delta         = 662.8892
t_end           = 2020-07-06 19:28:02

[timestamp]
t_start         = 2020-07-06 19:28:02
t_delta         = 0.0011
t_end           = 2020-07-06 19:28:02

[ior-hard-write]
t_start         = 2020-07-06 19:28:02
exe             = ./ior -C -Q 1 -g -G 27 -k -e -o ./out//2020.07.06-17.56.35-app/ior-hard/file -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 1600000 -w -D 300 -a POSIX
throughput-stonewall = 1389.43
score           = 1.830179
t_delta         = 1130.7011
t_end           = 2020-07-06 19:46:53

[mdtest-hard-write]
t_start         = 2020-07-06 19:46:53
exe             = ./mdtest -n 130000 -t -w 3901 -e 3901 -P -N 1 -F -d ./out//2020.07.06-17.56.35-app/mdtest-hard -x ./out//2020.07.06-17.56.35-app/mdtest-hard-stonewall -C -Y -W 300 -a POSIX
rate-stonewall  = 3.042889
score           = 2.333363
t_delta         = 418.6958
t_end           = 2020-07-06 19:53:52

[find]
t_start         = 2020-07-06 19:53:52
exe             = ./pfind ./out//2020.07.06-17.56.35-app -newer ./out//2020.07.06-17.56.35-app/timestampfile -size 3901c -name *01* -C -N -H 1 -q 15000
found           = 27120
total-files     = 1263190446
score           = 9265.907975
t_delta         = 136.3629
t_end           = 2020-07-06 19:56:08

[ior-easy-read]
t_start         = 2020-07-06 19:56:08
exe             = ./ior -C -Q 1 -g -G 271 -k -e -o ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-easy/stonewall -t 1m -b 200000m -F -r -R -a POSIX
score           = 473.951010
t_delta         = 428.4238
t_end           = 2020-07-06 20:03:17

[mdtest-easy-stat]
t_start         = 2020-07-06 20:03:17
exe             = ./mdtest -n 2000000 -u -L -F -P -N 1 -d ./out//2020.07.06-17.56.35-app/mdtest-easy -x ./out//2020.07.06-17.56.35-app/mdtest-easy-stonewall -T -a POSIX
score           = 8595.725805
t_delta         = 146.8546
t_end           = 2020-07-06 20:05:44

[ior-hard-read]
t_start         = 2020-07-06 20:05:44
exe             = ./ior -C -Q 1 -g -G 27 -k -e -o ./out//2020.07.06-17.56.35-app/ior-hard/file -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 1600000 -r -R -a POSIX
score           = 10.881723
t_delta         = 171.1793
t_end           = 2020-07-06 20:08:35

[mdtest-hard-stat]
t_start         = 2020-07-06 20:08:35
exe             = ./mdtest -n 130000 -t -w 3901 -e 3901 -P -N 1 -F -d ./out//2020.07.06-17.56.35-app/mdtest-hard -x ./out//2020.07.06-17.56.35-app/mdtest-hard-stonewall -T -a POSIX
score           = 24.385338
t_delta         = 39.9967
t_end           = 2020-07-06 20:09:15

[mdtest-easy-delete]
t_start         = 2020-07-06 20:09:15
exe             = ./mdtest -n 2000000 -u -L -F -P -N 1 -d ./out//2020.07.06-17.56.35-app/mdtest-easy -x ./out//2020.07.06-17.56.35-app/mdtest-easy-stonewall -r -a POSIX
score           = 2021.912150
t_delta         = 651.8392
t_end           = 2020-07-06 20:20:07

[mdtest-hard-read]
t_start         = 2020-07-06 20:20:07
exe             = ./mdtest -n 130000 -t -w 3901 -e 3901 -P -N 1 -F -d ./out//2020.07.06-17.56.35-app/mdtest-hard -x ./out//2020.07.06-17.56.35-app/mdtest-hard-stonewall -E -X -a POSIX
score           = 17.786020
t_delta         = 54.8385
t_end           = 2020-07-06 20:21:01

[mdtest-hard-delete]
t_start         = 2020-07-06 20:21:01
exe             = ./mdtest -n 130000 -t -w 3901 -e 3901 -P -N 1 -F -d ./out//2020.07.06-17.56.35-app/mdtest-hard -x ./out//2020.07.06-17.56.35-app/mdtest-hard-stonewall -r -a POSIX
score           = 7.052951
t_delta         = 139.3481
t_end           = 2020-07-06 20:23:21

[SCORE]
MD              = 196.203013
BW              = 42.650251
SCORE           = 91.477362 
hash            = 6CC0DBB
; END 2020-07-06 20:23:21
result_summary
IO500 version io500-isc20_v4
[RESULT]       ior-easy-write      350.559438 GiB/s  : time 674.219 seconds
[RESULT]    mdtest-easy-write     1910.521400 kIOPS : time 662.889 seconds
[RESULT]       ior-hard-write        1.830179 GiB/s  : time 1130.701 seconds
[RESULT]    mdtest-hard-write        2.333363 kIOPS : time 418.696 seconds
[RESULT]                 find     9265.907975 kIOPS : time 136.363 seconds
[RESULT]        ior-easy-read      473.951010 GiB/s  : time 428.424 seconds
[RESULT]     mdtest-easy-stat     8595.725805 kIOPS : time 146.855 seconds
[RESULT]        ior-hard-read       10.881723 GiB/s  : time 171.179 seconds
[RESULT]     mdtest-hard-stat       24.385338 kIOPS : time 39.997 seconds
[RESULT]   mdtest-easy-delete     2021.912150 kIOPS : time 651.839 seconds
[RESULT]     mdtest-hard-read       17.786020 kIOPS : time 54.838 seconds
[RESULT]   mdtest-hard-delete        7.052951 kIOPS : time 139.348 seconds
[SCORE] Bandwidth 42.650251 GB/s : IOPS 196.203013 kiops : TOTAL 91.477362