- ior-easy-read
-
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began : Mon Jul 6 19:56:08 2020
Command line : ./ior -C -Q 1 -g -G 271 -k -e -o ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-easy/stonewall -t 1m -b 200000m -F -r -R -a POSIX
Machine : Linux inst-0ne1g-guided-louse
TestID : 0
StartTime : Mon Jul 6 19:56:08 2020
Path : /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app/ior-easy
FS : 989.4 TiB Used FS: 41.9% Inodes: 0.0 Mi Used Inodes: -nan%
Options:
api : POSIX
apiVersion :
test filename : ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : constant task offset
task offset : 1
nodes : 170
tasks : 2040
clients per node : 12
repetitions : 1
xfersize : 1 MiB
blocksize : 195.31 GiB
aggregate filesize : 389.10 TiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
WARNING: Expected aggregate file size = 427819008000000.
WARNING: Stat() of aggregate file size = 217995175526400.
WARNING: Using actual aggregate bytes moved = 217995175526400.
read 485326 485827 0.002140 204800000 1024.00 0.180552 427.92 0.262658 428.36 0
Max Read: 485325.83 MiB/sec (508901.02 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
read 485325.83 485325.83 485325.83 0.00 485325.83 485325.83 485325.83 0.00 428.36459 NA NA 0 2040 12 1 1 1 1 0 0 1 209715200000 1048576 207896400.0 POSIX 0
Finished : Mon Jul 6 20:03:17 2020
- ior-easy-write
-
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began : Mon Jul 6 19:05:45 2020
Command line : ./ior -C -Q 1 -g -G 271 -k -e -o ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-easy/stonewall -t 1m -b 200000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX
Machine : Linux inst-0ne1g-guided-louse
TestID : 0
StartTime : Mon Jul 6 19:05:45 2020
Path : /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app/ior-easy
FS : 989.4 TiB Used FS: 21.1% Inodes: 0.0 Mi Used Inodes: -nan%
Options:
api : POSIX
apiVersion :
test filename : ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : constant task offset
task offset : 1
nodes : 170
tasks : 2040
clients per node : 12
repetitions : 1
xfersize : 1 MiB
blocksize : 195.31 GiB
aggregate filesize : 389.10 TiB
stonewallingTime : 300
stoneWallingWearOut : 1
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
stonewalling pairs accessed min: 56163 max: 101910 -- min data: 54.8 GiB mean data: 83.5 GiB time: 300.1s
WARNING: Expected aggregate file size = 427819008000000.
WARNING: Stat() of aggregate file size = 217995175526400.
WARNING: Using actual aggregate bytes moved = 217995175526400.
WARNING: maybe caused by deadlineForStonewalling
write 358973 447187 0.002144 204800000 1024.00 114.00 464.90 0.242540 579.14 0
Max Write: 358972.86 MiB/sec (376410.33 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 358972.86 358972.86 358972.86 0.00 358972.86 358972.86 358972.86 0.00 579.14238 300.10 581010.04 0 2040 12 1 1 1 1 0 0 1 209715200000 1048576 207896400.0 POSIX 0
Finished : Mon Jul 6 19:17:00 2020
- ior-hard-read
-
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began : Mon Jul 6 20:05:44 2020
Command line : ./ior -C -Q 1 -g -G 27 -k -e -o ./out//2020.07.06-17.56.35-app/ior-hard/file -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 1600000 -r -R -a POSIX
Machine : Linux inst-0ne1g-guided-louse
TestID : 0
StartTime : Mon Jul 6 20:05:44 2020
Path : /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app/ior-hard
FS : 989.4 TiB Used FS: 41.9% Inodes: 0.0 Mi Used Inodes: -nan%
Options:
api : POSIX
apiVersion :
test filename : ./out//2020.07.06-17.56.35-app/ior-hard/file
access : single-shared-file
type : independent
segments : 1600000
ordering in a file : sequential
ordering inter file : constant task offset
task offset : 1
nodes : 170
tasks : 2040
clients per node : 12
repetitions : 1
xfersize : 47008 bytes
blocksize : 47008 bytes
aggregate filesize : 139.55 TiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
stonewalling pairs accessed min: 20837 max: 20837 -- min data: 0.9 GiB mean data: 0.9 GiB time: 170.8s
WARNING: Expected aggregate file size = 153434112000000.
WARNING: Stat() of aggregate file size = 1998191619840.
WARNING: Using actual aggregate bytes moved = 1998191619840.
read 11143 248795 170.85 45.91 45.91 0.154515 170.85 0.010689 171.02 0
Max Read: 11142.88 MiB/sec (11684.16 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
read 11142.88 11142.88 11142.88 0.00 248556.85 248556.85 248556.85 0.00 171.01713 170.76 11159.76 0 2040 12 1 0 1 1 0 0 1600000 47008 47008 1905624.0 POSIX 0
Finished : Mon Jul 6 20:08:35 2020
- ior-hard-write
-
IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O
Began : Mon Jul 6 19:28:02 2020
Command line : ./ior -C -Q 1 -g -G 27 -k -e -o ./out//2020.07.06-17.56.35-app/ior-hard/file -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 1600000 -w -D 300 -a POSIX
Machine : Linux inst-0ne1g-guided-louse
TestID : 0
StartTime : Mon Jul 6 19:28:02 2020
Path : /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app/ior-hard
FS : 989.4 TiB Used FS: 41.7% Inodes: 0.0 Mi Used Inodes: -nan%
Options:
api : POSIX
apiVersion :
test filename : ./out//2020.07.06-17.56.35-app/ior-hard/file
access : single-shared-file
type : independent
segments : 1600000
ordering in a file : sequential
ordering inter file : constant task offset
task offset : 1
nodes : 170
tasks : 2040
clients per node : 12
repetitions : 1
xfersize : 47008 bytes
blocksize : 47008 bytes
aggregate filesize : 139.55 TiB
stonewallingTime : 300
stoneWallingWearOut : 1
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
stonewalling pairs accessed min: 3627 max: 20837 -- min data: 0.2 GiB mean data: 0.3 GiB time: 316.5s
WARNING: Expected aggregate file size = 153434112000000.
WARNING: Stat() of aggregate file size = 1998191619840.
WARNING: Using actual aggregate bytes moved = 1998191619840.
WARNING: maybe caused by deadlineForStonewalling
write 1874.10 42823 833.60 45.91 45.91 24.17 992.64 0.010346 1016.82 0
Max Write: 1874.10 MiB/sec (1965.14 MB/sec)
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 1874.10 1874.10 1874.10 0.00 41804.37 41804.37 41804.37 0.00 1016.81898 316.49 2240.72 0 2040 12 1 0 1 1 0 0 1600000 47008 47008 1905624.0 POSIX 0
Finished : Mon Jul 6 19:46:53 2020
- mdtest-easy-delete
-
-- started at 07/06/2020 20:09:15 --
mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '2000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' './out//2020.07.06-17.56.35-app/mdtest-easy' '-x' './out//2020.07.06-17.56.35-app/mdtest-easy-stonewall' '-r' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB Used FS: 41.9% Inodes: 0.0 Mi Used Inodes: -nan%
Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 12 for each phase.
2040 tasks, 4080000000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 2021913.713 2021911.471 2021912.344 0.398
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.043 0.043 0.043 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 624.267 624.267 624.267 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 23.066 23.066 23.066 0.000
-- finished at 07/06/2020 20:20:07 --
- mdtest-easy-stat
-
-- started at 07/06/2020 20:03:17 --
mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '2000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' './out//2020.07.06-17.56.35-app/mdtest-easy' '-x' './out//2020.07.06-17.56.35-app/mdtest-easy-stonewall' '-T' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB Used FS: 41.9% Inodes: 0.0 Mi Used Inodes: -nan%
Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 12 for each phase.
2040 tasks, 4080000000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 8595744.958 8595718.060 8595729.798 3.257
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 146.842 146.842 146.842 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/06/2020 20:05:44 --
- mdtest-easy-write
-
-- started at 07/06/2020 19:17:00 --
mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '2000000' '-u' '-L' '-F' '-P' '-N' '1' '-d' './out//2020.07.06-17.56.35-app/mdtest-easy' '-x' './out//2020.07.06-17.56.35-app/mdtest-easy-stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB Used FS: 41.2% Inodes: 0.0 Mi Used Inodes: -nan%
Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 12 for each phase.
2040 tasks, 4080000000 files
Continue stonewall hit min: 251075 max: 618732 avg: 418224.1
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 1910524.496 1910518.925 1910521.757 1.255
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
File create (stonewall) : NA NA 2820824.311 NA
Tree creation : 3.609 3.609 3.609 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 660.665 660.663 660.664 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
File create (stonewall) : NA NA 302.457 NA
Tree creation : 0.277 0.277 0.277 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/06/2020 19:28:02 --
- mdtest-hard-delete
-
-- started at 07/06/2020 20:21:01 --
mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '130000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' './out//2020.07.06-17.56.35-app/mdtest-hard' '-x' './out//2020.07.06-17.56.35-app/mdtest-hard-stonewall' '-r' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB Used FS: 41.3% Inodes: 0.0 Mi Used Inodes: -nan%
Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 12 for each phase.
2040 tasks, 265200000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 7052.961 7052.935 7052.951 0.003
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.925 0.925 0.925 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 138.257 138.257 138.257 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 1.081 1.081 1.081 0.000
-- finished at 07/06/2020 20:23:21 --
- mdtest-hard-read
-
-- started at 07/06/2020 20:20:07 --
mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '130000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' './out//2020.07.06-17.56.35-app/mdtest-hard' '-x' './out//2020.07.06-17.56.35-app/mdtest-hard-stonewall' '-E' '-X' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB Used FS: 41.3% Inodes: 0.0 Mi Used Inodes: -nan%
Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 12 for each phase.
2040 tasks, 265200000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 17786.036 17785.968 17786.001 0.009
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 54.825 54.825 54.825 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/06/2020 20:21:01 --
- mdtest-hard-stat
-
-- started at 07/06/2020 20:08:35 --
mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '130000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' './out//2020.07.06-17.56.35-app/mdtest-hard' '-x' './out//2020.07.06-17.56.35-app/mdtest-hard-stonewall' '-T' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB Used FS: 41.9% Inodes: 0.0 Mi Used Inodes: -nan%
Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 12 for each phase.
2040 tasks, 265200000 files
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 24385.426 24385.287 24385.333 0.016
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 0.000 0.000 0.000 0.000
File stat : 39.988 39.988 39.988 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
Tree creation : 0.000 0.000 0.000 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/06/2020 20:09:15 --
- mdtest-hard-write
-
-- started at 07/06/2020 19:46:53 --
mdtest-3.3.0+dev was launched with 2040 total task(s) on 170 node(s)
Command line used: ./mdtest '-n' '130000' '-t' '-w' '3901' '-e' '3901' '-P' '-N' '1' '-F' '-d' './out//2020.07.06-17.56.35-app/mdtest-hard' '-x' './out//2020.07.06-17.56.35-app/mdtest-hard-stonewall' '-C' '-Y' '-W' '300' '-a' 'POSIX'
Path: /mnt/beeond/io500-app/out/2020.07.06-17.56.35-app
FS: 989.4 TiB Used FS: 41.9% Inodes: 0.0 Mi Used Inodes: -nan%
Nodemap: 111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
V-0: Rank 0 Line 2166 Shifting ranks by 12 for each phase.
2040 tasks, 265200000 files
Continue stonewall hit min: 441 max: 478 avg: 448.9
SUMMARY rate: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 2333.364 2333.361 2333.363 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
File create (stonewall) : NA NA 3042.889 NA
Tree creation : 137.120 137.120 137.120 0.000
Tree removal : 0.000 0.000 0.000 0.000
SUMMARY time: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 417.904 417.903 417.903 0.000
File stat : 0.000 0.000 0.000 0.000
File read : 0.000 0.000 0.000 0.000
File removal : 0.000 0.000 0.000 0.000
File create (stonewall) : NA NA 300.918 NA
Tree creation : 0.007 0.007 0.007 0.000
Tree removal : 0.000 0.000 0.000 0.000
-- finished at 07/06/2020 19:53:52 --
- result
-
version = io500-isc20_v4
config-hash = 65076E74
result-dir = ./results//2020.07.06-17.56.35-app
; START 2020-07-06 19:05:45
; WARNING Using internal pfind, will ignore any arguments to the external script
[ior-easy-write]
t_start = 2020-07-06 19:05:45
exe = ./ior -C -Q 1 -g -G 271 -k -e -o ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-easy/stonewall -t 1m -b 200000m -F -w -D 300 -O stoneWallingWearOut=1 -a POSIX
throughput-stonewall = 599774.45
score = 350.559438
t_delta = 674.2191
t_end = 2020-07-06 19:17:00
[mdtest-easy-write]
t_start = 2020-07-06 19:17:00
exe = ./mdtest -n 2000000 -u -L -F -P -N 1 -d ./out//2020.07.06-17.56.35-app/mdtest-easy -x ./out//2020.07.06-17.56.35-app/mdtest-easy-stonewall -C -Y -W 300 -a POSIX
rate-stonewall = 2820.824311
score = 1910.521400
t_delta = 662.8892
t_end = 2020-07-06 19:28:02
[timestamp]
t_start = 2020-07-06 19:28:02
t_delta = 0.0011
t_end = 2020-07-06 19:28:02
[ior-hard-write]
t_start = 2020-07-06 19:28:02
exe = ./ior -C -Q 1 -g -G 27 -k -e -o ./out//2020.07.06-17.56.35-app/ior-hard/file -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 1600000 -w -D 300 -a POSIX
throughput-stonewall = 1389.43
score = 1.830179
t_delta = 1130.7011
t_end = 2020-07-06 19:46:53
[mdtest-hard-write]
t_start = 2020-07-06 19:46:53
exe = ./mdtest -n 130000 -t -w 3901 -e 3901 -P -N 1 -F -d ./out//2020.07.06-17.56.35-app/mdtest-hard -x ./out//2020.07.06-17.56.35-app/mdtest-hard-stonewall -C -Y -W 300 -a POSIX
rate-stonewall = 3.042889
score = 2.333363
t_delta = 418.6958
t_end = 2020-07-06 19:53:52
[find]
t_start = 2020-07-06 19:53:52
exe = ./pfind ./out//2020.07.06-17.56.35-app -newer ./out//2020.07.06-17.56.35-app/timestampfile -size 3901c -name *01* -C -N -H 1 -q 15000
found = 27120
total-files = 1263190446
score = 9265.907975
t_delta = 136.3629
t_end = 2020-07-06 19:56:08
[ior-easy-read]
t_start = 2020-07-06 19:56:08
exe = ./ior -C -Q 1 -g -G 271 -k -e -o ./out//2020.07.06-17.56.35-app/ior-easy/ior_file_easy -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-easy/stonewall -t 1m -b 200000m -F -r -R -a POSIX
score = 473.951010
t_delta = 428.4238
t_end = 2020-07-06 20:03:17
[mdtest-easy-stat]
t_start = 2020-07-06 20:03:17
exe = ./mdtest -n 2000000 -u -L -F -P -N 1 -d ./out//2020.07.06-17.56.35-app/mdtest-easy -x ./out//2020.07.06-17.56.35-app/mdtest-easy-stonewall -T -a POSIX
score = 8595.725805
t_delta = 146.8546
t_end = 2020-07-06 20:05:44
[ior-hard-read]
t_start = 2020-07-06 20:05:44
exe = ./ior -C -Q 1 -g -G 27 -k -e -o ./out//2020.07.06-17.56.35-app/ior-hard/file -O stoneWallingStatusFile=./out//2020.07.06-17.56.35-app/ior-hard/stonewall -O stoneWallingWearOut=1 -t 47008 -b 47008 -s 1600000 -r -R -a POSIX
score = 10.881723
t_delta = 171.1793
t_end = 2020-07-06 20:08:35
[mdtest-hard-stat]
t_start = 2020-07-06 20:08:35
exe = ./mdtest -n 130000 -t -w 3901 -e 3901 -P -N 1 -F -d ./out//2020.07.06-17.56.35-app/mdtest-hard -x ./out//2020.07.06-17.56.35-app/mdtest-hard-stonewall -T -a POSIX
score = 24.385338
t_delta = 39.9967
t_end = 2020-07-06 20:09:15
[mdtest-easy-delete]
t_start = 2020-07-06 20:09:15
exe = ./mdtest -n 2000000 -u -L -F -P -N 1 -d ./out//2020.07.06-17.56.35-app/mdtest-easy -x ./out//2020.07.06-17.56.35-app/mdtest-easy-stonewall -r -a POSIX
score = 2021.912150
t_delta = 651.8392
t_end = 2020-07-06 20:20:07
[mdtest-hard-read]
t_start = 2020-07-06 20:20:07
exe = ./mdtest -n 130000 -t -w 3901 -e 3901 -P -N 1 -F -d ./out//2020.07.06-17.56.35-app/mdtest-hard -x ./out//2020.07.06-17.56.35-app/mdtest-hard-stonewall -E -X -a POSIX
score = 17.786020
t_delta = 54.8385
t_end = 2020-07-06 20:21:01
[mdtest-hard-delete]
t_start = 2020-07-06 20:21:01
exe = ./mdtest -n 130000 -t -w 3901 -e 3901 -P -N 1 -F -d ./out//2020.07.06-17.56.35-app/mdtest-hard -x ./out//2020.07.06-17.56.35-app/mdtest-hard-stonewall -r -a POSIX
score = 7.052951
t_delta = 139.3481
t_end = 2020-07-06 20:23:21
[SCORE]
MD = 196.203013
BW = 42.650251
SCORE = 91.477362
hash = 6CC0DBB
; END 2020-07-06 20:23:21
- result_summary
-
IO500 version io500-isc20_v4
[RESULT] ior-easy-write 350.559438 GiB/s : time 674.219 seconds
[RESULT] mdtest-easy-write 1910.521400 kIOPS : time 662.889 seconds
[RESULT] ior-hard-write 1.830179 GiB/s : time 1130.701 seconds
[RESULT] mdtest-hard-write 2.333363 kIOPS : time 418.696 seconds
[RESULT] find 9265.907975 kIOPS : time 136.363 seconds
[RESULT] ior-easy-read 473.951010 GiB/s : time 428.424 seconds
[RESULT] mdtest-easy-stat 8595.725805 kIOPS : time 146.855 seconds
[RESULT] ior-hard-read 10.881723 GiB/s : time 171.179 seconds
[RESULT] mdtest-hard-stat 24.385338 kIOPS : time 39.997 seconds
[RESULT] mdtest-easy-delete 2021.912150 kIOPS : time 651.839 seconds
[RESULT] mdtest-hard-read 17.786020 kIOPS : time 54.838 seconds
[RESULT] mdtest-hard-delete 7.052951 kIOPS : time 139.348 seconds
[SCORE] Bandwidth 42.650251 GB/s : IOPS 196.203013 kiops : TOTAL 91.477362