IOR-3.2.0: MPI Coordinated Test of Parallel I/O Began : Tue May 14 09:01:59 2019 Command line : /work/oehmes/io-500-dev/bin/ior -w -s 520000 -a MPIIO -H -U hintsfile -i 1 -C -Q 1 -g -G 27 -k -e -t 47008 -b 47008 -o /optane/datafiles/io500.2019.05.14-08.51.37/ior_hard/IOR_file -O stoneWallingStatusFile=/optane/datafiles/io500.2019.05.14-08.51.37/ior_hard/stonewall -O stoneWallingWearOut=1 -D 300 Machine : Linux c200 TestID : 0 StartTime : Tue May 14 09:01:59 2019 Path : /optane/datafiles/io500.2019.05.14-08.51.37/ior_hard FS : 12.0 TiB Used FS: 92.1% Inodes: 76.3 Mi Used Inodes: 42.2% Options: api : MPIIO apiVersion : (3.1) test filename : /optane/datafiles/io500.2019.05.14-08.51.37/ior_hard/IOR_file access : single-shared-file type : independent segments : 520000 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 tasks : 30 clients per node : 3 repetitions : 1 xfersize : 47008 bytes blocksize : 47008 bytes aggregate filesize : 682.96 GiB stonewallingTime : 300 stoneWallingWearOut : 1 Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) hints passed to MPI_File_open() { romio_cb_read = disable romio_cb_write = disable romio_ds_read = disable romio_ds_write = disable striping_unit = 262144 cb_nodes = 10 cb_buffer_size = 262144 direct_read = enable direct_write = enable direct_io = enable gpfsHintAccess = enable gpfsReleaseToken = enable romio_no_indep_rw = false cb_config_list = *:8 } WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) hints returned from opened file { romio_cb_read = disable romio_cb_write = disable romio_ds_read = disable romio_ds_write = disable striping_unit = 262144 cb_nodes = 10 cb_buffer_size = 262144 direct_read = enable direct_write = enable direct_io = enable gpfsHintAccess = enable gpfsReleaseToken = enable romio_no_indep_rw = false cb_config_list = *:8 } stonewalling pairs accessed min: 445063 max: 520000 -- min data: 19.5 GiB mean data: 20.4 GiB time: 300.0s write 2001.85 45.91 45.91 0.302683 349.05 0.003897 349.35 0 Max Write: 2001.85 MiB/sec (2099.09 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum write 2001.85 2001.85 2001.85 0.00 44653.82 44653.82 44653.82 0.00 349.35422 0 30 3 1 0 1 1 0 0 520000 47008 47008 699353.0 MPIIO 0 Finished : Tue May 14 09:07:49 2019