IOR-3.2.0: MPI Coordinated Test of Parallel I/O Began : Tue May 14 09:22:00 2019 Command line : /work/oehmes/io-500-dev/bin/ior -r -R -s 520000 -a MPIIO -H -U hintsfile -i 1 -C -Q 1 -g -G 27 -k -e -t 47008 -b 47008 -o /optane/datafiles/io500.2019.05.14-08.51.37/ior_hard/IOR_file -O stoneWallingStatusFile=/optane/datafiles/io500.2019.05.14-08.51.37/ior_hard/stonewall Machine : Linux c200 TestID : 0 StartTime : Tue May 14 09:22:00 2019 Path : /optane/datafiles/io500.2019.05.14-08.51.37/ior_hard FS : 12.0 TiB Used FS: 97.7% Inodes: 76.3 Mi Used Inodes: 63.4% Options: api : MPIIO apiVersion : (3.1) test filename : /optane/datafiles/io500.2019.05.14-08.51.37/ior_hard/IOR_file access : single-shared-file type : independent segments : 520000 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 tasks : 30 clients per node : 3 repetitions : 1 xfersize : 47008 bytes blocksize : 47008 bytes aggregate filesize : 682.96 GiB Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) WARNING: Unable to set GPFS hints (not implemented.) hints passed to MPI_File_open() { romio_cb_read = disable romio_cb_write = disable romio_ds_read = disable romio_ds_write = disable striping_unit = 262144 cb_nodes = 10 cb_buffer_size = 262144 direct_read = enable direct_write = enable direct_io = enable gpfsHintAccess = enable gpfsReleaseToken = enable romio_no_indep_rw = false cb_config_list = *:8 } hints returned from opened file { romio_cb_read = disable romio_cb_write = disable romio_ds_read = disable romio_ds_write = disable striping_unit = 262144 cb_nodes = 10 cb_buffer_size = 262144 direct_read = enable direct_write = enable direct_io = enable gpfsHintAccess = enable gpfsReleaseToken = enable romio_no_indep_rw = false cb_config_list = *:8 } read 10415 45.91 45.91 0.019988 67.12 0.004466 67.15 0 Max Read: 10415.27 MiB/sec (10921.21 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum read 10415.27 10415.27 10415.27 0.00 232326.54 232326.54 232326.54 0.00 67.14687 0 30 3 1 0 1 1 0 0 520000 47008 47008 699353.0 MPIIO 0 Finished : Tue May 14 09:23:07 2019