IOR-3.3alpha1: MPI Coordinated Test of Parallel I/O Began : Sun Jun 9 15:48:28 2019 Command line : /mnt/rpool/io-500-dev/bin/ior -r -R -s 100000 -a MPIIO -c -p -H -U /mnt/rpool/io-500-dev/romio-hints -i 1 -C -Q 1 -g -G 27 -k -e -t 47008 -b 47008 -o /mnt/rpool/io-500-dev/datafiles/io500.2019.06.09-15.16.42/ior_hard/IOR_file -O stoneWallingStatusFile=/mnt/rpool/io-500-dev/datafiles/io500.2019.06.09-15.16.42/ior_hard/stonewall Machine : Linux jp1.eag.rdlabs.hpecorp.net TestID : 0 StartTime : Sun Jun 9 15:48:28 2019 Path : /mnt/rpool/io-500-dev/datafiles/io500.2019.06.09-15.16.42/ior_hard FS : 130.6 TiB Used FS: 26.6% Inodes: 5350.0 Mi Used Inodes: 0.3% Options: api : MPIIO apiVersion : (3.1) test filename : /mnt/rpool/io-500-dev/datafiles/io500.2019.06.09-15.16.42/ior_hard/IOR_file access : single-shared-file type : collective segments : 100000 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 tasks : 200 clients per node : 20 repetitions : 1 xfersize : 47008 bytes blocksize : 47008 bytes aggregate filesize : 875.59 GiB Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- hints passed to MPI_File_open() { direct_read = true direct_write = true romio_cb_read = disable romio_cb_write = enable cb_buffer_size = 1073741824 cb_nodes = 1 cb_config_list = *:* romio_ds_write = enable ind_wr_buffer_size = 1073741824 } hints returned from opened file { direct_read = true direct_write = true cb_buffer_size = 1073741824 romio_cb_read = disable romio_cb_write = enable cb_nodes = 1 romio_no_indep_rw = false romio_cb_pfr = disable romio_cb_fr_types = aar romio_cb_fr_alignment = 1 romio_cb_ds_threshold = 0 romio_cb_alltoall = automatic ind_rd_buffer_size = 4194304 ind_wr_buffer_size = 1073741824 romio_ds_read = automatic romio_ds_write = enable cb_config_list = *:* romio_filesystem_type = XFS: SGI XFS romio_aggregator_list = 0 } WARNING: Expected aggregate file size = 940160000000. WARNING: Stat() of aggregate file size = 940160000000. WARNING: Using actual aggregate bytes moved = 443182022400. read 16874 45.91 45.91 0.032566 25.01 0.000839 25.05 0 Max Read: 16874.47 MiB/sec (17694.16 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum read 16874.47 16874.47 16874.47 0.00 376407.45 376407.45 376407.45 0.00 25.04679 0 200 20 1 0 1 1 0 0 100000 47008 47008 422651.3 MPIIO 0 Finished : Sun Jun 9 15:48:53 2019