MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 [0] MPI startup(): libfabric version: 1.8.0a1-impi MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 [0] MPI startup(): libfabric provider: psm2 [0] MPI startup(): Rank Pid Node name Pin cpu [0] MPI startup(): 0 35669 cpu-e-829 0 [0] MPI startup(): 1 35670 cpu-e-829 1 [0] MPI startup(): 2 35671 cpu-e-829 2 [0] MPI startup(): 3 35672 cpu-e-829 3 [0] MPI startup(): 4 35673 cpu-e-829 4 [0] MPI startup(): 5 35674 cpu-e-829 5 [0] MPI startup(): 6 35675 cpu-e-829 6 [0] MPI startup(): 7 35676 cpu-e-829 7 [0] MPI startup(): 8 35677 cpu-e-829 8 [0] MPI startup(): 9 35678 cpu-e-829 9 [0] MPI startup(): 10 35679 cpu-e-829 10 [0] MPI startup(): 11 35680 cpu-e-829 11 [0] MPI startup(): 12 35681 cpu-e-829 12 [0] MPI startup(): 13 35682 cpu-e-829 13 [0] MPI startup(): 14 35683 cpu-e-829 14 [0] MPI startup(): 15 35684 cpu-e-829 15 [0] MPI startup(): 16 35685 cpu-e-829 16 [0] MPI startup(): 17 35686 cpu-e-829 17 [0] MPI startup(): 18 35687 cpu-e-829 18 [0] MPI startup(): 19 35688 cpu-e-829 19 [0] MPI startup(): 20 35689 cpu-e-829 20 [0] MPI startup(): 21 35690 cpu-e-829 21 [0] MPI startup(): 22 35691 cpu-e-829 22 [0] MPI startup(): 23 35692 cpu-e-829 23 [0] MPI startup(): 24 35693 cpu-e-829 24 [0] MPI startup(): 25 35694 cpu-e-829 25 [0] MPI startup(): 26 35695 cpu-e-829 26 [0] MPI startup(): 27 35696 cpu-e-829 27 [0] MPI startup(): 28 35697 cpu-e-829 28 [0] MPI startup(): 29 35698 cpu-e-829 29 [0] MPI startup(): 30 35699 cpu-e-829 30 [0] MPI startup(): 31 35700 cpu-e-829 31 [0] MPI startup(): 32 34969 cpu-e-830 0 [0] MPI startup(): 33 34970 cpu-e-830 1 [0] MPI startup(): 34 34971 cpu-e-830 2 [0] MPI startup(): 35 34972 cpu-e-830 3 [0] MPI startup(): 36 34973 cpu-e-830 4 [0] MPI startup(): 37 34974 cpu-e-830 5 [0] MPI startup(): 38 34975 cpu-e-830 6 [0] MPI startup(): 39 34976 cpu-e-830 7 [0] MPI startup(): 40 34977 cpu-e-830 8 [0] MPI startup(): 41 34978 cpu-e-830 9 [0] MPI startup(): 42 34979 cpu-e-830 10 [0] MPI startup(): 43 34980 cpu-e-830 11 [0] MPI startup(): 44 34981 cpu-e-830 12 [0] MPI startup(): 45 34982 cpu-e-830 13 [0] MPI startup(): 46 34983 cpu-e-830 14 [0] MPI startup(): 47 34984 cpu-e-830 15 [0] MPI startup(): 48 34985 cpu-e-830 16 [0] MPI startup(): 49 34986 cpu-e-830 17 [0] MPI startup(): 50 34987 cpu-e-830 18 [0] MPI startup(): 51 34988 cpu-e-830 19 [0] MPI startup(): 52 34989 cpu-e-830 20 [0] MPI startup(): 53 34990 cpu-e-830 21 [0] MPI startup(): 54 34991 cpu-e-830 22 [0] MPI startup(): 55 34992 cpu-e-830 23 [0] MPI startup(): 56 34993 cpu-e-830 24 [0] MPI startup(): 57 34994 cpu-e-830 25 [0] MPI startup(): 58 34995 cpu-e-830 26 [0] MPI startup(): 59 34996 cpu-e-830 27 [0] MPI startup(): 60 34997 cpu-e-830 28 [0] MPI startup(): 61 34998 cpu-e-830 29 [0] MPI startup(): 62 34999 cpu-e-830 30 [0] MPI startup(): 63 35000 cpu-e-830 31 [0] MPI startup(): 64 34721 cpu-e-893 0 [0] MPI startup(): 65 34722 cpu-e-893 1 [0] MPI startup(): 66 34723 cpu-e-893 2 [0] MPI startup(): 67 34724 cpu-e-893 3 [0] MPI startup(): 68 34725 cpu-e-893 4 [0] MPI startup(): 69 34726 cpu-e-893 5 [0] MPI startup(): 70 34727 cpu-e-893 6 [0] MPI startup(): 71 34728 cpu-e-893 7 [0] MPI startup(): 72 34729 cpu-e-893 8 [0] MPI startup(): 73 34730 cpu-e-893 9 [0] MPI startup(): 74 34731 cpu-e-893 10 [0] MPI startup(): 75 34732 cpu-e-893 11 [0] MPI startup(): 76 34733 cpu-e-893 12 [0] MPI startup(): 77 34734 cpu-e-893 13 [0] MPI startup(): 78 34735 cpu-e-893 14 [0] MPI startup(): 79 34736 cpu-e-893 15 [0] MPI startup(): 80 34737 cpu-e-893 16 [0] MPI startup(): 81 34738 cpu-e-893 17 [0] MPI startup(): 82 34739 cpu-e-893 18 [0] MPI startup(): 83 34740 cpu-e-893 19 [0] MPI startup(): 84 34741 cpu-e-893 20 [0] MPI startup(): 85 34742 cpu-e-893 21 [0] MPI startup(): 86 34743 cpu-e-893 22 [0] MPI startup(): 87 34744 cpu-e-893 23 [0] MPI startup(): 88 34745 cpu-e-893 24 [0] MPI startup(): 89 34746 cpu-e-893 25 [0] MPI startup(): 90 34747 cpu-e-893 26 [0] MPI startup(): 91 34748 cpu-e-893 27 [0] MPI startup(): 92 34749 cpu-e-893 28 [0] MPI startup(): 93 34750 cpu-e-893 29 [0] MPI startup(): 94 34751 cpu-e-893 30 [0] MPI startup(): 95 34752 cpu-e-893 31 [0] MPI startup(): 96 34704 cpu-e-894 0 [0] MPI startup(): 97 34705 cpu-e-894 1 [0] MPI startup(): 98 34706 cpu-e-894 2 [0] MPI startup(): 99 34707 cpu-e-894 3 [0] MPI startup(): 100 34708 cpu-e-894 4 [0] MPI startup(): 101 34709 cpu-e-894 5 [0] MPI startup(): 102 34710 cpu-e-894 6 [0] MPI startup(): 103 34711 cpu-e-894 7 [0] MPI startup(): 104 34712 cpu-e-894 8 [0] MPI startup(): 105 34713 cpu-e-894 9 [0] MPI startup(): 106 34714 cpu-e-894 10 [0] MPI startup(): 107 34715 cpu-e-894 11 [0] MPI startup(): 108 34716 cpu-e-894 12 [0] MPI startup(): 109 34717 cpu-e-894 13 [0] MPI startup(): 110 34718 cpu-e-894 14 [0] MPI startup(): 111 34719 cpu-e-894 15 [0] MPI startup(): 112 34720 cpu-e-894 16 [0] MPI startup(): 113 34721 cpu-e-894 17 [0] MPI startup(): 114 34722 cpu-e-894 18 [0] MPI startup(): 115 34723 cpu-e-894 19 [0] MPI startup(): 116 34724 cpu-e-894 20 [0] MPI startup(): 117 34725 cpu-e-894 21 [0] MPI startup(): 118 34726 cpu-e-894 22 [0] MPI startup(): 119 34727 cpu-e-894 23 [0] MPI startup(): 120 34728 cpu-e-894 24 [0] MPI startup(): 121 34729 cpu-e-894 25 [0] MPI startup(): 122 34730 cpu-e-894 26 [0] MPI startup(): 123 34731 cpu-e-894 27 [0] MPI startup(): 124 34732 cpu-e-894 28 [0] MPI startup(): 125 34733 cpu-e-894 29 [0] MPI startup(): 126 34734 cpu-e-894 30 [0] MPI startup(): 127 34735 cpu-e-894 31 [0] MPI startup(): 128 34848 cpu-e-957 0 [0] MPI startup(): 129 34849 cpu-e-957 1 [0] MPI startup(): 130 34850 cpu-e-957 2 [0] MPI startup(): 131 34851 cpu-e-957 3 [0] MPI startup(): 132 34852 cpu-e-957 4 [0] MPI startup(): 133 34853 cpu-e-957 5 [0] MPI startup(): 134 34854 cpu-e-957 6 [0] MPI startup(): 135 34855 cpu-e-957 7 [0] MPI startup(): 136 34856 cpu-e-957 8 [0] MPI startup(): 137 34857 cpu-e-957 9 [0] MPI startup(): 138 34858 cpu-e-957 10 [0] MPI startup(): 139 34859 cpu-e-957 11 [0] MPI startup(): 140 34860 cpu-e-957 12 [0] MPI startup(): 141 34861 cpu-e-957 13 [0] MPI startup(): 142 34862 cpu-e-957 14 [0] MPI startup(): 143 34863 cpu-e-957 15 [0] MPI startup(): 144 34864 cpu-e-957 16 [0] MPI startup(): 145 34865 cpu-e-957 17 [0] MPI startup(): 146 34866 cpu-e-957 18 [0] MPI startup(): 147 34867 cpu-e-957 19 [0] MPI startup(): 148 34868 cpu-e-957 20 [0] MPI startup(): 149 34869 cpu-e-957 21 [0] MPI startup(): 150 34870 cpu-e-957 22 [0] MPI startup(): 151 34871 cpu-e-957 23 [0] MPI startup(): 152 34872 cpu-e-957 24 [0] MPI startup(): 153 34873 cpu-e-957 25 [0] MPI startup(): 154 34874 cpu-e-957 26 [0] MPI startup(): 155 34875 cpu-e-957 27 [0] MPI startup(): 156 34876 cpu-e-957 28 [0] MPI startup(): 157 34877 cpu-e-957 29 [0] MPI startup(): 158 34878 cpu-e-957 30 [0] MPI startup(): 159 34879 cpu-e-957 31 [0] MPI startup(): 160 34794 cpu-e-958 0 [0] MPI startup(): 161 34795 cpu-e-958 1 [0] MPI startup(): 162 34796 cpu-e-958 2 [0] MPI startup(): 163 34797 cpu-e-958 3 [0] MPI startup(): 164 34798 cpu-e-958 4 [0] MPI startup(): 165 34799 cpu-e-958 5 [0] MPI startup(): 166 34800 cpu-e-958 6 [0] MPI startup(): 167 34801 cpu-e-958 7 [0] MPI startup(): 168 34802 cpu-e-958 8 [0] MPI startup(): 169 34803 cpu-e-958 9 [0] MPI startup(): 170 34804 cpu-e-958 10 [0] MPI startup(): 171 34805 cpu-e-958 11 [0] MPI startup(): 172 34806 cpu-e-958 12 [0] MPI startup(): 173 34807 cpu-e-958 13 [0] MPI startup(): 174 34808 cpu-e-958 14 [0] MPI startup(): 175 34809 cpu-e-958 15 [0] MPI startup(): 176 34810 cpu-e-958 16 [0] MPI startup(): 177 34811 cpu-e-958 17 [0] MPI startup(): 178 34812 cpu-e-958 18 [0] MPI startup(): 179 34813 cpu-e-958 19 [0] MPI startup(): 180 34814 cpu-e-958 20 [0] MPI startup(): 181 34815 cpu-e-958 21 [0] MPI startup(): 182 34816 cpu-e-958 22 [0] MPI startup(): 183 34817 cpu-e-958 23 [0] MPI startup(): 184 34818 cpu-e-958 24 [0] MPI startup(): 185 34819 cpu-e-958 25 [0] MPI startup(): 186 34820 cpu-e-958 26 [0] MPI startup(): 187 34821 cpu-e-958 27 [0] MPI startup(): 188 34822 cpu-e-958 28 [0] MPI startup(): 189 34823 cpu-e-958 29 [0] MPI startup(): 190 34824 cpu-e-958 30 [0] MPI startup(): 191 34825 cpu-e-958 31 [0] MPI startup(): 192 35047 cpu-e-1021 0 [0] MPI startup(): 193 35048 cpu-e-1021 1 [0] MPI startup(): 194 35049 cpu-e-1021 2 [0] MPI startup(): 195 35050 cpu-e-1021 3 [0] MPI startup(): 196 35051 cpu-e-1021 4 [0] MPI startup(): 197 35052 cpu-e-1021 5 [0] MPI startup(): 198 35053 cpu-e-1021 6 [0] MPI startup(): 199 35054 cpu-e-1021 7 [0] MPI startup(): 200 35055 cpu-e-1021 8 [0] MPI startup(): 201 35056 cpu-e-1021 9 [0] MPI startup(): 202 35057 cpu-e-1021 10 [0] MPI startup(): 203 35058 cpu-e-1021 11 [0] MPI startup(): 204 35059 cpu-e-1021 12 [0] MPI startup(): 205 35060 cpu-e-1021 13 [0] MPI startup(): 206 35061 cpu-e-1021 14 [0] MPI startup(): 207 35062 cpu-e-1021 15 [0] MPI startup(): 208 35063 cpu-e-1021 16 [0] MPI startup(): 209 35064 cpu-e-1021 17 [0] MPI startup(): 210 35065 cpu-e-1021 18 [0] MPI startup(): 211 35066 cpu-e-1021 19 [0] MPI startup(): 212 35067 cpu-e-1021 20 [0] MPI startup(): 213 35068 cpu-e-1021 21 [0] MPI startup(): 214 35069 cpu-e-1021 22 [0] MPI startup(): 215 35070 cpu-e-1021 23 [0] MPI startup(): 216 35071 cpu-e-1021 24 [0] MPI startup(): 217 35072 cpu-e-1021 25 [0] MPI startup(): 218 35073 cpu-e-1021 26 [0] MPI startup(): 219 35074 cpu-e-1021 27 [0] MPI startup(): 220 35075 cpu-e-1021 28 [0] MPI startup(): 221 35076 cpu-e-1021 29 [0] MPI startup(): 222 35077 cpu-e-1021 30 [0] MPI startup(): 223 35078 cpu-e-1021 31 [0] MPI startup(): 224 34808 cpu-e-1022 0 [0] MPI startup(): 225 34809 cpu-e-1022 1 [0] MPI startup(): 226 34810 cpu-e-1022 2 [0] MPI startup(): 227 34811 cpu-e-1022 3 [0] MPI startup(): 228 34812 cpu-e-1022 4 [0] MPI startup(): 229 34813 cpu-e-1022 5 [0] MPI startup(): 230 34814 cpu-e-1022 6 [0] MPI startup(): 231 34815 cpu-e-1022 7 [0] MPI startup(): 232 34816 cpu-e-1022 8 [0] MPI startup(): 233 34817 cpu-e-1022 9 [0] MPI startup(): 234 34818 cpu-e-1022 10 [0] MPI startup(): 235 34819 cpu-e-1022 11 [0] MPI startup(): 236 34820 cpu-e-1022 12 [0] MPI startup(): 237 34821 cpu-e-1022 13 [0] MPI startup(): 238 34822 cpu-e-1022 14 [0] MPI startup(): 239 34823 cpu-e-1022 15 [0] MPI startup(): 240 34824 cpu-e-1022 16 [0] MPI startup(): 241 34825 cpu-e-1022 17 [0] MPI startup(): 242 34826 cpu-e-1022 18 [0] MPI startup(): 243 34827 cpu-e-1022 19 [0] MPI startup(): 244 34828 cpu-e-1022 20 [0] MPI startup(): 245 34829 cpu-e-1022 21 [0] MPI startup(): 246 34830 cpu-e-1022 22 [0] MPI startup(): 247 34831 cpu-e-1022 23 [0] MPI startup(): 248 34832 cpu-e-1022 24 [0] MPI startup(): 249 34833 cpu-e-1022 25 [0] MPI startup(): 250 34834 cpu-e-1022 26 [0] MPI startup(): 251 34835 cpu-e-1022 27 [0] MPI startup(): 252 34836 cpu-e-1022 28 [0] MPI startup(): 253 34837 cpu-e-1022 29 [0] MPI startup(): 254 34838 cpu-e-1022 30 [0] MPI startup(): 255 34839 cpu-e-1022 31 [0] MPI startup(): 256 34834 cpu-e-1149 0 [0] MPI startup(): 257 34835 cpu-e-1149 1 [0] MPI startup(): 258 34836 cpu-e-1149 2 [0] MPI startup(): 259 34837 cpu-e-1149 3 [0] MPI startup(): 260 34838 cpu-e-1149 4 [0] MPI startup(): 261 34839 cpu-e-1149 5 [0] MPI startup(): 262 34840 cpu-e-1149 6 [0] MPI startup(): 263 34841 cpu-e-1149 7 [0] MPI startup(): 264 34842 cpu-e-1149 8 [0] MPI startup(): 265 34843 cpu-e-1149 9 [0] MPI startup(): 266 34844 cpu-e-1149 10 [0] MPI startup(): 267 34845 cpu-e-1149 11 [0] MPI startup(): 268 34846 cpu-e-1149 12 [0] MPI startup(): 269 34847 cpu-e-1149 13 [0] MPI startup(): 270 34848 cpu-e-1149 14 [0] MPI startup(): 271 34849 cpu-e-1149 15 [0] MPI startup(): 272 34850 cpu-e-1149 16 [0] MPI startup(): 273 34851 cpu-e-1149 17 [0] MPI startup(): 274 34852 cpu-e-1149 18 [0] MPI startup(): 275 34853 cpu-e-1149 19 [0] MPI startup(): 276 34854 cpu-e-1149 20 [0] MPI startup(): 277 34855 cpu-e-1149 21 [0] MPI startup(): 278 34856 cpu-e-1149 22 [0] MPI startup(): 279 34857 cpu-e-1149 23 [0] MPI startup(): 280 34858 cpu-e-1149 24 [0] MPI startup(): 281 34859 cpu-e-1149 25 [0] MPI startup(): 282 34860 cpu-e-1149 26 [0] MPI startup(): 283 34861 cpu-e-1149 27 [0] MPI startup(): 284 34862 cpu-e-1149 28 [0] MPI startup(): 285 34863 cpu-e-1149 29 [0] MPI startup(): 286 34864 cpu-e-1149 30 [0] MPI startup(): 287 34865 cpu-e-1149 31 [0] MPI startup(): 288 34858 cpu-e-1150 0 [0] MPI startup(): 289 34859 cpu-e-1150 1 [0] MPI startup(): 290 34860 cpu-e-1150 2 [0] MPI startup(): 291 34861 cpu-e-1150 3 [0] MPI startup(): 292 34862 cpu-e-1150 4 [0] MPI startup(): 293 34863 cpu-e-1150 5 [0] MPI startup(): 294 34864 cpu-e-1150 6 [0] MPI startup(): 295 34865 cpu-e-1150 7 [0] MPI startup(): 296 34866 cpu-e-1150 8 [0] MPI startup(): 297 34867 cpu-e-1150 9 [0] MPI startup(): 298 34868 cpu-e-1150 10 [0] MPI startup(): 299 34869 cpu-e-1150 11 [0] MPI startup(): 300 34870 cpu-e-1150 12 [0] MPI startup(): 301 34871 cpu-e-1150 13 [0] MPI startup(): 302 34872 cpu-e-1150 14 [0] MPI startup(): 303 34873 cpu-e-1150 15 [0] MPI startup(): 304 34874 cpu-e-1150 16 [0] MPI startup(): 305 34875 cpu-e-1150 17 [0] MPI startup(): 306 34876 cpu-e-1150 18 [0] MPI startup(): 307 34877 cpu-e-1150 19 [0] MPI startup(): 308 34878 cpu-e-1150 20 [0] MPI startup(): 309 34879 cpu-e-1150 21 [0] MPI startup(): 310 34880 cpu-e-1150 22 [0] MPI startup(): 311 34881 cpu-e-1150 23 [0] MPI startup(): 312 34882 cpu-e-1150 24 [0] MPI startup(): 313 34883 cpu-e-1150 25 [0] MPI startup(): 314 34884 cpu-e-1150 26 [0] MPI startup(): 315 34885 cpu-e-1150 27 [0] MPI startup(): 316 34886 cpu-e-1150 28 [0] MPI startup(): 317 34887 cpu-e-1150 29 [0] MPI startup(): 318 34888 cpu-e-1150 30 [0] MPI startup(): 319 34889 cpu-e-1150 31 [0] MPI startup(): I_MPI_CC=icc [0] MPI startup(): I_MPI_CXX=icpc [0] MPI startup(): I_MPI_FC=ifort [0] MPI startup(): I_MPI_F90=ifort [0] MPI startup(): I_MPI_F77=ifort [0] MPI startup(): I_MPI_ROOT=/usr/local/Cluster-Apps/intel/2019.3//compilers_and_libraries_2019.3.192/linux/mpi [0] MPI startup(): I_MPI_HYDRA_RMK=slurm [0] MPI startup(): I_MPI_JOB_RESPECT_PROCESS_PLACEMENT=off [0] MPI startup(): I_MPI_PIN_DOMAIN=omp:compact [0] MPI startup(): I_MPI_PIN_ORDER=scatter [0] MPI startup(): I_MPI_FABRICS=shm:ofi [0] MPI startup(): I_MPI_DEBUG=10 [0] MPI startup(): I_MPI_TMI_PROVIDER variable has been removed from the product, its value is ignored [0] MPI startup(): I_MPI_TMI_PROVIDER environment variable is not supported. [0] MPI startup(): Similar variables: I_MPI_OFI_PROVIDER [0] MPI startup(): To check the list of supported variables, use the impi_info utility or refer to https://software.intel.com/en-us/mpi-library/documentation/get-started. IOR-3.3.0+dev: MPI Coordinated Test of Parallel I/O Began : Fri Nov 8 00:25:21 2019 Command line : /home/wjt27/io-500-sc19/bin/ior -r -R -a=POSIX --posix.odirect -t 16m -b 9920000m -F -i 1 -C -Q 1 -g -G 27 -k -e -o /dac/fs1/mjr208/job16760824-2019-11-07-2352/ior_easy/ior_file_easy -O stoneWallingStatusFile=/dac/fs1/mjr208/job16760824-2019-11-07-2352/ior_easy/stonewall Machine : Linux cpu-e-829 TestID : 0 StartTime : Fri Nov 8 00:25:21 2019 Path : /dac/fs1/mjr208/job16760824-2019-11-07-2352/ior_easy FS : 405.5 TiB Used FS: 26.5% Inodes: 1820.8 Mi Used Inodes: 10.5% Options: api : POSIX apiVersion : test filename : /dac/fs1/mjr208/job16760824-2019-11-07-2352/ior_easy/ior_file_easy access : file-per-process type : independent segments : 1 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 nodes : 10 tasks : 320 clients per node : 32 repetitions : 1 xfersize : 16 MiB blocksize : 9.46 TiB aggregate filesize : 3027.34 TiB Results: access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ---- WARNING: Expected aggregate file size = 3328599654400000. WARNING: Stat() of aggregate file size = 53252225761280. WARNING: Using actual aggregate bytes moved = 53252225761280. read 108887 6806 0.000752 10158080000 16384 0.021328 466.38 0.005932 466.41 0 Max Read: 108886.50 MiB/sec (114175.77 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum read 108886.50 108886.50 108886.50 0.00 6805.41 6805.41 6805.41 0.00 466.40565 NA NA 0 320 32 1 1 1 1 0 0 1 10401873920000 16777216 50785280.0 POSIX 0 Finished : Fri Nov 8 00:33:08 2019