MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 [0] MPI startup(): libfabric version: 1.8.0a1-impi MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 [0] MPI startup(): libfabric provider: psm2 [0] MPI startup(): Rank Pid Node name Pin cpu [0] MPI startup(): 0 38829 cpu-e-829 0 [0] MPI startup(): 1 38830 cpu-e-829 1 [0] MPI startup(): 2 38831 cpu-e-829 2 [0] MPI startup(): 3 38832 cpu-e-829 3 [0] MPI startup(): 4 38833 cpu-e-829 4 [0] MPI startup(): 5 38834 cpu-e-829 5 [0] MPI startup(): 6 38835 cpu-e-829 6 [0] MPI startup(): 7 38836 cpu-e-829 7 [0] MPI startup(): 8 38837 cpu-e-829 8 [0] MPI startup(): 9 38838 cpu-e-829 9 [0] MPI startup(): 10 38839 cpu-e-829 10 [0] MPI startup(): 11 38840 cpu-e-829 11 [0] MPI startup(): 12 38841 cpu-e-829 12 [0] MPI startup(): 13 38842 cpu-e-829 13 [0] MPI startup(): 14 38843 cpu-e-829 14 [0] MPI startup(): 15 38844 cpu-e-829 15 [0] MPI startup(): 16 38845 cpu-e-829 16 [0] MPI startup(): 17 38846 cpu-e-829 17 [0] MPI startup(): 18 38847 cpu-e-829 18 [0] MPI startup(): 19 38848 cpu-e-829 19 [0] MPI startup(): 20 38849 cpu-e-829 20 [0] MPI startup(): 21 38850 cpu-e-829 21 [0] MPI startup(): 22 38851 cpu-e-829 22 [0] MPI startup(): 23 38852 cpu-e-829 23 [0] MPI startup(): 24 38853 cpu-e-829 24 [0] MPI startup(): 25 38854 cpu-e-829 25 [0] MPI startup(): 26 38855 cpu-e-829 26 [0] MPI startup(): 27 38856 cpu-e-829 27 [0] MPI startup(): 28 38857 cpu-e-829 28 [0] MPI startup(): 29 38858 cpu-e-829 29 [0] MPI startup(): 30 38859 cpu-e-829 30 [0] MPI startup(): 31 38860 cpu-e-829 31 [0] MPI startup(): 32 38714 cpu-e-830 0 [0] MPI startup(): 33 38715 cpu-e-830 1 [0] MPI startup(): 34 38716 cpu-e-830 2 [0] MPI startup(): 35 38717 cpu-e-830 3 [0] MPI startup(): 36 38718 cpu-e-830 4 [0] MPI startup(): 37 38719 cpu-e-830 5 [0] MPI startup(): 38 38720 cpu-e-830 6 [0] MPI startup(): 39 38721 cpu-e-830 7 [0] MPI startup(): 40 38722 cpu-e-830 8 [0] MPI startup(): 41 38723 cpu-e-830 9 [0] MPI startup(): 42 38724 cpu-e-830 10 [0] MPI startup(): 43 38725 cpu-e-830 11 [0] MPI startup(): 44 38726 cpu-e-830 12 [0] MPI startup(): 45 38727 cpu-e-830 13 [0] MPI startup(): 46 38728 cpu-e-830 14 [0] MPI startup(): 47 38729 cpu-e-830 15 [0] MPI startup(): 48 38730 cpu-e-830 16 [0] MPI startup(): 49 38731 cpu-e-830 17 [0] MPI startup(): 50 38732 cpu-e-830 18 [0] MPI startup(): 51 38733 cpu-e-830 19 [0] MPI startup(): 52 38734 cpu-e-830 20 [0] MPI startup(): 53 38735 cpu-e-830 21 [0] MPI startup(): 54 38736 cpu-e-830 22 [0] MPI startup(): 55 38737 cpu-e-830 23 [0] MPI startup(): 56 38738 cpu-e-830 24 [0] MPI startup(): 57 38739 cpu-e-830 25 [0] MPI startup(): 58 38740 cpu-e-830 26 [0] MPI startup(): 59 38741 cpu-e-830 27 [0] MPI startup(): 60 38742 cpu-e-830 28 [0] MPI startup(): 61 38743 cpu-e-830 29 [0] MPI startup(): 62 38744 cpu-e-830 30 [0] MPI startup(): 63 38745 cpu-e-830 31 [0] MPI startup(): 64 38569 cpu-e-893 0 [0] MPI startup(): 65 38570 cpu-e-893 1 [0] MPI startup(): 66 38571 cpu-e-893 2 [0] MPI startup(): 67 38572 cpu-e-893 3 [0] MPI startup(): 68 38573 cpu-e-893 4 [0] MPI startup(): 69 38574 cpu-e-893 5 [0] MPI startup(): 70 38575 cpu-e-893 6 [0] MPI startup(): 71 38576 cpu-e-893 7 [0] MPI startup(): 72 38577 cpu-e-893 8 [0] MPI startup(): 73 38578 cpu-e-893 9 [0] MPI startup(): 74 38579 cpu-e-893 10 [0] MPI startup(): 75 38580 cpu-e-893 11 [0] MPI startup(): 76 38581 cpu-e-893 12 [0] MPI startup(): 77 38582 cpu-e-893 13 [0] MPI startup(): 78 38583 cpu-e-893 14 [0] MPI startup(): 79 38584 cpu-e-893 15 [0] MPI startup(): 80 38585 cpu-e-893 16 [0] MPI startup(): 81 38586 cpu-e-893 17 [0] MPI startup(): 82 38587 cpu-e-893 18 [0] MPI startup(): 83 38588 cpu-e-893 19 [0] MPI startup(): 84 38589 cpu-e-893 20 [0] MPI startup(): 85 38590 cpu-e-893 21 [0] MPI startup(): 86 38591 cpu-e-893 22 [0] MPI startup(): 87 38592 cpu-e-893 23 [0] MPI startup(): 88 38593 cpu-e-893 24 [0] MPI startup(): 89 38594 cpu-e-893 25 [0] MPI startup(): 90 38595 cpu-e-893 26 [0] MPI startup(): 91 38596 cpu-e-893 27 [0] MPI startup(): 92 38597 cpu-e-893 28 [0] MPI startup(): 93 38598 cpu-e-893 29 [0] MPI startup(): 94 38599 cpu-e-893 30 [0] MPI startup(): 95 38600 cpu-e-893 31 [0] MPI startup(): 96 38558 cpu-e-894 0 [0] MPI startup(): 97 38559 cpu-e-894 1 [0] MPI startup(): 98 38560 cpu-e-894 2 [0] MPI startup(): 99 38561 cpu-e-894 3 [0] MPI startup(): 100 38562 cpu-e-894 4 [0] MPI startup(): 101 38563 cpu-e-894 5 [0] MPI startup(): 102 38564 cpu-e-894 6 [0] MPI startup(): 103 38565 cpu-e-894 7 [0] MPI startup(): 104 38566 cpu-e-894 8 [0] MPI startup(): 105 38567 cpu-e-894 9 [0] MPI startup(): 106 38568 cpu-e-894 10 [0] MPI startup(): 107 38569 cpu-e-894 11 [0] MPI startup(): 108 38570 cpu-e-894 12 [0] MPI startup(): 109 38571 cpu-e-894 13 [0] MPI startup(): 110 38572 cpu-e-894 14 [0] MPI startup(): 111 38573 cpu-e-894 15 [0] MPI startup(): 112 38574 cpu-e-894 16 [0] MPI startup(): 113 38575 cpu-e-894 17 [0] MPI startup(): 114 38576 cpu-e-894 18 [0] MPI startup(): 115 38577 cpu-e-894 19 [0] MPI startup(): 116 38578 cpu-e-894 20 [0] MPI startup(): 117 38579 cpu-e-894 21 [0] MPI startup(): 118 38580 cpu-e-894 22 [0] MPI startup(): 119 38581 cpu-e-894 23 [0] MPI startup(): 120 38582 cpu-e-894 24 [0] MPI startup(): 121 38583 cpu-e-894 25 [0] MPI startup(): 122 38584 cpu-e-894 26 [0] MPI startup(): 123 38585 cpu-e-894 27 [0] MPI startup(): 124 38586 cpu-e-894 28 [0] MPI startup(): 125 38587 cpu-e-894 29 [0] MPI startup(): 126 38588 cpu-e-894 30 [0] MPI startup(): 127 38589 cpu-e-894 31 [0] MPI startup(): 128 38609 cpu-e-957 0 [0] MPI startup(): 129 38610 cpu-e-957 1 [0] MPI startup(): 130 38611 cpu-e-957 2 [0] MPI startup(): 131 38612 cpu-e-957 3 [0] MPI startup(): 132 38613 cpu-e-957 4 [0] MPI startup(): 133 38614 cpu-e-957 5 [0] MPI startup(): 134 38615 cpu-e-957 6 [0] MPI startup(): 135 38616 cpu-e-957 7 [0] MPI startup(): 136 38617 cpu-e-957 8 [0] MPI startup(): 137 38618 cpu-e-957 9 [0] MPI startup(): 138 38619 cpu-e-957 10 [0] MPI startup(): 139 38620 cpu-e-957 11 [0] MPI startup(): 140 38621 cpu-e-957 12 [0] MPI startup(): 141 38622 cpu-e-957 13 [0] MPI startup(): 142 38623 cpu-e-957 14 [0] MPI startup(): 143 38624 cpu-e-957 15 [0] MPI startup(): 144 38625 cpu-e-957 16 [0] MPI startup(): 145 38626 cpu-e-957 17 [0] MPI startup(): 146 38627 cpu-e-957 18 [0] MPI startup(): 147 38628 cpu-e-957 19 [0] MPI startup(): 148 38629 cpu-e-957 20 [0] MPI startup(): 149 38630 cpu-e-957 21 [0] MPI startup(): 150 38631 cpu-e-957 22 [0] MPI startup(): 151 38632 cpu-e-957 23 [0] MPI startup(): 152 38633 cpu-e-957 24 [0] MPI startup(): 153 38634 cpu-e-957 25 [0] MPI startup(): 154 38635 cpu-e-957 26 [0] MPI startup(): 155 38636 cpu-e-957 27 [0] MPI startup(): 156 38637 cpu-e-957 28 [0] MPI startup(): 157 38638 cpu-e-957 29 [0] MPI startup(): 158 38639 cpu-e-957 30 [0] MPI startup(): 159 38640 cpu-e-957 31 [0] MPI startup(): 160 38673 cpu-e-958 0 [0] MPI startup(): 161 38674 cpu-e-958 1 [0] MPI startup(): 162 38675 cpu-e-958 2 [0] MPI startup(): 163 38676 cpu-e-958 3 [0] MPI startup(): 164 38677 cpu-e-958 4 [0] MPI startup(): 165 38678 cpu-e-958 5 [0] MPI startup(): 166 38679 cpu-e-958 6 [0] MPI startup(): 167 38680 cpu-e-958 7 [0] MPI startup(): 168 38681 cpu-e-958 8 [0] MPI startup(): 169 38682 cpu-e-958 9 [0] MPI startup(): 170 38683 cpu-e-958 10 [0] MPI startup(): 171 38684 cpu-e-958 11 [0] MPI startup(): 172 38685 cpu-e-958 12 [0] MPI startup(): 173 38686 cpu-e-958 13 [0] MPI startup(): 174 38687 cpu-e-958 14 [0] MPI startup(): 175 38688 cpu-e-958 15 [0] MPI startup(): 176 38689 cpu-e-958 16 [0] MPI startup(): 177 38690 cpu-e-958 17 [0] MPI startup(): 178 38691 cpu-e-958 18 [0] MPI startup(): 179 38692 cpu-e-958 19 [0] MPI startup(): 180 38693 cpu-e-958 20 [0] MPI startup(): 181 38694 cpu-e-958 21 [0] MPI startup(): 182 38695 cpu-e-958 22 [0] MPI startup(): 183 38696 cpu-e-958 23 [0] MPI startup(): 184 38697 cpu-e-958 24 [0] MPI startup(): 185 38698 cpu-e-958 25 [0] MPI startup(): 186 38699 cpu-e-958 26 [0] MPI startup(): 187 38700 cpu-e-958 27 [0] MPI startup(): 188 38701 cpu-e-958 28 [0] MPI startup(): 189 38702 cpu-e-958 29 [0] MPI startup(): 190 38703 cpu-e-958 30 [0] MPI startup(): 191 38704 cpu-e-958 31 [0] MPI startup(): 192 38659 cpu-e-1021 0 [0] MPI startup(): 193 38660 cpu-e-1021 1 [0] MPI startup(): 194 38661 cpu-e-1021 2 [0] MPI startup(): 195 38662 cpu-e-1021 3 [0] MPI startup(): 196 38663 cpu-e-1021 4 [0] MPI startup(): 197 38664 cpu-e-1021 5 [0] MPI startup(): 198 38665 cpu-e-1021 6 [0] MPI startup(): 199 38666 cpu-e-1021 7 [0] MPI startup(): 200 38667 cpu-e-1021 8 [0] MPI startup(): 201 38668 cpu-e-1021 9 [0] MPI startup(): 202 38669 cpu-e-1021 10 [0] MPI startup(): 203 38670 cpu-e-1021 11 [0] MPI startup(): 204 38671 cpu-e-1021 12 [0] MPI startup(): 205 38672 cpu-e-1021 13 [0] MPI startup(): 206 38673 cpu-e-1021 14 [0] MPI startup(): 207 38674 cpu-e-1021 15 [0] MPI startup(): 208 38675 cpu-e-1021 16 [0] MPI startup(): 209 38676 cpu-e-1021 17 [0] MPI startup(): 210 38677 cpu-e-1021 18 [0] MPI startup(): 211 38678 cpu-e-1021 19 [0] MPI startup(): 212 38679 cpu-e-1021 20 [0] MPI startup(): 213 38680 cpu-e-1021 21 [0] MPI startup(): 214 38681 cpu-e-1021 22 [0] MPI startup(): 215 38682 cpu-e-1021 23 [0] MPI startup(): 216 38683 cpu-e-1021 24 [0] MPI startup(): 217 38684 cpu-e-1021 25 [0] MPI startup(): 218 38685 cpu-e-1021 26 [0] MPI startup(): 219 38686 cpu-e-1021 27 [0] MPI startup(): 220 38687 cpu-e-1021 28 [0] MPI startup(): 221 38688 cpu-e-1021 29 [0] MPI startup(): 222 38689 cpu-e-1021 30 [0] MPI startup(): 223 38690 cpu-e-1021 31 [0] MPI startup(): 224 38623 cpu-e-1022 0 [0] MPI startup(): 225 38624 cpu-e-1022 1 [0] MPI startup(): 226 38625 cpu-e-1022 2 [0] MPI startup(): 227 38626 cpu-e-1022 3 [0] MPI startup(): 228 38627 cpu-e-1022 4 [0] MPI startup(): 229 38628 cpu-e-1022 5 [0] MPI startup(): 230 38629 cpu-e-1022 6 [0] MPI startup(): 231 38630 cpu-e-1022 7 [0] MPI startup(): 232 38631 cpu-e-1022 8 [0] MPI startup(): 233 38632 cpu-e-1022 9 [0] MPI startup(): 234 38633 cpu-e-1022 10 [0] MPI startup(): 235 38634 cpu-e-1022 11 [0] MPI startup(): 236 38635 cpu-e-1022 12 [0] MPI startup(): 237 38636 cpu-e-1022 13 [0] MPI startup(): 238 38637 cpu-e-1022 14 [0] MPI startup(): 239 38638 cpu-e-1022 15 [0] MPI startup(): 240 38639 cpu-e-1022 16 [0] MPI startup(): 241 38640 cpu-e-1022 17 [0] MPI startup(): 242 38641 cpu-e-1022 18 [0] MPI startup(): 243 38642 cpu-e-1022 19 [0] MPI startup(): 244 38643 cpu-e-1022 20 [0] MPI startup(): 245 38644 cpu-e-1022 21 [0] MPI startup(): 246 38645 cpu-e-1022 22 [0] MPI startup(): 247 38646 cpu-e-1022 23 [0] MPI startup(): 248 38647 cpu-e-1022 24 [0] MPI startup(): 249 38648 cpu-e-1022 25 [0] MPI startup(): 250 38649 cpu-e-1022 26 [0] MPI startup(): 251 38650 cpu-e-1022 27 [0] MPI startup(): 252 38651 cpu-e-1022 28 [0] MPI startup(): 253 38652 cpu-e-1022 29 [0] MPI startup(): 254 38653 cpu-e-1022 30 [0] MPI startup(): 255 38654 cpu-e-1022 31 [0] MPI startup(): 256 38501 cpu-e-1149 0 [0] MPI startup(): 257 38502 cpu-e-1149 1 [0] MPI startup(): 258 38503 cpu-e-1149 2 [0] MPI startup(): 259 38504 cpu-e-1149 3 [0] MPI startup(): 260 38505 cpu-e-1149 4 [0] MPI startup(): 261 38506 cpu-e-1149 5 [0] MPI startup(): 262 38507 cpu-e-1149 6 [0] MPI startup(): 263 38508 cpu-e-1149 7 [0] MPI startup(): 264 38509 cpu-e-1149 8 [0] MPI startup(): 265 38510 cpu-e-1149 9 [0] MPI startup(): 266 38511 cpu-e-1149 10 [0] MPI startup(): 267 38512 cpu-e-1149 11 [0] MPI startup(): 268 38513 cpu-e-1149 12 [0] MPI startup(): 269 38514 cpu-e-1149 13 [0] MPI startup(): 270 38515 cpu-e-1149 14 [0] MPI startup(): 271 38516 cpu-e-1149 15 [0] MPI startup(): 272 38517 cpu-e-1149 16 [0] MPI startup(): 273 38518 cpu-e-1149 17 [0] MPI startup(): 274 38519 cpu-e-1149 18 [0] MPI startup(): 275 38520 cpu-e-1149 19 [0] MPI startup(): 276 38521 cpu-e-1149 20 [0] MPI startup(): 277 38522 cpu-e-1149 21 [0] MPI startup(): 278 38523 cpu-e-1149 22 [0] MPI startup(): 279 38524 cpu-e-1149 23 [0] MPI startup(): 280 38525 cpu-e-1149 24 [0] MPI startup(): 281 38526 cpu-e-1149 25 [0] MPI startup(): 282 38527 cpu-e-1149 26 [0] MPI startup(): 283 38528 cpu-e-1149 27 [0] MPI startup(): 284 38529 cpu-e-1149 28 [0] MPI startup(): 285 38530 cpu-e-1149 29 [0] MPI startup(): 286 38531 cpu-e-1149 30 [0] MPI startup(): 287 38532 cpu-e-1149 31 [0] MPI startup(): 288 38590 cpu-e-1150 0 [0] MPI startup(): 289 38591 cpu-e-1150 1 [0] MPI startup(): 290 38592 cpu-e-1150 2 [0] MPI startup(): 291 38593 cpu-e-1150 3 [0] MPI startup(): 292 38594 cpu-e-1150 4 [0] MPI startup(): 293 38595 cpu-e-1150 5 [0] MPI startup(): 294 38596 cpu-e-1150 6 [0] MPI startup(): 295 38597 cpu-e-1150 7 [0] MPI startup(): 296 38598 cpu-e-1150 8 [0] MPI startup(): 297 38599 cpu-e-1150 9 [0] MPI startup(): 298 38600 cpu-e-1150 10 [0] MPI startup(): 299 38601 cpu-e-1150 11 [0] MPI startup(): 300 38602 cpu-e-1150 12 [0] MPI startup(): 301 38603 cpu-e-1150 13 [0] MPI startup(): 302 38604 cpu-e-1150 14 [0] MPI startup(): 303 38605 cpu-e-1150 15 [0] MPI startup(): 304 38606 cpu-e-1150 16 [0] MPI startup(): 305 38607 cpu-e-1150 17 [0] MPI startup(): 306 38608 cpu-e-1150 18 [0] MPI startup(): 307 38609 cpu-e-1150 19 [0] MPI startup(): 308 38610 cpu-e-1150 20 [0] MPI startup(): 309 38611 cpu-e-1150 21 [0] MPI startup(): 310 38612 cpu-e-1150 22 [0] MPI startup(): 311 38613 cpu-e-1150 23 [0] MPI startup(): 312 38614 cpu-e-1150 24 [0] MPI startup(): 313 38615 cpu-e-1150 25 [0] MPI startup(): 314 38616 cpu-e-1150 26 [0] MPI startup(): 315 38617 cpu-e-1150 27 [0] MPI startup(): 316 38618 cpu-e-1150 28 [0] MPI startup(): 317 38619 cpu-e-1150 29 [0] MPI startup(): 318 38620 cpu-e-1150 30 [0] MPI startup(): 319 38621 cpu-e-1150 31 [0] MPI startup(): I_MPI_CC=icc [0] MPI startup(): I_MPI_CXX=icpc [0] MPI startup(): I_MPI_FC=ifort [0] MPI startup(): I_MPI_F90=ifort [0] MPI startup(): I_MPI_F77=ifort [0] MPI startup(): I_MPI_ROOT=/usr/local/Cluster-Apps/intel/2019.3//compilers_and_libraries_2019.3.192/linux/mpi [0] MPI startup(): I_MPI_HYDRA_RMK=slurm [0] MPI startup(): I_MPI_JOB_RESPECT_PROCESS_PLACEMENT=off [0] MPI startup(): I_MPI_PIN_DOMAIN=omp:compact [0] MPI startup(): I_MPI_PIN_ORDER=scatter [0] MPI startup(): I_MPI_FABRICS=shm:ofi [0] MPI startup(): I_MPI_DEBUG=10 [0] MPI startup(): I_MPI_TMI_PROVIDER variable has been removed from the product, its value is ignored [0] MPI startup(): I_MPI_TMI_PROVIDER environment variable is not supported. [0] MPI startup(): Similar variables: I_MPI_OFI_PROVIDER [0] MPI startup(): To check the list of supported variables, use the impi_info utility or refer to https://software.intel.com/en-us/mpi-library/documentation/get-started. IOR-3.3alpha1: MPI Coordinated Test of Parallel I/O Began : Sun Jun 9 10:21:13 2019 Command line : /home/mjr208/projects/benchmarking/io-500-src-stonewall-fix/bin/ior -w -s 90000 -a MPIIO -i 1 -C -Q 1 -g -G 27 -k -e -t 47008 -b 47008 -o /dac/fs1/mjr208/job12143920-2019-06-09-1006/ior_hard/IOR_file -O stoneWallingStatusFile=/dac/fs1/mjr208/job12143920-2019-06-09-1006/ior_hard/stonewall -O stoneWallingWearOut=1 -D 300 Machine : Linux cpu-e-829 TestID : 0 StartTime : Sun Jun 9 10:21:13 2019 Path : /dac/fs1/mjr208/job12143920-2019-06-09-1006/ior_hard FS : 412.5 TiB Used FS: 12.1% Inodes: 960.0 Mi Used Inodes: 15.3% Options: api : MPIIO apiVersion : (3.1) test filename : /dac/fs1/mjr208/job12143920-2019-06-09-1006/ior_hard/IOR_file access : single-shared-file type : independent segments : 90000 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 tasks : 320 clients per node : 32 repetitions : 1 xfersize : 47008 bytes blocksize : 47008 bytes aggregate filesize : 1.23 TiB stonewallingTime : 300 stoneWallingWearOut : 1 Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- stonewalling pairs accessed min: 73220 max: 90000 -- min data: 3.2 GiB mean data: 3.5 GiB time: 300.0s write 3605 45.91 45.91 0.019708 358.12 0.003492 358.14 0 Max Write: 3605.00 MiB/sec (3780.12 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum write 3605.00 3605.00 3605.00 0.00 80414.39 80414.39 80414.39 0.00 358.14484 0 320 32 1 0 1 1 0 0 90000 47008 47008 1291113.2 MPIIO 0 Finished : Sun Jun 9 10:27:12 2019