MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 [0] MPI startup(): libfabric version: 1.8.0a1-impi MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 MPI startup(): Imported environment partly inaccesible. Map=0 Info=0 [0] MPI startup(): libfabric provider: psm2 [0] MPI startup(): Rank Pid Node name Pin cpu [0] MPI startup(): 0 35775 cpu-e-829 0 [0] MPI startup(): 1 35776 cpu-e-829 1 [0] MPI startup(): 2 35777 cpu-e-829 2 [0] MPI startup(): 3 35778 cpu-e-829 3 [0] MPI startup(): 4 35779 cpu-e-829 4 [0] MPI startup(): 5 35780 cpu-e-829 5 [0] MPI startup(): 6 35781 cpu-e-829 6 [0] MPI startup(): 7 35782 cpu-e-829 7 [0] MPI startup(): 8 35783 cpu-e-829 8 [0] MPI startup(): 9 35784 cpu-e-829 9 [0] MPI startup(): 10 35785 cpu-e-829 10 [0] MPI startup(): 11 35786 cpu-e-829 11 [0] MPI startup(): 12 35787 cpu-e-829 12 [0] MPI startup(): 13 35788 cpu-e-829 13 [0] MPI startup(): 14 35789 cpu-e-829 14 [0] MPI startup(): 15 35790 cpu-e-829 15 [0] MPI startup(): 16 35791 cpu-e-829 16 [0] MPI startup(): 17 35792 cpu-e-829 17 [0] MPI startup(): 18 35793 cpu-e-829 18 [0] MPI startup(): 19 35794 cpu-e-829 19 [0] MPI startup(): 20 35795 cpu-e-829 20 [0] MPI startup(): 21 35796 cpu-e-829 21 [0] MPI startup(): 22 35797 cpu-e-829 22 [0] MPI startup(): 23 35798 cpu-e-829 23 [0] MPI startup(): 24 35799 cpu-e-829 24 [0] MPI startup(): 25 35800 cpu-e-829 25 [0] MPI startup(): 26 35801 cpu-e-829 26 [0] MPI startup(): 27 35802 cpu-e-829 27 [0] MPI startup(): 28 35803 cpu-e-829 28 [0] MPI startup(): 29 35804 cpu-e-829 29 [0] MPI startup(): 30 35805 cpu-e-829 30 [0] MPI startup(): 31 35806 cpu-e-829 31 [0] MPI startup(): 32 35715 cpu-e-830 0 [0] MPI startup(): 33 35716 cpu-e-830 1 [0] MPI startup(): 34 35717 cpu-e-830 2 [0] MPI startup(): 35 35718 cpu-e-830 3 [0] MPI startup(): 36 35719 cpu-e-830 4 [0] MPI startup(): 37 35720 cpu-e-830 5 [0] MPI startup(): 38 35721 cpu-e-830 6 [0] MPI startup(): 39 35722 cpu-e-830 7 [0] MPI startup(): 40 35723 cpu-e-830 8 [0] MPI startup(): 41 35724 cpu-e-830 9 [0] MPI startup(): 42 35725 cpu-e-830 10 [0] MPI startup(): 43 35726 cpu-e-830 11 [0] MPI startup(): 44 35727 cpu-e-830 12 [0] MPI startup(): 45 35728 cpu-e-830 13 [0] MPI startup(): 46 35729 cpu-e-830 14 [0] MPI startup(): 47 35730 cpu-e-830 15 [0] MPI startup(): 48 35731 cpu-e-830 16 [0] MPI startup(): 49 35732 cpu-e-830 17 [0] MPI startup(): 50 35733 cpu-e-830 18 [0] MPI startup(): 51 35734 cpu-e-830 19 [0] MPI startup(): 52 35735 cpu-e-830 20 [0] MPI startup(): 53 35736 cpu-e-830 21 [0] MPI startup(): 54 35737 cpu-e-830 22 [0] MPI startup(): 55 35738 cpu-e-830 23 [0] MPI startup(): 56 35739 cpu-e-830 24 [0] MPI startup(): 57 35740 cpu-e-830 25 [0] MPI startup(): 58 35741 cpu-e-830 26 [0] MPI startup(): 59 35742 cpu-e-830 27 [0] MPI startup(): 60 35743 cpu-e-830 28 [0] MPI startup(): 61 35744 cpu-e-830 29 [0] MPI startup(): 62 35745 cpu-e-830 30 [0] MPI startup(): 63 35746 cpu-e-830 31 [0] MPI startup(): 64 35671 cpu-e-893 0 [0] MPI startup(): 65 35672 cpu-e-893 1 [0] MPI startup(): 66 35673 cpu-e-893 2 [0] MPI startup(): 67 35674 cpu-e-893 3 [0] MPI startup(): 68 35675 cpu-e-893 4 [0] MPI startup(): 69 35676 cpu-e-893 5 [0] MPI startup(): 70 35677 cpu-e-893 6 [0] MPI startup(): 71 35678 cpu-e-893 7 [0] MPI startup(): 72 35679 cpu-e-893 8 [0] MPI startup(): 73 35680 cpu-e-893 9 [0] MPI startup(): 74 35681 cpu-e-893 10 [0] MPI startup(): 75 35682 cpu-e-893 11 [0] MPI startup(): 76 35683 cpu-e-893 12 [0] MPI startup(): 77 35684 cpu-e-893 13 [0] MPI startup(): 78 35685 cpu-e-893 14 [0] MPI startup(): 79 35686 cpu-e-893 15 [0] MPI startup(): 80 35687 cpu-e-893 16 [0] MPI startup(): 81 35688 cpu-e-893 17 [0] MPI startup(): 82 35689 cpu-e-893 18 [0] MPI startup(): 83 35690 cpu-e-893 19 [0] MPI startup(): 84 35691 cpu-e-893 20 [0] MPI startup(): 85 35692 cpu-e-893 21 [0] MPI startup(): 86 35693 cpu-e-893 22 [0] MPI startup(): 87 35694 cpu-e-893 23 [0] MPI startup(): 88 35695 cpu-e-893 24 [0] MPI startup(): 89 35696 cpu-e-893 25 [0] MPI startup(): 90 35697 cpu-e-893 26 [0] MPI startup(): 91 35698 cpu-e-893 27 [0] MPI startup(): 92 35699 cpu-e-893 28 [0] MPI startup(): 93 35700 cpu-e-893 29 [0] MPI startup(): 94 35701 cpu-e-893 30 [0] MPI startup(): 95 35702 cpu-e-893 31 [0] MPI startup(): 96 35631 cpu-e-894 0 [0] MPI startup(): 97 35632 cpu-e-894 1 [0] MPI startup(): 98 35633 cpu-e-894 2 [0] MPI startup(): 99 35634 cpu-e-894 3 [0] MPI startup(): 100 35635 cpu-e-894 4 [0] MPI startup(): 101 35636 cpu-e-894 5 [0] MPI startup(): 102 35637 cpu-e-894 6 [0] MPI startup(): 103 35638 cpu-e-894 7 [0] MPI startup(): 104 35639 cpu-e-894 8 [0] MPI startup(): 105 35640 cpu-e-894 9 [0] MPI startup(): 106 35641 cpu-e-894 10 [0] MPI startup(): 107 35642 cpu-e-894 11 [0] MPI startup(): 108 35643 cpu-e-894 12 [0] MPI startup(): 109 35644 cpu-e-894 13 [0] MPI startup(): 110 35645 cpu-e-894 14 [0] MPI startup(): 111 35646 cpu-e-894 15 [0] MPI startup(): 112 35647 cpu-e-894 16 [0] MPI startup(): 113 35648 cpu-e-894 17 [0] MPI startup(): 114 35649 cpu-e-894 18 [0] MPI startup(): 115 35650 cpu-e-894 19 [0] MPI startup(): 116 35651 cpu-e-894 20 [0] MPI startup(): 117 35652 cpu-e-894 21 [0] MPI startup(): 118 35653 cpu-e-894 22 [0] MPI startup(): 119 35654 cpu-e-894 23 [0] MPI startup(): 120 35655 cpu-e-894 24 [0] MPI startup(): 121 35656 cpu-e-894 25 [0] MPI startup(): 122 35657 cpu-e-894 26 [0] MPI startup(): 123 35658 cpu-e-894 27 [0] MPI startup(): 124 35659 cpu-e-894 28 [0] MPI startup(): 125 35660 cpu-e-894 29 [0] MPI startup(): 126 35661 cpu-e-894 30 [0] MPI startup(): 127 35662 cpu-e-894 31 [0] MPI startup(): 128 35711 cpu-e-957 0 [0] MPI startup(): 129 35712 cpu-e-957 1 [0] MPI startup(): 130 35713 cpu-e-957 2 [0] MPI startup(): 131 35714 cpu-e-957 3 [0] MPI startup(): 132 35715 cpu-e-957 4 [0] MPI startup(): 133 35716 cpu-e-957 5 [0] MPI startup(): 134 35717 cpu-e-957 6 [0] MPI startup(): 135 35718 cpu-e-957 7 [0] MPI startup(): 136 35719 cpu-e-957 8 [0] MPI startup(): 137 35720 cpu-e-957 9 [0] MPI startup(): 138 35721 cpu-e-957 10 [0] MPI startup(): 139 35722 cpu-e-957 11 [0] MPI startup(): 140 35723 cpu-e-957 12 [0] MPI startup(): 141 35724 cpu-e-957 13 [0] MPI startup(): 142 35725 cpu-e-957 14 [0] MPI startup(): 143 35726 cpu-e-957 15 [0] MPI startup(): 144 35727 cpu-e-957 16 [0] MPI startup(): 145 35728 cpu-e-957 17 [0] MPI startup(): 146 35729 cpu-e-957 18 [0] MPI startup(): 147 35730 cpu-e-957 19 [0] MPI startup(): 148 35731 cpu-e-957 20 [0] MPI startup(): 149 35732 cpu-e-957 21 [0] MPI startup(): 150 35733 cpu-e-957 22 [0] MPI startup(): 151 35734 cpu-e-957 23 [0] MPI startup(): 152 35735 cpu-e-957 24 [0] MPI startup(): 153 35736 cpu-e-957 25 [0] MPI startup(): 154 35737 cpu-e-957 26 [0] MPI startup(): 155 35738 cpu-e-957 27 [0] MPI startup(): 156 35739 cpu-e-957 28 [0] MPI startup(): 157 35740 cpu-e-957 29 [0] MPI startup(): 158 35741 cpu-e-957 30 [0] MPI startup(): 159 35742 cpu-e-957 31 [0] MPI startup(): 160 35711 cpu-e-958 0 [0] MPI startup(): 161 35712 cpu-e-958 1 [0] MPI startup(): 162 35713 cpu-e-958 2 [0] MPI startup(): 163 35714 cpu-e-958 3 [0] MPI startup(): 164 35715 cpu-e-958 4 [0] MPI startup(): 165 35716 cpu-e-958 5 [0] MPI startup(): 166 35717 cpu-e-958 6 [0] MPI startup(): 167 35718 cpu-e-958 7 [0] MPI startup(): 168 35719 cpu-e-958 8 [0] MPI startup(): 169 35720 cpu-e-958 9 [0] MPI startup(): 170 35721 cpu-e-958 10 [0] MPI startup(): 171 35722 cpu-e-958 11 [0] MPI startup(): 172 35723 cpu-e-958 12 [0] MPI startup(): 173 35724 cpu-e-958 13 [0] MPI startup(): 174 35725 cpu-e-958 14 [0] MPI startup(): 175 35726 cpu-e-958 15 [0] MPI startup(): 176 35727 cpu-e-958 16 [0] MPI startup(): 177 35728 cpu-e-958 17 [0] MPI startup(): 178 35729 cpu-e-958 18 [0] MPI startup(): 179 35730 cpu-e-958 19 [0] MPI startup(): 180 35731 cpu-e-958 20 [0] MPI startup(): 181 35732 cpu-e-958 21 [0] MPI startup(): 182 35733 cpu-e-958 22 [0] MPI startup(): 183 35734 cpu-e-958 23 [0] MPI startup(): 184 35735 cpu-e-958 24 [0] MPI startup(): 185 35736 cpu-e-958 25 [0] MPI startup(): 186 35737 cpu-e-958 26 [0] MPI startup(): 187 35738 cpu-e-958 27 [0] MPI startup(): 188 35739 cpu-e-958 28 [0] MPI startup(): 189 35740 cpu-e-958 29 [0] MPI startup(): 190 35741 cpu-e-958 30 [0] MPI startup(): 191 35742 cpu-e-958 31 [0] MPI startup(): 192 35778 cpu-e-1021 0 [0] MPI startup(): 193 35779 cpu-e-1021 1 [0] MPI startup(): 194 35780 cpu-e-1021 2 [0] MPI startup(): 195 35781 cpu-e-1021 3 [0] MPI startup(): 196 35782 cpu-e-1021 4 [0] MPI startup(): 197 35783 cpu-e-1021 5 [0] MPI startup(): 198 35784 cpu-e-1021 6 [0] MPI startup(): 199 35785 cpu-e-1021 7 [0] MPI startup(): 200 35786 cpu-e-1021 8 [0] MPI startup(): 201 35787 cpu-e-1021 9 [0] MPI startup(): 202 35788 cpu-e-1021 10 [0] MPI startup(): 203 35789 cpu-e-1021 11 [0] MPI startup(): 204 35790 cpu-e-1021 12 [0] MPI startup(): 205 35791 cpu-e-1021 13 [0] MPI startup(): 206 35792 cpu-e-1021 14 [0] MPI startup(): 207 35793 cpu-e-1021 15 [0] MPI startup(): 208 35794 cpu-e-1021 16 [0] MPI startup(): 209 35795 cpu-e-1021 17 [0] MPI startup(): 210 35796 cpu-e-1021 18 [0] MPI startup(): 211 35797 cpu-e-1021 19 [0] MPI startup(): 212 35798 cpu-e-1021 20 [0] MPI startup(): 213 35799 cpu-e-1021 21 [0] MPI startup(): 214 35800 cpu-e-1021 22 [0] MPI startup(): 215 35801 cpu-e-1021 23 [0] MPI startup(): 216 35802 cpu-e-1021 24 [0] MPI startup(): 217 35803 cpu-e-1021 25 [0] MPI startup(): 218 35804 cpu-e-1021 26 [0] MPI startup(): 219 35805 cpu-e-1021 27 [0] MPI startup(): 220 35806 cpu-e-1021 28 [0] MPI startup(): 221 35807 cpu-e-1021 29 [0] MPI startup(): 222 35808 cpu-e-1021 30 [0] MPI startup(): 223 35809 cpu-e-1021 31 [0] MPI startup(): 224 35738 cpu-e-1022 0 [0] MPI startup(): 225 35739 cpu-e-1022 1 [0] MPI startup(): 226 35740 cpu-e-1022 2 [0] MPI startup(): 227 35741 cpu-e-1022 3 [0] MPI startup(): 228 35742 cpu-e-1022 4 [0] MPI startup(): 229 35743 cpu-e-1022 5 [0] MPI startup(): 230 35744 cpu-e-1022 6 [0] MPI startup(): 231 35745 cpu-e-1022 7 [0] MPI startup(): 232 35746 cpu-e-1022 8 [0] MPI startup(): 233 35747 cpu-e-1022 9 [0] MPI startup(): 234 35748 cpu-e-1022 10 [0] MPI startup(): 235 35749 cpu-e-1022 11 [0] MPI startup(): 236 35750 cpu-e-1022 12 [0] MPI startup(): 237 35751 cpu-e-1022 13 [0] MPI startup(): 238 35752 cpu-e-1022 14 [0] MPI startup(): 239 35753 cpu-e-1022 15 [0] MPI startup(): 240 35754 cpu-e-1022 16 [0] MPI startup(): 241 35755 cpu-e-1022 17 [0] MPI startup(): 242 35756 cpu-e-1022 18 [0] MPI startup(): 243 35757 cpu-e-1022 19 [0] MPI startup(): 244 35758 cpu-e-1022 20 [0] MPI startup(): 245 35759 cpu-e-1022 21 [0] MPI startup(): 246 35760 cpu-e-1022 22 [0] MPI startup(): 247 35761 cpu-e-1022 23 [0] MPI startup(): 248 35762 cpu-e-1022 24 [0] MPI startup(): 249 35763 cpu-e-1022 25 [0] MPI startup(): 250 35764 cpu-e-1022 26 [0] MPI startup(): 251 35765 cpu-e-1022 27 [0] MPI startup(): 252 35766 cpu-e-1022 28 [0] MPI startup(): 253 35767 cpu-e-1022 29 [0] MPI startup(): 254 35768 cpu-e-1022 30 [0] MPI startup(): 255 35769 cpu-e-1022 31 [0] MPI startup(): 256 35577 cpu-e-1149 0 [0] MPI startup(): 257 35578 cpu-e-1149 1 [0] MPI startup(): 258 35579 cpu-e-1149 2 [0] MPI startup(): 259 35580 cpu-e-1149 3 [0] MPI startup(): 260 35581 cpu-e-1149 4 [0] MPI startup(): 261 35582 cpu-e-1149 5 [0] MPI startup(): 262 35583 cpu-e-1149 6 [0] MPI startup(): 263 35584 cpu-e-1149 7 [0] MPI startup(): 264 35585 cpu-e-1149 8 [0] MPI startup(): 265 35586 cpu-e-1149 9 [0] MPI startup(): 266 35587 cpu-e-1149 10 [0] MPI startup(): 267 35588 cpu-e-1149 11 [0] MPI startup(): 268 35589 cpu-e-1149 12 [0] MPI startup(): 269 35590 cpu-e-1149 13 [0] MPI startup(): 270 35591 cpu-e-1149 14 [0] MPI startup(): 271 35592 cpu-e-1149 15 [0] MPI startup(): 272 35593 cpu-e-1149 16 [0] MPI startup(): 273 35594 cpu-e-1149 17 [0] MPI startup(): 274 35595 cpu-e-1149 18 [0] MPI startup(): 275 35596 cpu-e-1149 19 [0] MPI startup(): 276 35597 cpu-e-1149 20 [0] MPI startup(): 277 35598 cpu-e-1149 21 [0] MPI startup(): 278 35599 cpu-e-1149 22 [0] MPI startup(): 279 35600 cpu-e-1149 23 [0] MPI startup(): 280 35601 cpu-e-1149 24 [0] MPI startup(): 281 35602 cpu-e-1149 25 [0] MPI startup(): 282 35603 cpu-e-1149 26 [0] MPI startup(): 283 35604 cpu-e-1149 27 [0] MPI startup(): 284 35605 cpu-e-1149 28 [0] MPI startup(): 285 35606 cpu-e-1149 29 [0] MPI startup(): 286 35607 cpu-e-1149 30 [0] MPI startup(): 287 35608 cpu-e-1149 31 [0] MPI startup(): 288 35633 cpu-e-1150 0 [0] MPI startup(): 289 35634 cpu-e-1150 1 [0] MPI startup(): 290 35635 cpu-e-1150 2 [0] MPI startup(): 291 35636 cpu-e-1150 3 [0] MPI startup(): 292 35637 cpu-e-1150 4 [0] MPI startup(): 293 35638 cpu-e-1150 5 [0] MPI startup(): 294 35639 cpu-e-1150 6 [0] MPI startup(): 295 35640 cpu-e-1150 7 [0] MPI startup(): 296 35641 cpu-e-1150 8 [0] MPI startup(): 297 35642 cpu-e-1150 9 [0] MPI startup(): 298 35643 cpu-e-1150 10 [0] MPI startup(): 299 35644 cpu-e-1150 11 [0] MPI startup(): 300 35645 cpu-e-1150 12 [0] MPI startup(): 301 35646 cpu-e-1150 13 [0] MPI startup(): 302 35647 cpu-e-1150 14 [0] MPI startup(): 303 35648 cpu-e-1150 15 [0] MPI startup(): 304 35649 cpu-e-1150 16 [0] MPI startup(): 305 35650 cpu-e-1150 17 [0] MPI startup(): 306 35651 cpu-e-1150 18 [0] MPI startup(): 307 35652 cpu-e-1150 19 [0] MPI startup(): 308 35653 cpu-e-1150 20 [0] MPI startup(): 309 35654 cpu-e-1150 21 [0] MPI startup(): 310 35655 cpu-e-1150 22 [0] MPI startup(): 311 35656 cpu-e-1150 23 [0] MPI startup(): 312 35657 cpu-e-1150 24 [0] MPI startup(): 313 35658 cpu-e-1150 25 [0] MPI startup(): 314 35659 cpu-e-1150 26 [0] MPI startup(): 315 35660 cpu-e-1150 27 [0] MPI startup(): 316 35661 cpu-e-1150 28 [0] MPI startup(): 317 35662 cpu-e-1150 29 [0] MPI startup(): 318 35663 cpu-e-1150 30 [0] MPI startup(): 319 35664 cpu-e-1150 31 [0] MPI startup(): I_MPI_CC=icc [0] MPI startup(): I_MPI_CXX=icpc [0] MPI startup(): I_MPI_FC=ifort [0] MPI startup(): I_MPI_F90=ifort [0] MPI startup(): I_MPI_F77=ifort [0] MPI startup(): I_MPI_ROOT=/usr/local/Cluster-Apps/intel/2019.3//compilers_and_libraries_2019.3.192/linux/mpi [0] MPI startup(): I_MPI_HYDRA_RMK=slurm [0] MPI startup(): I_MPI_JOB_RESPECT_PROCESS_PLACEMENT=off [0] MPI startup(): I_MPI_PIN_DOMAIN=omp:compact [0] MPI startup(): I_MPI_PIN_ORDER=scatter [0] MPI startup(): I_MPI_FABRICS=shm:ofi [0] MPI startup(): I_MPI_DEBUG=10 [0] MPI startup(): I_MPI_TMI_PROVIDER variable has been removed from the product, its value is ignored [0] MPI startup(): I_MPI_TMI_PROVIDER environment variable is not supported. [0] MPI startup(): Similar variables: I_MPI_OFI_PROVIDER [0] MPI startup(): To check the list of supported variables, use the impi_info utility or refer to https://software.intel.com/en-us/mpi-library/documentation/get-started. IOR-3.3alpha1: MPI Coordinated Test of Parallel I/O Began : Sun Jun 9 10:09:27 2019 Command line : /home/mjr208/projects/benchmarking/io-500-src-stonewall-fix/bin/ior -w -a=POSIX --posix.odirect -C -t 16m -b 160g -F -i 1 -C -Q 1 -g -G 27 -k -e -o /dac/fs1/mjr208/job12143920-2019-06-09-1006/ior_easy/ior_file_easy -O stoneWallingStatusFile=/dac/fs1/mjr208/job12143920-2019-06-09-1006/ior_easy/stonewall -O stoneWallingWearOut=1 -D 300 Machine : Linux cpu-e-829 TestID : 0 StartTime : Sun Jun 9 10:09:27 2019 Path : /dac/fs1/mjr208/job12143920-2019-06-09-1006/ior_easy FS : 412.5 TiB Used FS: 0.0% Inodes: 960.0 Mi Used Inodes: 0.0% Options: api : POSIX apiVersion : test filename : /dac/fs1/mjr208/job12143920-2019-06-09-1006/ior_easy/ior_file_easy access : file-per-process type : independent segments : 1 ordering in a file : sequential tasks : 320 clients per node : 32 repetitions : 1 xfersize : 16 MiB blocksize : 160 GiB aggregate filesize : 50 TiB stonewallingTime : 300 stoneWallingWearOut : 1 Results: access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- stonewalling pairs accessed min: 8780 max: 10240 -- min data: 137.2 GiB mean data: 157.8 GiB time: 300.0s write 156790 167772160 16384 0.013947 334.37 0.004553 334.39 0 Max Write: 156789.51 MiB/sec (164405.72 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum write 156789.51 156789.51 156789.51 0.00 9799.34 9799.34 9799.34 0.00 334.38972 0 320 32 1 1 2 1 0 0 1 171798691840 16777216 52428800.0 POSIX 0 Finished : Sun Jun 9 10:15:01 2019