[6871] 2019-11-14 07:56:55 [ warn] ( im_net_cci_process_connection_connect:01067) Connection request received rc=-54 (Connection reset by peer) (conn@0x1f1d610 172.30.140.227@verbs-ib C P2-peer06 st=3 ref=3 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [6871] 2019-11-14 07:56:55 [ warn] ( im_rpc_connection_callback_common:03453) rc=-54 (Connection reset by peer) (conn@0x1f1d610 172.30.140.227@verbs-ib C P2-peer06 st=1 ref=2 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [13005] 2019-11-14 07:56:59 [ warn] ( im_net_cci_process_connection_connect:01067) Connection request received rc=-54 (Connection reset by peer) (conn@0x1fed5f0 172.30.141.116@verbs-ib C P1-peer05 st=3 ref=3 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [13005] 2019-11-14 07:56:59 [ warn] ( im_rpc_connection_callback_common:03453) rc=-54 (Connection reset by peer) (conn@0x1fed5f0 172.30.141.116@verbs-ib C P1-peer05 st=1 ref=2 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [13007] 2019-11-14 07:56:59 [ warn] ( im_net_cci_process_connection_connect:01067) Connection request received rc=-54 (Connection reset by peer) (conn@0xdd5050 172.30.141.233@verbs-ib C P3-peer02 st=3 ref=3 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [13007] 2019-11-14 07:56:59 [ warn] ( im_rpc_connection_callback_common:03453) rc=-54 (Connection reset by peer) (conn@0xdd5050 172.30.141.233@verbs-ib C P3-peer02 st=1 ref=2 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [12998] 2019-11-14 07:56:59 [ warn] ( im_net_cci_process_connection_connect:01067) Connection request received rc=-54 (Connection reset by peer) (conn@0x18b6910 172.30.140.235@verbs-ib C P3-peer04 st=3 ref=3 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [12998] 2019-11-14 07:56:59 [ warn] ( im_rpc_connection_callback_common:03453) rc=-54 (Connection reset by peer) (conn@0x18b6910 172.30.140.235@verbs-ib C P3-peer04 st=1 ref=2 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [12996] 2019-11-14 07:56:59 [ warn] ( im_net_cci_process_connection_connect:01067) Connection request received rc=-54 (Connection reset by peer) (conn@0x1b32c10 172.30.140.143@verbs-ib C P4-peer02 st=3 ref=3 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [12996] 2019-11-14 07:56:59 [ warn] ( im_rpc_connection_callback_common:03453) rc=-54 (Connection reset by peer) (conn@0x1b32c10 172.30.140.143@verbs-ib C P4-peer02 st=1 ref=2 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [8620] 2019-11-14 07:57:04 [ warn] ( im_net_cci_process_connection_connect:01067) Connection request received rc=-54 (Connection reset by peer) (conn@0x21f9350 172.30.141.141@verbs-ib C P4-peer00 st=3 ref=3 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) [8620] 2019-11-14 07:57:04 [ warn] ( im_rpc_connection_callback_common:03453) rc=-54 (Connection reset by peer) (conn@0x21f9350 172.30.141.141@verbs-ib C P4-peer00 st=1 ref=2 cr(tx:rx)=12:24 num(tx:rx)=0:0 TxC=0 rsp(tx:rx)=0:0 CCF=0 tx(p:o:n)=0:0:0 rx(p:a:cw)=0:0:0) -- started at 11/14/2019 07:57:23 -- mdtest-3.3.0+dev was launched with 16384 total task(s) on 2048 node(s) Command line used: /cache/xg17i000/x10007/io500-sc-19/bin/mdtest '-C' '-t' '-F' '-P' '-w' '3901' '-e' '3901' '-d' '/cache/xg17i000/x10007/io500-sc-19/datafiles/io500.2019.11.14-07.32.14/mdt_hard' '-n' '950000' '-x' '/cache/xg17i000/x10007/io500-sc-19/datafiles/io500.2019.11.14-07.32.14/mdt_hard-stonewall' '-a' 'POSIX' '-N' '1' '-W' '300' Path: /cache/1/xg17i000/x10007/io500-sc-19/datafiles/io500.2019.11.14-07.32.14 FS: 23597.0 TiB Used FS: 33.9% Inodes: 12312.0 Mi Used Inodes: 14.8% Nodemap: 1111111100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 V-0: Rank 0 Line 2128 Shifting ranks by 8 for each phase. 16384 tasks, 15564800000 files Continue stonewall hit min: 214 max: 377 avg: 283.0 SUMMARY rate: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 13090.144 13089.982 13090.033 0.018 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 0.000 0.000 0.000 0.000 File create (stonewall) : NA NA 15357.909 NA Tree creation : 222.274 222.274 222.274 0.000 Tree removal : 0.000 0.000 0.000 0.000 SUMMARY time: (of 1 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 471.870 471.864 471.868 0.001 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 0.000 0.000 0.000 0.000 File create (stonewall) : NA NA 301.950 NA Tree creation : 0.004 0.004 0.004 0.000 Tree removal : 0.000 0.000 0.000 0.000 -- finished at 11/14/2019 08:05:15 --