Peering Issues - master branch

[araskachoi]

1/2/2019 Analysis:

Peering Issues

• commands to run sharding application

docker exec -d whiteblock-node0 sharding-p2p-poc -seed=0 -port=5566 -rpcport=7788 ip=0.0.0.0
docker exec -d whiteblock-node1 sharding-p2p-poc -seed=1 -port=5566 -rpcport=7788 -bootstrap -bootnodes=/ip4/10.2.0.2/tcp/5566/ipfs/Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi -ip=0.0.0.0
docker exec -d whiteblock-node2 sharding-p2p-poc -seed=2 -port=5566 -rpcport=7788 -bootstrap -bootnodes=/ip4/10.2.0.2/tcp/5566/ipfs/Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi -ip=0.0.0.0
docker exec -d whiteblock-node3 sharding-p2p-poc -seed=3 -port=5566 -rpcport=7788 -bootstrap -bootnodes=/ip4/10.2.0.2/tcp/5566/ipfs/Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi -ip=0.0.0.0
docker exec -d whiteblock-node4 sharding-p2p-poc -seed=4 -port=5566 -rpcport=7788 -bootstrap -bootnodes=/ip4/10.2.0.2/tcp/5566/ipfs/Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi -ip=0.0.0.0
docker exec -d whiteblock-node5 sharding-p2p-poc -seed=5 -port=5566 -rpcport=7788 -bootstrap -bootnodes=/ip4/10.2.0.2/tcp/5566/ipfs/Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi -ip=0.0.0.0

• bootstrap peering issue
  • using dockerfile from the master branch (commit 66ca4fc)
  • all docker containers can ping one another so not a networking issue
  • when the client nodes use the bootstrap flag and the bootnode address when starting the application, the following error is thrown

/bin # sharding-p2p-poc -seed=1 -port=5566 -rpcport=7788 -bootstrap -bootnodes=/ip4/10.2.0.2/tcp/5566/ipfs/Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi -ip=0.0.0.0
20:04:01.543 ERROR sharding-p: Failed to bootstrap with <peer.ID Qm*zMzwwi>: dial attempt failed: <peer.ID Qm*57Yrmd> --> <peer.ID Qm*zMzwwi> dial attempt failed: connection refused bootstrap.go:50

• manually call addPeer
  • the bootnode can manually add peers using the cli, but when the other client nodes try to add the bootnode as a peer, an error is thrown (below)
  • when the bootstrap node manually adds the peer to a client node, that client node can call addPeer to the bootstrap node without any error (but they are already peered so this is not useful to peer again)
  • addpeer call from QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd to Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi (node1 -> bootnode) gives error:

/bin # sharding-p2p-poc -client -rpcport=7788 addpeer 10.2.0.2 5566 0
19:46:43.019 CRITI sharding-p: Failed to add peer at 10.2.0.2:5566, err: rpc error: code = Unknown desc = Failed to connect to peer <peer.ID Qm*zMzwwi>, err: dial attempt failed: <peer.ID Qm*57Yrmd> --> <peer.ID Qm*zMzwwi> dial attempt failed: connection refused cli.go:199

RPC call changes

• changed the format of subshard
  • what is numShardPeerToConnect?
  • is this a hard limit on how many peers can join this shard?
• it would be nice to have a readme section to describe the rpc calls and what arguments are required for those calls

[mhchia]

Thank you for the awesome feedback! I'm still confirming the issue. Will have feedback later.

changed the format of subshard
what is numShardPeerToConnect?
is this a hard limit on how many peers can join this shard?

Sorry again for the lack of documenting. subshard is changed in #131.

connect to randomly chosen numShardPeerToConnect peers from that shard when executed

numShardPeerToConnect indicates how many nodes you will connect in the shard you are going to subscribe with subshard. For example, if the number is 5, then subshard 5 0 will subscribe your node to the shard 0, and then connect to 5 peers in the shard 5. Those peers are selected using the discovery module, which is currently the ShardPreferenceTable

it would be nice to have a readme section to describe the rpc calls and what arguments are required for those calls

Yes, you're right. We had one document specified in https://github.com/ethresearch/sharding-p2p-poc/#command-line-interface, but it is also stale. Will update it!

changes needed in readme.md

Thank you so much for pointing them out. It will be really great if you don't mind opening a PR for it. 🙏 I can update it if you are inconvenient:)

[araskachoi]

moved the readme.md section to a seperate PR #146

[araskachoi]

Found out the issue... It was because I was missing the - in the -ip=... flag!
This resolves the issue and peering is working as expected!

for 1 bootnode, 10 client nodes

 *********** Peer List ***********
node 0 peer list: ["QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R"]
node 1 peer list: ["QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R"]
node 2 peer list: ["QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U"]
node 3 peer list: ["QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB"]
node 4 peer list: ["QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi"]
node 5 peer list: ["QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB"]
node 6 peer list: ["Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm"]
node 7 peer list: ["QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R"]
node 8 peer list: ["QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB"]
node 9 peer list: ["QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB"]
node 10 peer list: ["QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4"]

 *********** Topic Peer List ***********
node 0 topic list: {"listeningShard":["QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd"]}
node 1 topic list: {"listeningShard":["QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm"]}
node 2 topic list: {"listeningShard":["Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4"]}
node 3 topic list: {"listeningShard":["QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB"]}
node 4 topic list: {"listeningShard":["QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd"]}
node 5 topic list: {"listeningShard":["QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm"]}
node 6 topic list: {"listeningShard":["QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm"]}
node 7 topic list: {"listeningShard":["QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL"]}
node 8 topic list: {"listeningShard":["QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm"]}
node 9 topic list: {"listeningShard":["QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmeMdxpbB5aK6gYu78TdMHMLnQuEatPAw5UuRPTfoXLDsm"]}
node 10 topic list: {"listeningShard":["QmRd2F8C6Nk49zjLmNCHKRzPaMUggEicJMw6tHX6DEe8VL","QmYfkGxaRn675YYywLu7CHR9iTjUa7A4tHbskDcpFtPc5R","QmTkBrU7gzzAZo6B93oPc2hetvv8EhmVEZGdkpmdkg7Pw2","QmRfvHwkUAnv5shq1e8mEdMjbHkuJruQgab6ijSYR5kJXv","Qmd8vXqRiFVkcXcB1nigjCDuUyHcFkja6fQcU9w2zMzwwi","QmXEM4JajZe6o2ejwkWA6pH3qRw3rkNbF23Lo5PJxrof7U","QmXtW5fXrrvmHWPhq3FLHdm4zKnC5FZdhTRynSQT57Yrmd","QmWxmXbDqhho2CrJhiu2hHFHba2bsdKDbCSV548KxxAmbB","QmUEYt4pTZwnmeiWJhCQJ2sHH46A3bs3KBVN8eN2nC87Y4","QmaPF7a84gB8Ld35T9mJG2kDPNgQ1v5DkZr3hvjeGaxuQN"]}

• looks like everything is peering fine now!

[mhchia]

Glad to hear that!

It was because I was missing the - in the -ip=... flag

But it sounds an issue, the CLI argument checking should be improved.

[mhchia]

Note: the API document is updated.