<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi all
<div class=""><br class="">
</div>
<div class="">We have a production cluster with 2 nodes (gfs01a and gfs01b) in a distributed replicate setup with glusterfs 3.6.4. We want to expand the volume with 2 extra nodes (gfs02a and gfs02b) because we are running out of diskspace. Therefor we deployed
2 extra nodes with glusterfs 3.6.4.</div>
<div class=""><br class="">
</div>
<div class="">Now, while probing the 2 new nodes from a node in the existing cluster we got the following error:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">root@gfs01a-dcg:~# gluster peer probe <a href="http://gfs02a-dcg.intnet.be" class="">
gfs02a-dcg.intnet.be</a></div>
<div class="">peer probe: success.</div>
<div class="">root@gfs01a-dcg:~# gluster peer status</div>
<div class="">Number of Peers: 2</div>
<div class=""><br class="">
</div>
<div class="">Hostname: <a href="http://gfs01b-dcg.intnet.be" class="">gfs01b-dcg.intnet.be</a></div>
<div class="">Uuid: cfc83cf2-b719-40c7-afea-b23accc714c3</div>
<div class="">State: Peer in Cluster (Connected)</div>
<div class=""><br class="">
</div>
<div class="">Hostname: <a href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a></div>
<div class="">Uuid: 29592d5b-242b-43b5-afc5-5f9a1496d59f</div>
<div class=""><b class="">State: Peer Rejected (Connected)</b></div>
</div>
<div class=""><br class="">
</div>
<div class="">In the log file /var/log/glusterfs/etc-glusterfs-glusterd.vol.log the following entries are written:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[2015-09-11 09:37:49.405906] I [glusterd-handler.c:1031:__glusterd_handle_cli_probe] 0-glusterd: Received CLI probe req
<a href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a> 24007</div>
<div class="">[2015-09-11 09:37:49.428630] I [glusterd-handler.c:3198:glusterd_probe_begin] 0-glusterd: Unable to find peerinfo for host:
<a href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a> (24007)</div>
<div class="">[2015-09-11 09:37:49.438636] I [rpc-clnt.c:969:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600</div>
<div class="">[2015-09-11 09:37:49.440513] I [glusterd-handler.c:3131:glusterd_friend_add] 0-management: connect returned 0</div>
<div class="">[2015-09-11 09:37:49.474316] I [glusterd-rpc-ops.c:245:__glusterd_probe_cbk] 0-management: Received probe resp from uuid: 29592d5b-242b-43b5-afc5-5f9a1496d59f, host:
<a href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a></div>
<div class="">[2015-09-11 09:37:49.481801] I [glusterd-rpc-ops.c:387:__glusterd_probe_cbk] 0-glusterd: Received resp to probe req</div>
<div class="">[2015-09-11 09:37:51.650265] I [glusterd-rpc-ops.c:437:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 29592d5b-242b-43b5-afc5-5f9a1496d59f, host:
<a href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a>, port: 0</div>
<div class="">[2015-09-11 09:37:51.665861] I [glusterd-handshake.c:1119:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 30603</div>
<div class="">[2015-09-11 09:37:51.690170] I [glusterd-handler.c:2543:__glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: 29592d5b-242b-43b5-afc5-5f9a1496d59f</div>
<div class="">[2015-09-11 09:37:51.692652] I [glusterd-handler.c:2595:__glusterd_handle_probe_query] 0-glusterd: Responded to
<a href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a>, op_ret: 0, op_errno: 0, ret: 0</div>
<div class="">[2015-09-11 09:37:51.706203] I [glusterd-handler.c:2232:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 29592d5b-242b-43b5-afc5-5f9a1496d59f</div>
<div class=""><b class="">[2015-09-11 09:37:51.708909] E [MSGID: 106010] [glusterd-utils.c:3297:glusterd_compare_friend_volume] 0-management: Version of Cksums public differ. local cksum = 1932535021, remote cksum = 2474653383 on peer
<a href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a></b></div>
<div class="">[2015-09-11 09:37:51.709026] I [glusterd-handler.c:3367:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to
<a href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a> (0), ret: 0</div>
<div class="">[2015-09-11 09:37:55.537231] I [glusterd-handler.c:1241:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req</div>
</div>
<div class=""><br class="">
</div>
<div class="">The exact same error appears while probing the second node (gfs02b).</div>
<div class=""><br class="">
</div>
<div class="">Anyone any idea how to solve this?</div>
<div class=""><br class="">
</div>
<div class="">Thanks in advance.</div>
<div class=""><br class="">
</div>
<div class="">Kind regards</div>
<div class="">Davy</div>
</body>
</html>