<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Can you check the checksum of the volume "public" in both of the
    current nodes. Checksums are located in
    (/var/lib/glusterd/vols/public/cksum).<br>
    <br>
    Regards<br>
    Rafi KC<br>
    <br>
    <div class="moz-cite-prefix">On 09/11/2015 03:24 PM, Davy Croonen
      wrote:<br>
    </div>
    <blockquote
      cite="mid:4A847EE1-EA20-4A68-A172-FCF727A36D3D@smartbit.be"
      type="cite">
      <meta http-equiv="Content-Type" content="text/html;
        charset=windows-1252">
      Hi all
      <div class=""><br class="">
      </div>
      <div class="">We have a production cluster with 2 nodes (gfs01a
        and gfs01b) in a distributed replicate setup with glusterfs
        3.6.4. We want to expand the volume with 2 extra nodes (gfs02a
        and gfs02b) because we are running out of diskspace. Therefor we
        deployed 2 extra nodes with glusterfs 3.6.4.</div>
      <div class=""><br class="">
      </div>
      <div class="">Now, while probing the 2 new nodes from a node in
        the existing cluster we got the following error:</div>
      <div class=""><br class="">
      </div>
      <div class="">
        <div class="">root@gfs01a-dcg:~# gluster peer probe <a
            moz-do-not-send="true" href="http://gfs02a-dcg.intnet.be"
            class="">
            gfs02a-dcg.intnet.be</a></div>
        <div class="">peer probe: success.</div>
        <div class="">root@gfs01a-dcg:~# gluster peer status</div>
        <div class="">Number of Peers: 2</div>
        <div class=""><br class="">
        </div>
        <div class="">Hostname: <a moz-do-not-send="true"
            href="http://gfs01b-dcg.intnet.be" class="">gfs01b-dcg.intnet.be</a></div>
        <div class="">Uuid: cfc83cf2-b719-40c7-afea-b23accc714c3</div>
        <div class="">State: Peer in Cluster (Connected)</div>
        <div class=""><br class="">
        </div>
        <div class="">Hostname: <a moz-do-not-send="true"
            href="http://gfs02a-dcg.intnet.be" class="">gfs02a-dcg.intnet.be</a></div>
        <div class="">Uuid: 29592d5b-242b-43b5-afc5-5f9a1496d59f</div>
        <div class=""><b class="">State: Peer Rejected (Connected)</b></div>
      </div>
      <div class=""><br class="">
      </div>
      <div class="">In the log file
        /var/log/glusterfs/etc-glusterfs-glusterd.vol.log the following
        entries are written:</div>
      <div class=""><br class="">
      </div>
      <div class="">
        <div class="">[2015-09-11 09:37:49.405906] I
          [glusterd-handler.c:1031:__glusterd_handle_cli_probe]
          0-glusterd: Received CLI probe req
          <a moz-do-not-send="true" href="http://gfs02a-dcg.intnet.be"
            class="">gfs02a-dcg.intnet.be</a> 24007</div>
        <div class="">[2015-09-11 09:37:49.428630] I
          [glusterd-handler.c:3198:glusterd_probe_begin] 0-glusterd:
          Unable to find peerinfo for host:
          <a moz-do-not-send="true" href="http://gfs02a-dcg.intnet.be"
            class="">gfs02a-dcg.intnet.be</a> (24007)</div>
        <div class="">[2015-09-11 09:37:49.438636] I
          [rpc-clnt.c:969:rpc_clnt_connection_init] 0-management:
          setting frame-timeout to 600</div>
        <div class="">[2015-09-11 09:37:49.440513] I
          [glusterd-handler.c:3131:glusterd_friend_add] 0-management:
          connect returned 0</div>
        <div class="">[2015-09-11 09:37:49.474316] I
          [glusterd-rpc-ops.c:245:__glusterd_probe_cbk] 0-management:
          Received probe resp from uuid:
          29592d5b-242b-43b5-afc5-5f9a1496d59f, host:
          <a moz-do-not-send="true" href="http://gfs02a-dcg.intnet.be"
            class="">gfs02a-dcg.intnet.be</a></div>
        <div class="">[2015-09-11 09:37:49.481801] I
          [glusterd-rpc-ops.c:387:__glusterd_probe_cbk] 0-glusterd:
          Received resp to probe req</div>
        <div class="">[2015-09-11 09:37:51.650265] I
          [glusterd-rpc-ops.c:437:__glusterd_friend_add_cbk] 0-glusterd:
          Received ACC from uuid: 29592d5b-242b-43b5-afc5-5f9a1496d59f,
          host:
          <a moz-do-not-send="true" href="http://gfs02a-dcg.intnet.be"
            class="">gfs02a-dcg.intnet.be</a>, port: 0</div>
        <div class="">[2015-09-11 09:37:51.665861] I
          [glusterd-handshake.c:1119:__glusterd_mgmt_hndsk_versions_ack]
          0-management: using the op-version 30603</div>
        <div class="">[2015-09-11 09:37:51.690170] I
          [glusterd-handler.c:2543:__glusterd_handle_probe_query]
          0-glusterd: Received probe from uuid:
          29592d5b-242b-43b5-afc5-5f9a1496d59f</div>
        <div class="">[2015-09-11 09:37:51.692652] I
          [glusterd-handler.c:2595:__glusterd_handle_probe_query]
          0-glusterd: Responded to
          <a moz-do-not-send="true" href="http://gfs02a-dcg.intnet.be"
            class="">gfs02a-dcg.intnet.be</a>, op_ret: 0, op_errno: 0,
          ret: 0</div>
        <div class="">[2015-09-11 09:37:51.706203] I
          [glusterd-handler.c:2232:__glusterd_handle_incoming_friend_req]
          0-glusterd: Received probe from uuid:
          29592d5b-242b-43b5-afc5-5f9a1496d59f</div>
        <div class=""><b class="">[2015-09-11 09:37:51.708909] E [MSGID:
            106010]
            [glusterd-utils.c:3297:glusterd_compare_friend_volume]
            0-management: Version of Cksums public differ. local cksum =
            1932535021, remote cksum = 2474653383 on peer
            <a moz-do-not-send="true" href="http://gfs02a-dcg.intnet.be"
              class="">gfs02a-dcg.intnet.be</a></b></div>
        <div class="">[2015-09-11 09:37:51.709026] I
          [glusterd-handler.c:3367:glusterd_xfer_friend_add_resp]
          0-glusterd: Responded to
          <a moz-do-not-send="true" href="http://gfs02a-dcg.intnet.be"
            class="">gfs02a-dcg.intnet.be</a> (0), ret: 0</div>
        <div class="">[2015-09-11 09:37:55.537231] I
          [glusterd-handler.c:1241:__glusterd_handle_cli_list_friends]
          0-glusterd: Received cli list req</div>
      </div>
      <div class=""><br class="">
      </div>
      <div class="">The exact same error appears while probing the
        second node (gfs02b).</div>
      <div class=""><br class="">
      </div>
      <div class="">Anyone any idea how to solve this?</div>
      <div class=""><br class="">
      </div>
      <div class="">Thanks in advance.</div>
      <div class=""><br class="">
      </div>
      <div class="">Kind regards</div>
      <div class="">Davy</div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  </body>
</html>