<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">On 12/26/2016 03:16 PM, Service Mail
      wrote:<br>
    </div>
    <blockquote
cite="mid:CA+0N=e1pK4NxwhkM_dfa9FCLTM09g7253HWFcDvQcwswSR79JQ@mail.gmail.com"
      type="cite">
      <div dir="ltr">Hello, 
        <div><br>
        </div>
        <div>I have a cluster with 3 nodes with some replica volumes. I
          have restart one of the brick while still writing to the
          others so that I can test the healing (self healing is on).
          After few hrs the healing seems to be stopped but if I check
          the status, after many hours,  I still can see the following:</div>
        <div><br>
        </div>
        <div>
          <div>[root@brick-a ~]# gluster volume heal backup info</div>
          <div>Brick brick-a:/pool/backup</div>
          <div>&lt;gfid:670563bf-76da-41bc-a4b8-4bf5e05d7a4e&gt; </div>
          <div>&lt;gfid:562106de-2768-4c66-9d9a-3e5da19ec3f6&gt; </div>
          <div>&lt;gfid:2084e791-b3f8-4234-989b-6f3dfa395e6b&gt; </div>
          <div>&lt;gfid:981b9503-efc0-4617-864a-7ce0768524e5&gt; </div>
          <div>&lt;gfid:394201a8-d551-491b-81b9-89044c11076f&gt; </div>
          <div>&lt;gfid:863335e0-79ec-46d4-8704-40e33e248653&gt; </div>
          <div>&lt;gfid:a8342c60-76d9-4dc9-8e3e-a5c97a8f843a&gt; </div>
          <div>&lt;gfid:9517abe3-a466-404c-8987-164fbd0c01ad&gt; </div>
          <div>&lt;gfid:c075be3f-4f1b-4235-9172-1ad34bd273d1&gt; </div>
          <div>Status: Connected</div>
          <div>Number of entries: 9</div>
        </div>
      </div>
    </blockquote>
    <br>
    Can you check if the .glusterfs hardlinks are present for these
    entries in brick-b? i.e `stat
brick-b:/pool/backup/.glusterfs/67/05/670563bf-76da-41bc-a4b8-4bf5e05d7a4e`
    etc.<br>
    <br>
    -Ravi<br>
    <blockquote
cite="mid:CA+0N=e1pK4NxwhkM_dfa9FCLTM09g7253HWFcDvQcwswSR79JQ@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div>
          <div><br>
          </div>
          <div>Brick brick-b:/pool/backup</div>
          <div>Status: Connected</div>
        </div>
        <div><br>
        </div>
        <div>Far as I understand, this means some data on brick b (the
          one I have restarted) is not healthy </div>
        <div><br>
        </div>
        <div>I have tried "#gluster volume heal backup full" however the
          info command still list those files as corrupted.</div>
        <div><br>
        </div>
        <div>But the most concerning thing to me is that checking the
          directory structure on all nodes they look different:</div>
        <div><br>
        </div>
        <div>
          <div>[root@brick-a backup]# du * -sh</div>
          <div>301G<span class="gmail-Apple-tab-span" style="white-space:pre">        </span>data</div>
          <div>1.9T<span class="gmail-Apple-tab-span" style="white-space:pre">        </span>data2</div>
          <div>1.9T<span class="gmail-Apple-tab-span" style="white-space:pre">        data3</span></div>
        </div>
        <div><span class="gmail-Apple-tab-span" style="white-space:pre">
</span></div>
        <div><span class="gmail-Apple-tab-span"><span style="white-space:pre">[root@brick-b backup]# du * -sh
304G        data
1.4T        data2
1.7T        data3</span><br>
          </span></div>
        <div><span class="gmail-Apple-tab-span"><span style="white-space:pre">
</span></span></div>
        <div><span style="white-space:pre">Could be that the 9 entries listed with the "info" commands are big files being "synced" to the others bricks? how can I verified this? </span></div>
        <div><span class="gmail-Apple-tab-span"><span style="white-space:pre">
</span></span></div>
        <div><br>
        </div>
        <div>Can you help?</div>
        <div><br>
        </div>
        <div>Thanks</div>
        <div><br>
        </div>
        <div><br>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <p><br>
    </p>
  </body>
</html>