<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 12/26/2016 03:16 PM, Service Mail
wrote:<br>
</div>
<blockquote
cite="mid:CA+0N=e1pK4NxwhkM_dfa9FCLTM09g7253HWFcDvQcwswSR79JQ@mail.gmail.com"
type="cite">
<div dir="ltr">Hello,
<div><br>
</div>
<div>I have a cluster with 3 nodes with some replica volumes. I
have restart one of the brick while still writing to the
others so that I can test the healing (self healing is on).
After few hrs the healing seems to be stopped but if I check
the status, after many hours, I still can see the following:</div>
<div><br>
</div>
<div>
<div>[root@brick-a ~]# gluster volume heal backup info</div>
<div>Brick brick-a:/pool/backup</div>
<div><gfid:670563bf-76da-41bc-a4b8-4bf5e05d7a4e> </div>
<div><gfid:562106de-2768-4c66-9d9a-3e5da19ec3f6> </div>
<div><gfid:2084e791-b3f8-4234-989b-6f3dfa395e6b> </div>
<div><gfid:981b9503-efc0-4617-864a-7ce0768524e5> </div>
<div><gfid:394201a8-d551-491b-81b9-89044c11076f> </div>
<div><gfid:863335e0-79ec-46d4-8704-40e33e248653> </div>
<div><gfid:a8342c60-76d9-4dc9-8e3e-a5c97a8f843a> </div>
<div><gfid:9517abe3-a466-404c-8987-164fbd0c01ad> </div>
<div><gfid:c075be3f-4f1b-4235-9172-1ad34bd273d1> </div>
<div>Status: Connected</div>
<div>Number of entries: 9</div>
</div>
</div>
</blockquote>
<br>
Can you check if the .glusterfs hardlinks are present for these
entries in brick-b? i.e `stat
brick-b:/pool/backup/.glusterfs/67/05/670563bf-76da-41bc-a4b8-4bf5e05d7a4e`
etc.<br>
<br>
-Ravi<br>
<blockquote
cite="mid:CA+0N=e1pK4NxwhkM_dfa9FCLTM09g7253HWFcDvQcwswSR79JQ@mail.gmail.com"
type="cite">
<div dir="ltr">
<div>
<div><br>
</div>
<div>Brick brick-b:/pool/backup</div>
<div>Status: Connected</div>
</div>
<div><br>
</div>
<div>Far as I understand, this means some data on brick b (the
one I have restarted) is not healthy </div>
<div><br>
</div>
<div>I have tried "#gluster volume heal backup full" however the
info command still list those files as corrupted.</div>
<div><br>
</div>
<div>But the most concerning thing to me is that checking the
directory structure on all nodes they look different:</div>
<div><br>
</div>
<div>
<div>[root@brick-a backup]# du * -sh</div>
<div>301G<span class="gmail-Apple-tab-span" style="white-space:pre">        </span>data</div>
<div>1.9T<span class="gmail-Apple-tab-span" style="white-space:pre">        </span>data2</div>
<div>1.9T<span class="gmail-Apple-tab-span" style="white-space:pre">        data3</span></div>
</div>
<div><span class="gmail-Apple-tab-span" style="white-space:pre">
</span></div>
<div><span class="gmail-Apple-tab-span"><span style="white-space:pre">[root@brick-b backup]# du * -sh
304G        data
1.4T        data2
1.7T        data3</span><br>
</span></div>
<div><span class="gmail-Apple-tab-span"><span style="white-space:pre">
</span></span></div>
<div><span style="white-space:pre">Could be that the 9 entries listed with the "info" commands are big files being "synced" to the others bricks? how can I verified this? </span></div>
<div><span class="gmail-Apple-tab-span"><span style="white-space:pre">
</span></span></div>
<div><br>
</div>
<div>Can you help?</div>
<div><br>
</div>
<div>Thanks</div>
<div><br>
</div>
<div><br>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<p><br>
</p>
</body>
</html>