<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">On 03/04/2016 06:23 PM, ABHISHEK
PALIWAL wrote:<br>
</div>
<blockquote
cite="mid:CA+15cFPGgt2Nuko8Za2O7S=uKMFamiAt=vdz=M1d5Zuqd8caKQ@mail.gmail.com"
type="cite">
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><font size="2"><br>
Ok, just to confirm, glusterd and other brick processes are
running after this node rebooted? <br>
When you run the above command, you need to check
/var/log/glusterfs/glfsheal-volname.log logs errros. Setting
client-log-level to DEBUG would give you a more verbose
message<br>
<br>
</font></div>
</blockquote>
<div>Yes, glusterd and other brick processes running fine. I have
check the <font size="2">
/var/log/glusterfs/glfsheal-volname.log file without the
log-level= DEBUG. Here is the logs from that file<br>
<br>
[2016-03-02 13:51:39.059440] I [MSGID: 101190]
[event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll:
Started thread with index 1<br>
[2016-03-02 13:51:39.072172] W [MSGID: 101012]
[common-utils.c:2776:gf_get_reserved_ports] 0-glusterfs: could
not open the file /proc/sys/net/ipv4/ip_local_reserved_ports
for getting reserved ports info [No such file or directory]<br>
[2016-03-02 13:51:39.072228] W [MSGID: 101081]
[common-utils.c:2810:gf_process_reserved_ports] 0-glusterfs:
Not able to get reserved ports, hence there is a possibility
that glusterfs may consume reserved port<br>
[2016-03-02 13:51:39.072583] E
[socket.c:2278:socket_connect_finish] 0-gfapi: connection to <a
moz-do-not-send="true" href="http://127.0.0.1:24007">127.0.0.1:24007</a>
failed (Connection refused)<br>
</font></div>
</blockquote>
<br>
<font size="2">Not sure why ^^ occurs. You could try flushing
iptables (iptables -F), restart glusterd and run the heal info
command again .<br>
<br>
</font>
<blockquote
cite="mid:CA+15cFPGgt2Nuko8Za2O7S=uKMFamiAt=vdz=M1d5Zuqd8caKQ@mail.gmail.com"
type="cite">
<div><font size="2">[2016-03-02 13:51:39.072663] E [MSGID: 104024]
[glfs-mgmt.c:738:mgmt_rpc_notify] 0-glfs-mgmt: failed to
connect with remote-host: localhost (Transport endpoint is not
connected) [Transport endpoint is not connected]<br>
[2016-03-02 13:51:39.072700] I [MSGID: 104025]
[glfs-mgmt.c:744:mgmt_rpc_notify] 0-glfs-mgmt: Exhausted all
volfile servers [Transport endpoint is not connected]<br>
</font> </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><font size="2"> </font><span
class="">
<blockquote type="cite">
<div dir="ltr">
<div><span><font face="Tahoma" size="2" color="black"><span
style="font-size:10pt" dir="ltr"><font
face="Times New Roman" size="2"><span
style="font-size:16px"><font
face="sans-serif" size="2"># gluster
volume heal c_glusterfs info split-brain</font>
<br>
<font face="sans-serif" size="2">c_glusterfs:
Not able to fetch volfile from glusterd</font>
<br>
<font face="sans-serif" size="2">Volume heal
failed.</font></span></font></span></font></span></div>
</div>
</blockquote>
<font size="2"><br>
</font>
<blockquote type="cite">
<div dir="ltr">
<div><span><font face="Tahoma" size="2" color="black"><span
style="font-size:10pt" dir="ltr"><font
face="Times New Roman" size="2"><span
style="font-size:16px"> <br>
<br>
</span></font></span></font></span></div>
<span><font face="Tahoma" size="2" color="black"><span
style="font-size:10pt" dir="ltr"><font face="Times
New Roman" size="2"><span style="font-size:16px">And
based on the your observation I understood
that this is not the problem of split-brain
but <b>is there any way through which can
find out the file which is not in
split-brain as well as not in sync?</b><br>
</span></font></span></font></span></div>
</blockquote>
</span><span><font face="Tahoma" size="2" color="black"><span
style="font-size:10pt" dir="ltr"><font face="Times New
Roman" size="2"><span style="font-size:16px"><font
face="sans-serif" size="2"><br>
`gluster volume heal c_glusterfs info
split-brain` should give you files that need
heal.<br>
</font></span></font></span></font></span></div>
</blockquote>
</blockquote>
<font size="2"><br>
Sorry I meant '</font><span><font face="Tahoma" size="2"
color="black"><span style="font-size:10pt" dir="ltr"><font
face="Times New Roman" size="2"><span style="font-size:16px"><font
face="sans-serif" size="2">gluster volume heal
c_glusterfs info' should give you the files that need
heal and '</font></span></font></span></font></span><span><font
face="Tahoma" size="2" color="black"><span
style="font-size:10pt" dir="ltr"><font face="Times New Roman"
size="2"><span style="font-size:16px"><font
face="sans-serif" size="2">gluster volume heal
c_glusterfs info split-brain' the list of files in split-brain.<br>
The commands are detailed in
<a class="moz-txt-link-freetext" href="https://github.com/gluster/glusterfs-specs/blob/master/done/Features/heal-info-and-split-brain-resolution.md">https://github.com/gluster/glusterfs-specs/blob/master/done/Features/heal-info-and-split-brain-resolution.md</a><br>
<br>
</font></span></font></span></font></span>
<blockquote
cite="mid:CA+15cFPGgt2Nuko8Za2O7S=uKMFamiAt=vdz=M1d5Zuqd8caKQ@mail.gmail.com"
type="cite">
<div><br>
</div>
<div>I have run <span><font face="Tahoma" size="2" color="black"><span
style="font-size:10pt" dir="ltr"><font face="Times New
Roman" size="2"><span style="font-size:16px"><font
face="sans-serif" size="2">"gluster volume heal
c_glusterfs info split-brain" command but it is not
showing that file which is out of sync that is the
issue file is not in sync on both of the brick and
split-brain is not showing that command in output
for heal required. <br>
<br>
</font></span></font></span></font></span></div>
<div><span><font face="Tahoma" size="2" color="black"><span
style="font-size:10pt" dir="ltr"><font face="Times New
Roman" size="2"><span style="font-size:16px"><font
face="sans-serif" size="2">Thats is why I am asking
that is there any command other than this split
brain command so that I can find out the files those
are required the heal operation but not displayed in
the output of </font></span></font></span></font></span><span><font
face="Tahoma" size="2" color="black"><span
style="font-size:10pt" dir="ltr"><font face="Times New
Roman" size="2"><span style="font-size:16px"><font
face="sans-serif" size="2">"gluster volume heal
c_glusterfs info split-brain" command.</font></span></font></span></font></span>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><span><font face="Tahoma"
size="2" color="black"><span style="font-size:10pt"
dir="ltr"><font face="Times New Roman" size="2"><span
style="font-size:16px"><font face="sans-serif"
size="2"> <br>
</font></span></font></span></font></span>
<div>
<div class="h5">
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</blockquote>
<br>
<br>
</body>
</html>