<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<br>
<br>
<div class="moz-cite-prefix">On 09/21/2015 01:18 PM, Mark Ruys
wrote:<br>
</div>
<blockquote
cite="mid:F7C78736-D609-4242-8FEF-FAF2339D5B0F@peercode.nl"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
Hi,
<div class=""><br class="">
</div>
<div class="">I’ve trouble the two bricks in replica (on two
servers, file1 and file2). They fail to perform a heal:</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">file1:~$ sudo gluster volume heal GLUSTER-SHARE </div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Launching Heal operation on volume GLUSTER-SHARE has
been unsuccessful</div>
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">file2:~$ sudo gluster volume heal GLUSTER-SHARE </div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Commit failed on file1. Please check the log file for
more details.</div>
</div>
</blockquote>
<br>
Can you share the output of what gets logged to glustershd.log and
usr-local-etc-glusterfs-glusterd.vol.log from both nodes when you
run the heal command?<br>
<br>
<blockquote
cite="mid:F7C78736-D609-4242-8FEF-FAF2339D5B0F@peercode.nl"
type="cite">
<div class=""><br class="">
</div>
<div class="">As a result, I can’t fix a split brain situation on
these bricks. Other volumes on the same machine don’t have this
problem.</div>
<div class=""><br class="">
</div>
<div class="">How can I fix it?</div>
<div class=""><br class="">
</div>
<div class="">Thanks, Mark</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">PS. Some configuration and status details:</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">file1:~$ sudo gluster volume status GLUSTER-SHARE</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Status of volume: GLUSTER-SHARE</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Gluster process<span class="Apple-tab-span" style="white-space:pre"> </span>Port<span class="Apple-tab-span" style="white-space:pre"> </span>Online<span class="Apple-tab-span" style="white-space:pre"> </span>Pid</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">------------------------------------------------------------------------------</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Brick file1:/data/export-share-1<span class="Apple-tab-span" style="white-space:pre"> </span>49152<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>1229</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Brick file2:/data/export-share-2<span class="Apple-tab-span" style="white-space:pre"> </span>49160<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>4966</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">NFS Server on localhost<span class="Apple-tab-span" style="white-space:pre"> </span>2049<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>16980</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Self-heal Daemon on localhost<span class="Apple-tab-span" style="white-space:pre"> </span>N/A<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>16988</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">NFS Server on file2<span class="Apple-tab-span" style="white-space:pre"> </span>2049<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>4978</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Self-heal Daemon on file2<span class="Apple-tab-span" style="white-space:pre"> </span>N/A<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>4995</div>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;
min-height: 13px;" class=""> <br
class="webkit-block-placeholder">
</p>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">There are no active volume tasks</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class=""><br class="">
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class=""><br class="">
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">file2:~$ sudo gluster volume status GLUSTER-SHARE</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Status of volume: GLUSTER-SHARE</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Gluster process<span class="Apple-tab-span" style="white-space:pre"> </span>Port<span class="Apple-tab-span" style="white-space:pre"> </span>Online<span class="Apple-tab-span" style="white-space:pre"> </span>Pid</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">------------------------------------------------------------------------------</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Brick file1:/data/export-share-1<span class="Apple-tab-span" style="white-space:pre"> </span>49152<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>1229</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Brick file2:/data/export-share-2<span class="Apple-tab-span" style="white-space:pre"> </span>49160<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>4966</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">NFS Server on localhost<span class="Apple-tab-span" style="white-space:pre"> </span>2049<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>4978</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Self-heal Daemon on localhost<span class="Apple-tab-span" style="white-space:pre"> </span>N/A<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>4995</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">NFS Server on file1<span class="Apple-tab-span" style="white-space:pre"> </span>2049<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>16980</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Self-heal Daemon on file1<span class="Apple-tab-span" style="white-space:pre"> </span>N/A<span class="Apple-tab-span" style="white-space:pre"> </span>Y<span class="Apple-tab-span" style="white-space:pre"> </span>16988</div>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;
min-height: 13px;" class=""> <br
class="webkit-block-placeholder">
</p>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">There are no active volume tasks</div>
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class=""><br class="">
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">file1:~$ sudo gluster volume info GLUSTER-SHARE</div>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;
min-height: 13px;" class=""> <br
class="webkit-block-placeholder">
</p>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Volume Name: GLUSTER-SHARE</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Type: Replicate</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Volume ID: e6eb05aa-be3b-456c-bf30-27275faa529c</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Status: Started</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Number of Bricks: 1 x 2 = 2</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Transport-type: tcp</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Bricks:</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Brick1: file1:/data/export-share-1</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Brick2: file2:/data/export-share-2</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Options Reconfigured:</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">features.limit-usage: /:10gb</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">auth.allow: 10.0.0.*</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">features.quota: on</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">nfs.disable: off</div>
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">cli.log on file1:</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:40:32.848845] W
[rpc-transport.c:175:rpc_transport_load] 0-rpc-transport:
missing 'option transport-type'. defaulting to "socket"</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:40:32.851395] I
[socket.c:3564:socket_init] 0-glusterfs: SSL support is NOT
enabled</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:40:32.852809] I
[socket.c:3579:socket_init] 0-glusterfs: using system polling
thread</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:40:33.006118] I
[cli-rpc-ops.c:6293:gf_cli_heal_volume_cbk] 0-cli: Received
resp to heal volume</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:40:33.006211] I [input.c:36:cli_batch]
0-: Exiting with: -1</div>
</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">cli.log on file2:</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:39:42.730058] W
[rpc-transport.c:175:rpc_transport_load] 0-rpc-transport:
missing 'option transport-type'. defaulting to "socket"</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:39:42.730809] I
[socket.c:3564:socket_init] 0-glusterfs: SSL support is NOT
enabled</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:39:42.730833] I
[socket.c:3579:socket_init] 0-glusterfs: using system
polling thread</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:39:42.828081] I
[cli-rpc-ops.c:6293:gf_cli_heal_volume_cbk] 0-cli: Received
resp to heal volume</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">[2015-09-21 07:39:42.828212] I
[input.c:36:cli_batch] 0-: Exiting with: 0</div>
</div>
<div class=""><br class="">
</div>
</div>
<div class=""><br class="">
</div>
<div class="">Gluster version:</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">file1:/var/log/glusterfs$ dpkg -l 'gluster*'</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">Desired=Unknown/Install/Remove/Purge/Hold</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">|
Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">|/ Err?=(none)/Reinst-required (Status,Err:
uppercase=bad)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">||/ Name Version
Description</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">+++-=====================================-=====================================-==========================================================================================</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">un glusterfs
<none> (no description
available)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">ii glusterfs-client
3.4.7-ubuntu1~precise1 clustered file-system
(client package)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">ii glusterfs-common
3.4.7-ubuntu1~precise1 GlusterFS common
libraries and translator modules</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;"
class="">ii glusterfs-server
3.4.7-ubuntu1~precise1 clustered file-system
(server package)</div>
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
<div apple-content-edited="true" class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal;
orphans: auto; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: auto;
word-spacing: 0px; -webkit-text-stroke-width: 0px;
word-wrap: break-word; -webkit-nbsp-mode: space;
-webkit-line-break: after-white-space;" class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal;
orphans: auto; text-align: start; text-indent: 0px;
text-transform: none; white-space: normal; widows: auto;
word-spacing: 0px; -webkit-text-stroke-width: 0px;
word-wrap: break-word; -webkit-nbsp-mode: space;
-webkit-line-break: after-white-space;" class="">
<div style="orphans: 2; widows: 2;" class=""><span
class="Apple-style-span" style="font-family:
monospace;">---</span></div>
<div style="orphans: 2; widows: 2;" class=""><span
style="font-family: monospace; text-align:
-webkit-auto;" class="">Oudenhof 4c, 4191NW
Geldermalsen, The Netherlands</span></div>
<div style="orphans: 2; widows: 2;" class=""><span
class="Apple-style-span" style="font-family:
monospace;">Web site and travel directions: </span><span
class="Apple-style-span" style="font-family:
monospace;"><a moz-do-not-send="true"
href="http://peercode.nl" class="">www.peercode.nl</a><br
class="">
</span><span class="Apple-style-span"
style="font-family: monospace;">Phone +31.88.0084124
:: Mobile +31.6.51298623</span></div>
</div>
</div>
</div>
<br class="">
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</body>
</html>