<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: Arial; font-size: 10pt; color: #000000'><font face="Arial"><span style="font-size: 10pt;">Hi folks,</span></font><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">I have a 3 node gluster volume that developed a problem with gluster vol commands e.g. gluster vol status</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">GlusterFS version 3.6.2</span></font></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">The volume is successfully mounted and appears to be working correctly (for now).</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div><div><font size="2" face="arial, helvetica, sans-serif"><b>gluster volume info</b></font></div><div><font size="2" face="arial, helvetica, sans-serif"><br></font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Volume Name: my_filestore_vol</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Type: Replicate</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Volume ID: ....</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Status: Started</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Number of Bricks: 1 x 3 = 3</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Transport-type: tcp</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Bricks:</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Brick1: my-web01:/export/brick0</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Brick2: my-web02:/export/brick0</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Brick3: my-web03:/export/brick0</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Options Reconfigured:</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>nfs.drc: off</font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>diagnostics.brick-log-level: WARNING</font></div><div style="color: rgb(0, 0, 0);"><font size="2" face="arial, helvetica, sans-serif"><br></font></div><div><div><font size="2" face="arial, helvetica, sans-serif"><b>gluster volume status</b></font></div><div><font size="2" face="arial, helvetica, sans-serif"><br></font></div><div><font size="2" face="arial, helvetica, sans-serif"><span class="Apple-tab-span" style="white-space:pre"> </span>Another transaction is in progress. Please try again after sometime.</font></div></div><div><font size="2" face="arial, helvetica, sans-serif"><br></font></div><div><font size="2" face="arial, helvetica, sans-serif">I am also seeing errors in the self-heal logs...</font></div><div><font size="2" face="arial, helvetica, sans-serif"><br></font></div><div><font face="arial, helvetica, sans-serif" size="2"><b>/var/log/glusterfs/glfsheal-my_filestore_vol.log</b></font></div><div><font face="arial, helvetica, sans-serif" size="2"><br></font></div><div><font face="arial, helvetica, sans-serif" size="2"><div>[2015-07-06 13:49:12.609285] E [glfs-mgmt.c:520:mgmt_getspec_cbk] 0-gfapi: failed to get the 'volume file' from server</div><div>[2015-07-06 13:49:12.609331] E [glfs-mgmt.c:599:mgmt_getspec_cbk] 0-glfs-mgmt: failed to fetch volume file (key:my_filestore_vol)</div><div>[2015-07-06 13:49:27.377875] E [glfs-mgmt.c:520:mgmt_getspec_cbk] 0-gfapi: failed to get the 'volume file' from server</div><div>[2015-07-06 13:49:27.377928] E [glfs-mgmt.c:599:mgmt_getspec_cbk] 0-glfs-mgmt: failed to fetch volume file (key:my_filestore_vol)</div><div>[2015-07-06 13:50:21.963651] E [glfs-mgmt.c:520:mgmt_getspec_cbk] 0-gfapi: failed to get the 'volume file' from server</div><div>[2015-07-06 13:50:21.963710] E [glfs-mgmt.c:599:mgmt_getspec_cbk] 0-glfs-mgmt: failed to fetch volume file (key:my_filestore_vol)</div><div><br></div><div>Has anyone experienced similar?</div></font></div><br><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><span name="x"></span><font face="arial, helvetica, sans-serif" size="2">ALUN JAMES<br><font>Senior Systems Engineer</font><br><font>Tibus</font><br><br><font>T: +44 (0)28 9033 1122</font><br><font>E: ajames@tibus.com</font><br><font>W: </font><a href="http://www.tibus.com">www.tibus.com</a><br><br><font>Follow us on Twitter </font><a href="http://twitter.com/intent/user?screen_name=tibus">@tibus</a><br><br><font>Tibus is a trading name of The Internet Business Ltd, a company limited by share capital and registered in Northern Ireland, NI31235. It is part of UTV Media Plc.</font><br><br><font>This email and any attachment may contain confidential information for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorised to receive for the recipient), please contact the sender by reply email and delete all copies of this message. </font></font><span name="x"></span><br></div></div></div></body></html>