<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jun 10, 2016 at 1:25 AM, Phil Dumont <span dir="ltr"><<a href="mailto:phil@solidstatescientific.com" target="_blank">phil@solidstatescientific.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div>Just started trying gluster, to decide if we want to put it into production.</div><div><br></div>Running version 3.7.11-1<div><br></div><div>Replicated, distributed volume, two servers, 20 bricks per server:</div><div><br></div><div><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div><div><font face="monospace, monospace">[root@storinator1 ~]# gluster volume status gv0</font></div><div><font face="monospace, monospace">Status of volume: gv0</font></div><div><font face="monospace, monospace">Gluster process TCP Port RDMA Port Online Pid</font></div><div><font face="monospace, monospace">------------------------------------------------------------------------------</font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick1/gv0 49153 0 Y 2554 </font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick1/gv0 49153 0 Y 9686 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick2/gv0 49154 0 Y 2562 </font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick2/gv0 49154 0 Y 9708 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick3/gv0 49155 0 Y 2568 </font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick3/gv0 49155 0 Y 9692 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick4/gv0 49156 0 Y 2574 </font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick4/gv0 49156 0 Y 9765 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick5/gv0 49173 0 Y 16901</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick5/gv0 49173 0 Y 9727 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick6/gv0 49174 0 Y 16920</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick6/gv0 49174 0 Y 9733 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick7/gv0 49175 0 Y 16939</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick7/gv0 49175 0 Y 9739 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick8/gv0 49176 0 Y 16958</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick8/gv0 49176 0 Y 9703 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick9/gv0 49177 0 Y 16977</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick9/gv0 49177 0 Y 9713 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick10/gv0 49178 0 Y 16996</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick10/gv0 49178 0 Y 9718 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick11/gv0 49179 0 Y 17015</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick11/gv0 49179 0 Y 9746 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick12/gv0 49180 0 Y 17034</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick12/gv0 49180 0 Y 9792 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick13/gv0 49181 0 Y 17053</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick13/gv0 49181 0 Y 9755 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick14/gv0 49182 0 Y 17072</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick14/gv0 49182 0 Y 9767 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick15/gv0 49183 0 Y 17091</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick15/gv0 N/A N/A N N/A </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick16/gv0 49184 0 Y 17110</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick16/gv0 49184 0 Y 9791 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick17/gv0 49185 0 Y 17129</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick17/gv0 49185 0 Y 9756 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick18/gv0 49186 0 Y 17148</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick18/gv0 49186 0 Y 9766 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick19/gv0 49187 0 Y 17167</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick19/gv0 49187 0 Y 9745 </font></div><div><font face="monospace, monospace">Brick storinator1:/export/brick20/gv0 49188 0 Y 17186</font></div><div><font face="monospace, monospace">Brick storinator2:/export/brick20/gv0 49188 0 Y 9783 </font></div><div><font face="monospace, monospace">NFS Server on localhost 2049 0 Y 17206</font></div><div><font face="monospace, monospace">Self-heal Daemon on localhost N/A N/A Y 17214</font></div><div><font face="monospace, monospace">NFS Server on storinator2 2049 0 Y 9657 </font></div><div><font face="monospace, monospace">Self-heal Daemon on storinator2 N/A N/A Y 9677 </font></div><div><font face="monospace, monospace"> </font></div><div><font face="monospace, monospace">Task Status of Volume gv0</font></div><div><font face="monospace, monospace">------------------------------------------------------------------------------</font></div><div><font face="monospace, monospace">Task : Rebalance </font></div><div><font face="monospace, monospace">ID : 28c733e9-d618-44fc-873f-405d3b29a609</font></div><div><font face="monospace, monospace">Status : completed </font></div><div><font face="monospace, monospace"> </font></div></div></blockquote>Wouldn't you know it, within a week or two of pulling the hardware together and getting gluster installed and configured, a disk dies. Note the dead process for brick15 on server storinator2.</div><div><br></div><div>I would like to remove (not replace) the failed brick (and its replica). (I don't have a spare disk handy, and there's plenty of room on the other bricks.) But gluster doesn't seem to want to remove a brick if the brick is dead:</div><div><br></div><div><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div><div><font face="monospace, monospace">[root@storinator1 ~]# gluster volume remove-brick gv0 storinator{1..2}:/export/brick15/gv0 start</font></div><div><font face="monospace, monospace">volume remove-brick start: failed: Staging failed on storinator2. Error: Found stopped brick storinator2:/export/brick15/gv0</font></div></div></blockquote><div><br></div>So what do I do? I can't remove the brick while the brick is bad, but I want to remove the brick *because* the brick is bad. Bit of a Catch-22.</div></div></blockquote><div><br></div><div><br></div><div>Hi Phil,</div><div><br></div><div>This looks like a bug - please open a new BZ for this issue. </div><div><br></div><div><br></div><div>You can remove these bricks using </div><div> gluster v remove-brick <vol> <bricks> force<br></div><div><br></div><div>However, that will not copy the data from the bricks that have been removed. You will need to copy the files manually from the brick to the gluster volume mount point.</div><div><br></div><div>Thanks,</div><div>Nithya</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div><br></div><div>Thanks in advance for any help you can give.</div><span class=""><font color="#888888"><div><br></div><div>phil</div><div><br></div><div><br></div></font></span></div>
<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div></div>