<div dir="ltr">Hi,<div><br></div><div> While you removing a failed brick from four existing cluster volume try to provide the correct replica number <b>'n-1' </b>while removing a brick from 'n' number of bricks from a gluster volume.</div><div><br></div><div>so here you are trying to remove one brick from a volume that contain 2 number of bricks in total, so do like this</div><div><br></div><div><span style="font-size:12.8px">gluster volume remove-brick datastore1 replica <b>1</b> vnb.proxmox.softlog:/</span><span style="font-size:12.8px">glusterdata/datastore1c force.</span><br></div><div><span style="font-size:12.8px"><br></span></div><div>Follow the same strategy while adding a brick to an existing cluster volume. provide replica number as 'n+1'</div><div><br></div><div>and if you are using a cloned VM that already contains gluster packages installed on it and have some gluster volume/peer/brick information on it, then reset those values( including extended attributes ) and then only add that new node/brick to your existing cluster.</div><div><br></div><div>and if you are replacing a failed node with a new one that having the same IP, then after probing the peer you have to set the volume attributes on it and restart the gluster-server service, then everything will be fine. If you have anymore doubt in that feel free to contact.</div><div><br></div><div>regards,</div><div>sreejith K B,</div><div><a href="mailto:sree15081947@gmail.com">sree15081947@gmail.com</a></div><div>mob:09895315396</div><div><br></div><div><br></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px"><br></span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On 7 October 2015 at 12:36, Lindsay Mathieson <span dir="ltr"><<a href="mailto:lindsay.mathieson@gmail.com" target="_blank">lindsay.mathieson@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div><div><div><div><div><div><div>First up - one of the things that concerns me re gluster is the incoherent state of documentation. The only docs linked on the main webpage are for 3.2 and there is almost nothing on how to handle failure modes such as dead disks/bricks etc, which is one of glusters primary functions.<br><br></div>My problem - I have a replica 2 volume, 2 nodes, 2 bricks (zfs datasets).<br><br></div>As a test, I destroyed one brick (zfs destroy the dataset).<br><br><br></div>Can't start the datastore1:<br><br> volume start: datastore1: failed: Failed to find brick directory /glusterdata/datastore1 for volume datastore1. Reason : No such file or directory<br><br></div>A bit disturbing, I was hoping it would work off the remaining brick.<br><br></div>Can't replace the brick:<br><br> gluster volume replace-brick datastore1 vnb.proxmox.softlog:/glusterdata/datastore1 vnb.proxmox.softlog:/glusterdata/datastore1-2 commit force<br><br></div>because the store is not running.<br><br></div><div>After a lot of googling I found list messages referencing the remove brick command:<br></div>gluster volume remove-brick datastore1 replica 2 vnb.proxmox.softlog:/glusterdata/datastore1c commit force<br><br></div>Fails with the unhelpful error:<br><br>wrong brick type: commit, use <HOSTNAME>:<export-dir-abs-path><br>Usage: volume remove-brick <VOLNAME> [replica <COUNT>] <BRICK> ... <start|stop|status|commit|force><br><br></div>In the end I destroyed and recreated the volume so I could resume testing, but I have no idea how I would handle a real failed brick in the future<span class="HOEnZb"><font color="#888888"><br clear="all"><div><div><div><div><div><div><div><div><div><div><br>-- <br><div>Lindsay</div>
</div></div></div></div></div></div></div></div></div></div></font></span></div>
<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr">........................................................................................<br>Regards,<br>Sreejith k b<br>Mob: 09895315396<br></div></div>
</div>