<div dir="ltr"><div>Could you please attach the glusterfs client and brick logs?<br></div><div>Also provide output of `gluster volume info`.<br></div><div><br></div>-Krutika<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 6, 2016 at 4:29 AM, Kevin Lemonnier <span dir="ltr"><<a href="mailto:lemonnierk@ulrar.net" target="_blank">lemonnierk@ulrar.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">> - What was the original (and current) geometry? (status and info)<br>
<br>
</span>It was a 1x3 that I was trying to bump to 2x3.<br>
<span class=""><br>
> - what parameters did you use when adding the bricks?<br>
><br>
<br>
</span>Just a simple add-brick node1:/path node2:/path node3:/path<br>
Then a fix-layout when everything started going wrong.<br>
<br>
<br>
I was able to salvage some VMs by stopping them then starting them again,<br>
but most won't start for various reasons (disk corrupted, grub not found ...).<br>
For those we are deleting the disks then importing them from backups, that's<br>
a huge loss but everything has been down for so long, no choice ..<br>
<div class="HOEnZb"><div class="h5"><br>
> On 6/09/2016 8:00 AM, Kevin Lemonnier wrote:<br>
><br>
> I tried a fix-layout, and since that didn't work I removed the brick (start then commit when it showed<br>
> completed). Not better, the volume is now running on the 3 original bricks (replica 3) but the VMs<br>
> are still corrupted. I have 880 Mb of shards on the bricks I removed for some reason, thos shards do exist<br>
> (and are bigger) on the "live" volume. I don't understand why now that I have removed the new bricks<br>
> everything isn't working like before ..<br>
><br>
> On Mon, Sep 05, 2016 at 11:06:16PM +0200, Kevin Lemonnier wrote:<br>
><br>
> Hi,<br>
><br>
> I just added 3 bricks to a volume and all the VMs are doing I/O errors now.<br>
> I rebooted a VM to see and it can't start again, am I missing something ? Is the reblance required<br>
> to make everything run ?<br>
><br>
> That's urgent, thanks.<br>
><br>
> --<br>
> Kevin Lemonnier<br>
> PGP Fingerprint : 89A5 2283 04A0 E6E9 0111<br>
><br>
><br>
><br>
><br>
> ______________________________<wbr>_________________<br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> <a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
><br>
><br>
><br>
> ______________________________<wbr>_________________<br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> <a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
><br>
> --<br>
> Lindsay Mathieson<br>
<br>
> ______________________________<wbr>_________________<br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> <a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
<br>
<br>
--<br>
Kevin Lemonnier<br>
PGP Fingerprint : 89A5 2283 04A0 E6E9 0111<br>
</div></div><br>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br></blockquote></div><br></div>