<html><body><div style="font-family: garamond,new york,times,serif; font-size: 12pt; color: #000000"><div>Sorry, that was a typo. :( It is supposed to be moved into /var/lib/glusterd/groups/virt.<br></div><div>I am suspecting stat-prefetch to be the culprit.<br></div><div>So to start with, just disable performance.stat-prefetch and leave the rest of the options as they were before and run the test case.<br></div><div><br></div><div>Thank you very much for your help. :)<br></div><div><br></div><div>-Krutika<br></div><hr id="zwchr"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"Lindsay Mathieson" <lindsay.mathieson@gmail.com><br><b>To: </b>"Krutika Dhananjay" <kdhananj@redhat.com><br><b>Cc: </b>"gluster-users" <gluster-users@gluster.org><br><b>Sent: </b>Saturday, November 14, 2015 4:56:39 PM<br><b>Subject: </b>Re: [Gluster-users] File Corruption with shards - 100% reproducable<br><div><br></div><div dir="ltr"><div class="gmail_extra"><br><div class="gmail_quote">On 14 November 2015 at 17:30, Krutika Dhananjay <span dir="ltr"><<a href="mailto:kdhananj@redhat.com" target="_blank" data-mce-href="mailto:kdhananj@redhat.com">kdhananj@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" data-mce-style="margin: 0px 0px 0px 0.8ex; border-left: 1px solid #cccccc; padding-left: 1ex;"><div>You should be able to find a file named group-virt.example under /etc/glusterfs/<br></div><div>Copy that as /var/lib/glusterd/virt.<br></div><div><br></div></blockquote></div><br><div><br></div><br></div><div class="gmail_extra">Doesn't seem to exist in the debian jessie apt repo, but I copied it from here:<br><div><br></div> <a href="https://raw.githubusercontent.com/gluster/glusterfs/master/extras/group-virt.example" target="_blank" data-mce-href="https://raw.githubusercontent.com/gluster/glusterfs/master/extras/group-virt.example">https://raw.githubusercontent.com/gluster/glusterfs/master/extras/group-virt.example</a><br><div><br></div></div><div class="gmail_extra">And I think it needed to go here:<br><div><br></div> /var/lib/glusterd/virt/group<br><div><br></div></div><div class="gmail_extra">However the good news is, I applied it and seems to have made the difference. Freely migrating my test VM now with no corruption. Will stress test it a bit more.<br><div><br></div></div><div class="gmail_extra">current settings are now:<br><span style="font-family:monospace,monospace" data-mce-style="font-family: monospace,monospace;"><span style="font-family:monospace,monospace" data-mce-style="font-family: monospace,monospace;">gluster volume info<br></span></span><div><br></div><span style="font-family:monospace,monospace" data-mce-style="font-family: monospace,monospace;">Volume Name: datastore1<br>Type: Replicate<br>Volume ID: 238fddd0-a88c-4edb-8ac5-ef87c58682bf<br>Status: Started<br>Number of Bricks: 1 x 3 = 3<br>Transport-type: tcp<br>Bricks:<br>Brick1: vnb.proxmox.softlog:/mnt/ext4<br>Brick2: vng.proxmox.softlog:/mnt/ext4<br>Brick3: vna.proxmox.softlog:/mnt/ext4<br>Options Reconfigured:<br>cluster.server-quorum-type: server<br>network.remote-dio: enable<br>cluster.eager-lock: enable<br>performance.stat-prefetch: off<br>performance.io-cache: off<br>performance.read-ahead: off<br>performance.quick-read: off<br>cluster.quorum-type: auto<br>performance.readdir-ahead: off<br>features.shard: on<br>features.shard-block-size: 128MB<br>performance.strict-write-ordering: on<br></span><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">Thanks for all the help. If you like I can start unsetting setting until we discover which one does the trick.<br clear="all"></div><div class="gmail_extra"><br>-- <br><div class="gmail_signature">Lindsay</div></div></div></blockquote><div><br></div></div></body></html>