<div dir="ltr">But I've got some questions about options<div><br></div><div>are these options are normal for only 2 nodes in replica?</div><div><br></div><div><span style="font-size:12.8000001907349px">cluster.server-quorum-type.</span><span style="font-size:12.8000001907349px">server</span></div><div><span style="font-size:12.8000001907349px">cluster.quorum-type</span></div><div><span style="font-size:12.8000001907349px">according to description seems like useless if not running at least 3 nodes? and won't it even harm my installation in the future?</span><br></div><div><span style="font-size:12.8000001907349px"><br></span></div><div><span style="font-size:12.8000001907349px">network.remote-dio I did not understand from description, what actually this one does and how it could be useful for qemu?</span><br></div><div><span style="font-size:12.8000001907349px"><br></span></div><div><span style="font-size:12.8000001907349px">And general question about remaining performance options.. they all set some kind of caching off.. Does it affects performance in some way?</span></div><div><span style="font-size:12.8000001907349px"><br></span></div><div><span style="font-size:12.8000001907349px"><br></span></div><div><span style="font-size:12.8000001907349px"><br></span></div><div><span style="font-size:12.8000001907349px"><br></span></div></div><div class="gmail_extra"><br><div class="gmail_quote">2015-07-18 7:03 GMT+03:00 Roman <span dir="ltr"><<a href="mailto:romeo.r@gmail.com" target="_blank">romeo.r@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>Niels, its turned out that I had one of the options you told me to set already on (performance.read-ahead: off). After I added the second one (performance.write-behind: off) it seem like this problem does not exists any more. At least I installed twice D8 with with Mate. I will do more tests to be certain about that. As for now, can we speak, that recommended options for qemu VM storage are:</div><div><br></div><div><div>server.allow-insecure: on<br></div><div>cluster.server-quorum-type: server</div><div>cluster.quorum-type: auto</div><div>network.remote-dio: enable</div><div>cluster.eager-lock: enable</div><div>performance.stat-prefetch: off</div><div>performance.io-cache: off</div><div>performance.read-ahead: off</div><div>performance.quick-read: off</div></div><div>performance.write-behind: off<br></div><div><br></div><div>How bad this affects volume performance (if it does, of course) ?</div><div><br></div></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">2015-07-14 13:38 GMT+03:00 Roman <span dir="ltr"><<a href="mailto:romeo.r@gmail.com" target="_blank">romeo.r@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">here is one of the errors example. its like files that debian installer copies to the virtual disk that is located on glusterfs storage are getting corrupted.<br><div>in-target is /dev/vda1</div><div><br></div></div><div class="gmail_extra"><div><div><br><div class="gmail_quote">2015-07-14 11:49 GMT+03:00 Roman <span dir="ltr"><<a href="mailto:romeo.r@gmail.com" target="_blank">romeo.r@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Ubuntu 14.04 LTS base install and then mate install was fine!</div><div><br></div>Forgot to add, that debian8 installs OK on local disks. </div><div class="gmail_extra"><div><div><br><div class="gmail_quote">2015-07-14 9:30 GMT+03:00 Roman <span dir="ltr"><<a href="mailto:romeo.r@gmail.com" target="_blank">romeo.r@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>I've reported a lot on gluster-users list, but seems, like noone is excited because of this bug. I think devs should try this out in their lab.</div><div><br></div><div>In short:</div><div><br></div><div>Running latest proxmox VE with these versions:</div><div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Linux services 2.6.32-37-pve<br></div><div style="font-size:12.8000001907349px">QEMU emulator version 2.2.1<br></div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Running 2 gluster servers with Replica and Distributed volumes, both server and client side of gluster are updated to <span style="font-size:12.8000001907349px">glusterfs 3.6.4 yesterday. Before that was 3.5.4 with same behavior. </span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">Problem:</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">I'm not able to install Debian 8 on gluster volumes. It just randomly aborts installation on random step:</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">If we talk about base system, it aborts on mirror selecting step (just keeps saying, there is networking problems and unable to connect to any mirror (while i do can ping them all from console). Or it aborts (if got downloaded packages) on installation steps complaining about not solved depndecies due to unsuccessfull install one of them (the most often is python-gtk2 pkg, when I install with Mate)</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">Once I was lucky enough to insall the base system, but after reboot it was not usable, i wasn't able to run even apache, it always said there are no modules, while they were on their place. So i think they were corrupted.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">And such behavior is only with debian8, debian7 installs and runs perfectly, same as centos6 on all of my 4 proxmox nodes.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">I did md5sum of the installation iso, it is ok.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">I'll try today Latest Centos and Ubuntu just to check.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">But please, test the same in your lab or tell me what should i check for to help you to trace the bug.. There are no bad logs in gluster log files also.</span></div><span><font color="#888888"><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div><br></div><div><br></div>-- <br><div>Best regards,<br>Roman.</div>
</font></span></div></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span><font color="#888888">-- <br><div>Best regards,<br>Roman.</div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span><font color="#888888">-- <br><div>Best regards,<br>Roman.</div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br><div>Best regards,<br>Roman.</div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature">Best regards,<br>Roman.</div>
</div>