<html><head><meta content="text/html; charset=windows-1252" http-equiv="Content-Type" /></head><body bgcolor="#FFFFFF" text="#000000">I last used GlusterFS around early 3.6. I could get great results for streaming large files. I was seeing up to 700MB/s with a DD test. Small file/metadata access wasn't right for our use, but for VMs it should be fine with a bit of tuning.<br><br><div class="gmail_quote">On 31 October 2016 15:33:06 GMT+00:00, Joe Julian <joe@julianfamily.org> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
On 10/31/2016 08:29 AM, Alastair Neil wrote:<br />
<blockquote cite="mid:CA+SarwpdguRGL9xkemvhBVOtN199_QybmfGVsCNqEeAz2aUgqA@mail.gmail.com" type="cite">
<div dir="ltr">
<div>What version of Gluster? Are you using glusterfs or nfs
mount? Any other traffic on the network, is the cluster
quiescent apart from your dd test?<br />
<br />
</div>
</div>
</blockquote>
<br />
What type of volume?<br />
<br />
<blockquote cite="mid:CA+SarwpdguRGL9xkemvhBVOtN199_QybmfGVsCNqEeAz2aUgqA@mail.gmail.com" type="cite">
<div dir="ltr">
<div>It does seem slow. I have a three server cluster, using
straight xfs over 10G with Gluster 3.8 and glusterfs mounts
and I see:<br />
<br />
[root@sb-c 192.168.10.49:VM]# sync; dd if=/dev/zero of=nfsp2
bs=1M count=1024; sync<br />
1024+0 records in<br />
1024+0 records out<br />
1073741824 bytes (1.1 GB) copied, 11.3322 s, 94.8 MB/s<br />
[root@sb-c 192.168.10.49:VM]# sync; dd if=/dev/zero of=nfsp2
bs=1M count=10240; sync<br />
10240+0 records in<br />
10240+0 records out<br />
10737418240 bytes (11 GB) copied, 117.854 s, 91.1 MB/s<br />
<br />
</div>
this is on a cluster serving 5 ovirt nodes and about 60 running
VMs.<br />
<br />
<div><br />
</div>
</div>
<div class="gmail_extra"><br />
<div class="gmail_quote">On 25 October 2016 at 12:50, Service
Mail <span dir="ltr"><<a moz-do-not-send="true" href="mailto:ciclopeblu@gmail.com" target="_blank">ciclopeblu@gmail.com</a>></span>
wrote:<br />
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hello,
<div><br />
</div>
<div>I have the following setup:</div>
<div><br />
</div>
<div>3x zfs raidz2 servers with a single gluster 3.8
replicated volume across a 10G network</div>
<div><br />
</div>
<div>Everything is working fine however performance looks
very poor to me:</div>
<div><br />
</div>
<div>
<div><br />
</div>
<div>root@Client:/test_mount# sync; dd if=/dev/zero
of=nfsp2 bs=1M count=1024; sync</div>
<div>1024+0 records in</div>
<div>1024+0 records out</div>
<div>1073741824 bytes (1.1 GB, 1.0 GiB) copied, 32.1786
s, 33.4 MB/s</div>
<div><br />
</div>
<div>root@Client:/test_mount# sync; dd if=/dev/zero
of=nfsp2 bs=1M count=10240; sync</div>
<div>10240+0 records in</div>
<div>10240+0 records out</div>
<div>10737418240 bytes (11 GB, 10 GiB) copied, 301.563
s, 35.6 MB/s</div>
<div><br />
</div>
</div>
<div>Are those reading normal? Where should I look to
increase performance?</div>
<div><br />
</div>
<div>Thanks,</div>
<div><br />
</div>
<div>Ciclope</div>
<div><br />
</div>
<div><br />
</div>
<div><br />
</div>
</div>
<br />
______________________________<wbr />_________________<br />
Gluster-users mailing list<br />
<a moz-do-not-send="true" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br />
<a moz-do-not-send="true" href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/<wbr />mailman/listinfo/gluster-users</a><br />
</blockquote>
</div>
<br />
</div>
<br />
<fieldset class="mimeAttachmentHeader"></fieldset>
<br />
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br />
<p style="margin-top: 2.5em; margin-bottom: 1em; border-bottom: 1px solid #000"></p><pre class="k9mail"><hr /><br />Gluster-users mailing list<br />Gluster-users@gluster.org<br /><a href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre></blockquote></div><br>
-- <br>
Sent from my Android device with K-9 Mail. Please excuse my brevity.
<br><pre>
--
This message is intended only for the addressee and may contain
confidential information. Unless you are that person, you may not
disclose its contents or use it in any way and are requested to delete
the message along with any attachments and notify us immediately.
This email is not intended to, nor should it be taken to, constitute advice.
The information provided is correct to our knowledge & belief and must not
be used as a substitute for obtaining tax, regulatory, investment, legal or
any other appropriate advice.
"Transact" is operated by Integrated Financial Arrangements Ltd.
29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 5300.
(Registered office: as above; Registered in England and Wales under
number: 3727592). Authorised and regulated by the Financial Conduct
Authority (entered on the Financial Services Register; no. 190856).
</pre><br>
</body></html>