<div dir="ltr">I believe if this is replica 3 then you would expect 40 MB/s, as the client has to write to 3 bricks. You only mentioned 2 servers so I assume this is at most replica 2, so 60 MB/s would be what I would expect. This is still 1.5-3x the numbers you are reporting though. </div><div class="gmail_extra"><br><div class="gmail_quote">On 16 October 2015 at 16:43, Kandalf ® <span dir="ltr"><<a href="mailto:tinuro@yahoo.com" target="_blank">tinuro@yahoo.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"><div dir="ltr">I also tried more gluster version but the same situation.If I use iscsi for example to export a raw image... I have 120MB/s write speed.<br></div><div><div class="h5"><div><span></span></div> <br><div><br><br></div><div style="display:block"> <div style="font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"> <div style="font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"> <div dir="ltr"> <font face="Arial" size="2"> On Friday, October 16, 2015 11:42 PM, Kandalf ® <<a href="mailto:tinuro@yahoo.com" target="_blank">tinuro@yahoo.com</a>> wrote:<br> </font> </div> <br><br> <div><div><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"><div dir="ltr">If I write with DD in linux locally to the same cluster node... or via network I have 120MB/s. the full speed of te 1 Gbps.</div><div dir="ltr">But if I write to an RAW Image File... like vmdk in vmware... I have average of 20-40MB/s only.<br clear="none"></div><div><span></span></div> <br clear="none"><div><br clear="none"><br clear="none"></div><div><div style="display:block"> <div style="font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"> <div style="font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"> <div dir="ltr"> <font face="Arial" size="2"> On Friday, October 16, 2015 11:31 PM, Alastair Neil <<a href="mailto:ajneil.tech@gmail.com" target="_blank">ajneil.tech@gmail.com</a>> wrote:<br clear="none"> </font> </div> <br clear="none"><br clear="none"> <div><div><div><div dir="ltr">I'm getting confused, 120 mb/s is less that 20 MB/s unless you mean 120MB/s?</div><div><div><br clear="none"><div>On 16 October 2015 at 16:26, Kandalf ® <span dir="ltr"><<a rel="nofollow" shape="rect" href="mailto:tinuro@yahoo.com" target="_blank">tinuro@yahoo.com</a>></span> wrote:<br clear="none"><blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"><div dir="ltr">No, is real speed. From any computer linux or esxi if I write via NFS with dd utility I have this speed. But if I try to write to one raw file like esxi does in vmdk, than the speed drops to 20-40mb/s. So my issue is low speed when I write into raw image file (using losetup and DD on linux , or esxi vmdk - vm guest)<br clear="none"></div><div><div><div><span></span></div> <br clear="none"><div><br clear="none"><br clear="none"></div><div style="display:block"> <div style="font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"> <div style="font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"> <div dir="ltr"> <font face="Arial" size="2"> On Friday, October 16, 2015 8:31 PM, Alastair Neil <<a rel="nofollow" shape="rect" href="mailto:ajneil.tech@gmail.com" target="_blank">ajneil.tech@gmail.com</a>> wrote:<br clear="none"> </font> </div> <br clear="none"><br clear="none"> <div><div><div><div dir="ltr">is that a typo 120mb/s? Is this volume replica 2 or distributed or both?<div><br clear="none"></div></div><div><br clear="none"><div>On 16 October 2015 at 08:05, Kandalf ® <span dir="ltr"><<a rel="nofollow" shape="rect" href="mailto:tinuro@yahoo.com" target="_blank">tinuro@yahoo.com</a>></span> wrote:<br clear="none"><blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif;font-size:16px"><div>Hi,</div><div><br clear="none"></div><div dir="ltr">I have 2 server with centos 7 and I want to make a replicate storage cluster for the esxi.</div><div dir="ltr">In both server I have 4 disk in raid 5 mdadm. The write speed on that device is ~250-300MB/s all the time.</div><div dir="ltr">I create xfs file system on the mdadm and I exported that gluster volume via native fuse nfs v3 to the esxi.</div><div dir="ltr">Read seed is great but when I try to write to the guest vms I see 20-40MB/s only. I try the test also with gluster distributed with only one brick to one server. If I take one dd write from esxi to the cluster I receive 120mb/s the full ethernet link speed. I also try to mount to linux that volumes and try dd write and the write speed is 120mb/s.</div><div dir="ltr">But if I try to mount an raw file image with losetup, or use vmdk files, and if I write to them, the speed is 20-40MB/s and I see 12 load on linux.</div><div dir="ltr">Can someone help me?</div><div dir="ltr"><br clear="none"></div><div dir="ltr">Thanks!<br clear="none"></div><div dir="ltr"><br clear="none"></div><div><br clear="none"></div></div></div></div><br clear="none">_______________________________________________<br clear="none">
Gluster-users mailing list<br clear="none">
<a rel="nofollow" shape="rect" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br clear="none">
<a rel="nofollow" shape="rect" href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br clear="none"></blockquote></div><br clear="none"></div></div></div><br clear="none"><br clear="none"></div> </div> </div> </div></div></div></div></div></blockquote></div><br clear="none"></div></div></div></div><br clear="none"><br clear="none"></div> </div> </div> </div></div></div></div></div><br><br></div> </div> </div> </div></div></div></div></div></blockquote></div><br></div>