<html><head></head><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:10px"><div id="yui_3_16_0_ym19_1_1470233984459_6609"><span id="yui_3_16_0_ym19_1_1470233984459_6608">your 10G nic is capable, the problem is the disk speed, fix ur disk speed first, use ssd or sshd or sas 15k in a raid 0 or raid 5/6 x4 at least.</span></div> <div class="qtdSeparateBR"><br><br></div><div class="yahoo_quoted" style="display: block;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 10px;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div dir="ltr"><font size="2" face="Arial"> On Wednesday, August 3, 2016 2:40 AM, Kaamesh Kamalaaharan <kaamesh@novocraft.com> wrote:<br></font></div> <br><br> <div class="y_msg_container"><div id="yiv9484362480"><div dir="ltr">Hi , <div>I have gluster 3.6.2 installed on my server network. Due to internal issues we are not allowed to upgrade the gluster version. All the clients are on the same version of gluster. When transferring files to/from the clients or between my nodes over the 10gb network, the transfer rate is capped at 450Mb/s .Is there any way to increase the transfer speeds for gluster mounts? </div><div><br></div><div>Our server setup is as following:</div><div><br></div><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px;"><div>2 gluster servers -gfs1 and gfs2</div><div> volume name : gfsvolume</div><div>3 clients - hpc1, hpc2,hpc3</div><div>gluster volume mounted on /export/gfsmount/</div></blockquote><div><br></div><div><br></div><div><br></div><div>The following is the average results what i did so far:</div><div><br></div><div>1) test bandwith with iperf between all machines - 9.4 GiB/s</div><div>2) test write speed with dd <br></div><div><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px;"><div>dd if=/dev/zero of=/export/gfsmount/testfile bs=1G count=1</div><div><br></div></blockquote><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px;"><div>result=399Mb/s</div></blockquote><div><br></div>3) test read speed with dd</div><div><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px;"><div>dd if=/export/gfsmount/testfile of=/dev/zero bs=1G count=1</div></blockquote><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px;"><div><br></div></blockquote><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px;">result=284MB/s<br></blockquote><br></div><div>My gluster volume configuration:</div><div> </div><blockquote style="margin:0 0 0 40px;border:none;padding:0px;"><div><pre style="color:rgb(0,0,0);">Volume Name: gfsvolume</pre></div><div><pre style="color:rgb(0,0,0);">Type: Replicate</pre></div><div><pre style="color:rgb(0,0,0);">Volume ID: a29bd2fb-b1ef-4481-be10-c2f4faf4059b</pre></div><div><pre style="color:rgb(0,0,0);">Status: Started</pre></div><div><pre style="color:rgb(0,0,0);">Number of Bricks: 1 x 2 = 2</pre></div><div><pre style="color:rgb(0,0,0);">Transport-type: tcp</pre></div><div><pre style="color:rgb(0,0,0);">Bricks:</pre></div><div><pre style="color:rgb(0,0,0);">Brick1: gfs1:/export/sda/brick</pre></div><div><pre style="color:rgb(0,0,0);">Brick2: gfs2:/export/sda/brick</pre></div><div><pre style="color:rgb(0,0,0);">Options Reconfigured:</pre></div><div><pre style="color:rgb(0,0,0);">performance.quick-read: off</pre></div><div><pre style="color:rgb(0,0,0);">network.ping-timeout: 30</pre></div><div><pre style="color:rgb(0,0,0);">network.frame-timeout: 90</pre></div><div><pre style="color:rgb(0,0,0);">performance.cache-max-file-size: 2MB</pre></div><div><pre style="color:rgb(0,0,0);">cluster.server-quorum-type: none</pre></div><div><pre style="color:rgb(0,0,0);">nfs.addr-namelookup: off</pre></div><div><pre style="color:rgb(0,0,0);">nfs.trusted-write: off</pre></div><div><pre style="color:rgb(0,0,0);">performance.write-behind-window-size: 4MB</pre></div><div><pre style="color:rgb(0,0,0);">cluster.data-self-heal-algorithm: diff</pre></div><div><pre style="color:rgb(0,0,0);">performance.cache-refresh-timeout: 60</pre></div><div><pre style="color:rgb(0,0,0);">performance.cache-size: 1GB</pre></div><div><pre style="color:rgb(0,0,0);">cluster.quorum-type: fixed</pre></div><div><pre style="color:rgb(0,0,0);">auth.allow: 172.*</pre></div><div><pre style="color:rgb(0,0,0);">cluster.quorum-count: 1</pre></div><div><pre style="color:rgb(0,0,0);">diagnostics.latency-measurement: on</pre></div><div><pre style="color:rgb(0,0,0);">diagnostics.count-fop-hits: on</pre></div><div><pre style="color:rgb(0,0,0);">cluster.server-quorum-ratio: 50%</pre></div></blockquote><div><pre style="color:rgb(0,0,0);"><br></pre><pre style="color:rgb(0,0,0);">Any help would be appreciated. </pre><pre style="color:rgb(0,0,0);">Thanks,</pre><pre style="color:rgb(0,0,0);">Kaamesh</pre><pre style="color:rgb(0,0,0);"><br></pre></div></div></div><br>_______________________________________________<br>Gluster-users mailing list<br><a ymailto="mailto:Gluster-users@gluster.org" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br><a href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br><br></div> </div> </div> </div></div></body></html>