<div dir="ltr"><div><div><div><div>Hello,<br>I doesn't use version 3.7 in production.<br><br></div>I think need try new options (I don't know how it improve work with big files but it should improve work with small files):<br>gluster v set prodcmsroot client.event-threads 4<br>gluster v set prodcmsroot server.event-threads 4<br>gluster v set prodcmsroot cluster.lookup-optimize on<br></div><div>Моre info about this:<br><a href="https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Administration_Guide/Small_File_Performance_Enhancements.html">https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Administration_Guide/Small_File_Performance_Enhancements.html</a><br></div><div><br></div>And may be increase number of threads in IO threads translator:<br>gluster v set prodcmsroot performance.io-thread-count 48<br><br></div>I recommend try this on test environment.<br></div><br><br><br><br></div><div class="gmail_extra"><br><div class="gmail_quote">2015-12-10 17:29 GMT+03:00 Srikanth Mampilakal <span dir="ltr"><<a href="mailto:shrikanth1980@gmail.com" target="_blank">shrikanth1980@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr">Hi members,</p>
<p dir="ltr">Really appreciate if you can share your thoughts or any feedback for resolving the slow copy issue</p>
<p dir="ltr">Regards<br>
Srikanth</p>
<div class="gmail_quote"><div><div class="h5">On 10-Dec-2015 2:12 AM, "Srikanth Mampilakal" <<a href="mailto:srikanth.mampilakal@gmail.com" target="_blank">srikanth.mampilakal@gmail.com</a>> wrote:<br type="attribution"></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5"><div dir="ltr"><div>Hi,</div><div><br></div><div><br></div><div>I have production gluster file service used as a shared storage where the content management system uses it as document root. I have run in to a performance issue with the gluster/fuse client.</div><div><br></div><div>Looking for your thoughts and experience in resolving Gluster performance issues:</div><div><br></div><div>Gluster Infrastructure</div><div><br></div><div>Gluster version :GlusterFS 3.7.6</div><div><br></div><div>2 gluster nodes of the same config below</div><div><br></div><div>Redhat EL7.0-64</div><div>Memory : 4GB</div><div>Processor : 2 x 2.0 Ghz</div><div>Network : 100 Mbps</div><div>File Storage Volume : NETAPP Storage LUN with 2.0 IOPS/GB</div><div><br></div><div>Gluster Volume information:</div><div><br></div><div>[root@GlusterFileServe1 ~]# gluster volume info</div><div><br></div><div>Volume Name: prodcmsroot</div><div>Type: Replicate</div><div>Volume ID: f1284bf0-1939-46f9-a672-a7716e362947</div><div>Status: Started</div><div>Number of Bricks: 1 x 2 = 2</div><div>Transport-type: tcp</div><div>Bricks:</div><div>Brick1: Server1:/glusterfs/brick1/prodcmsroot</div><div>Brick2: Server2:/glusterfs/brick1/prodcmsroot</div><div>Options Reconfigured:</div><div>performance.io-thread-count: 64</div><div>performance.cache-size: 1073741824</div><div>performance.readdir-ahead: on</div><div>performance.write-behind-window-size: 524288</div><div><br></div><div>[root@GlusterFileServe1 ~]#</div><div><br></div><div>The replication between Gluster node are quick and consistent. </div><div><br></div><div>The apache webservers are accessing the Gluster volume using native gluster fuse client and located in the same VLAN as the Gluster Server.</div><div><br></div><div>GlusterFileServe1:/prodcmsroot /mnt/glusterfs glusterfs direct-io-mode=disable,defaults,_netdev 0 0</div><div><br></div><div>The server utilization (memory,cpu,network and disk 1/0) is relatively low</div><div><br></div><div>I am experiencing very slow performance while copying multiple file/folders (approx 75 MB) and it takes atleast approx 35 min. Even copy a folder (with multiple files/subfolders) within the Gluster volume take the same time.</div><div><br></div><div>However, if I do dd to check the copy speed, I get the below result.</div><div><br></div><div>[root@ClientServer ~]# time sh -c "dd if=/dev/zero of=/mnt/testmount/test.tmp bs=4k count=20000 && sync"</div><div>20000+0 records in</div><div>20000+0 records out</div><div>81920000 bytes (82 MB) copied, 17.1357 s, 4.8 MB/s</div><div><br></div><div>real 0m17.337s</div><div>user 0m0.031s</div><div>sys 0m0.317s</div><div><br></div><div><br></div><div>Anyone experience the same kind of performance issue, please let me know your thoughts.</div><div><br></div><div>Cheers</div><div>Srikanth</div><img src="http://t.sidekickopen32.com/e1t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9gXrN7sKj6v5dlMzN3Mhzlvd78sgN4WYKX8QFLCHVJRqz71k1H6H0?si=5606145044512768&pi=1087b8ba-84ee-4995-d761-66a897a5e5ff" style="display:none!important" height="1" width="1"></div>
<br></div></div>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div>
<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div>