<div dir="ltr"><div class="gmail_quote"><div dir="ltr"><div>Hi,</div><div><br></div><div><br></div><div>I have production gluster file service used as a shared storage where the content management system uses it as document root. I have run in to a performance issue with the gluster/fuse client.</div><div><br></div><div>Looking for your thoughts and experience in resolving Gluster performance issues:</div><div><br></div><div>Gluster Infrastructure</div><div><br></div><div>Gluster version :GlusterFS 3.7.6</div><div><br></div><div>2 gluster nodes of the same config below</div><div><br></div><div>Redhat EL7.0-64</div><div>Memory : 4GB</div><div>Processor : 2 x 2.0 Ghz</div><div>Network : 100 Mbps</div><div>File Storage Volume : NETAPP Storage LUN with 2.0 IOPS/GB</div><div><br></div><div>Gluster Volume information:</div><div><br></div><div>[root@GlusterFileServe1 ~]# gluster volume info</div><div><br></div><div>Volume Name: prodcmsroot</div><div>Type: Replicate</div><div>Volume ID: f1284bf0-1939-46f9-a672-a7716e362947</div><div>Status: Started</div><div>Number of Bricks: 1 x 2 = 2</div><div>Transport-type: tcp</div><div>Bricks:</div><div>Brick1: Server1:/glusterfs/brick1/prodcmsroot</div><div>Brick2: Server2:/glusterfs/brick1/prodcmsroot</div><div>Options Reconfigured:</div><div>performance.io-thread-count: 64</div><div>performance.cache-size: 1073741824</div><div>performance.readdir-ahead: on</div><div>performance.write-behind-window-size: 524288</div><div><br></div><div>[root@GlusterFileServe1 ~]#</div><div><br></div><div>The replication between Gluster node are quick and consistent. </div><div><br></div><div>The apache webservers are accessing the Gluster volume using native gluster fuse client and located in the same VLAN as the Gluster Server.</div><div><br></div><div>GlusterFileServe1:/prodcmsroot /mnt/glusterfs glusterfs direct-io-mode=disable,defaults,_netdev 0 0</div><div><br></div><div>The server utilization (memory,cpu,network and disk 1/0) is relatively low</div><div><br></div><div>I am experiencing very slow performance while copying multiple file/folders (approx 75 MB) and it takes atleast approx 35 min. Even copy a folder (with multiple files/subfolders) within the Gluster volume take the same time.</div><div><br></div><div>However, if I do dd to check the copy speed, I get the below result.</div><div><br></div><div>[root@ClientServer ~]# time sh -c "dd if=/dev/zero of=/mnt/testmount/test.tmp bs=4k count=20000 && sync"</div><div>20000+0 records in</div><div>20000+0 records out</div><div>81920000 bytes (82 MB) copied, 17.1357 s, 4.8 MB/s</div><div><br></div><div>real 0m17.337s</div><div>user 0m0.031s</div><div>sys 0m0.317s</div><div><br></div><div><br></div><div>Anyone experience the same kind of performance issue, please let me know your thoughts.</div><div><br></div><div>Cheers</div><div>Srikanth</div></div>
</div><br><img src="http://t.sidekickopen32.com/e1t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9gXrN7sKj6v5dlMzN3Mhzlvd78sgN4WYKX8QFLCHVJRqz71k1H6H0?si=5606145044512768&pi=9399cde6-4efa-4b17-b283-b5199f1daf26" style="display:none!important" height="1" width="1"></div>