<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"><html><head><meta content="text/html;charset=UTF-8" http-equiv="Content-Type"></head><body ><div style='font-size:10pt;'>Hi bturner,<br><br><br> I am getting below error while adding server.event <br><b><br>gluster v set integvol server.event-threads 3<br>volume set: failed: option : server.event-threads does not exist<br>Did you mean server.gid-timeout or ...manage-gids?</b> <br><br><br>Glusterfs version has been upgraded to 3.6.3<br>Also os kernel upgraded to 6.6 kernel <br>Yes two brick are running in KVM and one is physical machine and we are not using thinp.<br><br><div id=""><div><span style="color: rgb(0, 0, 0);">Regards</span></div><span style="color: rgb(0, 0, 0);">G.J<br></span><div style="color: rgb(255, 0, 0);"><b><br clear="none"></b></div><font size="3"><span style="color: rgb(192, 192, 192); font-family: arial,helvetica,sans-serif;"><font style="font-family: 'courier new',courier,monospace;" size="5"><span style="color: rgb(0, 0, 255);"></span></font><span></span></span></font></div><br><div class="zmail_extra"><div id="1"><br>---- On Thu, 30 Apr 2015 00:37:44 +0530 <b>Ben Turner<bturner@redhat.com></b> wrote ---- <br></div><blockquote style="border-left: 1px solid #0000FF; padding-left: 6px; margin:0 0 0 5px"><div>----- Original Message ----- <br>> From: "gjprabu" <<a subj="" mailid="gjprabu%40zohocorp.com" href="mailto:gjprabu@zohocorp.com" target="_blank">gjprabu@zohocorp.com</a>> <br>> To: "A Ghoshal" <<a subj="" mailid="a.ghoshal%40tcs.com" href="mailto:a.ghoshal@tcs.com" target="_blank">a.ghoshal@tcs.com</a>> <br>> Cc: <a subj="" mailid="gluster-users%40gluster.org" href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a>, <a subj="" mailid="gluster-users-bounces%40gluster.org" href="mailto:gluster-users-bounces@gluster.org" target="_blank">gluster-users-bounces@gluster.org</a> <br>> Sent: Wednesday, April 29, 2015 9:07:07 AM <br>> Subject: Re: [Gluster-users] client is terrible with large amount of small files <br>> <br>> Hi Ghoshal, <br>> <br>> Please find the details below. <br>> <br>> A) Glusterfs version <br>> glusterfs 3.6.2 <br> <br>Upgrade to 3.6.3 and set client.event-threads and server.event-threads to at least 4. Here is a guide on tuning MT epoll: <br> <br><a href="https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Administration_Guide/Small_File_Performance_Enhancements.html" target="_blank">https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Administration_Guide/Small_File_Performance_Enhancements.html</a> <br> <br>> <br>> B) volume configuration (gluster v <volname> info) <br>> gluster volume info <br>> <br>> <br>> Volume Name: integvol <br>> Type: Replicate <br>> Volume ID: b8f3a19e-59bc-41dc-a55a-6423ec834492 <br>> Status: Started <br>> Number of Bricks: 1 x 3 = 3 <br>> Transport-type: tcp <br>> Bricks: <br>> Brick1: integ-gluster2:/srv/sdb1/brick <br>> Brick2: integ-gluster1:/srv/sdb1/brick <br>> Brick3: integ-gluster3:/srv/sdb1/brick <br>> <br>> <br>> C) host linux version <br>> CentOS release 6.5 (Final) <br> <br>Are your bricks on LVM? Are you using thinp? If so update to the latest kernel as thinp perf was really bad in 6.5 and early 6.6 kernels. <br> <br>> <br>> D) details about the kind of network you use to connect your servers making <br>> up your storage pool. <br>> We are connecting LAN to LAN there is no special network configuration done <br>> <br>> Frome client we use to mount like below <br>> mount -t glusterfs gluster1:/integvol /mnt/gluster/ <br>> <br>> <br>> Regards <br>> Prabu <br>> <br>> <br>> <br>> ---- On Wed, 29 Apr 2015 17:58:16 +0530 A Ghoshal<<a subj="" mailid="a.ghoshal%40tcs.com" href="mailto:a.ghoshal@tcs.com" target="_blank">a.ghoshal@tcs.com</a>> wrote <br>> ---- <br>> <br>> <br>> <br>> Performance would largely depend upon setup. While I cannot think of any <br>> setup that would cause write to be this slow, if would help if you share the <br>> following details: <br>> <br>> A) Glusterfs version <br>> B) volume configuration (gluster v <volname> info) <br>> C) host linux version <br>> D) details about the kind of network you use to connect your servers making <br>> up your storage pool. <br>> <br>> Thanks, <br>> Anirban <br>> <br>> <br>> <br>> From: gjprabu < <a subj="" mailid="gjprabu%40zohocorp.com" href="mailto:gjprabu@zohocorp.com" target="_blank">gjprabu@zohocorp.com</a> > <br>> To: < <a subj="" mailid="gluster-users%40gluster.org" href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a> > <br>> Date: 04/29/2015 05:52 PM <br>> Subject: Re: [Gluster-users] client is terrible with large amount of small <br>> files <br>> Sent by: <a subj="" mailid="gluster-users-bounces%40gluster.org" href="mailto:gluster-users-bounces@gluster.org" target="_blank">gluster-users-bounces@gluster.org</a> <br>> <br>> <br>> <br>> <br>> Hi Team, <br>> <br>> If anybody know the solution please share us. <br>> <br>> Regards <br>> Prabu <br>> <br>> <br>> <br>> ---- On Tue, 28 Apr 2015 19:32:40 +0530 gjprabu < <a subj="" mailid="gjprabu%40zohocorp.com" href="mailto:gjprabu@zohocorp.com" target="_blank">gjprabu@zohocorp.com</a> > <br>> wrote ---- <br>> Hi Team, <br>> <br>> We are using glusterfs newly and testing data transfer part in client using <br>> fuse.glusterfs file system but it is terrible with large amount of small <br>> files (Large amount of small file 150MB of size it's writing around 18min). <br>> I can able copy small files and syncing between the server brick are working <br>> fine but it is terrible with large amount of small files. <br>> <br>> if anybody please share the solution for the above issue. <br>> <br>> Regards <br>> Prabu <br>> <br>> _______________________________________________ <br>> Gluster-users mailing list <br>> <a subj="" mailid="Gluster-users%40gluster.org" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a> <br>> <a href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a> <br>> <br>> _______________________________________________ <br>> Gluster-users mailing list <br>> <a subj="" mailid="Gluster-users%40gluster.org" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a> <br>> <a href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a> <br>> <br>> <br>> =====-----=====-----===== <br>> Notice: The information contained in this e-mail <br>> message and/or attachments to it may contain <br>> confidential or privileged information. If you are <br>> not the intended recipient, any dissemination, use, <br>> review, distribution, printing or copying of the <br>> information contained in this e-mail message <br>> and/or attachments to it are strictly prohibited. If <br>> you have received this communication in error, <br>> please notify us by reply e-mail or telephone and <br>> immediately and permanently delete the message <br>> and any attachments. Thank you <br>> <br>> <br>> <br>> _______________________________________________ <br>> Gluster-users mailing list <br>> <a subj="" mailid="Gluster-users%40gluster.org" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a> <br>> <a href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a> <br></div></blockquote><br></div><br></div></body></html>