<html><body><div style="font-family: arial,helvetica,sans-serif; font-size: 10pt; color: #000000"><div><br></div><div><br></div><hr id="zwchr"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"Hafeez Bana" <hafeez.bana@gmail.com><br><b>To: </b>gluster-devel@gluster.org<br><b>Sent: </b>Tuesday, August 4, 2015 10:25:46 PM<br><b>Subject: </b>[Gluster-devel] Small File Performance - Strange results<br><div><br></div><div dir="ltr"><div><div>All,<br><div><br></div></div>We've been evaluating glusterfs 3.2.7 on ubuntu 14.04 LTS. All tests were run with event-thread matching cpu-cores and lookup-unhashed turned off</div></div></blockquote><div>Is it really GlusterFS 3.2.7? That is pretty old version. Upgrade is highly recommended.</div><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><div dir="ltr"><div><br><div><br></div></div><div>We noted a couple of issues and some interesting results which might be of benefit to the developers<br><div><br></div></div><div>Setup <br></div><div>- bare metal machine with SSD running ZFS - 2 LXC container running glusterd and another running a samba instance which is serving a share backed by a fuse mounted volume.<br><div><br></div></div><div>Observations<br></div><div>1 ) the fuse mounted volume has to be done in the host and LXC run on top of it. If you try to fuse mount within in LXC - posix acls group persmissions are not respected completed by gluster </div></div></blockquote><div>If you use -oacl option then it should work whether within LXC or not.</div><div>Logs would be useful to debug this issue more.</div><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><div dir="ltr"><div><br></div><div>2) small file performance - tests were run unzipping from a windows box a 45M and 150M (expanded size - contains 8000 files) archive. 45M performance is reasonable. 150M tests takes 10 times as long(about 18 minutes) as the same samba instance serving of a straight zfs filesystem</div></div></blockquote><div>We have seen that time required for creation of new files increases exponentially when the number of existing files in the parent folder is increased. It is fixed in 3.7 version of Gluster if you use the VFS plugin integration between Samba and Gluster instead of FUSE mount.</div><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><div dir="ltr"><div><br></div><div>3) As a whim we logged into the container containing the samba instance and copied files from the ZFS folder to the folder under gluster. 14seconds for the same transfer of 8000 files!!<br><div><br></div></div><div>We don't know if there is a mismatch in the config of samba that is causing issues with gluster. Any ideas? And also is the issue with posix acls groups being broken if you fuse_mount a gluster volume within LXC known? <br></div><div><br></div><div>Finally, are there any gluster developers in the UK - we would love to talk to them.<br></div><div><br></div><div>Thanks,<br></div><div>Hafeez<br></div></div><br>_______________________________________________<br>Gluster-devel mailing list<br>Gluster-devel@gluster.org<br>http://www.gluster.org/mailman/listinfo/gluster-devel<br></blockquote><div><br><br></div><div><br></div><div>-- <br></div><div><span name="x"></span><br>Thanks! <br>Raghavendra Talur | Red Hat Storage Developer | Bangalore | +918039245176 <br><span name="x"></span><br></div></div></body></html>