<div dir="ltr">Hello Ernie, list,<div><br></div><div>No, that's not the case. The volume is mounted through glusterfs-fuse - on the same server running one of the bricks. The fstab:</div><div><br></div><div><div># /etc/fstab</div><div># Created by anaconda on Tue Aug 18 18:10:49 2015</div><div>#</div><div># Accessible filesystems, by reference, are maintained under '/dev/disk'</div><div># See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info</div><div>#</div><div>UUID=56778fed-bf3f-435e-8c32-edaa8c707f29 / <span class="" style="white-space:pre"> </span>xfs<span class="" style="white-space:pre"> </span>defaults 0 0</div><div>UUID=a44e32ed-cfbe-4ba0-896f-1efff9397ba1 /boot <span class="" style="white-space:pre"> </span>xfs<span class="" style="white-space:pre"> </span>defaults 0 0</div><div>UUID=a344d2bc-266d-4905-85b1-fbb7fe927659 swap <span class="" style="white-space:pre"> </span>swap<span class="" style="white-space:pre"> </span>defaults 0 0</div><div>/dev/vdb1<span class="" style="white-space:pre"> </span> /data/brick<span class="" style="white-space:pre"> </span> <span class="" style="white-space:pre"> </span>xfs<span class="" style="white-space:pre"> </span>defaults<span class="" style="white-space:pre"> </span>1 2</div><div>iron2:/lpxassets<span class="" style="white-space:pre"> </span> /mnt/lpxassets<span class="" style="white-space:pre"> </span> <span class="" style="white-space:pre"> </span>glusterfs<span class="" style="white-space:pre"> </span>_netdev,acl<span class="" style="white-space:pre"> </span>0 0<br></div><div><br></div><div><br></div><div><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On 12 November 2015 at 22:50, Ernie Dunbar <span dir="ltr"><<a href="mailto:maillist@lightspeed.ca" target="_blank">maillist@lightspeed.ca</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Tiemen<br>
<br>
It sounds like you're trying to rsync files onto your Gluster server, rather than to the Gluster filesystem. You want to copy these files into the mounted filesystem (typically on some other system than the Gluster servers), because Gluster is designed to handle it that way.<br>
<br>
I can't remember the nitty gritty details about why this is, but I've made this mistake before as well. Hope that helps. :)<div><div class="h5"><br>
<br>
On 2015-11-12 11:31, Tiemen Ruiten wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5">
Hello,<br>
<br>
While rsyncing to a directory mounted through glusterfs fuse,<br>
performance is very bad and it appears every synced file generates a<br>
(metadata) self-heal.<br>
<br>
The volume is mounted with option acl and acl's are set on a<br>
subdirectory.<br>
<br>
Setup is as follows:<br>
<br>
Two Centos 7 VM's (KVM), with Gluster 3.7.6 and one physical CentOS 6<br>
node, also Gluster 3.7.6. Physical node functions as arbiter. So it's<br>
a replica 3 arbiter 1 volume. The bricks are LVM's with XFS<br>
filesystem.<br>
<br>
While I don't think I should expect top performance for rsync on<br>
Gluster, I wouldn't expect every file synced to trigger a self-heal.<br>
Anything I can do to improve this? Should I file a bug?<br>
<br>
Another thing that looks related, I see a lot of these messages,<br>
especially when doing IO:<br>
<br>
[2015-11-12 19:25:42.185904] I [dict.c:473:dict_get]<br>
(-->/usr/lib64/glusterfs/3.7.6/xlator/debug/io-stats.so(io_stats_lookup_cbk+0x121)<br>
[0x7fdcc2d31161]<br>
-->/usr/lib64/glusterfs/3.7.6/xlator/system/posix-acl.so(posix_acl_lookup_cbk+0x242)<br>
[0x7fdcc2b1b212] -->/lib64/libglusterfs.so.0(dict_get+0xac)<br>
[0x7fdcd5e770cc] ) 0-dict: !this || key=system.posix_acl_default<br>
[Invalid argument]<br>
<br>
--<br>
<br>
Tiemen Ruiten<br>
Systems Engineer<br>
R&D Media<br>
<br></div></div>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr">Tiemen Ruiten<br>Systems Engineer<br>R&D Media<br></div></div>
</div>