<div dir="ltr">Hello,<div><br></div><div>On gluster client and server, did you disable atime & co ?</div><div>Did you check for network bottleneck ? You are now using network twice:</div><div>-One way to read data through glusterfs,</div><div>-One way to push data remotely somewhere</div><div><br></div><div>I am using rsnapshot on my side, so it's doing hardlink to same files, maybe it goes faster than true full copy.</div><div>Also problem raise with folder containing a lot of small files in replicated setup.</div><div>Which gluster version are you using ?</div><div><br></div><div>I also experience memory leakage from server doing rsync (glusterfs client leak), but we are aware and patched has been pushed for version 3.7.8</div><div><br></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature">Cordialement,<br>Mathieu CHATEAU<br><a href="http://www.lotp.fr" target="_blank">http://www.lotp.fr</a></div></div>
<br><div class="gmail_quote">2016-02-14 10:56 GMT+01:00 Nico Schottelius <span dir="ltr"><<a href="mailto:nico-gluster-users@schottelius.org" target="_blank">nico-gluster-users@schottelius.org</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello everyone,<br>
<br>
we have a 2 brick setup running on a raid6 with 19T storage.<br>
<br>
We are currently facing the problem that the backup (9.1 TB data in<br>
48126852 files) is taking more than a week when being backed up by<br>
means of rsync (actually, ccollect[0]).<br>
<br>
During backup the rsync process is continously in D state (expected),<br>
but cpu load is far from 100% and disk is also only about 15-30% busy.<br>
<br>
(this is snapshot from right now)<br>
<br>
I have two questions, the second one more important:<br>
<br>
a) Is there a good way to identify the bottleneck?<br>
b) Is it "safe" to backup data directly from the underlying<br>
filesystem instead of going via the glusterfs mount?<br>
<br>
The reason why I ask about (b) is that we used to backup from those<br>
servers *before* we switched to glusterfs within about a day and thus<br>
I suspect backing up from the xfs filesystem again should do the job.<br>
<br>
Thanks for any hints,<br>
<br>
Nico<br>
<br>
<br>
[0] <a href="http://www.nico.schottelius.org/software/ccollect/" rel="noreferrer" target="_blank">http://www.nico.schottelius.org/software/ccollect/</a><br>
<span class="HOEnZb"><font color="#888888"><br>
--<br>
Werde Teil des modernen Arbeitens im Glarnerland auf <a href="http://www.digitalglarus.ch" rel="noreferrer" target="_blank">www.digitalglarus.ch</a>!<br>
Lese Neuigkeiten auf Twitter: <a href="http://www.twitter.com/DigitalGlarus" rel="noreferrer" target="_blank">www.twitter.com/DigitalGlarus</a><br>
Diskutiere mit auf Facebook: <a href="http://www.facebook.com/digitalglarus" rel="noreferrer" target="_blank">www.facebook.com/digitalglarus</a><br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</font></span></blockquote></div><br></div>