<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Nov 10, 2016 at 8:57 PM, Vijay Bellur <span dir="ltr"><<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On Thu, Nov 10, 2016 at 3:17 AM, Nithya Balachandran<br>
<<a href="mailto:nbalacha@redhat.com">nbalacha@redhat.com</a>> wrote:<br>
><br>
><br>
> On 8 November 2016 at 20:21, Kyle Johnson <<a href="mailto:kjohnson@gnulnx.net">kjohnson@gnulnx.net</a>> wrote:<br>
>><br>
>> Hey there,<br>
>><br>
>> We have a number of processes which daily walk our entire directory tree<br>
>> and perform operations on the found files.<br>
>><br>
>> Pre-gluster, this processes was able to complete within 24 hours of<br>
>> starting. After outgrowing that single server and moving to a gluster setup<br>
>> (two bricks, two servers, distribute, 10gig uplink), the processes became<br>
>> unusable.<br>
>><br>
>> After turning this option on, we were back to normal run times, with the<br>
>> process completing within 24 hours.<br>
>><br>
>> Our data is heavy nested in a large number of subfolders under /media/ftp.<br>
><br>
><br>
> Thanks for getting back to us - this is very good information. Can you<br>
> provide a few more details?<br>
><br>
> How deep is your directory tree and roughly how many directories do you have<br>
> at each level?<br>
> Are all your files in the lowest level dirs or do they exist on several<br>
> levels?<br>
> Would you be willing to provide the gluster volume info output for this<br>
> volume?<br>
>><br>
<br>
<br>
</span>I have had performance improvement with this option when the first<br>
level below the root consisted several thousands of directories<br>
without any files. IIRC, I was testing this in a 16 x 2 setup.<br></blockquote><div><br></div><div>Yes Vijay. I remember you mentioning it. This option is expected to only boost readdir performance on a directory containing subdirectories. For files it has no effect.<br><br></div><div>On a similar note, I think we can also skip linkto files in readdirp (on brick) as dht_readdirp picks the dentry from subvol containing data-file.<br><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Regards,<br>
Vijay<br>
<div class="HOEnZb"><div class="h5">______________________________<wbr>_________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/<wbr>mailman/listinfo/gluster-devel</a><br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature">Raghavendra G<br></div>
</div></div>