<div dir="ltr"><div class="gmail_extra">Thanks for the help, see below:</div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Sep 3, 2016 at 11:41 AM, Mohammed Rafi K C <span dir="ltr"><<a href="mailto:rkavunga@redhat.com" target="_blank">rkavunga@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div bgcolor="#FFFFFF" text="#000000">Files created before attaching hot tier will be present on hot brick
until it gets heated and migrated completely. During this time
interval we won't get the benefit of hot storage since the files are
served from cold brick.<br></div></blockquote><div>The issue I'm having is that when the hot tier is added read from the volume drops from 150MB/s (no tier) to 2-10MB/s (tier added). I experienced this issue for a while even after the hot brick reached 90% capacity, so many files were promoted.</div><div>I detached the hotbrick and verified there weren't any files left over, and the performance was still effected.</div><div>It was only until I committed the detach that throughput returned to 150MB/s.</div><div><br></div><div>Reattaching the hot tier immediately caused the issue to return until the tier was again detach-committed</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div bgcolor="#FFFFFF" text="#000000">
<br>
<br>
For smallfiles (order of kbs), We are experiencing some performance
issue mostly with EC (disperse ) volume.<br>
<br>
Follow up questions,<br>
What is the volume type ? and version of glusterfs ?<br></div></blockquote><div>The volume is a 2x replica on btrfs bricks that are luks encrypted. 2048K GPT offset for 1st partition . Gluster 3.8.3, built aug 22 running on Centos.</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div bgcolor="#FFFFFF" text="#000000">
<br>
Does reread gives an equal performance when it hits the server ?<br>
reading any files with hot tier results in 2-10MB/s (node mounted volume via localhost6:/volume), reading them again any number of times does not improve performance</div></blockquote><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div bgcolor="#FFFFFF" text="#000000">
Have you done any rename for those files ?</div></blockquote><div>Some files have been renamed, however the 10GB test file has not it is the original name/copy</div></div><br><br></div></div>