<div dir="ltr">Hi,<div>Can anyone please provide your inputs on the issue?</div><div><br></div><div>-Prashanth</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Dec 17, 2015 at 11:33 AM, Prashanth kumar N <span dir="ltr"><<a href="mailto:prashanth.kumar.n@gmail.com" target="_blank">prashanth.kumar.n@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div>One of my gluster deployment requires to completely disable Gluster caching and put in proprietary caching logic. Setup is as follows:</div><div><br></div><div>- PCI flash will be used as flash</div><div>- Two node connected using 40GB Melanox cards</div><div>- Gluster version 3.7.6</div><div><br></div><div>With fresh installation of Gluster, using fio with libgapi with bs=1M/4M, seq_write i am able to achieve speeds up to 2.4GB/s from user point of view. When i check the raw flash speed, seeing bandwidth of 1.1GB/s but flash is capable of getting speeds of 1.5GB/s. </div><div>Before putting in our own cache, i disabled Gluster caching by disabling below options and measured fio speed </div><div><br></div><div><div>gluster vol set $vol_name performance.io-cache off</div><div>gluster vol set $vol_name performance.write-behind off</div><div>gluster vol set $vol_name performance.flush-behind off</div><div>service glusterd restart</div></div><div><br></div><div>[ $vol_name was my name name passed in shell script ]</div><div><br></div><div>With the above parameters disabled, i was drop in fio speed ( as expected ) to around 1.4GB/s but raw flash speed measured was around 250-350MB/s using iostat. This shows that Gluster caching might not be completely disabled or i am missing some piece of information.</div><div>Please provide your valuable inputs if any other settings need to be disabled.</div><span class="HOEnZb"><font color="#888888"><div><br></div><div>-Prashanth</div><div><br></div><div><br></div><div><br></div></font></span></div>
</blockquote></div><br></div>