<div dir="ltr"><div>Hi</div><div><br></div>iostat i am not running on Network interface. I am running on my storage device( SSD card:: iostat /dev/nvme0n1 1).<div><br></div><div>Sateesh</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Nov 10, 2015 at 1:47 AM, Piotr Rybicki <span dir="ltr"><<a href="mailto:piotr.rybicki@innervision.pl" target="_blank">piotr.rybicki@innervision.pl</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">W dniu 2015-11-10 o 04:01, satish kondapalli pisze:<div><div class="h5"><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi,<br>
<br>
I am running performance test between fuse vs libgfapi. I have a<br>
single node, client and server are running on same node. I have NVMe SSD<br>
device as a storage.<br>
<br>
My volume info::<br>
<br>
[root@sys04 ~]# gluster vol info<br>
Volume Name: vol1<br>
Type: Distribute<br>
Volume ID: 9f60ceaf-3643-4325-855a-455974e36cc7<br>
Status: Started<br>
Number of Bricks: 1<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: 172.16.71.19:/mnt_nvme/brick1<br>
Options Reconfigured:<br>
performance.cache-size: 0<br>
performance.write-behind: off<br>
performance.read-ahead: off<br>
performance.io-cache: off<br>
performance.strict-o-direct: on<br>
<br>
<br>
fio Job file::<br>
<br>
[global]<br>
direct=1<br>
runtime=20<br>
time_based<br>
ioengine=gfapi<br>
iodepth=1<br>
volume=vol1<br>
brick=172.16.71.19<br>
rw=read<br>
size=128g<br>
bs=32k<br>
group_reporting<br>
numjobs=1<br>
filename=128g.bar<br>
<br>
While doing sequential read test, I am not seeing any data transfer on<br>
device with iostat tool. Looks like gfapi engine is reading from the<br>
cache because i am reading from same file with different block sizes.<br>
<br>
But i disabled io cache for my volume. Can someone help me from where<br>
fio is reading the data?<br>
</blockquote>
<br></div></div>
Hi.<br>
<br>
It is normal - not seeing traffic on ethernet interface, when using native RDMA protocol (not TCP via IPoIB).<br>
<br>
Try perfquery -x , to see traffic counters increase on RDMA interface.<br>
<br>
Regards<span class="HOEnZb"><font color="#888888"><br>
Piotr Rybicki<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</font></span></blockquote></div><br></div>