<div dir="ltr">Manikandan,<div><br></div><div style="">Can you test this fix since you've the setup ready?</div><div style=""><br></div><div style="">regards,</div><div style="">Raghavendra</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 5, 2016 at 11:11 PM, Raghavendra G <span dir="ltr"><<a href="mailto:raghavendra@gluster.com" target="_blank">raghavendra@gluster.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>A fix has been sent to:</div><a href="http://review.gluster.org/13177" target="_blank">http://review.gluster.org/13177</a><br></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Tue, Jan 5, 2016 at 2:24 PM, Raghavendra Gowdappa <span dir="ltr"><<a href="mailto:rgowdapp@redhat.com" target="_blank">rgowdapp@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span><br>
<br>
----- Original Message -----<br>
> From: "Raghavendra Gowdappa" <<a href="mailto:rgowdapp@redhat.com" target="_blank">rgowdapp@redhat.com</a>><br>
> To: "Manikandan Selvaganesh" <<a href="mailto:mselvaga@redhat.com" target="_blank">mselvaga@redhat.com</a>><br>
</span><span>> Cc: "Vijaikumar Mallikarjuna" <<a href="mailto:vmallika@redhat.com" target="_blank">vmallika@redhat.com</a>>, "Emmanuel Dreyfus" <<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>>, "Raghavendra Talur"<br>
> <<a href="mailto:rtalur@redhat.com" target="_blank">rtalur@redhat.com</a>>, "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>><br>
</span><span>> Sent: Tuesday, January 5, 2016 12:16:27 PM<br>
> Subject: Re: [Gluster-devel] quota.t hangs on NetBSD machines<br>
><br>
</span><span>> Thanks. There is a write call which is not unwound by write-behind as can be<br>
> seen below:<br>
><br>
> [.WRITE]<br>
> request-ptr=0xb80a4830<br>
> refcount=2<br>
> wound=no<br>
> generation-number=90<br>
> req->op_ret=32768<br>
> req->op_errno=0<br>
> sync-attempts=0<br>
> sync-in-progress=no<br>
> size=32768<br>
> offset=11665408<br>
> lied=0<br>
> append=0<br>
> fulfilled=0<br>
> go=0<br>
><br>
> note, the request is not wound (wound=no and sync-in-progress=no), not<br>
> unwound (lied=0). I am yet to figure out the RCA. will be sending a patch<br>
> soon.<br>
<br>
</span>I figured out this issue occurs when "trickling-writes" is on in write-behind (by default its on). Unfortunately this option cannot be turned off using cli as of now (one can edit volfiles though).<br>
<div><div><br>
><br>
> ----- Original Message -----<br>
> > From: "Manikandan Selvaganesh" <<a href="mailto:mselvaga@redhat.com" target="_blank">mselvaga@redhat.com</a>><br>
> > To: "Raghavendra Gowdappa" <<a href="mailto:rgowdapp@redhat.com" target="_blank">rgowdapp@redhat.com</a>><br>
> > Cc: "Vijaikumar Mallikarjuna" <<a href="mailto:vmallika@redhat.com" target="_blank">vmallika@redhat.com</a>>, "Emmanuel Dreyfus"<br>
> > <<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>>, "Raghavendra Talur"<br>
> > <<a href="mailto:rtalur@redhat.com" target="_blank">rtalur@redhat.com</a>>, "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>><br>
> > Sent: Tuesday, January 5, 2016 11:43:55 AM<br>
> > Subject: Re: [Gluster-devel] quota.t hangs on NetBSD machines<br>
> ><br>
> > Hi Raghavendra,<br>
> ><br>
> > Yeah, we have taken the statedump when the test program was in 'D' state. I<br>
> > have enabled statedump of inodes too.<br>
> ><br>
> > Attaching the entire statedump file.<br>
> ><br>
> > Thank you :-)<br>
> ><br>
> > --<br>
> > Regards,<br>
> > Manikandan Selvaganesh.<br>
> ><br>
> > ----- Original Message -----<br>
> > From: "Raghavendra Gowdappa" <<a href="mailto:rgowdapp@redhat.com" target="_blank">rgowdapp@redhat.com</a>><br>
> > To: "Manikandan Selvaganesh" <<a href="mailto:mselvaga@redhat.com" target="_blank">mselvaga@redhat.com</a>><br>
> > Cc: "Emmanuel Dreyfus" <<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>>, "Gluster Devel"<br>
> > <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>>, "Vijaikumar Mallikarjuna"<br>
> > <<a href="mailto:vmallika@redhat.com" target="_blank">vmallika@redhat.com</a>><br>
> > Sent: Monday, January 4, 2016 11:56:03 PM<br>
> > Subject: Re: [Gluster-devel] quota.t hangs on NetBSD machines<br>
> ><br>
> ><br>
> ><br>
> > ----- Original Message -----<br>
> > > From: "Manikandan Selvaganesh" <<a href="mailto:mselvaga@redhat.com" target="_blank">mselvaga@redhat.com</a>><br>
> > > To: "Raghavendra Gowdappa" <<a href="mailto:rgowdapp@redhat.com" target="_blank">rgowdapp@redhat.com</a>><br>
> > > Cc: "Emmanuel Dreyfus" <<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>>, "Gluster Devel"<br>
> > > <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>>, "Vijaikumar Mallikarjuna"<br>
> > > <<a href="mailto:vmallika@redhat.com" target="_blank">vmallika@redhat.com</a>><br>
> > > Sent: Monday, January 4, 2016 7:00:16 PM<br>
> > > Subject: Re: [Gluster-devel] quota.t hangs on NetBSD machines<br>
> > ><br>
> > > Hi,<br>
> > ><br>
> > > We have taken statedump of fuse client process, quotad and bricks.<br>
> > > Apparently, we could not find any stack information in brick's statedump.<br>
> > > Below is the client statedump state information:<br>
> ><br>
> > Thanks Manikandan :). You took this statedump once the test program was in<br>
> > 'D' state, right? Otherwise these can be just in-transit fops.<br>
> ><br>
> > ><br>
> > > [global.callpool.stack.1.frame.1]<br>
> > > frame=0xb80775f0<br>
> > > ref_count=0<br>
> > > translator=patchy-write-behind<br>
> > > complete=0<br>
> > > parent=patchy-read-ahead<br>
> > > wind_from=ra_writev<br>
> > > wind_to=FIRST_CHILD(this)->fops->writev<br>
> > > unwind_to=ra_writev_cbk<br>
> ><br>
> > As I suspected, write-behind seems to be the culprit. Can you upload the<br>
> > entire statedump file? Also, make sure you've enabled statedump of inodes<br>
> > (by setting "all=yes" in glusterdump.options as explained in my previous<br>
> > mail).<br>
> ><br>
> > ><br>
> > > [global.callpool.stack.1.frame.2]<br>
> > > frame=0xb8077540<br>
> > > ref_count=1<br>
> > > translator=patchy-read-ahead<br>
> > > complete=0<br>
> > > parent=patchy-io-cache<br>
> > > wind_from=ioc_writev<br>
> > > wind_to=FIRST_CHILD(this)->fops->writev<br>
> > > unwind_to=ioc_writev_cbk<br>
> > ><br>
> > > [global.callpool.stack.1.frame.3]<br>
> > > frame=0xb8077490<br>
> > > ref_count=1<br>
> > > translator=patchy-io-cache<br>
> > > complete=0<br>
> > > parent=patchy-quick-read<br>
> > > wind_from=qr_writev<br>
> > > wind_to=FIRST_CHILD (this)->fops->writev<br>
> > > unwind_to=default_writev_cbk<br>
> > ><br>
> > > [global.callpool.stack.1.frame.4]<br>
> > > frame=0xb80773e0<br>
> > > ref_count=1<br>
> > > translator=patchy-quick-read<br>
> > > complete=0<br>
> > > parent=patchy-open-behind<br>
> > > wind_from=default_writev_resume<br>
> > > wind_to=FIRST_CHILD(this)->fops->writev<br>
> > > unwind_to=default_writev_cbk<br>
> > ><br>
> > > [global.callpool.stack.1.frame.5]<br>
> > > frame=0xb8077330<br>
> > > ref_count=1<br>
> > > translator=patchy-open-behind<br>
> > > complete=0<br>
> > > parent=patchy-md-cache<br>
> > > wind_from=mdc_writev<br>
> > > wind_to=FIRST_CHILD(this)->fops->writev<br>
> > > unwind_to=mdc_writev_cbk<br>
> > ><br>
> > > [global.callpool.stack.1.frame.6]<br>
> > > frame=0xb80771d0<br>
> > > ref_count=1<br>
> > > translator=patchy-md-cache<br>
> > > complete=0<br>
> > > parent=patchy<br>
> > > wind_from=io_stats_writev<br>
> > > wind_to=FIRST_CHILD(this)->fops->writev<br>
> > > unwind_to=io_stats_writev_cbk<br>
> > ><br>
> > > [global.callpool.stack.1.frame.7]<br>
> > > frame=0xb8077120<br>
> > > ref_count=1<br>
> > > translator=patchy<br>
> > > complete=0<br>
> > > parent=fuse<br>
> > > wind_from=fuse_write_resume<br>
> > > wind_to=FIRST_CHILD(this)->fops->writev<br>
> > > unwind_to=fuse_writev_cbk<br>
> > ><br>
> > > [global.callpool.stack.1.frame.8]<br>
> > > frame=0xb8077070<br>
> > > ref_count=1<br>
> > > translator=fuse<br>
> > > complete=0<br>
> > ><br>
> > > [global.callpool.stack.2]<br>
> > > stack=0xba420040<br>
> > > uid=0<br>
> > > gid=0<br>
> > > pid=0<br>
> > > unique=0<br>
> > > lk-owner=<br>
> > > op=stack<br>
> > > type=0<br>
> > > cnt=1<br>
> > ><br>
> > > [global.callpool.stack.2.frame.1]<br>
> > > frame=0xba43c6d0<br>
> > > ref_count=0<br>
> > > translator=glusterfs<br>
> > > complete=0<br>
> > ><br>
> > > [fuse]<br>
> > ><br>
> > > Below is the statedump information for quotad<br>
> > ><br>
> > > [global.callpool.stack.1.frame.1]<br>
> > > frame=0xbb1d0620<br>
> > > ref_count=0<br>
> > > translator=glusterfs<br>
> > > complete=0<br>
> > ><br>
> > > Thank you :-)<br>
> > ><br>
> > > --<br>
> > > Regards,<br>
> > > Manikandan Selvaganesh.<br>
> > ><br>
> > > ----- Original Message -----<br>
> > > From: "Raghavendra Gowdappa" <<a href="mailto:rgowdapp@redhat.com" target="_blank">rgowdapp@redhat.com</a>><br>
> > > To: "Emmanuel Dreyfus" <<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>><br>
> > > Cc: "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>><br>
> > > Sent: Monday, January 4, 2016 6:11:24 PM<br>
> > > Subject: Re: [Gluster-devel] quota.t hangs on NetBSD machines<br>
> > ><br>
> > ><br>
> > ><br>
> > > ----- Original Message -----<br>
> > > > From: "Emmanuel Dreyfus" <<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>><br>
> > > > To: "Raghavendra Gowdappa" <<a href="mailto:rgowdapp@redhat.com" target="_blank">rgowdapp@redhat.com</a>><br>
> > > > Cc: "Emmanuel Dreyfus" <<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>>, "Gluster Devel"<br>
> > > > <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>>, "Raghavendra Talur"<br>
> > > > <<a href="mailto:rtalur@redhat.com" target="_blank">rtalur@redhat.com</a>><br>
> > > > Sent: Monday, January 4, 2016 4:03:22 PM<br>
> > > > Subject: Re: [Gluster-devel] quota.t hangs on NetBSD machines<br>
> > > ><br>
> > > > On Mon, Jan 04, 2016 at 05:16:16AM -0500, Raghavendra Gowdappa wrote:<br>
> > > > > Can you send the statedump? Please look for frames with "complete=0".<br>
> > > > > This<br>
> > > > > indicates that the frame is not unwound.<br>
> > > ><br>
> > > > Here it is. No unwound frame?<br>
> > ><br>
> > > Is this statedump? Statedumps carry lots of other information too. This<br>
> > > seems<br>
> > > more like profile output from io-stats. Steps to obtain statedump from my<br>
> > > previous mail:<br>
> > ><br>
> > > 1. Add "all=yes"<br>
> > > <gluster-install-directory>/var/run/gluster/glusterdump.options<br>
> > > 2. kill -SIGUSR1 <gluster-client-pid><br>
> > > 3. statedump can be found in<br>
> > > <gluster-install-directory>/var/run/gluster/*dump*<br>
> > ><br>
> > > Also, please take statedump only after you find the application process<br>
> > > is<br>
> > > in<br>
> > > "uninterruptible sleep" ('D' on Linux) state.<br>
> > ><br>
> > > ><br>
> > > > {<br>
> > > > "gluster.patchy.aggr.read_1b": "0",<br>
> > > > "gluster.patchy.aggr.write_1b": "0",<br>
> > > > "gluster.patchy.aggr.read_2b": "0",<br>
> > > > "gluster.patchy.aggr.write_2b": "0",<br>
> > > > "gluster.patchy.aggr.read_4b": "0",<br>
> > > > "gluster.patchy.aggr.write_4b": "0",<br>
> > > > "gluster.patchy.aggr.read_8b": "0",<br>
> > > > "gluster.patchy.aggr.write_8b": "0",<br>
> > > > "gluster.patchy.aggr.read_16b": "0",<br>
> > > > "gluster.patchy.aggr.write_16b": "0",<br>
> > > > "gluster.patchy.aggr.read_32b": "0",<br>
> > > > "gluster.patchy.aggr.write_32b": "0",<br>
> > > > "gluster.patchy.aggr.read_64b": "0",<br>
> > > > "gluster.patchy.aggr.write_64b": "0",<br>
> > > > "gluster.patchy.aggr.read_128b": "0",<br>
> > > > "gluster.patchy.aggr.write_128b": "0",<br>
> > > > "gluster.patchy.aggr.read_256b": "0",<br>
> > > > "gluster.patchy.aggr.write_256b": "0",<br>
> > > > "gluster.patchy.aggr.read_512b": "0",<br>
> > > > "gluster.patchy.aggr.write_512b": "0",<br>
> > > > "gluster.patchy.aggr.read_1kb": "0",<br>
> > > > "gluster.patchy.aggr.write_1kb": "0",<br>
> > > > "gluster.patchy.aggr.read_2kb": "0",<br>
> > > > "gluster.patchy.aggr.write_2kb": "0",<br>
> > > > "gluster.patchy.aggr.read_4kb": "0",<br>
> > > > "gluster.patchy.aggr.write_4kb": "0",<br>
> > > > "gluster.patchy.aggr.read_8kb": "0",<br>
> > > > "gluster.patchy.aggr.write_8kb": "0",<br>
> > > > "gluster.patchy.aggr.read_16kb": "0",<br>
> > > > "gluster.patchy.aggr.write_16kb": "0",<br>
> > > > "gluster.patchy.aggr.read_32kb": "0",<br>
> > > > "gluster.patchy.aggr.write_32kb": "357",<br>
> > > > "gluster.patchy.aggr.read_64kb": "0",<br>
> > > > "gluster.patchy.aggr.write_64kb": "0",<br>
> > > > "gluster.patchy.aggr.read_128kb": "0",<br>
> > > > "gluster.patchy.aggr.write_128kb": "0",<br>
> > > > "gluster.patchy.aggr.read_256kb": "0",<br>
> > > > "gluster.patchy.aggr.write_256kb": "0",<br>
> > > > "gluster.patchy.aggr.read_512kb": "0",<br>
> > > > "gluster.patchy.aggr.write_512kb": "0",<br>
> > > > "gluster.patchy.aggr.read_1mb": "0",<br>
> > > > "gluster.patchy.aggr.write_1mb": "0",<br>
> > > > "gluster.patchy.aggr.read_2mb": "0",<br>
> > > > "gluster.patchy.aggr.write_2mb": "0",<br>
> > > > "gluster.patchy.aggr.read_4mb": "0",<br>
> > > > "gluster.patchy.aggr.write_4mb": "0",<br>
> > > > "gluster.patchy.aggr.read_8mb": "0",<br>
> > > > "gluster.patchy.aggr.write_8mb": "0",<br>
> > > > "gluster.patchy.aggr.read_16mb": "0",<br>
> > > > "gluster.patchy.aggr.write_16mb": "0",<br>
> > > > "gluster.patchy.aggr.read_32mb": "0",<br>
> > > > "gluster.patchy.aggr.write_32mb": "0",<br>
> > > > "gluster.patchy.aggr.read_64mb": "0",<br>
> > > > "gluster.patchy.aggr.write_64mb": "0",<br>
> > > > "gluster.patchy.aggr.read_128mb": "0",<br>
> > > > "gluster.patchy.aggr.write_128mb": "0",<br>
> > > > "gluster.patchy.aggr.read_256mb": "0",<br>
> > > > "gluster.patchy.aggr.write_256mb": "0",<br>
> > > > "gluster.patchy.aggr.read_512mb": "0",<br>
> > > > "gluster.patchy.aggr.write_512mb": "0",<br>
> > > > "gluster.patchy.aggr.read_1024mb": "0",<br>
> > > > "gluster.patchy.aggr.write_1024mb": "0",<br>
> > > > "gluster.patchy.aggr.fds.open_count": "1",<br>
> > > > "gluster.patchy.aggr.fds.max_open_count": "1",<br>
> > > > "gluster.patchy.aggr.fop.null.count": "-5070885384636858368",<br>
> > > > "gluster.patchy.aggr.fop.null.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.null.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.null.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.stat.count": "-5070885384636858368",<br>
> > > > "gluster.patchy.aggr.fop.stat.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.stat.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.stat.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readlink.count": "-4937050892273713152",<br>
> > > > "gluster.patchy.aggr.fop.readlink.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readlink.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readlink.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.mknod.count": "-4937050853619007488",<br>
> > > > "gluster.patchy.aggr.fop.mknod.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.mknod.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.mknod.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.mkdir.count": "-4937050827849203712",<br>
> > > > "gluster.patchy.aggr.fop.mkdir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.mkdir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.mkdir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.unlink.count": "-4937050802079399936",<br>
> > > > "gluster.patchy.aggr.fop.unlink.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.unlink.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.unlink.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rmdir.count": "-4937050772014628864",<br>
> > > > "gluster.patchy.aggr.fop.rmdir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rmdir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rmdir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.symlink.count": "-4937050746244825088",<br>
> > > > "gluster.patchy.aggr.fop.symlink.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.symlink.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.symlink.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rename.count": "-4937050711885086720",<br>
> > > > "gluster.patchy.aggr.fop.rename.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rename.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rename.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.link.count": "-5070885384636858368",<br>
> > > > "gluster.patchy.aggr.fop.link.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.link.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.link.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.truncate.count": "-4937050660345479168",<br>
> > > > "gluster.patchy.aggr.fop.truncate.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.truncate.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.truncate.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.open.count": "-5070885384636858368",<br>
> > > > "gluster.patchy.aggr.fop.open.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.open.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.open.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.read.count": "-5070885384636858368",<br>
> > > > "gluster.patchy.aggr.fop.read.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.read.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.read.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.write.count": "-4937050578741100544",<br>
> > > > "gluster.patchy.aggr.fop.write.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.write.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.write.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.statfs.count": "-4937050552971296768",<br>
> > > > "gluster.patchy.aggr.fop.statfs.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.statfs.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.statfs.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.flush.count": "-4937050522906525696",<br>
> > > > "gluster.patchy.aggr.fop.flush.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.flush.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.flush.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsync.count": "-4937050497136721920",<br>
> > > > "gluster.patchy.aggr.fop.fsync.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsync.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsync.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.setxattr.count": "-4937050471366918144",<br>
> > > > "gluster.patchy.aggr.fop.setxattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.setxattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.setxattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.getxattr.count": "-4937050432712212480",<br>
> > > > "gluster.patchy.aggr.fop.getxattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.getxattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.getxattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.removexattr.count": "-5071240166115377152",<br>
> > > > "gluster.patchy.aggr.fop.removexattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.removexattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.removexattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.opendir.count": "-4937050342517899264",<br>
> > > > "gluster.patchy.aggr.fop.opendir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.opendir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.opendir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsyncdir.count": "-4937050308158160896",<br>
> > > > "gluster.patchy.aggr.fop.fsyncdir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsyncdir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsyncdir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.access.count": "-4937050269503455232",<br>
> > > > "gluster.patchy.aggr.fop.access.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.access.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.access.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.create.count": "-4937050239438684160",<br>
> > > > "gluster.patchy.aggr.fop.create.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.create.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.create.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.ftruncate.count": "-5071240166115377152",<br>
> > > > "gluster.patchy.aggr.fop.ftruncate.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.ftruncate.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.ftruncate.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fstat.count": "-4937050166424240128",<br>
> > > > "gluster.patchy.aggr.fop.fstat.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fstat.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fstat.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.lk.count": "-5070885384636858368",<br>
> > > > "gluster.patchy.aggr.fop.lk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.lk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.lk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.lookup.count": "-4937050127769534464",<br>
> > > > "gluster.patchy.aggr.fop.lookup.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.lookup.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.lookup.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readdir.count": "-4937050097704763392",<br>
> > > > "gluster.patchy.aggr.fop.readdir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readdir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readdir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.inodelk.count": "-4937050063345025024",<br>
> > > > "gluster.patchy.aggr.fop.inodelk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.inodelk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.inodelk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.finodelk.count": "-4937050028985286656",<br>
> > > > "gluster.patchy.aggr.fop.finodelk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.finodelk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.finodelk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.entrylk.count": "-4937049990330580992",<br>
> > > > "gluster.patchy.aggr.fop.entrylk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.entrylk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.entrylk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fentrylk.count": "-4937049955970842624",<br>
> > > > "gluster.patchy.aggr.fop.fentrylk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fentrylk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fentrylk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.xattrop.count": "-4937049917316136960",<br>
> > > > "gluster.patchy.aggr.fop.xattrop.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.xattrop.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.xattrop.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fxattrop.count": "-4937049882956398592",<br>
> > > > "gluster.patchy.aggr.fop.fxattrop.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fxattrop.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fxattrop.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fgetxattr.count": "-5071240166115377152",<br>
> > > > "gluster.patchy.aggr.fop.fgetxattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fgetxattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fgetxattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsetxattr.count": "-5071240166115377152",<br>
> > > > "gluster.patchy.aggr.fop.fsetxattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsetxattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsetxattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rchecksum.count": "-5071240166115377152",<br>
> > > > "gluster.patchy.aggr.fop.rchecksum.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rchecksum.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.rchecksum.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.setattr.count": "-4937049715452674048",<br>
> > > > "gluster.patchy.aggr.fop.setattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.setattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.setattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsetattr.count": "-4937049681092935680",<br>
> > > > "gluster.patchy.aggr.fop.fsetattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsetattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fsetattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readdirp.count": "-4937049642438230016",<br>
> > > > "gluster.patchy.aggr.fop.readdirp.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readdirp.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.readdirp.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.forget.count": "-4937049603783524350",<br>
> > > > "gluster.patchy.aggr.fop.forget.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.forget.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.forget.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.release.count": "-4937049573718753280",<br>
> > > > "gluster.patchy.aggr.fop.release.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.release.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.release.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.releasedir.count": "-5071240166115377149",<br>
> > > > "gluster.patchy.aggr.fop.releasedir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.releasedir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.releasedir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.getspec.count": "-4937049492114374656",<br>
> > > > "gluster.patchy.aggr.fop.getspec.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.getspec.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.getspec.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fremovexattr.count": "-5071240166115377152",<br>
> > > > "gluster.patchy.aggr.fop.fremovexattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fremovexattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fremovexattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fallocate.count": "-5071240166115377152",<br>
> > > > "gluster.patchy.aggr.fop.fallocate.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fallocate.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.fallocate.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.discard.count": "-4937049358970388480",<br>
> > > > "gluster.patchy.aggr.fop.discard.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.discard.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.discard.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.zerofill.count": "-4937049324610650112",<br>
> > > > "gluster.patchy.aggr.fop.zerofill.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.zerofill.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.zerofill.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.ipc.count": "-5070885384636858368",<br>
> > > > "gluster.patchy.aggr.fop.ipc.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.ipc.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.fop.ipc.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.aggr.uptime": "349665",<br>
> > > > "gluster.patchy.aggr.bytes_read": "0",<br>
> > > > "gluster.patchy.aggr.bytes_written": "11698176"<br>
> > > > }<br>
> > > > {<br>
> > > > "gluster.patchy.inter.read_1b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_1b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_2b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_2b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_4b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_4b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_8b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_8b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_16b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_16b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_32b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_32b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_64b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_64b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_128b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_128b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_256b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_256b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_512b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_512b_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_1kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_1kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_2kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_2kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_4kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_4kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_8kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_8kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_16kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_16kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_32kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_32kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_64kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_64kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_128kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_128kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_256kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_256kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_512kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_512kb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_1mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_1mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_2mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_2mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_4mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_4mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_8mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_8mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_16mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_16mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_32mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_32mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_64mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_64mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_128mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_128mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_256mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_256mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_512mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_512mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.read_1024mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.write_1024mb_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.null.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.null.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.null.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.null.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.stat.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.stat.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.stat.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.stat.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readlink.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readlink.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readlink.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readlink.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.mknod.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.mknod.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.mknod.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.mknod.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.mkdir.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.mkdir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.mkdir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.mkdir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.unlink.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.unlink.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.unlink.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.unlink.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rmdir.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rmdir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rmdir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rmdir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.symlink.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.symlink.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.symlink.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.symlink.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rename.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rename.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rename.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rename.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.link.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.link.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.link.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.link.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.truncate.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.truncate.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.truncate.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.truncate.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.open.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.open.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.open.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.open.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.read.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.read.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.read.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.read.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.write.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.write.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.write.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.write.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.statfs.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.statfs.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.statfs.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.statfs.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.flush.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.flush.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.flush.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.flush.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsync.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsync.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsync.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsync.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.setxattr.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.setxattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.setxattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.setxattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.getxattr.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.getxattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.getxattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.getxattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.removexattr.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.removexattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.removexattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.removexattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.opendir.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.opendir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.opendir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.opendir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsyncdir.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsyncdir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsyncdir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsyncdir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.access.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.access.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.access.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.access.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.create.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.create.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.create.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.create.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.ftruncate.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.ftruncate.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.ftruncate.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.ftruncate.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fstat.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fstat.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fstat.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fstat.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.lk.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.lk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.lk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.lk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.lookup.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.lookup.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.lookup.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.lookup.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readdir.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readdir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readdir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readdir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.inodelk.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.inodelk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.inodelk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.inodelk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.finodelk.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.finodelk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.finodelk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.finodelk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.entrylk.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.entrylk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.entrylk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.entrylk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fentrylk.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fentrylk.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fentrylk.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fentrylk.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.xattrop.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.xattrop.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.xattrop.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.xattrop.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fxattrop.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fxattrop.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fxattrop.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fxattrop.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fgetxattr.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fgetxattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fgetxattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fgetxattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsetxattr.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsetxattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsetxattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsetxattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rchecksum.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rchecksum.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rchecksum.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.rchecksum.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.setattr.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.setattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.setattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.setattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsetattr.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsetattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsetattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fsetattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readdirp.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readdirp.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readdirp.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.readdirp.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.forget.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.forget.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.forget.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.forget.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.release.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.release.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.release.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.release.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.releasedir.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.releasedir.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.releasedir.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.releasedir.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.getspec.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.getspec.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.getspec.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.getspec.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fremovexattr.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fremovexattr.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fremovexattr.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fremovexattr.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fallocate.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fallocate.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fallocate.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.fallocate.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.discard.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.discard.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.discard.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.discard.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.zerofill.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.zerofill.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.zerofill.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.zerofill.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.ipc.per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.ipc.latency_ave_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.ipc.latency_min_usec": "0.00",<br>
> > > > "gluster.patchy.inter.fop.ipc.latency_max_usec": "0.00",<br>
> > > > "gluster.patchy.inter.sample_interval_sec": "5.01",<br>
> > > > "gluster.patchy.inter.bytes_read_per_sec": "0.00",<br>
> > > > "gluster.patchy.inter.bytes_written_per_sec": "0.00"<br>
> > > > }<br>
> > > ><br>
> > > > --<br>
> > > > Emmanuel Dreyfus<br>
> > > > <a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a><br>
> > > ><br>
> > > _______________________________________________<br>
> > > Gluster-devel mailing list<br>
> > > <a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
> > > <a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
> > ><br>
> ><br>
><br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br><div>Raghavendra G<br></div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature">Raghavendra G<br></div>
</div>