<html><body><div style="font-family: times new roman,new york,times,serif; font-size: 12pt; color: #000000"><div>Hi,<br></div><div><br></div><div>The error that you see in the log file, is fixed as a part of patch <a href="http://review.gluster.org/#/c/10206/">http://review.gluster.org/#/c/10206/</a> (release 3.8.0)<br></div><div>But these errors are not responsible for the "Transport endpoint not connected issues." Can you check if there are any other errors reported in the log?<br></div><div><br></div><div>Regards,<br></div><div>Poornima<br></div><div><br></div><hr id="zwchr"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"ngsflow" <ngsflow@hygenomics.com><br><b>To: </b>"gluster-users" <gluster-users@gluster.org><br><b>Sent: </b>Sunday, August 21, 2016 7:53:38 PM<br><b>Subject: </b>[Gluster-users] iobuf/iobref error<br><div><br></div><div><div style="font-family: 'lucida Grande', Verdana; line-height: normal;" data-mce-style="font-family: 'lucida Grande', Verdana; line-height: normal;">Hi:</div><div style="font-family: 'lucida Grande', Verdana; line-height: normal;" data-mce-style="font-family: 'lucida Grande', Verdana; line-height: normal;"><br></div><div style="font-family: 'lucida Grande', Verdana; line-height: normal;" data-mce-style="font-family: 'lucida Grande', Verdana; line-height: normal;"><div>I'v been experiencing an intermittent issue with GlusterFS in 30 nodes cluster which makes the mounted file system unavailable through the GlusterFS client.</div><div><br></div><div>The symptom is:</div><div><br></div><div>$ ls /gluster</div><div>ls: cannot access /gluster: Transport endpoint is not connected</div><div><br></div><div>the client log reports the following error:</div><div><br></div><div>[2016-08-09 23:25:36.012877] E [iobuf.c:759:iobuf_unref] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x371a220580] (--> /usr/li</div><div>b64/glusterfs/3.6.7/xlator/performance/quick-read.so(qr_readv_cached+0xb7)[0x7ff57f318ea7] (--> /usr/lib64/glusterfs/3.6.7/xlator/performance/</div><div>quick-read.so(qr_readv+0x62)[0x7ff57f3194c2] (--> /usr/lib64/libglusterfs.so.0(default_readv_resume+0x14d)[0x371a22a75d] (--> /usr/lib64/libgl</div><div>usterfs.so.0(call_resume+0x3d6)[0x371a2424b6] ))))) 0-iobuf: invalid argument: iobuf</div><div>[2016-08-09 23:25:36.013192] E [iobuf.c:865:iobref_unref] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x371a220580] (--> /usr/l</div><div>ib64/glusterfs/3.6.7/xlator/performance/quick-read.so(qr_readv_cached+0xc1)[0x7ff57f318eb1] (--> /usr/lib64/glusterfs/3.6.7/xlator/performance</div><div>/quick-read.so(qr_readv+0x62)[0x7ff57f3194c2] (--> /usr/lib64/libglusterfs.so.0(default_readv_resume+0x14d)[0x371a22a75d] (--> /usr/lib64/libg</div><div>lusterfs.so.0(call_resume+0x3d6)[0x371a2424b6] ))))) 0-iobuf: invalid argument: iobref</div><div><br></div><div>seems to me it's the out-of-memory issue.</div><div><br></div><div><br></div><div>info: glusterfs is configured as follows</div><div><br></div><div>performance.io-thread-count: 4</div><div>performance.cache-max-file-size: 0</div><div>performance.write-behind-window-size: 64MB</div><div>performance.cache-size: 4GB</div><div>cluster.consistent-metadata: on</div><div><br></div><div>and each node in cluster are deployed both glusterfs client and server.</div><div><br></div><div><br></div><div><span style="line-height: 1.5;" data-mce-style="line-height: 1.5;">is there any way to ease the above issue via modify configuration? such as increase cache-size, or some other paramters?</span></div></div><div style="font-family: 'lucida Grande', Verdana; line-height: normal;" data-mce-style="font-family: 'lucida Grande', Verdana; line-height: normal;"><span style="line-height: 1.5;" data-mce-style="line-height: 1.5;"><br></span></div><div style="font-family: 'lucida Grande', Verdana; line-height: normal;" data-mce-style="font-family: 'lucida Grande', Verdana; line-height: normal;">thx.</div></div><div><br></div><br>_______________________________________________<br>Gluster-users mailing list<br>Gluster-users@gluster.org<br>http://www.gluster.org/mailman/listinfo/gluster-users</blockquote><div><br></div></div></body></html>