<HTML><HEAD>
<STYLE id=eMClientCss>blockquote.cite { margin-left: 5px; margin-right: 0px; padding-left: 10px; padding-right:0px; border-left: 1px solid #cccccc }
blockquote.cite2 {margin-left: 5px; margin-right: 0px; padding-left: 10px; padding-right:0px; border-left: 1px solid #cccccc; margin-top: 3px; padding-top: 0px; }
.plain pre, .plain tt { font-family: monospace; font-size: 100%; font-weight: normal; font-style: normal; white-space: pre-wrap; }
a img { border: 0px; }body {font-family: Times New Roman;font-size: 12pt;}
.plain pre, .plain tt {font-family: Times New Roman;font-size: 12pt;}

BLOCKQUOTE.cite {
        PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px
}
BLOCKQUOTE.cite2 {
        PADDING-TOP: 0px; PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; MARGIN-TOP: 3px; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px
}
.plain PRE {
        FONT-SIZE: 100%; FONT-FAMILY: monospace; WHITE-SPACE: pre-wrap; FONT-WEIGHT: normal; FONT-STYLE: normal
}
.plain TT {
        FONT-SIZE: 100%; FONT-FAMILY: monospace; WHITE-SPACE: pre-wrap; FONT-WEIGHT: normal; FONT-STYLE: normal
}
A IMG {
        BORDER-TOP: 0px; BORDER-RIGHT: 0px; BORDER-BOTTOM: 0px; BORDER-LEFT: 0px
}
BODY {
        FONT-SIZE: 12pt; FONT-FAMILY: Times New Roman
}
.plain PRE {
        FONT-SIZE: 12pt; FONT-FAMILY: Times New Roman
}
.plain TT {
        FONT-SIZE: 12pt; FONT-FAMILY: Times New Roman
}</STYLE>

<STYLE title=signatureStyle>#x99d0c83487814dbda3bd1696eb29eaa0 P.MsoNormal {
        FONT-SIZE: 11pt; FONT-FAMILY: "Calibri","sans-serif"; MARGIN: 0in 0in 0pt
}
DIV.MsoNormal {
        FONT-SIZE: 11pt; FONT-FAMILY: "Calibri","sans-serif"; MARGIN: 0in 0in 0pt
}
LI.MsoNormal {
        FONT-SIZE: 11pt; FONT-FAMILY: "Calibri","sans-serif"; MARGIN: 0in 0in 0pt
}
#x99d0c83487814dbda3bd1696eb29eaa0 A:link {
        TEXT-DECORATION: underline; COLOR: blue; mso-style-priority: 99
}
SPAN.MsoHyperlink {
        TEXT-DECORATION: underline; COLOR: blue; mso-style-priority: 99
}
#x99d0c83487814dbda3bd1696eb29eaa0 A:visited {
        TEXT-DECORATION: underline; COLOR: purple; mso-style-priority: 99
}
SPAN.MsoHyperlinkFollowed {
        TEXT-DECORATION: underline; COLOR: purple; mso-style-priority: 99
}
#x99d0c83487814dbda3bd1696eb29eaa0 SPAN.EmailStyle17 {
        FONT-FAMILY: "Calibri","sans-serif"; COLOR: windowtext; mso-style-type: personal-compose
}
#x99d0c83487814dbda3bd1696eb29eaa0 .MsoChpDefault {
        FONT-FAMILY: "Calibri","sans-serif"; mso-style-type: export-only
}
#x99d0c83487814dbda3bd1696eb29eaa0 DIV.WordSection1 {
        page: WordSection1
}
</STYLE>
</HEAD>
<BODY>
<DIV>I upgrade my systems to 3.6.3 and some of my clients are now having issues connecting.&nbsp; I can mount using NFS without any issues.&nbsp; However, when I try to FUSE mount, it times out on many of my nodes.&nbsp; It mounted to approximately 400-nodes.&nbsp; However, the remainder timed out.&nbsp; Any suggestions for how to fix?</DIV>
<DIV>&nbsp;</DIV>
<DIV>On the client side, I am getting the following in the logs: </DIV>
<DIV>&nbsp;</DIV>
<DIV>[2015-05-05 00:17:18.013319] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.6.3<BR>(args: /usr/sbin/glusterfs --volfile-server=gfsib01a.corvidtec.com --volfile-server-transport=tcp --volfile-id=/homegfs.tcp /homegfs_test)<BR>[2015-05-05 00:18:21.019012] E [socket.c:2276:socket_connect_finish] 0-glusterfs: connection to 10.1.70.1:24007 failed (Connection timed out)<BR>[2015-05-05 00:18:21.019092] E [glusterfsd-mgmt.c:1811:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: gfsib01a.corvidtec<BR>.com (Transport endpoint is not connected)<BR>[2015-05-05 00:18:21.019100] I [glusterfsd-mgmt.c:1817:mgmt_rpc_notify] 0-glusterfsd-mgmt: Exhausted all volfile servers<BR>[2015-05-05 00:18:21.019224] W [glusterfsd.c:1194:cleanup_and_exit] (--&gt; 0-: received signum (1), shutting down<BR>[2015-05-05 00:18:21.019239] I [fuse-bridge.c:5599:fini] 0-fuse: Unmounting '/homegfs_test'.<BR>[2015-05-05 00:18:21.027770] W [glusterfsd.c:1194:cleanup_and_exit] (--&gt; 0-: received signum (15), shutting down<BR></DIV>
<DIV>Logs from my server are attached... </DIV>
<DIV>&nbsp;</DIV>
<DIV>[root@gfs01a log]# gluster volume status homegfs<BR>Status of volume: homegfs<BR>Gluster process&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Port&nbsp;&nbsp;&nbsp; Online&nbsp; Pid<BR>------------------------------------------------------------------------------<BR>Brick gfsib01a.corvidtec.com:/data/brick01a/homegfs&nbsp;&nbsp;&nbsp;&nbsp; 49152&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3816<BR>Brick gfsib01b.corvidtec.com:/data/brick01b/homegfs&nbsp;&nbsp;&nbsp;&nbsp; 49152&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3826<BR>Brick gfsib01a.corvidtec.com:/data/brick02a/homegfs&nbsp;&nbsp;&nbsp;&nbsp; 49153&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3821<BR>Brick gfsib01b.corvidtec.com:/data/brick02b/homegfs&nbsp;&nbsp;&nbsp;&nbsp; 49153&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3831<BR>Brick gfsib02a.corvidtec.com:/data/brick01a/homegfs&nbsp;&nbsp;&nbsp;&nbsp; 49152&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3959<BR>Brick gfsib02b.corvidtec.com:/data/brick01b/homegfs&nbsp;&nbsp;&nbsp;&nbsp; 49152&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3970<BR>Brick gfsib02a.corvidtec.com:/data/brick02a/homegfs&nbsp;&nbsp;&nbsp;&nbsp; 49153&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3964<BR>Brick gfsib02b.corvidtec.com:/data/brick02b/homegfs&nbsp;&nbsp;&nbsp;&nbsp; 49153&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3975<BR>NFS Server on localhost&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2049&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3830<BR>Self-heal Daemon on localhost&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3835<BR>NFS Server on gfsib01b.corvidtec.com&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2049&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3840<BR>Self-heal Daemon on gfsib01b.corvidtec.com&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3845<BR>NFS Server on gfsib02b.corvidtec.com&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2049&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3984<BR>Self-heal Daemon on gfsib02b.corvidtec.com&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3989<BR>NFS Server on gfsib02a.corvidtec.com&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2049&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3973<BR>Self-heal Daemon on gfsib02a.corvidtec.com&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3978<BR>&nbsp;<BR>Task Status of Volume homegfs<BR>------------------------------------------------------------------------------<BR>Task&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; : Rebalance&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <BR>ID&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; : 58b6cc76-c29c-4695-93fe-c42b1112e171<BR>Status&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; : completed&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <BR>&nbsp;<BR></DIV>
<DIV>&nbsp;</DIV>
<DIV>[root@gfs01a log]# gluster volume info homegfs<BR>&nbsp;<BR>Volume Name: homegfs<BR>Type: Distributed-Replicate<BR>Volume ID: 1e32672a-f1b7-4b58-ba94-58c085e59071<BR>Status: Started<BR>Number of Bricks: 4 x 2 = 8<BR>Transport-type: tcp<BR>Bricks:<BR>Brick1: gfsib01a.corvidtec.com:/data/brick01a/homegfs<BR>Brick2: gfsib01b.corvidtec.com:/data/brick01b/homegfs<BR>Brick3: gfsib01a.corvidtec.com:/data/brick02a/homegfs<BR>Brick4: gfsib01b.corvidtec.com:/data/brick02b/homegfs<BR>Brick5: gfsib02a.corvidtec.com:/data/brick01a/homegfs<BR>Brick6: gfsib02b.corvidtec.com:/data/brick01b/homegfs<BR>Brick7: gfsib02a.corvidtec.com:/data/brick02a/homegfs<BR>Brick8: gfsib02b.corvidtec.com:/data/brick02b/homegfs<BR>Options Reconfigured:<BR>server.manage-gids: on<BR>changelog.rollover-time: 15<BR>changelog.fsync-interval: 3<BR>changelog.changelog: on<BR>geo-replication.ignore-pid-check: on<BR>geo-replication.indexing: off<BR>storage.owner-gid: 100<BR>network.ping-timeout: 10<BR>server.allow-insecure: on<BR>performance.write-behind-window-size: 128MB<BR>performance.cache-size: 128MB<BR>performance.io-thread-count: 32<BR></DIV>
<DIV>&nbsp;</DIV>
<DIV>David</DIV>
<DIV>&nbsp;</DIV>
<DIV>&nbsp;</DIV>
<DIV>&nbsp;</DIV>
<DIV id=signature_old>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: Times New Roman"><SPAN id=xc493ce70c1c64653841aa9f5ac6ad16e><SPAN id=x834d59d53b4a45d8a1f25809459ef478>
<DIV class=WordSection1><SPAN id=x99d0c83487814dbda3bd1696eb29eaa0>
<P class=MsoNormal>======================== </P>
<P class=MsoNormal>&nbsp;</P>
<P class=MsoNormal><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Times New Roman","serif"'>David F. Robinson, Ph.D.</SPAN></P>
<P class=MsoNormal><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Times New Roman","serif"'>President - Corvid Technologies</SPAN></P>
<P class=MsoNormal><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Times New Roman","serif"'>145 Overhill Drive</SPAN></P>
<P class=MsoNormal><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Times New Roman","serif"'>Mooresville, NC 28117</SPAN></P>
<P class=MsoNormal><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Times New Roman","serif"'>704.799.6944 x101&nbsp;&nbsp; [Office]</SPAN></P>
<P class=MsoNormal><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Times New Roman","serif"'>704.252.1310&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; [Cell]</SPAN></P>
<P class=MsoNormal><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Times New Roman","serif"'>704.799.7974&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; [Fax]</SPAN></P>
<P class=MsoNormal>d<A href="mailto:David.Robinson@corvidtec.com">avid.robinson@corvidtec.com</A></P>
<P class=MsoNormal><A href="http://www.corvidtec.com/"><SPAN style='FONT-SIZE: 10pt; FONT-FAMILY: "Times New Roman","serif"; COLOR: blue'>http://www.corvidtec.com</SPAN></A></P></SPAN></DIV></SPAN></SPAN></DIV></DIV>
<DIV>&nbsp;</DIV></BODY></HTML>