<HTML><HEAD>
<STYLE id=eMClientCss>blockquote.cite { margin-left: 5px; margin-right: 0px; padding-left: 10px; padding-right:0px; border-left: 1px solid #cccccc }
blockquote.cite2 {margin-left: 5px; margin-right: 0px; padding-left: 10px; padding-right:0px; border-left: 1px solid #cccccc; margin-top: 3px; padding-top: 0px; }
.plain pre, .plain tt { font-family: monospace; font-size: 100%; font-weight: normal; font-style: normal;}
a img { border: 0px; }body {font-family: Times New Roman;font-size: 12pt;}
.plain pre, .plain tt {font-family: Times New Roman;font-size: 12pt;}
</STYLE>
<STYLE>#xb0ba93f1518347a49cb4c8e25d6d3e59 BLOCKQUOTE.cite
{PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px}
#xb0ba93f1518347a49cb4c8e25d6d3e59 BLOCKQUOTE.cite2
{MARGIN-TOP: 3px; PADDING-TOP: 0px; PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px}
#xb0ba93f1518347a49cb4c8e25d6d3e59 .plain PRE, #xb0ba93f1518347a49cb4c8e25d6d3e59 .plain TT
{FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal}
#xb0ba93f1518347a49cb4c8e25d6d3e59 A IMG
{BORDER-TOP: 0px; BORDER-RIGHT: 0px; BORDER-BOTTOM: 0px; BORDER-LEFT: 0px}
#xb0ba93f1518347a49cb4c8e25d6d3e59 .plain PRE, #xb0ba93f1518347a49cb4c8e25d6d3e59 .plain TT, #xb0ba93f1518347a49cb4c8e25d6d3e59
{FONT-SIZE: 12pt; FONT-FAMILY: Times New Roman}
#xb0ba93f1518347a49cb4c8e25d6d3e59 DIV.MsoNormal, #xb0ba93f1518347a49cb4c8e25d6d3e59 LI.MsoNormal
{FONT-SIZE: 11pt; FONT-FAMILY: "Calibri","sans-serif"; MARGIN: 0in 0in 0pt}
#xb0ba93f1518347a49cb4c8e25d6d3e59 SPAN.MsoHyperlink
{TEXT-DECORATION: underline; COLOR: blue; mso-style-priority: 99}
#xb0ba93f1518347a49cb4c8e25d6d3e59 SPAN.MsoHyperlinkFollowed
{TEXT-DECORATION: underline; COLOR: purple; mso-style-priority: 99}
</STYLE>
</HEAD>
<BODY scroll=auto class>
<DIV> </DIV>
<DIV> </DIV>
<DIV id=xb0ba93f1518347a49cb4c8e25d6d3e59>
<BLOCKQUOTE class=cite2 cite=eme3b2cb80-8be2-4fa5-9d08-4710955e237c@dfrobins-vaio type="cite">
<DIV>I am having issues with 3.6.6 where the load will spike up to 800% for one of the glusterfsd processes and the users can no longer access the system. If I reboot the node, the heal will finish normally after a few minutes and the system will be responsive, but a few hours later the issue will start again. It look like it is hanging in a heal and spinning up the load on one of the bricks. The heal gets stuck and says it is crawling and never returns. After a few minutes of the heal saying it is crawling, the load spikes up and the mounts become unresponsive.</DIV>
<DIV> </DIV>
<DIV>Any suggestions on how to fix this? It has us stopped cold as the user can no longer access the systems when the load spikes... Logs attached.</DIV>
<DIV> </DIV>
<DIV>System setup info is: </DIV>
<DIV> </DIV>
<DIV>[root@gfs01a ~]# gluster volume info homegfs<BR> <BR>Volume Name: homegfs<BR>Type: Distributed-Replicate<BR>Volume ID: 1e32672a-f1b7-4b58-ba94-58c085e59071<BR>Status: Started<BR>Number of Bricks: 4 x 2 = 8<BR>Transport-type: tcp<BR>Bricks:<BR>Brick1: gfsib01a.corvidtec.com:/data/brick01a/homegfs<BR>Brick2: gfsib01b.corvidtec.com:/data/brick01b/homegfs<BR>Brick3: gfsib01a.corvidtec.com:/data/brick02a/homegfs<BR>Brick4: gfsib01b.corvidtec.com:/data/brick02b/homegfs<BR>Brick5: gfsib02a.corvidtec.com:/data/brick01a/homegfs<BR>Brick6: gfsib02b.corvidtec.com:/data/brick01b/homegfs<BR>Brick7: gfsib02a.corvidtec.com:/data/brick02a/homegfs<BR>Brick8: gfsib02b.corvidtec.com:/data/brick02b/homegfs<BR>Options Reconfigured:<BR>performance.io-thread-count: 32<BR>performance.cache-size: 128MB<BR>performance.write-behind-window-size: 128MB<BR>server.allow-insecure: on<BR>network.ping-timeout: 42<BR>storage.owner-gid: 100<BR>geo-replication.indexing: off<BR>geo-replication.ignore-pid-check: on<BR>changelog.changelog: off<BR>changelog.fsync-interval: 3<BR>changelog.rollover-time: 15<BR>server.manage-gids: on<BR>diagnostics.client-log-level: WARNING</DIV>
<DIV> </DIV>
<DIV>[root@gfs01a ~]# rpm -qa | grep gluster<BR>gluster-nagios-common-0.1.1-0.el6.noarch<BR>glusterfs-fuse-3.6.6-1.el6.x86_64<BR>glusterfs-debuginfo-3.6.6-1.el6.x86_64<BR>glusterfs-libs-3.6.6-1.el6.x86_64<BR>glusterfs-geo-replication-3.6.6-1.el6.x86_64<BR>glusterfs-api-3.6.6-1.el6.x86_64<BR>glusterfs-devel-3.6.6-1.el6.x86_64<BR>glusterfs-api-devel-3.6.6-1.el6.x86_64<BR>glusterfs-3.6.6-1.el6.x86_64<BR>glusterfs-cli-3.6.6-1.el6.x86_64<BR>glusterfs-rdma-3.6.6-1.el6.x86_64<BR>samba-vfs-glusterfs-4.1.11-2.el6.x86_64<BR>glusterfs-server-3.6.6-1.el6.x86_64<BR>glusterfs-extra-xlators-3.6.6-1.el6.x86_64<BR></DIV>
<DIV> </DIV>
<DIV id=signature_old>
<DIV style="FONT-SIZE: 12pt; FONT-FAMILY: Times New Roman"><SPAN id=xc493ce70c1c64653841aa9f5ac6ad16e><SPAN id=x834d59d53b4a45d8a1f25809459ef478>
<DIV class=WordSection1><FONT face=Calibri></FONT> </DIV></SPAN></SPAN></DIV></DIV></BLOCKQUOTE></DIV></BODY></HTML>