<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: Arial; font-size: 10pt; color: #000000'><font face="Arial"><span style="font-size: 10pt;">A hard reboot solved it for me too, but I am a little worried on the stability of it.</span></font><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">The entire wordpress web root is stored on the gluster volume, a day later I attempted to tar/gzip the web directory on the gluster volume and again the load on one particular server sky rocketed, server became unresponsive and kernel hang messages appeared claiming the gzip process was hanging. It seems that if I cause any serious IO on the volume, things seem to snowball. </div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><span style="font-size: 10pt;"><br></span></div><div><font face="Arial"><span style="font-size: 10pt;">There are 3 web nodes with a replicated gluster volume between them all. Each web node also mounts the gluster volume locally using NFS (an attempt to improve performance for lots of small php files). I tried </span><span style="font-size: 13.3333330154419px;">mounting</span><span style="font-size: 10pt;"> native glusterfs instead of NFS for client mount, but I had the same issues.</span></font></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">ii glusterfs-client 3.6.2-ubuntu1~trusty3 amd64 clustered file-system (client package)</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">ii glusterfs-common 3.6.2-ubuntu1~trusty3 amd64 GlusterFS common libraries and translator modules</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">ii glusterfs-server 3.6.2-ubuntu1~trusty3 amd64 clustered file-system (server package)</span></font></div></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Volume Name: my_filestore_vol</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Type: Replicate</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Volume ID: xyz</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Status: Started</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Number of Bricks: 1 x 3 = 3</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Transport-type: tcp</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Bricks:</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Brick1: my-web01:/export/brick0</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Brick2: my-web02:/export/brick0</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Brick3: my-web03:/export/brick0</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Options Reconfigured:</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">nfs.drc: off</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">diagnostics.brick-log-level: WARNING</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Status of volume: my_filestore_vol</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Gluster process Port Online Pid</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">------------------------------------------------------------------------------</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Brick my-web01:/export/brick0 49152 Y 2138</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Brick my-web02:/export/brick0 49152 Y 21104</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Brick my-web03:/export/brick0 49152 Y 1827</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">NFS Server on localhost 2049 Y 2145</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Self-heal Daemon on localhost N/A Y 2152</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">NFS Server on my-web03 2049 Y 1834</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Self-heal Daemon on my-web03 N/A Y 1841</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">NFS Server on my-web02 2049 Y 21118</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Self-heal Daemon on my-web02 N/A Y 21123</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;"><br></span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">Task Status of Volume my_filestore_vol</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">------------------------------------------------------------------------------</span></font></div><div><font face="Arial"><span style="font-size: 13.3333330154419px;">There are no active volume tasks</span></font></div></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">Regards,</div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;"><br></div><div style="color: rgb(0, 0, 0); font-family: Arial; font-size: 10pt;">A<br><br><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Hoggins!" <fuckspam@wheres5.com><br><b>To: </b>gluster-users@gluster.org<br><b>Sent: </b>Friday, 8 May, 2015 1:25:26 PM<br><b>Subject: </b>Re: [Gluster-users] High load / hang<br><br>
<font size="-1"><font face="Helvetica, Arial, sans-serif">Well,
that's "funny", because the exact same thing happened to me this
morning, except that I could hard reboot the machine, and it got
up and running normally again.<br>
But the symptoms you describe are oddly similar, and strangely
simultaneous.<br>
</font></font><br>
<div class="moz-cite-prefix">Le 08/05/2015 10:36, Alun James a
écrit :<br>
</div>
<blockquote cite="mid:255ea5a9-94c8-4a5e-aae5-606f0a6ee938@bossk">Hi folks,
<div><br>
</div>
<div>I have a 3 node gluster/web/db cluster running a Wordpress
site . This morning one of the nodes is under very high load and
the mounted gluster partition is inaccessible. Attempts to
reboot that node have failed with the server seemingly
hung/blocked. Has anyone else experienced this or can give any
pointers in how to diagnose the cause of gluster going awry?</div>
</blockquote>
<br>
<br>_______________________________________________<br>Gluster-users mailing list<br>Gluster-users@gluster.org<br>http://www.gluster.org/mailman/listinfo/gluster-users</div><br></div></div></body></html>