<html><body><div style="font-family: times new roman, new york, times, serif; font-size: 12pt; color: #000000"><div>Hi Serkan,<br></div><div><br></div><div>I have gone through the logs and can see there are some blocked inode lock requests.</div><div>We have observed that some other user have also faced this issue with similar logs.<br></div><div>I think you have tried some rolling update on your setup or some NODES , on which you have collected these statedumps, must have gone down for one or other reason.<br></div><div> <br>We will further dig it up and will try to find out the root cause. Till than you can resolve this issue by restarting the volume which will restart nfs and shd and will release any locks taken by these process.<br></div><div><br></div><div>"gluster volume start <volname> force" will do the same.<br></div><div><br></div><div>Regards,<br></div><div>Ashish<br></div><div><br></div><div><br></div><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"Serkan Çoban" <cobanserkan@gmail.com><br><b>To: </b>"Ashish Pandey" <aspandey@redhat.com><br><b>Cc: </b>"Gluster Users" <gluster-users@gluster.org>, "Gluster Devel" <gluster-devel@gluster.org><br><b>Sent: </b>Monday, April 18, 2016 11:51:37 AM<br><b>Subject: </b>Re: [Gluster-users] Assertion failed: ec_get_inode_size<br><div><br></div>You can find the statedumps of server and client in below link.<br>Gluster version is 3.7.10, 78x(16+4) disperse setup. 60 nodes named<br>node185..node244<br>https://www.dropbox.com/s/cc2dgsxwuk48mba/gluster_statedumps.zip?dl=0<br><div><br></div><br>On Fri, Apr 15, 2016 at 9:52 PM, Ashish Pandey <aspandey@redhat.com> wrote:<br>><br>> Actually it was my mistake I overlooked the configuration you provided..It<br>> will be huge.<br>> I would suggest to take statedump on all the nodes and try to grep for<br>> "BLOCKED" in statedump files on all the nodes.<br>> See if you can see any such line in any file and send those files. No need<br>> to send statedump of all the bricks..<br>><br>><br>><br>><br>> ________________________________<br>> From: "Serkan Çoban" <cobanserkan@gmail.com><br>> To: "Ashish Pandey" <aspandey@redhat.com><br>> Cc: "Gluster Users" <gluster-users@gluster.org>, "Gluster Devel"<br>> <gluster-devel@gluster.org><br>> Sent: Friday, April 15, 2016 6:07:00 PM<br>><br>> Subject: Re: [Gluster-users] Assertion failed: ec_get_inode_size<br>><br>> Hi Asish,<br>><br>> Sorry for the question but do you want all brick statedumps from all<br>> servers or all brick dumps from one server?<br>> All server brick dumps is nearly 700MB zipped..<br>><br>> On Fri, Apr 15, 2016 at 2:16 PM, Ashish Pandey <aspandey@redhat.com> wrote:<br>>><br>>> To get the state dump of fuse client-<br>>> 1 - get the PID of fuse mount process<br>>> 2 - kill -USR1 <PID><br>>><br>>> statedump can be found in the same directory where u get for brick<br>>> process.<br>>><br>>> Following link could be helpful for future reference -<br>>><br>>> https://github.com/gluster/glusterfs/blob/master/doc/debugging/statedump.md<br>>><br>>> Ashish<br>>><br>>> ________________________________<br>>> From: "Serkan Çoban" <cobanserkan@gmail.com><br>>> To: "Ashish Pandey" <aspandey@redhat.com><br>>> Cc: "Gluster Users" <gluster-users@gluster.org>, "Gluster Devel"<br>>> <gluster-devel@gluster.org><br>>> Sent: Friday, April 15, 2016 4:02:20 PM<br>>> Subject: Re: [Gluster-users] Assertion failed: ec_get_inode_size<br>>><br>>> Yes it is only one brick which error appears. I can send all other<br>>> brick dumps too..<br>>> How can I get state dump in fuse client? There is no gluster command<br>>> there..<br>>> _______________________________________________<br>>> Gluster-users mailing list<br>>> Gluster-users@gluster.org<br>>> http://www.gluster.org/mailman/listinfo/gluster-users<br>>><br>> _______________________________________________<br>> Gluster-users mailing list<br>> Gluster-users@gluster.org<br>> http://www.gluster.org/mailman/listinfo/gluster-users<br>><br>_______________________________________________<br>Gluster-users mailing list<br>Gluster-users@gluster.org<br>http://www.gluster.org/mailman/listinfo/gluster-users</div><div><br></div></div></body></html>