<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
To satisfy this curiosity, however, ubuntu 12.04's
libc6-2.15-0ubuntu10.5 produces:<br>
<br>
objdump -r -d /lib/x86_64-linux-gnu/libc.so.6 | grep -C 20 _int_free
| grep -C 10 cmpxchg | head -21 | grep -A 3 cmpxchg | tail -1 |
(grep '%r' && echo "Your libc is likely buggy." || echo
"Your libc looks OK.")<br>
Your libc looks OK.<br>
<br>
<div class="moz-cite-prefix">On 02/23/2016 07:53 AM, Krutika
Dhananjay wrote:<br>
</div>
<blockquote
cite="mid:1100132162.14341117.1456242813347.JavaMail.zimbra@redhat.com"
type="cite">
<div style="font-family: garamond,new york,times,serif; font-size:
12pt; color: #000000">
<div>Raghavendra,<br>
</div>
<div><br>
</div>
<div>The crash was due to bug(s) in clear-locks command
implementation. Joe and I had had an offline discussion about
this.<br>
</div>
<div><br>
</div>
<div>-Krutika<br>
</div>
<hr id="zwchr">
<blockquote style="border-left:2px solid
#1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From:
</b>"Raghavendra G" <a class="moz-txt-link-rfc2396E" href="mailto:raghavendra@gluster.com"><raghavendra@gluster.com></a><br>
<b>To: </b>"Krutika Dhananjay" <a class="moz-txt-link-rfc2396E" href="mailto:kdhananj@redhat.com"><kdhananj@redhat.com></a><br>
<b>Cc: </b>"Joe Julian" <a class="moz-txt-link-rfc2396E" href="mailto:joe@julianfamily.org"><joe@julianfamily.org></a>,
"Gluster Devel" <a class="moz-txt-link-rfc2396E" href="mailto:gluster-devel@gluster.org"><gluster-devel@gluster.org></a><br>
<b>Sent: </b>Tuesday, February 23, 2016 8:54:01 PM<br>
<b>Subject: </b>Re: [Gluster-devel] 3.6.8 crashing a lot in
production<br>
<div><br>
</div>
<div dir="ltr">
<div style=""><span style="color:rgb(51,51,51);font-family:monospace;font-size:11px;line-height:19.59375px;white-space:pre-wrap">Came across a glibc bug which could've caused some corruptions. </span><span style="color:rgb(51,51,51);font-family:monospace;font-size:11px;line-height:19.59375px;white-space:pre-wrap">On googling about possible problems, we found that there is an issue (</span><a moz-do-not-send="true" target="_blank" href="https://bugzilla.redhat.com/show_bug.cgi?id=1305406" style="color:rgb(0,136,206);text-decoration:none;font-family:monospace;font-size:11px;line-height:19.59375px;white-space:pre-wrap">https://bugzilla.redhat.com/show_bug.cgi?id=1305406</a><span style="color:rgb(51,51,51);font-family:monospace;font-size:11px;line-height:19.59375px;white-space:pre-wrap">) fixed in glibc-2.17-121.el7. From the bug we found the following test-script to determine if the glibc is buggy. And on running it, we ran it on the local setup using the following method giv
en in the bug:</span></div>
<span style="color:rgb(51,51,51);font-family:monospace;font-size:11px;line-height:19.59375px;white-space:pre-wrap">
----------------
# objdump -r -d /lib64/libc.so.6 | grep -C 20 _int_free | grep -C 10 cmpxchg | head -21 | grep -A 3 cmpxchg | tail -1 | (grep '%r' && echo "Your libc is likely buggy." || echo "Your libc looks OK.")
7cc36: 48 85 c9 test %rcx,%rcx
Your libc is likely buggy.
----------------
Could you check if the above command on your setup gives the same output which says "Your libc is likely buggy."
</span>regards,</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sat, Feb 13, 2016 at 7:46 AM,
Krutika Dhananjay <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:kdhananj@redhat.com" target="_blank"><a class="moz-txt-link-abbreviated" href="mailto:kdhananj@redhat.com">kdhananj@redhat.com</a></a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div style="font-family:garamond,new
york,times,serif;font-size:12pt;color:#000000">
<div>Taking a look. Give me some time.<br>
</div>
<div><br>
</div>
<div>-Krutika<br>
</div>
<div><br>
</div>
<hr>
<blockquote style="border-left:2px solid
#1010ff;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt"><b>From:
</b>"Joe Julian" <<a moz-do-not-send="true"
href="mailto:joe@julianfamily.org"
target="_blank">joe@julianfamily.org</a>><br>
<b>To: </b>"Krutika Dhananjay" <<a
moz-do-not-send="true"
href="mailto:kdhananj@redhat.com"
target="_blank"><a class="moz-txt-link-abbreviated" href="mailto:kdhananj@redhat.com">kdhananj@redhat.com</a></a>>, <a
moz-do-not-send="true"
href="mailto:gluster-devel@gluster.org"
target="_blank"><a class="moz-txt-link-abbreviated" href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a></a><br>
<b>Sent: </b>Saturday, February 13, 2016 6:02:13
AM<br>
<b>Subject: </b>Fwd: [Gluster-devel] 3.6.8
crashing a lot in production
<div>
<div class="h5"><br>
<div><br>
</div>
Could this be a regression from <a
moz-do-not-send="true"
href="http://review.gluster.org/7981"
target="_blank"><a class="moz-txt-link-freetext" href="http://review.gluster.org/7981">http://review.gluster.org/7981</a></a>
?<br>
<div><br>
-------- Forwarded Message --------
<table class="mceItemTable" border="0"
cellpadding="0" cellspacing="0">
<tbody>
<tr>
<th align="RIGHT" valign="BASELINE"
nowrap="nowrap">Subject:</th>
<td>[Gluster-devel] 3.6.8 crashing a
lot in production</td>
</tr>
<tr>
<th align="RIGHT" valign="BASELINE"
nowrap="nowrap">Date:</th>
<td>Fri, 12 Feb 2016 16:20:59 -0800</td>
</tr>
<tr>
<th align="RIGHT" valign="BASELINE"
nowrap="nowrap">From:</th>
<td>Joe Julian <a
moz-do-not-send="true"
href="mailto:joe@julianfamily.org"
target="_blank"><a class="moz-txt-link-rfc2396E" href="mailto:joe@julianfamily.org"><joe@julianfamily.org></a></a><br>
</td>
</tr>
<tr>
<th align="RIGHT" valign="BASELINE"
nowrap="nowrap">To:</th>
<td><a moz-do-not-send="true"
href="mailto:gluster-users@gluster.org"
target="_blank">gluster-users@gluster.org</a>,
<a moz-do-not-send="true"
href="mailto:gluster-devel@gluster.org"
target="_blank">gluster-devel@gluster.org</a><br>
</td>
</tr>
</tbody>
</table>
<br>
<br>
<pre>I have multiple bricks crashing in production. Any help would be greatly
appreciated.
The crash log is in this bug report:
<a moz-do-not-send="true" href="https://bugzilla.redhat.com/show_bug.cgi?id=1307146" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1307146</a>
Looks like it's crashing in pl_inodelk_client_cleanup
_______________________________________________
Gluster-devel mailing list
<a moz-do-not-send="true" href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>
<a moz-do-not-send="true" href="http://www.gluster.org/mailman/listinfo/gluster-devel" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a>
</pre>
<br>
</div>
<br>
</div>
</div>
</blockquote>
<div><br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a moz-do-not-send="true"
href="mailto:Gluster-devel@gluster.org"
target="_blank">Gluster-devel@gluster.org</a><br>
<a moz-do-not-send="true"
href="http://www.gluster.org/mailman/listinfo/gluster-devel"
rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
<div class="gmail_signature">Raghavendra G<br>
</div>
</div>
</blockquote>
<div><br>
</div>
</div>
</blockquote>
<br>
</body>
</html>