<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    I once had that happen. Turned out to be bad ram.<br>
    <br>
    <div class="moz-cite-prefix">On 01/26/2016 09:12 PM, Krutika
      Dhananjay wrote:<br>
    </div>
    <blockquote
      cite="mid:1135917242.8475321.1453871528844.JavaMail.zimbra@redhat.com"
      type="cite">
      <div style="font-family: garamond,new york,times,serif; font-size:
        12pt; color: #000000">
        <div>Hi,</div>
        <div><br>
        </div>
        <div>Could you share the following pieces of information:<br>
        </div>
        <div><br>
        </div>
        <div>1) output of `gluster volume info &lt;VOL&gt;`<br>
        </div>
        <div>2) the client/mount logs<br>
        </div>
        <div>3) glustershd logs<br>
        </div>
        <div><br>
        </div>
        <div>-Krutika<br>
        </div>
        <div><br>
        </div>
        <hr id="zwchr">
        <blockquote style="border-left:2px solid
#1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From:
          </b>"Klearchos Chaloulos (Nokia - GR/Athens)"
          <a class="moz-txt-link-rfc2396E" href="mailto:klearchos.chaloulos@nokia.com">&lt;klearchos.chaloulos@nokia.com&gt;</a><br>
          <b>To: </b><a class="moz-txt-link-abbreviated" href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><br>
          <b>Sent: </b>Tuesday, January 26, 2016 9:57:38 PM<br>
          <b>Subject: </b>[Gluster-users] Different file in two
          bricks,        no split-brain detected<br>
          <div><br>
          </div>
          <style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
          <span style="font-family: Calibri; font-size: small;"
            data-mce-style="font-family: Calibri; font-size: small;"
            face="Calibri" size="2"><span style="font-size:11pt;">
              <div>Description of problem:</div>
              <div>My setup has 5 gluster volumes, and each of them has
                2 bricks as backend. </div>
              <div>When I copy a large file (100MB) in a gluster volume,
                9/10 times it works OK. But about 1 in 10 times the
                resulting md5 is wrong. After checking I found that the
                file in one brick has the correct md5sum, while the file
                in the other brick has a wrong md5sum.
                The size of the two files is the same.</div>
              <div>By running "cmp -l &lt;correct_file&gt;
                &lt;wrong_file&gt;"</div>
              <div>I found that the difference was in 49 bytes. So the
                files in the two bricks had the same size, but 49 files
                were different. Interestingly enough I saw the same
                number of 49 bytes being different at every check that I
                made.</div>
              <div> </div>
              <div>Do you know what might cause this behavior, has
                anyone seen something like this before? Is this a bug in
                glusterfs? </div>
              <div> </div>
              <div> </div>
              <div>Version-Release number of selected component (if
                applicable):</div>
              <div>glusterfs 3.7.5 built on Nov 19 2015 16:29:59</div>
              <div>Repository revision:
                git://git.gluster.com/glusterfs.git</div>
              <div>Copyright (c) 2006-2011 Gluster Inc. &lt;<a
                  moz-do-not-send="true" href="http://www.gluster.com"
                  target="_blank"><a class="moz-txt-link-freetext" href="http://www.gluster.com">http://www.gluster.com</a></a>&gt;</div>
              <div>GlusterFS comes with ABSOLUTELY NO WARRANTY.</div>
              <div>You may redistribute copies of GlusterFS under the
                terms of the GNU General Public License.</div>
              <div> </div>
              <div> </div>
              <div>How reproducible:</div>
              <div>Not easy to reproduce, about 1 in 10 times in some
                environments, not reproducible at all in other
                environments.</div>
              <div> </div>
              <div>Steps to Reproduce:</div>
              <div>1. scp &lt;100MB file&gt; &lt;path in gluster
                volume&gt;</div>
              <div> </div>
              <div>Actual results:</div>
              <div>1. md5sum of destination should be the same as the
                source</div>
              <div>2. If checksum of files is different between the two
                bricks, the command "gluster volume heal
                &lt;vol-name&gt; info split-brain" should return that
                the two bricks are in split-brain.</div>
              <div> </div>
              <div> </div>
              <div>Expected results:</div>
              <div>1. 1 in 10 times the destination file has incorrect
                checksum. Size is the same, but 49 bytes are altered.</div>
              <div>2. "gluster volume heal &lt;vol-name&gt; info
                split-brain" does not return that the bricks are in
                split-brain, even though the checksum of the file in the
                two bricks is different. The size of the file is the
                same in the two bricks. But 49 bytes are altered.</div>
              <div> </div>
              <div>Additional info:</div>
              <div> </div>
            </span></span>
          <br>
          _______________________________________________<br>
          Gluster-users mailing list<br>
          <a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
          <a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></blockquote>
        <div><br>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  </body>
</html>