<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <div class="moz-cite-prefix">On 03/03/2016 02:53 PM, <a class="moz-txt-link-abbreviated" href="mailto:paf1@email.cz">paf1@email.cz</a>
      wrote:<br>
    </div>
    <blockquote cite="mid:56D80297.6080407@email.cz" type="cite">
      <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
      This is replica 2, only , with following settings<br>
      <br>
      Options Reconfigured:<br>
      performance.quick-read: off<br>
      performance.read-ahead: off<br>
      performance.io-cache: off<br>
      performance.stat-prefetch: off<br>
      cluster.eager-lock: enable<br>
      network.remote-dio: enable<br>
      cluster.quorum-type: fixed<br>
    </blockquote>
    Not sure why you have set this option.<br>
    Ideally replica 3 or arbiter volumes are recommended for
    gluster+ovirt use.  (client) quorum does not make sense for a 2 node
    setup. I have a detailed write up here which explains things
    <a class="moz-txt-link-freetext" href="http://gluster.readthedocs.org/en/latest/Administrator%20Guide/arbiter-volumes-and-quorum/">http://gluster.readthedocs.org/en/latest/Administrator%20Guide/arbiter-volumes-and-quorum/</a>
    which explains things.<br>
    <br>
    <blockquote cite="mid:56D80297.6080407@email.cz" type="cite">
      cluster.server-quorum-type: none<br>
      storage.owner-uid: 36<br>
      storage.owner-gid: 36<br>
      cluster.quorum-count: 1<br>
      cluster.self-heal-daemon: enable<br>
      <br>
      If I'll create "ids" file manually (  eg. " sanlock direct init -s
      3c34ad63-6c66-4e23-ab46-084f3d70b147:0:/STORAGES/g1r5p3/GFS/3c34ad63-6c66-4e23-ab46-084f3d70b147/dom_md/ids:0

      " ) on both bricks,<br>
      vdsm is writing only to half of them ( that with 2 links = correct
      )<br>
      "ids" file has correct permittions, owner, size  on both bricks.<br>
      brick 1:  -rw-rw---- 1 vdsm kvm 1048576  2. bře 18.56
      /STORAGES/g1r5p3/GFS/3c34ad63-6c66-4e23-ab46-084f3d70b147/dom_md/ids
      - not updated<br>
    </blockquote>
    <br>
    Okay, so this one has link count =1 which means the .glusterfs
    hardlink is missing.  Can you try deleting this file from the brick
    and perform a stat on the file from the mount? That should heal (i.e
    recreate it ) on this brick from the other brick with the
    appropriate .glusterfs hard link.<br>
    <br>
    <br>
    <blockquote cite="mid:56D80297.6080407@email.cz" type="cite"> brick
      2:  -rw-rw---- 2 vdsm kvm 1048576  3. bře 10.16
      /STORAGES/g1r5p3/GFS/3c34ad63-6c66-4e23-ab46-084f3d70b147/dom_md/ids
      - is continually updated<br>
      <br>
      What happens when I'll restart vdsm ? Will oVirt storages go to
      "disable " state ??? = disconnect VMs storages ?<br>
    </blockquote>
    <br>
    No idea on this one...<br>
    -Ravi<br>
    <blockquote cite="mid:56D80297.6080407@email.cz" type="cite"> <br>
      regs.Pa.<br>
      <br>
      <div class="moz-cite-prefix">On 3.3.2016 02:02, Ravishankar N
        wrote:<br>
      </div>
      <blockquote cite="mid:56D78D3B.9060101@redhat.com" type="cite">
        <meta content="text/html; charset=utf-8"
          http-equiv="Content-Type">
        <div class="moz-cite-prefix">On 03/03/2016 12:43 AM, Nir Soffer
          wrote:<br>
        </div>
        <blockquote
cite="mid:CAMRbyysFqJwke8vdmYL7NGUuzpFNJppZC3riLR8jC7pd33DVdQ@mail.gmail.com"
          type="cite">
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div text="#000066" bgcolor="#FFFFFF">PS:  # find /STORAGES
              -samefile
              /STORAGES/g1r5p3/GFS/3c34ad63-6c66-4e23-ab46-084f3d70b147/dom_md/ids
              -print<br>
/STORAGES/g1r5p3/GFS/3c34ad63-6c66-4e23-ab46-084f3d70b147/dom_md/ids<br>
              = missing "shadowfile" in " .gluster " dir.<br>
              How can I fix it ?? - online !</div>
          </blockquote>
          <div><br>
          </div>
          <div>Ravi?</div>
        </blockquote>
        Is this the case in all 3 bricks of the replica? <br>
        BTW, you can just stat the file on the brick and see the link
        count (it must be 2) instead of running the more expensive find
        command.<br>
        <br>
      </blockquote>
      <br>
    </blockquote>
    <br>
    <br>
  </body>
</html>