<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">Hi Vijay,<div><br></div><div><span id="result_box" class="short_text" lang="en"><span class="hps">However</span> <span class="hps">the problem</span> <span class="hps">seemed to happen with one of these path… From strace output…</span></span></div><div><br></div><div>Geoffrey<br><div apple-content-edited="true">
------------------------------------------------------<br>Geoffrey Letessier<br>Responsable informatique &amp; ingénieur&nbsp;système<br>UPR 9080 - CNRS - Laboratoire de&nbsp;Biochimie Théorique<br>Institut de Biologie Physico-Chimique<br>13, rue Pierre et Marie Curie - 75005&nbsp;Paris<br>Tel: 01 58 41 50 93 - eMail:&nbsp;<a href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a>
</div>
<br><div><div>Le 14 juil. 2015 à 05:15, Vijaikumar M &lt;<a href="mailto:vmallika@redhat.com">vmallika@redhat.com</a>&gt; a écrit :</div><br class="Apple-interchange-newline"><blockquote type="cite">
  
    <meta content="text/html; charset=windows-1252" http-equiv="Content-Type">
  
  <div bgcolor="#FFFFFF" text="#000000">
    <tt>Hi Geoffrey,</tt><tt><br>
    </tt><tt><br>
    </tt><tt>Quota-Crawl is a background operation, this will not create
      problem in IO path.</tt><tt><br>
    </tt><tt>I will check the logs provided if I can find some clue
      here.</tt><tt><br>
    </tt><tt><br>
    </tt><tt>Thanks,</tt><tt><br>
    </tt><tt>Vijay</tt><br>
    <br>
    <br>
    <br>
    <div class="moz-cite-prefix">On Tuesday 14 July 2015 12:08 AM,
      Geoffrey Letessier wrote:<br>
    </div>
    <blockquote cite="mid:59A0747B-7533-40CF-B110-74823E3D9BE7@cnrs.fr" type="cite">
      <meta http-equiv="Content-Type" content="text/html;
        charset=windows-1252">
      Additional information:
      <div><br>
        <div>Here what i can find
          in&nbsp;/var/log/glusterfs/vol_home-quota-crawl.log:</div>
        <div>
          <div style="margin: 0px; font-size: 11px; font-family: Menlo;
            color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
            16:41:08.099848] W [rdma.c:121:gf_rdma_new_post]
            0-vol_home-client-0: memory registration failed (Ne peut
            allouer de la mémoire)</div>
          <div style="margin: 0px; font-size: 11px; font-family: Menlo;
            color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
            16:41:08.099899] E [rdma.c:333:__gf_rdma_create_posts]
            0-vol_home-client-0: post creation failed</div>
          <div style="margin: 0px; font-size: 11px; font-family: Menlo;
            color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
            16:41:51.692421] E [rdma.c:796:gf_rdma_get_device]
            0-vol_home-client-0: could not allocate posts for device
            (qib0)</div>
          <div style="margin: 0px; font-size: 11px; font-family: Menlo;
            color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
            16:41:51.693331] I [mem-pool.c:604:mem_pool_destroy]
            0-glusterfs: size=1404 max=0 total=0</div>
          <div style="margin: 0px; font-size: 11px; font-family: Menlo;
            color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
            16:41:51.693391] I [mem-pool.c:604:mem_pool_destroy]
            0-glusterfs: size=132 max=0 total=0</div>
          <div style="margin: 0px; font-size: 11px; font-family: Menlo;
            color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
            16:41:51.696491] I [mem-pool.c:604:mem_pool_destroy]
            0-glusterfs: size=52 max=0 total=0</div>
          <div style="margin: 0px; font-size: 11px; font-family: Menlo;
            color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
            16:41:51.697378] W [rdma.c:3141:gf_rdma_create_qp]
            0-vol_home-client-0: cannot get device for device qib0</div>
          <div style="margin: 0px; font-size: 11px; font-family: Menlo;
            color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);
            position: static; z-index: auto;">[2015-07-13
            16:41:51.697394] W
            [rdma.c:1047:gf_rdma_cm_handle_route_resolved]
            0-vol_home-client-0: could not create QP
            (peer:10.0.4.1:24008 me:10.0.4.1:988)</div>
          <div><br>
          </div>
          <div>Is RDMA afresh supported? or do you advice me to set TCP
            as transport-type? If you advice me to change the
            transport-type, can you explain me how to do it step-by-step
            because I set my volume with rdma only as transport-type…</div>
          <div><br>
          </div>
          <div>Thanks in advance,</div>
          <div>Geoffrey</div>
          <div><br>
          </div>
          <div apple-content-edited="true">
            ------------------------------------------------------<br>
            Geoffrey Letessier<br>
            Responsable informatique &amp; ingénieur&nbsp;système<br>
            UPR 9080 - CNRS - Laboratoire de&nbsp;Biochimie Théorique<br>
            Institut de Biologie Physico-Chimique<br>
            13, rue Pierre et Marie Curie - 75005&nbsp;Paris<br>
            Tel: 01 58 41 50 93 - eMail:&nbsp;<a moz-do-not-send="true" href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a>
          </div>
          <br>
          <div>
            <div>Le 13 juil. 2015 à 20:25, Geoffrey Letessier &lt;<a moz-do-not-send="true" href="mailto:geoffrey.letessier@cnrs.fr">geoffrey.letessier@cnrs.fr</a>&gt;
              a écrit :</div>
            <br class="Apple-interchange-newline">
            <blockquote type="cite">
              <meta http-equiv="Content-Type" content="text/html;
                charset=windows-1252">
              <div style="word-wrap: break-word; -webkit-nbsp-mode:
                space; -webkit-line-break: after-white-space;">Arf, now,
                without quota features enabled, my system hangs with a
                DF, a LS on, etc..
                <div>Here is the result of strace command:</div>
                <div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0);">statfs("/archive/sterpone_team",
                    {f_type="NFS_SUPER_MAGIC", f_bsize=1048576,
                    f_blocks=36700160, f_bfree=22460451,
                    f_bavail=22460451, f_files=45999237162,
                    f_ffree=45999003257, f_fsid={0, 0}, f_namelen=255,
                    f_frsize=1048576}) = 0</div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0);">statfs("/archive/amyloid_team",
                    {f_type="NFS_SUPER_MAGIC", f_bsize=1048576,
                    f_blocks=7340032, f_bfree=3258562, f_bavail=3258562,
                    f_files=6676333171, f_ffree=6673534246, f_fsid={0,
                    0}, f_namelen=255, f_frsize=1048576}) = 0</div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0);">statfs("/home", {f_type=0x65735546,
                    f_bsize=131072, f_blocks=602107776,
                    f_bfree=602106710, f_bavail=602106710,
                    f_files=7707031808, f_ffree=7707031719, f_fsid={0,
                    0}, f_namelen=255, f_frsize=131072}) = 0</div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0);">statfs("/tmp/mntqM2nAB",&nbsp;</div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0); min-height: 13px;"><br>
                  </div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0); min-height: 13px;"><br>
                  </div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0); min-height: 13px;"><br>
                  </div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0); min-height: 13px;"><br>
                  </div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0); min-height: 13px;"><br>
                  </div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0); min-height: 13px;"><br>
                  </div>
                  <div style="margin: 0px; font-size: 11px; font-family:
                    Menlo; color: rgb(255, 255, 255); background-color:
                    rgb(0, 0, 0);">^C &lt;unfinished ...&gt;</div>
                  <div><br>
                  </div>
                  <div>As you can note, a mount point to /mnt/mntqM2nAB
                    that i dont know appears to exist… Do you have an
                    idea of what it is form?</div>
                  <div><br>
                  </div>
                  <div>Here is an extract of /etc/mtab file:</div>
                  <div>
                    <div style="margin: 0px; font-size: 11px;
                      font-family: Menlo; color: rgb(255, 255, 255);
                      background-color: rgb(0, 0, 0);">localhost:vol_home.rdma
                      /home fuse.glusterfs
                      rw,default_permissions,allow_other,max_read=131072
                      0 0</div>
                    <div style="margin: 0px; font-size: 11px;
                      font-family: Menlo; color: rgb(255, 255, 255);
                      background-color: rgb(0, 0, 0);">localhost:vol_home
                      /tmp/mntqM2nAB fuse.glusterfs
                      rw,default_permissions,allow_other,max_read=131072
                      0 0</div>
                    <div style="margin: 0px; font-size: 11px;
                      font-family: Menlo; color: rgb(255, 255, 255);
                      background-color: rgb(0, 0, 0);">localhost:vol_home
                      /tmp/mnt88HLLE fuse.glusterfs
                      rw,default_permissions,allow_other,max_read=131072
                      0 0</div>
                  </div>
                  <div><br>
                  </div>
                  <div><br>
                  </div>
                  <div>Geoffrey</div>
                  <div apple-content-edited="true">
------------------------------------------------------<br>
                    Geoffrey Letessier<br>
                    Responsable informatique &amp; ingénieur&nbsp;système<br>
                    UPR 9080 - CNRS - Laboratoire de&nbsp;Biochimie Théorique<br>
                    Institut de Biologie Physico-Chimique<br>
                    13, rue Pierre et Marie Curie - 75005&nbsp;Paris<br>
                    Tel: 01 58 41 50 93 - eMail:&nbsp;<a moz-do-not-send="true" href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a>
                  </div>
                  <br>
                  <div>
                    <div>Le 13 juil. 2015 à 16:45, Atin Mukherjee &lt;<a moz-do-not-send="true" href="mailto:atin.mukherjee83@gmail.com">atin.mukherjee83@gmail.com</a>&gt;
                      a écrit :</div>
                    <br class="Apple-interchange-newline">
                    <blockquote type="cite">
                      <div><br class="webkit-block-placeholder">
                      </div><p dir="ltr">-Atin<br>
                        Sent from one plus one<br>
                        On Jul 13, 2015 8:08 PM, "Geoffrey Letessier"
                        &lt;<a moz-do-not-send="true" href="mailto:geoffrey.letessier@cnrs.fr">geoffrey.letessier@cnrs.fr</a>&gt;
                        wrote:<br>
                        &gt;<br>
                        &gt; Hi Atin,<br>
                        &gt;<br>
                        &gt; First of all, thanks for your reply and for
                        your help.<br>
                        &gt; Now, after having set
                        features.quota-deem-statfs to on, my df hang:<br>
                        &gt;<br>
                        &gt; # gluster volume set vol_home
                        features.quota-deem-statfs on;<br>
                        &gt; volume set: success<br>
                        &gt; [root@lucifer ~]# df<br>
                        I am not a quota expert, Vijaikumar can help you
                        on this. However 'strace df' might give you a
                        hint where exactly its stuck.<br>
                        &gt;<br>
                        &gt; An idea? :)<br>
                        &gt;<br>
                        &gt; Thanks in advance,<br>
                        &gt; Geoffrey<br>
                        &gt;
                        ------------------------------------------------------<br>
                        &gt; Geoffrey Letessier<br>
                        &gt; Responsable informatique&nbsp;&amp; ingénieur
                        système<br>
                        &gt; UPR 9080 - CNRS - Laboratoire de
                        Biochimie&nbsp;Théorique<br>
                        &gt; Institut de Biologie Physico-Chimique<br>
                        &gt; 13, rue Pierre et Marie Curie - 75005 Paris<br>
                        &gt; Tel: 01 58 41 50 93 - eMail:&nbsp;<a moz-do-not-send="true" href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a><br>
                        &gt;<br>
                        &gt;&gt; Le 13 juil. 2015 à 16:29, Atin
                        Mukherjee &lt;<a moz-do-not-send="true" href="mailto:atin.mukherjee83@gmail.com">atin.mukherjee83@gmail.com</a>&gt;
                        a écrit :<br>
                        &gt;&gt;<br>
                        &gt;&gt; Please bump up the op version by
                        Gluster volume set all cluster.op-version 30702<br>
                        &gt;&gt;<br>
                        &gt;&gt; -Atin<br>
                        &gt;&gt; Sent from one plus one<br>
                        &gt;&gt;<br>
                        &gt;&gt; On Jul 13, 2015 7:43 PM, "Geoffrey
                        Letessier" &lt;<a moz-do-not-send="true" href="mailto:geoffrey.letessier@cnrs.fr">geoffrey.letessier@cnrs.fr</a>&gt;
                        wrote:<br>
                        &gt;&gt;&gt;<br>
                        &gt;&gt;&gt; Dear all,<br>
                        &gt;&gt;&gt;<br>
                        &gt;&gt;&gt; I just upgraded my storage cluster
                        from 3.5.3 to the latest version of GlusterFS
                        (3.7.2-3) but when I want to activate quota info
                        my volume I obtain this result:<br>
                        &gt;&gt;&gt; # gluster volume quota vol_home
                        enable<br>
                        &gt;&gt;&gt; quota command failed : Volume quota
                        failed. The cluster is operating at version 3.
                        Quota command enable is unavailable in this
                        version.<br>
                        &gt;&gt;&gt;<br>
                        &gt;&gt;&gt; Can you give me your help?<br>
                        &gt;&gt;&gt;<br>
                        &gt;&gt;&gt; Thanks in advance,<br>
                        &gt;&gt;&gt; Geoffrey<br>
                        &gt;&gt;&gt;
                        ------------------------------------------------------<br>
                        &gt;&gt;&gt; Geoffrey Letessier<br>
                        &gt;&gt;&gt; Responsable informatique&nbsp;&amp;
                        ingénieur système<br>
                        &gt;&gt;&gt; UPR 9080 - CNRS - Laboratoire de
                        Biochimie&nbsp;Théorique<br>
                        &gt;&gt;&gt; Institut de Biologie
                        Physico-Chimique<br>
                        &gt;&gt;&gt; 13, rue Pierre et Marie Curie -
                        75005 Paris<br>
                        &gt;&gt;&gt; Tel: 01 58 41 50 93 - eMail:&nbsp;<a moz-do-not-send="true" href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a><br>
                        &gt;&gt;&gt;<br>
                        &gt;&gt;&gt;<br>
                        &gt;&gt;&gt;
                        _______________________________________________<br>
                        &gt;&gt;&gt; Gluster-users mailing list<br>
                        &gt;&gt;&gt; <a moz-do-not-send="true" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
                        &gt;&gt;&gt; <a moz-do-not-send="true" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
                        &gt;<br>
                        &gt;<br>
                      </p>
                    </blockquote>
                  </div>
                  <br>
                </div>
              </div>
            </blockquote>
          </div>
          <br>
        </div>
      </div>
    </blockquote>
    <br>
  </div>

</blockquote></div><br></div></body></html>