<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">Hi Vijay,<div><br></div><div><span id="result_box" class="short_text" lang="en"><span class="hps">However</span> <span class="hps">the problem</span> <span class="hps">seemed to happen with one of these path… From strace output…</span></span></div><div><br></div><div>Geoffrey<br><div apple-content-edited="true">
------------------------------------------------------<br>Geoffrey Letessier<br>Responsable informatique & ingénieur système<br>UPR 9080 - CNRS - Laboratoire de Biochimie Théorique<br>Institut de Biologie Physico-Chimique<br>13, rue Pierre et Marie Curie - 75005 Paris<br>Tel: 01 58 41 50 93 - eMail: <a href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a>
</div>
<br><div><div>Le 14 juil. 2015 à 05:15, Vijaikumar M <<a href="mailto:vmallika@redhat.com">vmallika@redhat.com</a>> a écrit :</div><br class="Apple-interchange-newline"><blockquote type="cite">
<meta content="text/html; charset=windows-1252" http-equiv="Content-Type">
<div bgcolor="#FFFFFF" text="#000000">
<tt>Hi Geoffrey,</tt><tt><br>
</tt><tt><br>
</tt><tt>Quota-Crawl is a background operation, this will not create
problem in IO path.</tt><tt><br>
</tt><tt>I will check the logs provided if I can find some clue
here.</tt><tt><br>
</tt><tt><br>
</tt><tt>Thanks,</tt><tt><br>
</tt><tt>Vijay</tt><br>
<br>
<br>
<br>
<div class="moz-cite-prefix">On Tuesday 14 July 2015 12:08 AM,
Geoffrey Letessier wrote:<br>
</div>
<blockquote cite="mid:59A0747B-7533-40CF-B110-74823E3D9BE7@cnrs.fr" type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
Additional information:
<div><br>
<div>Here what i can find
in /var/log/glusterfs/vol_home-quota-crawl.log:</div>
<div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;
color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
16:41:08.099848] W [rdma.c:121:gf_rdma_new_post]
0-vol_home-client-0: memory registration failed (Ne peut
allouer de la mémoire)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;
color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
16:41:08.099899] E [rdma.c:333:__gf_rdma_create_posts]
0-vol_home-client-0: post creation failed</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;
color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
16:41:51.692421] E [rdma.c:796:gf_rdma_get_device]
0-vol_home-client-0: could not allocate posts for device
(qib0)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;
color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
16:41:51.693331] I [mem-pool.c:604:mem_pool_destroy]
0-glusterfs: size=1404 max=0 total=0</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;
color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
16:41:51.693391] I [mem-pool.c:604:mem_pool_destroy]
0-glusterfs: size=132 max=0 total=0</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;
color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
16:41:51.696491] I [mem-pool.c:604:mem_pool_destroy]
0-glusterfs: size=52 max=0 total=0</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;
color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);">[2015-07-13
16:41:51.697378] W [rdma.c:3141:gf_rdma_create_qp]
0-vol_home-client-0: cannot get device for device qib0</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;
color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);
position: static; z-index: auto;">[2015-07-13
16:41:51.697394] W
[rdma.c:1047:gf_rdma_cm_handle_route_resolved]
0-vol_home-client-0: could not create QP
(peer:10.0.4.1:24008 me:10.0.4.1:988)</div>
<div><br>
</div>
<div>Is RDMA afresh supported? or do you advice me to set TCP
as transport-type? If you advice me to change the
transport-type, can you explain me how to do it step-by-step
because I set my volume with rdma only as transport-type…</div>
<div><br>
</div>
<div>Thanks in advance,</div>
<div>Geoffrey</div>
<div><br>
</div>
<div apple-content-edited="true">
------------------------------------------------------<br>
Geoffrey Letessier<br>
Responsable informatique & ingénieur système<br>
UPR 9080 - CNRS - Laboratoire de Biochimie Théorique<br>
Institut de Biologie Physico-Chimique<br>
13, rue Pierre et Marie Curie - 75005 Paris<br>
Tel: 01 58 41 50 93 - eMail: <a moz-do-not-send="true" href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a>
</div>
<br>
<div>
<div>Le 13 juil. 2015 à 20:25, Geoffrey Letessier <<a moz-do-not-send="true" href="mailto:geoffrey.letessier@cnrs.fr">geoffrey.letessier@cnrs.fr</a>>
a écrit :</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<div style="word-wrap: break-word; -webkit-nbsp-mode:
space; -webkit-line-break: after-white-space;">Arf, now,
without quota features enabled, my system hangs with a
DF, a LS on, etc..
<div>Here is the result of strace command:</div>
<div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0);">statfs("/archive/sterpone_team",
{f_type="NFS_SUPER_MAGIC", f_bsize=1048576,
f_blocks=36700160, f_bfree=22460451,
f_bavail=22460451, f_files=45999237162,
f_ffree=45999003257, f_fsid={0, 0}, f_namelen=255,
f_frsize=1048576}) = 0</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0);">statfs("/archive/amyloid_team",
{f_type="NFS_SUPER_MAGIC", f_bsize=1048576,
f_blocks=7340032, f_bfree=3258562, f_bavail=3258562,
f_files=6676333171, f_ffree=6673534246, f_fsid={0,
0}, f_namelen=255, f_frsize=1048576}) = 0</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0);">statfs("/home", {f_type=0x65735546,
f_bsize=131072, f_blocks=602107776,
f_bfree=602106710, f_bavail=602106710,
f_files=7707031808, f_ffree=7707031719, f_fsid={0,
0}, f_namelen=255, f_frsize=131072}) = 0</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0);">statfs("/tmp/mntqM2nAB", </div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0); min-height: 13px;"><br>
</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0); min-height: 13px;"><br>
</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0); min-height: 13px;"><br>
</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0); min-height: 13px;"><br>
</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0); min-height: 13px;"><br>
</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0); min-height: 13px;"><br>
</div>
<div style="margin: 0px; font-size: 11px; font-family:
Menlo; color: rgb(255, 255, 255); background-color:
rgb(0, 0, 0);">^C <unfinished ...></div>
<div><br>
</div>
<div>As you can note, a mount point to /mnt/mntqM2nAB
that i dont know appears to exist… Do you have an
idea of what it is form?</div>
<div><br>
</div>
<div>Here is an extract of /etc/mtab file:</div>
<div>
<div style="margin: 0px; font-size: 11px;
font-family: Menlo; color: rgb(255, 255, 255);
background-color: rgb(0, 0, 0);">localhost:vol_home.rdma
/home fuse.glusterfs
rw,default_permissions,allow_other,max_read=131072
0 0</div>
<div style="margin: 0px; font-size: 11px;
font-family: Menlo; color: rgb(255, 255, 255);
background-color: rgb(0, 0, 0);">localhost:vol_home
/tmp/mntqM2nAB fuse.glusterfs
rw,default_permissions,allow_other,max_read=131072
0 0</div>
<div style="margin: 0px; font-size: 11px;
font-family: Menlo; color: rgb(255, 255, 255);
background-color: rgb(0, 0, 0);">localhost:vol_home
/tmp/mnt88HLLE fuse.glusterfs
rw,default_permissions,allow_other,max_read=131072
0 0</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Geoffrey</div>
<div apple-content-edited="true">
------------------------------------------------------<br>
Geoffrey Letessier<br>
Responsable informatique & ingénieur système<br>
UPR 9080 - CNRS - Laboratoire de Biochimie Théorique<br>
Institut de Biologie Physico-Chimique<br>
13, rue Pierre et Marie Curie - 75005 Paris<br>
Tel: 01 58 41 50 93 - eMail: <a moz-do-not-send="true" href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a>
</div>
<br>
<div>
<div>Le 13 juil. 2015 à 16:45, Atin Mukherjee <<a moz-do-not-send="true" href="mailto:atin.mukherjee83@gmail.com">atin.mukherjee83@gmail.com</a>>
a écrit :</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<div><br class="webkit-block-placeholder">
</div><p dir="ltr">-Atin<br>
Sent from one plus one<br>
On Jul 13, 2015 8:08 PM, "Geoffrey Letessier"
<<a moz-do-not-send="true" href="mailto:geoffrey.letessier@cnrs.fr">geoffrey.letessier@cnrs.fr</a>>
wrote:<br>
><br>
> Hi Atin,<br>
><br>
> First of all, thanks for your reply and for
your help.<br>
> Now, after having set
features.quota-deem-statfs to on, my df hang:<br>
><br>
> # gluster volume set vol_home
features.quota-deem-statfs on;<br>
> volume set: success<br>
> [root@lucifer ~]# df<br>
I am not a quota expert, Vijaikumar can help you
on this. However 'strace df' might give you a
hint where exactly its stuck.<br>
><br>
> An idea? :)<br>
><br>
> Thanks in advance,<br>
> Geoffrey<br>
>
------------------------------------------------------<br>
> Geoffrey Letessier<br>
> Responsable informatique & ingénieur
système<br>
> UPR 9080 - CNRS - Laboratoire de
Biochimie Théorique<br>
> Institut de Biologie Physico-Chimique<br>
> 13, rue Pierre et Marie Curie - 75005 Paris<br>
> Tel: 01 58 41 50 93 - eMail: <a moz-do-not-send="true" href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a><br>
><br>
>> Le 13 juil. 2015 à 16:29, Atin
Mukherjee <<a moz-do-not-send="true" href="mailto:atin.mukherjee83@gmail.com">atin.mukherjee83@gmail.com</a>>
a écrit :<br>
>><br>
>> Please bump up the op version by
Gluster volume set all cluster.op-version 30702<br>
>><br>
>> -Atin<br>
>> Sent from one plus one<br>
>><br>
>> On Jul 13, 2015 7:43 PM, "Geoffrey
Letessier" <<a moz-do-not-send="true" href="mailto:geoffrey.letessier@cnrs.fr">geoffrey.letessier@cnrs.fr</a>>
wrote:<br>
>>><br>
>>> Dear all,<br>
>>><br>
>>> I just upgraded my storage cluster
from 3.5.3 to the latest version of GlusterFS
(3.7.2-3) but when I want to activate quota info
my volume I obtain this result:<br>
>>> # gluster volume quota vol_home
enable<br>
>>> quota command failed : Volume quota
failed. The cluster is operating at version 3.
Quota command enable is unavailable in this
version.<br>
>>><br>
>>> Can you give me your help?<br>
>>><br>
>>> Thanks in advance,<br>
>>> Geoffrey<br>
>>>
------------------------------------------------------<br>
>>> Geoffrey Letessier<br>
>>> Responsable informatique &
ingénieur système<br>
>>> UPR 9080 - CNRS - Laboratoire de
Biochimie Théorique<br>
>>> Institut de Biologie
Physico-Chimique<br>
>>> 13, rue Pierre et Marie Curie -
75005 Paris<br>
>>> Tel: 01 58 41 50 93 - eMail: <a moz-do-not-send="true" href="mailto:geoffrey.letessier@ibpc.fr">geoffrey.letessier@ibpc.fr</a><br>
>>><br>
>>><br>
>>>
_______________________________________________<br>
>>> Gluster-users mailing list<br>
>>> <a moz-do-not-send="true" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
>>> <a moz-do-not-send="true" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
><br>
><br>
</p>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
</div>
</blockquote></div><br></div></body></html>