<div dir="ltr">+Anoop, Jiffin<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jun 27, 2016 at 1:50 PM, Yann LEMARIE <span dir="ltr"><<a href="mailto:ylemarie@iraiser.eu" target="_blank">ylemarie@iraiser.eu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
Thanks Atin,<br>
<br>
Here is the log with "backtrace"<br>
<br>
<blockquote type="cite">time of crash:<br>
2016-06-26 09:27:44<br>
configuration details:<br>
argp 1<br>
backtrace 1<br>
dlfcn 1<br>
libpthread 1<br>
llistxattr 1<br>
setfsid 1<br>
spinlock 1<br>
epoll.h 1<br>
xattr.h 1<br>
st_atim.tv_nsec 1<br>
package-string: glusterfs 3.7.11<br>
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_msg_backtrace_nomem+0x92)[0x7f2626e7a5e2]<br>
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_print_trace+0x31d)[0x7f2626e966cd]<br>
/lib/x86_64-linux-gnu/libc.so.6(+0x36cb0)[0x7f2626278cb0]<br>
/lib/x86_64-linux-gnu/libc.so.6(strlen+0x2a)[0x7f26262ca9da]<br>
/usr/lib/x86_64-linux-gnu/glusterfs/3.7.11/xlator/features/trash.so(trash_truncate_stat_cbk+0x279)[0x7f2620c7a909]<br>
</blockquote>
<br>
I have lot of message about [File exist] or [No such file or
directory] within the .trash directory, is ther any link with the
crash ?<br>
<br>
<blockquote type="cite">[2016-06-26 09:27:37.965461] E [MSGID:
113027] [posix.c:1427:posix_mkdir] 0-cdn-posix: mkdir of /srv/cdn/
failed [File exists]<br>
[2016-06-26 09:27:37.965479] E [MSGID: 113027]
[posix.c:1427:posix_mkdir] 0-cdn-posix: mkdir of
/srv/cdn/.trashcan failed [File exists]<br>
[2016-06-26 09:27:37.965495] E [MSGID: 113027]
[posix.c:1427:posix_mkdir] 0-cdn-posix: mkdir of
/srv/cdn/.trashcan/ failed [File exists]<br>
[2016-06-26 09:27:37.965512] E [MSGID: 113027]
[posix.c:1427:posix_mkdir] 0-cdn-posix: mkdir of
/srv/cdn/.trashcan//medias failed [File exists]<br>
[2016-06-26 09:27:37.965570] E [MSGID: 113001]
[posix.c:1451:posix_mkdir] 0-cdn-posix: setting xattrs on
/srv/cdn/.trashcan//medias/fjDtE6cAz80xweuAdoIcWCDYxo9FdPqIVL88Yrl8ZiGVIvdiyBD5u1pJUXBzYJ5b
failed [No such file or directory]<br>
[2016-06-26 09:27:37.965615] E [MSGID: 113001]
[posix.c:1451:posix_mkdir] 0-cdn-posix: setting xattrs on
/srv/cdn/.trashcan//medias/fjDtE6cAz80xweuAdoIcWCDYxo9FdPqIVL88Yrl8ZiGVIvdiyBD5u1pJUXBzYJ5b/Dante_Olive
failed [No such file or directory]<br>
[2016-06-26 09:27:37.965659] E [MSGID: 113001]
[posix.c:1451:posix_mkdir] 0-cdn-posix: setting xattrs on
/srv/cdn/.trashcan//medias/fjDtE6cAz80xweuAdoIcWCDYxo9FdPqIVL88Yrl8ZiGVIvdiyBD5u1pJUXBzYJ5b/Dante_Olive/origin
failed [No such file or directory]<br>
[2016-06-26 09:27:37.965683] E [MSGID: 113027]
[posix.c:1427:posix_mkdir] 0-cdn-posix: mkdir of
/srv/cdn/.trashcan//medias/fjDtE6cAz80xweuAdoIcWCDYxo9FdPqIVL88Yrl8ZiGVIvdiyBD5u1pJUXBzYJ5b/Dante_Olive/origin
failed [File exists]<br>
[2016-06-26 09:27:37.965720] E [MSGID: 113001]
[posix.c:1451:posix_mkdir] 0-cdn-posix: setting xattrs on
/srv/cdn/.trashcan//medias/fjDtE6cAz80xweuAdoIcWCDYxo9FdPqIVL88Yrl8ZiGVIvdiyBD5u1pJUXBzYJ5b/Dante_Olive/origin/tmp
failed [No such file or directory]<br>
[2016-06-26 09:27:37.965767] E [MSGID: 113001]
[posix.c:2644:posix_create] 0-cdn-posix: setting xattrs on
/srv/cdn/.trashcan//medias/fjDtE6cAz80xweuAdoIcWCDYxo9FdPqIVL88Yrl8ZiGVIvdiyBD5u1pJUXBzYJ5b/Dante_Olive/origin/tmp/IMG3920.JPG_2016-06-26_092737
failed [No such file or directory]<br>
[2016-06-26 09:27:37.965955] E [posix.c:2996:_fill_writev_xdata]
(-->/usr/lib/x86_64-linux-gnu/glusterfs/3.7.11/xlator/features/trash.so(trash_truncate_readv_cbk+0x16c)
[0x7f2620c6fc4c]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.7.11/xlator/storage/posix.so(posix_writev+0x1dc)
[0x7f26214ae37c]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.7.11/xlator/storage/posix.so(_fill_writev_xdata+0x1ff)
[0x7f26214ae16f] ) 0-cdn-posix: fd: 0x7f26140057fc inode:
0x7f2600932484gfid:00000000-0000-0000-0000-000000000000 [Invalid
argument]<br>
[2016-06-26 09:27:37.966096] E [posix.c:2996:_fill_writev_xdata]
(-->/usr/lib/x86_64-linux-gnu/glusterfs/3.7.11/xlator/features/trash.so(trash_truncate_readv_cbk+0x16c)
[0x7f2620c6fc4c]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.7.11/xlator/storage/posix.so(posix_writev+0x1dc)
[0x7f26214ae37c]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.7.11/xlator/storage/posix.so(_fill_writev_xdata+0x1ff)
[0x7f26214ae16f] ) 0-cdn-posix: fd: 0x7f26140057fc inode:
0x7f2600932484gfid:00000000-0000-0000-0000-000000000000 [Invalid
argument]<span class="HOEnZb"><font color="#888888"><br>
</font></span></blockquote><span class="HOEnZb"><font color="#888888">
<br>
Yann</font></span><div><div class="h5"><br>
<br>
<div>Le 27/06/2016 10:02, Atin Mukherjee a
écrit :<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>Grep for "backtrace" in /var/log/glusterfs, that should
give you a particular log file name by which you can determine
which process crashed. You should also be able to see a
coredump. Why don't you attach the same for further analysis?<br>
<br>
</div>
~Atin<br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Jun 27, 2016 at 1:17 PM, Yann
LEMARIE <span dir="ltr"><<a href="mailto:ylemarie@iraiser.eu" target="_blank">ylemarie@iraiser.eu</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"> Hi,<br>
<br>
I'm using GlusterFS since many years and never see this
problem, but this is the second time in one week ...<br>
<br>
I have 3 volumes with 2 bricks and 1 volume crash with no
reason, I just have to stop/start the volume to make it up
again.<br>
The only logs I can find are in syslog :<br>
<br>
<blockquote type="cite">Jun 26 11:27:44 nfs05
srv-cdn[7879]: pending frames:<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: frame : type(0)
op(10)<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: patchset: git://<a href="http://git.gluster.com/glusterfs.git" target="_blank">git.gluster.com/glusterfs.git</a><br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: signal received: 11<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: time of crash:<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: 2016-06-26 09:27:44<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: configuration
details:<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: argp 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: backtrace 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: dlfcn 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: libpthread 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: llistxattr 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: setfsid 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: spinlock 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: epoll.h 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: xattr.h 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: st_atim.tv_nsec 1<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: package-string:
glusterfs 3.7.11<br>
Jun 26 11:27:44 nfs05 srv-cdn[7879]: ---------<br>
<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: pending frames:<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: frame : type(0)
op(10)<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: patchset: git://<a href="http://git.gluster.com/glusterfs.git" target="_blank">git.gluster.com/glusterfs.git</a><br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: signal received: 11<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: time of crash:<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: 2016-06-26 09:27:44<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: configuration
details:<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: argp 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: backtrace 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: dlfcn 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: libpthread 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: llistxattr 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: setfsid 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: spinlock 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: epoll.h 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: xattr.h 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: st_atim.tv_nsec 1<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: package-string:
glusterfs 3.7.11<br>
Jun 26 11:27:44 nfs06 srv-cdn[1787]: ---------<br>
<br>
</blockquote>
<br>
Thanks for your help<br>
<br>
<br>
Regards<span><font color="#888888"><br>
<div>-- <br>
<div dir="ltr">
<div style="margin-bottom:0px;margin-left:0px;padding-bottom:5px">
<div style="overflow:hidden">
<div dir="ltr">
<div dir="ltr" style="font-size:13px">Yann
Lemarié</div>
<div dir="ltr" style="font-size:13px"><span style="font-size:x-small">iRaiser -
Support Technique</span></div>
<div dir="ltr"> <a href="http://www.iraiser.eu" target="_blank"> <img title="" alt="iRaiser Logotype" src="cid:part4.06080901.06050505@iraiser.eu" height="22" width="102"> </a> </div>
<div dir="ltr" style="font-size:13px"><span style="font-size:x-small"><a href="mailto:ylemarie@iraiser.eu" target="_blank"></a><a href="mailto:ylemarie@iraiser.eu" target="_blank">ylemarie@iraiser.eu</a></span></div>
</div>
</div>
</div>
</div>
</div>
</font></span></div>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
<div>-- <br>
<div dir="ltr">
<div style="margin-bottom:0px;margin-left:0px;padding-bottom:5px">
<div style="overflow:hidden">
<div dir="ltr">
<div dir="ltr" style="font-size:13px">Yann Lemarié</div>
<div dir="ltr" style="font-size:13px"><span style="font-size:x-small">iRaiser - Support Technique</span></div>
<div dir="ltr">
<a href="http://www.iraiser.eu" target="_blank"> <img title="" alt="iRaiser Logotype" src="cid:part9.09040506.09090006@iraiser.eu" height="22" width="102"> </a> </div>
<div dir="ltr" style="font-size:13px"><span style="font-size:x-small"><a href="mailto:ylemarie@iraiser.eu" target="_blank"></a><a href="mailto:ylemarie@iraiser.eu" target="_blank">ylemarie@iraiser.eu</a></span></div>
</div>
</div>
</div>
</div>
</div>
</div></div></div>
</blockquote></div><br></div>