<font size=2 face="sans-serif">Thanks for your response.</font>
<br>
<br><font size=2 face="sans-serif">We use glusterfs 3.6.7.</font>
<br>
<br><font size=2 face="sans-serif">Sure ,We use Centos7.0.</font>
<br>
<br><font size=2 face="sans-serif">Related log show bellow:</font>
<br>
<br><font size=2 face="sans-serif"> 143 [2016-04-13 06:33:54.236013]
W [glusterfsd.c:1211:cleanup_and_exit] (--> 0-: received signum (15),
shutting down</font>
<br><font size=2 face="sans-serif"> 144 [2016-04-13 06:33:54.236081]
I [fuse-bridge.c:5607:fini] 0-fuse: Unmounting '/var/lib/nova/mnt/a77401a594b06b2b56cc52ee61bb4
def'.</font>
<br><font size=2 face="sans-serif"> 145 [2016-04-13 06:55:11.365558]
I [MSGID: 100030] [glusterfsd.c:2035:main] 0-/usr/sbin/glusterfs: Started
running /usr/sbin/glu sterfs version 3.6.7 (args:
/usr/sbin/glusterfs --volfile-server=10.74.125.254 --volfile-id=/xitos-volume
/var/lib/nova/mnt/ a77401a594b06b2b56cc52ee61bb4def)</font>
<br><font size=2 face="sans-serif"> 146 [2016-04-13 06:55:11.402762]
I [dht-shared.c:337:dht_init_regex] 0-xitos-volume-dht: using regex rsync-hash-regex
= ^\.(.+)\ .[^.]+$</font>
<br><font size=2 face="sans-serif"> 147 [2016-04-13 06:55:11.404087]
I [client.c:2268:notify] 0-xitos-volume-client-0: parent translators are
ready, attempting conn ect on transport</font>
<br><font size=2 face="sans-serif"> 148 Final graph:</font>
<br><font size=2 face="sans-serif"> 149 +------------------------------------------------------------------------------+</font>
<br><font size=2 face="sans-serif"> 150 1: volume xitos-volume-client-0</font>
<br><font size=2 face="sans-serif"> 151 2:
type protocol/client</font>
<br><font size=2 face="sans-serif"> 152 3:
option ping-timeout 42</font>
<br><font size=2 face="sans-serif"> 153 4:
option remote-host 10.74.125.247</font>
<br><font size=2 face="sans-serif"> 154 5:
option remote-subvolume /mnt/dht/volume</font>
<br><font size=2 face="sans-serif"> 155 6:
option transport-type socket</font>
<br><font size=2 face="sans-serif"> 156 7:
option send-gids true</font>
<br><font size=2 face="sans-serif"> 157 8: end-volume</font>
<br><font size=2 face="sans-serif"> 158 9: </font>
<br><font size=2 face="sans-serif"> 159 10: volume xitos-volume-dht</font>
<br><font size=2 face="sans-serif"> 160 11:
type cluster/distribute</font>
<br><font size=2 face="sans-serif"> 161 12:
subvolumes xitos-volume-client-0</font>
<br><font size=2 face="sans-serif"> 162 13: end-volume</font>
<br><font size=2 face="sans-serif"> 163 14: </font>
<br><font size=2 face="sans-serif"> 164 15: volume xitos-volume-write-behind</font>
<br><font size=2 face="sans-serif"> 165 16:
type performance/write-behind</font>
<br><font size=2 face="sans-serif"> 166 17:
subvolumes xitos-volume-dht</font>
<br><font size=2 face="sans-serif"> 167 18: end-volume</font>
<br><font size=2 face="sans-serif"> 168 19: </font>
<br><font size=2 face="sans-serif"> 169 20: volume xitos-volume-read-ahead</font>
<br><font size=2 face="sans-serif"> 170 21:
type performance/read-ahead</font>
<br><font size=2 face="sans-serif"> 171 22:
subvolumes xitos-volume-write-behind</font>
<br><font size=2 face="sans-serif"> 172 23: end-volume</font>
<br><font size=2 face="sans-serif"> 173 24: </font>
<br><font size=2 face="sans-serif"> 174 25: volume xitos-volume-io-cache</font>
<br><font size=2 face="sans-serif"> 175 26:
type performance/io-cache</font>
<br><font size=2 face="sans-serif"> 176 27:
subvolumes xitos-volume-read-ahead</font>
<br><font size=2 face="sans-serif"> 177 28: end-volume</font>
<br><font size=2 face="sans-serif"> 178 29:</font>
<br><font size=2 face="sans-serif"> 179 30: volume xitos-volume-quick-read</font>
<br><font size=2 face="sans-serif"> 180 31:
type performance/quick-read</font>
<br><font size=2 face="sans-serif"> 181 32:
subvolumes xitos-volume-io-cache</font>
<br><font size=2 face="sans-serif"> 182 33: end-volume</font>
<br><font size=2 face="sans-serif"> 183 34:</font>
<br><font size=2 face="sans-serif"> 184 35: volume xitos-volume-open-behind</font>
<br><font size=2 face="sans-serif"> 185 36:
type performance/open-behind</font>
<br><font size=2 face="sans-serif"> 186 37:
subvolumes xitos-volume-quick-read</font>
<br><font size=2 face="sans-serif"> 187 38: end-volume</font>
<br><font size=2 face="sans-serif"> 188 39:</font>
<br><font size=2 face="sans-serif"> 189 40: volume xitos-volume-md-cache</font>
<br><font size=2 face="sans-serif"> 190 41:
type performance/md-cache</font>
<br><font size=2 face="sans-serif"> 191 42:
subvolumes xitos-volume-open-behind</font>
<br><font size=2 face="sans-serif"> 192 43: end-volume</font>
<br><font size=2 face="sans-serif"> 193 44:</font>
<br><font size=2 face="sans-serif"> 194 45: volume xitos-volume</font>
<br><font size=2 face="sans-serif"> 195 46:
type debug/io-stats</font>
<br><font size=2 face="sans-serif"> 196 47:
option latency-measurement off</font>
<br><font size=2 face="sans-serif"> 197 48:
option count-fop-hits off</font>
<br><font size=2 face="sans-serif"> 198 49:
subvolumes xitos-volume-md-cache</font>
<br><font size=2 face="sans-serif"> 199 50: end-volume</font>
<br><font size=2 face="sans-serif"> 200 51: </font>
<br><font size=2 face="sans-serif"> 201 52: volume meta-autoload</font>
<br><font size=2 face="sans-serif"> 202 53:
type meta</font>
<br><font size=2 face="sans-serif"> 203 54:
subvolumes xitos-volume</font>
<br><font size=2 face="sans-serif"> 204 55: end-volume</font>
<br><font size=2 face="sans-serif"> 205 56: </font>
<br><font size=2 face="sans-serif"> 206 +------------------------------------------------------------------------------+</font>
<br><font size=2 face="sans-serif"> 207 [2016-04-13 06:55:11.408891]
I [rpc-clnt.c:1761:rpc_clnt_reconfig] 0-xitos-volume-client-0: changing
port to 49152 (from 0)</font>
<br><font size=2 face="sans-serif"> 208 [2016-04-13 06:55:11.413254]
I [client-handshake.c:1413:select_server_supported_programs] 0-xitos-volume-client-0:
Using Pro gram GlusterFS 3.3, Num (1298437),
Version (330)</font>
<br><font size=2 face="sans-serif"> 209 [2016-04-13 06:55:11.413766]
I [client-handshake.c:1200:client_setvolume_cbk] 0-xitos-volume-client-0:
Connected to xitos-vo lume-client-0, attached
to remote volume '/mnt/dht/volume'.</font>
<br><font size=2 face="sans-serif"> 210 [2016-04-13 06:55:11.413795]
I [client-handshake.c:1210:client_setvolume_cbk] 0-xitos-volume-client-0:
Server and Client lk- version numbers are not
same, reopening the fds</font>
<br><font size=2 face="sans-serif"> 211 [2016-04-13 06:55:11.420494]
I [fuse-bridge.c:5086:fuse_graph_setup] 0-fuse: switched to graph 0</font>
<br><font size=2 face="sans-serif"> 212 [2016-04-13 06:55:11.420691]
I [client-handshake.c:188:client_set_lk_version_cbk] 0-xitos-volume-client-0:
Server lk version = 1</font>
<br><font size=2 face="sans-serif"> 213 [2016-04-13 06:55:11.420921]
I [fuse-bridge.c:4015:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol
versions: glusterf s 7.22 kernel 7.22</font>
<br><font size=2 face="sans-serif"><b> 214 pending frames:</b></font>
<br><font size=2 face="sans-serif"><b> 215 frame : type(0)
op(0)</b></font>
<br><font size=2 face="sans-serif"><b> 216 frame : type(0)
op(0)</b></font>
<br><font size=2 face="sans-serif"><b> 217 frame : type(0)
op(0)</b></font>
<br><font size=2 face="sans-serif"><b> 218 frame : type(0)
op(0)</b></font>
<br><font size=2 face="sans-serif"><b> 219 frame : type(0)
op(0)</b></font>
<br><font size=2 face="sans-serif"><b> 220 frame : type(0)
op(0)</b></font>
<br><font size=2 face="sans-serif"><b> 221 frame : type(0)
op(0)</b></font>
<br><font size=2 face="sans-serif"><b> 222 patchset: git://git.gluster.com/glusterfs.git</b></font>
<br><font size=2 face="sans-serif"><b> 223 signal received:
6</b></font>
<br><font size=2 face="sans-serif"><b> 224 time of crash:</b></font>
<br><font size=2 face="sans-serif"><b> 225 2016-04-13 08:15:37</b></font>
<br><font size=2 face="sans-serif"><b> 226 configuration details:</b></font>
<br><font size=2 face="sans-serif"><b> 227 argp 1</b></font>
<br><font size=2 face="sans-serif"><b> 228 backtrace 1</b></font>
<br><font size=2 face="sans-serif"><b> 229 dlfcn 1</b></font>
<br><font size=2 face="sans-serif"><b> 230 libpthread 1</b></font>
<br><font size=2 face="sans-serif"><b> 231 llistxattr 1</b></font>
<br><font size=2 face="sans-serif"><b> 232 setfsid 1</b></font>
<br><font size=2 face="sans-serif"><b> 233 spinlock 1</b></font>
<br><font size=2 face="sans-serif"><b> 234 epoll.h 1</b></font>
<br><font size=2 face="sans-serif"><b> 235 xattr.h 1</b></font>
<br><font size=2 face="sans-serif"><b> 236 st_atim.tv_nsec
1</b></font>
<br><font size=2 face="sans-serif"><b> 237 package-string:
glusterfs 3.6.7</b></font>
<br><font size=2 face="sans-serif"><b> 238 /lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0xb2)[0x7f308d9e93d2]</b></font>
<br><font size=2 face="sans-serif"><b> 239 /lib64/libglusterfs.so.0(gf_print_trace+0x32d)[0x7f308da008bd]</b></font>
<br><font size=2 face="sans-serif"><b> 240 /lib64/libc.so.6(+0x35a00)[0x7f308ca04a00]</b></font>
<br><font size=2 face="sans-serif"><b> 241 /lib64/libc.so.6(gsignal+0x39)[0x7f308ca04989]</b></font>
<br><font size=2 face="sans-serif"><b> 242 /lib64/libc.so.6(abort+0x148)[0x7f308ca06098]</b></font>
<br><font size=2 face="sans-serif"><b> 243 /lib64/libc.so.6(+0x76197)[0x7f308ca45197]</b></font>
<br><font size=2 face="sans-serif"><b> 244 /lib64/libc.so.6(+0x7d56d)[0x7f308ca4c56d]</b></font>
<br><font size=2 face="sans-serif"><b> 245 /usr/lib64/glusterfs/3.6.7/xlator/cluster/distribute.so(dht_local_wipe+0x151)[0x7f308096ebc1]</b></font>
<br><font size=2 face="sans-serif"><b> 246 /usr/lib64/glusterfs/3.6.7/xlator/cluster/distribute.so(dht_writev_cbk+0x19d)[0x7f308099b9fd]</b></font>
<br><font size=2 face="sans-serif"><b> 247 /usr/lib64/glusterfs/3.6.7/xlator/protocol/client.so(client3_3_writev_cbk+0x672)[0x7f3080be4512]</b></font>
<br><font size=2 face="sans-serif"><b> 248 /lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)[0x7f308d7bd100]</b></font>
<br><font size=2 face="sans-serif"><b> 249 /lib64/libgfrpc.so.0(rpc_clnt_notify+0x174)[0x7f308d7bd374]</b></font>
<br><font size=2 face="sans-serif"><b> 250 /lib64/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f308d7b92c3]</b></font>
<br><font size=2 face="sans-serif"><b> 251 /usr/lib64/glusterfs/3.6.7/rpc-transport/socket.so(+0x87a0)[0x7f3082ac17a0]</b></font>
<br><font size=2 face="sans-serif"><b> 252 /usr/lib64/glusterfs/3.6.7/rpc-transport/socket.so(+0xaf94)[0x7f3082ac3f94]</b></font>
<br><font size=2 face="sans-serif"><b> 253 /lib64/libglusterfs.so.0(+0x768c2)[0x7f308da3e8c2]</b></font>
<br><font size=2 face="sans-serif"><b> 254 /usr/sbin/glusterfs(main+0x502)[0x7f308de92fe2]</b></font>
<br><font size=2 face="sans-serif"><b> 255 /lib64/libc.so.6(__libc_start_main+0xf5)[0x7f308c9f0af5]</b></font>
<br><font size=2 face="sans-serif"><b> 256 /usr/sbin/glusterfs(+0x6381)[0x7f308de93381]</b></font>
<br><font size=2 face="sans-serif"><b> 257 ---------</b></font>
<br><font size=2 face="sans-serif"> 258 [2016-04-13 08:36:22.385866]
I [MSGID: 100030] [glusterfsd.c:2035:main] 0-/usr/sbin/glusterfs: Started
running /usr/sbin/glu sterfs version 3.6.7 (args:
/usr/sbin/glusterfs --volfile-server=10.74.125.254 --volfile-id=/xitos-volume
/var/lib/nova/mnt/ a77401a594b06b2b56cc52ee61bb4def)</font>
<br><font size=2 face="sans-serif"> 259 [2016-04-13 08:36:22.409856]
I [dht-shared.c:337:dht_init_regex] 0-xitos-volume-dht: using regex rsync-hash-regex
= ^\.(.+)\ .[^.]+$</font>
<br><font size=2 face="sans-serif"> 260 [2016-04-13 08:36:22.411477]
I [client.c:2268:notify] 0-xitos-volume-client-0: parent translators are
ready, attempting conn ect on transport</font>
<br><font size=2 face="sans-serif"> 261 Final graph:</font>
<br><font size=2 face="sans-serif"> 262 +------------------------------------------------------------------------------+</font>
<br><font size=2 face="sans-serif"> 263 1: volume xitos-volume-client-0</font>
<br><font size=2 face="sans-serif"> 264 2:
type protocol/client</font>
<br><font size=2 face="sans-serif"> 265 3:
option ping-timeout 42<br>
</font>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br><font size=3>On Fri, Apr 15, 2016 at 2:43 AM, </font><a href=mailto:yang.bin18@zte.com.cn><font size=3 color=blue><u>yang.bin18@zte.com.cn</u></font></a><font size=3>
<</font><a href=mailto:yang.bin18@zte.com.cn target=_blank><font size=3 color=blue><u>yang.bin18@zte.com.cn</u></font></a><font size=3>>
wrote:</font>
<br><font size=2 face="sans-serif">Glusterfs core when mounting. here is
the backtree.</font><font size=3><br>
<br>
</font><font size=2 face="sans-serif"><br>
Program terminated with signal 6, Aborted.</font><font size=3> </font><font size=2 face="sans-serif"><br>
#0 0x00007f308ca04989 in raise () from /lib64/libc.so.6</font><font size=3>
</font><font size=2 face="sans-serif"><br>
Missing separate debuginfos, use: debuginfo-install glibc-2.17-55.el7.x86_64
keyutils-libs-1.5.8-3.el7.x86_64 krb5-libs-1.11.3-49.el7.x86_64 libcom_err-1.42.9-4.el7.x86_64
libgcc-4.8.2-16.el7.x86_64 libselinux-2.2.2-6.el7.x86_64 openssl-libs-1.0.1e-34.el7.7.x86_64
pcre-8.32-12.el7.x86_64 sssd-client-1.11.2-65.el7.x86_64 xz-libs-5.1.2-8alpha.el7.x86_64
zlib-1.2.7-13.el7.x86_64</font><font size=3> </font><font size=2 face="sans-serif"><br>
(gdb) bt</font><font size=3> </font><font size=2 face="sans-serif"><br>
#0 0x00007f308ca04989 in raise () from /lib64/libc.so.6</font><font size=3>
</font><font size=2 face="sans-serif"><br>
#1 0x00007f308ca06098 in abort () from /lib64/libc.so.6</font><font size=3>
</font><font size=2 face="sans-serif"><br>
#2 0x00007f308ca45197 in __libc_message () from /lib64/libc.so.6</font><font size=3>
</font><font size=2 face="sans-serif"><br>
#3 0x00007f308ca4c56d in _int_free () from /lib64/libc.so.6</font><font size=3>
</font><font size=2 face="sans-serif"><br>
#4 0x00007f308096ebc1 in dht_local_wipe (this=0x7f308f306460, local=0x7f3080042880)
at dht-helper.c:475</font><font size=3> </font><font size=2 face="sans-serif"><br>
#5 0x00007f308099b9fd in dht_writev_cbk (frame=0x7f308bc11e5c, cookie=<optimized
out>, this=<optimized out>, op_ret=131072, <br>
op_errno=0, prebuf=<optimized out>, postbuf=0x7fff2020c870,
xdata=0x0) at dht-inode-write.c:84</font><font size=3> </font><font size=2 face="sans-serif"><br>
#6 0x00007f3080be4512 in client3_3_writev_cbk (req=<optimized
out>, iov=<optimized out>, count=<optimized out>, <br>
myframe=0x7f308bc116f8) at client-rpc-fops.c:856</font><font size=3>
</font><font size=2 face="sans-serif"><br>
#7 0x00007f308d7bd100 in rpc_clnt_handle_reply (clnt=clnt@entry=0x7f308f3292d0,
pollin=pollin@entry=0x7f308f39bb10)</font><font size=3> </font><font size=2 face="sans-serif"><br>
at rpc-clnt.c:763</font><font size=3> </font><font size=2 face="sans-serif"><br>
#8 0x00007f308d7bd374 in rpc_clnt_notify (trans=<optimized out>,
mydata=0x7f308f329300, event=<optimized out>, <br>
data=0x7f308f39bb10) at rpc-clnt.c:891</font><font size=3>
</font><font size=2 face="sans-serif"><br>
#9 0x00007f308d7b92c3 in rpc_transport_notify (this=this@entry=0x7f308f35f3f0,
event=event@entry=RPC_TRANSPORT_MSG_RECEIVED, <br>
data=data@entry=0x7f308f39bb10) at rpc-transport.c:516</font><font size=3>
</font><font size=2 face="sans-serif"><br>
#10 0x00007f3082ac17a0 in socket_event_poll_in (this=this@entry=0x7f308f35f3f0)
at socket.c:2234</font><font size=3> </font><font size=2 face="sans-serif"><br>
#11 0x00007f3082ac3f94 in socket_event_handler (fd=<optimized out>,
idx=1, data=data@entry=0x7f308f35f3f0, poll_in=1, poll_out=0, <br>
poll_err=0) at socket.c:2347</font><font size=3> </font><font size=2 face="sans-serif"><br>
#12 0x00007f308da3e8c2 in event_dispatch_epoll_handler (i=<optimized
out>, events=0x7f308f2febd0, event_pool=0x7f308f2b76c0)</font><font size=3>
</font><font size=2 face="sans-serif"><br>
at event-epoll.c:384</font><font size=3> </font><font size=2 face="sans-serif"><br>
#13 event_dispatch_epoll (event_pool=0x7f308f2b76c0) at event-epoll.c:445</font><font size=3>
</font><font size=2 face="sans-serif"><br>
#14 0x00007f308de92fe2 in main (argc=4, argv=0x7fff2020de78) at glusterfsd.c:2060</font><font size=3>
</font>
<br>
<br>
<br><font size=3>Thanks for the report. What version of gluster is being
used here? I assume this is on Centos 7.</font>
<br>
<br><font size=3>Would it be possible to share the client log file?</font>
<br>
<br><font size=3>Regards,</font>
<br><font size=3>Vijay</font>
<br>
<br><pre><font color="blue">
--------------------------------------------------------
ZTE Information Security Notice: The information contained in this mail (and any attachment transmitted herewith) is privileged and confidential and is intended for the exclusive use of the addressee(s). If you are not an intended recipient, any disclosure, reproduction, distribution or other dissemination or use of the information contained is strictly prohibited. If you have received this mail in error, please delete it and notify us immediately.
</font></pre><br>