<HTML><HEAD>
<STYLE id=eMClientCss>BLOCKQUOTE.cite {
PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px
}
BLOCKQUOTE.cite2 {
PADDING-TOP: 0px; PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; MARGIN-TOP: 3px; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px
}
.plain PRE {
FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal
}
.plain TT {
FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal
}
A IMG {
BORDER-TOP: 0px; BORDER-RIGHT: 0px; BORDER-BOTTOM: 0px; BORDER-LEFT: 0px
}
#xe60b686594a740079b887ddce629ff53 {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
#xf1e287161bd4490db9e311762abf12c2 {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
.plain PRE {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
.plain TT {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
BODY {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
</STYLE>
<STYLE title=signatureStyle>.plain TT {
FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal
}
.plain TT {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
</STYLE>
</HEAD>
<BODY>
<DIV>I am seeing the following on one of my FUSE clients (indy.rst and indy.rst.old has ??? ???). </DIV>
<DIV>Has anyone seen this before? Any idea what causes this for a given client?</DIV>
<DIV>If I try to access the file, I get a stale file handle.. </DIV>
<DIV> </DIV>
<DIV># cp indy.rst dfr.rst<BR>cp: cannot stat `indy.rst': Stale file handle<BR></DIV>
<DIV>Bottom of the log has: </DIV>
<DIV>[2015-02-10 22:20:34.913632] I [dht-rename.c:1344:dht_rename] 0-homegfs-dht: renaming /hpc_shared/motorsports/gmics/Raven/p4/133/dc3.tmp (hash=homegfs-replicate-2/cache=homegfs-replicate-2) => /hpc_shared/motorsports/gmics/Raven/p4/133/data_collected3 (hash=homegfs-replicate-3/cache=homegfs-replicate-2)<BR>[2015-02-10 22:40:04.138594] W [client-rpc-fops.c:504:client3_3_stat_cbk] 0-homegfs-client-1: remote operation failed: Stale file handle<BR>[2015-02-10 22:40:04.158855] W [MSGID: 108008] [afr-read-txn.c:221:afr_read_txn] 0-homegfs-replicate-0: Unreadable subvolume -1 found with event generation 2. (Possible split-brain)<BR>[2015-02-10 22:40:04.202696] W [fuse-bridge.c:779:fuse_attr_cbk<STRONG>] 0-glusterfs-fuse: 1396664: STAT() /hpc_shared/motorsports/gmics/Raven/p3/70_sst_r4_1em3/indy.rst.old => -1 (Stale file handle)<BR></STRONG>The message "W [MSGID: 108008] [afr-read-txn.c:221:afr_read_txn] 0-homegfs-replicate-0: Unreadable subvolume -1 found with event generation 2. (Possible split-brain)" repeated 14 times between [2015-02-10 22:40:04.158855] and [2015-02-10 22:41:00.610296]<BR>[2015-02-10 22:41:45.339419] W [MSGID: 108008] [afr-read-txn.c:221:afr_read_txn] 0-homegfs-replicate-0: Unreadable subvolume -1 found with event generation 2. (Possible split-brain)<BR>The message "W [MSGID: 108008] [afr-read-txn.c:221:afr_read_txn] 0-homegfs-replicate-0: Unreadable subvolume -1 found with event generation 2. (Possible split-brain)" repeated 31 times between [2015-02-10 22:41:45.339419] and [2015-02-10 22:43:11.483421]<BR>[2015-02-10 22:43:37.498720] W [MSGID: 108008] [afr-read-txn.c:221:afr_read_txn] 0-homegfs-replicate-0: Unreadable subvolume -1 found with event generation 2. (Possible split-brain)<BR><BR></DIV>
<DIV> </DIV>
<DIV> </DIV>
<DIV> </DIV>
<DIV><IMG src="cid:em4aabc1df-86bd-4195-a948-96db6c24cf4e@dfrobins-vaio"></DIV>
<DIV> </DIV>
<DIV>However, the same files on my other FUSE clients look fine:</DIV>
<DIV><SPAN id=xe60b686594a740079b887ddce629ff53 style="BACKGROUND-COLOR: #ffffff">
<DIV> <SPAN id=xf1e287161bd4490db9e311762abf12c2 style="BACKGROUND-COLOR: #ffffff">
<DIV>From the storage system:</DIV>
<DIV><IMG src="cid:emce5dc613-f1b7-4f00-871d-65ef01210a92@dfrobins-vaio"></DIV>
<DIV> </DIV>
<DIV>From another client:</DIV>
<DIV><IMG src="cid:em8b66162c-f75b-4c4b-b901-f9eb2e2aed9d@dfrobins-vaio"></DIV></SPAN></SPAN></DIV></DIV></BODY></HTML>