<HTML><HEAD>
<STYLE id=eMClientCss>BLOCKQUOTE.cite {
        PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px
}
BLOCKQUOTE.cite2 {
        PADDING-TOP: 0px; PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; MARGIN-TOP: 3px; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px
}
.plain PRE {
        FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal
}
.plain TT {
        FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal
}
A IMG {
        BORDER-TOP: 0px; BORDER-RIGHT: 0px; BORDER-BOTTOM: 0px; BORDER-LEFT: 0px
}
#x7769f3cbbca44011b61184d1af7e16ae {
        FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
.plain PRE {
        FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
.plain TT {
        FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
BODY {
        FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
</STYLE>
<STYLE></STYLE>
</HEAD>
<BODY scroll=auto class>
<DIV><SPAN id=x7769f3cbbca44011b61184d1af7e16ae>
<DIV>Sorry. Thought about this a little more. I should have been clearer. The files were on both bricks of the replica, not just one side. So, both bricks had to have been up... The files/directories just don't show up on the mount. </DIV>
<DIV> </DIV>
<DIV>I was reading and saw a related bug (<A href="https://bugzilla.redhat.com/show_bug.cgi?id=1159484">https://bugzilla.redhat.com/show_bug.cgi?id=1159484</A>). I saw it suggested to run:</DIV>
<DIV> </DIV>
<DIV> find <mount> -d -exec getfattr -h -n trusted.ec.heal {} \;</DIV>
<DIV><BR> </DIV>
<DIV>I get a bunch of errors for operation not supported:</DIV>
<DIV> </DIV>
<DIV>[root@gfs02a homegfs]# find wks_backup -d -exec getfattr -h -n trusted.ec.heal {} \;<BR>find: warning: the -d option is deprecated; please use -depth instead, because the latter is a POSIX-compliant feature.<BR>wks_backup/homer_backup/backup: trusted.ec.heal: Operation not supported<BR>wks_backup/homer_backup/logs/2014_05_20.log: trusted.ec.heal: Operation not supported<BR>wks_backup/homer_backup/logs/2014_05_21.log: trusted.ec.heal: Operation not supported<BR>wks_backup/homer_backup/logs/2014_05_18.log: trusted.ec.heal: Operation not supported<BR>wks_backup/homer_backup/logs/2014_05_19.log: trusted.ec.heal: Operation not supported<BR>wks_backup/homer_backup/logs/2014_05_22.log: trusted.ec.heal: Operation not supported<BR>wks_backup/homer_backup/logs: trusted.ec.heal: Operation not supported<BR>wks_backup/homer_backup: trusted.ec.heal: Operation not supported<BR></DIV></SPAN></DIV>
<DIV> </DIV>
<DIV>------ Original Message ------</DIV>
<DIV>From: "Benjamin Turner" <<A href="mailto:bennyturns@gmail.com">bennyturns@gmail.com</A>></DIV>
<DIV>To: "David F. Robinson" <<A href="mailto:david.robinson@corvidtec.com">david.robinson@corvidtec.com</A>></DIV>
<DIV>Cc: "Gluster Devel" <<A href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</A>>; "gluster-users@gluster.org" <<A href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</A>></DIV>
<DIV>Sent: 2/3/2015 7:12:34 PM</DIV>
<DIV>Subject: Re: [Gluster-devel] missing files</DIV>
<DIV> </DIV>
<DIV id=xb7d4c5aa0ad14cf08027779d54423fff>
<BLOCKQUOTE class=cite2 cite=CA+zRGOTJRdwKC_DxaZ7=HbboLegNdh-+jLja49XNF2EyrNo1nw@mail.gmail.com type="cite">
<DIV dir=ltr>It sounds to me like the files were only copied to one replica, werent there for the initial for the initial ls which triggered a self heal, and were there for the last ls because they were healed. Is there any chance that one of the replicas was down during the rsync? It could be that you lost a brick during copy or something like that. To confirm I would look for disconnects in the brick logs as well as checking glusterfshd.log to verify the missing files were actually healed.
<DIV><BR></DIV>
<DIV>-b</DIV></DIV>
<DIV class=gmail_extra><BR>
<DIV class=gmail_quote>On Tue, Feb 3, 2015 at 5:37 PM, David F. Robinson <SPAN dir=ltr><<A href="mailto:david.robinson@corvidtec.com">david.robinson@corvidtec.com</A>></SPAN> wrote:<BR>
<BLOCKQUOTE class=gmail_quote style="PADDING-LEFT: 1ex; MARGIN: 0px 0px 0px 0.8ex; BORDER-LEFT: #ccc 1px solid">
<DIV>
<DIV>I rsync'd 20-TB over to my gluster system and noticed that I had some directories missing even though the rsync completed normally. </DIV>
<DIV>The rsync logs showed that the missing files were transferred. </DIV>
<DIV> </DIV>
<DIV>I went to the bricks and did an 'ls -al /data/brick*/homegfs/dir/*' the files were on the bricks. After I did this 'ls', the files then showed up on the FUSE mounts. </DIV>
<DIV> </DIV>
<DIV>1) Why are the files hidden on the fuse mount? </DIV>
<DIV>2) Why does the ls make them show up on the FUSE mount?</DIV>
<DIV>3) How can I prevent this from happening again?</DIV>
<DIV> </DIV>
<DIV>Note, I also mounted the gluster volume using NFS and saw the same behavior. The files/directories were not shown until I did the "ls" on the bricks.</DIV>
<DIV> </DIV>
<DIV>David</DIV>
<DIV> </DIV>
<DIV> </DIV>
<DIV>
<DIV style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri"><SPAN>
<DIV></DIV>
<DIV> </DIV>
<DIV>
<DIV style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri"><SPAN>
<DIV>=============================== </DIV>
<DIV>David F. Robinson, Ph.D. </DIV>
<DIV>President - Corvid Technologies </DIV>
<DIV><A href="tel:704.799.6944%20x101" value="+17047996944">704.799.6944 x101</A> [office] </DIV>
<DIV><A href="tel:704.252.1310" value="+17042521310">704.252.1310</A> [cell] </DIV>
<DIV><A href="tel:704.799.7974" value="+17047997974">704.799.7974</A> [fax] </DIV>
<DIV><A href="mailto:David.Robinson@corvidtec.com">David.Robinson@corvidtec.com</A></DIV>
<DIV><A href="http://www.corvidtechnologies.com/">http://www.corvidtechnologies.com</A></DIV></SPAN></DIV></DIV>
<DIV> </DIV></SPAN></DIV></DIV>
<DIV> </DIV></DIV><BR>_______________________________________________<BR>Gluster-devel mailing list<BR><A href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</A><BR><A href="http://www.gluster.org/mailman/listinfo/gluster-devel">http://www.gluster.org/mailman/listinfo/gluster-devel</A><BR><BR></BLOCKQUOTE></DIV><BR></DIV></BLOCKQUOTE></DIV></BODY></HTML>