<HTML><HEAD>
<STYLE id=eMClientCss>blockquote.cite { margin-left: 5px; margin-right: 0px; padding-left: 10px; padding-right:0px; border-left: 1px solid #cccccc }
blockquote.cite2 {margin-left: 5px; margin-right: 0px; padding-left: 10px; padding-right:0px; border-left: 1px solid #cccccc; margin-top: 3px; padding-top: 0px; }
.plain pre, .plain tt { font-family: monospace; font-size: 100%; font-weight: normal; font-style: normal; }
a img { border: 0px; }body {font-family: Calibri;font-size: 11pt;}
.plain pre, .plain tt {font-family: Calibri;font-size: 11pt;}
BLOCKQUOTE.cite {
PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px
}
BLOCKQUOTE.cite2 {
PADDING-TOP: 0px; PADDING-LEFT: 10px; MARGIN-LEFT: 5px; BORDER-LEFT: #cccccc 1px solid; MARGIN-TOP: 3px; PADDING-RIGHT: 0px; MARGIN-RIGHT: 0px
}
.plain PRE {
FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal
}
.plain TT {
FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal
}
A IMG {
BORDER-TOP: 0px; BORDER-RIGHT: 0px; BORDER-BOTTOM: 0px; BORDER-LEFT: 0px
}
BODY {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
.plain PRE {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
.plain TT {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}</STYLE>
<STYLE title=signatureStyle>.plain TT {
FONT-SIZE: 100%; FONT-FAMILY: monospace; FONT-WEIGHT: normal; FONT-STYLE: normal
}
.plain TT {
FONT-SIZE: 11pt; FONT-FAMILY: Calibri
}
</STYLE>
</HEAD>
<BODY>
<DIV>I am seeing these messsages after I delete large amounts of data using gluster 3.6.2.</DIV>
<DIV>cannot delete non-empty directory: old_shelf4/Aegis/!!!Programs/RavenCFD/Storage/Jimmy_Old/src_vj1.5_final<BR></DIV>
<DIV> </DIV>
<DIV><STRONG><U>From the FUSE mount (as root), the directory shows up as empty:</U></STRONG></DIV>
<DIV> </DIV>
<DIV># pwd<BR>/backup/homegfs/backup.0/old_shelf4/Aegis/!!!Programs/RavenCFD/Storage/Jimmy_Old/src_vj1.5_final</DIV>
<DIV><BR># ls -al<BR>total 5<BR>d--------- 2 root root 4106 Feb 6 13:55 .<BR>drwxrws--- 3 601 dmiller 72 Feb 6 13:55 ..</DIV>
<DIV> </DIV>
<DIV>However, when you look at the bricks, the files are still there (none on brick01bkp, all files are on brick02bkp). All of the files are 0-length and have ------T permissions.</DIV>
<DIV>Any suggestions on how to fix this and how to prevent it from happening?</DIV>
<DIV> </DIV>
<DIV># ls -al /data/brick*/homegfs_bkp/backup.0/old_shelf4/Aegis/\!\!\!Programs/RavenCFD/Storage/Jimmy_Old/src_vj1.5_final<BR>/data/brick01bkp/homegfs_bkp/backup.0/old_shelf4/Aegis/!!!Programs/RavenCFD/Storage/Jimmy_Old/src_vj1.5_final:<BR>total 4<BR>d---------+ 2 root root 10 Feb 6 13:55 .<BR>drwxrws---+ 3 601 raven 36 Feb 6 13:55 ..</DIV>
<DIV> </DIV>
<DIV>/data/brick02bkp/homegfs_bkp/backup.0/old_shelf4/Aegis/!!!Programs/RavenCFD/Storage/Jimmy_Old/src_vj1.5_final:<BR>total 8<BR>d---------+ 3 root root 4096 Dec 31 1969 .<BR>drwxrws---+ 3 601 raven 36 Feb 6 13:55 ..<BR>---------T 5 601 raven 0 Nov 20 00:08 read_inset.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 readbc.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 readcn.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 readinp.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 readinp_v1_2.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 readinp_v1_3.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 rotatept.f.gz<BR>d---------+ 2 root root 118 Feb 6 13:54 save1<BR>---------T 5 601 raven 0 Nov 20 00:08 sepvec.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 shadow.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 snksrc.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 source.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 step.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 stoprog.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 summer6.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 totforc.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 tritet.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 wallrsd.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 wheat.f.gz<BR>---------T 5 601 raven 0 Nov 20 00:08 write_inset.f.gz<BR></DIV>
<DIV> </DIV>
<DIV> </DIV>
<DIV>This is using gluster 3.6.2 on a distributed gluster volume that resides on a single machine. Both of the bricks are on one machine consisting of 2x RAID-6 arrays.</DIV>
<DIV> </DIV>
<DIV>df -h | grep brick</DIV>
<DIV>/dev/mapper/vg01-lvol1 88T 22T 66T 25% /data/brick01bkp<BR>/dev/mapper/vg02-lvol1 88T 22T 66T 26% /data/brick02bkp</DIV>
<DIV> </DIV>
<DIV># gluster volume info homegfs_bkp</DIV>
<DIV>Volume Name: homegfs_bkp<BR>Type: Distribute<BR>Volume ID: 96de8872-d957-4205-bf5a-076e3f35b294<BR>Status: Started<BR>Number of Bricks: 2<BR>Transport-type: tcp<BR>Bricks:<BR>Brick1: gfsib01bkp.corvidtec.com:/data/brick01bkp/homegfs_bkp<BR>Brick2: gfsib01bkp.corvidtec.com:/data/brick02bkp/homegfs_bkp<BR>Options Reconfigured:<BR>storage.owner-gid: 100<BR>performance.io-thread-count: 32<BR>server.allow-insecure: on<BR>network.ping-timeout: 10<BR>performance.cache-size: 128MB<BR>performance.write-behind-window-size: 128MB<BR>server.manage-gids: on<BR>changelog.rollover-time: 15<BR>changelog.fsync-interval: 3<BR></DIV>
<DIV> </DIV>
<DIV> </DIV>
<DIV id=signature_old>
<DIV style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri"><SPAN id=1348f65e19ee496282228556c6b7280a>
<DIV></DIV>
<DIV> </DIV>
<DIV id=signature_old>
<DIV style="FONT-SIZE: 11pt; FONT-FAMILY: Calibri"><SPAN id=d5c4808716844dbdb517ca869a81ed1d>
<DIV>=============================== </DIV>
<DIV>David F. Robinson, Ph.D. </DIV>
<DIV>President - Corvid Technologies </DIV>
<DIV>704.799.6944 x101 [office] </DIV>
<DIV>704.252.1310 [cell] </DIV>
<DIV>704.799.7974 [fax] </DIV>
<DIV><A href="mailto:David.Robinson@corvidtec.com">David.Robinson@corvidtec.com</A></DIV>
<DIV><A href="http://www.corvidtechnologies.com">http://www.corvidtechnologies.com</A></DIV></SPAN></DIV></DIV>
<DIV> </DIV></SPAN></DIV></DIV>
<DIV> </DIV></BODY></HTML>