<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle19
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-CA" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Hello,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We’ve noticed that the .glusterfs directory is larger than the contents of the volume. Our application only has access through the client so I don’t suspect anything was deleted on the brick.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"># du -sh .glusterfs<o:p></o:p></p>
<p class="MsoNormal">31G .glusterfs/<o:p></o:p></p>
<p class="MsoNormal"># du -sh *<o:p></o:p></p>
<p class="MsoNormal">13G dir1<o:p></o:p></p>
<p class="MsoNormal">31M dir2<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">How could we have come into this state? Is there a way to find what is orphaned?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We tried looking for any references to deleted files but it didn’t seem to yield much:<o:p></o:p></p>
<p class="MsoNormal"># find .glusterfs -links 1 –ls<o:p></o:p></p>
<p class="MsoNormal">221163 0 lrwxrwxrwx 1 root root 51 Mar 4 14:34 .glusterfs/91/ff/91ffa-f20f-4933-a8d6-abx93074 -> ../../00/00/00000000-0000-0000-0000-000000000001/dir2<o:p></o:p></p>
<p class="MsoNormal">383515 0 lrwxrwxrwx 1 root root 59 Mar 4 15:08 .glusterfs/b1/2d/bd5b5-e00c-4bd1-95c6-312a25 -> ../../7e/85/7cxxxxxxxxxxx90-88e9-4cdd-95fd-dd48/recyclebin<o:p></o:p></p>
<p class="MsoNormal">449405 0 lrwxrwxrwx 1 root root 51 Mar 4 15:08 .glusterfs/21/28/2102-101e-4177-b775-74379ba -> ../../00/00/00000000-0000-0000-0000-000000000001/dir2<o:p></o:p></p>
<p class="MsoNormal">394150 0 lrwxrwxrwx 1 root root 59 Apr 4 13:24 .glusterfs/c7/2b/c728-877-49a-b7d-3bxxxx3149c -> ../../e1/09/e10xx94e-c5xcd-4c1f-95f-48xxxx24106e/recyclebin<o:p></o:p></p>
<p class="MsoNormal">229934 0 lrwxrwxrwx 1 root root 60 Mar 4 15:08 .glusterfs/00/00/00000000-0000-0000-0000-000000000006 -> ../../00/00/00000000-0000-0000-0000-000000000005/internal_op<o:p></o:p></p>
<p class="MsoNormal">212931 0 lrwxrwxrwx 1 root root 8 Mar 4 15:08 .glusterfs/00/00/00000000-0000-0000-0000-000000000001 -> ../../..<o:p></o:p></p>
<p class="MsoNormal">477541 0 lrwxrwxrwx 1 root root 58 Mar 4 15:08 .glusterfs/00/00/00000000-0000-0000-0000-000000000005 -> ../../00/00/00000000-0000-0000-0000-000000000001/.trashcan<o:p></o:p></p>
<p class="MsoNormal">385048 0 lrwxrwxrwx 1 root root 55 Mar 23 12:02 .glusterfs/b3/21/b3xxb20-4b23-4e93-8db4-3dxx8x6e -> ../../e1/09/e10084e-c5cd-4c1f-95f-482106e/videos<o:p></o:p></p>
<p class="MsoNormal">219936 4 -rw-r--r-- 1 root root 19 Apr 27 10:54 .glusterfs/health_check<o:p></o:p></p>
<p class="MsoNormal">264027 0 ---------- 1 root root 0 Apr 26 13:01 .glusterfs/indices/xattrop/xattrop-2198-d683-431-bxx2-103474<o:p></o:p></p>
<p class="MsoNormal">212941 0 lrwxrwxrwx 1 root root 51 Mar 4 14:24 .glusterfs/e1/09/e1xxx4e-c5d-4c1f-95f-482xe -> ../../00/00/00000000-0000-0000-0000-000000000001/dir1<o:p></o:p></p>
<p class="MsoNormal">397665 0 lrwxrwxrwx 1 root root 51 Mar 4 15:08 .glusterfs/7e/85/757c90-8e9-4cdd-95fd-dd48 -> ../../00/00/00000000-0000-0000-0000-000000000001/dir1<o:p></o:p></p>
<p class="MsoNormal">270337 20 -rw-r--r-- 1 root root 20480 Dec 14 23:03 .glusterfs/data.db<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We are running on a single node but when I added a second node and perform a full heal, the .glusterfs directory size is the same as the volume content size which is that we expected.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Version: glusterfs 3.7.3<o:p></o:p></p>
<p class="MsoNormal">OS: CentOS 5<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Any advice would be much appreciated!<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks!<o:p></o:p></p>
<p class="MsoNormal">Vincent-<o:p></o:p></p>
</div>
</body>
</html>