<div>That didn't fix it unfortunately. In fact, I've done a full rebalance after initially discovering the problem and after updating Gluster, but nothing was changed..</div>
<div> </div>
<div>I don't know too much about how Gluster works internally; is it possible to compute the hash for each duplicate filename - figure out on which brick it belong is and find where it actually resides, then recreate the link file or update the linkto attribute? Assuming broken link files are the problem..</div>
<div> </div>
<blockquote class="threadBlockQuote" style="border-left: 2px solid #C2C2C2; padding-left: 3px; margin-left: 4px;">--------- Original Message ---------
<div>Subject: Re: [Gluster-users] Hundreds of duplicate files<br />From: "Joe Julian" <joe@julianfamily.org><br />Date: 12/27/14 1:55 pm<br />To: tbenzvi@3vgeomatics.com, gluster-users@gluster.org<br /><br />I'm wondering if this is from a corrupted failed rebalance. In a directory that has duplicates, do "setfattr -n trusted.distribute.fix.layout -v 1 ."<br /> <br /> If that fixes it, do a rebalance...fix-layout<br /><br />
<div class="gmail_quote">On December 27, 2014 12:38:01 PM PST, tbenzvi@3vgeomatics.com wrote:
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid #cccccc; padding-left: 1ex;">
<div>Ok, I am really tearing my hair out here. I tried doing this manually for several other files just to be sure. And in these cases it removed the duplicate file from the directory listing, but the file can still not be read.. Reading directly from the brick works fine.</div>
<div> </div>
<blockquote class="threadBlockQuote" style="border-left: 2px solid #C2C2C2; padding-left: 3px; margin-left: 4px;">--------- Original Message ---------
<div>Subject: Re: [Gluster-users] Hundreds of duplicate files<br />From: "Joe Julian" <joe@julianfamily.org><br />Date: 12/27/14 12:01 pm<br />To: gluster-users@gluster.org<br /><br />Should be safe.<br /> <br /> Here's what I've done in the past to clean up rogue dht link files (not that yours looked rogue though):<br /> <br /> find $brick_root -type f -size 0 -perm 1000 -exec /bin/rm {} \;<br />
<div class="moz-cite-prefix"><br /> On 12/27/2014 11:09 AM, <a class="moz-txt-link-abbreviated" href="mailto:tbenzvi@3vgeomatics.com">tbenzvi@3vgeomatics.com</a> wrote:</div>
<blockquote cite="mid:20141227120924.b2b02683b6fce9ed61e10e2e9bfae354.cc4510135d.mailapi@email04.secureserver.net">
<div>Moving the file with linkto attribute worked! Just one copy of the file is retained in the listing and can be read without problems.</div>
<div>I will write a script to remove these rogue link files from the bricks - any risks associated with this?</div>
<div> </div>
<div>Thanks everyone for your help, of course if anyone could explain how this happened I would love to hear it..</div>
<div> </div>
<div>Tom</div>
<div> </div>
<blockquote class="threadBlockQuote" style="border-left: 2px solid
#C2C2C2; padding-left: 3px; margin-left: 4px;">--------- Original Message ---------
<div>Subject: Re: [Gluster-users] Hundreds of duplicate files<br /> From: "Vijay Bellur" <a class="moz-txt-link-rfc2396E" href="mailto:vbellur@redhat.com"><vbellur@redhat.com></a><br /> Date: 12/27/14 9:12 am<br /> To: <a class="moz-txt-link-abbreviated" href="mailto:tbenzvi@3vgeomatics.com">tbenzvi@3vgeomatics.com</a>, <a class="moz-txt-link-abbreviated" href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><br /> <br /> On 12/27/2014 01:11 PM, <a class="moz-txt-link-abbreviated" href="mailto:tbenzvi@3vgeomatics.com">tbenzvi@3vgeomatics.com</a> wrote:<br /> > Thanks for your continued help Joe.<br /> > A demonstration of the problem, in this case I was able to open the file<br /> > in vim (a text file) without any issues, however sometimes duplicated<br /> > text files open in vim as one line consisting of @ characters, and<br /> > binary data files can also not be opened correctly for reading.<br /> > However the duplicate listing is still an issue. Note that Dec 13 was<br /> > the date of a server crash.<br /> ><br /> > [root@jongoo ~]# ll /sar/complete/vancouver/refdem/tif2flt.pro*<br /> > -rw-rw-r-T 1 parwant users 1712 Dec 13 19:02 tif2flt.pro<br /> > -rw-rw-r-- 1 parwant users 1712 Jun 17 2010 tif2flt.pro<br /> ><br /> > A few minutes later doing the same listing.. sticky bit disappeared and<br /> > modification date changed<br /> ><br /> > [root@jongoo ~]# ll /sar/complete/vancouver/refdem/tif2flt.pro*<br /> > -rw-rw-r-- 1 parwant users 1712 Jun 17 2010<br /> > /sar/complete/vancouver/refdem/tif2flt.pro<br /> > -rw-rw-r-- 1 parwant users 1712 Jun 17 2010<br /> > /sar/complete/vancouver/refdem/tif2flt.pro<br /> ><br /> > [root@jongoo ~]# getfattr -m . -d -e hex<br /> > /data/glusterfs/safari/brick00/brick/complete/vancouver/refdem/tif2flt.pro<br /> > getfattr: Removing leading '/' from absolute path names<br /> > # file:<br /> > data/glusterfs/safari/brick00/brick/complete/vancouver/refdem/tif2flt.pro<br /> > system.posix_acl_access=0x0200000001000600ffffffff04000600ffffffff10000600ffffffff20000400ffffffff<br /> > trusted.SGI_ACL_FILE=0x0000000400000001ffffffff0006000000000004ffffffff0006000000000010ffffffff0006000000000020ffffffff00040000<br /> > trusted.gfid=0xdfe13dc088bf4a779488ef72f0a879cd<br /> > trusted.glusterfs.dht.linkto=0x7361666172692d636c69656e742d3300<br /> ><br /> > [root@ndovu ~]# getfattr -m . -d -e hex<br /> > /data/glusterfs/safari/brick03/brick/complete/vancouver/refdem/tif2flt.pro<br /> > getfattr: Removing leading '/' from absolute path names<br /> > # file:<br /> > data/glusterfs/safari/brick03/brick/complete/vancouver/refdem/tif2flt.pro<br /> > system.posix_acl_access=0x0200000001000600ffffffff04000600ffffffff10000600ffffffff20000400ffffffff<br /> > trusted.SGI_ACL_FILE=0x0000000400000001ffffffff0006000000000004ffffffff0006000000000010ffffffff0006000000000020ffffffff00040000<br /> > trusted.gfid=0xdfe13dc088bf4a779488ef72f0a879cd<br /> ><br /> <br /> Is rebalance running on this volume right now? If not, can you please <br /> move out the file copy with "trusted.glusterfs.dht.linkto" attribute out <br /> of the brick directory <br /> (/data/glusterfs/safari/brick00/brick/complete/vancouver/refdem/tif2flt.pro) <br /> to an alternate location & check the behavior?<br /> <br /> Thanks,<br /> Vijay</div>
</blockquote>
<br /><fieldset class="mimeAttachmentHeader"></fieldset><br />
<pre>_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br />_______________________________________________ Gluster-users mailing list Gluster-users@gluster.org http://www.gluster.org/mailman/listinfo/gluster-users</div>
</blockquote>
<p style="margin-top: 2.5em; margin-bottom: 1em; border-bottom: 1px solid #000;"> </p>
<hr />
<pre class="k9mail"><br />Gluster-users mailing list<br />Gluster-users@gluster.org<br /><a href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
</div>
<br /> -- <br /> Sent from my Android device with K-9 Mail. Please excuse my brevity.</div>
</blockquote>