<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">If you go the ZFS route - be absolutely sure you set xattr=sa on all filesystems that will hold bricks BEFORE you create bricks on same. Not doing so will cause major problems with data that should be deleted not being reclaimed until after a forced dismount or reboot (which can take hours -> days if there are several terabytes of data to reclaim.)<div class=""><br class=""></div><div class="">Setting it also vastly improves directory and stat() performance.</div><div class=""><br class=""></div><div class="">Setting it after the bricks had been created led to data inconsistencies and eventual data loss on a cluster we used to operate.<br class=""><div class=""><br class=""></div><div class="">-t</div><div class=""><br class=""><div><blockquote type="cite" class=""><div class="">On Jul 4, 2016, at 4:35 PM, Lindsay Mathieson <<a href="mailto:lindsay.mathieson@gmail.com" class="">lindsay.mathieson@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class="">
<meta content="text/html; charset=windows-1252" http-equiv="Content-Type" class="">
<div bgcolor="#FFFFFF" text="#000000" class="">
<div class="moz-cite-prefix">On 5/07/2016 12:54 AM, Gandalf
Corvotempesta wrote:<br class="">
</div>
<blockquote cite="mid:CAJH6TXj75NK2FnbfTjcN0T9Spg-dA-zxPvSMG=t_4N8Guekx9A@mail.gmail.com" type="cite" class=""><p dir="ltr" class="">No suggestions ?</p>
<div class="gmail_quote">Il 14 giu 2016 10:01 AM, "Gandalf
Corvotempesta" <<a moz-do-not-send="true" href="mailto:gandalf.corvotempesta@gmail.com" class="">gandalf.corvotempesta@gmail.com</a>>
ha scritto:<br type="attribution" class="">
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">Let's assume
a small cluster made by 3 servers, 12 disks/bricks each.<br class="">
This cluster would be expanded to a maximum of 15 servers in
near future.<br class="">
<br class="">
What do you suggest, a JBOD or a RAID? Which RAID level?<br class="">
</blockquote>
</div>
</blockquote>
<br class=""><p class=""><br class="">
</p><p class="">I setup my much smaller cluster with ZFS RAID10 on each node. <br class="">
</p><p class="">- Greatly increased the iops per node</p><p class="">- auto bitrot detection and repair</p><p class="">- SSD caches</p><p class="">- compression clawed back 30% of the disk space I lost to RAID10.<br class="">
</p>
<pre class="moz-signature" cols="72">--
Lindsay Mathieson</pre>
</div>
_______________________________________________<br class="">Gluster-users mailing list<br class=""><a href="mailto:Gluster-users@gluster.org" class="">Gluster-users@gluster.org</a><br class="">http://www.gluster.org/mailman/listinfo/gluster-users</div></blockquote></div><br class=""></div></div></body></html>