<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>I've written an example of how gluster's dht works on my blog at
<a class="moz-txt-link-freetext" href="https://joejulian.name/blog/dht-misses-are-expensive/">https://joejulian.name/blog/dht-misses-are-expensive/</a> which might
make it clear why the end result is not what you expected.</p>
<p>By setting cluster.min-free-disk (defaults to 10%) you can, at
least, ensure that your new bricks are utilized as needed to
prevent over filling your smaller bricks.<br>
</p>
<div class="moz-cite-prefix">On 10/10/2016 10:13 AM, Jackie Tung
wrote:<br>
</div>
<blockquote cite="mid:9AA43039-99E9-42FE-A7A2-72422AD3F6B6@drive.ai"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
Hi,
<div class=""><br class="">
</div>
<div class="">We have a 2 node, distributed replicated setup (11
bricks on each node). Each of these bricks are 6TB in size.</div>
<div class=""><br class="">
</div>
<div class="">node_A:/brick1 replicates node_B:/brick1</div>
<div class="">node_A:/brick2 replicates node_B:/brick2</div>
<div class="">node_A:/brick3 replicates node_B:/brick3</div>
<div class="">…</div>
<div class="">…</div>
<div class="">node_A:/brick11 replicates node_B:/brick11</div>
<div class=""><br class="">
</div>
<div class="">We recently added 5 more bricks to make it 16 bricks
on each node in total. Each of these new bricks are 8TB in
size.</div>
<div class=""><br class="">
</div>
<div class="">We completed a full rebalance operation (status says
“completed”).</div>
<div class=""><br class="">
</div>
<div class="">However the end result is somewhat unexpected:</div>
<div class="">
<div class=""><b class=""><font class="" face="Courier New">/dev/sdl1
7.3T 2.2T 5.2T 29%</font></b></div>
<div class=""><b class=""><font class="" face="Courier New">/dev/sdk1
7.3T 2.0T 5.3T 28%</font></b></div>
<div class=""><b class=""><font class="" face="Courier New">/dev/sdj1
7.3T 2.0T 5.3T 28%</font></b></div>
<div class=""><b class=""><font class="" face="Courier New">/dev/sdn1
7.3T 2.2T 5.2T 30%</font></b></div>
<div class=""><b class=""><font class="" face="Courier New">/dev/sdp1
7.3T 2.2T 5.2T 30%</font></b></div>
<div class=""><font class="" face="Courier New">/dev/sdc1 5.5T
2.3T 3.2T 42%</font></div>
<div class=""><font class="" face="Courier New">/dev/sdf1 5.5T
2.3T 3.2T 43%</font></div>
<div class=""><font class="" face="Courier New">/dev/sdo1 5.5T
2.3T 3.2T 42%</font></div>
<div class=""><font class="" face="Courier New">/dev/sda1 5.5T
2.3T 3.2T 43%</font></div>
<div class=""><font class="" face="Courier New">/dev/sdi1 5.5T
2.3T 3.2T 42%</font></div>
<div class=""><font class="" face="Courier New">/dev/sdh1 5.5T
2.3T 3.2T 43%</font></div>
<div class=""><font class="" face="Courier New">/dev/sde1 5.5T
2.3T 3.2T 42%</font></div>
<div class=""><font class="" face="Courier New">/dev/sdb1 5.5T
2.3T 3.2T 42%</font></div>
<div class=""><font class="" face="Courier New">/dev/sdm1 5.5T
2.3T 3.2T 42%</font></div>
<div class=""><font class="" face="Courier New">/dev/sdg1 5.5T
2.3T 3.2T 42%</font></div>
<div class=""><font class="" face="Courier New">/dev/sdd1 5.5T
2.3T 3.2T 42%</font></div>
</div>
<div class=""><br class="">
</div>
<div class="">The df output in <b class="">bold</b> are the new
8TB drives.</div>
<div class="">Was I wrong to expect the % usage to be roughly
equal? Is there some parameter I need to tweak to make
rebalance account for disk sizes properly?</div>
<div class=""><br class="">
</div>
<div class="">I’m using Gluster 3.8 on Ubuntu.</div>
<div class=""><br class="">
</div>
<div class="">Thanks,</div>
<div class="">Jackie</div>
<br>
<p><font color="#808080" face="Courier New" size="1">The
information in this email is confidential and may be legally
privileged. It is intended solely for the addressee. Access to
this email by anyone else is unauthorized. If you are not the
intended recipient, any disclosure, copying, distribution or
any action taken or omitted to be taken in reliance on it, is
prohibited and may be unlawful.</font></p>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</body>
</html>