<div dir="ltr">I am not seeing the performance you were. I am running on 500GB of data:<div><br></div><div><div>[root@gqas001 ~]# gluster v rebalance testvol status</div><div> Node Rebalanced-files size scanned failures skipped status run time in secs</div><div> --------- ----------- ----------- ----------- ----------- ----------- ------------ --------------</div><div> localhost 129021 7.9GB 912104 0 0 in progress 10100.00</div><div><a href="http://gqas012.sbu.lab.eng.bos.redhat.com">gqas012.sbu.lab.eng.bos.redhat.com</a> 0 0Bytes 1930312 0 0 in progress 10100.00</div><div><a href="http://gqas003.sbu.lab.eng.bos.redhat.com">gqas003.sbu.lab.eng.bos.redhat.com</a> 0 0Bytes 1930312 0 0 in progress 10100.00</div><div><a href="http://gqas004.sbu.lab.eng.bos.redhat.com">gqas004.sbu.lab.eng.bos.redhat.com</a> 128903 7.9GB 946730 0 0 in progress 10100.00</div><div><a href="http://gqas013.sbu.lab.eng.bos.redhat.com">gqas013.sbu.lab.eng.bos.redhat.com</a> 0 0Bytes 1930312 0 0 in progress 10100.00</div><div><a href="http://gqas014.sbu.lab.eng.bos.redhat.com">gqas014.sbu.lab.eng.bos.redhat.com</a> 0 0Bytes 1930312 0 0 in progress 10100.00</div></div><div><br></div><div>Based on what I am seeing I expect this to take 2 days. Was you rebal run on a pure dist volume? I am trying on 2x2 + 2 new bricks. Any idea why mine is taking so long?</div><div><br></div><div>-b</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Apr 22, 2015 at 1:10 AM, Nithya Balachandran <span dir="ltr"><<a href="mailto:nbalacha@redhat.com" target="_blank">nbalacha@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">That sounds great. Thanks.<br>
<span class="im HOEnZb"><br>
Regards,<br>
Nithya<br>
<br>
----- Original Message -----<br>
</span><span class="im HOEnZb">From: "Benjamin Turner" <<a href="mailto:bennyturns@gmail.com">bennyturns@gmail.com</a>><br>
To: "Nithya Balachandran" <<a href="mailto:nbalacha@redhat.com">nbalacha@redhat.com</a>><br>
Cc: "Susant Palai" <<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>>, "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
</span><div class="HOEnZb"><div class="h5">Sent: Wednesday, 22 April, 2015 12:14:14 AM<br>
Subject: Re: [Gluster-devel] Rebalance improvement design<br>
<br>
I am setting up a test env now, I'll have some feedback for you this week.<br>
<br>
-b<br>
<br>
On Tue, Apr 21, 2015 at 11:36 AM, Nithya Balachandran <<a href="mailto:nbalacha@redhat.com">nbalacha@redhat.com</a>><br>
wrote:<br>
<br>
> Hi Ben,<br>
><br>
> Did you get a chance to try this out?<br>
><br>
> Regards,<br>
> Nithya<br>
><br>
> ----- Original Message -----<br>
> From: "Susant Palai" <<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>><br>
> To: "Benjamin Turner" <<a href="mailto:bennyturns@gmail.com">bennyturns@gmail.com</a>><br>
> Cc: "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
> Sent: Monday, April 13, 2015 9:55:07 AM<br>
> Subject: Re: [Gluster-devel] Rebalance improvement design<br>
><br>
> Hi Ben,<br>
> Uploaded a new patch here: <a href="http://review.gluster.org/#/c/9657/" target="_blank">http://review.gluster.org/#/c/9657/</a>. We can<br>
> start perf test on it. :)<br>
><br>
> Susant<br>
><br>
> ----- Original Message -----<br>
> From: "Susant Palai" <<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>><br>
> To: "Benjamin Turner" <<a href="mailto:bennyturns@gmail.com">bennyturns@gmail.com</a>><br>
> Cc: "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
> Sent: Thursday, 9 April, 2015 3:40:09 PM<br>
> Subject: Re: [Gluster-devel] Rebalance improvement design<br>
><br>
> Thanks Ben. RPM is not available and I am planning to refresh the patch in<br>
> two days with some more regression fixes. I think we can run the tests post<br>
> that. Any larger data-set will be good(say 3 to 5 TB).<br>
><br>
> Thanks,<br>
> Susant<br>
><br>
> ----- Original Message -----<br>
> From: "Benjamin Turner" <<a href="mailto:bennyturns@gmail.com">bennyturns@gmail.com</a>><br>
> To: "Vijay Bellur" <<a href="mailto:vbellur@redhat.com">vbellur@redhat.com</a>><br>
> Cc: "Susant Palai" <<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>>, "Gluster Devel" <<br>
> <a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
> Sent: Thursday, 9 April, 2015 2:10:30 AM<br>
> Subject: Re: [Gluster-devel] Rebalance improvement design<br>
><br>
><br>
> I have some rebalance perf regression stuff I have been working on, is<br>
> there an RPM with these patches anywhere so that I can try it on my<br>
> systems? If not I'll just build from:<br>
><br>
><br>
> git fetch git:// <a href="http://review.gluster.org/glusterfs" target="_blank">review.gluster.org/glusterfs</a> refs/changes/57/9657/8 &&<br>
> git cherry-pick FETCH_HEAD<br>
><br>
><br>
><br>
> I will have _at_least_ 10TB of storage, how many TBs of data should I run<br>
> with?<br>
><br>
><br>
> -b<br>
><br>
><br>
> On Tue, Apr 7, 2015 at 9:07 AM, Vijay Bellur < <a href="mailto:vbellur@redhat.com">vbellur@redhat.com</a> > wrote:<br>
><br>
><br>
><br>
><br>
> On 04/07/2015 03:08 PM, Susant Palai wrote:<br>
><br>
><br>
> Here is one test performed on a 300GB data set and around 100%(1/2 the<br>
> time) improvement was seen.<br>
><br>
> [root@gprfs031 ~]# gluster v i<br>
><br>
> Volume Name: rbperf<br>
> Type: Distribute<br>
> Volume ID: 35562662-337e-4923-b862- d0bbb0748003<br>
> Status: Started<br>
> Number of Bricks: 4<br>
> Transport-type: tcp<br>
> Bricks:<br>
> Brick1: gprfs029-10ge:/bricks/ gprfs029/brick1<br>
> Brick2: gprfs030-10ge:/bricks/ gprfs030/brick1<br>
> Brick3: gprfs031-10ge:/bricks/ gprfs031/brick1<br>
> Brick4: gprfs032-10ge:/bricks/ gprfs032/brick1<br>
><br>
><br>
> Added server 32 and started rebalance force.<br>
><br>
> Rebalance stat for new changes:<br>
> [root@gprfs031 ~]# gluster v rebalance rbperf status<br>
> Node Rebalanced-files size scanned failures skipped status run time in secs<br>
> --------- ----------- ----------- ----------- ----------- -----------<br>
> ------------ --------------<br>
> localhost 74639 36.1GB 297319 0 0 completed 1743.00<br>
> 172.17.40.30 67512 33.5GB 269187 0 0 completed 1395.00<br>
> gprfs029-10ge 79095 38.8GB 284105 0 0 completed 1559.00<br>
> gprfs032-10ge 0 0Bytes 0 0 0 completed 402.00<br>
> volume rebalance: rbperf: success:<br>
><br>
> Rebalance stat for old model:<br>
> [root@gprfs031 ~]# gluster v rebalance rbperf status<br>
> Node Rebalanced-files size scanned failures skipped status run time in secs<br>
> --------- ----------- ----------- ----------- ----------- -----------<br>
> ------------ --------------<br>
> localhost 86493 42.0GB 634302 0 0 completed 3329.00<br>
> gprfs029-10ge 94115 46.2GB 687852 0 0 completed 3328.00<br>
> gprfs030-10ge 74314 35.9GB 651943 0 0 completed 3072.00<br>
> gprfs032-10ge 0 0Bytes 594166 0 0 completed 1943.00<br>
> volume rebalance: rbperf: success:<br>
><br>
><br>
> This is interesting. Thanks for sharing & well done! Maybe we should<br>
> attempt a much larger data set and see how we fare there :).<br>
><br>
> Regards,<br>
><br>
><br>
> Vijay<br>
><br>
><br>
> ______________________________ _________________<br>
> Gluster-devel mailing list<br>
> <a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
> <a href="http://www.gluster.org/" target="_blank">http://www.gluster.org/</a> mailman/listinfo/gluster-devel<br>
><br>
> _______________________________________________<br>
> Gluster-devel mailing list<br>
> <a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
> <a href="http://www.gluster.org/mailman/listinfo/gluster-devel" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
> _______________________________________________<br>
> Gluster-devel mailing list<br>
> <a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
> <a href="http://www.gluster.org/mailman/listinfo/gluster-devel" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
><br>
</div></div></blockquote></div><br></div>