<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">dear all，<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Recently, I have a test to rebalance, I seem to be a bug.<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>I used the cluster version is v3.6.2 tag.<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>The case I did is below.<br class=""><br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>1. create a volume with dht number 2<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>2. write a few files in the volume<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>3. add-brick to the volume<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>4. rebalance fix-layout<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>5. find a file which would be rebalance to other brick<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>6. continuing write something to the file<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>7. exec the rebalance to move file to where they should be<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span><br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>After the rebalance, we saw something has been lost when it were write during the rebalance.<br class=""><br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Could anyone help me with it?<br class=""><br class=""><blockquote type="cite" class="">On May 14, 2015, at 8:00 PM, <a href="mailto:gluster-devel-request@gluster.org" class="">gluster-devel-request@gluster.org</a> wrote:<br class=""><br class=""><br class="">Send Gluster-devel mailing list submissions to<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span><a href="mailto:gluster-devel@gluster.org" class="">gluster-devel@gluster.org</a><br class=""><br class="">To subscribe or unsubscribe via the World Wide Web, visit<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>http://www.gluster.org/mailman/listinfo/gluster-devel<br class="">or, via email, send a message with subject or body 'help' to<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>gluster-devel-request@gluster.org<br class=""><br class="">You can reach the person managing the list at<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>gluster-devel-owner@gluster.org<br class=""><br class="">When replying, please edit your Subject line so it is more specific<br class="">than "Re: Contents of Gluster-devel digest..."<br class=""><br class=""><br class="">Today's Topics:<br class=""><br class=""> 1. Re: Rebalance failure wrt trashcan (Nithya Balachandran)<br class=""><br class=""><br class="">----------------------------------------------------------------------<br class=""><br class="">Message: 1<br class="">Date: Thu, 14 May 2015 07:08:46 -0400 (EDT)<br class="">From: Nithya Balachandran <nbalacha@redhat.com><br class="">To: SATHEESARAN <sasundar@redhat.com><br class="">Cc: Gluster Devel <gluster-devel@gluster.org><br class="">Subject: Re: [Gluster-devel] Rebalance failure wrt trashcan<br class="">Message-ID:<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span><786595040.14130930.1431601726039.JavaMail.zimbra@redhat.com><br class="">Content-Type: text/plain; charset=utf-8<br class=""><br class="">The rebalance failure is due to the interaction of the lookup-unhashed changes and rebalance local crawl changes. I will send a patch shortly.<br class=""><br class="">Regards,<br class="">Nithya<br class=""><br class=""><br class=""><br class=""><br class="">----- SATHEESARAN <sasundar@redhat.com> wrote:<br class=""><blockquote type="cite" class="">On 05/14/2015 12:55 PM, Vijay Bellur wrote:<br class=""><blockquote type="cite" class="">On 05/14/2015 09:00 AM, SATHEESARAN wrote:<br class=""><blockquote type="cite" class="">Hi All,<br class=""><br class="">I was using glusterfs-3.7 beta2 build (<br class="">glusterfs-3.7.0beta2-0.0.el6.x86_64 )<br class="">I have seen rebalance failure in one of the node.<br class=""><br class="">[2015-05-14 12:17:03.695156] E<br class="">[dht-rebalance.c:2368:gf_defrag_settle_hash] 0-vmstore-dht: fix layout<br class="">on /.trashcan/internal_op failed<br class="">[2015-05-14 12:17:03.695636] E [MSGID: 109016]<br class="">[dht-rebalance.c:2528:gf_defrag_fix_layout] 0-vmstore-dht: Fix layout<br class="">failed for /.trashcan<br class=""><br class="">Does it have any impact ?<br class=""><br class=""></blockquote><br class="">I don't think there should be any impact due to this. rebalance should <br class="">continue fine without any problems. Do let us know if you observe the <br class="">behavior to be otherwise.<br class=""><br class="">-Vijay<br class=""></blockquote>I tested the same functionally and I don't find any impact as such, but <br class="">the 'gluster volume status <vol-name>' reports the rebalance as a FAILURE.<br class="">Any tool ( for example oVirt ), consuming the output from 'gluster <br class="">volume status <vol> --xml' would report the rebalance operation as FAILURE<br class=""><br class="">[root@ ~]# gluster volume rebalance vmstore start<br class="">volume rebalance: vmstore: success: Rebalance on vmstore has been <br class="">started successfully. Use rebalance status command to check status of <br class="">the rebalance process.<br class="">ID: 68a12fc9-acd5-4f24-ba2d-bfc070ad5668<br class=""><br class="">[root@~]# gluster volume rebalance vmstore status<br class=""> Node Rebalanced-files size <br class="">scanned failures skipped status run time in secs<br class=""> --------- ----------- ----------- <br class="">----------- ----------- ----------- ------------ --------------<br class=""> localhost 0 <br class="">0Bytes 2 0 0 completed <br class="">0.00<br class=""> 10.70.37.58 0 <br class="">0Bytes 0 3 0 failed 0.00<br class="">volume rebalance: vmstore: success:<br class=""><br class="">[root@~]# gluster volume status vmstore<br class="">Status of volume: vmstore<br class="">Gluster process TCP Port RDMA Port Online Pid<br class="">------------------------------------------------------------------------------<br class="">......<br class=""><br class="">Task Status of Volume vmstore<br class="">------------------------------------------------------------------------------<br class="">Task : Rebalance<br class="">ID : 68a12fc9-acd5-4f24-ba2d-bfc070ad5668<br class="">Status : failed<br class=""><br class="">Snip from --xml tasks :<br class=""><tasks><br class=""> <task><br class=""> <type>Rebalance</type><br class=""><id>68a12fc9-acd5-4f24-ba2d-bfc070ad5668</id><br class=""> <status>4</status><br class=""> <statusStr>failed</statusStr><br class=""> </task><br class=""></tasks><br class=""><br class="">Even this is the case with remove-brick with data migration too<br class=""><br class="">-- sas<br class=""><br class="">_______________________________________________<br class="">Gluster-devel mailing list<br class="">Gluster-devel@gluster.org<br class="">http://www.gluster.org/mailman/listinfo/gluster-devel<br class=""></blockquote><br class=""><br class=""><br class="">------------------------------<br class=""><br class="">_______________________________________________<br class="">Gluster-devel mailing list<br class="">Gluster-devel@gluster.org<br class="">http://www.gluster.org/mailman/listinfo/gluster-devel<br class=""><br class=""><br class="">End of Gluster-devel Digest, Vol 14, Issue 56<br class="">*********************************************<br class=""><br class=""><br class=""></blockquote><br class=""><div apple-content-edited="true" class="">
<span style="color: rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: verdana; font-size: 13px; line-height: 20px;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><span><span><span><span><img height="62" width="180" apple-inline="yes" id="00C9BB7C-B527-4ACD-9CD6-669D6048DD1D" apple-width="yes" apple-height="yes" src="cid:B9A9E82C-57D0-4ACD-A124-FCFC13555163@lan" class=""></span><span style="color: rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-family: verdana; font-size: 13px; line-height: 20px;" class=""> </span><div style="color: rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 13px; line-height: 20px; font-family: 黑体;" class=""><div class=""><span lang="EN-US" style="font-family: Arial, sans-serif; font-size: 9pt;" class=""><span style="font-family: 微软雅黑; color: rgb(44, 152, 199); font-size: 12pt; font-weight: bold;" class="">—————————</span></span></div><div class=""><span style="font-family: 宋体; font-size: 10.5pt;" class=""><font face="微软雅黑" class=""><font color="#333333" class=""><span style="color: rgb(0, 0, 0); font-size: 16pt;" class=""><b class="">余长财</b><span class="Apple-converted-space"> </span> <span style="font-size: 10pt; font-weight: bold;" class="">技术部</span></span></font></font></span></div><div class=""><font color="#333333" face="微软雅黑" style="font-size: 10pt;" class=""></font></div><div class=""><font color="#333333" style="font-size: 10pt;" class=""></font></div><div class=""><font color="#333333" face="微软雅黑" class=""><strong style="font-size: 10pt;" class="">浙江九州云信息科技有限公司</strong></font></div><font face="微软雅黑" class=""><div class=""><font color="#333333" style="font-size: 10pt;" class="">地址：上海市卢湾区局门路427号1号楼206室</font></div><div class=""><font size="1" class=""><font color="#333333" face="微软雅黑" style="font-size: 10pt;" class="">网址：</font><a href="http://www.99cloud.netm/" style="margin-top: 0px; margin-bottom: 0px;" class=""><font color="#333333" face="微软雅黑" style="font-size: 10pt;" class="">http://www.99cloud.net</font></a></font></div></font></div>
</span></span></span></span></div>
<br class=""></body></html>