<html><head><meta http-equiv="content-type" content="text/html; charset=UTF-8"><style>body { line-height: 1.5; }blockquote { margin-top: 0px; margin-bottom: 0px; margin-left: 0.5em; }body { font-size: 10.5pt; font-family: 'Microsoft YaHei UI'; color: rgb(0, 0, 0); line-height: 1.5; }</style></head><body>
<div><span></span><div style="font-size: 14.399999618530273px; line-height: 16.799999237060547px;">Here is the tail of the failed rebalance log, any clue?</div><div style="font-size: 14.399999618530273px; line-height: 16.799999237060547px;"><br></div><div style="font-size: 14.399999618530273px; line-height: 16.799999237060547px;"><span microsoft="" yahei="" ui'";="" font-size:="" 14px;="" color:="" rgb(0,="" 0,="" 0);="" background-color:="" rgba(0,="" font-weight:="" normal;="" font-style:="" normal;text-decoration:="" none;'="" style="font-family: '';">[2015-12-13&nbsp;21:30:31.527493]&nbsp;I&nbsp;[dht-rebalance.c:2340:gf_defrag_process_dir]&nbsp;0-FastVol-dht:&nbsp;Migration&nbsp;operation&nbsp;on&nbsp;dir&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/Ny/5F/1MsH5--BcoGRAJPI&nbsp;took&nbsp;20.95&nbsp;secs<br>[2015-12-13&nbsp;21:30:31.528704]&nbsp;I&nbsp;[dht-rebalance.c:1010:dht_migrate_file]&nbsp;0-FastVol-dht:&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/Kn/hM/oHcPMp4hKq5Tq2ZQ/flag_finished:&nbsp;attempting&nbsp;to&nbsp;move&nbsp;from&nbsp;FastVol-client-0&nbsp;to&nbsp;FastVol-client-1<br>[2015-12-13&nbsp;21:30:31.543901]&nbsp;I&nbsp;[dht-rebalance.c:1010:dht_migrate_file]&nbsp;0-FastVol-dht:&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/PU/ps/qUa-n38i8QBgeMdI/userPoint:&nbsp;attempting&nbsp;to&nbsp;move&nbsp;from&nbsp;FastVol-client-0&nbsp;to&nbsp;FastVol-client-1<br>[2015-12-13&nbsp;21:31:37.210496]&nbsp;I&nbsp;[MSGID:&nbsp;109081]&nbsp;[dht-common.c:3780:dht_setxattr]&nbsp;0-FastVol-dht:&nbsp;fixing&nbsp;the&nbsp;layout&nbsp;of&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/Ny/7Q<br>[2015-12-13&nbsp;21:31:37.722825]&nbsp;I&nbsp;[MSGID:&nbsp;109045]&nbsp;[dht-selfheal.c:1508:dht_fix_layout_of_directory]&nbsp;0-FastVol-dht:&nbsp;subvolume&nbsp;0&nbsp;(FastVol-client-0):&nbsp;1032124&nbsp;chunks<br>[2015-12-13&nbsp;21:31:37.722837]&nbsp;I&nbsp;[MSGID:&nbsp;109045]&nbsp;[dht-selfheal.c:1508:dht_fix_layout_of_directory]&nbsp;0-FastVol-dht:&nbsp;subvolume&nbsp;1&nbsp;(FastVol-client-1):&nbsp;1032124&nbsp;chunks<br>[2015-12-13&nbsp;21:33:03.955539]&nbsp;I&nbsp;[MSGID:&nbsp;109064]&nbsp;[dht-layout.c:808:dht_layout_dir_mismatch]&nbsp;0-FastVol-dht:&nbsp;subvol:&nbsp;FastVol-client-0;&nbsp;inode&nbsp;layout&nbsp;-&nbsp;0&nbsp;-&nbsp;2146817919&nbsp;-&nbsp;1;&nbsp;disk&nbsp;layout&nbsp;-&nbsp;2146817920&nbsp;-&nbsp;4294967295&nbsp;-&nbsp;1<br>[2015-12-13&nbsp;21:33:04.069859]&nbsp;I&nbsp;[MSGID:&nbsp;109018]&nbsp;[dht-common.c:806:dht_revalidate_cbk]&nbsp;0-FastVol-dht:&nbsp;Mismatching&nbsp;layouts&nbsp;for&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/Ny/7Q,&nbsp;gfid&nbsp;=&nbsp;f38c4ed2-a26a-4d83-adfd-6b0331831738<br>[2015-12-13&nbsp;21:33:04.118800]&nbsp;I&nbsp;[MSGID:&nbsp;109064]&nbsp;[dht-layout.c:808:dht_layout_dir_mismatch]&nbsp;0-FastVol-dht:&nbsp;subvol:&nbsp;FastVol-client-1;&nbsp;inode&nbsp;layout&nbsp;-&nbsp;2146817920&nbsp;-&nbsp;4294967295&nbsp;-&nbsp;1;&nbsp;disk&nbsp;layout&nbsp;-&nbsp;0&nbsp;-&nbsp;2146817919&nbsp;-&nbsp;1<br>[2015-12-13&nbsp;21:33:19.979507]&nbsp;I&nbsp;[MSGID:&nbsp;109022]&nbsp;[dht-rebalance.c:1290:dht_migrate_file]&nbsp;0-FastVol-dht:&nbsp;completed&nbsp;migration&nbsp;of&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/Kn/hM/oHcPMp4hKq5Tq2ZQ/flag_finished&nbsp;from&nbsp;subvolume&nbsp;FastVol-client-0&nbsp;to&nbsp;FastVol-client-1<br>[2015-12-13&nbsp;21:33:19.979459]&nbsp;I&nbsp;[MSGID:&nbsp;109022]&nbsp;[dht-rebalance.c:1290:dht_migrate_file]&nbsp;0-FastVol-dht:&nbsp;completed&nbsp;migration&nbsp;of&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/PU/ps/qUa-n38i8QBgeMdI/userPoint&nbsp;from&nbsp;subvolume&nbsp;FastVol-client-0&nbsp;to&nbsp;FastVol-client-1<br>[2015-12-13&nbsp;21:33:25.543941]&nbsp;I&nbsp;[dht-rebalance.c:1010:dht_migrate_file]&nbsp;0-FastVol-dht:&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/PU/ps/qUa-n38i8QBgeMdI/portrait_origin.jpg:&nbsp;attempting&nbsp;to&nbsp;move&nbsp;from&nbsp;FastVol-client-0&nbsp;to&nbsp;FastVol-client-1<br>[2015-12-13&nbsp;21:33:25.962547]&nbsp;I&nbsp;[dht-rebalance.c:1010:dht_migrate_file]&nbsp;0-FastVol-dht:&nbsp;/for_ybest_fsdir/user/Weixin.oClDcjhe/PU/ps/qUa-n38i8QBgeMdI/portrait_small.jpg:&nbsp;attempting&nbsp;to&nbsp;move&nbsp;from&nbsp;FastVol-client-0&nbsp;to&nbsp;FastVol-client-1</span></div></div>
<div><br></div><hr style="width: 210px; height: 1px;" color="#b5c4df" size="1" align="left">
<div><span><div style="MARGIN: 10px; FONT-FAMILY: verdana; FONT-SIZE: 10pt"><div>Cloudor</div></div></span></div>
<blockquote style="margin-top: 0px; margin-bottom: 0px; margin-left: 0.5em;"><div>&nbsp;</div><div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"><div style="PADDING-RIGHT: 8px; PADDING-LEFT: 8px; FONT-SIZE: 12px;FONT-FAMILY:tahoma;COLOR:#000000; BACKGROUND: #efefef; PADDING-BOTTOM: 8px; PADDING-TOP: 8px"><div><b>From:</b>&nbsp;<a href="mailto:sabansal@redhat.com">Sakshi Bansal</a></div><div><b>Date:</b>&nbsp;2015-12-12&nbsp;13:02</div><div><b>To:</b>&nbsp;<a href="mailto:cloudor@126.com">蒲云</a></div><div><b>CC:</b>&nbsp;<a href="mailto:gluster-users@gluster.org">gluster-users</a></div><div><b>Subject:</b>&nbsp;Re: [Gluster-users] How to diagnose volume rebalance failure?</div></div></div><div>In the rebalance log file you can check the file/directory for which the rebalance has failed. It can mention what was the fop for whihc the failure happened.
</div></blockquote>
</body></html>