<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jul 2, 2015 at 1:26 PM, Nithya Balachandran <span dir="ltr"><<a href="mailto:nbalacha@redhat.com" target="_blank">nbalacha@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span class=""><br>
<br>
----- Original Message -----<br>
> From: "Kotresh Hiremath Ravishankar" <<a href="mailto:khiremat@redhat.com">khiremat@redhat.com</a>><br>
> To: "Susant Palai" <<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>><br>
> Cc: "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
</span><div><div class="h5">> Sent: Thursday, July 2, 2015 1:03:18 PM<br>
> Subject: Re: [Gluster-devel] Regression Failure: ./tests/basic/quota.t<br>
><br>
> Comments inline.<br>
><br>
> Thanks and Regards,<br>
> Kotresh H R<br>
><br>
> ----- Original Message -----<br>
> > From: "Susant Palai" <<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>><br>
> > To: "Sachin Pandit" <<a href="mailto:spandit@redhat.com">spandit@redhat.com</a>><br>
> > Cc: "Kotresh Hiremath Ravishankar" <<a href="mailto:khiremat@redhat.com">khiremat@redhat.com</a>>, "Gluster Devel"<br>
> > <<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
> > Sent: Thursday, July 2, 2015 12:35:08 PM<br>
> > Subject: Re: [Gluster-devel] Regression Failure: ./tests/basic/quota.t<br>
> ><br>
> > Comments inline.<br>
> ><br>
> > ----- Original Message -----<br>
> > > From: "Sachin Pandit" <<a href="mailto:spandit@redhat.com">spandit@redhat.com</a>><br>
> > > To: "Kotresh Hiremath Ravishankar" <<a href="mailto:khiremat@redhat.com">khiremat@redhat.com</a>><br>
> > > Cc: "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
> > > Sent: Thursday, July 2, 2015 12:21:44 PM<br>
> > > Subject: Re: [Gluster-devel] Regression Failure: ./tests/basic/quota.t<br>
> > ><br>
> > > ----- Original Message -----<br>
> > > > From: "Vijaikumar M" <<a href="mailto:vmallika@redhat.com">vmallika@redhat.com</a>><br>
> > > > To: "Kotresh Hiremath Ravishankar" <<a href="mailto:khiremat@redhat.com">khiremat@redhat.com</a>>, "Gluster<br>
> > > > Devel"<br>
> > > > <<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
> > > > Cc: "Sachin Pandit" <<a href="mailto:spandit@redhat.com">spandit@redhat.com</a>><br>
> > > > Sent: Thursd, TOTAL CHANGELOGS: 106<br>
> [2015-07-02 07:01:06.883504] E<br>
> [gf-history-changelog.c:877:gf_history_changelog] 0-gfchangelog: wrong<br>
> result for start: 1435818ay, July 2, 2015 12:01:03 PM<br>
> > > > Subject: Re: Regression Failure: ./tests/basic/quota.t<br>
> > > ><br>
> > > > We look into this issue<br>
> > > ><br>
> > > > Thanks,<br>
> > > > Vijay<br>
> > > ><br>
> > > > On Thursday 02 July 2015 11:46 AM, Kotresh Hiremath Ravishankar wrote:<br>
> > > > > Hi,<br>
> > > > ><br>
> > > > > I see quota.t regression failure for the following. The changes are<br>
> > > > > related<br>
> > > > > to<br>
> > > > > example programs in libgfchangelog.<br>
> > > > ><br>
> > > > > <a href="http://build.gluster.org/job/rackspace-regression-2GB-triggered/11785/consoleFull" rel="noreferrer" target="_blank">http://build.gluster.org/job/rackspace-regression-2GB-triggered/11785/consoleFull</a><br>
> > > > ><br>
> > > > > Could someone from quota team, take a look at it.<br>
> > ><br>
> > > Hi,<br>
> > ><br>
> > > I had a quick look at this. It looks like the following test case failed<br>
> > ><br>
> > > TEST $CLI volume add-brick $V0 $H0:$B0/brick{3,4}<br>
> > > EXPECT_WITHIN $REBALANCE_TIMEOUT "0" rebalance_completed<br>
> > ><br>
<br>
<br>
<br>
</div></div>Looks like the same "port in use" issue. From the d-backends-brick3.log:<br>
<br>
<br>
[2015-07-01 09:27:17.821430] E [socket.c:818:__socket_server_bind] 0-tcp.patchy-server: binding to failed: Address already in use<br>
[2015-07-01 09:27:17.821441] E [socket.c:821:__socket_server_bind] 0-tcp.patchy-server: Port is already in use<br>
[2015-07-01 09:27:17.821452] W [rpcsvc.c:1599:rpcsvc_transport_create] 0-rpc-service: listening on transport failed<br>
[2015-07-01 09:27:17.821462] W [MSGID: 115045] [server.c:996:init] 0-patchy-server: creation of listener failed<br>
[2015-07-01 09:27:17.821475] E [MSGID: 101019] [xlator.c:423:xlator_init] 0-patchy-server: Initialization of volume 'patchy-server' failed, review your volfile again<br>
[2015-07-01 09:27:17.821485] E [MSGID: 101066] [graph.c:323:glusterfs_graph_init] 0-patchy-server: initializing translator failed<br>
[2015-07-01 09:27:17.821495] E [MSGID: 101176] [graph.c:669:glusterfs_graph_activate] 0-graph: init failed<br>
[2015-07-01 09:27:17.821891] W [glusterfsd.c:1214:cleanup_and_exit] (--> 0-: received signum (0), shutting down<br>
<div class=""><div class="h5"><br></div></div></blockquote><div><br></div><div>The patch which exposed this bug is being reverted till the underlying bug is also fixed.</div><div>You can monitor revert patches here </div><div>master: <a href="http://review.gluster.org/11507">http://review.gluster.org/11507</a></div><div>3.7 branch: <a href="http://review.gluster.org/11508">http://review.gluster.org/11508</a></div><div><br></div><div>Please rebase your patches after the above patches are merged to ensure that you patches pass regression.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div class=""><div class="h5">
<br>
> > ><br>
> > > I looked at the logs too, and found out the following errors<br>
> > ><br>
> > > patchy-rebalance.log:[2015-07-01 09:27:23.040756] E [MSGID: 109026]<br>
> > > [dht-rebalance.c:2689:gf_defrag_start_crawl] 0-patchy-dht: fix layout on<br>
> > > /<br>
> > > failed<br>
> > > build-install-etc-glusterfs-glusterd.vol.log:[2015-07-01 09:27:23.040998]<br>
> > > E<br>
> > > [MSGID: 106224]<br>
> > > [glusterd-rebalance.c:960:glusterd_defrag_event_notify_handle]<br>
> > > 0-management:<br>
> > > Failed to update status<br>
> > > StartMigrationDuringRebalanceTest-rebalance.log:[2015-06-19<br>
> > > 14:34:47.557887]<br>
> > > E [rpc-clnt.c:362:saved_frames_unwind] (--><br>
> > > /build/install/lib/libglusterfs.so.0(_gf_log_callingfn+0x240)[0x7fc882d04d5a]<br>
> > > (--><br>
> > > /build/install/lib/libgfrpc.so.0(saved_frames_unwind+0x212)[0x7fc882ace086]<br>
> > > (--><br>
> > > /build/install/lib/libgfrpc.so.0(saved_frames_destroy+0x1f)[0x7fc882ace183]<br>
> > > (--><br>
> > > /build/install/lib/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x11e)[0x7fc882ace615]<br>
> > > (--><br>
> > > /build/install/lib/libgfrpc.so.0(rpc_clnt_notify+0x147)[0x7fc882acf00f]<br>
> > > ))))) 0-StartMigrationDuringRebalanceTest-client-0: forced unwinding<br>
> > > frame<br>
> > > type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-06-19 14:34:47.554862<br>
> > > (xid=0xc)<br>
> > > StartMigrationDuringRebalanceTest-rebalance.log:[2015-06-19<br>
> > > 14:34:47.561191]<br>
> > > E [MSGID: 114031] [client-rpc-fops.c:1623:client3_3_inodelk_cbk]<br>
> > > 0-StartMigrationDuringRebalanceTest-client-0: remote operation failed:<br>
> > > Transport endpoint is not connected [Transport endpoint is not connected]<br>
> > > StartMigrationDuringRebalanceTest-rebalance.log:[2015-06-19<br>
> > > 14:34:47.561417]<br>
> > > E [socket.c:2332:socket_connect_finish]<br>
> > > 0-StartMigrationDuringRebalanceTest-client-0: connection to<br>
> > > <a href="http://23.253.62.104:24007" rel="noreferrer" target="_blank">23.253.62.104:24007</a> failed (Connection refused)<br>
> > > StartMigrationDuringRebalanceTest-rebalance.log:[2015-06-19<br>
> > > 14:34:47.561707]<br>
> > > E [dht-common.c:2643:dht_find_local_subvol_cbk]<br>
> > > 0-StartMigrationDuringRebalanceTest-dht: getxattr err (Transport endpoint<br>
> > > is<br>
> > > not connected) for dir<br>
> > ><br>
> > Seems like a network partition. Rebalance fails if there it receives<br>
> > ENOTCONN<br>
> > on it's child.<br>
><br>
> Is this intended to happen on regression machines?<br>
> ><br>
> > ><br>
> > > Any help regarding this or more information on this would be much<br>
> > > appreciated.<br>
> > ><br>
> > > Thanks,<br>
> > > Sachin Pandit.<br>
> > ><br>
> > ><br>
> > > > ><br>
> > > > > Thanks and Regards,<br>
> > > > > Kotresh H R<br>
> > > > ><br>
> > > ><br>
> > > ><br>
> > > _______________________________________________<br>
> > > Gluster-devel mailing list<br>
> > > <a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
> > > <a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
> > ><br>
> ><br>
> _______________________________________________<br>
> Gluster-devel mailing list<br>
> <a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
> <a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
><br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><font color="#666666"><b>Raghavendra Talur </b></font><div><br></div></div></div>
</div></div>