<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jul 2, 2015 at 1:26 PM, Nithya Balachandran <span dir="ltr">&lt;<a href="mailto:nbalacha@redhat.com" target="_blank">nbalacha@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span class=""><br>
<br>
----- Original Message -----<br>
&gt; From: &quot;Kotresh Hiremath Ravishankar&quot; &lt;<a href="mailto:khiremat@redhat.com">khiremat@redhat.com</a>&gt;<br>
&gt; To: &quot;Susant Palai&quot; &lt;<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>&gt;<br>
&gt; Cc: &quot;Gluster Devel&quot; &lt;<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>&gt;<br>
</span><div><div class="h5">&gt; Sent: Thursday, July 2, 2015 1:03:18 PM<br>
&gt; Subject: Re: [Gluster-devel] Regression Failure: ./tests/basic/quota.t<br>
&gt;<br>
&gt; Comments inline.<br>
&gt;<br>
&gt; Thanks and Regards,<br>
&gt; Kotresh H R<br>
&gt;<br>
&gt; ----- Original Message -----<br>
&gt; &gt; From: &quot;Susant Palai&quot; &lt;<a href="mailto:spalai@redhat.com">spalai@redhat.com</a>&gt;<br>
&gt; &gt; To: &quot;Sachin Pandit&quot; &lt;<a href="mailto:spandit@redhat.com">spandit@redhat.com</a>&gt;<br>
&gt; &gt; Cc: &quot;Kotresh Hiremath Ravishankar&quot; &lt;<a href="mailto:khiremat@redhat.com">khiremat@redhat.com</a>&gt;, &quot;Gluster Devel&quot;<br>
&gt; &gt; &lt;<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>&gt;<br>
&gt; &gt; Sent: Thursday, July 2, 2015 12:35:08 PM<br>
&gt; &gt; Subject: Re: [Gluster-devel] Regression Failure: ./tests/basic/quota.t<br>
&gt; &gt;<br>
&gt; &gt; Comments inline.<br>
&gt; &gt;<br>
&gt; &gt; ----- Original Message -----<br>
&gt; &gt; &gt; From: &quot;Sachin Pandit&quot; &lt;<a href="mailto:spandit@redhat.com">spandit@redhat.com</a>&gt;<br>
&gt; &gt; &gt; To: &quot;Kotresh Hiremath Ravishankar&quot; &lt;<a href="mailto:khiremat@redhat.com">khiremat@redhat.com</a>&gt;<br>
&gt; &gt; &gt; Cc: &quot;Gluster Devel&quot; &lt;<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>&gt;<br>
&gt; &gt; &gt; Sent: Thursday, July 2, 2015 12:21:44 PM<br>
&gt; &gt; &gt; Subject: Re: [Gluster-devel] Regression Failure: ./tests/basic/quota.t<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; ----- Original Message -----<br>
&gt; &gt; &gt; &gt; From: &quot;Vijaikumar M&quot; &lt;<a href="mailto:vmallika@redhat.com">vmallika@redhat.com</a>&gt;<br>
&gt; &gt; &gt; &gt; To: &quot;Kotresh Hiremath Ravishankar&quot; &lt;<a href="mailto:khiremat@redhat.com">khiremat@redhat.com</a>&gt;, &quot;Gluster<br>
&gt; &gt; &gt; &gt; Devel&quot;<br>
&gt; &gt; &gt; &gt; &lt;<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>&gt;<br>
&gt; &gt; &gt; &gt; Cc: &quot;Sachin Pandit&quot; &lt;<a href="mailto:spandit@redhat.com">spandit@redhat.com</a>&gt;<br>
&gt; &gt; &gt; &gt; Sent: Thursd, TOTAL CHANGELOGS: 106<br>
&gt; [2015-07-02 07:01:06.883504] E<br>
&gt; [gf-history-changelog.c:877:gf_history_changelog] 0-gfchangelog: wrong<br>
&gt; result for start: 1435818ay, July 2, 2015 12:01:03 PM<br>
&gt; &gt; &gt; &gt; Subject: Re: Regression Failure: ./tests/basic/quota.t<br>
&gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; We look into this issue<br>
&gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; Thanks,<br>
&gt; &gt; &gt; &gt; Vijay<br>
&gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; On Thursday 02 July 2015 11:46 AM, Kotresh Hiremath Ravishankar wrote:<br>
&gt; &gt; &gt; &gt; &gt; Hi,<br>
&gt; &gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; &gt; I see quota.t regression failure for the following. The changes are<br>
&gt; &gt; &gt; &gt; &gt; related<br>
&gt; &gt; &gt; &gt; &gt; to<br>
&gt; &gt; &gt; &gt; &gt; example programs in libgfchangelog.<br>
&gt; &gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; &gt; <a href="http://build.gluster.org/job/rackspace-regression-2GB-triggered/11785/consoleFull" rel="noreferrer" target="_blank">http://build.gluster.org/job/rackspace-regression-2GB-triggered/11785/consoleFull</a><br>
&gt; &gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; &gt; Could someone from quota team, take a look at it.<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; Hi,<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; I had a quick look at this. It looks like the following test case failed<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; TEST $CLI volume add-brick $V0 $H0:$B0/brick{3,4}<br>
&gt; &gt; &gt; EXPECT_WITHIN $REBALANCE_TIMEOUT &quot;0&quot; rebalance_completed<br>
&gt; &gt; &gt;<br>
<br>
<br>
<br>
</div></div>Looks like the same &quot;port in use&quot; issue. From the d-backends-brick3.log:<br>
<br>
<br>
[2015-07-01 09:27:17.821430] E [socket.c:818:__socket_server_bind] 0-tcp.patchy-server: binding to  failed: Address already in use<br>
[2015-07-01 09:27:17.821441] E [socket.c:821:__socket_server_bind] 0-tcp.patchy-server: Port is already in use<br>
[2015-07-01 09:27:17.821452] W [rpcsvc.c:1599:rpcsvc_transport_create] 0-rpc-service: listening on transport failed<br>
[2015-07-01 09:27:17.821462] W [MSGID: 115045] [server.c:996:init] 0-patchy-server: creation of listener failed<br>
[2015-07-01 09:27:17.821475] E [MSGID: 101019] [xlator.c:423:xlator_init] 0-patchy-server: Initialization of volume &#39;patchy-server&#39; failed, review your volfile again<br>
[2015-07-01 09:27:17.821485] E [MSGID: 101066] [graph.c:323:glusterfs_graph_init] 0-patchy-server: initializing translator failed<br>
[2015-07-01 09:27:17.821495] E [MSGID: 101176] [graph.c:669:glusterfs_graph_activate] 0-graph: init failed<br>
[2015-07-01 09:27:17.821891] W [glusterfsd.c:1214:cleanup_and_exit] (--&gt; 0-: received signum (0), shutting down<br>
<div class=""><div class="h5"><br></div></div></blockquote><div><br></div><div>The patch which exposed this bug is being reverted till the underlying bug is also fixed.</div><div>You can monitor revert patches here </div><div>master: <a href="http://review.gluster.org/11507">http://review.gluster.org/11507</a></div><div>3.7 branch: <a href="http://review.gluster.org/11508">http://review.gluster.org/11508</a></div><div><br></div><div>Please rebase your patches after the above patches are merged to ensure that you patches pass regression.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div class=""><div class="h5">
<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; I looked at the logs too, and found out the following errors<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; patchy-rebalance.log:[2015-07-01 09:27:23.040756] E [MSGID: 109026]<br>
&gt; &gt; &gt; [dht-rebalance.c:2689:gf_defrag_start_crawl] 0-patchy-dht: fix layout on<br>
&gt; &gt; &gt; /<br>
&gt; &gt; &gt; failed<br>
&gt; &gt; &gt; build-install-etc-glusterfs-glusterd.vol.log:[2015-07-01 09:27:23.040998]<br>
&gt; &gt; &gt; E<br>
&gt; &gt; &gt; [MSGID: 106224]<br>
&gt; &gt; &gt; [glusterd-rebalance.c:960:glusterd_defrag_event_notify_handle]<br>
&gt; &gt; &gt; 0-management:<br>
&gt; &gt; &gt; Failed to update status<br>
&gt; &gt; &gt; StartMigrationDuringRebalanceTest-rebalance.log:[2015-06-19<br>
&gt; &gt; &gt; 14:34:47.557887]<br>
&gt; &gt; &gt; E [rpc-clnt.c:362:saved_frames_unwind] (--&gt;<br>
&gt; &gt; &gt; /build/install/lib/libglusterfs.so.0(_gf_log_callingfn+0x240)[0x7fc882d04d5a]<br>
&gt; &gt; &gt; (--&gt;<br>
&gt; &gt; &gt; /build/install/lib/libgfrpc.so.0(saved_frames_unwind+0x212)[0x7fc882ace086]<br>
&gt; &gt; &gt; (--&gt;<br>
&gt; &gt; &gt; /build/install/lib/libgfrpc.so.0(saved_frames_destroy+0x1f)[0x7fc882ace183]<br>
&gt; &gt; &gt; (--&gt;<br>
&gt; &gt; &gt; /build/install/lib/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x11e)[0x7fc882ace615]<br>
&gt; &gt; &gt; (--&gt;<br>
&gt; &gt; &gt; /build/install/lib/libgfrpc.so.0(rpc_clnt_notify+0x147)[0x7fc882acf00f]<br>
&gt; &gt; &gt; ))))) 0-StartMigrationDuringRebalanceTest-client-0: forced unwinding<br>
&gt; &gt; &gt; frame<br>
&gt; &gt; &gt; type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-06-19 14:34:47.554862<br>
&gt; &gt; &gt; (xid=0xc)<br>
&gt; &gt; &gt; StartMigrationDuringRebalanceTest-rebalance.log:[2015-06-19<br>
&gt; &gt; &gt; 14:34:47.561191]<br>
&gt; &gt; &gt; E [MSGID: 114031] [client-rpc-fops.c:1623:client3_3_inodelk_cbk]<br>
&gt; &gt; &gt; 0-StartMigrationDuringRebalanceTest-client-0: remote operation failed:<br>
&gt; &gt; &gt; Transport endpoint is not connected [Transport endpoint is not connected]<br>
&gt; &gt; &gt; StartMigrationDuringRebalanceTest-rebalance.log:[2015-06-19<br>
&gt; &gt; &gt; 14:34:47.561417]<br>
&gt; &gt; &gt; E [socket.c:2332:socket_connect_finish]<br>
&gt; &gt; &gt; 0-StartMigrationDuringRebalanceTest-client-0: connection to<br>
&gt; &gt; &gt; <a href="http://23.253.62.104:24007" rel="noreferrer" target="_blank">23.253.62.104:24007</a> failed (Connection refused)<br>
&gt; &gt; &gt; StartMigrationDuringRebalanceTest-rebalance.log:[2015-06-19<br>
&gt; &gt; &gt; 14:34:47.561707]<br>
&gt; &gt; &gt; E [dht-common.c:2643:dht_find_local_subvol_cbk]<br>
&gt; &gt; &gt; 0-StartMigrationDuringRebalanceTest-dht: getxattr err (Transport endpoint<br>
&gt; &gt; &gt; is<br>
&gt; &gt; &gt; not connected) for dir<br>
&gt; &gt; &gt;<br>
&gt; &gt; Seems like a network partition. Rebalance fails if there it receives<br>
&gt; &gt; ENOTCONN<br>
&gt; &gt; on it&#39;s child.<br>
&gt;<br>
&gt; Is this intended to happen on regression machines?<br>
&gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; Any help regarding this or more information on this would be much<br>
&gt; &gt; &gt; appreciated.<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; Thanks,<br>
&gt; &gt; &gt; Sachin Pandit.<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; &gt; Thanks and Regards,<br>
&gt; &gt; &gt; &gt; &gt; Kotresh H R<br>
&gt; &gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; _______________________________________________<br>
&gt; &gt; &gt; Gluster-devel mailing list<br>
&gt; &gt; &gt; <a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
&gt; &gt; &gt; <a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
&gt; &gt; &gt;<br>
&gt; &gt;<br>
&gt; _______________________________________________<br>
&gt; Gluster-devel mailing list<br>
&gt; <a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
&gt; <a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
&gt;<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><font color="#666666"><b>Raghavendra Talur </b></font><div><br></div></div></div>
</div></div>