I think we should compare n-1th week report with nth and any common tests out of that comparison having more than or equal to 3 instances of failures SHOULD immediately marked as bad and any component having more than 5 bad tests should be BLOCKED for further merges till bad tests are fixed.<span></span> What do others think about it?<br><br>On Wednesday 3 August 2016, Vijay Bellur <<a href="mailto:vbellur@redhat.com">vbellur@redhat.com</a>> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<font size="+1"><tt>[Thanks to Jeff Darcy, Poornima G and
Raghavendra Talur for extras/failed-tests.py which generates
this summary]<br>
<br>
Found cores:<br>
<br>
Component: [u'glusterfs-1879.core']<br>
Regression Link:
<a href="https://build.gluster.org/job/regression-test-burn-in/1451/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1451/consoleFull</a><br>
<br>
./tests/performance/open-behind.t ; Failed 3 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1443/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1443/consoleFull</a><br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1426/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1426/consoleFull</a><br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1425/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1425/consoleFull</a><br>
<br>
./tests/bugs/glusterd/bug-963541.t ; Failed 1 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1431/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1431/consoleFull</a><br>
<br>
./tests/basic/ec/ec-new-entry.t ; Failed 1 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1451/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1451/consoleFull</a><br>
<br>
./tests/bugs/bug-1110262.t ; Failed 2 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1424/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1424/consoleFull</a><br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1418/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1418/consoleFull</a><br>
<br>
./tests/bugs/glusterd/bug-1089668.t ; Failed 2 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1447/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1447/consoleFull</a><br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1435/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1435/consoleFull</a><br>
<br>
./tests/basic/volume-snapshot.t ; Failed 1 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1429/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1429/consoleFull</a><br>
<br>
./tests/basic/gfapi/bug1291259.t ; Failed 1 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1450/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1450/consoleFull</a><br>
<br>
./tests/bugs/quick-read/bug-846240.t ; Failed 1 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1416/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1416/consoleFull</a><br>
<br>
./tests/bugs/gfapi/bug-1093594.t ; Failed 1 times<br>
Regression Links:
<a href="https://build.gluster.org/job/regression-test-burn-in/1423/consoleFull" target="_blank">https://build.gluster.org/job/regression-test-burn-in/1423/consoleFull</a><br>
</tt><br>
</font><tt><font size="+1">maintainers & owners of above tests -
can we please address these failures?<br>
<br>
Thanks,<br>
Vijay</font><br>
</tt>
</div>
</blockquote><br><br>-- <br>--Atin<br>