<div dir="ltr">Hi Anita,<div> We debugged the system logs when the incident occurred and found that there was an I/O error that occurred on the operating system disk of the Jenkins Master node.</div><div>We have setup a new Jenkins master node that resolves the I/O error issue. I am also providing below a snippet of the system log file that indicates the failure that occurred. </div><div>Could you please enable the HPMSA CI account, so that we can complete the sandbox testing and have the HPMSA CI report on the cinder patches after discussing with cinder developers.</div><div><br></div><div>To prevent this issue from re-occurring, we will pro-actively monitor the operating system logs for any warnings from the disk subsystem. Also, we will pro-actively run disk checks to make sure the disk is healthy.</div><div><br></div><div>Please let me know if you have any questions.</div><div><br></div><div><div><b>Jul 9 05:07:44 HPMSA-VM-JENKINS-MASTER kernel: [783653.044064] Buffer I/O error on device loop0p1, logical block 23020928</b></div><div><b>Jul 9 05:07:44 HPMSA-VM-JENKINS-MASTER kernel: [783653.044068] Buffer I/O error on device loop0p1, logical block 23020929</b></div><div><b>Jul 9 05:07:44 HPMSA-VM-JENKINS-MASTER kernel: [783653.044068] Buffer I/O error on device loop0p1, logical block 23020930</b></div><div><b>Jul 9 05:07:44 HPMSA-VM-JENKINS-MASTER kernel: [783653.044068] Buffer I/O error on device loop0p1, logical block 23020931</b></div><div><b>Jul 9 05:07:44 HPMSA-VM-JENKINS-MASTER kernel: [783653.044068] Buffer I/O error on device loop0p1, logical block 23020932</b></div><div><b>Jul 9 05:07:44 HPMSA-VM-JENKINS-MASTER kernel: [783653.044068] Buffer I/O error on device loop0p1, logical block 23020933</b></div><div><b>Jul 9 05:07:44 HPMSA-VM-JENKINS-MASTER kernel: [783653.044068] Buffer I/O error on device loop0p1, logical block 23020934</b></div><div><b>Jul 9 05:07:44 HPMSA-VM-JENKINS-MASTER kernel: [783653.044068] Buffer I/O error on device loop0p1, logical block 23020935</b></div><div><br></div><div><br></div><div>Regards</div><div>-Nikesh</div></div><div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jul 9, 2015 at 5:43 AM, Anita Kuno <span dir="ltr"><<a href="mailto:anteaya@anteaya.info" target="_blank">anteaya@anteaya.info</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><a href="https://review.openstack.org/#/c/188732/" rel="noreferrer" target="_blank">https://review.openstack.org/#/c/188732/</a><br>
<br>
Vedams-HPMSA FCISCSIDriver CI 8:11 PM<br>
<br>
Patch Set 9:<br>
<br>
Build failed. For information on how to proceed, see<br>
<a href="https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures" rel="noreferrer" target="_blank">https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures</a>. For 3rd<br>
party ci contact info: <a href="https://wiki.openstack.org/wiki/ThirdPartySystems/" rel="noreferrer" target="_blank">https://wiki.openstack.org/wiki/ThirdPartySystems/</a><br>
<br>
vedams-hpmsa-dsvm-tempest-full-iscsi EXCEPTION<br>
vedams-hpmsa-dsvm-tempest-full-fc FAILURE in 1h 41m 32s<br>
<br>
Vedams-HPMSA FCISCSIDriver CI 8:11 PM<br>
<br>
Patch Set 9:<br>
<br>
Build failed. For information on how to proceed, see<br>
<a href="https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures" rel="noreferrer" target="_blank">https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures</a>. For 3rd<br>
party ci contact info: <a href="https://wiki.openstack.org/wiki/ThirdPartySystems/" rel="noreferrer" target="_blank">https://wiki.openstack.org/wiki/ThirdPartySystems/</a><br>
<br>
vedams-hpmsa-dsvm-tempest-full-iscsi EXCEPTION<br>
vedams-hpmsa-dsvm-tempest-full-fc FAILURE in 1h 41m 32s<br>
<br>
Vedams-HPMSA FCISCSIDriver CI 8:11 PM<br>
<br>
Patch Set 9:<br>
<br>
Build failed. For information on how to proceed, see<br>
<a href="https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures" rel="noreferrer" target="_blank">https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures</a>. For 3rd<br>
party ci contact info: <a href="https://wiki.openstack.org/wiki/ThirdPartySystems/" rel="noreferrer" target="_blank">https://wiki.openstack.org/wiki/ThirdPartySystems/</a><br>
<br>
vedams-hpmsa-dsvm-tempest-full-iscsi EXCEPTION<br>
vedams-hpmsa-dsvm-tempest-full-fc FAILURE in 1h 41m 32s<br>
<br>
Vedams-HPMSA FCISCSIDriver CI 8:11 PM<br>
<br>
Patch Set 9:<br>
<br>
Build failed. For information on how to proceed, see<br>
<a href="https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures" rel="noreferrer" target="_blank">https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures</a>. For 3rd<br>
party ci contact info: <a href="https://wiki.openstack.org/wiki/ThirdPartySystems/" rel="noreferrer" target="_blank">https://wiki.openstack.org/wiki/ThirdPartySystems/</a><br>
<br>
vedams-hpmsa-dsvm-tempest-full-iscsi EXCEPTION<br>
vedams-hpmsa-dsvm-tempest-full-fc FAILURE in 1h 41m 32s<br>
<br>
<br>
Please assess your system using the ci-sandbox repo and communicate with<br>
cinder developers.<br>
<br>
Thank you,<br>
Anita.<br>
<br>
_______________________________________________<br>
Third-party-announce mailing list<br>
<a href="mailto:Third-party-announce@lists.openstack.org">Third-party-announce@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/third-party-announce" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/third-party-announce</a><br>
Please attend the third party meetings: <a href="http://eavesdrop.openstack.org/#Third_Party_Meeting" rel="noreferrer" target="_blank">http://eavesdrop.openstack.org/#Third_Party_Meeting</a><br>
</blockquote></div><br></div></div>