<div dir="ltr"><div>So the test fails (intermittently) in check_fs which tries to do a df on the mount point for a volume which is carved out of three bricks from 3 nodes and one node is completely down. A quick look at the mount log reveals the following:<br><br>[2016-10-10 13:58:59.279446]:++++++++++ G_LOG:./tests/bugs/glusterd/<wbr>bug-913555.t: TEST: 48 0 check_fs /mnt/glusterfs/0 ++++++++++<br>[2016-10-10 13:58:59.287973] W [MSGID: 114031] [client-rpc-fops.c:2930:<wbr>client3_3_lookup_cbk] 0-patchy-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-<wbr>000000000001) [Transport endpoint is not connected]<br>[2016-10-10 13:58:59.288326] I [MSGID: 109063] [dht-layout.c:713:dht_layout_<wbr>normalize] 0-patchy-dht: Found anomalies in / (gfid = 00000000-0000-0000-0000-<wbr>000000000001). Holes=1 overlaps=0<br>[2016-10-10 13:58:59.288352] W [MSGID: 109005] [dht-selfheal.c:2102:dht_<wbr>selfheal_directory] 0-patchy-dht: Directory selfheal failed: 1 subvolumes down.Not fixing. path = /, gfid = <br>[2016-10-10 13:58:59.288643] W [MSGID: 114031] [client-rpc-fops.c:2930:<wbr>client3_3_lookup_cbk] 0-patchy-client-2: remote operation failed. Path: / (00000000-0000-0000-0000-<wbr>000000000001) [Transport endpoint is not connected]<br>[2016-10-10 13:58:59.288927] W [fuse-resolve.c:132:fuse_<wbr>resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000- <wbr> 000000000001: failed to resolve (Stale file handle)<br>[2016-10-10 13:58:59.288949] W [fuse-bridge.c:2597:fuse_<wbr>opendir_resume] 0-glusterfs-fuse: 7: OPENDIR (00000000-0000- 0000-0000-000000000001) resolution failed<br>[2016-10-10 13:58:59.289505] W [fuse-resolve.c:132:fuse_<wbr>resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000- <wbr> 000000000001: failed to resolve (Stale file handle)<br>[2016-10-10 13:58:59.289524] W [fuse-bridge.c:3137:fuse_<wbr>statfs_resume] 0-glusterfs-fuse: 8: STATFS (00000000-0000- 0000-0000-000000000001) resolution fail<br><br></div>DHT team - are these anomalies expected here? I also see opendir and statfs failing here too.<br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Oct 12, 2016 at 12:18 PM, Atin Mukherjee <span dir="ltr"><<a href="mailto:amukherj@redhat.com" target="_blank">amukherj@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I will take a look at it in sometime.<br></div><div class="gmail_extra"><div><div class="m_2449460313019310865h5"><br><div class="gmail_quote">On Wed, Oct 12, 2016 at 12:08 PM, Oleksandr Natalenko <span dir="ltr"><<a href="mailto:oleksandr@natalenko.name" target="_blank">oleksandr@natalenko.name</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello.<br>
<br>
Vijay asked me to drop a note about spurious failure of ./tests/bugs/glusterd/bug-9135<wbr>55.t test. Here are the examples:<br>
<br>
* <a href="https://build.gluster.org/job/centos6-regression/1069/consoleFull" rel="noreferrer" target="_blank">https://build.gluster.org/job/<wbr>centos6-regression/1069/consol<wbr>eFull</a><br>
* <a href="https://build.gluster.org/job/centos6-regression/1076/consoleFull" rel="noreferrer" target="_blank">https://build.gluster.org/job/<wbr>centos6-regression/1076/consol<wbr>eFull</a><br>
<br>
Could someone take a look at it?<br>
<br>
Also, last two tests were broken because of this:<br>
<br>
===<br>
Slave went offline during the build<br>
===<br>
<br>
See these builds for details:<br>
<br>
* <a href="https://build.gluster.org/job/centos6-regression/1077/consoleFull" rel="noreferrer" target="_blank">https://build.gluster.org/job/<wbr>centos6-regression/1077/consol<wbr>eFull</a><br>
* <a href="https://build.gluster.org/job/centos6-regression/1078/consoleFull" rel="noreferrer" target="_blank">https://build.gluster.org/job/<wbr>centos6-regression/1078/consol<wbr>eFull</a><br>
<br>
Was that intentionally?<br>
<br>
Thanks.<br>
<br>
Regards,<br>
Oleksandr<br>
______________________________<wbr>_________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman<wbr>/listinfo/gluster-devel</a><br>
</blockquote></div><br><br clear="all"><br></div></div><span class="m_2449460313019310865HOEnZb"><font color="#888888">-- <br><div class="m_2449460313019310865m_4619341227867596571gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><br></div>--Atin<br></div></div>
</font></span></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="m_2449460313019310865gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><br></div>--Atin<br></div></div>
</div></div>