<div dir="ltr"><div><div><div>Hi Rafi KC,<br><br></div>I have already attached all the logs in my first mail and I am getting these logs on 25th board.<br><br></div>You can find the logs at logs/d/usr/002500_glusterfiles/varlog_glusterfs/brick/ <br><br><br></div>//Abhishek</div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Nov 11, 2016 at 11:50 AM, Mohammed Rafi K C <span dir="ltr">&lt;<a href="mailto:rkavunga@redhat.com" target="_blank">rkavunga@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    <p>Hi Abhishek,<br>
    </p>
    <p>Could you please see if you are bricks are healthy or not, may be
      you can do a gluster volume status or you can look into the logs.
      If bricks are not running can you please attach the bricks logs in
      /var/log/gluster/bricks/ .</p>
    <p><br>
    </p>
    <p>Rafi KC<br>
    </p><div><div class="h5">
    <br>
    <div class="m_8959294982350413426moz-cite-prefix">On 11/11/2016 10:20 AM, ABHISHEK
      PALIWAL wrote:<br>
    </div>
    </div></div><blockquote type="cite"><div><div class="h5">
      <div dir="ltr">
        <div>
          <div>Hi,<br>
            <br>
          </div>
          Its an urgent case. <br>
          <br>
        </div>
        Atleast provide your views on this<br>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Wed, Nov 9, 2016 at 11:08 AM,
          ABHISHEK PALIWAL <span dir="ltr">&lt;<a href="mailto:abhishpaliwal@gmail.com" target="_blank"></a><a class="m_8959294982350413426moz-txt-link-abbreviated" href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>&gt;</span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div dir="ltr">
              <div>Hi,<br>
                <br>
              </div>
              <span style="background-color:white" lang="sv"><font face="Times New Roman,serif" color="black" size="3"><span style="font-size:12pt"><font face="Kalinga,sans-serif" size="2"><span style="font-size:10pt">We could see that sync is
                        getting failed to sync the GlusterFS bricks due
                        to error trace &quot;Transport endpoint is not
                        connected &quot;<br>
                        <br>
                        [2016-10-31 04:06:03.627395] E [MSGID: 114031]
                        [client-rpc-fops.c:1673:client<wbr>3_3_finodelk_cbk]
                        0-c_glusterfs-client-9: remote operation failed
                        [Transport endpoint is not connected]<br>
                        [2016-10-31 04:06:03.628381] I
                        [socket.c:3308:socket_submit_r<wbr>equest]
                        0-c_glusterfs-client-9: not connected
                        (priv-&gt;connected = 0)<br>
                        [2016-10-31 04:06:03.628432] W
                        [rpc-clnt.c:1586:rpc_clnt_subm<wbr>it]
                        0-c_glusterfs-client-9: failed to submit
                        rpc-request (XID: 0x7f5f Program: GlusterFS 3.3,
                        ProgVers: 330, Proc: 30) to rpc-transport
                        (c_glusterfs-client-9)<br>
                        [2016-10-31 04:06:03.628466] E [MSGID: 114031]
                        [client-rpc-fops.c:1673:client<wbr>3_3_finodelk_cbk]
                        0-c_glusterfs-client-9: remote operation failed
                        [Transport endpoint is not connected]<br>
                        [2016-10-31 04:06:03.628475] I [MSGID: 108019]
                        [afr-lk-common.c:1086:afr_lock<wbr>_blocking]
                        0-c_glusterfs-replicate-0: unable to lock on
                        even one child<br>
                        [2016-10-31 04:06:03.628539] I [MSGID: 108019]
                        [afr-transaction.c:1224:afr_po<wbr>st_blocking_inodelk_cbk]
                        0-c_glusterfs-replicate-0: Blocking inodelks
                        failed.<br>
                        [2016-10-31 04:06:03.628630] W
                        [fuse-bridge.c:1282:fuse_err_c<wbr>bk]
                        0-glusterfs-fuse: 20790: FLUSH() ERR =&gt; -1
                        (Transport endpoint is not connected)<br>
                        [2016-10-31 04:06:03.629149] E
                        [rpc-clnt.c:362:saved_frames_u<wbr>nwind]
                        (--&gt; /usr/lib64/libglusterfs.so.0(_<wbr>gf_log_callingfn-0xb5c80)[0x3f<wbr>ff8ab79f58]
                        (--&gt; /usr/lib64/libgfrpc.so.0(saved<wbr>_frames_unwind-0x1b7a0)[0x3fff<wbr>8ab1dc90]
                        (--&gt; /usr/lib64/libgfrpc.so.0(saved<wbr>_frames_destroy-0x1b638)[0x3ff<wbr>f8ab1de10]
                        (--&gt; /usr/lib64/libgfrpc.so.0(rpc_c<wbr>lnt_connection_cleanup-0x19af8<wbr>)[0x3fff8ab1fb18]
                        (--&gt; /usr/lib64/libgfrpc.so.0(rpc_c<wbr>lnt_notify-0x18e68)[0x3fff8ab2<wbr>0808]
                        ))))) 0-c_glusterfs-client-9: forced unwinding
                        frame type(GlusterFS 3.3) op(LOOKUP(27)) called
                        at 2016-10-31 04:06:03.624346 (xid=0x7f5a)<br>
                        [2016-10-31 04:06:03.629183] I
                        [rpc-clnt.c:1847:rpc_clnt_reco<wbr>nfig]
                        0-c_glusterfs-client-9: changing port to 49391
                        (from 0)<br>
                        [2016-10-31 04:06:03.629210] W [MSGID: 114031]
                        [client-rpc-fops.c:2971:client<wbr>3_3_lookup_cbk]
                        0-c_glusterfs-client-9: remote operation failed.
                        Path: /loadmodules_norepl/CXC1725605<wbr>_P93A001/cello/emasviews
                        (b0e5a94e-a432-4dce-b86f-a5515<wbr>55780a2)
                        [Transport endpoint is not connected]<br>
                      </span></font> </span></font></span>
              <div>
                <div><br>
                  <br>
                </div>
                <div>Could you please tell us the reason why we are
                  getting these trace and how to resolve this.<br>
                </div>
                <div><br>
                </div>
                <div>Logs are attached here please share your analysis.<br>
                  <br>
                </div>
                <div>Thanks in advanced<span class="m_8959294982350413426HOEnZb"><font color="#888888"><br>
                    </font></span></div>
                <span class="m_8959294982350413426HOEnZb"><font color="#888888">
                    <div><br>
                      -- <br>
                      <div class="m_8959294982350413426m_5515194601349185739gmail_signature">
                        <div dir="ltr">Regards<br>
                          Abhishek Paliwal<br>
                        </div>
                      </div>
                    </div>
                  </font></span></div>
            </div>
          </blockquote>
        </div>
        <br>
        <br clear="all">
        <br>
        -- <br>
        <div class="m_8959294982350413426gmail_signature" data-smartmail="gmail_signature">
          <div dir="ltr"><br>
            <br>
            <br>
            <br>
            Regards<br>
            Abhishek Paliwal<br>
          </div>
        </div>
      </div>
      <br>
      <fieldset class="m_8959294982350413426mimeAttachmentHeader"></fieldset>
      <br>
      </div></div><pre>______________________________<wbr>_________________
Gluster-users mailing list
<a class="m_8959294982350413426moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<a class="m_8959294982350413426moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/<wbr>mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  </div>

</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div>
</div>