<div dir="ltr"><div><div><div>Hi Soumya,<br><br><br></div>Please find attached nfs.log file.<br><br></div>Regards,<br></div>Abhishek<br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 4, 2016 at 11:45 AM, ABHISHEK PALIWAL <span dir="ltr">&lt;<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div><div>HI Soumya,<br><br></div>Thanks for reply.<br><br></div>Yes, I am getting following error in /var/log/glusterfs/nfs.log file<br><br>[2016-04-25 06:27:23.721851] E [MSGID: 112109] [nfs.c:1482:init] 0-nfs: Failed to initialize protocols<br><br></div><div>Please suggest me how can I resolve it.<br></div><div><br></div>Regards,<br></div>Abhishek<br></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Wed, May 4, 2016 at 11:33 AM, Soumya Koduri <span dir="ltr">&lt;<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Abhishek,<br>
<br>
Below &#39;rpcinfo&#39; output doesn&#39;t list &#39;nfsacl&#39; protocol. That must be the reason client is not able set ACLs. Could you please check the log file &#39;/var/lib/glusterfs/nfs.log&#39; if there are any errors logged with respect protocol registration failures.<br>
<br>
Thanks,<br>
Soumya<span><br>
<br>
On 05/04/2016 11:15 AM, ABHISHEK PALIWAL wrote:<br>
</span><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span>
Hi Niels,<br>
<br>
Please reply it is really urgent.<br>
<br>
Regards,<br>
Abhishek<br>
<br>
On Tue, May 3, 2016 at 11:36 AM, ABHISHEK PALIWAL<br></span><span>
&lt;<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a> &lt;mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>&gt;&gt; wrote:<br>
<br>
    Hi Niels,<br>
<br>
    Do you require more logs...<br>
<br>
    Regards,<br>
    Abhishek<br>
<br>
    On Mon, May 2, 2016 at 4:58 PM, ABHISHEK PALIWAL<br></span><div><div>
    &lt;<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a> &lt;mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>&gt;&gt; wrote:<br>
<br>
        Hi Niels,<br>
<br>
<br>
        Here is the output of rpcinfo -p $NFS_SERVER<br>
<br>
        root@128:/# rpcinfo -p $NFS_SERVER<br>
            program vers proto   port  service<br>
             100000    4   tcp    111  portmapper<br>
             100000    3   tcp    111  portmapper<br>
             100000    2   tcp    111  portmapper<br>
             100000    4   udp    111  portmapper<br>
             100000    3   udp    111  portmapper<br>
             100000    2   udp    111  portmapper<br>
             100005    3   tcp  38465  mountd<br>
             100005    1   tcp  38465  mountd<br>
             100003    3   tcp  38465  nfs<br>
             100227    3   tcp  38465<br>
<br>
<br>
        out of mount command<br>
<br>
        #mount -vvv -t nfs -o acl,vers=3 128.224.95.140:/gv0 /tmp/e<br>
        mount: fstab path: &quot;/etc/fstab&quot;<br>
        mount: mtab path:  &quot;/etc/mtab&quot;<br>
        mount: lock path:  &quot;/etc/mtab~&quot;<br>
        mount: temp path:  &quot;/etc/mtab.tmp&quot;<br>
        mount: UID:        0<br>
        mount: eUID:       0<br>
        mount: spec:  &quot;128.224.95.140:/gv0&quot;<br>
        mount: node:  &quot;/tmp/e&quot;<br>
        mount: types: &quot;nfs&quot;<br>
        mount: opts:  &quot;acl,vers=3&quot;<br>
        mount: external mount: argv[0] = &quot;/sbin/mount.nfs&quot;<br>
        mount: external mount: argv[1] = &quot;128.224.95.140:/gv0&quot;<br>
        mount: external mount: argv[2] = &quot;/tmp/e&quot;<br>
        mount: external mount: argv[3] = &quot;-v&quot;<br>
        mount: external mount: argv[4] = &quot;-o&quot;<br>
        mount: external mount: argv[5] = &quot;rw,acl,vers=3&quot;<br>
        mount.nfs: timeout set for Mon May  2 16:58:58 2016<br>
        mount.nfs: trying text-based options<br>
        &#39;acl,vers=3,addr=128.224.95.140&#39;<br>
        mount.nfs: prog 100003, trying vers=3, prot=6<br>
        mount.nfs: trying 128.224.95.140 prog 100003 vers 3 prot TCP<br>
        port 38465<br>
        mount.nfs: prog 100005, trying vers=3, prot=17<br>
        mount.nfs: portmap query retrying: RPC: Program not registered<br>
        mount.nfs: prog 100005, trying vers=3, prot=6<br>
        mount.nfs: trying 128.224.95.140 prog 100005 vers 3 prot TCP<br>
        port 38465<br>
<br>
<br>
        On Mon, May 2, 2016 at 4:36 PM, Niels de Vos &lt;<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a><br></div></div><div><div>
        &lt;mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>&gt;&gt; wrote:<br>
<br>
            On Mon, May 02, 2016 at 04:14:01PM +0530, ABHISHEK PALIWAL<br>
            wrote:<br>
             &gt; HI Team,<br>
             &gt;<br>
             &gt; I am exporting gluster volume using GlusterNFS  with ACL<br>
            support but at NFS<br>
             &gt; client while running &#39;setfacl&#39; command getting &quot;setfacl:<br>
            /tmp/e: Remote I/O<br>
             &gt; error&quot;<br>
             &gt;<br>
             &gt;<br>
             &gt; Following is the NFS option status for Volume:<br>
             &gt;<br>
             &gt; nfs.enable-ino32<br>
             &gt; no<br>
             &gt; nfs.mem-factor<br>
             &gt; 15<br>
             &gt; nfs.export-dirs<br>
             &gt; on<br>
             &gt; nfs.export-volumes<br>
             &gt; on<br>
             &gt; nfs.addr-namelookup<br>
             &gt; off<br>
             &gt; nfs.dynamic-volumes<br>
             &gt; off<br>
             &gt; nfs.register-with-portmap<br>
             &gt; on<br>
             &gt; nfs.outstanding-rpc-limit<br>
             &gt; 16<br>
             &gt; nfs.port<br>
             &gt; 38465<br>
             &gt; nfs.rpc-auth-unix<br>
             &gt; on<br>
             &gt; nfs.rpc-auth-null<br>
             &gt; on<br>
             &gt; nfs.rpc-auth-allow<br>
             &gt; all<br>
             &gt; nfs.rpc-auth-reject<br>
             &gt; none<br>
             &gt; nfs.ports-insecure<br>
             &gt; off<br>
             &gt; nfs.trusted-sync<br>
             &gt; off<br>
             &gt; nfs.trusted-write<br>
             &gt; off<br>
             &gt; nfs.volume-access<br>
             &gt; read-write<br>
             &gt; nfs.export-dir<br>
             &gt;<br>
             &gt; nfs.disable<br>
             &gt; off<br>
             &gt; nfs.nlm<br>
             &gt; on<br>
             &gt; nfs.acl<br>
             &gt; on<br>
             &gt; nfs.mount-udp<br>
             &gt; off<br>
             &gt; nfs.mount-rmtab<br>
             &gt; /var/lib/glusterd/nfs/rmtab<br>
             &gt; nfs.rpc-statd<br>
             &gt; /sbin/rpc.statd<br>
             &gt; nfs.server-aux-gids<br>
             &gt; off<br>
             &gt; nfs.drc<br>
             &gt; off<br>
             &gt; nfs.drc-size<br>
             &gt; 0x20000<br>
             &gt; nfs.read-size                           (1 *<br>
             &gt; 1048576ULL)<br>
             &gt; nfs.write-size                          (1 *<br>
             &gt; 1048576ULL)<br>
             &gt; nfs.readdir-size                        (1 *<br>
             &gt; 1048576ULL)<br>
             &gt; nfs.exports-auth-enable<br>
             &gt; (null)<br>
             &gt; nfs.auth-refresh-interval-sec<br>
             &gt; (null)<br>
             &gt; nfs.auth-cache-ttl-sec                  (null)<br>
             &gt;<br>
             &gt; Command to mount exported gluster volume on NFS client is<br>
             &gt;<br>
             &gt; mount -v -t nfs -o acl,vers=3 128.224.95.140:/gv0 /tmp/e<br>
<br>
            Could you post the output of mounting with &#39;mount -vvv ...&#39;?<br>
            In previous<br>
            emails I&#39;ve asked for the output of &#39;rpcinfo -p<br>
            $NFS_SERVER&#39;, I do not<br>
            think I&#39;ve seen that yet.<br>
<br>
            The port used for NFSv3 ACLs on the NFS-server should be<br>
            listed in<br>
            &#39;netstat -tulpen&#39; and the PID of the process should be the<br>
            one of the<br>
            Gluster/NFS service.<br>
<br>
            HTH,<br>
            Niels<br>
<br>
<br>
            &gt; setfacl -m u:nobody:r /tmp/e<br>
            &gt; setfacl: /tmp/e: Remote I/O error<br>
            &gt;<br>
            &gt; --<br>
            &gt;<br>
            &gt;<br>
            &gt;<br>
            &gt;<br>
            &gt; Regards<br>
            &gt; Abhishek Paliwal<br>
<br>
             &gt; _______________________________________________<br>
             &gt; Gluster-devel mailing list<br></div></div>
             &gt; <a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a> &lt;mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>&gt;<span><br>
             &gt; <a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
<br>
<br>
<br>
<br>
        --<br>
<br>
<br>
<br>
<br>
        Regards<br>
        Abhishek Paliwal<br>
<br>
<br>
<br>
<br>
    --<br>
<br>
<br>
<br>
<br>
    Regards<br>
    Abhishek Paliwal<br>
<br>
<br>
<br>
<br>
--<br>
<br>
<br>
<br>
<br>
Regards<br>
Abhishek Paliwal<br>
<br>
<br></span>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
</blockquote>
</blockquote></div><br><br clear="all"><br></div></div><span class="HOEnZb"><font color="#888888">-- <br><div><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div>
</font></span></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature"><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div>
</div></div>