<div dir="ltr"><div>i am changing the nfs.port using gluster volume set gv0 nfs.port 2049 but it automatically changing MOUNTD as well<br><br></div>and nfs.disable is also off<br><br>gluster volume get gv0 nfs.disable <br>Option Value <br>------ ----- <br>nfs.disable off <br><br><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 4, 2016 at 12:25 PM, Soumya Koduri <span dir="ltr"><<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Not sure why mountd is registering on 2049 port number. Please try resetting volume options (if its fine) using "gluster v reset <volname> force" and enable only nfs and verify the behavior.<br>
<br>
"gluster v set <volname> nfs.disable off"<br>
<br>
Thanks,<br>
Soumya<span class=""><br>
<br>
On 05/04/2016 12:17 PM, ABHISHEK PALIWAL wrote:<br>
</span><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">
still having the same problem not able to see NETFACL option in rpcinfo -p<br>
<br>
rpcinfo -p<br>
program vers proto port service<br>
100000 4 tcp 111 portmapper<br>
100000 3 tcp 111 portmapper<br>
100000 2 tcp 111 portmapper<br>
100000 4 udp 111 portmapper<br>
100000 3 udp 111 portmapper<br>
100000 2 udp 111 portmapper<br>
100005 3 tcp 2049 mountd<br>
100005 1 tcp 2049 mountd<br>
100003 3 tcp 2049 nfs<br>
100227 3 tcp 2049<br>
<br>
<br>
<br>
<br>
On Wed, May 4, 2016 at 12:09 PM, Soumya Koduri <<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a><br></span><span class="">
<mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>>> wrote:<br>
<br>
<br>
<br>
On 05/04/2016 12:04 PM, ABHISHEK PALIWAL wrote:<br>
<br>
but gluster mentioned that Gluster NFS works on 38465-38469 that<br>
why I<br>
took these ports.<br>
<br>
<br>
yes. Gluster-NFS uses ports 38465-38469 to register the side-band<br>
protocols it needs like MOUNTD, NLM, NFSACL etc.. I am not sure, but<br>
maybe the wording in that documentation was misleading.<br>
<br>
Thanks,<br>
Soumya<br>
<br>
<br>
Regards,<br>
Abhishek<br>
<br>
On Wed, May 4, 2016 at 12:00 PM, Soumya Koduri<br>
<<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a> <mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>><br></span><span class="">
<mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a> <mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>>>> wrote:<br>
<br></span><span class="">
> nfs.port<br>
> 38465<br>
<br>
Is there any reason behind choosing this port for NFS<br>
protocol? This<br>
port number seems to be used for MOUNT (V3) protocol as<br>
well and<br>
that may have resulted in port registration failures. Could you<br>
please change nfs port to default (2049) or some other port<br>
(other<br>
than 38465-38469). Also please make sure kernel-nfs is stopeed.<br>
<br>
Thanks,<br>
Soumya<br>
<br>
<br>
On 05/04/2016 11:49 AM, ABHISHEK PALIWAL wrote:<br>
<br>
Hi Soumya,<br>
<br>
<br>
Please find attached nfs.log file.<br>
<br>
Regards,<br>
Abhishek<br>
<br>
On Wed, May 4, 2016 at 11:45 AM, ABHISHEK PALIWAL<br>
<<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>> <mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>><br></span><span class="">
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>>>> wrote:<br>
<br></span><div><div class="h5">
HI Soumya,<br>
<br>
Thanks for reply.<br>
<br>
Yes, I am getting following error in<br>
/var/log/glusterfs/nfs.log file<br>
<br>
[2016-04-25 06:27:23.721851] E [MSGID: 112109]<br>
[nfs.c:1482:init]<br>
0-nfs: Failed to initialize protocols<br>
<br>
Please suggest me how can I resolve it.<br>
<br>
Regards,<br>
Abhishek<br>
<br>
On Wed, May 4, 2016 at 11:33 AM, Soumya Koduri<br>
<<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a> <mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>><br>
<mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a> <mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>>><br>
<mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a><br>
<mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>> <mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a><br>
<mailto:<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>>>>> wrote:<br>
<br>
Hi Abhishek,<br>
<br>
Below 'rpcinfo' output doesn't list 'nfsacl'<br>
protocol.<br>
That must<br>
be the reason client is not able set ACLs.<br>
Could you please<br>
check the log file '/var/lib/glusterfs/nfs.log' if<br>
there are any<br>
errors logged with respect protocol<br>
registration failures.<br>
<br>
Thanks,<br>
Soumya<br>
<br>
On 05/04/2016 11:15 AM, ABHISHEK PALIWAL wrote:<br>
<br>
Hi Niels,<br>
<br>
Please reply it is really urgent.<br>
<br>
Regards,<br>
Abhishek<br>
<br>
On Tue, May 3, 2016 at 11:36 AM, ABHISHEK<br>
PALIWAL<br>
<<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a> <mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>>>>> wrote:<br>
<br>
Hi Niels,<br>
<br>
Do you require more logs...<br>
<br>
Regards,<br>
Abhishek<br>
<br>
On Mon, May 2, 2016 at 4:58 PM,<br>
ABHISHEK PALIWAL<br>
<<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>><br>
<br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
<mailto:<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>>>>>> wrote:<br>
<br>
Hi Niels,<br>
<br>
<br>
Here is the output of rpcinfo -p<br>
$NFS_SERVER<br>
<br>
root@128:/# rpcinfo -p $NFS_SERVER<br>
program vers proto port<br>
service<br>
100000 4 tcp 111<br>
portmapper<br>
100000 3 tcp 111<br>
portmapper<br>
100000 2 tcp 111<br>
portmapper<br>
100000 4 udp 111<br>
portmapper<br>
100000 3 udp 111<br>
portmapper<br>
100000 2 udp 111<br>
portmapper<br>
100005 3 tcp 38465 mountd<br>
100005 1 tcp 38465 mountd<br>
100003 3 tcp 38465 nfs<br>
100227 3 tcp 38465<br>
<br>
<br>
out of mount command<br>
<br>
#mount -vvv -t nfs -o acl,vers=3<br>
128.224.95.140:/gv0 /tmp/e<br>
mount: fstab path: "/etc/fstab"<br>
mount: mtab path: "/etc/mtab"<br>
mount: lock path: "/etc/mtab~"<br>
mount: temp path: "/etc/mtab.tmp"<br>
mount: UID: 0<br>
mount: eUID: 0<br>
mount: spec: "128.224.95.140:/gv0"<br>
mount: node: "/tmp/e"<br>
mount: types: "nfs"<br>
mount: opts: "acl,vers=3"<br>
mount: external mount: argv[0] =<br>
"/sbin/mount.nfs"<br>
mount: external mount: argv[1] =<br>
"128.224.95.140:/gv0"<br>
mount: external mount: argv[2] =<br>
"/tmp/e"<br>
mount: external mount: argv[3] = "-v"<br>
mount: external mount: argv[4] = "-o"<br>
mount: external mount: argv[5] =<br>
"rw,acl,vers=3"<br>
mount.nfs: timeout set for Mon May 2<br>
16:58:58 2016<br>
mount.nfs: trying text-based options<br>
'acl,vers=3,addr=128.224.95.140'<br>
mount.nfs: prog 100003, trying<br>
vers=3, prot=6<br>
mount.nfs: trying 128.224.95.140 prog<br>
100003 vers 3<br>
prot TCP<br>
port 38465<br>
mount.nfs: prog 100005, trying<br>
vers=3, prot=17<br>
mount.nfs: portmap query<br>
retrying: RPC:<br>
Program not<br>
registered<br>
mount.nfs: prog 100005, trying<br>
vers=3, prot=6<br>
mount.nfs: trying 128.224.95.140 prog<br>
100005 vers 3<br>
prot TCP<br>
port 38465<br>
<br>
<br>
On Mon, May 2, 2016 at 4:36 PM,<br>
Niels de Vos<br>
<<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>> <mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>>><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a> <mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a> <mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>>>><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a> <mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>>><br>
<br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a><br>
<mailto:<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>>>>>> wrote:<br>
<br>
On Mon, May 02, 2016 at<br>
04:14:01PM +0530,<br>
ABHISHEK PALIWAL<br>
wrote:<br>
> HI Team,<br>
><br>
> I am exporting gluster<br>
volume using<br>
GlusterNFS with ACL<br>
support but at NFS<br>
> client while running<br>
'setfacl' command<br>
getting "setfacl:<br>
/tmp/e: Remote I/O<br>
> error"<br>
><br>
><br>
> Following is the NFS<br>
option status<br>
for Volume:<br>
><br>
> nfs.enable-ino32<br>
> no<br>
> nfs.mem-factor<br>
> 15<br>
> nfs.export-dirs<br>
> on<br>
> nfs.export-volumes<br>
> on<br>
> nfs.addr-namelookup<br>
> off<br>
> nfs.dynamic-volumes<br>
> off<br>
> nfs.register-with-portmap<br>
> on<br>
> nfs.outstanding-rpc-limit<br>
> 16<br>
> nfs.port<br>
> 38465<br>
> nfs.rpc-auth-unix<br>
> on<br>
> nfs.rpc-auth-null<br>
> on<br>
> nfs.rpc-auth-allow<br>
> all<br>
> nfs.rpc-auth-reject<br>
> none<br>
> nfs.ports-insecure<br>
> off<br>
> nfs.trusted-sync<br>
> off<br>
> nfs.trusted-write<br>
> off<br>
> nfs.volume-access<br>
> read-write<br>
> nfs.export-dir<br>
><br>
> nfs.disable<br>
> off<br>
> nfs.nlm<br>
> on<br>
> nfs.acl<br>
> on<br>
> nfs.mount-udp<br>
> off<br>
> nfs.mount-rmtab<br>
> /var/lib/glusterd/nfs/rmtab<br>
> nfs.rpc-statd<br>
> /sbin/rpc.statd<br>
> nfs.server-aux-gids<br>
> off<br>
> nfs.drc<br>
> off<br>
> nfs.drc-size<br>
> 0x20000<br>
> nfs.read-size<br>
(1 *<br>
> 1048576ULL)<br>
> nfs.write-size<br>
(1 *<br>
> 1048576ULL)<br>
> nfs.readdir-size<br>
(1 *<br>
> 1048576ULL)<br>
> nfs.exports-auth-enable<br>
> (null)<br>
> nfs.auth-refresh-interval-sec<br>
> (null)<br>
> nfs.auth-cache-ttl-sec<br>
(null)<br>
><br>
> Command to mount exported<br>
gluster<br>
volume on<br>
NFS client is<br>
><br>
> mount -v -t nfs -o acl,vers=3<br>
128.224.95.140:/gv0 /tmp/e<br>
<br>
Could you post the output of<br>
mounting with<br>
'mount -vvv ...'?<br>
In previous<br>
emails I've asked for the<br>
output of<br>
'rpcinfo -p<br>
$NFS_SERVER', I do not<br>
think I've seen that yet.<br>
<br>
The port used for NFSv3 ACLs<br>
on the<br>
NFS-server<br>
should be<br>
listed in<br>
'netstat -tulpen' and the PID<br>
of the<br>
process<br>
should be the<br>
one of the<br>
Gluster/NFS service.<br>
<br>
HTH,<br>
Niels<br>
<br>
<br>
> setfacl -m u:nobody:r /tmp/e<br>
> setfacl: /tmp/e: Remote I/O<br>
error<br>
><br>
> --<br>
><br>
><br>
><br>
><br>
> Regards<br>
> Abhishek Paliwal<br>
<br>
><br>
_______________________________________________<br>
> Gluster-devel mailing list<br>
> <a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>>><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>>>><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>>><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>>>>><br>
><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
<br>
<br>
<br>
<br>
--<br>
<br>
<br>
<br>
<br>
Regards<br>
Abhishek Paliwal<br>
<br>
<br>
<br>
<br>
--<br>
<br>
<br>
<br>
<br>
Regards<br>
Abhishek Paliwal<br>
<br>
<br>
<br>
<br>
--<br>
<br>
<br>
<br>
<br>
Regards<br>
Abhishek Paliwal<br>
<br>
<br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a> <mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>><br>
<mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>>><br>
<mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>><br>
<mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>>>><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
<br>
<br>
<br>
--<br>
<br>
<br>
<br>
<br>
Regards<br>
Abhishek Paliwal<br>
<br>
<br>
<br>
<br>
--<br>
<br>
<br>
<br>
<br>
Regards<br>
Abhishek Paliwal<br>
<br>
<br>
<br>
<br>
--<br>
<br>
<br>
<br>
<br>
Regards<br>
Abhishek Paliwal<br>
<br>
<br>
<br>
<br>
--<br>
<br>
<br>
<br>
<br>
Regards<br>
Abhishek Paliwal<br>
</div></div></blockquote>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature"><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div>
</div>