<div dir="ltr"><div>In my original message I've mentioned that:<br>==========================================<br>root@PSC01SERV008:/var/lib/glusterd/nfs# rpcinfo -p<br> program vers proto port service<br> 100000 4 tcp 111 portmapper<br> 100000 3 tcp 111 portmapper<br> 100000 2 tcp 111 portmapper<br> 100000 4 udp 111 portmapper<br> 100000 3 udp 111 portmapper<br> 100000 2 udp 111 portmapper<br>==========================================<br></div>will try rpcbind in debug mode approach. <br></div><div class="gmail_extra"><br><div class="gmail_quote">2015-09-16 4:37 GMT+08:00 Niels de Vos <span dir="ltr"><<a href="mailto:ndevos@redhat.com" target="_blank">ndevos@redhat.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On Sun, Sep 13, 2015 at 04:30:43PM +0530, Soumya Koduri wrote:<br>
><br>
><br>
> On 09/13/2015 09:38 AM, Yaroslav Molochko wrote:<br>
> >I wish this could be that simple:<br>
> >root@PSC01SERV008:/var/lib# netstat -nap | grep 38465<br>
> >root@PSC01SERV008:/var/lib# ss -n | grep 38465<br>
> >root@PSC01SERV008:/var/lib#<br>
> ><br>
> >2015-09-13 1:34 GMT+08:00 Atin Mukherjee <<a href="mailto:atin.mukherjee83@gmail.com">atin.mukherjee83@gmail.com</a><br>
> ><mailto:<a href="mailto:atin.mukherjee83@gmail.com">atin.mukherjee83@gmail.com</a>>>:<br>
> ><br>
> > By any chance is your Gluster NFS server is already running? Output<br>
> > of netstat -nap | grep 38465 might give some clue?<br>
> ><br>
> > -Atin<br>
> > Sent from one plus one<br>
> ><br>
> > On Sep 12, 2015 10:54 PM, "Yaroslav Molochko" <<a href="mailto:onorua@gmail.com">onorua@gmail.com</a><br>
> > <mailto:<a href="mailto:onorua@gmail.com">onorua@gmail.com</a>>> wrote:<br>
> ><br>
> > Hello,<br>
> ><br>
> > I have a problem reported in logs:<br>
> > ==================<br>
> > [2015-09-12 13:56:06.271644] I [MSGID: 100030]<br>
> > [glusterfsd.c:2301:main] 0-/usr/sbin/glusterfs: Started running<br>
> > /usr/sbin/glusterfs version 3.7.4 (args: /usr/sbin/glusterfs -s<br>
> > localhost --volfile-id gluster/nfs -p<br>
> > /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log<br>
> > -S /var/run/gluster/cb186678589f28e74c67da70fd06e736.socket)<br>
> > [2015-09-12 13:56:06.277921] I [MSGID: 101190]<br>
> > [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started<br>
> > thread with index 1<br>
> > [2015-09-12 13:56:07.284888] I<br>
> > [rpcsvc.c:2215:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service:<br>
> > Configured rpc.outstanding-rpc-limit with value 16<br>
> > [2015-09-12 13:56:07.292484] W [MSGID: 112153]<br>
> > [mount3.c:3910:mnt3svc_init] 0-nfs-mount: Exports auth has been<br>
> > disabled!<br>
> > [2015-09-12 13:56:07.294357] E<br>
> > [rpcsvc.c:1370:rpcsvc_program_register_portmap] 0-rpc-service:<br>
> > Could not register with portmap 100005 3 38465<br>
><br>
> Port registration failed. Could you check '/var/log/messages' and dmesg to<br>
> see if there are any errors logged? Is firewalld running on your system.<br>
> Verify if the port is open to be used.<br>
<br>
</div></div>Registration of services at portmap can also fail because there is a<br>
service with that program number and version registered already. Could<br>
you check if that is the case?<br>
<br>
$ rpcinfo -p | grep 100005<br>
100005 3 tcp 38465 mountd<br>
100005 1 tcp 38466 mountd<br>
<br>
If you see a similar output, check if you have standard NFS services<br>
running. The rpc.mountd process will also register itself at the<br>
portmapper, but it will conflict with the NFS-services that Gluster<br>
provides. Make sure all NFS services (server and client) have been<br>
disabled and stopped. After that, check with the 'rpcinfo' command if<br>
any of nlockmgr, mount, status or nfs are registered. If that is the<br>
case, you can unregister them one-by-one with commands like this:<br>
<br>
# rpcinfo -d 100005 1<br>
# rpcinfo -d 100005 3<br>
...<br>
<br>
After unregistering the services at the portmapper, you should be able<br>
to start the Gluster-NFS service by restarting glusterd.<br>
<br>
HTH,<br>
Niels<br>
<div class="HOEnZb"><div class="h5"><br>
><br>
> Thanks,<br>
> Soumya<br>
> > [2015-09-12 13:56:07.294398] E [MSGID: 112088]<br>
> > [nfs.c:341:nfs_init_versions] 0-nfs: Required program MOUNT3<br>
> > registration failed<br>
> > [2015-09-12 13:56:07.294413] E [MSGID: 112109] [nfs.c:1482:init]<br>
> > 0-nfs: Failed to initialize protocols<br>
> > [2015-09-12 13:56:07.294426] E [MSGID: 101019]<br>
> > [xlator.c:428:xlator_init] 0-nfs-server: Initialization of<br>
> > volume 'nfs-server' failed, review your volfile again<br>
> > [2015-09-12 13:56:07.294438] E<br>
> > [graph.c:322:glusterfs_graph_init] 0-nfs-server: initializing<br>
> > translator failed<br>
> > [2015-09-12 13:56:07.294448] E<br>
> > [graph.c:661:glusterfs_graph_activate] 0-graph: init failed<br>
> > [2015-09-12 13:56:07.294781] W<br>
> > [glusterfsd.c:1219:cleanup_and_exit]<br>
> > (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x11a) [0x7fbe9c754b7a]<br>
> > -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x123)<br>
> > [0x7fbe9c74fcb3] -->/usr/sbin/glusterfs(cleanup_and_exit+0x59)<br>
> > [0x7fbe9c74f329] ) 0-: received signum (0), shutting down<br>
> > ===================<br>
> ><br>
> > I've checked the page:<br>
> > <a href="http://www.gluster.org/community/documentation/index.php/Gluster_3.1:_NFS_Frequently_Asked_Questions" rel="noreferrer" target="_blank">http://www.gluster.org/community/documentation/index.php/Gluster_3.1:_NFS_Frequently_Asked_Questions</a><br>
> ><br>
> > I've found report in RedHat that it's necessary to remove -w<br>
> > from rpcbind becuse some times it causes problems.<br>
> > I did all that but still no luck on one of the servers, what is<br>
> > interesting, the other server (peered) is working fine without<br>
> > any problems.<br>
> ><br>
> > root@PSC01SERV008:/var/lib/glusterd/nfs# systemctl status nfs<br>
> > ● nfs.service<br>
> > Loaded: not-found (Reason: No such file or directory)<br>
> > Active: inactive (dead)<br>
> ><br>
> > root@PSC01SERV008:/var/lib/glusterd/nfs# systemctl status rpcbind<br>
> > ● rpcbind.service - RPC bind portmap service<br>
> > Loaded: loaded (/etc/systemd/system/rpcbind.service;<br>
> > enabled; vendor preset: enabled)<br>
> > Drop-In: /run/systemd/generator/rpcbind.service.d<br>
> > └─50-rpcbind-$portmap.conf<br>
> > Active: active (running) since Sat 2015-09-12 13:55:07 UTC;<br>
> > 6min ago<br>
> > Main PID: 9796 (rpcbind)<br>
> > Memory: 428.0K<br>
> > CGroup: /system.slice/rpcbind.service<br>
> > └─9796 /sbin/rpcbind<br>
> ><br>
> > Sep 12 13:55:07 PSC01SERV008 systemd[1]: Starting RPC bind<br>
> > portmap service...<br>
> > Sep 12 13:55:07 PSC01SERV008 systemd[1]: Started RPC bind<br>
> > portmap service.<br>
> > root@PSC01SERV008:/var/lib/glusterd/nfs# rpcinfo -p<br>
> > program vers proto port service<br>
> > 100000 4 tcp 111 portmapper<br>
> > 100000 3 tcp 111 portmapper<br>
> > 100000 2 tcp 111 portmapper<br>
> > 100000 4 udp 111 portmapper<br>
> > 100000 3 udp 111 portmapper<br>
> > 100000 2 udp 111 portmapper<br>
> ><br>
> > I've tried to reinstall it agaon and again - but there is no luck.<br>
> ><br>
> > What I have:<br>
> > cat /etc/lsb-release<br>
> > DISTRIB_ID=Ubuntu<br>
> > DISTRIB_RELEASE=15.04<br>
> > DISTRIB_CODENAME=vivid<br>
> > DISTRIB_DESCRIPTION="Ubuntu 15.04"<br>
> ><br>
> > ii glusterfs-client<br>
> > 3.7.4-ubuntu1~vivid1 amd64 clustered<br>
> > file-system (client package)<br>
> > ii glusterfs-common<br>
> > 3.7.4-ubuntu1~vivid1 amd64 GlusterFS common<br>
> > libraries and translator modules<br>
> > ii glusterfs-server<br>
> > 3.7.4-ubuntu1~vivid1 amd64 clustered<br>
> > file-system (server package)<br>
> ><br>
> > What else can I check? How can I fix it, what is most important :)<br>
> > Thanks in advance!<br>
> ><br>
> > _______________________________________________<br>
> > Gluster-users mailing list<br>
> > <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a> <mailto:<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>><br>
> > <a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
> ><br>
> ><br>
> ><br>
> ><br>
> >_______________________________________________<br>
> >Gluster-users mailing list<br>
> ><a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> ><a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
> ><br>
> _______________________________________________<br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> <a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</div></div></blockquote></div><br></div>