<div dir="ltr"><div>You won't believe! I have removed "glusterfs-server" and installed it again and now all files is present in the installation and shared storage is working!</div><div><br></div><div>Here what I have done:</div><div># yum remove glusterfs-server</div><div># yum install glusterfs-server</div><div># systemctl start glusterfs</div><div># gluster volume set all cluster.enable-shared-storage enable</div><div><br></div><div>After that shared_storage became workable! Thank you very much for your help! I would spent much more time without you. I don't know why it haven't installed fully first time. Maybe I have ran some command which have removed those scripts but I am not sure. Thank you again for help.</div><div><br></div><div>Best regards,</div><div>Alexandr</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Nov 21, 2016 at 12:19 PM, Alexandr Porunov <span dir="ltr"><<a href="mailto:alexandr.porunov@gmail.com" target="_blank">alexandr.porunov@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>It seems that not all files have been installed. But I don't know why.. </div><div>For example this folders are empty but they should have several scripts:</div><div><span style="font-size:12.8px">/var/lib/glusterd/hooks/1/set/</span><span style="font-size:12.8px"><wbr>post/</span><br></div><div><span style="font-size:12.8px">/var/lib/glusterd/hooks/1/</span><span style="font-size:12.8px">stop<wbr>/pre/</span><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Nov 21, 2016 at 12:15 PM, Alexandr Porunov <span dir="ltr"><<a href="mailto:alexandr.porunov@gmail.com" target="_blank">alexandr.porunov@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Sorry, I misunderstood that command. <div>Here is it:<br><div># rpm -qil glusterfs-server<br></div><div><br></div><div><div>Name : glusterfs-server</div><div>Version : 3.8.5</div><div>Release : 1.el7</div><div>Architecture: x86_64</div><div>Install Date: Thu 17 Nov 2016 07:23:22 PM EET</div><div>Group : System Environment/Daemons</div><div>Size : 4776600</div><div>License : GPLv2 or LGPLv3+</div><div>Signature : RSA/SHA1, Wed 26 Oct 2016 04:27:02 PM EEST, Key ID d4a2e50be451e5b5</div><div>Source RPM : glusterfs-3.8.5-1.el7.src.rpm</div><div>Build Date : Thu 13 Oct 2016 04:28:18 PM EEST</div><div>Build Host : <a href="http://c1bd.rdu2.centos.org" target="_blank">c1bd.rdu2.centos.org</a></div><div>Relocations : (not relocatable)</div><div>Packager : CBS <<a href="mailto:cbs@centos.org" target="_blank">cbs@centos.org</a>></div><div>Vendor : Fedora Project</div><div>URL : <a href="http://www.gluster.org/docs/index.php/GlusterFS" target="_blank">http://www.gluster.org/docs/in<wbr>dex.php/GlusterFS</a></div><div>Summary : Clustered file-system server</div><div>Description :</div><div>GlusterFS is a distributed file-system capable of scaling to several</div><div>petabytes. It aggregates various storage bricks over Infiniband RDMA</div><div>or TCP/IP interconnect into one large parallel network file</div><div>system. GlusterFS is one of the most sophisticated file systems in</div><div>terms of features and extensibility. It borrows a powerful concept</div><div>called Translators from GNU Hurd kernel. Much of the code in GlusterFS</div><div>is in user space and easily manageable.</div><div><br></div><div>This package provides the glusterfs server daemon.</div><div>/etc/glusterfs</div><div>/etc/glusterfs/gluster-rsyslog<wbr>-5.8.conf</div><div>/etc/glusterfs/gluster-rsyslog<wbr>-7.2.conf</div><div>/etc/glusterfs/glusterd.vol</div><div>/etc/glusterfs/glusterfs-geore<wbr>p-logrotate</div><div>/etc/glusterfs/glusterfs-logro<wbr>tate</div><div>/etc/glusterfs/group-virt.exam<wbr>ple</div><div>/etc/glusterfs/logger.conf.exa<wbr>mple</div><div>/etc/sysconfig/glusterd</div><div>/etc/sysconfig/glusterfsd</div><div>/usr/bin/glusterfind</div><div>/usr/lib/firewalld/services/gl<wbr>usterfs.xml</div><div>/usr/lib/systemd/system/gluste<wbr>rd.service</div><div>/usr/lib/systemd/system/gluste<wbr>rfsd.service</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/cluster/pump.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/arbiter.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/bit-rot.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/bitrot-stub.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/changetimerecorde<wbr>r.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/index.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/leases.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/locks.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/marker.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/posix-locks.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/quota.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/quotad.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/snapview-server.<wbr>so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/trash.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/features/upcall.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/mgmt</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/mgmt/glusterd.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/nfs</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/nfs/server.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/performance/decompounder.<wbr>so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/protocol/server.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/storage</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/storage/bd.so</div><div>/usr/lib64/glusterfs/3.8.5/xla<wbr>tor/storage/posix.so</div><div>/usr/lib64/libgfdb.so.0</div><div>/usr/lib64/libgfdb.so.0.0.1</div><div>/usr/libexec/glusterfs/gluster<wbr>find</div><div>/usr/libexec/glusterfs/gluster<wbr>find/S57glusterfind-delete-<wbr>post.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/S57glusterfind-delete-<wbr>post.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/S57glusterfind-delete-<wbr>post.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/__init__.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/__init__.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/__init__.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/brickfind.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/brickfind.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/brickfind.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/changelog.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/changelog.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/changelog.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/changelogdata.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/changelogdata.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/changelogdata.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/conf.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/conf.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/conf.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/libgfchangelog.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/libgfchangelog.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/libgfchangelog.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/main.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/main.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/main.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/nodeagent.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/nodeagent.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/nodeagent.pyo</div><div>/usr/libexec/glusterfs/gluster<wbr>find/tool.conf</div><div>/usr/libexec/glusterfs/gluster<wbr>find/utils.py</div><div>/usr/libexec/glusterfs/gluster<wbr>find/utils.pyc</div><div>/usr/libexec/glusterfs/gluster<wbr>find/utils.pyo</div><div>/usr/libexec/glusterfs/peer_ad<wbr>d_secret_pub</div><div>/usr/sbin/gcron.py</div><div>/usr/sbin/glfsheal</div><div>/usr/sbin/glusterd</div><div>/usr/sbin/snap_scheduler.py</div><div>/usr/share/doc/glusterfs-serve<wbr>r-3.8.5</div><div>/usr/share/doc/glusterfs-serve<wbr>r-3.8.5/clear_xattrs.sh</div><div>/usr/share/glusterfs/scripts/s<wbr>top-all-gluster-processes.sh</div><div>/var/lib/glusterd</div><div>/var/lib/glusterd/bitd</div><div>/var/lib/glusterd/<a href="http://glusterd.info" target="_blank">glusterd.inf<wbr>o</a></div><div>/var/lib/glusterd/glusterfind</div><div>/var/lib/glusterd/glusterfind/<wbr>.keys</div><div>/var/lib/glusterd/glustershd</div><div>/var/lib/glusterd/groups</div><div>/var/lib/glusterd/groups/virt</div><div>/var/lib/glusterd/hooks</div><div>/var/lib/glusterd/hooks/1</div><div>/var/lib/glusterd/hooks/1/add-<wbr>brick</div><div>/var/lib/glusterd/hooks/1/add-<wbr>brick/post</div><div>/var/lib/glusterd/hooks/1/add-<wbr>brick/post/disabled-quota-root<wbr>-xattr-heal.sh</div><div>/var/lib/glusterd/hooks/1/add-<wbr>brick/pre</div><div>/var/lib/glusterd/hooks/1/add-<wbr>brick/pre/S28Quota-enable-root<wbr>-xattr-heal.sh</div><div>/var/lib/glusterd/hooks/1/copy<wbr>-file</div><div>/var/lib/glusterd/hooks/1/copy<wbr>-file/post</div><div>/var/lib/glusterd/hooks/1/copy<wbr>-file/pre</div><div>/var/lib/glusterd/hooks/1/crea<wbr>te</div><div>/var/lib/glusterd/hooks/1/crea<wbr>te/post</div><div>/var/lib/glusterd/hooks/1/crea<wbr>te/pre</div><div>/var/lib/glusterd/hooks/1/dele<wbr>te</div><div>/var/lib/glusterd/hooks/1/dele<wbr>te/post</div><div>/var/lib/glusterd/hooks/1/dele<wbr>te/post/S57glusterfind-delete-<wbr>post</div><div>/var/lib/glusterd/hooks/1/dele<wbr>te/pre</div><div>/var/lib/glusterd/hooks/1/remo<wbr>ve-brick</div><div>/var/lib/glusterd/hooks/1/remo<wbr>ve-brick/post</div><div>/var/lib/glusterd/hooks/1/remo<wbr>ve-brick/pre</div><div>/var/lib/glusterd/hooks/1/rese<wbr>t</div><div>/var/lib/glusterd/hooks/1/rese<wbr>t/post</div><div>/var/lib/glusterd/hooks/1/rese<wbr>t/pre</div><div>/var/lib/glusterd/hooks/1/set</div><div>/var/lib/glusterd/hooks/1/set/<wbr>post</div><div>/var/lib/glusterd/hooks/1/set/<wbr>post/S30samba-set.sh</div><div>/var/lib/glusterd/hooks/1/set/<wbr>post/S32gluster_enable_shared_<wbr>storage.sh</div><div>/var/lib/glusterd/hooks/1/set/<wbr>pre</div><div>/var/lib/glusterd/hooks/1/star<wbr>t</div><div>/var/lib/glusterd/hooks/1/star<wbr>t/post</div><div>/var/lib/glusterd/hooks/1/star<wbr>t/post/S29CTDBsetup.sh</div><div>/var/lib/glusterd/hooks/1/star<wbr>t/post/S30samba-start.sh</div><div>/var/lib/glusterd/hooks/1/star<wbr>t/pre</div><div>/var/lib/glusterd/hooks/1/stop</div><div>/var/lib/glusterd/hooks/1/stop<wbr>/post</div><div>/var/lib/glusterd/hooks/1/stop<wbr>/pre</div><div>/var/lib/glusterd/hooks/1/stop<wbr>/pre/S29CTDB-teardown.sh</div><div>/var/lib/glusterd/hooks/1/stop<wbr>/pre/S30samba-stop.sh</div><div>/var/lib/glusterd/nfs</div><div>/var/lib/glusterd/nfs/nfs-serv<wbr>er.vol</div><div>/var/lib/glusterd/nfs/run</div><div>/var/lib/glusterd/nfs/run/nfs.<wbr>pid</div><div>/var/lib/glusterd/options</div><div>/var/lib/glusterd/peers</div><div>/var/lib/glusterd/quotad</div><div>/var/lib/glusterd/scrub</div><div>/var/lib/glusterd/snaps</div><div>/var/lib/glusterd/ss_brick</div><div>/var/lib/glusterd/vols</div></div></div></div><div class="m_419028694318136339HOEnZb"><div class="m_419028694318136339h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Nov 21, 2016 at 12:10 PM, Alexandr Porunov <span dir="ltr"><<a href="mailto:alexandr.porunov@gmail.com" target="_blank">alexandr.porunov@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>I don't have volumes named "gluster_shared_storage".</div><div><br></div><div>Here is what I have:</div><span><div># gluster volume status gluster_shared_storage</div><div>Volume gluster_shared_storage does not exist</div><div><br></div></span><div>I added that script "/var/lib/glusterd/hooks/1/set<wbr>/post/S32gluster_enable_shared<wbr>_storage.sh"</div><div><br></div><div>Then I run next commands:</div><div># systemctl restart glusterd</div><div># gluster volume set all cluster.enable-shared-storage disable</div><span><div># gluster volume set all cluster.enable-shared-storage enable</div><div><br></div></span><div>After several minutes I tried to check if the volume is exists but it still doesn't:</div><span><div># gluster volume status gluster_shared_storage</div><div>Volume gluster_shared_storage does not exist</div><div><br></div></span><div>I have check next log file: "/var/log/glusterfs/run-gluste<wbr>r-shared_storage.log" and it is empty.</div><div><br></div><div>Then I checked next log file "/var/log/glusterfs/etc-gluste<wbr>rfs-glusterd.vol.log" it has the next content:</div><div>[2016-11-21 10:01:58.847473] I [MSGID: 106499] [glusterd-handler.c:4349:__glu<wbr>sterd_handle_status_volume] 0-management: Received status volume req for volume gluster_shared_storage</div><div>[2016-11-21 10:01:58.850019] E [MSGID: 106525] [glusterd-op-sm.c:3914:gluster<wbr>d_dict_set_volid] 0-management: Volume gluster_shared_storage does not exist</div><div>[2016-11-21 10:01:58.850058] E [MSGID: 106289] [glusterd-syncop.c:1894:gd_syn<wbr>c_task_begin] 0-management: Failed to build payload for operation 'Volume Status'</div><div><br></div><div>I am not sure how to check rpm file because I have installed glusterfs with "yum install glusterfs-server".</div><div><br></div><div>Do you know how to get rpm with yum? </div><div><br></div><div>Sincerely,</div><div>Alexandr</div></div><div class="m_419028694318136339m_3748601482494747611HOEnZb"><div class="m_419028694318136339m_3748601482494747611h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Nov 21, 2016 at 9:02 AM, Jiffin Tony Thottan <span dir="ltr"><<a href="mailto:jthottan@redhat.com" target="_blank">jthottan@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"><span>
<p><br>
</p>
<br>
<div class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909moz-cite-prefix">On 21/11/16 11:13, Alexandr Porunov
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>
<div>Version of glusterfs is 3.8.5</div>
<div><br>
</div>
<div>Here what I have installed:</div>
<div>rpm -ivh <a href="http://dl.fedoraproject.org/pub/epel/7/x86_64/e/epel-release-7-8.noarch.rpm" target="_blank">http://dl.fedoraproject.org/p<wbr>ub/epel/7/x86_64/e/epel-releas<wbr>e-7-8.noarch.rpm</a></div>
<div>yum install centos-release-gluster</div>
<div>yum install glusterfs-server</div>
</div>
</div>
</blockquote>
<br></span>
It should be part of glusterfs-server. So can u check files provided
by this, run rpm -qil <full name of glusterfs-server rpm><span><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div>
<div>yum install glusterfs-geo-replication</div>
<div><br>
</div>
<div>Unfortunately it doesn't work if I just add the script
"/var/lib/glusterd/hooks/1/set<wbr>/post/S32gluster_enable_shared<wbr>_storage.sh"
and restart "glusterd".</div>
<div><br>
</div>
</div>
</div>
</blockquote>
<br></span>
I didn't get that, when u rerun gluster v set all
cluster.enable-shared-storage enable should work (I guess even
glusterd restart is not required)<br>
Or do u have any volumes named "gluster_shared_storage", if yes
please remove it and rerun the cli.<br>
<br>
--<br>
Jiffin<div><div class="m_419028694318136339m_3748601482494747611m_6728370012781127316h5"><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div>
<div>It seems that I have to install something else..</div>
<div><br>
</div>
<div>Sincerely,</div>
<div>Alexandr</div>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Nov 21, 2016 at 6:58 AM, Jiffin
Tony Thottan <span dir="ltr"><<a href="mailto:jthottan@redhat.com" target="_blank">jthottan@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"><span>
<p><br>
</p>
<div class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413moz-cite-prefix">On
21/11/16 01:07, Alexandr Porunov wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>I have installed it from rpm. No that file
isn't there. The folder
"/var/lib/glusterd/hooks/1/set<wbr>/post/" is
empty..</div>
<div><br>
</div>
</div>
</blockquote>
<br>
</span> which gluster version and what all gluster rpms
have u installed?<br>
For time being just download this file[1] and copy to
above location and rerun the same cli.<br>
<br>
[1] <a href="https://github.com/gluster/glusterfs/blob/master/extras/hook-scripts/set/post/S32gluster_enable_shared_storage.sh" target="_blank">https://github.com/gluster/glu<wbr>sterfs/blob/master/extras/hook<wbr>-scripts/set/post/S32gluster_e<wbr>nable_shared_storage.sh</a><br>
<br>
--<br>
Jiffin
<div>
<div class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909h5"><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div>Sincerely,</div>
<div>Alexandr</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 20, 2016 at
2:55 PM, Jiffin Tony Thottan <span dir="ltr"><<a href="mailto:jthottan@redhat.com" target="_blank">jthottan@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<p>Did u install rpm or directly from
sources. Can u check whether following
script is present?<br>
</p>
/var/lib/glusterd/hooks/1/set/<wbr>post/S32gluster_enable_shared_<wbr>storage.sh<br>
<br>
--<br>
<br>
Jiffin
<div>
<div class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413h5"><br>
<br>
<div class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413m_3574131477938731546moz-cite-prefix">On
20/11/16 13:33, Alexandr Porunov
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>To enable shared storage I used
next command:</div>
<div># gluster volume set all
cluster.enable-shared-storage
enable</div>
<div><br>
</div>
<div>But it seems that it doesn't
create gluster_shared_storage
automatically.</div>
<div><br>
</div>
<div># gluster volume status
gluster_shared_storage</div>
<div>Volume gluster_shared_storage
does not exist</div>
<div><br>
</div>
<div>Do I need to manually create a
volume "gluster_shared_storage"?
Do I need to manually create a
folder
"/var/run/gluster/shared_stora<wbr>ge"?
Do I need to manually mount it? Or
something I don't need to do?</div>
<div><br>
</div>
<div>If I use 6 cluster nodes and I
need to have a shared storage on
all of them then how to create a
shared storage? </div>
<div>It says that it have to be with
replication 2 or replication 3.
But if we use shared storage on
all of 6 nodes then we have only 2
ways to create a volume:</div>
<div>1. Use replication 6</div>
<div>2. Use replication 3 with
distribution.</div>
<div><br>
</div>
<div>Which way I need to use?</div>
<div><br>
</div>
<div>Sincerely,</div>
<div>Alexandr</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov
20, 2016 at 9:07 AM, Jiffin Tony
Thottan <span dir="ltr"><<a href="mailto:jthottan@redhat.com" target="_blank">jthottan@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"><span>
<p><br>
</p>
<br>
<div class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413m_3574131477938731546m_1748935029945796892moz-cite-prefix">On
19/11/16 21:47, Alexandr
Porunov wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>Unfortunately I
haven't this log file
but I have
'run-gluster-shared_storage.lo<wbr>g'
and it has errors I
don't know why.</div>
<div><br>
</div>
<div>Here is the content
of the
'run-gluster-shared_storage.lo<wbr>g':</div>
<div><br>
</div>
</div>
</blockquote>
<br>
</span> Make sure shared
storage is up and running
using "gluster volume status
gluster_shared_storage"<br>
<br>
May be the issue is related to
firewalld or iptables. Try it
after disabling them.<br>
<br>
--<br>
<br>
Jiffin<br>
<blockquote type="cite">
<div>
<div class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413m_3574131477938731546h5">
<div dir="ltr">
<div>
<div><font size="1">[2016-11-19
10:37:01.581737]
I [MSGID:
100030]
[glusterfsd.c:2454:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5
(args:
/usr/sbin/glusterfs
--volfile-server=127.0.0.1 --volfile-id=gluster_shared_st<wbr>orage
/run/gluster/shared_storage)</font></div>
<div><font size="1">[2016-11-19
10:37:01.641836]
I [MSGID:
101190]
[event-epoll.c:628:event_dispa<wbr>tch_epoll_worker]
0-epoll: Started
thread with
index 1</font></div>
<div><font size="1">[2016-11-19
10:37:01.642311]
E
[glusterfsd-mgmt.c:1586:mgmt_g<wbr>etspec_cbk]
0-glusterfs:
failed to get
the 'volume
file' from
server</font></div>
<div><font size="1">[2016-11-19
10:37:01.642340]
E
[glusterfsd-mgmt.c:1686:mgmt_g<wbr>etspec_cbk]
0-mgmt: failed
to fetch volume
file
(key:gluster_shared_storage)</font></div>
<div><font size="1">[2016-11-19
10:37:01.642592]
W
[glusterfsd.c:1327:cleanup_and<wbr>_exit]
(-->/lib64/libgfrpc.so.0(rpc_c<wbr>lnt_handle_reply+0x90)
[0x7f95cd309770]
-->/usr/sbin/glusterfs(mgmt_ge<wbr>tspec_cbk+0x536) [0x7f95cda3afc6]
-->/usr/sbin/glusterfs(cleanup<wbr>_and_exit+0x6b) [0x7f95cda34b4b] )
0-: received
signum (0),
shutting down</font></div>
<div><font size="1">[2016-11-19
10:37:01.642638]
I
[fuse-bridge.c:5793:fini]
0-fuse:
Unmounting
'/run/gluster/shared_storage'.</font></div>
<div><font size="1">[2016-11-19
10:37:18.798787]
I [MSGID:
100030]
[glusterfsd.c:2454:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5
(args:
/usr/sbin/glusterfs
--volfile-server=127.0.0.1 --volfile-id=gluster_shared_st<wbr>orage
/run/gluster/shared_storage)</font></div>
<div><font size="1">[2016-11-19
10:37:18.813011]
I [MSGID:
101190]
[event-epoll.c:628:event_dispa<wbr>tch_epoll_worker]
0-epoll: Started
thread with
index 1</font></div>
<div><font size="1">[2016-11-19
10:37:18.813363]
E
[glusterfsd-mgmt.c:1586:mgmt_g<wbr>etspec_cbk]
0-glusterfs:
failed to get
the 'volume
file' from
server</font></div>
<div><font size="1">[2016-11-19
10:37:18.813386]
E
[glusterfsd-mgmt.c:1686:mgmt_g<wbr>etspec_cbk]
0-mgmt: failed
to fetch volume
file
(key:gluster_shared_storage)</font></div>
<div><font size="1">[2016-11-19
10:37:18.813592]
W
[glusterfsd.c:1327:cleanup_and<wbr>_exit]
(-->/lib64/libgfrpc.so.0(rpc_c<wbr>lnt_handle_reply+0x90)
[0x7f96ba4c7770]
-->/usr/sbin/glusterfs(mgmt_ge<wbr>tspec_cbk+0x536) [0x7f96babf8fc6]
-->/usr/sbin/glusterfs(cleanup<wbr>_and_exit+0x6b) [0x7f96babf2b4b] )
0-: received
signum (0),
shutting down
</font></div>
<div><font size="1">[2016-11-19
10:37:18.813633]
I
[fuse-bridge.c:5793:fini]
0-fuse:
Unmounting
'/run/gluster/shared_storage'.
</font></div>
<div><font size="1">[2016-11-19
10:40:33.115685]
I [MSGID:
100030]
[glusterfsd.c:2454:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5
(args:
/usr/sbin/glusterfs
--volfile-server=127.0.0.1 --volfile-id=gluster_shared_st<wbr>orage
/run/gluster/shared_storage)
</font></div>
<div><font size="1">[2016-11-19
10:40:33.124218]
I [MSGID:
101190]
[event-epoll.c:628:event_dispa<wbr>tch_epoll_worker]
0-epoll: Started
thread with
index 1 </font></div>
<div><font size="1">[2016-11-19
10:40:33.124722]
E
[glusterfsd-mgmt.c:1586:mgmt_g<wbr>etspec_cbk]
0-glusterfs:
failed to get
the 'volume
file' from
server </font></div>
<div><font size="1">[2016-11-19
10:40:33.124738]
E
[glusterfsd-mgmt.c:1686:mgmt_g<wbr>etspec_cbk]
0-mgmt: failed
to fetch volume
file
(key:gluster_shared_storage)
</font></div>
<div><font size="1">[2016-11-19
10:40:33.124869]
W
[glusterfsd.c:1327:cleanup_and<wbr>_exit]
(-->/lib64/libgfrpc.so.0(rpc_c<wbr>lnt_handle_reply+0x90)
[0x7f23576a9770]
-->/usr/sbin/glusterfs(mgmt_ge<wbr>tspec_cbk+0x536) [0x7f2357ddafc6]
-->/usr/sbin/glusterfs(cleanup<wbr>_and_exit+0x6b) [0x7f2357dd4b4b] )
0-: received
signum (0),
shutting down
</font></div>
<div><font size="1">[2016-11-19
10:40:33.124896]
I
[fuse-bridge.c:5793:fini]
0-fuse:
Unmounting
'/run/gluster/shared_storage'.
</font></div>
<div><font size="1">[2016-11-19
10:44:36.029838]
I [MSGID:
100030]
[glusterfsd.c:2454:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5
(args:
/usr/sbin/glusterfs
--volfile-server=127.0.0.1 --volfile-id=gluster_shared_st<wbr>orage
/run/gluster/shared_storage)
</font></div>
<div><font size="1">[2016-11-19
10:44:36.043705]
I [MSGID:
101190]
[event-epoll.c:628:event_dispa<wbr>tch_epoll_worker]
0-epoll: Started
thread with
index 1 </font></div>
<div><font size="1">[2016-11-19
10:44:36.044082]
E
[glusterfsd-mgmt.c:1586:mgmt_g<wbr>etspec_cbk]
0-glusterfs:
failed to get
the 'volume
file' from
server </font></div>
<div><font size="1">[2016-11-19
10:44:36.044106]
E
[glusterfsd-mgmt.c:1686:mgmt_g<wbr>etspec_cbk]
0-mgmt: failed
to fetch volume
file
(key:gluster_shared_storage)
</font></div>
<div><font size="1">[2016-11-19
10:44:36.044302]
W
[glusterfsd.c:1327:cleanup_and<wbr>_exit]
(-->/lib64/libgfrpc.so.0(rpc_c<wbr>lnt_handle_reply+0x90)
[0x7fbd9dced770]
-->/usr/sbin/glusterfs(mgmt_ge<wbr>tspec_cbk+0x536) [0x7fbd9e41efc6]
-->/usr/sbin/glusterfs(cleanup<wbr>_and_exit+0x6b) [0x7fbd9e418b4b] )
0-: received
signum (0),
shutting down
</font></div>
<div><font size="1">[2016-11-19
10:44:36.044356]
I
[fuse-bridge.c:5793:fini]
0-fuse:
Unmounting
'/run/gluster/shared_storage'.<wbr> </font></div>
</div>
<div><font size="1"><br>
</font></div>
<div>
<div>Can you help me
to figure out what
I am doing wrong?</div>
<div><br>
</div>
<div>Sincerely,</div>
<div>Alexandr</div>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Sat, Nov 19, 2016 at
3:18 PM,
Saravanakumar
Arumugam <span dir="ltr"><<a href="mailto:sarumuga@redhat.com" target="_blank">sarumuga@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><span>
<br>
<br>
<div class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413m_3574131477938731546m_1748935029945796892m_-5622734281375389035moz-cite-prefix">On
11/19/2016
04:13 PM,
Alexandr
Porunov wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">It
still doesn't
work..
<div><br>
</div>
<div>I have
created that
dir:</div>
<div># mkdir
-p
/var/run/gluster/shared_storag<wbr>e<br>
</div>
<div><br>
</div>
<div>and then:</div>
<div>
<div># mount
-t glusterfs
127.0.0.1:gluster_shared_stora<wbr>ge
/var/run/gluster/shared_storag<wbr>e</div>
<div>Mount
failed. Please
check the log
file for more
details.</div>
</div>
<div><br>
</div>
<div>Where to
find a proper
file to read
logs? Because
"/var/log/glusterfs/" has a lot of log files.</div>
</div>
</blockquote>
<br>
</span> You can
find mount logs
like this :
"directory_mounted".log
inside
/var/log/glusterfs<br>
There is some
issue in your
setup...check
this log and
share it here.<span><br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>Sincerely,</div>
<div>Alexandr</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Sat, Nov 19,
2016 at 11:16
AM,
Saravanakumar
Arumugam <span dir="ltr"><<a class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413m_3574131477938731546m_1748935029945796892m_-5622734281375389035moz-txt-link-abbreviated" href="mailto:sarumuga@redhat.com" target="_blank">sarumuga@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span><br>
On 11/19/2016
01:39 AM,
Alexandr
Porunov wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hello,<br>
<br>
I try to
enable shared
storage for
Geo-Replication
but I am not
sure that I do
it properly.<br>
<br>
Here is what I
do:<br>
# gluster
volume set all
cluster.enable-shared-storage enable<br>
volume set:
success<br>
<br>
# mount -t
glusterfs
127.0.0.1:gluster_shared_stora<wbr>ge
/var/run/gluster/shared_storag<wbr>e<br>
ERROR: Mount
point does not
exist<br>
Please specify
a mount point<br>
Usage:<br>
man 8
/sbin/mount.glusterfs<br>
<br>
<br>
</blockquote>
</span> This
error means
/var/run/gluster/shared_storag<wbr>e
directory does
NOT exists.<br>
<br>
But, running
the command
(gluster
volume set all
cluster.enable-shared-storage enable)<br>
should carry
out the
mounting
automatically.
(so, there is
no need to
manually
mount).<br>
<br>
Check after
running
"gluster
volume set all
cluster.enable-shared-storage enable"<br>
1. gluster
volume info<br>
2.
glusterfs
process
started with
volfile-id as
gluster_shared_storage.<br>
<br>
Thanks,<br>
Saravana<br>
<br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</span></div>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413m_3574131477938731546m_1748935029945796892mimeAttachmentHeader"></fieldset>
<br>
</div>
</div>
<pre>______________________________<wbr>_________________
Gluster-users mailing list
<a class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413m_3574131477938731546m_1748935029945796892moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<a class="m_419028694318136339m_3748601482494747611m_6728370012781127316m_-6082414171146989909m_2414979832125924413m_3574131477938731546m_1748935029945796892moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman<wbr>/listinfo/gluster-users</a></pre>
</blockquote>
</div>
</blockquote></div>
</div>
</blockquote>
</div></div></div></blockquote></div>
</div>
</blockquote>
</div></div></div></blockquote></div>
</div>
</blockquote>
</div></div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>