<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hello.<br>
<br>
Tnx for your answer.<br>
<br>
I have installed libgfchangelog
in all nodes, it is probably a missing dependency on OpenSuSE for
the Gluster rpm (the libgfchangelog rpm was not installed
automatically).<br>
<br>
However I still have an issue with the changelog replication mode <br>
<br>
<pre wrap="">[2015-05-27 12:18:37.475994] I [monitor(monitor):222:distribute] <top>: slave bricks: [{'host': 'gluster3.marcobaldo.ch', 'dir': '/gluster_slave'}]
[2015-05-27 12:18:37.476838] I [monitor(monitor):238:distribute] <top>: worker specs: [('/gluster', '<a class="moz-txt-link-freetext" href="ssh://root@gluster3.marcobaldo.ch:gluster://localhost:volume1_slave">ssh://root@gluster3.marcobaldo.ch:gluster://localhost:volume1_slave</a>')]
[2015-05-27 12:18:37.477180] I [monitor(monitor):81:set_state] Monitor: new state: Initializing...
[2015-05-27 12:18:37.492440] I [monitor(monitor):129:monitor] Monitor: ------------------------------------------------------------
[2015-05-27 12:18:37.492871] I [monitor(monitor):130:monitor] Monitor: starting gsyncd worker
[2015-05-27 12:18:37.582231] I [gsyncd(/gluster):532:main_i] <top>: syncing: gluster://localhost:volume1 -> <a class="moz-txt-link-freetext" href="ssh://root@gluster3.marcobaldo.ch:gluster://localhost:volume1_slave">ssh://root@gluster3.marcobaldo.ch:gluster://localhost:volume1_slave</a>
[2015-05-27 12:18:41.440675] I [master(/gluster):58:gmaster_builder] <top>: setting up xsync change detection mode
[2015-05-27 12:18:41.441387] I [master(/gluster):357:__init__] _GMaster: using 'rsync' as the sync engine
[2015-05-27 12:18:41.443038] I [master(/gluster):58:gmaster_builder] <top>: setting up changelog change detection mode
[2015-05-27 12:18:41.443597] I [master(/gluster):357:__init__] _GMaster: using 'rsync' as the sync engine
[2015-05-27 12:18:41.445401] I [master(/gluster):1103:register] _GMaster: xsync temp directory: /var/run/gluster/volume1/ssh%3A%2F%2Froot%40192.168.178.233%3Agluster%3A%2F%2F127.0.0.1%3Avolume1_slave/1077eb0027f1f616115bcb74a330d1c2/xsync
[2015-05-27 12:18:51.463219] I [master(/gluster):682:fallback_xsync] _GMaster: falling back to xsync mode
[2015-05-27 12:18:51.478179] I [syncdutils(/gluster):192:finalize] <top>: exiting.
[2015-05-27 12:18:52.455018] I [monitor(monitor):157:monitor] Monitor: worker(/gluster) died in startup phase
[2015-05-27 12:18:52.455300] I [monitor(monitor):81:set_state] Monitor: new state: faulty
[2015-05-27 12:19:02.475231] I [monitor(monitor):129:monitor] Monitor: ------------------------------------------------------------
[2015-05-27 12:19:02.475580] I [monitor(monitor):130:monitor] Monitor: starting gsyncd worker
[2015-05-27 12:19:02.582557] I [gsyncd(/gluster):532:main_i] <top>: syncing: gluster://localhost:volume1 -> <a class="moz-txt-link-freetext" href="ssh://root@gluster3.marcobaldo.ch:gluster://localhost:volume1_slave">ssh://root@gluster3.marcobaldo.ch:gluster://localhost:volume1_slave</a>
[2015-05-27 12:19:05.739321] I [master(/gluster):58:gmaster_builder] <top>: setting up xsync change detection mode
[2015-05-27 12:19:05.739571] I [master(/gluster):357:__init__] _GMaster: using 'rsync' as the sync engine
[2015-05-27 12:19:05.740775] I [master(/gluster):58:gmaster_builder] <top>: setting up xsync change detection mode
[2015-05-27 12:19:05.741525] I [master(/gluster):357:__init__] _GMaster: using 'rsync' as the sync engine
[2015-05-27 12:19:05.744210] I [master(/gluster):1103:register] _GMaster: xsync temp directory: /var/run/gluster/volume1/ssh%3A%2F%2Froot%40192.168.178.233%3Agluster%3A%2F%2F127.0.0.1%3Avolume1_slave/1077eb0027f1f616115bcb74a330d1c2/xsync
[2015-05-27 12:19:05.744954] I [master(/gluster):1103:register] _GMaster: xsync temp directory: /var/run/gluster/volume1/ssh%3A%2F%2Froot%40192.168.178.233%3Agluster%3A%2F%2F127.0.0.1%3Avolume1_slave/1077eb0027f1f616115bcb74a330d1c2/xsync
[2015-05-27 12:19:05.752686] I [master(/gluster):421:crawlwrap] _GMaster: primary master with volume id 0952d1ce-f62c-40b6-809a-4e193db0f1f9 ...
[2015-05-27 12:19:05.780159] W [master(/gluster):327:get_initial_crawl_data] _GMaster: Creating new gconf.state_detail_file.
[2015-05-27 12:19:05.780477] I [master(/gluster):432:crawlwrap] _GMaster: crawl interval: 60 seconds
[2015-05-27 12:19:05.781547] I [master(<i class="moz-txt-slash"><span class="moz-txt-tag">/</span>gluster):912:update_worker_status] _GMaster: Creating new /var/lib/glusterd/geo-replication/volume1_gluster3.marcobaldo.ch_volume1_slave<span class="moz-txt-tag">/</span></i>_gluster.status
[2015-05-27 12:19:05.799737] I [master(/gluster):1124:crawl] _GMaster: starting hybrid crawl...
[2015-05-27 12:19:07.812315] I [master(/gluster):1133:crawl] _GMaster: processing xsync changelog /var/run/gluster/volume1/ssh%3A%2F%2Froot%40192.168.178.233%3Agluster%3A%2F%2F127.0.0.1%3Avolume1_slave/1077eb0027f1f616115bcb74a330d1c2/xsync/XSYNC-CHANGELOG.1432721945
[2015-05-27 12:20:02.796933] I [monitor(monitor):81:set_state] Monitor: new state: Stable
[2015-05-27 12:24:41.907495] I [master(/gluster):1133:crawl] _GMaster: processing xsync changelog /var/run/gluster/volume1/ssh%3A%2F%2Froot%40192.168.178.233%3Agluster%3A%2F%2F127.0.0.1%3Avolume1_slave/1077eb0027f1f616115bcb74a330d1c2/xsync/XSYNC-CHANGELOG.1432721948</pre>
<br>
With xsync it works (fallback)<br>
<br>
# gluster volume geo-replication volume1
gluster3.marcobaldo.ch::volume1_slave status<br>
<br>
MASTER NODE MASTER VOL MASTER BRICK
SLAVE STATUS CHECKPOINT
STATUS CRAWL STATUS <br>
-----------------------------------------------------------------------------------------------------------------------------------<br>
fs1 volume1 /gluster
gluster3.marcobaldo.ch::volume1_slave Active
N/A Hybrid Crawl <br>
fs2 volume1 /gluster
gluster3.marcobaldo.ch::volume1_slave Passive
N/A N/A <br>
<br>
<br>
The slave volume is created with the sequence<br>
<br>
gluster volume geo-replication volume1
gluster3.marcobaldo.ch::volume1_slave create<br>
gluster volume geo-replication volume1
gluster3.marcobaldo.ch::volume1_slave config change-detector
changelog<br>
gluster volume geo-replication volume1
gluster3.marcobaldo.ch::volume1_slave start<br>
gluster volume geo-replication volume1
gluster3.marcobaldo.ch::volume1_slave status<br>
<br>
And the status is<br>
<br>
Volume Name: volume1<br>
Type: Replicate<br>
Volume ID: 0952d1ce-f62c-40b6-809a-4e193db0f1f9<br>
Status: Started<br>
Number of Bricks: 1 x 2 = 2<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: gluster1.marcobaldo.ch:/gluster<br>
Brick2: gluster2.marcobaldo.ch:/gluster<br>
Options Reconfigured:<br>
nfs.disable: off<br>
geo-replication.indexing: on<br>
geo-replication.ignore-pid-check: on<br>
changelog.changelog: on<br>
<br>
Volume Name: volume1_slave<br>
Type: Distribute<br>
Volume ID: 95610eee-84c2-4ac0-8f0f-7531e942e77c<br>
Status: Started<br>
Number of Bricks: 1<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: gluster3.marcobaldo.ch:/gluster_slav<br>
<br>
I could not find a log file with usefull debugging information (on
gluster3.marcobaldo.ch maybe? Which one?)<br>
<br>
If this matters: gluster1 and gluster2 are 64 bit KVM VMs, gluster3
a 32 bit physical machine deemed to be a backup server (all are
up-to-date OpenSuSE 13.2).<br>
<br>
May I ask where I will find information to undertand why the
geo-replication worker fails, enters the faulty state and then it is
switched to xsync?<br>
<br>
Tnx<br>
<br>
Marco<br>
<br>
<div class="moz-cite-prefix">Il 26. 05. 15 08:21, Kotresh Hiremath
Ravishankar ha scritto:<br>
</div>
<blockquote
cite="mid:1845367453.3429251.1432621313209.JavaMail.zimbra@redhat.com"
type="cite">
<pre wrap="">Hi Marco,
'gf_changelog_register' is an API exposed from the shared library 'libgfchangelog.so'.
Please check whether 'libgfchangelog.so' is available to linker by using following command.
#ldconfig -p | grep libgfchangelog
If it is not found, please find where the libgfchangelog.so is installed and run ldconfig
on it.
e.g., If found at /usr/local/lib/libgfchangelog.so,
#ldconfig /usr/local/lib
After this, confirm whether the library is cached by using first command above and try restarting
geo-replication.
Let us know if the library is cached and still you face this issue.
Hope this helps!
Thanks and Regards,
Kotresh H R
----- Original Message -----
</pre>
<blockquote type="cite">
<pre wrap="">From: "Marco" <a class="moz-txt-link-rfc2396E" href="mailto:marco.brignoli@marcobaldo.ch"><marco.brignoli@marcobaldo.ch></a>
To: <a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
Sent: Tuesday, May 26, 2015 4:25:26 AM
Subject: [Gluster-users] AttributeError: python: undefined symbol: gf_changelog_register
Hello all.
I have an issue when I'm trying to populate a geo-replication volume:
[2015-05-25 23:59:26.666712] I [monitor(monitor):129:monitor] Monitor:
------------------------------------------------------------
[2015-05-25 23:59:26.667079] I [monitor(monitor):130:monitor] Monitor:
starting gsyncd worker
[2015-05-25 23:59:26.762124] I [gsyncd(/gluster):532:main_i] <top>:
syncing: gluster://localhost:volume1 ->
<a class="moz-txt-link-freetext" href="ssh://root@gluster3.marcobaldo.ch:gluster://localhost:volume1_slave">ssh://root@gluster3.marcobaldo.ch:gluster://localhost:volume1_slave</a>
[2015-05-25 23:59:29.611541] I [master(/gluster):58:gmaster_builder]
<top>: setting up xsync change detection mode
[2015-05-25 23:59:29.612349] I [master(/gluster):357:__init__] _GMaster:
using 'rsync' as the sync engine
[2015-05-25 23:59:29.613812] I [master(/gluster):58:gmaster_builder]
<top>: setting up changelog change detection mode
[2015-05-25 23:59:29.614294] I [master(/gluster):357:__init__] _GMaster:
using 'rsync' as the sync engine
[2015-05-25 23:59:29.616271] I [master(/gluster):1103:register]
_GMaster: xsync temp directory:
/var/run/gluster/volume1/ssh%3A%2F%2Froot%40192.168.178.233%3Agluster%3A%2F%2F127.0.0.1%3Avolume1_slave/1077eb0027f1f616115bcb74a330d1c2/xsync
[2015-05-25 23:59:29.648611] E
[syncdutils(/gluster):240:log_raise_exception] <top>: FAIL:
Traceback (most recent call last):
File "/usr/lib/glusterfs/python/syncdaemon/gsyncd.py", line 150, in main
main_i()
File "/usr/lib/glusterfs/python/syncdaemon/gsyncd.py", line 542, in main_i
local.service_loop(*[r for r in [remote] if r])
File "/usr/lib/glusterfs/python/syncdaemon/resource.py", line 1175, in
service_loop
g2.register()
File "/usr/lib/glusterfs/python/syncdaemon/master.py", line 1077, in
register
workdir, logfile, 9, 5)
File "/usr/lib/glusterfs/python/syncdaemon/resource.py", line 614, in
changelog_register
Changes.cl_register(cl_brick, cl_dir, cl_log, cl_level, retries)
File "/usr/lib/glusterfs/python/syncdaemon/libgfchangelog.py", line 23,
in cl_register
ret = cls._get_api('gf_changelog_register')(brick, path,
File "/usr/lib/glusterfs/python/syncdaemon/libgfchangelog.py", line
19, in _get_api
return getattr(cls.libgfc, call)
File "/usr/lib64/python2.7/ctypes/__init__.py", line 378, in __getattr__
func = self.__getitem__(name)
File "/usr/lib64/python2.7/ctypes/__init__.py", line 383, in __getitem__
func = self._FuncPtr((name_or_ordinal, self))
AttributeError: python: undefined symbol: gf_changelog_register
[2015-05-25 23:59:29.650513] I [syncdutils(/gluster):192:finalize]
<top>: exiting.
[2015-05-25 23:59:30.613435] I [monitor(monitor):157:monitor] Monitor:
worker(/gluster) died in startup phase
COMMANDS
************
# gluster volume geo-replication volume1
gluster3.marcobaldo.ch::volume1_slave start
Starting geo-replication session between volume1 &
gluster3.marcobaldo.ch::volume1_slave has been successful
# gluster volume geo-replication volume1
gluster3.marcobaldo.ch::volume1_slave status
MASTER NODE MASTER VOL MASTER BRICK
SLAVE STATUS CHECKPOINT
STATUS CRAWL STATUS
-------------------------------------------------------------------------------------------------------------------------------------------
fs2 volume1 /gluster
gluster3.marcobaldo.ch::volume1_slave Initializing...
N/A N/A
fs1 volume1 /gluster
gluster3.marcobaldo.ch::volume1_slave Initializing...
N/A N/A
and after a few seconds
# gluster volume geo-replication volume1
gluster3.marcobaldo.ch::volume1_slave status
MASTER NODE MASTER VOL MASTER BRICK
SLAVE STATUS CHECKPOINT STATUS
CRAWL STATUS
----------------------------------------------------------------------------------------------------------------------------------
fs2 volume1 /gluster
gluster3.marcobaldo.ch::volume1_slave faulty N/A
N/A
fs1 volume1 /gluster
gluster3.marcobaldo.ch::volume1_slave faulty N/A N/A
VOLUMES
**********
Volume Name: volume1
Type: Replicate
Volume ID: 0952d1ce-f62c-40b6-809a-4e193db0f1f9
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: gluster1.marcobaldo.ch:/gluster
Brick2: gluster2.marcobaldo.ch:/gluster
Options Reconfigured:
changelog.changelog: on
geo-replication.ignore-pid-check: on
geo-replication.indexing: on
nfs.disable: off
Volume Name: volume1_slave
Type: Distribute
Volume ID: b0b161d8-a642-4d41-808e-2bb076989f78
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: gluster3.marcobaldo.ch:/gluster_slave
VERSION
*********
# glusterd -V
glusterfs 3.5.2 built on *bleep*
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2013 Red Hat, Inc. <a class="moz-txt-link-rfc2396E" href="http://www.redhat.com/"><http://www.redhat.com/></a>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
It is licensed to you under your choice of the GNU Lesser
General Public License, version 3 or any later version (LGPLv3
or later), or the GNU General Public License, version 2 (GPLv2),
in all cases as published by the Free Software Foundation.
I'm running OpenSuSE 13.2 and I have installed Glusterfs from the
standard OpenSuSE repos. Currently I don't have any known problem with
"Replicate" volumes.
May I ask for your help? I have been googling but I could not find any
input.
Tnx in advance and have a nice day
Marco
_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a>
</pre>
</blockquote>
</blockquote>
<br>
</body>
</html>