<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Cool. We will work on resolving Ubuntu packaging issues. Thanks for
reporting.<br>
<br>
Data sync always happens via Gluster Mount, Connecting Slave node is
just for distributing the load. Each Master nodes randomly connect
to available Slave nodes but sync happens via mount.(It is not data
copy Brick to Brick)<br>
Since Master has 4 nodes and Slave has 2 nodes. 2 Master nodes are
connected to 1 Slave node.<br>
<br>
<pre class="moz-signature" cols="72">regards
Aravinda</pre>
<div class="moz-cite-prefix">On 10/07/2015 05:43 AM, Wade
Fitzpatrick wrote:<br>
</div>
<blockquote cite="mid:561463C1.8030503@ladbrokes.com.au" type="cite">
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
So I ran the following on palace and madonna and it appears to be
syncing properly now<br>
<tt><br>
</tt><tt>root@palace:~# sed -i -e
's:/usr/libexec/glusterfs/gsyncd:/usr/lib/x86_64-linux-gnu/glusterfs/gsyncd:'
.ssh/authorized_keys</tt><tt><br>
</tt><tt><br>
</tt><tt>root@james:~/georepsetup# gluster volume geo-replication
status</tt><tt><br>
</tt><tt><br>
</tt><tt>MASTER NODE MASTER VOL MASTER
BRICK SLAVE USER SLAVE
SLAVE NODE STATUS CRAWL STATUS LAST_SYNCED</tt><tt><br>
</tt><tt>------------------------------------------------------------------------------------------------------------------------------------------------------</tt><tt><br>
</tt><tt>james static
/data/gluster1/static/brick1 root <a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="ssh://palace::static"><a class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a></a> palace
Active Hybrid Crawl N/A</tt><tt><br>
</tt><tt><tt>cupid static
/data/gluster1/static/brick2 root <a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="ssh://palace::static"><a class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a></a>
madonna Passive N/A N/A</tt><tt><br>
</tt>hilton static
/data/gluster1/static/brick3 root <a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="ssh://palace::static"><a class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a></a> palace
Passive N/A N/A</tt><tt><br>
</tt><tt>present static
/data/gluster1/static/brick4 root <a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="ssh://palace::static"><a class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a></a>
madonna Passive N/A N/A</tt><tt><br>
</tt><br>
<br>
I am still a little confused by the SLAVE column though - should
"palace" in that column really be an A record such as
"gluster-remote" that has 2 addresses (for both palace and
madonna)?<br>
<br>
<div class="moz-cite-prefix">On 7/10/2015 8:10 am, Wade
Fitzpatrick wrote:<br>
</div>
<blockquote cite="mid:561446F2.9090207@ladbrokes.com.au"
type="cite"><br>
<br>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<br>
<br>
<br>
Thanks for the response, it looks like the problem is<br>
<br>
<br>
<br>
[2015-10-06 19:08:49.547874] E<br>
[resource(/data/gluster1/static/brick1):222:errlog] Popen:
command<br>
"ssh -oPasswordAuthentication=no -oStrictHostKeyChecking=no -i<br>
/var/lib/glusterd/geo-replication/secret.pem
-oControlMaster=auto -S<br>
/tmp/gsyncd-aux-ssh-RX3NRr/eb9c0906d6265193f403278fc1489309.sock<br>
root@palace /nonexistent/gsyncd --session-owner<br>
3f9f810d-a988-4914-a5ca-5bd7b251a273 -N --listen --timeout 120<br>
gluster://localhost:static" returned with 127, saying:<br>
<br>
[2015-10-06 19:08:49.547976] E<br>
[resource(/data/gluster1/static/brick1):226:logerr] Popen:
ssh><br>
This system is monitored and logged. Any unauthorized usage will
be<br>
prosecuted.<br>
<br>
[2015-10-06 19:08:49.548062] E<br>
[resource(/data/gluster1/static/brick1):226:logerr] Popen:
ssh><br>
bash: /usr/libexec/glusterfs/gsyncd: No such file or directory<br>
<br>
<div class="moz-signature moz-quoted-signature"><br>
<style type="text/css"> body {font-family: sans-serif;}</style><br>
<br>
All servers are Ubuntu 15.04 running glusterfs 3.7.4 built on
Sep <br>
1 2015 12:08:58 but /usr/libexec/glusterfs does not exist so
is<br>
this a packaging error?<br>
<br>
<br>
<br>
</div>
<br>
<div class="moz-cite-prefix">On 6/10/2015 6:11 pm, Aravinda
wrote:<br>
<br>
</div>
<br>
<blockquote cite="mid:5613823E.6060209@redhat.com" type="cite"><br>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<br>
Please share the tracebacks/errors from the logs(Master nodes)<br>
/var/log/glusterfs/geo-replication/static/*.log<br>
<br>
<pre class="moz-signature moz-quoted-signature" cols="72">regards
Aravinda</pre>
<br>
<div class="moz-cite-prefix">On 10/06/2015 01:19 PM, Wade<br>
Fitzpatrick wrote:<br>
<br>
</div>
<br>
<blockquote cite="mid:56137D1A.2030803@ladbrokes.com.au"
type="cite"><br>
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
<br>
I am trying to set up geo-replication of a striped-replicate<br>
volume. I used <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://github.com/aravindavk/georepsetup">https://github.com/aravindavk/georepsetup</a><br>
to configure the replication.<br>
<br>
<br>
<br>
root@james:~# gluster volume info<br>
<br>
<br>
<br>
Volume Name: static<br>
<br>
Type: Striped-Replicate<br>
<br>
Volume ID: 3f9f810d-a988-4914-a5ca-5bd7b251a273<br>
<br>
Status: Started<br>
<br>
Number of Bricks: 1 x 2 x 2 = 4<br>
<br>
Transport-type: tcp<br>
<br>
Bricks:<br>
<br>
Brick1: james:/data/gluster1/static/brick1<br>
<br>
Brick2: cupid:/data/gluster1/static/brick2<br>
<br>
Brick3: hilton:/data/gluster1/static/brick3<br>
<br>
Brick4: present:/data/gluster1/static/brick4<br>
<br>
Options Reconfigured:<br>
<br>
changelog.changelog: on<br>
<br>
geo-replication.ignore-pid-check: on<br>
<br>
geo-replication.indexing: on<br>
<br>
performance.readdir-ahead: on<br>
<br>
<br>
<br>
root@james:~# gluster volume geo-replication status<br>
<br>
<br>
<br>
MASTER NODE MASTER VOL MASTER BRICK <br>
SLAVE USER SLAVE SLAVE NODE
STATUS <br>
CRAWL STATUS LAST_SYNCED<br>
<br>
------------------------------------------------------------------------------------------------------------------------------------------------------<br>
<br>
james static /data/gluster1/static/brick1 <br>
root <a moz-do-not-send="true"
class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a> <br>
<br>
N/A Created N/A N/A<br>
<br>
cupid static /data/gluster1/static/brick2 <br>
root <a moz-do-not-send="true"
class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a> <br>
<br>
N/A Created N/A N/A<br>
<br>
hilton static /data/gluster1/static/brick3 <br>
root <a moz-do-not-send="true"
class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a> <br>
<br>
N/A Created N/A N/A<br>
<br>
present static /data/gluster1/static/brick4 <br>
root <a moz-do-not-send="true"
class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a> <br>
<br>
N/A Created N/A N/A<br>
<br>
<br>
<br>
So of the 4 bricks, data is striped over brick1 and brick3,
also<br>
brick1=brick2 is a mirror and brick3=brick4 is a mirror.<br>
Therefore I have no need to geo-replicate bricks 2 and 4.<br>
<br>
<br>
<br>
At the other site, palace and madonna form a stripe volume
(no<br>
replication):<br>
<br>
<br>
<br>
root@palace:~# gluster volume info<br>
<br>
<br>
<br>
Volume Name: static<br>
<br>
Type: Stripe<br>
<br>
Volume ID: 0e91c6f2-3499-4fc4-9630-9da8b7f57db5<br>
<br>
Status: Started<br>
<br>
Number of Bricks: 1 x 2 = 2<br>
<br>
Transport-type: tcp<br>
<br>
Bricks:<br>
<br>
Brick1: palace:/data/gluster1/static/brick1<br>
<br>
Brick2: madonna:/data/gluster1/static/brick2<br>
<br>
Options Reconfigured:<br>
<br>
performance.readdir-ahead: on<br>
<br>
<br>
<br>
However, when I try to start geo-replication, it fails as
below.<br>
<br>
<br>
<br>
root@james:~# gluster volume geo-replication static <a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="ssh://palace::static"><a class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a></a> start<br>
<br>
Starting geo-replication session between static & <a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="ssh://palace::static"><a class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a></a> has
been<br>
successful<br>
<br>
root@james:~# gluster volume geo-replication status<br>
<br>
<br>
<br>
MASTER NODE MASTER VOL MASTER BRICK <br>
SLAVE USER SLAVE SLAVE NODE
STATUS <br>
CRAWL STATUS LAST_SYNCED<br>
<br>
-----------------------------------------------------------------------------------------------------------------------------------------------------<br>
<br>
james static /data/gluster1/static/brick1 <br>
root <a moz-do-not-send="true"
class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a> <br>
<br>
N/A Faulty N/A N/A<br>
<br>
cupid static /data/gluster1/static/brick2 <br>
root <a moz-do-not-send="true"
class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a> <br>
<br>
N/A Faulty N/A N/A<br>
<br>
hilton static /data/gluster1/static/brick3 <br>
root <a moz-do-not-send="true"
class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a> <br>
<br>
N/A Faulty N/A N/A<br>
<br>
present static /data/gluster1/static/brick4 <br>
root <a moz-do-not-send="true"
class="moz-txt-link-freetext" href="ssh://palace::static">ssh://palace::static</a> <br>
<br>
N/A Faulty N/A N/A<br>
<br>
<br>
<br>
<br>
<br>
What should I do to set this up properly so that<br>
james:/data/gluster1/static/brick1 gets replicated to<br>
palace:/data/gluster1/static/brick1 ; and<br>
hilton:/data/gluster1/static/brick3 gets replicated to<br>
madonna:/data/gluster1/static/brick2 ???<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<div class="moz-signature moz-quoted-signature">-- <br>
<br>
<style type="text/css"> body {font-family: sans-serif;}</style></div>
<br>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<br>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
<br>
</blockquote>
<br>
<br>
<br>
</blockquote>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
</blockquote>
<br>
<br>
<div class="moz-signature">-- <br>
<style type="text/css"> body {font-family: sans-serif;}</style></div>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</body>
</html>