<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Hi All,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I am setting up a new Gluster environment between 2 datacenters and Geo-Replication is Faulty.<o:p></o:p></p>
<p class="MsoNormal">Here is the setup:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Datacenter A<o:p></o:p></p>
<p class="MsoNormal">2 nodes:<o:p></o:p></p>
<p class="MsoNormal">-master_node1<o:p></o:p></p>
<p class="MsoNormal">-master_node2<o:p></o:p></p>
<p class="MsoNormal">1 brick per node (replica)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Datacenter B<o:p></o:p></p>
<p class="MsoNormal">2 nodes:<o:p></o:p></p>
<p class="MsoNormal">-slave_node1<o:p></o:p></p>
<p class="MsoNormal">-slave_node2<o:p></o:p></p>
<p class="MsoNormal">1 brick per node (replica)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">OS: CentOS 6.6<o:p></o:p></p>
<p class="MsoNormal">Gluster: glusterfs 3.6.1 built on Nov 7 2014 15:15:48<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Bricks setup properly without any error.<o:p></o:p></p>
<p class="MsoNormal">Passwordless authentication between node 1 of datacenter 1 and node 1 of datacenter 2 setup successfully.<o:p></o:p></p>
<p class="MsoNormal">Geo-Replication setup properly as below:<o:p></o:p></p>
<p class="MsoNormal">gluster system:: execute gsec_create<o:p></o:p></p>
<p class="MsoNormal">gluster volume geo-replication master_volume root@slave_node1::slave_volume create push-pem<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I can start successfully the geo-replication:<o:p></o:p></p>
<p class="MsoNormal">gluster volume geo-replication master_volume root@slave_node1::slave_volume start<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">But when checking the status, I have the following:<o:p></o:p></p>
<p class="MsoNormal">gluster volume geo-replication master_volume root@slave_node1::slave_volume status<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">MASTER NODE MASTER VOL MASTER BRICK SLAVE STATUS CHECKPOINT STATUS CRAWL STATUS<o:p></o:p></p>
<p class="MsoNormal">------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">master_node1 master_volume /master_brick1 root@slave_node1::slave_volume faulty N/A N/A<o:p></o:p></p>
<p class="MsoNormal">master_node2 master_volume /master_brick2 root@slave_node1::slave_volume faulty N/A N/A<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">From the master node 1, I run geo-replication logs in debug mode and I found the following:<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.247694] D [monitor(monitor):280:distribute] <top>: master bricks: [{'host': 'master_node1', 'dir': '/master_brick1'}, {'host': 'master_node2', 'dir': '/master_brick2'}]<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.248047] D [monitor(monitor):286:distribute] <top>: slave SSH gateway: root@slave_node1<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.721532] I [monitor(monitor):296:distribute] <top>: slave bricks: [{'host': 'slave_node1', 'dir': '/slave_brick1'}, {'host': 'slave_node2', 'dir': '/ slave_brick2'}]<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.729722] I [monitor(monitor):316:distribute] <top>: worker specs: [('/master_brick1', 'ssh://root@slave_node2:gluster://localhost:slave_volume')]<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.730287] I [monitor(monitor):109:set_state] Monitor: new state: Initializing...<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.731513] I [monitor(monitor):163:monitor] Monitor: ------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.731647] I [monitor(monitor):164:monitor] Monitor: starting gsyncd worker<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.830656] D [gsyncd(agent):627:main_i] <top>: rpc_fd: '7,10,9,8'<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.831882] I [monitor(monitor):214:monitor] Monitor: worker(/master_brick1) died before establishing connection<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.831476] I [changelogagent(agent):72:__init__] ChangelogAgent: Agent listining...<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.832392] I [repce(agent):92:service_loop] RepceServer: terminating on reaching EOF.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.832693] I [syncdutils(agent):214:finalize] <top>: exiting.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:29.834060] I [monitor(monitor):109:set_state] Monitor: new state: faulty<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:39.846858] I [monitor(monitor):163:monitor] Monitor: ------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:39.847105] I [monitor(monitor):164:monitor] Monitor: starting gsyncd worker<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:39.941967] D [gsyncd(agent):627:main_i] <top>: rpc_fd: '7,10,9,8'<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:39.942630] I [changelogagent(agent):72:__init__] ChangelogAgent: Agent listining...<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:39.945791] I [repce(agent):92:service_loop] RepceServer: terminating on reaching EOF.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:39.945941] I [syncdutils(agent):214:finalize] <top>: exiting.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:39.945904] I [monitor(monitor):214:monitor] Monitor: worker(/master_brick1) died before establishing connection<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:49.959361] I [monitor(monitor):163:monitor] Monitor: ------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:49.959599] I [monitor(monitor):164:monitor] Monitor: starting gsyncd worker<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:50.56200] D [gsyncd(agent):627:main_i] <top>: rpc_fd: '7,10,9,8'<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:50.56809] I [changelogagent(agent):72:__init__] ChangelogAgent: Agent listining...<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:50.58903] I [repce(agent):92:service_loop] RepceServer: terminating on reaching EOF.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:50.59078] I [syncdutils(agent):214:finalize] <top>: exiting.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:33:50.59039] I [monitor(monitor):214:monitor] Monitor: worker(/master_brick1) died before establishing connection<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:00.72674] I [monitor(monitor):163:monitor] Monitor: ------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:00.72926] I [monitor(monitor):164:monitor] Monitor: starting gsyncd worker<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:00.169071] D [gsyncd(agent):627:main_i] <top>: rpc_fd: '7,10,9,8'<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:00.169931] I [changelogagent(agent):72:__init__] ChangelogAgent: Agent listining...<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:00.170466] I [repce(agent):92:service_loop] RepceServer: terminating on reaching EOF.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:00.170526] I [monitor(monitor):214:monitor] Monitor: worker(/master_brick1) died before establishing connection<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:00.170938] I [syncdutils(agent):214:finalize] <top>: exiting.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:10.183361] I [monitor(monitor):163:monitor] Monitor: ------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:10.183614] I [monitor(monitor):164:monitor] Monitor: starting gsyncd worker<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:10.278914] D [monitor(monitor):217:monitor] Monitor: worker(/master_brick1) connected<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:10.279994] I [monitor(monitor):222:monitor] Monitor: worker(/master_brick1) died in startup phase<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:10.282217] D [gsyncd(agent):627:main_i] <top>: rpc_fd: '7,10,9,8'<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:10.282943] I [repce(agent):92:service_loop] RepceServer: terminating on reaching EOF.<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:10.283098] I [changelogagent(agent):72:__init__] ChangelogAgent: Agent listining...<o:p></o:p></p>
<p class="MsoNormal">[2015-01-26 15:34:10.283303] I [syncdutils(agent):214:finalize] <top>: exiting.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Any idea how to solve this issue?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thank you<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">PM<o:p></o:p></p>
</div>
<br>
<hr>
<h5><font color="gray">This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email
and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from
Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses.
<h5></h5>
</font></h5>
</body>
</html>