<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Following command should be run after the Geo-rep create push-pem
    step<br>
    <br>
    /usr/libexec/glusterfs/set_geo_rep_pem_keys.sh geoaccount gv0 gv0<br>
    <br>
    Please run that command in any one of the slave node and observe the
    Geo-replication status.<br>
    <br>
    Admin guide:
<a class="moz-txt-link-freetext" href="http://gluster.readthedocs.io/en/latest/Administrator%20Guide/Geo%20Replication/">http://gluster.readthedocs.io/en/latest/Administrator%20Guide/Geo%20Replication/</a><br>
    <br>
    <pre class="moz-signature" cols="72">regards
Aravinda</pre>
    <div class="moz-cite-prefix">On 11/26/2016 02:33 AM, Alexandr
      Porunov wrote:<br>
    </div>
    <blockquote
cite="mid:CAB-_WnHp4g68dx2v_dSXNhLHStH0pJwACreLqbPhZiT-iK-k2Q@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div>Hello,<br>
        </div>
        <div><br>
        </div>
        <div>I want to create geo replication between two volumes.
          Volumes works just fine. But geo-replication doesn't work at
          all.</div>
        <div><br>
        </div>
        <div>My master volume nodes are:</div>
        <div>192.168.0.120</div>
        <div>192.168.0.121<br>
        </div>
        <div>192.168.0.122<br>
        </div>
        <div><br>
        </div>
        <div>My slave volume nodes are:</div>
        <div>192.168.0.123<br>
        </div>
        <div>192.168.0.124<br>
        </div>
        <div>192.168.0.125<br>
        </div>
        <div><br>
        </div>
        <div>My OS is: CentOS 7</div>
        <div>I am running GlusterFS 3.8.5</div>
        <div><br>
        </div>
        <div>Here is the status of geo-replication session:</div>
        <div># gluster volume geo-replication gv0
          <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a> status</div>
        <div> </div>
        <div>MASTER NODE      MASTER VOL    MASTER BRICK        SLAVE
          USER    SLAVE                            SLAVE NODE      
          STATUS    CRAWL STATUS       LAST_SYNCED                  </div>
        <div>------------------------------------------------------------------------------------------------------------------------------------------------------------------</div>
        <div>192.168.0.120    gv0           /data/brick1/gv0  
           geoaccount    <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a>    192.168.0.123
             Active    Changelog Crawl    2016-11-25 22:25:12          </div>
        <div>192.168.0.121    gv0           /data/brick1/gv0  
           geoaccount    <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a>    N/A          
             Faulty    N/A                N/A                          </div>
        <div>192.168.0.122    gv0           /data/brick1/gv0  
           geoaccount    <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a>    N/A          
             Faulty    N/A                N/A </div>
        <div><br>
        </div>
        <div><br>
        </div>
        <div>I don't understand why it doesn't work. Here are
          interesting log files from the master node (192.168.0.120):</div>
        <div>/var/log/glusterfs/etc-glusterfs-glusterd.vol.log - <a
            moz-do-not-send="true"
            href="http://paste.openstack.org/show/590503/">http://paste.openstack.org/show/590503/</a></div>
        <div><br>
        </div>
        <div>/var/log/glusterfs/mnt.log - <a moz-do-not-send="true"
            href="http://paste.openstack.org/show/590504/">http://paste.openstack.org/show/590504/</a></div>
        <div><br>
        </div>
        <div>/var/log/glusterfs/run-gluster-shared_storage.log - <a
            moz-do-not-send="true"
            href="http://paste.openstack.org/show/590505/">http://paste.openstack.org/show/590505/</a></div>
        <div><br>
        </div>
        <div>/var/log/glusterfs/geo-replication/gv0/ssh%3A%2F%2Fgeoaccount%40192.168.0.123%3Agluster%3A%2F%2F127.0.0.1%3Agv0.log
          - <a moz-do-not-send="true"
            href="http://paste.openstack.org/show/590506/">http://paste.openstack.org/show/590506/</a></div>
        <div><br>
        </div>
        <div>Here is a log file from the slave node (192.168.0.123):</div>
        <div>/var/log/glusterfs/geo-replication-slaves/5afe64e3-d4e9-452b-a9cf-10674e052616\:gluster%3A%2F%2F127.0.0.1%3Agv0.gluster.log
           - <a moz-do-not-send="true"
            href="http://paste.openstack.org/show/590507/">http://paste.openstack.org/show/590507/</a></div>
        <div><br>
        </div>
        <div>Here is how I have created a session:</div>
        <div>On slave nodes:</div>
        <div>
          <div>useradd geoaccount</div>
          <div>groupadd geogroup</div>
          <div>usermod -a -G geogroup geoaccount</div>
          <div>usermod -a -G geogroup root</div>
          <div>passwd geoaccount</div>
        </div>
        <div>
          <div>mkdir -p /var/mountbroker-root</div>
          <div>chown root:root -R /var/mountbroker-root</div>
          <div>chmod 0711 -R /var/mountbroker-root</div>
          <div>chown root:geogroup -R
            /var/lib/glusterd/geo-replication/*</div>
        </div>
        <div>chmod g=rwx,u=rwx,o-rwx -R
          /var/lib/glusterd/geo-replication/*<br>
        </div>
        <div><br>
        </div>
        <div>On the slave (192.168.0.123):</div>
        <div>
          <div>gluster system:: execute mountbroker opt mountbroker-root
            /var/mountbroker-root</div>
          <div>gluster system:: execute mountbroker opt
            geo-replication-log-group geogroup</div>
          <div>gluster system:: execute mountbroker opt
            rpc-auth-allow-insecure on</div>
        </div>
        <div>gluster system:: execute mountbroker user geoaccount gv0<br>
        </div>
        <div>/usr/libexec/glusterfs/set_geo_rep_pem_keys.sh geoaccount
          gv0 gv0<br>
        </div>
        <div>gluster volume set all cluster.enable-shared-storage enable<br>
        </div>
        <div><br>
        </div>
        <div>Then I have restarted all the slaves:</div>
        <div>systemctl restart glusterd<br>
        </div>
        <div><br>
        </div>
        <div>On the master node (192.168.0.120):</div>
        <div>ssh-keygen<br>
        </div>
        <div>ssh-copy-id <a moz-do-not-send="true"
            href="mailto:geoaccount@192.168.0.123">geoaccount@192.168.0.123</a><br>
        </div>
        <div>gluster system:: execute gsec_create container</div>
        <div>gluster volume set all cluster.enable-shared-storage enable<br>
        </div>
        <div>gluster volume geo-replication gv0
          <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a> create ssh-port 22 push-pem<br>
        </div>
        <div>
          <div>gluster volume geo-replication gv0
            <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a> config remote-gsyncd
            /usr/libexec/glusterfs/gsyncd</div>
          <div>gluster volume geo-replication gv0
            <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a> config use-meta-volume true</div>
          <div>gluster volume geo-replication gv0
            <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a> config sync-jobs 3</div>
          <div>gluster volume geo-replication gv0
            <a class="moz-txt-link-abbreviated" href="mailto:geoaccount@192.168.0.123::gv0">geoaccount@192.168.0.123::gv0</a> start</div>
        </div>
        <div><br>
        </div>
        <div>Does somebody know what is wrong with this installation? I
          tried to install geo-replication for several times but without
          success.. Please help me</div>
        <div><br>
        </div>
        <div>Sincerely,</div>
        <div>Alexandr</div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  </body>
</html>