<html><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px"><div id="yui_3_16_0_1_1442174602913_3459" dir="ltr" class=""><br class="" id="yui_3_16_0_1_1442174602913_6627">Hi Atin,</div><div id="yui_3_16_0_1_1442174602913_3459" dir="ltr" class=""><br id="yui_3_16_0_1_1442174602913_6630" class=""></div><div id="yui_3_16_0_1_1442174602913_3459" dir="ltr" class="">Looks like Humble is busy currently,</div><div id="yui_3_16_0_1_1442174602913_3459" dir="ltr" class=""><br id="yui_3_16_0_1_1442174602913_6634" class=""></div><div id="yui_3_16_0_1_1442174602913_3459" dir="ltr" class="">Could you share the workaround that you may know.</div><div id="yui_3_16_0_1_1442174602913_3459" dir="ltr" class=""><br id="yui_3_16_0_1_1442174602913_6638" class=""></div><div id="yui_3_16_0_1_1442174602913_3459" dir="ltr" class="">Thanks,</div><div id="yui_3_16_0_1_1442174602913_3459" dir="ltr" class="">-Tohru</div><div dir="ltr" id="yui_3_16_0_1_1442174602913_6642" class=""><br id="yui_3_16_0_1_1442174602913_6644" class=""></div> <br><div class="qtdSeparateBR"><br><br></div><div class="yahoo_quoted" style="display: block;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div dir="ltr"> <font size="2" face="Arial"> On Monday, September 7, 2015 9:43 PM, Atin Mukherjee <amukherj@redhat.com> wrote:<br> </font> </div> <br><br> <div class="y_msg_container">+ Humble<br clear="none"><br clear="none">Considering you had recently faced a similar problem, you could share<br clear="none">the work around.<br clear="none"><div class="yqt3480642397" id="yqtfd20588"><br clear="none">On 09/08/2015 09:15 AM, Tohru_Kao wrote:<br clear="none">> Hi all,<br clear="none">> <br clear="none">> This is regarding using Gluster 3.7.4 with GRE tunnel between 2 Ubuntu<br clear="none">> (14.04.3) VMs.<br clear="none">> <br clear="none">> ### Observation<br clear="none">> <br clear="none">> After Gluster Peer Probe success, Status returns few thing strange:<br clear="none">> <br clear="none">> #1: the State as "Accepted peer request (Connected/Disconnected)”.<br clear="none">> #2: IP address return is the Tunnel IP, not probed host IP.<br clear="none">> <br clear="none">> * Environments and GRE commands I applied are listed below.<br clear="none">> * GRE tunnel settings are done by<br clear="none">> referring <a shape="rect" href="http://ask.xmodulo.com/create-gre-tunnel-linux.html" target="_blank">http://ask.xmodulo.com/create-gre-tunnel-linux.html</a><br clear="none">> <br clear="none">> ### Questions<br clear="none">> <br clear="none">> Q1:<br clear="none">> Do I need to add/set additional parameters in glusterd.vol because of<br clear="none">> GRE ?<br clear="none">> <br clear="none">> Q2:<br clear="none">> Are my GRE tunnel command settings wrong ? or missing some commands?<br clear="none">> <br clear="none">> Any idea?<br clear="none">> <br clear="none">> Appreciate any comments or pointers.<br clear="none">> <br clear="none">> ### Note:<br clear="none">> * Peer Probe via external IPs works properly.<br clear="none">> <br clear="none">> Thank in Advance.<br clear="none">> -JaCoder<br clear="none">> <br clear="none">> ############## Environment and Commands ############## <br clear="none">> Environment:<br clear="none">> U1: external ip address: 172.16.213.128 internal network:<br clear="none">> 169.254.0.0/24<br clear="none">> U2: external ip address: 172.16.213.129 internal network:<br clear="none">> 169.254.1.0/24<br clear="none">> <br clear="none">> ### Output of ‘gluster peer probe’ and status<br clear="none">> <br clear="none">> On U1<br clear="none">> # gluster peer probe 169.254.1.1<br clear="none">> peer probe: success. <br clear="none">> <br clear="none">> # gluster peer status<br clear="none">> Number of Peers: 1<br clear="none">> <br clear="none">> Hostname: 169.254.1.1<br clear="none">> Uuid: b6519618-e3aa-4307-afce-8f3d0dae39fc<br clear="none">> State: Accepted peer request (Connected)<br clear="none">> ---<br clear="none">> On U2<br clear="none">> <br clear="none">> # gluster peer status<br clear="none">> Number of Peers: 1<br clear="none">> <br clear="none">> Hostname: 10.10.10.1<br clear="none">> Uuid: 2306591b-25d6-41cf-ba50-db30ef0687bb<br clear="none">> State: Accepted peer request (Disconnected)<br clear="none">> <br clear="none">> <br clear="none">> ### glusterd.vol Files<br clear="none">> On U1<br clear="none">> <br clear="none">> # cat /etc/glusterfs/glusterd.vol <br clear="none">> volume management<br clear="none">> type mgmt/glusterd<br clear="none">> option working-directory /var/lib/glusterd<br clear="none">> option transport.socket.bind-address 169.254.0.1<br clear="none">> option transport-type socket,rdma<br clear="none">> option transport.socket.keepalive-time 10<br clear="none">> option transport.socket.keepalive-interval 2<br clear="none">> option transport.socket.read-fail-log off<br clear="none">> option ping-timeout 30<br clear="none">> # option base-port 49152<br clear="none">> end-volume<br clear="none">> <br clear="none">> ---<br clear="none">> On U2<br clear="none">> <br clear="none">> # cat /etc/glusterfs/glusterd.vol <br clear="none">> volume management<br clear="none">> type mgmt/glusterd<br clear="none">> option working-directory /var/lib/glusterd<br clear="none">> option transport.socket.bind-address 169.254.1.1<br clear="none">> option transport-type socket,rdma<br clear="none">> option transport.socket.keepalive-time 10<br clear="none">> option transport.socket.keepalive-interval 2<br clear="none">> option transport.socket.read-fail-log off<br clear="none">> option ping-timeout 30<br clear="none">> # option base-port 49152<br clear="none">> end-volume<br clear="none">> <br clear="none">> ### Output of ‘ifconfig | inet'<br clear="none">> <br clear="none">> On U1<br clear="none">> # ifconfig | grep inet<br clear="none">> inet addr:172.16.213.128 Bcast:172.16.213.255 Mask:255.255.255.0<br clear="none">> inet addr:169.254.0.1 Bcast:169.254.0.255 Mask:255.255.255.0<br clear="none">> inet addr:127.0.0.1 Mask:255.0.0.0<br clear="none">> inet addr:10.10.10.1 P-t-P:10.10.10.1 Mask:255.255.255.0<br clear="none">> <br clear="none">> On U2<br clear="none">> # ifconfig | grep inet<br clear="none">> inet addr:172.16.213.129 Bcast:172.16.213.255 Mask:255.255.255.0<br clear="none">> inet addr:169.254.1.1 Bcast:169.254.1.255 Mask:255.255.255.0<br clear="none">> inet addr:127.0.0.1 Mask:255.0.0.0<br clear="none">> inet addr:10.10.10.2 P-t-P:10.10.10.2 Mask:255.255.255.0<br clear="none">> <br clear="none">> <br clear="none">> ### Applied GRE Tunnel Commands<br clear="none">> On U1<br clear="none">> <br clear="none">> modprobe ip_gre<br clear="none">> ip tunnel add test-gre mode gre remote 172.16.213.129<br clear="none">> local 172.16.213.128 ttl 255<br clear="none">> ip link set test-gre up<br clear="none">> ip addr add 10.10.10.1/24 dev test-gre<br clear="none">> ip route add 169.254.1.0/24 dev test-gre<br clear="none">> <br clear="none">> On U2<br clear="none">> <br clear="none">> modprobe ip_gre<br clear="none">> ip tunnel add test-gre mode gre remote 172.16.213.128<br clear="none">> local 172.16.213.129 ttl 255<br clear="none">> ip link set test-gre up<br clear="none">> ip addr add 10.10.10.2/24 dev test-gre<br clear="none">> ip route add 169.254.0.0/24 dev test-gre<br clear="none">> <br clear="none">> ### Output of 'ip route show'<br clear="none">> On U1<br clear="none">> <br clear="none">> # ip route show<br clear="none">> default via 172.16.213.2 dev eth0 <br clear="none">> 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.1 <br clear="none">> 169.254.0.0/24 dev ux-br0 proto kernel scope link src 169.254.0.1 <br clear="none">> 169.254.1.0/24 dev test-gre scope link <br clear="none">> 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.128 <br clear="none">> <br clear="none">> # ping 169.254.1.1<br clear="none">> PING 169.254.1.1 (169.254.1.1) 56(84) bytes of data.<br clear="none">> 64 bytes from 169.254.1.1: icmp_seq=1 ttl=64 time=0.340 ms<br clear="none">> 64 bytes from 169.254.1.1: icmp_seq=2 ttl=64 time=0.305 ms<br clear="none">> <br clear="none">> ---<br clear="none">> On U2<br clear="none">> <br clear="none">> # ip route show<br clear="none">> default via 172.16.213.2 dev eth0 <br clear="none">> 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.2 <br clear="none">> 169.254.0.0/24 dev test-gre scope link <br clear="none">> 169.254.1.0/24 dev ux-br0 proto kernel scope link src 169.254.1.1 <br clear="none">> 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.100<br clear="none">> <br clear="none">> # ping 169.254.0.1<br clear="none">> PING 169.254.0.1 (169.254.0.1) 56(84) bytes of data.<br clear="none">> 64 bytes from 169.254.0.1: icmp_seq=1 ttl=64 time=0.720 ms<br clear="none">> 64 bytes from 169.254.0.1: icmp_seq=2 ttl=64 time=0.298 ms<br clear="none">> <br clear="none">> <br clear="none">> === End ===</div><br clear="none">> <br clear="none">> <br clear="none">> <br clear="none">> _______________________________________________<br clear="none">> Gluster-users mailing list<br clear="none">> <a shape="rect" ymailto="mailto:Gluster-users@gluster.org" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br clear="none">> <a shape="rect" href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><div class="yqt3480642397" id="yqtfd39984"><br clear="none">> <br clear="none"></div><br><br></div> </div> </div> </div></div></body></html>