<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style></head>
<body class='hmmessage'><div dir='ltr'>Hi,<br><br>Replying to the gluster-users list with a solution to this problem.<br><br>Our VMs are under 4 different Azure subscriptions in separate virtual networks.<br>VMs under these subscriptions are unable to ping each other, <br>thus unable to be a part of a Gluster cluster or be a Gluster client.<br><br>Mr. Tom Wu has written a Powershell script to connect Azure virtual<br>networks under different Azure subscriptions. <br><br>https://tombwu.wordpress.com/2015/07/02/build-complex-cross-azure-subscription-windows-lab-by-using-azure-site-to-site-vpn/<br><br>This solved my problem completely. The throughput to the Glusterfs client is approx. 100 Mbps<br>with the basic Azure VPN gateway. There is a high performance VPN gateway but it costs about 8¤ per day.<br><br>One thing that was missing from Tom's blog post was how the Azure Powershell authentication is done.<br>This needs to be set in Azure Powershell session with Get-AzurePublishSettingsFile and Import-AzurePublishSettingsFile.<br><br>--<br>Aki<br><br><br><div><hr id="stopSpelling">From: ak-su@outlook.com<br>To: gluster-users@gluster.org<br>Subject: glusterfs on Microsoft Azure?<br>Date: Thu, 24 Sep 2015 09:51:18 +0000<br><br>
<style><!--
.ExternalClass .ecxhmmessage P {
padding:0px;
}
.ExternalClass body.ecxhmmessage {
font-size:12pt;
font-family:Calibri;
}
--></style>
<div dir="ltr">Hi,<br><br>I was trying to setup glusterfs 3.7.4-2<span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_0"></span> on CentOS 6.7 on Microsoft Azure.<br>We are fortunate to receive service from Microsoft Bizspark program for startups.<br>Unfortunately, we are forced to run the virtual machines on separate Azure accounts.<br>This in turn <span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_19"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_18"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_17"></span>causes the VM's not being able to ping each other.<br><br>Reading the gluster <span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_27"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_26"></span>documentation at <a href="http://gluster.readthedocs.org/en/latest/Install-Guide/Configure/" target="_blank">http://gluster.readthedocs.org/en/latest/Install-Guide/Configure/</a><br>it says "For the Gluster to communicate within a cluster either the firewalls
have to be turned off or enable communication for each server."<br><br>In my case this is impossible because the VM's under different Azure accounts are unable to<br>ping each other. This restriction is a design choice Microsoft has made<span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_63"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_62"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_61"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_60"></span>.<span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_64"></span> The needed glusterfs <br>service ports are open between the VM's.<span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_70"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_69"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_68"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_67"></span><br><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_66"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_65"></span><br><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_59"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_58"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_57"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_56"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_55"></span>What could be a remedy to this problem?<span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_54"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_53"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_52"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_51"></span><br><br>Here's detailed information about my setup:<br><br>(on hostA)<br># gluster peer status<br>Number of Peers: 1<br><br>Hostname: hostB.domain<br>Uuid: 7e468940-97e5-4595-a835-5eeedae07770<br>State: Peer in Cluster (Connected)<br><br>(on hostB)<br># gluster peer status<br>Number of Peers: 1<br><br>Hostname: hostA.domain<br>Uuid: 1a5a62a8-4e08-4f06-9f5d-e159a2f7e5c9<br>State: Peer in Cluster (Connected)<br><br>(on hostA)<br># gluster volume create home replica 2 hostA.domain:/data/home/gv0 hostB.domain:/data/home/gv0<br>volume create: home: failed: Host hostA.domain is not in 'Peer in Cluster' state<br><br>(/var/log/glusterfs/etc-glusterfs-glusterd.vol.log)<br>[2015-09-22 07:54:36.374674] I [MSGID: 106487] [glusterd-handler.c:1402:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req<br>[2015-09-22 07:59:08.515867] E [MSGID: 106452] [glusterd-utils.c:5569:glusterd_new_brick_validate] 0-management: Host hostA.domain is not in 'Peer in Cluster' state<br>[2015-09-22 07:59:08.515896] E [MSGID: 106536] [glusterd-volume-ops.c:1273:glusterd_op_stage_create_volume] 0-management: Host hostA.domain is not in 'Peer in Cluster' state<br>[2015-09-22 07:59:08.515908] E [MSGID: 106301] [glusterd-syncop.c:1274:gd_stage_op_phase] 0-management: Staging of operation 'Volume Create' failed on localhost : Host hostA.domain is not in 'Peer in Cluster' state<br><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_50"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_49"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_48"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_47"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_46"></span><br>Best regards,<br><br>Aki<br><br><br><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_45"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_44"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_43"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_42"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_41"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_40"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_39"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_38"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_37"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_36"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_35"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_34"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_33"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_32"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_25"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_24"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_23"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_22"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_21"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_20"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_16"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_15"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_14"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_13"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_12"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_11"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_10"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_9"></span><span style="background-color:rgb(255, 204, 204);" id="ecxtextmarked_8"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_7"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_6"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_5"></span><span style="background-color:rgb(255, 204, 153);" id="ecxtextmarked_4"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_3"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_2"></span><span style="background-color:rgb(255, 255, 204);" id="ecxtextmarked_1"></span> </div></div> </div></body>
</html>