<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none"><!--P{margin-top:0;margin-bottom:0;} .ms-cui-menu {background-color:#ffffff;border:1px rgb(171, 171, 171) solid;font-family:'Segoe UI WPC', 'Segoe UI', Tahoma, 'Microsoft Sans Serif', Verdana, sans-serif;font-size:11pt;color:rgb(51, 51, 51);} .ms-cui-menusection-title {display:none;} .ms-cui-ctl {vertical-align:text-top;text-decoration:none;color:rgb(51, 51, 51);} .ms-cui-ctl-on {background-color:rgb(223, 237, 250);opacity: 0.8;} .ms-cui-img-cont-float {display:inline-block;margin-top:2px} .ms-cui-smenu-inner {padding-top:0px;} .ms-owa-paste-option-icon {margin: 2px 4px 0px 4px;vertical-align:sub;padding-bottom: 2px;display:inline-block;} .ms-rtePasteFlyout-option:hover {background-color:rgb(223, 237, 250) !important;opacity:1 !important;} .ms-rtePasteFlyout-option {padding:8px 4px 8px 4px;outline:none;} .ms-cui-menusection {float:left; width:85px;height:24px;overflow:hidden}--></style>
</head>
<body>
<div style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p>Justin,<br>
</p>
<p><br>
</p>
<p>I do something similar, but not quite as complex.<br>
</p>
<p><br>
</p>
<p>I have a replicated (x2) Gluster volume where I drop thin-provisioned iSCSI volume files to be served up via tgtd on CentOS6. I mount the Gluster volume locally on both Gluster servers (FUSE driver), then point <span style="font-family: calibri, arial, helvetica, sans-serif; font-size: 16px; background-color: #ffffff;">the
tgtd daemons to the image files. I use this as a back-end for a VMware ESXi datastore, so I'm using the multipath iSCSI functionality of ESXi to handle the failover between the nodes.</span><br>
</p>
<p><span style="font-family: calibri, arial, helvetica, sans-serif; font-size: 16px; background-color: #ffffff;"><br>
</span></p>
<p><span style="font-family: calibri, arial, helvetica, sans-serif; font-size: 16px; background-color: #ffffff;">I was previously doing this with DRBD/Pacemaker/Corosync, but ESXi freaks out when all paths to a datastore go down, and it takes ~2-5 seconds for
the entire cluster stack to go down and come back up during an orderly failover (to say nothing of a catastrophic failover), so that model just didn't work for me.</span></p>
<p><span style="font-family: calibri, arial, helvetica, sans-serif; font-size: 16px; background-color: #ffffff;"><br>
</span></p>
<p>I've since done some testing with just a simple VIP in Keepalived on top of Gluster using LIO and the libgfapi stuff on CentOS7, and that seemed to work great -- but I have some other incompatibilities with CentOS7, so I decided not to pursue that for this
project -- maybe another one on the horizon.<br>
</p>
<p><br>
</p>
<p>I briefly tried testing the libgfapi driver on CentOS6 with my current production setup, but when I started the rebuild tgtd instance it gave my iSCSI LUNs different LUN numbers so my ESXi cluster didn't recognize them as different paths to the same LUN.
I couldn't be bothered to work out the reason for this change, so I just switched back in the meantime. I will probably play with it a bit in a test environment when I have time -- the libgfapi stuff should be faster and more efficient than going through
the FUSE stuff.<br>
</p>
<p><br>
</p>
<p>What would the Pacemaker CRM handle for you, besides a shared VIP? Would you want it to start/stop the iSCSI target daemon as well? (If so, why?) Is there any reason to use a full CRM for this versus a simple VIP in something like keepalived?<br>
</p>
<p><br>
</p>
<p>Good luck, and let us know how you get on!<br>
</p>
<p><br>
</p>
<p>Regards,<br>
</p>
<p>Jon Heese<br>
</p>
<p><br>
</p>
<p><br>
</p>
<div style="color: #282828;">
<hr tabindex="-1" style="display: inline-block; width: 98%;">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size: 11pt;"><b>From:</b> gluster-users-bounces@gluster.org <gluster-users-bounces@gluster.org> on behalf of Justin Chin-You <justin.chinyou@gmail.com><br>
<b>Sent:</b> Monday, April 20, 2015 10:14 PM<br>
<b>To:</b> gluster-users@gluster.org<br>
<b>Subject:</b> [Gluster-users] GlusterFS with iSCSI and PaceMaker</font>
<div> </div>
</div>
<div>
<div dir="ltr">Hi All,
<div><br>
</div>
<div>I'm new to Gluster and I'm trying to work through some test configurations. </div>
<div><br>
</div>
<div>What I am trying to do is use Gluster to create a mirrored and scalable storage array. My plan is once I setup Gluster is to then export the GlusterFS via an iSCSI interface which will have an Active/Standby failover managed via Pacemaker. </div>
<div><br>
</div>
<div>I am curious if anyone has tried anything similar and if you have what iSCSI driver are you using. </div>
<div><br>
</div>
<div>Thanks,</div>
<div><br>
</div>
<div>Justin </div>
</div>
</div>
</div>
</div>
</body>
</html>