<div dir="ltr"><div>Just trying to understand the setup better....<br><br>So you create the bricks on controller node and have the gluster volume present there ?<br></div>Do you use the mpathXX devices as bricks ? Whats the brick type (LV or dir) ?<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 20, 2015 at 12:11 PM, chamara samarakoon <span dir="ltr"><<a href="mailto:chthsa123@gmail.com" target="_blank">chthsa123@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">HI <span style="font-size:13px;white-space:nowrap">Deepak</span>,<div><br></div><div><br></div><div>Yes, it is Openstack controller and SAN is configured for redundancy through multi-path.</div><div><br></div><div>Regards,</div><div>Chamara</div><div><br></div></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Tue, Jan 20, 2015 at 11:55 AM, Deepak Shetty <span dir="ltr"><<a href="mailto:dpkshetty@gmail.com" target="_blank">dpkshetty@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>What does "Controller" mean, the openstack controller node or somethign else (like HBA ) ?<br></div><div>You picture says its SAN but the text says multi-path mount.. SAN would mean block devices, so I am assuming you have redundant block devices on the compute host, mkfs'ing it and then creating bricks for gluster ?<br><br><br></div>The stack trace looks like you hit a kernel bug and glusterfsd happens to be running on the CPU at the time... my 2 cents<br><br>thanx,<br>deepak<br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Tue, Jan 20, 2015 at 11:29 AM, chamara samarakoon <span dir="ltr"><<a href="mailto:chthsa123@gmail.com" target="_blank">chthsa123@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi All,<div><br></div><div><br></div><div>We have setup Openstack cloud as below. And the "/va/lib/nova/instances" is a Gluster volume.</div><div><br></div><div>CentOS - 6.5</div><div>Kernel - 2.6.32-431.29.2.el6.x86_64</div><div>GlusterFS - glusterfs 3.5.2 built on Jul 31 2014 18:47:54</div><div>OpenStack - RDO using Packstack</div><div><br></div><div><br></div><div><br></div><div><img src="cid:ii_i54v7c090_14b05e6194ec7afe" style="margin-right:0px" height="335" width="696"><br><br></div><div> </div><div><br></div><div>Recently Controller node freezes with following error (Which required hard reboot), as a result Gluster volumes on compute node can not reach the controller and due to that all the instances on compute nodes become to read-only status which causes to restart all instances.</div><div><br></div><div><br></div><div><br></div><div><b>BUG: scheduling while atomic : glusterfsd/42725/0xffffffff<br clear="all"></b><div><b>BUG: unable to handle kernel paging request at 0000000038a60d0a8</b></div><div><b>IP: [<fffffffff81058e5d>] task_rq_lock+0x4d/0xa0</b></div><div><b>PGD 1065525067 PUD 0</b></div><div><b>Oops: 0000 [#1] SMP</b></div><div><b>last sysfs file : /sys/device/pci0000:80/0000:80:02.0/0000:86:00.0/host2/port-2:0/end_device-2:0/target2:0:0/2:0:0:1/state</b></div><div><b>CPU 0</b></div><div><b>Modules linked in : xtconntrack iptable_filter ip_tables ipt_REDIRECT fuse ipv openvswitch vxlan iptable_mangle </b></div><div><b><br></b></div><div>Please advice on above incident , also feedback on the Openstack + GlusterFS setup is appreciated.<br></div><div><br></div><div>Thank You,</div><div>Chamara</div><div><br></div>
</div></div>
<br></div></div>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br><div>chthsa</div>
</font></span></div>
</blockquote></div><br></div>