<html><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px"><div style="color: rgb(34, 34, 34); font-family: arial, sans-serif; font-size: 13px;" class="" id="yui_3_16_0_1_1422353578429_51816">Hi Xavi,</div><div style="color: rgb(34, 34, 34); font-family: arial, sans-serif; font-size: 13px;" class="" id="yui_3_16_0_1_1422353578429_51817">what happens is that Nova cannot create the file structure which is needed in order to create the virtual machine.</div><div style="color: rgb(34, 34, 34); font-family: arial, sans-serif; font-size: 13px;" class="" id="yui_3_16_0_1_1422353578429_51820">In <i class="" style="" id="yui_3_16_0_1_1422353578429_51819"><span style="font-size: 13.3333339691162px;" class="" id="yui_3_16_0_1_1422353578429_51818">/var/lib/nova/i</span></i><span style="font-size: 13.3333339691162px;" class=""><i class="" style="">nstances</i>, I can find only one directory under a casual name (<i class="" style="">random</i>), for example </span><i class="" style=""><span style="font-size: 13.3333339691162px;" class="">ca095fd4-1c0c-4</span><span style="font-size: 13.3333339691162px;" class="">fb4-<wbr class="" style="">a2d8-a0d758</span></i><span style="font-size: 13.3333339691162px;" class="" id="yui_3_16_0_1_1422353578429_51821"><i class="" style="">6c0ffa. </i>If I try to list the content, the command fails and never comes back. The shell freezes.</span></div><div style="color: rgb(34, 34, 34); font-family: arial, sans-serif; font-size: 13px;" class="" id="yui_3_16_0_1_1422353578429_51823"><span style="font-size: 13.3333339691162px;" class="" id="yui_3_16_0_1_1422353578429_51822">By the way, I try to find out some more verbous logs and to update the spftware to 3.6.2. In this case, should I unistall 3.6.1. and install it again?</span></div><div class="" style=""><span style="font-size: 13.3333339691162px;" class=""><br class="" style=""></span></div> <div class="qtdSeparateBR"><br><br></div><div class="yahoo_quoted" style="display: block;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div dir="ltr"> <font size="2" face="Arial"> El Martes 27 de enero de 2015 12:14, Xavier Hernandez <xhernandez@datalab.es> escribió:<br> </font> </div> <br><br> <div class="y_msg_container">Hi Pedro,<br clear="none"><br clear="none">do you get any specific error ?<br clear="none"><br clear="none"> From logs, the only thing I see is a warning about a GFID not being <br clear="none">available. This can cause troubles, but I'm not sure if this is the problem.<br clear="none"><br clear="none">Anyway, version 3.6.2 has some fixes that improve on this. Is it <br clear="none">possible for you to try the newer version ?<br clear="none"><br clear="none">Xavi<br clear="none"><div class="yqt4284283618" id="yqtfd51546"><br clear="none">On 01/27/2015 11:25 AM, Pedro Serotto wrote:<br clear="none">> Dear all,<br clear="none">> I try the disperse volume on 3 node cluster, but my instances never build.<br clear="none">><br clear="none">> This is the log:<br clear="none">><br clear="none">> <a shape="rect" ymailto="mailto:root@node-1" href="mailto:root@node-1">root@node-1</a>:/var/log/glusterfs# tail -f var-lib-nova-instances.log<br clear="none">> [2015-01-27 10:03:11.510702] I<br clear="none">> [client-handshake.c:1415:select_server_supported_programs]<br clear="none">> 0-nova-vm-client-1: Using Program GlusterFS 3.3, Num (1298437), Version<br clear="none">> (330)<br clear="none">> [2015-01-27 10:03:11.511052] I<br clear="none">> [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-2:<br clear="none">> Connected to nova-vm-client-2, attached to remote volume '/data/nova'.<br clear="none">> [2015-01-27 10:03:11.511074] I<br clear="none">> [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-2:<br clear="none">> Server and Client lk-version numbers are not same, reopening the fds<br clear="none">> [2015-01-27 10:03:11.511783] I<br clear="none">> [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-1:<br clear="none">> Connected to nova-vm-client-1, attached to remote volume '/data/nova'.<br clear="none">> [2015-01-27 10:03:11.511806] I<br clear="none">> [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-1:<br clear="none">> Server and Client lk-version numbers are not same, reopening the fds<br clear="none">> [2015-01-27 10:03:11.512464] I [ec.c:205:ec_up] 0-nova-vm-disperse-0:<br clear="none">> Going UP<br clear="none">> [2015-01-27 10:03:11.520391] I [fuse-bridge.c:5080:fuse_graph_setup]<br clear="none">> 0-fuse: switched to graph 0<br clear="none">> [2015-01-27 10:03:11.520660] I<br clear="none">> [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-1:<br clear="none">> Server lk version = 1<br clear="none">> [2015-01-27 10:03:11.520680] I<br clear="none">> [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-2:<br clear="none">> Server lk version = 1<br clear="none">> [2015-01-27 10:03:11.520941] I [fuse-bridge.c:4009:fuse_init]<br clear="none">> 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.22<br clear="none">> kernel 7.17<br clear="none">><br clear="none">><br clear="none">><br clear="none">> ------------>>>> nova boot --flavor 1 --image<br clear="none">> 4f31cf1b-3cff-470e-8533-0792c0e805d5 test-vm<br clear="none">><br clear="none">><br clear="none">><br clear="none">><br clear="none">> [2015-01-27 10:04:38.002739] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.009403] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.019634] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on<br clear="none">> subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.025431] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on<br clear="none">> subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.029552] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on<br clear="none">> subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.040237] I<br clear="none">> [dht-selfheal.c:1065:dht_selfheal_layout_new_directory] 0-nova-vm-dht:<br clear="none">> chunk size = 0xffffffff / 20458 = 0x33414<br clear="none">> [2015-01-27 10:04:38.040343] I<br clear="none">> [dht-selfheal.c:1103:dht_selfheal_layout_new_directory] 0-nova-vm-dht:<br clear="none">> assigning range size 0xffffc648 to nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.045521] I [MSGID: 109036]<br clear="none">> [dht-common.c:6221:dht_log_new_layout_for_dir_selfheal] 0-nova-vm-dht:<br clear="none">> Setting layout of /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa with<br clear="none">> [Subvol_name: nova-vm-disperse-0, Err: -1 , Start: 0 , Stop: 4294967295 ],<br clear="none">> [2015-01-27 10:04:38.057391] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.062147] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.068511] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log<br clear="none">> missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.072586] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.076411] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.082613] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.config<br clear="none">> missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.086569] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.089969] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.093946] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log<br clear="none">> missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.096379] W [ec-helpers.c:501:ec_loc_prepare]<br clear="none">> 0-nova-vm-disperse-0: GFID not available for inode<br clear="none">> [2015-01-27 10:04:38.123688] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.127440] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.131979] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info<br clear="none">> missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.136525] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info<br clear="none">> missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.143846] W [ec-helpers.c:501:ec_loc_prepare]<br clear="none">> 0-nova-vm-disperse-0: GFID not available for inode<br clear="none">> [2015-01-27 10:04:38.159679] I [dht-common.c:1822:dht_lookup_cbk]<br clear="none">> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp<br clear="none">> missing on subvol nova-vm-disperse-0<br clear="none">> [2015-01-27 10:04:38.162102] W [ec-helpers.c:501:ec_loc_prepare]<br clear="none">> 0-nova-vm-disperse-0: GFID not available for inode<br clear="none">> [2015-01-27 10:04:38.175625] I [dht-rename.c:1344:dht_rename]<br clear="none">> 0-nova-vm-dht: renaming<br clear="none">> /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp<br clear="none">> (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0) =><br clear="none">> /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info<br clear="none">> (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0)<br clear="none">><br clear="none">> where am I wrong?</div><br clear="none">><br clear="none">><br clear="none">> _______________________________________________<br clear="none">> Gluster-users mailing list<br clear="none">> <a shape="rect" ymailto="mailto:Gluster-users@gluster.org" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br clear="none">> <a shape="rect" href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><div class="yqt4284283618" id="yqtfd50954"><br clear="none">><br clear="none"></div><br><br></div> </div> </div> </div> </div></body></html>