<p dir="ltr"></p>
<p dir="ltr">Sent from one plus one<br>
On Jun 22, 2015 7:31 PM, "Andreas Hollaus" <<a href="mailto:andreas.hollaus@ericsson.com">andreas.hollaus@ericsson.com</a>> wrote:<br>
><br>
> Hi,<br>
><br>
> Well, I don't really know what to expect, but there actually are some errors:<br>
> Could it be due to that missing extended attribute? I don't understand why it's missing (yet).<br>
You are correct. Missing volume-id could be the problem, I will check the code and confirm tomorrow.<br>
><br>
> Regards<br>
> Andreas<br>
><br>
> # more /var/log/glusterfs/bricks/opt-lvmdir-c2-brick.log <br>
> [2015-06-22 13:23:47.924071] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-/usr/s<br>
> bin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.6.2 (args: /usr/s<br>
> bin/glusterfsd -s 10.32.0.64 --volfile-id c_glstr.10.32.0.64.opt-lvmdir-c2-brick<br>
> -p /system/glusterd/vols/c_glstr/run/10.32.0.64-opt-lvmdir-c2-brick.pid -S /var<br>
> /run/67a3053b5f738d0e72fb517a245687f1.socket --brick-name /opt/lvmdir/c2/brick -<br>
> l /var/log/glusterfs/bricks/opt-lvmdir-c2-brick.log --xlator-option *-posix.glus<br>
> terd-uuid=c7de0c97-ca3a-47a4-bc7d-21fc33b88fee --brick-port 49152 --xlator-optio<br>
> n c_glstr-server.listen-port=49152)<br>
> [2015-06-22 13:23:47.959891] I [graph.c:269:gf_add_cmdline_options] 0-c_glstr-se<br>
> rver: adding option 'listen-port' for volume 'c_glstr-server' with value '49152'<br>
> [2015-06-22 13:23:47.959949] I [graph.c:269:gf_add_cmdline_options] 0-c_glstr-po<br>
> six: adding option 'glusterd-uuid' for volume 'c_glstr-posix' with value 'c7de0c<br>
> 97-ca3a-47a4-bc7d-21fc33b88fee'<br>
> [2015-06-22 13:23:47.961541] I [rpcsvc.c:2142:rpcsvc_set_outstanding_rpc_limit] <br>
> 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64<br>
> [2015-06-22 13:23:47.961656] W [options.c:898:xl_opt_validate] 0-c_glstr-server:<br>
> option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port'<br>
> , continuing with correction<br>
> [2015-06-22 13:23:47.964258] E [posix.c:5626:init] 0-c_glstr-posix: Extended att<br>
> ribute trusted.glusterfs.volume-id is absent<br>
> [2015-06-22 13:23:47.964291] E [xlator.c:425:xlator_init] 0-c_glstr-posix: Initi<br>
> alization of volume 'c_glstr-posix' failed, review your volfile again<br>
> [2015-06-22 13:23:47.964310] E [graph.c:322:glusterfs_graph_init] 0-c_glstr-posi<br>
> x: initializing translator failed<br>
> [2015-06-22 13:23:47.964330] E [graph.c:525:glusterfs_graph_activate] 0-graph: i<br>
> nit failed<br>
> [2015-06-22 13:23:47.965149] W [glusterfsd.c:1194:cleanup_and_exit] (--> 0-: rec<br>
> eived signum (0), shutting down<br>
> [2015-06-22 13:25:48.579077] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-/usr/s<br>
> bin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.6.2 (args: /usr/s<br>
> bin/glusterfsd -s 10.32.0.64 --volfile-id c_glstr.10.32.0.64.opt-lvmdir-c2-brick<br>
> -p /system/glusterd/vols/c_glstr/run/10.32.0.64-opt-lvmdir-c2-brick.pid -S /var<br>
> /run/67a3053b5f738d0e72fb517a245687f1.socket --brick-name /opt/lvmdir/c2/brick -<br>
> l /var/log/glusterfs/bricks/opt-lvmdir-c2-brick.log --xlator-option *-posix.glus<br>
> terd-uuid=c7de0c97-ca3a-47a4-bc7d-21fc33b88fee --brick-port 49152 --xlator-optio<br>
> n c_glstr-server.listen-port=49152)<br>
> [2015-06-22 13:25:48.592801] I [graph.c:269:gf_add_cmdline_options] 0-c_glstr-se<br>
> rver: adding option 'listen-port' for volume 'c_glstr-server' with value '49152'<br>
> [2015-06-22 13:25:48.592855] I [graph.c:269:gf_add_cmdline_options] 0-c_glstr-po<br>
> six: adding option 'glusterd-uuid' for volume 'c_glstr-posix' with value 'c7de0c<br>
> 97-ca3a-47a4-bc7d-21fc33b88fee'<br>
> [2015-06-22 13:25:48.594307] I [rpcsvc.c:2142:rpcsvc_set_outstanding_rpc_limit] <br>
> 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64<br>
> [2015-06-22 13:25:48.594420] W [options.c:898:xl_opt_validate] 0-c_glstr-server:<br>
> option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port'<br>
> , continuing with correction<br>
> [2015-06-22 13:25:48.596705] W [graph.c:344:_log_if_unknown_option] 0-c_glstr-se<br>
> rver: option 'rpc-auth.auth-glusterfs' is not recognized<br>
> [2015-06-22 13:25:48.596741] W [graph.c:344:_log_if_unknown_option] 0-c_glstr-se<br>
> rver: option 'rpc-auth.auth-unix' is not recognized<br>
> [2015-06-22 13:25:48.596770] W [graph.c:344:_log_if_unknown_option] 0-c_glstr-se<br>
> rver: option 'rpc-auth.auth-null' is not recognized<br>
> [2015-06-22 13:25:48.596809] W [graph.c:344:_log_if_unknown_option] 0-c_glstr-qu<br>
> ota: option 'timeout' is not recognized<br>
> Final graph:<br>
> +------------------------------------------------------------------------------+<br>
> 1: volume c_glstr-posix<br>
> 2: type storage/posix<br>
> 3: option glusterd-uuid c7de0c97-ca3a-47a4-bc7d-21fc33b88fee<br>
> 4: option directory /opt/lvmdir/c2/brick<br>
> 5: option volume-id e052572c-c7ad-4d66-986f-621fbc48999e<br>
> 6: end-volume<br>
> 7: <br>
> 8: volume c_glstr-changelog<br>
> 9: type features/changelog<br>
> 10: option changelog-brick /opt/lvmdir/c2/brick<br>
> 11: option changelog-dir /opt/lvmdir/c2/brick/.glusterfs/changelogs<br>
> 12: option changelog-barrier-timeout 120<br>
> 13: subvolumes c_glstr-posix<br>
> 14: end-volume<br>
> 15: <br>
> 16: volume c_glstr-access-control<br>
> 17: type features/access-control<br>
> 18: subvolumes c_glstr-changelog<br>
> 19: end-volume<br>
> 20: <br>
> 21: volume c_glstr-locks<br>
> 22: type features/locks<br>
> 23: subvolumes c_glstr-access-control<br>
> 24: end-volume<br>
> 25: <br>
> 26: volume c_glstr-io-threads<br>
> 27: type performance/io-threads<br>
> 28: subvolumes c_glstr-locks<br>
> 29: end-volume<br>
> 30: <br>
> 31: volume c_glstr-barrier<br>
> 32: type features/barrier<br>
> 33: option barrier disable<br>
> 34: option barrier-timeout 120<br>
> 35: subvolumes c_glstr-io-threads<br>
> 36: end-volume<br>
> 37: <br>
> 38: volume c_glstr-index<br>
> 39: type features/index<br>
> 40: option index-base /opt/lvmdir/c2/brick/.glusterfs/indices<br>
> 41: subvolumes c_glstr-barrier<br>
> 42: end-volume<br>
> 43: <br>
> 44: volume c_glstr-marker<br>
> 45: type features/marker<br>
> 46: option volume-uuid e052572c-c7ad-4d66-986f-621fbc48999e<br>
> 47: option timestamp-file /system/glusterd/vols/c_glstr/marker.tstamp<br>
> 48: option xtime off<br>
> 49: option gsync-force-xtime off<br>
> 50: option quota off<br>
> 51: subvolumes c_glstr-index<br>
> 52: end-volume<br>
> 53: <br>
> 54: volume c_glstr-quota<br>
> 55: type features/quota<br>
> 56: option volume-uuid c_glstr<br>
> 57: option server-quota off<br>
> 58: option timeout 0<br>
> 59: option deem-statfs off<br>
> 60: subvolumes c_glstr-marker<br>
> 61: end-volume<br>
> 62: <br>
> 63: volume /opt/lvmdir/c2/brick<br>
><br>
> 64: type debug/io-stats<br>
> 65: option latency-measurement off<br>
> 66: option count-fop-hits off<br>
> 67: subvolumes c_glstr-quota<br>
> 68: end-volume<br>
> 69: <br>
> 70: volume c_glstr-server<br>
> 71: type protocol/server<br>
> 72: option transport.socket.listen-port 49152<br>
> 73: option rpc-auth.auth-glusterfs on<br>
> 74: option rpc-auth.auth-unix on<br>
> 75: option rpc-auth.auth-null on<br>
> 76: option transport-type tcp<br>
> 77: option auth.login./opt/lvmdir/c2/brick.allow b860abc7-dfeb-402c-baf3-ef<br>
> 13f1c3bb52<br>
> 78: option auth.login.b860abc7-dfeb-402c-baf3-ef13f1c3bb52.password db5d45c<br>
> 9-58f7-49ad-8080-9197eb69695e<br>
> 79: option auth.addr./opt/lvmdir/c2/brick.allow *<br>
> 80: subvolumes /opt/lvmdir/c2/brick<br>
> 81: end-volume<br>
> 82: <br>
> +------------------------------------------------------------------------------+<br>
> [2015-06-22 13:25:49.738346] I [login.c:82:gf_auth] 0-auth/login: allowed user n<br>
> ames: b860abc7-dfeb-402c-baf3-ef13f1c3bb52<br>
> [2015-06-22 13:25:49.738399] I [server-handshake.c:585:server_setvolume] 0-c_gls<br>
> tr-server: accepted client from oamhost-1994-2015/06/22-13:23:51:485466-c_glstr-<br>
> client-1-0-0 (version: 3.6.2)<br>
> [2015-06-22 13:25:49.744199] I [login.c:82:gf_auth] 0-auth/login: allowed user n<br>
> ames: b860abc7-dfeb-402c-baf3-ef13f1c3bb52<br>
> [2015-06-22 13:25:49.744238] I [server-handshake.c:585:server_setvolume] 0-c_gls<br>
> tr-server: accepted client from oamhost-1898-2015/06/22-13:23:46:623908-c_glstr-<br>
> client-1-0-0 (version: 3.6.2)<br>
> [2015-06-22 13:25:49.762796] I [login.c:82:gf_auth] 0-auth/login: allowed user n<br>
> ames: b860abc7-dfeb-402c-baf3-ef13f1c3bb52<br>
> [2015-06-22 13:25:49.762834] I [server-handshake.c:585:server_setvolume] 0-c_gls<br>
> tr-server: accepted client from oamhost-3395-2015/06/22-13:25:49:733813-c_glstr-<br>
> client-1-0-0 (version: 3.6.2)<br>
> [2015-06-22 13:25:49.882096] I [server.c:518:server_rpc_notify] 0-c_glstr-server<br>
> : disconnecting connection from oamhost-1898-2015/06/22-13:23:46:623908-c_glstr-<br>
> client-1-0-0<br>
> [2015-06-22 13:25:49.882150] I [client_t.c:417:gf_client_unref] 0-c_glstr-server<br>
> : Shutting down connection oamhost-1898-2015/06/22-13:23:46:623908-c_glstr-clien<br>
> t-1-0-0<br>
> [2015-06-22 13:25:50.465176] I [login.c:82:gf_auth] 0-auth/login: allowed user n<br>
> ames: b860abc7-dfeb-402c-baf3-ef13f1c3bb52<br>
> [2015-06-22 13:25:50.465214] I [server-handshake.c:585:server_setvolume] 0-c_gls<br>
> tr-server: accepted client from oamhost-2130-2015/06/22-13:23:48:74682-c_glstr-c<br>
> lient-1-0-0 (version: 3.6.2)<br>
> [2015-06-22 13:25:50.912886] I [login.c:82:gf_auth] 0-auth/login: allowed user n<br>
> ames: b860abc7-dfeb-402c-baf3-ef13f1c3bb52<br>
> [2015-06-22 13:25:50.912931] I [server-handshake.c:585:server_setvolume] 0-c_gls<br>
> tr-server: accepted client from oamhost-5400-2015/06/22-13:25:57:519410-c_glstr-<br>
> client-1-0-0 (version: 3.6.2)<br>
><br>
><br>
> Regards<br>
> Andreas<br>
><br>
><br>
> On 6/22/2015 3:45 PM, Atin Mukherjee wrote:<br>
>><br>
>> Sent from one plus one<br>
>> On Jun 22, 2015 7:06 PM, "Andreas Hollaus" <<a href="mailto:Andreas.Hollaus@ericsson.com">Andreas.Hollaus@ericsson.com</a>> wrote:<br>
>> ><br>
>> > Hi,<br>
>> ><br>
>> > I keep having this situation where I have to start the volume using the force<br>
>> > option.Why isn't the volume started without this?<br>
>> > It seems to have these problems after a node restart, but I expected the volume to be<br>
>> > restarted properly whenever the service is restarted.<br>
>> Do you see anything abnormal in glusterd/ brick logs pre and post restart? <br>
>> ><br>
>> ><br>
>> > Regards<br>
>> > Andreas<br>
>> ><br>
>> > On 06/22/15 10:40, Andreas Hollaus wrote:<br>
>> > > Hi,<br>
>> > ><br>
>> > > Well that did the trick. Thanks!<br>
>> > ><br>
>> > ><br>
>> > > Regards<br>
>> > > Andreas<br>
>> > ><br>
>> > ><br>
>> > > On 06/22/15 10:07, Sakshi Bansal wrote:<br>
>> > >> Both the bricks are down. Can you run -<br>
>> > >> $ gluster volume start <volume-name> force<br>
>> > > _______________________________________________<br>
>> > > Gluster-users mailing list<br>
>> > > <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
>> > > <a href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
>> > ><br>
>> > ><br>
>> ><br>
>> > _______________________________________________<br>
>> > Gluster-users mailing list<br>
>> > <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
>> > <a href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
><br>
><br>
</p>