<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div><br></div><blockquote type="cite"><div><div class="WordSection1"><p class="MsoNormal"><o:p> </o:p></p><p class="MsoNormal">Hi all,<o:p></o:p></p><p class="MsoNormal"><o:p> </o:p></p><p class="MsoNormal"><span lang="EN-US">we are running 4 server with Ubuntu 14.04 as glusterfs server with 3.5.2-ubuntu1~trusty1.</span></p></div></div></blockquote><div><br></div><blockquote type="cite"><div class="WordSection1"><p class="MsoNormal"><span lang="EN-US" style="background-color: rgba(255, 255, 255, 0);"><font color="#000000" face="UICTFontTextStyleBody" size="3">When starting quotas on any of the volumes the brick will be not available after some time. So we have to disable quota on this volume and stop and start this volume.<o:p></o:p></font></span></p><p class="MsoNormal"><span lang="EN-US" style="background-color: rgba(255, 255, 255, 0);"><font color="#000000" face="UICTFontTextStyleBody" size="3"> </font></span></p></div></blockquote><blockquote type="cite"><div><div class="WordSection1"><p class="MsoNormal"><span lang="EN-US"><o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">We have the following configuration<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">root@ikpsrv01:/var/log/glusterfs# gluster volume info<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume Name: gltestn<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Type: Distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume ID: e50bd30d-dbc8-4279-ac9d-2e557328a643<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Status: Started<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Number of Bricks: 1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Transport-type: tcp<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Bricks:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick1: ikpsrv01:/gltest2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume Name: glwww1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Type: Replicate<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume ID: 811e4c2a-4520-4e61-bb84-955afbdb9dff<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Status: Started<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Number of Bricks: 1 x 2 = 2<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Transport-type: tcp<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Bricks:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick1: ikpsrv03:/glwwwn/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick2: ikpsrv01:/glwwwn2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Options Reconfigured:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">features.quota: on<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume Name: corsika<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Type: Distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume ID: d6e07f3e-4b35-4736-9b71-afc3224f0f29<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Status: Started<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Number of Bricks: 4<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Transport-type: tcp<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Bricks:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick1: ikpsrv03:/glcors3-1/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick2: ikpsrv03:/glcors3-2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick3: ikpsrv02:/glcors2-1/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick4: ikpsrv02:/glcors2-2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume Name: gldata<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Type: Distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume ID: 82485d03-9ef4-4151-a2cc-881072e871a1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Status: Started<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Number of Bricks: 2<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Transport-type: tcp<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Bricks:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick1: ikpsrv02:/gldata2-1/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick2: ikpsrv01:/gldata1-2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Options Reconfigured:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">features.quota: on<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume Name: gltest<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Type: Distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume ID: 9e69afcc-d421-41c9-824b-7d9a31240072<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Status: Started<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Number of Bricks: 2<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Transport-type: tcp<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Bricks:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick1: ikpsrv01:/gltest3/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick2: ikpsrv01:/gltest4/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Options Reconfigured:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">features.quota: off<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume Name: glusersold<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Type: Distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume ID: 91a79e1a-4ff3-4191-b0ae-73357105774c<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Status: Started<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Number of Bricks: 1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Transport-type: tcp<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Bricks:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick1: ikpsrv02:/glusers2-2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume Name: glusers<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Type: Distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Volume ID: f48b1941-9c19-4311-bd9e-497660fbcc80<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Status: Started<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Number of Bricks: 1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Transport-type: tcp<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Bricks:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Brick1: ikpsrv02:/glusers2-1/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Options Reconfigured:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">diagnostics.client-log-level: CRITICAL<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">diagnostics.brick-log-level: CRITICAL<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">features.quota: off<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">When starting quotas on any of the volumes the brick will be not available after some time. So we have to disable quota on this volume and stop and start this volume.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">The command <o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Gluster volume quota gltestn enable <o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">gives the following output in quotad.log<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal">[2015-01-07 12:01:55.522229] W [glusterfsd.c:1095:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fb455bd9fbd] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7fb455ead182] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xd5) [0x7fb4569a7265]))) 0-: received signum (15), shutting down<o:p></o:p></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.534931] I [glusterfsd.c:1959:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.5.2 (/usr/sbin/glusterfs -s localhost --volfile-id gluster/quotad -p /var/lib/glusterd/quotad/run/quotad.pid -l /var/log/glusterfs/quotad.log -S /var/run/fa869d5552bf340ec7506747e21b2841.socket --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.537061] I [socket.c:3561:socket_init] 0-socket.glusterfsd: SSL support is NOT enabled<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.537134] I [socket.c:3576:socket_init] 0-socket.glusterfsd: using system polling thread<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.537355] I [socket.c:3561:socket_init] 0-glusterfs: SSL support is NOT enabled<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.537383] I [socket.c:3576:socket_init] 0-glusterfs: using system polling thread<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.541480] I [graph.c:254:gf_add_cmdline_options] 0-glwww1-replicate-0: adding option 'entry-self-heal' for volume 'glwww1-replicate-0' with value 'off'<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.541516] I [graph.c:254:gf_add_cmdline_options] 0-glwww1-replicate-0: adding option 'metadata-self-heal' for volume 'glwww1-replicate-0' with value 'off'<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.541536] I [graph.c:254:gf_add_cmdline_options] 0-glwww1-replicate-0: adding option 'data-self-heal' for volume 'glwww1-replicate-0' with value 'off'<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.543122] I [socket.c:3561:socket_init] 0-socket.quotad: SSL support is NOT enabled<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.543157] I [socket.c:3576:socket_init] 0-socket.quotad: using system polling thread<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.543404] I [dht-shared.c:311:dht_init_regex] 0-glwww1: using regex rsync-hash-regex = ^\.(.+)\.[^.]+$<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.547124] I [socket.c:3561:socket_init] 0-glwww1-client-1: SSL support is NOT enabled<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.547158] I [socket.c:3576:socket_init] 0-glwww1-client-1: using system polling thread<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.547728] I [socket.c:3561:socket_init] 0-glwww1-client-0: SSL support is NOT enabled<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.547754] I [socket.c:3576:socket_init] 0-glwww1-client-0: using system polling thread<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.547820] I [dht-shared.c:311:dht_init_regex] 0-gltestn: using regex rsync-hash-regex = ^\.(.+)\.[^.]+$<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.549471] I [socket.c:3561:socket_init] 0-gltestn-client-0: SSL support is NOT enabled<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.549501] I [socket.c:3576:socket_init] 0-gltestn-client-0: using system polling thread<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.549565] I [dht-shared.c:311:dht_init_regex] 0-gldata: using regex rsync-hash-regex = ^\.(.+)\.[^.]+$<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551155] I [socket.c:3561:socket_init] 0-gldata-client-1: SSL support is NOT enabled<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551184] I [socket.c:3576:socket_init] 0-gldata-client-1: using system polling thread<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551744] I [socket.c:3561:socket_init] 0-gldata-client-0: SSL support is NOT enabled<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551770] I [socket.c:3576:socket_init] 0-gldata-client-0: using system polling thread<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551790] W [graph.c:329:_log_if_unknown_option] 0-quotad: option 'rpc-auth.auth-glusterfs' is not recognized<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551819] W [graph.c:329:_log_if_unknown_option] 0-quotad: option 'rpc-auth.auth-unix' is not recognized<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551838] W [graph.c:329:_log_if_unknown_option] 0-quotad: option 'rpc-auth.auth-null' is not recognized<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551854] W [graph.c:329:_log_if_unknown_option] 0-quotad: option 'glwww1.volume-id' is not recognized<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551870] W [graph.c:329:_log_if_unknown_option] 0-quotad: option 'gltestn.volume-id' is not recognized<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551885] W [graph.c:329:_log_if_unknown_option] 0-quotad: option 'gldata.volume-id' is not recognized<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.551922] I [client.c:2294:notify] 0-glwww1-client-0: parent translators are ready, attempting connect on transport<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.552579] I [client.c:2294:notify] 0-glwww1-client-1: parent translators are ready, attempting connect on transport<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.553179] I [client.c:2294:notify] 0-gltestn-client-0: parent translators are ready, attempting connect on transport<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.553757] I [client.c:2294:notify] 0-gldata-client-0: parent translators are ready, attempting connect on transport<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.554372] I [client.c:2294:notify] 0-gldata-client-1: parent translators are ready, attempting connect on transport<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">Final graph:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">+------------------------------------------------------------------------------+<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 1: volume glwww1-client-0<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 2: type protocol/client<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 3: option remote-host ikpsrv03<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 4: option remote-subvolume /glwwwn/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 5: option transport-type socket<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> </span>6: option username 7c5931b4-d41e-40f7-978e-4b5a40f49481<o:p></o:p></p><p class="MsoNormal"> <span lang="EN-US">7: option password 6ab1661b-4752-42a4-80cc-ca0bd0167a9f<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 8: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 9:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 10: volume glwww1-client-1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 11: type protocol/client<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 12: option remote-host ikpsrv01<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 13: option remote-subvolume /glwwwn2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 14: option transport-type socket<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> </span>15: option username 7c5931b4-d41e-40f7-978e-4b5a40f49481<o:p></o:p></p><p class="MsoNormal"> <span lang="EN-US">16: option password 6ab1661b-4752-42a4-80cc-ca0bd0167a9f<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 17: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 18:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 19: volume glwww1-replicate-0<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 20: type cluster/replicate<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 21: option data-self-heal off<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 22: option metadata-self-heal off<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 23: option entry-self-heal off<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 24: subvolumes glwww1-client-0 glwww1-client-1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 25: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 26:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 27: volume glwww1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 28: type cluster/distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 29: subvolumes glwww1-replicate-0<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 30: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 31:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 32: volume gltestn-client-0<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 33: type protocol/client<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 34: option remote-host ikpsrv01<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 35: option remote-subvolume /gltest2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 36: option transport-type socket<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 37: option username 76c8bf85-a5c5-445d-8e04-e596b6eb173b<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 38: option password ceec81fd-5afd-4d6b-a413-00b2688f4c62<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 39: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 40:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 41: volume gltestn<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 42: type cluster/distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 43: subvolumes gltestn-client-0<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 44: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 45:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 46: volume gldata-client-0<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 47: type protocol/client<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 48: option remote-host ikpsrv02<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 49: option remote-subvolume /gldata2-1/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 50: option transport-type socket<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> </span>51: option username e9dcdbec-1110-4ab2-b667-63625126b246<o:p></o:p></p><p class="MsoNormal"> <span lang="EN-US">52: option password 05a9e37d-67a0-476b-88df-93d612a4e08e<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 53: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 54:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 55: volume gldata-client-1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 56: type protocol/client<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 57: option remote-host ikpsrv01<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 58: option remote-subvolume /gldata1-2/gl<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 59: option transport-type socket<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> </span>60: option username e9dcdbec-1110-4ab2-b667-63625126b246<o:p></o:p></p><p class="MsoNormal"> <span lang="EN-US">61: option password 05a9e37d-67a0-476b-88df-93d612a4e08e<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 62: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 63:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 64: volume gldata<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 65: type cluster/distribute<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 66: subvolumes gldata-client-0 gldata-client-1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 67: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 68:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 69: volume quotad<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 70: type features/quotad<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 71: option rpc-auth.auth-glusterfs on<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 72: option rpc-auth.auth-unix on<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 73: option rpc-auth.auth-null on<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 74: option transport.socket.listen-path /tmp/quotad.socket<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 75: option transport-type socket<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 76: option transport.address-family unix<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 77: option glwww1.volume-id glwww1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 78: option gltestn.volume-id gltestn<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 79: option gldata.volume-id gldata<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 80: subvolumes glwww1 gltestn gldata<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 81: end-volume<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"> 82:<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">+------------------------------------------------------------------------------+<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.555618] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-gldata-client-0: changing port to 49160 (from 0)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.556529] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-glwww1-client-1: changing port to 49165 (from 0)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.556597] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-gltestn-client-0: changing port to 49166 (from 0)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.556643] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-gldata-client-1: changing port to 49178 (from 0)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.558382] W [client-callback.c:31:client_cbk_fetchspec] 0-glwww1-client-0: this function should not be called<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.558484] I [glusterfsd-mgmt.c:56:mgmt_cbk_spec] 0-mgmt: Volume file changed<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.558601] I [client-handshake.c:1677:select_server_supported_programs] 0-gldata-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.559594] I [client-handshake.c:1677:select_server_supported_programs] 0-gltestn-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.559686] I [client-handshake.c:1677:select_server_supported_programs] 0-glwww1-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.559768] I [client-handshake.c:1677:select_server_supported_programs] 0-gldata-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.559852] I [client-handshake.c:1462:client_setvolume_cbk] 0-gldata-client-0: Connected to 141.52.67.86:49160, attached to remote volume '/gldata2-1/gl'.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.559873] I [client-handshake.c:1474:client_setvolume_cbk] 0-gldata-client-0: Server and Client lk-version numbers are not same, reopening the fds<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.559996] I [client-handshake.c:1462:client_setvolume_cbk] 0-gltestn-client-0: Connected to 141.52.67.85:49166, attached to remote volume '/gltest2/gl'.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560017] I [client-handshake.c:1474:client_setvolume_cbk] 0-gltestn-client-0: Server and Client lk-version numbers are not same, reopening the fds<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560089] I [client-handshake.c:450:client_set_lk_version_cbk] 0-gldata-client-0: Server lk version = 1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560139] I [client-handshake.c:1462:client_setvolume_cbk] 0-glwww1-client-1: Connected to 141.52.67.85:49165, attached to remote volume '/glwwwn2/gl'.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560158] I [client-handshake.c:1474:client_setvolume_cbk] 0-glwww1-client-1: Server and Client lk-version numbers are not same, reopening the fds<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560204] I [afr-common.c:4131:afr_notify] 0-glwww1-replicate-0: Subvolume 'glwww1-client-1' came back up; going online.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560262] I [client-handshake.c:1462:client_setvolume_cbk] 0-gldata-client-1: Connected to 141.52.67.85:49178, attached to remote volume '/gldata1-2/gl'.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560301] I [client-handshake.c:1474:client_setvolume_cbk] 0-gldata-client-1: Server and Client lk-version numbers are not same, reopening the fds<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560385] I [client-handshake.c:450:client_set_lk_version_cbk] 0-gltestn-client-0: Server lk version = 1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560467] I [client-handshake.c:450:client_set_lk_version_cbk] 0-glwww1-client-1: Server lk version = 1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:56.560546] I [client-handshake.c:450:client_set_lk_version_cbk] 0-gldata-client-1: Server lk version = 1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:57.255911] I [glusterfsd-mgmt.c:1307:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:57.557002] I [rpc-clnt.c:1729:rpc_clnt_reconfig] 0-glwww1-client-0: changing port to 49153 (from 0)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:57.557924] I [client-handshake.c:1677:select_server_supported_programs] 0-glwww1-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:57.558360] I [client-handshake.c:1462:client_setvolume_cbk] 0-glwww1-client-0: Connected to 141.52.67.96:49153, attached to remote volume '/glwwwn/gl'.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:57.558405] I [client-handshake.c:1474:client_setvolume_cbk] 0-glwww1-client-0: Server and Client lk-version numbers are not same, reopening the fds<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US">[2015-01-07 12:01:57.558706] I [client-handshake.c:450:client_set_lk_version_cbk] 0-glwww1-client-0: Server lk version = 1<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">what means <o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">2015-01-07 12:01:56.559594] I [client-handshake.c:1677:select_server_supported_programs] 0-gltestn-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">In the log output.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Our glusterfs clients all have 3.5.2 glusterfs version.<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US">Can someone help?<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:DE">kind regards<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">Klaus Bekk<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE"><o:p> </o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE"><o:p> </o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE"><o:p> </o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">----------------------------------------------------------<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">Karlsruher Institut of Technologie (KIT)<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">Institut für Kernphysik (IKP)<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE"><o:p> </o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">Dr. Klaus Bekk<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE"><o:p> </o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">Hermann-von-Helmholtz-Platz 1<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">Campus Nord Gebäude 425<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">76344 Eggenstein-Leopoldshafen<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE"><o:p> </o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">Telefon: +49 721 608-23382<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">Fax: +49 721 608-23321<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE"><o:p> </o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">E-Mail: <a href="mailto:Klaus.Bekk@kit.edu">Klaus.Bekk@kit.edu</a><o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:DE"><a href="http://www.kit.edu/">http://www.kit.edu/</a><o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:DE"><o:p> </o:p></span></p><p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:DE">KIT – University of the State of Baden-Wuerttemberg and<o:p></o:p></span></p><p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:DE">National Research Center of the Helmholtz Association<o:p></o:p></span></p><p class="MsoNormal"><span style="mso-fareast-language:DE">----------------------------------------------------------<o:p></o:p></span></p><p class="MsoNormal"><span style="color:red;mso-fareast-language:DE"> </span><span style="mso-fareast-language:DE"><o:p></o:p></span></p><p class="MsoNormal"><o:p> </o:p></p></div></div></blockquote><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style></body></html>