<div dir="ltr">From the the client side logs I can see version info on mount:<div><br></div><div><div><div>Final graph:</div><div>+------------------------------------------------------------------------------+</div><div> 1: volume storage-client-0</div><div> 2: type protocol/client</div><div> 3: option clnt-lk-version 1</div><div> 4: option volfile-checksum 0</div><div> 5: option volfile-key /storage</div><div> 6: option client-version 3.7.6</div><div> 7: option process-uuid template-centos7-compute.compute.domain-2773-2016/03/02-18:28:34:328100-storage-client-0-0-0</div><div> 8: option fops-version 1298437</div><div> 9: option ping-timeout 42</div><div> 10: option remote-host 10.0.231.50</div><div> 11: option remote-subvolume /mnt/raid6-storage/storage</div><div> 12: option transport-type socket</div><div> 13: option send-gids true</div><div> 14: end-volume</div><div> 15: </div><div> 16: volume storage-client-1</div><div> 17: type protocol/client</div><div> 18: option clnt-lk-version 1</div><div> 19: option volfile-checksum 0</div><div> 20: option volfile-key /storage</div><div> 21: option client-version 3.7.6</div><div> 22: option process-uuid template-centos7-compute.compute.domain-2773-2016/03/02-18:28:34:328100-storage-client-1-0-0</div><div> 23: option fops-version 1298437</div><div> 24: option ping-timeout 42</div><div> 25: option remote-host 10.0.231.51</div><div> 26: option remote-subvolume /mnt/raid6-storage/storage</div><div> 27: option transport-type socket</div><div> 28: option send-gids true</div><div> 29: end-volume</div><div> 30: </div><div> 31: volume storage-client-2</div><div> 32: type protocol/client</div><div> 33: option clnt-lk-version 1</div><div> 34: option volfile-checksum 0</div><div> 35: option volfile-key /storage</div><div> 36: option client-version 3.7.6</div><div> 37: option process-uuid template-centos7-compute.compute.domain-2773-2016/03/02-18:28:34:328100-storage-client-2-0-0</div><div> 38: option fops-version 1298437</div><div> 39: option ping-timeout 42</div><div> 40: option remote-host 10.0.231.52</div><div> 41: option remote-subvolume /mnt/raid6-storage/storage</div><div> 42: option transport-type socket</div><div> 43: option send-gids true</div><div> 44: end-volume</div><div> 45: </div><div> 46: volume storage-client-3</div><div> 47: type protocol/client</div><div> 48: option clnt-lk-version 1</div><div> 49: option volfile-checksum 0</div><div> 50: option volfile-key /storage</div><div> 51: option client-version 3.7.6</div><div> 52: option process-uuid template-centos7-compute.compute.domain-2773-2016/03/02-18:28:34:328100-storage-client-3-0-0</div><div> 53: option fops-version 1298437</div><div> 54: option ping-timeout 42</div><div> 55: option remote-host 10.0.231.53</div><div> 56: option remote-subvolume /mnt/raid6-storage/storage</div><div> 57: option transport-type socket</div><div> 58: option send-gids true</div><div> 59: end-volume</div><div> 60: </div><div> 61: volume storage-client-4</div><div> 62: type protocol/client</div><div> 63: option ping-timeout 42</div><div> 64: option remote-host 10.0.231.54</div><div> 65: option remote-subvolume /mnt/raid6-storage/storage</div><div> 66: option transport-type socket</div><div> 67: option send-gids true</div><div> 68: end-volume</div><div> 69: </div><div> 70: volume storage-client-5</div><div> 71: type protocol/client</div><div> 72: option ping-timeout 42</div><div> 73: option remote-host 10.0.231.55</div><div> 74: option remote-subvolume /mnt/raid6-storage/storage</div><div> 75: option transport-type socket</div><div> 76: option send-gids true</div><div> 77: end-volume</div><div> 78: </div><div> 79: volume storage-dht</div><div> 80: type cluster/distribute</div><div> 81: subvolumes storage-client-0 storage-client-1 storage-client-2 storage-client-3 storage-client-4 storage-client-5</div><div> 82: end-volume</div></div></div><div><br></div><div><br></div><div>But not the client op-version, how can I retrieve this info?</div><div><br></div><div>Thanks</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 1, 2016 at 10:19 PM, Gaurav Garg <span dir="ltr"><<a href="mailto:ggarg@redhat.com" target="_blank">ggarg@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Steve,<br>
<br>
Which version you have upgraded client, could you tell us client op-version after upgrade ?<br>
<br>
<br>
have you upgraded all of your clients ?<br>
<br>
<br>
Thanks,<br>
Gaurav<br>
<div><div class="h5"><br>
<br>
----- Original Message -----<br>
From: "Steve Dainard" <<a href="mailto:sdainard@spd1.com">sdainard@spd1.com</a>><br>
To: "<a href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a> List" <<a href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a>><br>
Sent: Wednesday, March 2, 2016 1:10:27 AM<br>
Subject: [Gluster-users] gluster 3.7.6 volume set: failed: One or more connected clients cannot support the feature being set<br>
<br>
Gluster 3.7.6<br>
'storage' is a distributed volume<br>
<br>
# gluster volume set storage rebal-throttle lazy<br>
volume set: failed: One or more connected clients cannot support the feature being set. These clients need to be upgraded or disconnected before running this command again<br>
<br>
I found a client connected using version 3.6.7 so I upgraded & umount/mount the gluster volume on the client but I'm still getting this error.<br>
<br>
I've run grep "accepted client from" /var/log/glusterfs/bricks/* | grep -v 3.7.6 and I get a few returns from the client above, all dated last week.<br>
<br>
I've run 'gluster volume status storage clients' and checked the connected clients manually, they're all running 3.7.6.<br>
<br>
/var/log/gluster/etc-glusterfs-glusterd.vol.log:<br>
[2016-03-01 19:23:20.180821] E [MSGID: 106022] [glusterd-utils.c:10154:glusterd_check_client_op_version_support] 0-management: One or more c<br>
lients don't support the required op-version<br>
[2016-03-01 19:23:20.180853] E [MSGID: 106301] [glusterd-syncop.c:1274:gd_stage_op_phase] 0-management: Staging of operation 'Volume Set' fa<br>
iled on localhost : One or more connected clients cannot support the feature being set. These clients need to be upgraded or disconnected be<br>
fore running this command again<br>
<br>
Also tried setting the diagnostics.brick-log-level logging level and got the same error.<br>
<br>
/var/lib/glusterd/vols/storage/info:<br>
type=0<br>
count=6<br>
status=1<br>
sub_count=0<br>
stripe_count=1<br>
replica_count=1<br>
disperse_count=0<br>
redundancy_count=0<br>
version=26<br>
transport-type=0<br>
volume-id=26d355cb-c486-481f-ac16-e25390e73775<br>
username=eb9e2063-6ba8-4d16-a54f-2c7cf7740c4c<br>
password=<br>
op-version=3<br>
client-op-version=3<br>
quota-version=1<br>
parent_volname=N/A<br>
restored_from_snap=00000000-0000-0000-0000-000000000000<br>
snap-max-hard-limit=256<br>
features.quota-deem-statfs=on<br>
features.inode-quota=on<br>
diagnostics.brick-log-level=WARNING<br>
features.quota=on<br>
performance.readdir-ahead=on<br>
performance.cache-size=1GB<br>
performance.stat-prefetch=on<br>
brick-0=10.0.231.50:-mnt-raid6-storage-storage<br>
brick-1=10.0.231.51:-mnt-raid6-storage-storage<br>
brick-2=10.0.231.52:-mnt-raid6-storage-storage<br>
brick-3=10.0.231.53:-mnt-raid6-storage-storage<br>
brick-4=10.0.231.54:-mnt-raid6-storage-storage<br>
brick-5=10.0.231.55:-mnt-raid6-storage-storage<br>
<br>
<br>
</div></div>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote></div><br></div>