<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Dear all,
<div class=""><br class="">
</div>
<div class="">I have a 3-node distribute setup with a controller of GlusterFS and upgraded to 3.7.6 today and to CentOS 7.2.</div>
<div class=""><br class="">
</div>
<div class="">After the ugprade (reboot), I can start the volume fine and see mounted volume as well on the controller.</div>
<div class=""><br class="">
</div>
<div class="">However, a gluster volume info <volname> results in an </div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[root@stor104 glusterfs]# gluster volume status live</div>
<div class="">Commit failed on localhost. Please check the log file for more details.</div>
</div>
<div class=""><br class="">
</div>
<div class="">error.</div>
<div class=""><br class="">
</div>
<div class="">Below some information and log extracts.</div>
<div class=""><br class="">
</div>
<div class="">Thank you for any hints on where to start fixing this,</div>
<div class=""><br class="">
</div>
<div class="">Kind regards,</div>
<div class=""><br class="">
</div>
<div class="">—</div>
<div class="">Christophe</div>
<div class=""><br class="">
</div>
<div class="">—————— </div>
<div class=""><br class="">
</div>
<div class="">Here is the gluster info command for the volume.</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[root@stor104 glusterfs]# gluster volume info live</div>
<div class=""><br class="">
</div>
<div class="">Volume Name: live</div>
<div class="">Type: Distribute</div>
<div class="">Volume ID: 1328637d-7730-4627-8945-bbe43626d527</div>
<div class="">Status: Started</div>
<div class="">Number of Bricks: 9</div>
<div class="">Transport-type: tcp</div>
<div class="">Bricks:</div>
<div class="">Brick1: stor104:/zfs/brick0/brick</div>
<div class="">Brick2: stor104:/zfs/brick1/brick</div>
<div class="">Brick3: stor104:/zfs/brick2/brick</div>
<div class="">Brick4: stor106:/zfs/brick0/brick</div>
<div class="">Brick5: stor106:/zfs/brick1/brick</div>
<div class="">Brick6: stor106:/zfs/brick2/brick</div>
<div class="">Brick7: stor105:/zfs/brick0/brick</div>
<div class="">Brick8: stor105:/zfs/brick1/brick</div>
<div class="">Brick9: stor105:/zfs/brick2/brick</div>
<div class="">Options Reconfigured:</div>
<div class=""><a href="http://performance.io" class="">performance.io</a>-thread-count: 8</div>
<div class="">nfs.disable: on</div>
<div class="">performance.write-behind-window-size: 4MB</div>
<div class="">performance.client-io-threads: on</div>
<div class="">performance.cache-size: 1GB</div>
<div class="">performance.cache-refresh-timeout: 60</div>
<div class="">performance.cache-max-file-size: 4MB</div>
<div class="">cluster.data-self-heal-algorithm: full</div>
<div class="">diagnostics.client-log-level: ERROR</div>
<div class="">diagnostics.brick-log-level: ERROR</div>
<div class="">cluster.min-free-disk: 1%</div>
<div class="">server.allow-insecure: on</div>
<div class=""><br class="">
</div>
<div class="">Relevant log parts when carrying out the command:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">==> /var/log/glusterfs/cli.log <==</div>
<div class="">[2015-12-29 12:51:03.216998] I [cli.c:721:main] 0-cli: Started running gluster with version 3.7.6</div>
<div class="">[2015-12-29 12:51:03.226123] I [cli-cmd-volume.c:1926:cli_check_gsync_present] 0-: geo-replication not installed</div>
<div class="">[2015-12-29 12:51:03.226623] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1</div>
<div class="">[2015-12-29 12:51:03.226723] I [socket.c:2355:socket_event_handler] 0-transport: disconnecting now</div>
<div class=""><br class="">
</div>
<div class="">==> /var/log/glusterfs/cmd_history.log <==</div>
<div class="">[2015-12-29 12:51:03.236182] : volume status : SUCCESS</div>
<div class=""><br class="">
</div>
<div class="">==> /var/log/glusterfs/etc-glusterfs-glusterd.vol.log <==</div>
<div class="">[2015-12-29 12:51:03.238562] I [MSGID: 106499] [glusterd-handler.c:4267:__glusterd_handle_status_volume] 0-management: Received status volume req for volume live</div>
<div class="">[2015-12-29 12:51:03.246043] E [MSGID: 106396] [glusterd-op-sm.c:2985:_add_task_to_dict] 0-management: Statedump operation doesn't have a task_id</div>
<div class="">[2015-12-29 12:51:03.246081] E [MSGID: 106060] [glusterd-op-sm.c:3055:glusterd_aggregate_task_status] 0-management: Failed to add task details to dict</div>
<div class="">[2015-12-29 12:51:03.246098] E [MSGID: 106123] [glusterd-syncop.c:1404:gd_commit_op_phase] 0-management: Commit of operation 'Volume Status' failed on localhost</div>
<div class=""><br class="">
</div>
<div class="">==> /var/log/glusterfs/cmd_history.log <==</div>
<div class="">[2015-12-29 12:51:03.249364] : volume status : FAILED : Commit failed on localhost. Please check the log file for more details.</div>
<div class=""><br class="">
</div>
<div class="">==> /var/log/glusterfs/cli.log <==</div>
<div class="">[2015-12-29 12:51:03.249647] I [input.c:36:cli_batch] 0-: Exiting with: 0</div>
</div>
<div class=""><br class="">
</div>
<div class="">All bricks are up</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[root@highlander glusterfs]# pdsh -g live 'df -h | grep brick*'</div>
<div class="">stor106: brick0 50T 33T 18T 66% /zfs/brick0</div>
<div class="">stor106: brick1 50T 33T 18T 66% /zfs/brick1</div>
<div class="">stor106: brick2 50T 33T 18T 66% /zfs/brick2</div>
<div class="">stor105: brick0 40T 23T 18T 57% /zfs/brick0</div>
<div class="">stor105: brick1 40T 23T 18T 57% /zfs/brick1</div>
<div class="">stor105: brick2 40T 23T 18T 57% /zfs/brick2</div>
<div class="">stor104: brick0 40T 23T 18T 57% /zfs/brick0</div>
<div class="">stor104: brick1 40T 23T 18T 57% /zfs/brick1</div>
<div class="">stor104: brick2 40T 23T 18T 57% /zfs/brick2</div>
</div>
<div class=""><br class="">
</div>
<div class="">Package details</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[root@highlander glusterfs]# rpm -qa | grep gluster</div>
<div class="">glusterfs-client-xlators-3.7.6-1.el7.x86_64</div>
<div class="">glusterfs-server-3.7.6-1.el7.x86_64</div>
<div class="">samba-vfs-glusterfs-4.2.3-10.el7.x86_64</div>
<div class="">glusterfs-3.7.6-1.el7.x86_64</div>
<div class="">glusterfs-cli-3.7.6-1.el7.x86_64</div>
<div class="">glusterfs-libs-3.7.6-1.el7.x86_64</div>
<div class="">glusterfs-fuse-3.7.6-1.el7.x86_64</div>
<div class="">glusterfs-api-3.7.6-1.el7.x86_64</div>
<div class=""><br class="">
</div>
<div class="">[root@highlander glusterfs]# pdsh -g live 'rpm -qa | grep gluster'</div>
<div class="">stor105: glusterfs-libs-3.7.6-1.el7.x86_64</div>
<div class="">stor105: glusterfs-api-3.7.6-1.el7.x86_64</div>
<div class="">stor105: glusterfs-3.7.6-1.el7.x86_64</div>
<div class="">stor105: glusterfs-fuse-3.7.6-1.el7.x86_64</div>
<div class="">stor105: glusterfs-cli-3.7.6-1.el7.x86_64</div>
<div class="">stor105: glusterfs-client-xlators-3.7.6-1.el7.x86_64</div>
<div class="">stor105: glusterfs-server-3.7.6-1.el7.x86_64</div>
<div class=""><br class="">
</div>
<div class="">stor104: glusterfs-server-3.7.6-1.el7.x86_64</div>
<div class="">stor104: glusterfs-libs-3.7.6-1.el7.x86_64</div>
<div class="">stor104: glusterfs-api-3.7.6-1.el7.x86_64</div>
<div class="">stor104: glusterfs-3.7.6-1.el7.x86_64</div>
<div class="">stor104: glusterfs-fuse-3.7.6-1.el7.x86_64</div>
<div class="">stor104: glusterfs-cli-3.7.6-1.el7.x86_64</div>
<div class="">stor104: glusterfs-client-xlators-3.7.6-1.el7.x86_64</div>
<div class=""><br class="">
</div>
<div class="">stor106: glusterfs-3.7.6-1.el7.x86_64</div>
<div class="">stor106: glusterfs-cli-3.7.6-1.el7.x86_64</div>
<div class="">stor106: glusterfs-server-3.7.6-1.el7.x86_64</div>
<div class="">stor106: glusterfs-libs-3.7.6-1.el7.x86_64</div>
<div class="">stor106: glusterfs-client-xlators-3.7.6-1.el7.x86_64</div>
<div class="">stor106: glusterfs-api-3.7.6-1.el7.x86_64</div>
<div class="">stor106: glusterfs-fuse-3.7.6-1.el7.x86_64</div>
</div>
<div class=""><br class="">
</div>
<div class="">More detailled logs:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">==> /var/log/glusterfs/cli.log <==</div>
<div class="">[2015-12-29 12:57:23.520821] I [cli.c:721:main] 0-cli: Started running gluster with version 3.7.6</div>
<div class="">[2015-12-29 12:57:23.530898] I [cli-cmd-volume.c:1926:cli_check_gsync_present] 0-: geo-replication not installed</div>
<div class="">[2015-12-29 12:57:23.531844] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1</div>
<div class="">[2015-12-29 12:57:23.532004] I [socket.c:2355:socket_event_handler] 0-transport: disconnecting now</div>
<div class=""><br class="">
</div>
<div class="">==> /var/log/glusterfs/etc-glusterfs-glusterd.vol.log <==</div>
<div class="">[2015-12-29 12:57:23.534830] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = c2886398-03c1-4d32-924a-9f92367be85c</div>
<div class="">[2015-12-29 12:57:23.534946] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : c2886398-03c1-4d32-924a-9f92367be85c</div>
<div class="">[2015-12-29 12:57:23.534975] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.535001] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : c2886398-03c1-4d32-924a-9f92367be85c</div>
<div class="">[2015-12-29 12:57:23.535031] D [MSGID: 0] [glusterd-syncop.c:1807:gd_sync_task_begin] 0-glusterd: Failed to get volume name</div>
<div class="">[2015-12-29 12:57:23.535078] D [MSGID: 0] [glusterd-op-sm.c:1695:glusterd_op_stage_status_volume] 0-management: Returning: 0</div>
<div class="">[2015-12-29 12:57:23.535103] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 18. Returning 0</div>
<div class="">[2015-12-29 12:57:23.535555] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x192)[0x7f410a9d5a82] (--> /lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked+0x8b)[0x7f410a7a587b] (-->
/lib64/libgfrpc.so.0(+0x13e74)[0x7f410a7a5e74] (--> /lib64/libgfrpc.so.0(rpc_clnt_submit+0x34f)[0x7f410a7a1c4f] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(gd_syncop_submit_request+0x1a5)[0x7f40ff5d24b5] ))))) 0-: 192.168.123.105:24007: ping timer
event already removed</div>
<div class="">[2015-12-29 12:57:23.535935] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x192)[0x7f410a9d5a82] (--> /lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked+0x8b)[0x7f410a7a587b] (-->
/lib64/libgfrpc.so.0(+0x13e74)[0x7f410a7a5e74] (--> /lib64/libgfrpc.so.0(rpc_clnt_submit+0x34f)[0x7f410a7a1c4f] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(gd_syncop_submit_request+0x1a5)[0x7f40ff5d24b5] ))))) 0-: 192.168.123.1:24007: ping timer
event already removed</div>
<div class="">[2015-12-29 12:57:23.536279] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x192)[0x7f410a9d5a82] (--> /lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked+0x8b)[0x7f410a7a587b] (-->
/lib64/libgfrpc.so.0(+0x13e74)[0x7f410a7a5e74] (--> /lib64/libgfrpc.so.0(rpc_clnt_submit+0x34f)[0x7f410a7a1c4f] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(gd_syncop_submit_request+0x1a5)[0x7f40ff5d24b5] ))))) 0-: 192.168.123.106:24007: ping timer
event already removed</div>
<div class="">[2015-12-29 12:57:23.536358] D [MSGID: 0] [glusterd-syncop.c:1312:gd_stage_op_phase] 0-management: Sent stage op req for 'Volume Status' to 3 peers</div>
<div class="">[2015-12-29 12:57:23.538064] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster</div>
<div class="">[2015-12-29 12:57:23.539059] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk</div>
<div class="">The message "D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster" repeated 2 times between [2015-12-29 12:57:23.538064] and [2015-12-29 12:57:23.538833]</div>
<div class="">[2015-12-29 12:57:23.539057] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.539163] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks</div>
<div class="">[2015-12-29 12:57:23.539213] D [MSGID: 0] [glusterd-op-sm.c:3360:glusterd_op_status_volume] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.539237] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.541960] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster</div>
<div class="">[2015-12-29 12:57:23.542525] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk</div>
<div class="">The message "D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster" repeated 2 times between [2015-12-29 12:57:23.541960] and [2015-12-29 12:57:23.542186]</div>
<div class="">[2015-12-29 12:57:23.542523] D [MSGID: 0] [glusterd-syncop.c:1449:gd_commit_op_phase] 0-management: Sent commit op req for 'Volume Status' to 3 peers</div>
<div class="">[2015-12-29 12:57:23.542643] D [MSGID: 0] [glusterd-op-sm.c:4487:glusterd_op_modify_op_ctx] 0-management: op_ctx modification not required for status operation being performed</div>
<div class="">[2015-12-29 12:57:23.542680] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : c2886398-03c1-4d32-924a-9f92367be85c</div>
<div class="">[2015-12-29 12:57:23.542704] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.542732] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : c2886398-03c1-4d32-924a-9f92367be85c</div>
<div class="">[2015-12-29 12:57:23.542756] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0</div>
<div class=""><br class="">
</div>
<div class="">==> /var/log/glusterfs/cmd_history.log <==</div>
<div class="">[2015-12-29 12:57:23.542781] : volume status : SUCCESS</div>
<div class=""><br class="">
</div>
<div class="">==> /var/log/glusterfs/etc-glusterfs-glusterd.vol.log <==</div>
<div class="">[2015-12-29 12:57:23.542847] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.545697] I [MSGID: 106499] [glusterd-handler.c:4267:__glusterd_handle_status_volume] 0-management: Received status volume req for volume live</div>
<div class="">[2015-12-29 12:57:23.545818] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = fd3671e4-fa7a-4913-a6dd-b37884a3a715</div>
<div class="">[2015-12-29 12:57:23.545872] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : fd3671e4-fa7a-4913-a6dd-b37884a3a715</div>
<div class="">[2015-12-29 12:57:23.545905] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.545926] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : fd3671e4-fa7a-4913-a6dd-b37884a3a715</div>
<div class="">[2015-12-29 12:57:23.545978] D [MSGID: 0] [glusterd-locks.c:562:glusterd_mgmt_v3_lock] 0-management: Trying to acquire lock of vol live for 305c0f00-0f11-4da3-a470-50b6e6c14976 as live_vol</div>
<div class="">[2015-12-29 12:57:23.546388] D [MSGID: 0] [glusterd-locks.c:618:glusterd_mgmt_v3_lock] 0-management: Lock for vol live successfully held by 305c0f00-0f11-4da3-a470-50b6e6c14976</div>
<div class="">[2015-12-29 12:57:23.546478] D [MSGID: 0] [glusterd-syncop.c:411:gd_syncop_mgmt_v3_lock] 0-glusterd: Returning 0</div>
<div class="">[2015-12-29 12:57:23.549943] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk</div>
<div class="">The message "D [MSGID: 0] [glusterd-syncop.c:411:gd_syncop_mgmt_v3_lock] 0-glusterd: Returning 0" repeated 2 times between [2015-12-29 12:57:23.546478] and [2015-12-29 12:57:23.546565]</div>
<div class="">[2015-12-29 12:57:23.549941] D [MSGID: 0] [glusterd-syncop.c:1205:gd_lock_op_phase] 0-management: Sent lock op req for 'Volume Status' to 3 peers. Returning 0</div>
<div class="">[2015-12-29 12:57:23.550063] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume live found</div>
<div class="">[2015-12-29 12:57:23.550087] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.550121] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume live found</div>
<div class="">[2015-12-29 12:57:23.550140] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.550167] D [MSGID: 0] [glusterd-op-sm.c:1695:glusterd_op_stage_status_volume] 0-management: Returning: 0</div>
<div class="">[2015-12-29 12:57:23.550192] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 18. Returning 0</div>
<div class="">[2015-12-29 12:57:23.550309] D [MSGID: 0] [glusterd-syncop.c:1312:gd_stage_op_phase] 0-management: Sent stage op req for 'Volume Status' to 3 peers</div>
<div class="">[2015-12-29 12:57:23.552791] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster</div>
<div class="">[2015-12-29 12:57:23.553395] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk</div>
<div class="">The message "D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster" repeated 2 times between [2015-12-29 12:57:23.552791] and [2015-12-29 12:57:23.553087]</div>
<div class="">[2015-12-29 12:57:23.553394] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.553499] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks</div>
<div class="">[2015-12-29 12:57:23.553535] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume live found</div>
<div class="">[2015-12-29 12:57:23.553556] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.553786] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume live</div>
<div class="">[2015-12-29 12:57:23.554065] E [MSGID: 106396] [glusterd-op-sm.c:2985:_add_task_to_dict] 0-management: Statedump operation doesn't have a task_id</div>
<div class="">[2015-12-29 12:57:23.554097] E [MSGID: 106060] [glusterd-op-sm.c:3055:glusterd_aggregate_task_status] 0-management: Failed to add task details to dict</div>
<div class="">[2015-12-29 12:57:23.554117] D [MSGID: 0] [glusterd-op-sm.c:3360:glusterd_op_status_volume] 0-management: Returning -1</div>
<div class="">[2015-12-29 12:57:23.554135] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning -1</div>
<div class="">[2015-12-29 12:57:23.554155] E [MSGID: 106123] [glusterd-syncop.c:1404:gd_commit_op_phase] 0-management: Commit of operation 'Volume Status' failed on localhost</div>
<div class="">[2015-12-29 12:57:23.554240] D [MSGID: 0] [glusterd-syncop.c:510:gd_syncop_mgmt_v3_unlock] 0-glusterd: Returning 0</div>
<div class="">[2015-12-29 12:57:23.557147] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk</div>
<div class="">The message "D [MSGID: 0] [glusterd-syncop.c:510:gd_syncop_mgmt_v3_unlock] 0-glusterd: Returning 0" repeated 2 times between [2015-12-29 12:57:23.554240] and [2015-12-29 12:57:23.554319]</div>
<div class="">[2015-12-29 12:57:23.557146] D [MSGID: 0] [glusterd-syncop.c:1558:gd_unlock_op_phase] 0-management: Sent unlock op req for 'Volume Status' to 3 peers. Returning 0</div>
<div class="">[2015-12-29 12:57:23.557255] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol live for 305c0f00-0f11-4da3-a470-50b6e6c14976 as live_vol</div>
<div class="">[2015-12-29 12:57:23.557286] D [MSGID: 0] [glusterd-locks.c:714:glusterd_mgmt_v3_unlock] 0-management: Lock for vol live successfully released</div>
<div class="">[2015-12-29 12:57:23.557312] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : fd3671e4-fa7a-4913-a6dd-b37884a3a715</div>
<div class="">[2015-12-29 12:57:23.557332] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0</div>
<div class="">[2015-12-29 12:57:23.557356] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : fd3671e4-fa7a-4913-a6dd-b37884a3a715</div>
<div class="">[2015-12-29 12:57:23.557420] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0</div>
<div class=""><br class="">
</div>
<div class="">==> /var/log/glusterfs/cmd_history.log <==</div>
<div class="">[2015-12-29 12:57:23.557447] : volume status : FAILED : Commit failed on localhost. Please check the log file for more details.</div>
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<p style="font-family: Arial, sans-serif; font-size: 10pt; line-height: 16px; color: rgb(33, 33, 33);" class="">
<span style="font-weight: bold; color: rgb(61, 59, 59); display: inline;" class="">Dr Christophe Trefois, Dipl.-Ing.</span><span class="Apple-converted-space"> </span><span class="Apple-converted-space"> </span><span style="display: inline;" class=""></span><br class="">
<span style="color: rgb(61, 59, 59); display: inline; font-size: 7.5pt;" class="">Technical Specialist / Post-Doc</span></p>
<p style="font-family: Arial, sans-serif; font-size: 7.5pt; line-height: 16px;" class="">
<span style="font-weight: bold; color: rgb(61, 59, 59); display: inline;" class="">UNIVERSITÉ DU LUXEMBOURG</span><br class="">
<span style="display: inline;" class=""><br class="">
</span><span style="font-weight: bold; color: rgb(61, 59, 59); display: inline;" class="">LUXEMBOURG CENTRE FOR SYSTEMS BIOMEDICINE</span><br class="">
<span style="color: rgb(61, 59, 59); display: inline;" class="">Campus Belval | House of Biomedicine<span class="Apple-converted-space"> </span><span class="Apple-converted-space"> </span><br class="">
<span class="Apple-converted-space">6, avenue du Swing </span><br class="">
L-4367 Belvaux<span class="Apple-converted-space"> </span><span class="Apple-converted-space"> </span></span><br class="">
<span style="color: rgb(61, 59, 59); display: inline;" class="">T:<span class="Apple-converted-space"> </span></span><span style="color: rgb(61, 59, 59); display: inline;" class="">+352 46 66 44 6124</span><span class="Apple-converted-space"> </span><br class="">
<span style="color: rgb(61, 59, 59); display: inline;" class="">F:<span class="Apple-converted-space"> </span></span><span style="color: rgb(61, 59, 59); display: inline;" class="">+352 46 66 44 6949</span><span class="Apple-converted-space"> </span><span class="Apple-converted-space"> </span><span style="display: inline;" class=""><br class="">
</span><a href="http://www.uni.lu/lcsb" style="color: rgb(0, 109, 189); display: inline;" class="">http://www.uni.lu/lcsb</a></p>
<p style="font-family: Arial, sans-serif; font-size: 14px; line-height: 16px;" class="">
<a href="https://www.facebook.com/trefex" style="display: inline;" class=""><img width="24" height="24" data-filename="facebook.png" src="https://s3.amazonaws.com/htmlsig-assets/rounded/facebook.png" alt="Facebook" class=""></a><span class="Apple-converted-space"> </span><span class="Apple-converted-space"> </span><a href="https://twitter.com/Trefex" style="display: inline;" class=""><img width="24" height="24" data-filename="twitter.png" src="https://s3.amazonaws.com/htmlsig-assets/rounded/twitter.png" alt="Twitter" class=""></a><span class="Apple-converted-space"> </span><span class="Apple-converted-space"> </span><a href="https://plus.google.com/+ChristopheTrefois/" style="display: inline;" class=""><img width="24" height="24" data-filename="googleplus.png" src="https://s3.amazonaws.com/htmlsig-assets/rounded/googleplus.png" alt="Google Plus" class=""></a><span class="Apple-converted-space"> </span><span class="Apple-converted-space"> </span><a href="https://www.linkedin.com/in/trefoischristophe" style="display: inline;" class=""><img width="24" height="24" data-filename="linkedin.png" src="https://s3.amazonaws.com/htmlsig-assets/rounded/linkedin.png" alt="Linkedin" class=""></a><span class="Apple-converted-space"> </span><span class="Apple-converted-space"> </span><a href="http://skype:Trefex?call" style="display: inline;" class=""><img width="24" height="24" data-filename="skype.png" src="https://s3.amazonaws.com/htmlsig-assets/rounded/skype.png" alt="skype" class=""></a></p>
<p class="banner-container" style="font-family: Arial, sans-serif; font-size: 14px; line-height: 16px;">
</p>
<p style="font-family: Arial, sans-serif; color: rgb(61, 59, 59); font-size: 9px; line-height: 16px;" class="">
----<br class="">
This message is confidential and may contain privileged information.<span class="Apple-converted-space"> </span><br class="">
It is intended for the named recipient only.<span class="Apple-converted-space"> </span><br class="">
If you receive it in error please notify me and permanently delete the original message and any copies.<span class="Apple-converted-space"> </span><br class="">
----<br class="">
</p>
<span class="Apple-converted-space"> </span></div>
</div>
<br class="">
</div>
</body>
</html>