[Gluster-users] Transport endpoint is not connected

[Holger Steinhaus]

I am using the rpms from the epel repository (currently 3.2.5-8.el6) on
Scientific Linux 6.2. My test setup consists of two machines, running
several volumes with replica=2. I am experiencing a lot of trouble
currently, especially I/O errors on random files if using the fuse
client after one machine was temporarily down.

The first strange thing in the logfiles is a bunch of the following
messages (>500 MB/week) in etc-glusterfs-glusterd.vol.log on one node
(192.168.2.9). There are no messages on the other node.

Firewall and SELinux are disabled.

Any suggestions?

Regards,
  Holger
------------------------------------------------------------------------
[2012-03-20 19:26:46.347926] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:46.347958] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:46.347987] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:46.348016] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:46.348045] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:46.348073] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:46.758118] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.4:988)
[2012-03-20 19:26:46.759507] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.4:987)
[2012-03-20 19:26:47.117369] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:780)
[2012-03-20 19:26:47.122469] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:761)
[2012-03-20 19:26:47.359062] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.8:997)
[2012-03-20 19:26:47.651679] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:984)
[2012-03-20 19:26:48.37491] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1017)
[2012-03-20 19:26:48.127588] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:977)
[2012-03-20 19:26:48.133402] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:976)
[2012-03-20 19:26:48.170200] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:975)
[2012-03-20 19:26:48.187941] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1016)
[2012-03-20 19:26:48.193975] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1015)
[2012-03-20 19:26:48.198601] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1013)
[2012-03-20 19:26:48.203602] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1012)
[2012-03-20 19:26:48.208457] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1006)
[2012-03-20 19:26:48.278537] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1005)
[2012-03-20 19:26:48.794218] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.4:986)
[2012-03-20 19:26:48.861831] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:974)
[2012-03-20 19:26:48.947367] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:973)
[2012-03-20 19:26:49.82867] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:970)
[2012-03-20 19:26:49.138542] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:969)
[2012-03-20 19:26:49.143393] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:968)
[2012-03-20 19:26:49.148482] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:965)
[2012-03-20 19:26:49.213986] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1004)
[2012-03-20 19:26:49.219398] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.7:1003)
[2012-03-20 19:26:49.298073] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.9:964)
[2012-03-20 19:26:49.348780] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:49.348853] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:49.348884] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:49.348912] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:49.348940] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:49.348968] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:49.348996] E [socket.c:2080:socket_connect]
0-management: connection attempt failed (Connection refused)
[2012-03-20 19:26:49.361451] W
[socket.c:1494:__socket_proto_state_machine] 0-socket.management:
reading from socket failed. Error (Transport endpoint is not connected),
peer (192.168.2.8:1019)
------------------------------------------------------------------------