<div dir="ltr">Hello,<div><br></div><div>We've just installed two new Gluster servers and rsync'd the data over from the old servers. I ran Joe's xattr command and was able to successfully recreate the one volume we are migrating.</div><div><br></div><div>However, after starting the volume, and even creating a new, empty volume with little data, the self-heal daemon quickly dies. All the ports seem open on the the other server, and issue in the logs seem to be connecting to localhost with a connection timeout? I've stopped iptables and made sure firewalld isn't running. Even then, the issue persists.</div><div><br></div><div>Has anyone seen this and can anyone shed some light?</div><div><br></div><div><p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">tail glustershd.log </p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-02 21:35:20.156998] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.6.1 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/lib/glusterd/glustershd/run/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/906ee9c6967f0e08e8fd8a30e56106ae.socket --xlator-option *replicate*.node-uuid=b66320ef-432f-4ed2-bc71-51fdfab46744)</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-02 21:37:27.443755] E [socket.c:2267:socket_connect_finish] 0-glusterfs: connection to <a href="http://127.0.0.1:24007">127.0.0.1:24007</a> failed (Connection timed out)</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-02 21:37:27.443851] E [glusterfsd-mgmt.c:1811:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-02 21:37:27.443868] I [glusterfsd-mgmt.c:1817:mgmt_rpc_notify] 0-glusterfsd-mgmt: Exhausted all volfile servers</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-02 21:37:27.444137] W [glusterfsd.c:1194:cleanup_and_exit] (--> 0-: received signum (1), shutting down</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-03 15:32:58.044137] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.6.1 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/lib/glusterd/glustershd/run/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/906ee9c6967f0e08e8fd8a30e56106ae.socket --xlator-option *replicate*.node-uuid=b66320ef-432f-4ed2-bc71-51fdfab46744)</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-03 15:35:05.363713] E [socket.c:2267:socket_connect_finish] 0-glusterfs: connection to <a href="http://127.0.0.1:24007">127.0.0.1:24007</a> failed (Connection timed out)</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-03 15:35:05.363813] E [glusterfsd-mgmt.c:1811:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-03 15:35:05.363829] I [glusterfsd-mgmt.c:1817:mgmt_rpc_notify] 0-glusterfsd-mgmt: Exhausted all volfile servers</p>
<p style="margin:0px;font-size:16px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">[2015-01-03 15:35:05.364232] W [glusterfsd.c:1194:cleanup_and_exit] (--> 0-: received signum (1), shutting down</p></div></div>