<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Fri, Aug 26, 2016 at 8:40 PM, David Gossage <span dir="ltr"><<a href="mailto:dgossage@carouselchecks.com" target="_blank">dgossage@carouselchecks.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">I was in process of redoing underlying disk layout for a brick. triggered full heal. then realized I had skipped a step of applying zfs set xattr=sa which is kind of important running zfs under linux.<div><br></div><div>Rather than wait however many hours until my TB of data heals is their a command in 3.8 to cancel a heal begun by gluster volume heal GLUSTER1 full? If not won't be end of world just waste of time to wait and then have to redo after writing out a TB of data.</div><span class=""><font color="#888888"><div><br></div></font></span></div></blockquote><div><br></div><div>Does the heal process crawl from any particular node when invoked? I have 3 nodes. I ran command from node 3, node 2 is one with files needing healed, node 1 is brick I heaeld yesterday but forgot to set xattr=sa on which usually has bad performance results for zfsonlinux. I did set it about 30 minutes into the heal figuring better some than none until I could redo it again.</div><div><br></div><div>12 hours later the 1TB of data was healed so I figured I'd move on to node 2, then 3. Then assuming 12 hour windows for each node I could redo node 1 with correct settings before Monday. When node 1 healed it first found all the visible files from mount point and .glusterfs, hen numbers jumped back up after those were done and it started finding shards. It happened fairly quickly. 2nd time around with node 2 it is crawling to a standstill while finding all the shards to heal. I'm wondering if its doing the crawl from node 1 and the poor settings that existed for first 30 minutes of file heals is slowing it down. If so I would hope once the files that were created/healed while settings weren't correct are found and it moves past them the rest should go faster.</div><div><br></div><div>The only errors in any logs are brick logs</div><div><br></div><div><div>[2016-08-27 14:25:10.022786] E [MSGID: 115050] [server-rpc-fops.c:156:server_lookup_cbk] 0-GLUSTER1-server: 3251237: LOOKUP (null) (00000000-0000-0000-0000-000000000000/4c7d44fc-a0c1-413b-8dc4-2abbbe1d4d4f.423) ==> (Invalid argument) [Invalid argument]</div><div>[2016-08-27 14:36:59.234073] W [MSGID: 115009] [server-resolve.c:569:server_resolve] 0-GLUSTER1-server: no resolution type for (null) (LOOKUP)</div><div>[2016-08-27 14:36:59.234128] E [MSGID: 115050] [server-rpc-fops.c:156:server_lookup_cbk] 0-GLUSTER1-server: 3288322: LOOKUP (null) (00000000-0000-0000-0000-000000000000/4c7d44fc-a0c1-413b-8dc4-2abbbe1d4d4f.328) ==> (Invalid argument) [Invalid argument]</div></div><div><br></div><div>And I would hope that it's just related to heal process or when a shard is hit and its found it doesnt exist here it errors out as expected.</div><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><span class=""><font color="#888888"><div></div><div><br clear="all"><div><div data-smartmail="gmail_signature"><div dir="ltr"><span><font color="#888888"><span style="color:rgb(0,0,0)"><b><i>David Gossage</i></b></span><font><i><span style="color:rgb(51,51,51)"><b><br>
</b></span></i></font></font></span><div><span><font color="#888888"><font><i><span style="color:rgb(51,51,51)"></span></i><font size="1"><b style="color:rgb(153,0,0)">Carousel Checks Inc.<span style="color:rgb(204,204,204)"> | System Administrator</span></b></font></font><font style="color:rgb(153,153,153)"><font size="1"><br>
</font></font><font><font size="1"><span style="color:rgb(51,51,51)"><b style="color:rgb(153,153,153)">Office</b><span style="color:rgb(153,153,153)"> <a value="+17086132426">708.613.2284<font color="#888888"><font size="1"><br></font></font></a></span></span></font></font></font></span></div></div></div></div>
</div></font></span></div>
</blockquote></div><br></div></div>