<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On 19 March 2015 at 14:59, 何亦军 <span dir="ltr">&lt;<a href="mailto:heyijun@greatwall.com.cn" target="_blank">heyijun@greatwall.com.cn</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">





<div link="#0563C1" vlink="#954F72" lang="ZH-CN">
<div>
<p class="MsoNormal"><span lang="EN-US">Hi Guys,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">     I have two servers in my pool , I plan add new server to that pool.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">     My volume info below:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">    Volume Name: vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Type: Distributed-Replicate<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Volume ID: 0bcd8d7c-b48a-4408-b7b8-56d4b5f8a97c<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Status: Started<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Number of Bricks: 2 x 2 = 4<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Transport-type: tcp<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Bricks:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick1: gwgfs01:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick2: gwgfs02:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick3: gwgfs01:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick4: gwgfs02:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">I plan to form a combination:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick1: gwgfs01:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick2: gwgfs03:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick3: gwgfs01:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick4: gwgfs02:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick5: gwgfs02:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick6: gwgfs03:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">My processing steps</span><span style="font-family:宋体">:</span><span lang="EN-US"><u></u><u></u></span></p>
<p style="margin-left:39pt">
<u></u><span lang="EN-US"><span>1.<span style="font:7pt &quot;Times New Roman&quot;">      
</span></span></span><u></u><span lang="EN-US">gluster peer probe gwgfs03<u></u><u></u></span></p>
<p style="margin-left:39pt">
<u></u><span lang="EN-US"><span>2.<span style="font:7pt &quot;Times New Roman&quot;">      
</span></span></span><u></u><span lang="EN-US">gluster volume replace-brick vol01 gwgfs02:/data/brick1/vol01  gwgfs03:/data/brick2/vol01 status<u></u><u></u></span></p>
<p style="margin-left:39pt">
<u></u><span lang="EN-US"><span>3.<span style="font:7pt &quot;Times New Roman&quot;">      
</span></span></span><u></u><span lang="EN-US">After replace completed, do: gluster volume rebalance vol01 start</span></p></div></div></blockquote><div> <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div link="#0563C1" vlink="#954F72" lang="ZH-CN"><div><p style="margin-left:39pt"><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">And  finally  I try to add brick meet problem:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">[root@gwgfs03 vol01]# gluster volume add-brick vol01 gwgfs02:/data/brick1/vol01  gwgfs03:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">volume add-brick: failed: /data/brick1/vol01 is already part of a volume</span></p></div></div></blockquote><div><br></div><div><br>The brick directory will have some xattrs while being part of the volume. So you will have to remove the xattrs from the directory before adding the brick to the volume again. You can simply delete the directory and re-create it again.<br><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div link="#0563C1" vlink="#954F72" lang="ZH-CN"><div><p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">[root@gwgfs03 vol01]# gluster volume remove-brick vol01 gwgfs02:/data/brick1/vol01 start<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">volume remove-brick start: failed: Remove brick incorrect brick count of 1 for replica 2</span></p></div></div></blockquote><div><br></div><div>Since you have replica 2 volume, you should add/remove at least 2 bricks at a time. You can try the following (after you delete and re-create <span lang="EN-US">gwgfs02:/data/brick1/vol01)</span><br><br></div><div>gluster volume add-brick vol01  <span lang="EN-US">gwgfs02:/data/brick1/vol01 </span><span lang="EN-US">gwgfs03:/data/brick1/vol01<br><br></span></div><div><span lang="EN-US">HTH<br></span></div><div><span lang="EN-US">MS<br></span></div><div><span lang="EN-US"><br></span></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div link="#0563C1" vlink="#954F72" lang="ZH-CN"><div><p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Current , my volume info below:    What can I do now? Help?<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">[root@gwgfs03 vol01]# gluster volume info<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Volume Name: vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Type: Distributed-Replicate<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Volume ID: 0bcd8d7c-b48a-4408-b7b8-56d4b5f8a97c<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Status: Started<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Number of Bricks: 2 x 2 = 4<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Transport-type: tcp<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Bricks:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick1: gwgfs01:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick2: gwgfs03:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick3: gwgfs01:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick4: gwgfs02:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Options Reconfigured:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">nfs.disable: on<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">user.cifs: disable<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">auth.allow: *<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
</div>

<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div></div>