<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On 19 March 2015 at 17:48, 何亦军 <span dir="ltr"><<a href="mailto:heyijun@greatwall.com.cn" target="_blank">heyijun@greatwall.com.cn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt">Thanks, MS.<br>
<br>
My problem resolved.<span class=""><br></span></div></div></blockquote><div>Great... <br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt"><span class="">
<br>
Volume Name: vol01<br>
Type: Distributed-Replicate<br>
Volume ID: 0bcd8d7c-b48a-4408-b7b8-56d4b5f8a97c<br>
Status: Started<br></span><span class="">
Number of Bricks: 3 x 2 = 6<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: gwgfs01:/data/brick1/vol01<br>
Brick2: gwgfs03:/data/brick2/vol01<br>
Brick3: gwgfs01:/data/brick2/vol01<br>
Brick4: gwgfs02:/data/brick2/vol01<br></span><span class="">
Brick5: gwgfs02:/data/brick1/vol01<br>
Brick6: gwgfs03:/data/brick1/vol01<br>
<br>
<br></span>
I have last question, What are correct procedure like my requirement? I didn't find any similar case in document.
<br>
<br>
Environment: Every node have two brick, Distributed-Replicate<br>
Requirement: Add node to pool<br></div></div></blockquote><div><br></div><div>peer probe to add new node to the pool and add_brick + rebalance *is* the correct procedure to expand the volume (increase the storage space) <br><br></div><div>MS<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt">
<br>
<br>
<div style="font-family:Times New Roman;color:#000000;font-size:16px">
<hr>
<div style="direction:ltr"><font color="#000000" face="Tahoma"><b>发件人:</b> M S Vishwanath Bhat [<a href="mailto:msvbhat@gmail.com" target="_blank">msvbhat@gmail.com</a>]<br>
<b>发送时间:</b> 2015年3月19日 18:27<br>
<b>收件人:</b> 何亦军<br>
<b>抄送:</b> <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
<b>主题:</b> Re: [Gluster-users] Add brick question.<br>
</font><br>
</div><div><div class="h5">
<div></div>
<div>
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On 19 March 2015 at 14:59, 何亦军 <span dir="ltr"><<a href="mailto:heyijun@greatwall.com.cn" target="_blank">heyijun@greatwall.com.cn</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="ZH-CN">
<div>
<p class="MsoNormal"><span lang="EN-US">Hi Guys,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> I have two servers in my pool , I plan add new server to that pool.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> My volume info below:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> Volume Name: vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Type: Distributed-Replicate<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Volume ID: 0bcd8d7c-b48a-4408-b7b8-56d4b5f8a97c<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Status: Started<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Number of Bricks: 2 x 2 = 4<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Transport-type: tcp<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Bricks:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick1: gwgfs01:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick2: gwgfs02:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick3: gwgfs01:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick4: gwgfs02:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">I plan to form a combination:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick1: gwgfs01:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick2: gwgfs03:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick3: gwgfs01:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick4: gwgfs02:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick5: gwgfs02:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick6: gwgfs03:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">My processing steps</span><span style="font-family:宋体">：</span><span lang="EN-US"><u></u><u></u></span></p>
<p style="margin-left:39pt"><u></u><span lang="EN-US"><span>1.<span style="font:7pt "Times New Roman"">
</span></span></span><u></u><span lang="EN-US">gluster peer probe gwgfs03<u></u><u></u></span></p>
<p style="margin-left:39pt"><u></u><span lang="EN-US"><span>2.<span style="font:7pt "Times New Roman"">
</span></span></span><u></u><span lang="EN-US">gluster volume replace-brick vol01 gwgfs02:/data/brick1/vol01 gwgfs03:/data/brick2/vol01 status<u></u><u></u></span></p>
<p style="margin-left:39pt"><u></u><span lang="EN-US"><span>3.<span style="font:7pt "Times New Roman"">
</span></span></span><u></u><span lang="EN-US">After replace completed, do: gluster volume rebalance vol01 start</span></p>
</div>
</div>
</blockquote>
<div> <br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="ZH-CN">
<div>
<p style="margin-left:39pt"><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">And finally I try to add brick meet problem:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">[root@gwgfs03 vol01]# gluster volume add-brick vol01 gwgfs02:/data/brick1/vol01 gwgfs03:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">volume add-brick: failed: /data/brick1/vol01 is already part of a volume</span></p>
</div>
</div>
</blockquote>
<div><br>
</div>
<div><br>
The brick directory will have some xattrs while being part of the volume. So you will have to remove the xattrs from the directory before adding the brick to the volume again. You can simply delete the directory and re-create it again.<br>
<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="ZH-CN">
<div>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">[root@gwgfs03 vol01]# gluster volume remove-brick vol01 gwgfs02:/data/brick1/vol01 start<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">volume remove-brick start: failed: Remove brick incorrect brick count of 1 for replica 2</span></p>
</div>
</div>
</blockquote>
<div><br>
</div>
<div>Since you have replica 2 volume, you should add/remove at least 2 bricks at a time. You can try the following (after you delete and re-create
<span lang="EN-US">gwgfs02:/data/brick1/vol01)</span><br>
<br>
</div>
<div>gluster volume add-brick vol01 <span lang="EN-US">gwgfs02:/data/brick1/vol01
</span><span lang="EN-US">gwgfs03:/data/brick1/vol01<br>
<br>
</span></div>
<div><span lang="EN-US">HTH<br>
</span></div>
<div><span lang="EN-US">MS<br>
</span></div>
<div><span lang="EN-US"><br>
</span></div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="ZH-CN">
<div>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Current , my volume info below: What can I do now? Help?<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">[root@gwgfs03 vol01]# gluster volume info<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Volume Name: vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Type: Distributed-Replicate<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Volume ID: 0bcd8d7c-b48a-4408-b7b8-56d4b5f8a97c<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Status: Started<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Number of Bricks: 2 x 2 = 4<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Transport-type: tcp<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Bricks:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick1: gwgfs01:/data/brick1/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick2: gwgfs03:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick3: gwgfs01:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Brick4: gwgfs02:/data/brick2/vol01<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">Options Reconfigured:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">nfs.disable: on<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">user.cifs: disable<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US">auth.allow: *<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-left:21pt"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
</div>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div></div></div>
</div>
</div>
</blockquote></div><br></div></div>