<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Jiri,<div class=""><br class=""></div><div class="">I’ve updated the op-version yesterday online without any problems, so I hope to be able to migrate my old bricks to the new tomorrow night without hassle using the remove brick command once all new bricks are added.</div><div class=""><br class=""></div><div class="">My new bricks are smaller than the current ones but higher in number so I could’t use the replace brick in any case…</div><div class=""><br class=""></div><div class="">thanks for the support….<br class=""><div class="">
<div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class="Apple-interchange-newline">Met vriendelijke groet / kind regards,</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><b class="">Sander Zijlstra</b></div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">| Linux Engineer | SURFsara | Science Park 140 | 1098XG Amsterdam | T +31 (0)6 43 99 12 47 | <a href="mailto:sander.zijlstra@surfsara.nl" class="">sander.zijlstra@surfsara.nl</a> | <a href="http://www.surfsara.nl" class="">www.surfsara.nl</a> |<br class=""><br class=""><i class="">Regular day off on friday</i></div>
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On 16 Apr 2015, at 08:58, Jiri Hoogeveen <<a href="mailto:j.hoogeveen@bluebillywig.com" class="">j.hoogeveen@bluebillywig.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi Sander,<div class=""><br class=""></div><div class="">Sorry for not getting back to you.</div><div class=""><br class=""></div><div class="">I guess, when you don’t use quota you do not need to run the scripts.</div><div class=""><br class=""></div><div class="">I do not have any experience changing the op-version on a running glusterfs cluster. But looking at some threads, it should be possible to change it on a running glusterfs cluster. But I think, only when all clients are the same version has the server.</div><div class=""><br class=""></div><div class="">And good luck this weekend.</div><div class=""><br class=""></div><div class="">Grtz, Jiri</div><div class=""><br class=""><div class=""><div class=""><blockquote type="cite" class=""><div class="">On 14 Apr 2015, at 15:15, Sander Zijlstra <<a href="mailto:sander.zijlstra@surfsara.nl" class="">sander.zijlstra@surfsara.nl</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Jiri,<div class=""><br class=""></div><div class="">thanks, I totally missed the op-version part as it’s not mentioned in the upgrade instructions as per the link you send. Actually I read that link and because I do not use quota I didn’t use that script either.</div><div class=""><br class=""></div><div class="">Can I update the op-version when the volume is online and currently doing a rebalance or shall I stop the rebalance, set the new op-version and then start the rebalance again?</div><div class=""><br class=""></div><div class="">many thanks for all the input….<br class=""><div class="">
<div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class="Apple-interchange-newline">Met vriendelijke groet / kind regards,</div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><b class="">Sander Zijlstra</b></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">| Linux Engineer | SURFsara | Science Park 140 | 1098XG Amsterdam | T +31 (0)6 43 99 12 47 | <a href="mailto:sander.zijlstra@surfsara.nl" class="">sander.zijlstra@surfsara.nl</a> | <a href="http://www.surfsara.nl/" class="">www.surfsara.nl</a> |<br class=""><br class=""><i class="">Regular day off on friday</i></div>
</div>
<br class=""><div class=""><blockquote type="cite" class=""><div class="">On 14 Apr 2015, at 15:01, Jiri Hoogeveen <<a href="mailto:j.hoogeveen@bluebillywig.com" class="">j.hoogeveen@bluebillywig.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi Sander,<div class=""><br class=""></div><div class="">If I take a look at <a href="http://www.gluster.org/community/documentation/index.php/OperatingVersions" class="">http://www.gluster.org/community/documentation/index.php/OperatingVersions</a></div><div class=""><br class=""></div><div class="">Then operating-version=2 is for glusterfs version 3.4, so I guess you still will be using the old style.</div><div class="">I think this is useful <a href="http://www.gluster.org/community/documentation/index.php/Upgrade_to_3.6" class="">http://www.gluster.org/community/documentation/index.php/Upgrade_to_3.6</a></div><div class=""><br class=""></div><div class="">And don’t forget to upgrade the clients also.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Grtz, Jiri</div><div class=""><br class=""></div><div class=""><div class=""><blockquote type="cite" class=""><div class="">On 14 Apr 2015, at 14:14, Sander Zijlstra <<a href="mailto:sander.zijlstra@surfsara.nl" class="">sander.zijlstra@surfsara.nl</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Jiri,<div class=""><br class=""></div><div class="">thanks for the information, I just commented on a question about op-version…. </div><div class=""><br class=""></div><div class="">I upgraded all systems to 3.6.2 does this mean they all will use the correct op-version and will not revert to old style behaviour?<br class=""><div class="">
<div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class="Apple-interchange-newline">Met vriendelijke groet / kind regards,</div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><b class="">Sander Zijlstra</b></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">| Linux Engineer | SURFsara | Science Park 140 | 1098XG Amsterdam | T +31 (0)6 43 99 12 47 | <a href="mailto:sander.zijlstra@surfsara.nl" class="">sander.zijlstra@surfsara.nl</a> | <a href="http://www.surfsara.nl/" class="">www.surfsara.nl</a> |<br class=""><br class=""><i class="">Regular day off on friday</i></div>
</div>
<br class=""><div class=""><blockquote type="cite" class=""><div class="">On 14 Apr 2015, at 14:11, Jiri Hoogeveen <<a href="mailto:j.hoogeveen@bluebillywig.com" class="">j.hoogeveen@bluebillywig.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi Sander,<div class=""><br class=""></div><div class=""><br class=""></div><div class=""><blockquote type="cite" class=""><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class=""><ul class="MailOutline"><li class="">Since version 3.6 the remove brick command migrates the data away from the brick being removed, right?</li></ul></div></div></blockquote><div class="">It should :)</div></div><div class=""><a href="https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/pdf/Administration_Guide/Red_Hat_Storage-3-Administration_Guide-en-US.pdf" class="">https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/pdf/Administration_Guide/Red_Hat_Storage-3-Administration_Guide-en-US.pdf</a> page 100, is I think a good start.</div><div class="">I think this is the most complete documentation.</div><div class=""><br class=""></div><div class=""><blockquote type="cite" class=""><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class=""><ul class="MailOutline"><li class="">When I have replicated bricks (replica 2), I also need to do "remove brick <volume> replica 2 brick1 brick2 …. , right?</li></ul></div></div></blockquote></div><div class="">Yes, you need to remove both replica’s at the same time.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><blockquote type="cite" class=""><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class=""><div class="">Last but not least, is there any way to tell how long a “remove brick” will take when it’s moving the data? I have dual 10GB ethernet between the cluster members and the brick storage is a RAID-6 set which can read 400-600MB/sec without any problems.</div><div class=""></div></div></div></blockquote></div><div class=""><br class=""></div><div class="">Depends on the size of the disk, the number of files and type of file. Network speed is less a issu, then the IO on the disks/brick.</div><div class="">To migratie data from one disk to a other (is like self-healing) GlusterFS will do a scan of all files on the disk, which can cause a high IO on the disk.</div><div class=""><br class=""></div><div class="">Because you had also some performance issues, when you added some bricks, I will expect the same issue with remove brick. So do this at night if possible.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Grtz, Jiri</div><div class=""><br class=""></div><div class=""><br class=""><div class=""><blockquote type="cite" class=""><div class="">On 14 Apr 2015, at 12:53, Sander Zijlstra <<a href="mailto:sander.zijlstra@surfsara.nl" class="">sander.zijlstra@surfsara.nl</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">LS,<div class=""><br class=""></div><div class="">I’m planning to decommission a few servers from my cluster, so to confirm:</div><div class=""><br class=""></div><div class=""><ul class="MailOutline"><li class="">Since version 3.6 the remove brick command migrates the data away from the brick being removed, right?</li><li class="">When I have replicated bricks (replica 2), I also need to do "remove brick <volume> replica 2 brick1 brick2 …. , right?</li></ul><div class=""><br class="webkit-block-placeholder"></div><div class="">Last but not least, is there any way to tell how long a “remove brick” will take when it’s moving the data? I have dual 10GB ethernet between the cluster members and the brick storage is a RAID-6 set which can read 400-600MB/sec without any problems.</div><div class="">
<div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class="Apple-interchange-newline">Met vriendelijke groet / kind regards,</div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><b class="">Sander Zijlstra</b></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br class=""></div><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">| Linux Engineer | SURFsara | Science Park 140 | 1098XG Amsterdam | T +31 (0)6 43 99 12 47 | <a href="mailto:sander.zijlstra@surfsara.nl" class="">sander.zijlstra@surfsara.nl</a> | <a href="http://www.surfsara.nl/" class="">www.surfsara.nl</a> |<br class=""><br class=""><i class="">Regular day off on friday</i></div>
</div>
<br class=""></div></div>_______________________________________________<br class="">Gluster-users mailing list<br class=""><a href="mailto:Gluster-users@gluster.org" class="">Gluster-users@gluster.org</a><br class=""><a href="http://www.gluster.org/mailman/listinfo/gluster-users" class="">http://www.gluster.org/mailman/listinfo/gluster-users</a></div></blockquote></div><br class=""></div></div></div></blockquote></div><br class=""></div></div></div></blockquote></div><br class=""></div></div></div></blockquote></div><br class=""></div></div></div></blockquote></div><br class=""></div></div></div></div></blockquote></div><br class=""></div></body></html>