<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">Am 09.12.2015 um 17:17 schrieb Joe
Julian:<br>
</div>
<blockquote cite="mid:5668542C.3080401@julianfamily.org" type="cite">
<blockquote type="cite"><span style="color: rgb(51, 51, 51);
font-family: Verdana, Arial, Tahoma, Calibri, Geneva,
sans-serif; font-size: 13px; font-style: normal; font-variant:
normal; font-weight: normal; letter-spacing: normal;
line-height: normal; orphans: auto; text-align: left;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px;
display: inline !important; float: none; background-color:
rgb(250, 250, 250);">A-1) shut down node #1 (the first that is
about to be upgraded)</span><br style="color: rgb(51, 51, 51);
font-family: Verdana, Arial, Tahoma, Calibri, Geneva,
sans-serif; font-size: 13px; font-style: normal; font-variant:
normal; font-weight: normal; letter-spacing: normal;
line-height: normal; orphans: auto; text-align: left;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px;
background-color: rgb(250, 250, 250);">
<span style="color: rgb(51, 51, 51); font-family: Verdana,
Arial, Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">A-2)
remove node #1 from the Proxmox cluster (</span><i
style="color: rgb(51, 51, 51); font-family: Verdana, Arial,
Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-variant: normal; font-weight: normal; letter-spacing:
normal; line-height: normal; orphans: auto; text-align: left;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px;
background-color: rgb(250, 250, 250);">pvevm delnode "metal1"</i><span
style="color: rgb(51, 51, 51); font-family: Verdana, Arial,
Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">)</span><br
style="color: rgb(51, 51, 51); font-family: Verdana, Arial,
Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(250,
250, 250);">
<span style="color: rgb(51, 51, 51); font-family: Verdana,
Arial, Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">A-3)
remove node #1 from the Gluster volume/cluster (</span><i
style="color: rgb(51, 51, 51); font-family: Verdana, Arial,
Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-variant: normal; font-weight: normal; letter-spacing:
normal; line-height: normal; orphans: auto; text-align: left;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px;
background-color: rgb(250, 250, 250);">gluster volume
remove-brick ... && gluster peer detach "metal1"</i><span
style="color: rgb(51, 51, 51); font-family: Verdana, Arial,
Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">)</span><br
style="color: rgb(51, 51, 51); font-family: Verdana, Arial,
Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(250,
250, 250);">
<span style="color: rgb(51, 51, 51); font-family: Verdana,
Arial, Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">A-4)
install Debian Jessie on node #1, overwriting all data on the
HDD -<span class="Apple-converted-space"> </span></span><b
style="color: rgb(51, 51, 51); font-family: Verdana, Arial,
Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; letter-spacing:
normal; line-height: normal; orphans: auto; text-align: left;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px;
background-color: rgb(250, 250, 250);">with same Network
settings and hostname as before</b><br style="color: rgb(51,
51, 51); font-family: Verdana, Arial, Tahoma, Calibri, Geneva,
sans-serif; font-size: 13px; font-style: normal; font-variant:
normal; font-weight: normal; letter-spacing: normal;
line-height: normal; orphans: auto; text-align: left;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px;
background-color: rgb(250, 250, 250);">
<span style="color: rgb(51, 51, 51); font-family: Verdana,
Arial, Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">A-5)<span
class="Apple-converted-space"> </span></span><a
moz-do-not-send="true"
href="https://pve.proxmox.com/wiki/Install_Proxmox_VE_on_Debian_Jessie"
target="_blank" style="color: rgb(65, 115, 148);
text-decoration: none; font-family: Verdana, Arial, Tahoma,
Calibri, Geneva, sans-serif; font-size: 13px; font-style:
normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(250,
250, 250);">install Proxmox 4.0</a><span style="color: rgb(51,
51, 51); font-family: Verdana, Arial, Tahoma, Calibri, Geneva,
sans-serif; font-size: 13px; font-style: normal; font-variant:
normal; font-weight: normal; letter-spacing: normal;
line-height: normal; orphans: auto; text-align: left;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px;
display: inline !important; float: none; background-color:
rgb(250, 250, 250);"><span class="Apple-converted-space"> </span>on
node #1</span><br style="color: rgb(51, 51, 51); font-family:
Verdana, Arial, Tahoma, Calibri, Geneva, sans-serif;
font-size: 13px; font-style: normal; font-variant: normal;
font-weight: normal; letter-spacing: normal; line-height:
normal; orphans: auto; text-align: left; text-indent: 0px;
text-transform: none; white-space: normal; widows: 1;
word-spacing: 0px; -webkit-text-stroke-width: 0px;
background-color: rgb(250, 250, 250);">
<span style="color: rgb(51, 51, 51); font-family: Verdana,
Arial, Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">A-6)
install Gluster on node #1 and add it back to the Gluster
volume (</span><i style="color: rgb(51, 51, 51); font-family:
Verdana, Arial, Tahoma, Calibri, Geneva, sans-serif;
font-size: 13px; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(250,
250, 250);">gluster volume add-brick ...</i><span
style="color: rgb(51, 51, 51); font-family: Verdana, Arial,
Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">) =>
shared storage will be complete again (spanning 3.4 and 4.0
nodes)</span><br style="color: rgb(51, 51, 51); font-family:
Verdana, Arial, Tahoma, Calibri, Geneva, sans-serif;
font-size: 13px; font-style: normal; font-variant: normal;
font-weight: normal; letter-spacing: normal; line-height:
normal; orphans: auto; text-align: left; text-indent: 0px;
text-transform: none; white-space: normal; widows: 1;
word-spacing: 0px; -webkit-text-stroke-width: 0px;
background-color: rgb(250, 250, 250);">
<span style="color: rgb(51, 51, 51); font-family: Verdana,
Arial, Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">A-7)
configure the Gluster volume as shared storage in Proxmox 4
(node #1)</span><br style="color: rgb(51, 51, 51);
font-family: Verdana, Arial, Tahoma, Calibri, Geneva,
sans-serif; font-size: 13px; font-style: normal; font-variant:
normal; font-weight: normal; letter-spacing: normal;
line-height: normal; orphans: auto; text-align: left;
text-indent: 0px; text-transform: none; white-space: normal;
widows: 1; word-spacing: 0px; -webkit-text-stroke-width: 0px;
background-color: rgb(250, 250, 250);">
<span style="color: rgb(51, 51, 51); font-family: Verdana,
Arial, Tahoma, Calibri, Geneva, sans-serif; font-size: 13px;
font-style: normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; orphans: auto;
text-align: left; text-indent: 0px; text-transform: none;
white-space: normal; widows: 1; word-spacing: 0px;
-webkit-text-stroke-width: 0px; display: inline !important;
float: none; background-color: rgb(250, 250, 250);">A-8)
configure the external Backup storage on node #1 (Proxmox 4)</span></blockquote>
<br>
Was the data on the gluster brick deleted as part of step 4? </blockquote>
<br>
Yes, all data on physical HDD was deleted (reformatted /
repartitioned).<br>
<br>
<br>
<blockquote cite="mid:5668542C.3080401@julianfamily.org" type="cite">When
you remove the brick, gluster will no longer track pending changes
for that brick. If you add it back in with stale data but matching
gfids, you would have two clean bricks with mismatching data. Did
you have to use "add-brick...force"? <br>
</blockquote>
<br>
No, "force" was not necessary and the added directory <tt>"/data/gluster/systems"</tt>
did not exist.<br>
<br>
This were the commands executed on node #2 during step 6:<br>
<br>
<blockquote><tt>gluster volume add-brick "systems" replica 3
metal1:/data/gluster/systems</tt><br>
<tt>gluster volume heal "systems" full # to trigger sync</tt><br>
</blockquote>
<tt><br>
</tt>Then I waited for replication to finish before doing anything
else (about 1 hour or maybe more), checking <u><tt>gluster volume
heal "systems" info</tt></u><br>
<br>
<br>
Udo<br>
<br>
</body>
</html>