<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi Krutika,<div class=""><br class=""></div><div class="">Sorry for the delay but I was overwhelmed since my arrival at my office :/</div><div class=""><br class=""></div><div class="">here are the result of the "bench" with write-behind disabled:</div><div class=""><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################ UNTAR time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>31m34.948s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m11.245s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m21.880s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# DU time consumed ##################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">557M<span class="Apple-tab-span" style="white-space:pre"> </span>linux-4.1-rc6</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m48.851s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.117s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m1.097s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# FIND time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">52663</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m45.922s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.278s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m1.547s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# GREP time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">7952</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>4m30.424s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.933s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m4.884s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# TAR time consumed #################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>5m19.299s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m30.281s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m5.786s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# RM time consumed ##################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 13px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>9m4.438s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.451s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space: pre;"> </span>0m5.523s</span></div><div class=""><br class="webkit-block-placeholder"></div><div class="">The result is very very bad, worse than previous ones.</div><div class="">Due to this result, i re-set the write-behing parameter to on.</div><div class=""><br class=""></div><div class="">Here is the only one process i found talking about self-heal (here set to off ?????!)</div><div class=""><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""># ps aux|grep heal</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">root 9437 0.0 0.0 296132 45620 ? Ssl May12 6:29 /usr/sbin/glusterfs -s localhost --volfile-id gluster/quotad -p /var/lib/glusterd/quotad/run/quotad.pid -l /var/log/glusterfs/quotad.log -S /var/run/71b4e5df9ffee9a41bcf0d94b98dc558.socket --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">root 42532 0.0 0.0 105324 940 pts/7 S+ 09:51 0:00 grep heal</span></div></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Thanks by advance for your help and fix.</div><div class="">Geoffrey</div><div apple-content-edited="true" class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">------------------------------------------------------<br class="">Geoffrey Letessier<br class="">Responsable informatique & ingénieur système<br class="">UPR 9080 - CNRS - Laboratoire de Biochimie Théorique<br class="">Institut de Biologie Physico-Chimique<br class="">13, rue Pierre et Marie Curie - 75005 Paris<br class="">Tel: 01 58 41 50 93 - eMail: <a href="mailto:geoffrey.letessier@ibpc.fr" class="">geoffrey.letessier@ibpc.fr</a></div>
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">Le 22 juin 2015 à 04:35, Krutika Dhananjay <<a href="mailto:kdhananj@redhat.com" class="">kdhananj@redhat.com</a>> a écrit :</div><br class="Apple-interchange-newline"><div class=""><div class=""><div style="font-family: garamond, 'new york', times, serif; font-size: 12pt;" class=""><div class="">Hi Geoffrey,<br class=""></div><div class=""><br class=""></div><div class="">1. Was self-heal also in progress while I/O was happening on the volume?<br class=""></div><div class="">2. Also, there seem to be quite a few fsyncs which could possibly have slowed things down a bit. Could you disable write-behind and try<br class=""></div><div class=""> getting the time stats one more time to eliminate the possibility of write-behind's presence causing out-of-order writes to increase the number of fsyncs<br class=""></div><div class=""> by the replication module.<br class=""></div><div class=""><br class=""></div><div class="">-Krutika<br class=""></div><hr id="zwchr" class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""><b class="">From: </b>"Geoffrey Letessier" <<a href="mailto:geoffrey.letessier@cnrs.fr" class="">geoffrey.letessier@cnrs.fr</a>><br class=""><b class="">To: </b><a href="mailto:gluster-users@gluster.org" class="">gluster-users@gluster.org</a><br class=""><b class="">Sent: </b>Saturday, June 20, 2015 6:04:40 AM<br class=""><b class="">Subject: </b>Re: [Gluster-users] GlusterFS 3.5.3 - untar: very poor performance<br class=""><div class=""><br class=""></div>Re,<div class=""><br class=""></div><div class="">For comparison, here is the output of the same script run on a distributed only volume (2 servers of the 4 previously described, 2 bricks each):<div class=""><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################ UNTAR time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>1m44.698s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m8.891s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m8.353s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# DU time consumed ##################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">554M<span class="Apple-tab-span" style="white-space:pre"> </span>linux-4.1-rc6</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m21.062s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.100s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m1.040s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# FIND time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">52663</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m21.325s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.104s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m1.054s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# GREP time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">7952</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m43.618s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.922s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m3.626s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# TAR time consumed #################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m50.577s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m29.745s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m4.086s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# RM time consumed ##################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m41.133s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.171s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m2.522s</span></div><div class=""><br class=""></div><div class="">The performances are amazing different!</div><div class=""><br class=""></div><div class="">Geoffrey</div><div class="">
<div style="letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">-----------------------------------------------<br class="">Geoffrey Letessier<br class=""><div class=""><br class=""></div>Responsable informatique & ingénieur système<br class="">CNRS - UPR 9080 - Laboratoire de Biochimie Théorique<br class="">Institut de Biologie Physico-Chimique<br class="">13, rue Pierre et Marie Curie - 75005 Paris<br class="">Tel: 01 58 41 50 93 - eMail: <a href="mailto:geoffrey.letessier@cnrs.fr" target="_blank" class="">geoffrey.letessier@cnrs.fr</a><br data-mce-bogus="1" class=""></div>
</div>
<br class=""><div class=""><div class="">Le 20 juin 2015 à 02:12, Geoffrey Letessier <<a href="mailto:geoffrey.letessier@cnrs.fr" target="_blank" class="">geoffrey.letessier@cnrs.fr</a>> a écrit :</div><br class="Apple-interchange-newline"><blockquote class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Dear all,<div class=""><br class=""></div><div class="">I just noticed on my main volume of my HPC cluster my IO operations become impressively poor.. </div><div class=""><br class=""></div><div class="">Doing some file operations above a linux kernel sources compressed file, the untar operation can take more than 1/2 hours for this file (roughly 80MB and 52 000 files inside) as you read below:</div><div class=""><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################ UNTAR time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>32m42.967s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m11.783s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m15.050s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# DU time consumed ##################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">557M<span class="Apple-tab-span" style="white-space:pre"> </span>linux-4.1-rc6</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m25.060s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.068s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.344s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# FIND time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">52663</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>0m25.687s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.084s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.387s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# GREP time consumed ################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">7952</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>2m15.890s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.887s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m2.777s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# TAR time consumed #################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>1m5.551s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m26.536s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m2.609s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">################# RM time consumed ##################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">#######################################################</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0); min-height: 11px;" class=""><span style="font-size: 9px;" class=""><br class=""></span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">real<span class="Apple-tab-span" style="white-space:pre"> </span>2m51.485s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">user<span class="Apple-tab-span" style="white-space:pre"> </span>0m0.167s</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">sys<span class="Apple-tab-span" style="white-space:pre"> </span>0m1.663s</span></div></div><div class=""><br class=""></div><div class="">For information, this volume is a distributed replicated one and is composed by 4 servers with 2 bricks each. Each bricks is a 12-drives RAID6 vdisk with nice native performances (around 1.2GBs).</div><div class=""><br class=""></div><div class="">In comparison, when I use DD to generate a 100GB file on the same volume, my write throughput is around 1GB (client side) and 500MBs (server side) because of replication:</div><div class="">Client side:</div><div class=""><div class=""><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">[root@node056 ~]# ifstat -i ib0</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""> ib0 </span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""> KB/s in KB/s out</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""> 3251.45 1.09e+06</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""> 3139.80 1.05e+06</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""> 3185.29 1.06e+06</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""> 3293.84 1.09e+06</span></div></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">...</span></div><div class=""><br class=""></div><div class="">Server side:</div><div class=""><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">[root@lucifer ~]# ifstat -i ib0</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""> ib0 </span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class=""> KB/s in KB/s out</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">561818.1 1746.42</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">560020.3 1737.92</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">526337.1 1648.20</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">513972.7 1613.69</span></div></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">...</span></div><div class=""><br class="webkit-block-placeholder"></div><div class="">DD command:</div><div class=""><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">[root@node056 ~]# dd if=/dev/zero of=/home/root/test.dd bs=1M count=100000</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">100000+0 enregistrements lus</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">100000+0 enregistrements écrits</span></div><div style="margin: 0px; font-family: Menlo; color: rgb(255, 255, 255); background-color: rgb(0, 0, 0);" class=""><span style="font-size: 9px;" class="">104857600000 octets (105 GB) copiés, 202,99 s, 517 MB/s</span></div></div><div class=""><br class=""></div><div class="">So this issue doesn’t seem coming from the network (which is Infiniband technology in this case)</div><div class=""><br class=""></div><div class="">You can find in attachments a set of files:</div><div class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- mybench.sh: the bench script</div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- benches.txt: output of my "bench"</div><div class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- profile.txt: gluster volume profile during the "bench"</div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- vol_status.txt: gluster volume status</div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>- vol_info.txt: gluster volume info</div><div class=""><br class=""></div><div class="">Can someone help me to fix it (it’s very critical because this volume is on a HPC cluster in production).</div><div class=""><br class=""></div><div class="">Thanks by advance,</div><div class="">Geoffrey</div><div class="">
<div style="letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">-----------------------------------------------<br class="">Geoffrey Letessier<br class=""><div class=""><br class=""></div>Responsable informatique & ingénieur système<br class="">CNRS - UPR 9080 - Laboratoire de Biochimie Théorique<br class="">Institut de Biologie Physico-Chimique<br class="">13, rue Pierre et Marie Curie - 75005 Paris<br class="">Tel: 01 58 41 50 93 - eMail: <a href="mailto:geoffrey.letessier@cnrs.fr" target="_blank" class="">geoffrey.letessier@cnrs.fr</a><br data-mce-bogus="1" class=""></div>
</div>
</div></div><span class=""><benches.txt></span><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class=""></div></div><span class=""><mybench.sh></span><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class=""></div></div><span class=""><profile.txt></span><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class=""></div></div><span class=""><vol_info.txt></span><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class=""></div></div><span class=""><vol_status.txt></span><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class=""></div></div></blockquote></div><br class=""></div></div><br class="">_______________________________________________<br class="">Gluster-users mailing list<br class="">Gluster-users@gluster.org<br class="">http://www.gluster.org/mailman/listinfo/gluster-users</blockquote><div class=""><br class=""></div></div></div></div></blockquote></div><br class=""></div></body></html>