<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <br>
    <div class="moz-cite-prefix">On 02/02/2015 02:42 PM, Ason Hu wrote:<br>
    </div>
    <blockquote
cite="mid:CAN7ydDXjneO=Esg4u3r7u7ot0FCbww-nVmZRv1qccQLSAdhuww@mail.gmail.com"
      type="cite">
      <div dir="ltr">Hi,
        <div><br>
        </div>
        <div>In my small file test, 3 types of volume are created in
          same GlusterFS Cluster (4 nodes)</div>
        <div>
          <ul>
            <li>Distritubed<br>
            </li>
            <li>Distributed Replicated<br>
            </li>
            <li>Distributed Striped</li>
          </ul>
          <br>
          10 million&nbsp;small files (8 byte) create and search each test
          cycle life&nbsp;<br>
          <table class=""
            style="border-spacing:0px;color:rgb(119,119,119);font-size:13px">
            <tbody>
            </tbody>
          </table>
          <div><br>
          </div>
          <div><br>
          </div>
          <div>
            <div>Nodes info :&nbsp;</div>
            <div>
              <ul>
                <li>OS : CentOS 6.6 64bit</li>
                <li>RAM : 64GB<br>
                </li>
                <li>HDD : 4TB, 7200RPM, SAS *6 RAID 0<br>
                </li>
                <li>FileSystem : XFS, BS=4K</li>
              </ul>
            </div>
          </div>
          <div><br>
          </div>
          <div><br>
          </div>
          <div>Problem :</div>
          <div><br>
          </div>
          <div>It occur when file reach&nbsp;<span
              style="color:rgb(84,84,84);line-height:18.2000007629395px">&#8786;</span>200
            million (sum of 3 volumes)</div>
        </div>
        <div>files created speed drop from&nbsp;<span
            style="color:rgb(84,84,84);line-height:18.2000007629395px">&nbsp;</span><span
            style="color:rgb(84,84,84);line-height:18.2000007629395px">&#8786;</span>1500
          to&nbsp;<span
            style="color:rgb(84,84,84);line-height:18.2000007629395px">&nbsp;</span><span
            style="color:rgb(84,84,84);line-height:18.2000007629395px">&#8786;</span>100</div>
      </div>
    </blockquote>
    If you do this test directly on the XFS partition, what is the kind
    of performance difference you see?<br>
    <br>
    Pranith<br>
    <blockquote
cite="mid:CAN7ydDXjneO=Esg4u3r7u7ot0FCbww-nVmZRv1qccQLSAdhuww@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div><br>
        </div>
        <div>Though the speed of creation become slow but search speed
          and throughput still good&nbsp;</div>
        <div>Seems each types of volume have same problem, I don't know
          what cause this problem..<br>
        </div>
        <div><br>
        </div>
        <div><br>
        </div>
        <div>Workaround :</div>
        <div><br>
        </div>
        <div>I try to create new volume ( Distributed |
          Distributed&nbsp;Replicated | Distributed Striped ), mount it,&nbsp;</div>
        <div>problem solved!</div>
        <div>But the old volume write speed still sad..</div>
        <div><br>
        </div>
        <div><br>
        </div>
        <div><br>
        </div>
        <div>I'd &nbsp;try to increase below volume setting, but don't work
          at all</div>
        <div>
          <ul>
            <li>performance.cache-size&nbsp;<br>
            </li>
            <li>performance.io-thread-count</li>
          </ul>
        </div>
        <div>
          <div><br>
          </div>
          <div>I didn't enable the volume qouta option.</div>
          <div>Does glusterfs volume have some kind of limitation of
            file creation? <br>
          </div>
        </div>
      </div>
    </blockquote>
    <blockquote
cite="mid:CAN7ydDXjneO=Esg4u3r7u7ot0FCbww-nVmZRv1qccQLSAdhuww@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div><br>
        </div>
        <div><br>
        </div>
        <div>Regards</div>
        <div>Nosa Hu,</div>
        <div><br>
        </div>
        <div><br>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  </body>
</html>