<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<br>
<div class="moz-cite-prefix">On 02/02/2015 02:42 PM, Ason Hu wrote:<br>
</div>
<blockquote
cite="mid:CAN7ydDXjneO=Esg4u3r7u7ot0FCbww-nVmZRv1qccQLSAdhuww@mail.gmail.com"
type="cite">
<div dir="ltr">Hi,
<div><br>
</div>
<div>In my small file test, 3 types of volume are created in
same GlusterFS Cluster (4 nodes)</div>
<div>
<ul>
<li>Distritubed<br>
</li>
<li>Distributed Replicated<br>
</li>
<li>Distributed Striped</li>
</ul>
<br>
10 million small files (8 byte) create and search each test
cycle life <br>
<table class=""
style="border-spacing:0px;color:rgb(119,119,119);font-size:13px">
<tbody>
</tbody>
</table>
<div><br>
</div>
<div><br>
</div>
<div>
<div>Nodes info : </div>
<div>
<ul>
<li>OS : CentOS 6.6 64bit</li>
<li>RAM : 64GB<br>
</li>
<li>HDD : 4TB, 7200RPM, SAS *6 RAID 0<br>
</li>
<li>FileSystem : XFS, BS=4K</li>
</ul>
</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Problem :</div>
<div><br>
</div>
<div>It occur when file reach <span
style="color:rgb(84,84,84);line-height:18.2000007629395px">≒</span>200
million (sum of 3 volumes)</div>
</div>
<div>files created speed drop from <span
style="color:rgb(84,84,84);line-height:18.2000007629395px"> </span><span
style="color:rgb(84,84,84);line-height:18.2000007629395px">≒</span>1500
to <span
style="color:rgb(84,84,84);line-height:18.2000007629395px"> </span><span
style="color:rgb(84,84,84);line-height:18.2000007629395px">≒</span>100</div>
</div>
</blockquote>
If you do this test directly on the XFS partition, what is the kind
of performance difference you see?<br>
<br>
Pranith<br>
<blockquote
cite="mid:CAN7ydDXjneO=Esg4u3r7u7ot0FCbww-nVmZRv1qccQLSAdhuww@mail.gmail.com"
type="cite">
<div dir="ltr">
<div><br>
</div>
<div>Though the speed of creation become slow but search speed
and throughput still good </div>
<div>Seems each types of volume have same problem, I don't know
what cause this problem..<br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Workaround :</div>
<div><br>
</div>
<div>I try to create new volume ( Distributed |
Distributed Replicated | Distributed Striped ), mount it, </div>
<div>problem solved!</div>
<div>But the old volume write speed still sad..</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>I'd try to increase below volume setting, but don't work
at all</div>
<div>
<ul>
<li>performance.cache-size <br>
</li>
<li>performance.io-thread-count</li>
</ul>
</div>
<div>
<div><br>
</div>
<div>I didn't enable the volume qouta option.</div>
<div>Does glusterfs volume have some kind of limitation of
file creation? <br>
</div>
</div>
</div>
</blockquote>
<blockquote
cite="mid:CAN7ydDXjneO=Esg4u3r7u7ot0FCbww-nVmZRv1qccQLSAdhuww@mail.gmail.com"
type="cite">
<div dir="ltr">
<div><br>
</div>
<div><br>
</div>
<div>Regards</div>
<div>Nosa Hu,</div>
<div><br>
</div>
<div><br>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</body>
</html>