<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<br>
<br>
<div class="moz-cite-prefix">On 29/06/15 15:49, 莊尚豪 wrote:<br>
</div>
<blockquote cite="mid:01b801d0b255$112e5dc0$338b1940$@iii.org.tw"
type="cite">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered
medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:新細明體;
panose-1:2 2 5 0 0 0 0 0 0 0;}
@font-face
{font-family:新細明體;
panose-1:2 2 5 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@新細明體";
panose-1:2 2 5 0 0 0 0 0 0 0;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Calibri","sans-serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US">Hi
Jiffin,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US">If
you have time, could you test multiple client to ganesha for
pnfs?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US">I
test a case that two client connect and translate data, and
they will suspend to translate.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US">Something
like CLIENT ID get conflict to each other, and these are
found wireshark in client.<o:p></o:p></span></p>
</div>
</blockquote>
<br>
<br>
Hi Ben,<br>
<br>
I created new pnfs s with latest code for nfs-ganesha(V2.3-dev-9)
and glusterfs (master)<br>
<br>
I have three servers and two clients , all running with fedora20
(kernel 3.19.3-100.fc20.x86_64) and having 1G network card in it.<br>
<br>
I created a volume "test" with following configuration in my
enviroment<br>
Volume Name: test<br>
Type: Distribute<br>
Volume ID: 77da4906-526c-4f0f-bd81-23eba2053e36<br>
Status: Started<br>
Number of Bricks: 3<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: 10.19.96.123:/home/brick/b1<br>
Brick2: 10.19.96.125:/home/brick/b2<br>
Brick3: 10.19.96.127:/home/brick/b3<br>
Options Reconfigured:<br>
features.cache-invalidation: on<br>
nfs.disable: on<br>
<br>
I used following dd command for 1gb and 10gb file in both clients<br>
<br>
echo 3 > /proc/sys/vm/drop_caches;dd if=/dev/zero of=<mount
point>/file bs=1000K count=1000 conv=sync ;<br>
1000+0 records in<br>
1000+0 records out<br>
10240000000 bytes (10 GB) copied, 97.0755 s, 105 MB/s<br>
<br>
echo 3 > /proc/sys/vm/drop_caches;dd if=/dev/zero
of=<mount_point>file bs=10000K count=1000 conv=sync ;<br>
1000+0 records in<br>
1000+0 records out<br>
1024000000 bytes (1.0 GB) copied, 10.013 s, 102 MB/s<br>
<br>
It didn't hang for me. Also i can read file from client1 which is
written from client2.<br>
<br>
<br>
Also i tried to run distributed iozone sequential write test in
which four files{iozone.DUMMY.[1-4] } of size 2G is written to two
clients concurrently. <br>
Still it didn't hang for me.<br>
I used following command for that.<br>
iozone -+m ./clients.ioz -+h 10.19.96.131 -i 0 -w -+n -c -C -e -s 8G
-r 64k -t 4 (clients.ioz -- iozone configuration file.)<br>
<br>
It seems to be i can't reproduce your issue<br>
<br>
Can u send ur packet trace in a file to me, so that i can analyze
same in a wireshark?<br>
<br>
And also send your test case in step by step, so that i can try the
same in my environment.<br>
<br>
I am attaching my iozone result with this mail<br>
<br>
With regards,<br>
Jiffin <br>
<br>
<br>
<blockquote cite="mid:01b801d0b255$112e5dc0$338b1940$@iii.org.tw"
type="cite">
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US"><o:p> <br>
</o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US">Thanks,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US">Ben<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D" lang="EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext"
lang="EN-US">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext"
lang="EN-US"> Jiffin Tony Thottan
[<a class="moz-txt-link-freetext" href="mailto:jthottan@redhat.com">mailto:jthottan@redhat.com</a>] <br>
<b>Sent:</b> Friday, June 26, 2015 2:34 PM<br>
<b>To:</b> </span><span
style="font-size:10.0pt;font-family:"新細明體","serif";
color:windowtext">莊尚豪</span><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext"
lang="EN-US">; <a class="moz-txt-link-abbreviated" href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><br>
<b>Subject:</b> Re: [Gluster-users] pnfs(glusterfs-3.7.1
+ ganesha-2.2) problem for clients layout commit<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span
lang="EN-US"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On 26/06/15 08:25, </span><span
style="font-family:"新細明體","serif"">莊尚豪</span><span
lang="EN-US"> wrote:<o:p></o:p></span></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Hi Jiffin,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Thanks your advice,
but I still have these errors.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I suspect the pnfs
clients causes errors because client can pass successfully
sometimes.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Can you tell me what
the linux or nfs-utils version you test? Or the
requirement for client?<o:p></o:p></span></p>
</blockquote>
<p class="MsoNormal"><span
style="font-family:"新細明體","serif""
lang="EN-US"><br>
As I said before, I ran perf tests (using dd, iozone) for
large files upto 10G two or three months back. I used fedora
20 clients and done basic testing in RHEL6.5 clients<br>
Initially I had some issues with rhel clients, with new
updates i don't anything. Anyway I will run again same with
latest sources and give my updates on the same. <br>
<br>
Just make sure your all ganesha server is up and exporting
the required volume. And more thing , every servers should
be resolvable from m.d.s (there is should information about
all other server in /etc/host).<br>
<br>
Regards,<br>
Jiffin<br>
<br>
<br>
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Many thanks,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Ben<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-family:"新細明體","serif""
lang="EN-US"><o:p> </o:p></span></p>
</div>
</blockquote>
<br>
</body>
</html>