<div dir="ltr">Thanks. Yes, I'll give it a shot in the future. Unfortunately, I don't have any spare systems to run experiments on. I might enable pNFS with the single MDS in the current RHS version though and do some initial tests. </div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Aug 13, 2015 at 2:36 AM, Anand Subramanian <span dir="ltr"><<a href="mailto:ansubram@redhat.com" target="_blank">ansubram@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>Hi Prasun,<br>
<br>
pNFS was recently released in a "tech-preview" form. With multiple
MDS-es or even an all-symmetric arch (every ganesha node can act
as both DS and MDS, which will also be a supported config) you
could potentially see improvements (due to increased throughput)
but, from our experiments so far (and this is certainly work in
progress) there is much improved perf for large files and not so
much for small file i/o (using distributed iozone workloads). That
said, we have not done a lot of work playing around with the
tuneables as yet (glusterfs side options and things like
vm-background ratio and vm-dirty ratio tuning on the OS side) for
small file pNFS access, so it is pending exercise at this point.
We can confirm only when these performance experiments are
completed. But if you happen to have large files as well, it
should be a win. And the best part is, it comes at zero extra cost
to try it out.<br>
<br>
If you have the bandwidth, you should probably give pnfs a spin
with the latest glusterfs versions if you want very quick answers.
It is quite easy to setup and we could lend a helping hand there.
And maybe you will pleasantly surprise us ;-) :)<span class="HOEnZb"><font color="#888888"><br>
<br>
Anand</font></span><div><div class="h5"><br>
<br>
<br>
On 08/13/2015 12:18 PM, Prasun Gera wrote:<br>
</div></div></div><div><div class="h5">
<blockquote type="cite">
<div dir="ltr">Thanks. For small files and random I/O, nfs has
been recommended over fuse. Would pNFS, with multiple MDS'es in
the future, be the recommended approach for small files ?</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Aug 12, 2015 at 11:03 PM,
Soumya Koduri <span dir="ltr"><<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">It depends
on the workload. Like native NFS, even with NFS-Ganesha,
data is routed through the server where its mounted from. In
addition NFSv4.x protocol adds more complexity and cannot be
directly compared with NFSv3 traffic. However with pNFS, I/O
is routed to data servers directly by the NFS clients which
results in performance gain for larger I/O workloads. Also
we do have plan to support multiple metadata servers going
forward.<br>
<br>
Thanks,<br>
Soumya<br>
<div>
<div><br>
----- Original Message -----<br>
From: "Prasun Gera" <<a href="mailto:prasun.gera@gmail.com" target="_blank">prasun.gera@gmail.com</a>><br>
To: "Joe Julian" <<a href="mailto:joe@julianfamily.org" target="_blank">joe@julianfamily.org</a>><br>
Cc: <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
Sent: Thursday, August 13, 2015 2:55:17 AM<br>
Subject: Re: [Gluster-users] ganesha BFS<br>
<br>
And do either of them perform better than fuse mounts ?
With native nfs, all data is routed through the server
where it's mounted from, which makes HA and load
balancing difficult. For pNFS, there is a single
metadata server. How does that affect HA and load ? I
thought one of the main goals of gluster was
decentralized metadata. Where do the four options (fuse,
native nfs, nfsv4, pnfs ) stand in terms of benefits and
disadvantages ?<br>
<br>
<br>
On Wed, Aug 12, 2015 at 11:26 AM, Joe Julian < <a href="mailto:joe@julianfamily.org" target="_blank">joe@julianfamily.org</a>
> wrote:<br>
<br>
<br>
<br>
nfs-ganesha is a much more feature rich nfs server that
uses libgfapi to access the gluster volume in userspace.
This userspace solution avoids the context switches like
the native gluster nfs does, but adds support for
pnfs/nfsv4 and udp.<br>
<br>
From the development standpoint, they have a full set of
developers working only on and focused only on their nfs
server whereas the gluster version was implemented as a
stop-gap to provide a solution where the kernel nfs
re-share was failing.<br>
<br>
I think nfs-ganesha is a better solution. There is
integration work being done in glusterfs to make its use
seamless, so I suspect that's the long-term nfs solution
that will eventually replace gluster's native nfs.<br>
<br>
<br>
On 08/12/2015 09:54 AM, <a href="mailto:paf1@email.cz" target="_blank">paf1@email.cz</a> wrote:<br>
<br>
<br>
<br>
Hello Dears,<br>
<br>
can anybody explain advanteges / disadvantages of
Ganesha NFS ??<br>
Will U reccomend me go through this way ??<br>
( 4 node glusterFS )<br>
regs.<br>
Pavel<br>
<br>
<br>
<br>
_______________________________________________<br>
Gluster-users mailing list <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a><br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Gluster-users mailing list
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<a href="http://www.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</div></div></div>
</blockquote></div><br></div>