<div dir="ltr"><div>So sharding in its current form should still work fine in the non-VM-store use-cases<br>as long as they are single-writer-to-large-file workloads.<br><br></div><div>I am starting (actually resuming :)) work on making it useful for multiple-writers workload.<br>Sharding will need to use locks to synchronize modification (inode writes mostly)<br>fops from multiple clients to the same file. To this end, we will need a common<br>transaction framework that can eliminate the need for multiple lock requests from<br>different translators on the client stack as part of the same transaction, if we want the<br>solution to yield good performance. This plus consumption of composite fops plus delayed<br>updates (xattrop) to global size are some of the things I need to complete before sharding<br>can be used in multiple-writers workload. I will be posting updates on gluster-devel as and<br>when I make progress on this.<br></div><div><br></div><div>-Krutika<br></div><div><br></div><div><br><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Aug 12, 2016 at 9:24 AM, Vijay Bellur <span dir="ltr"><<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On Sat, Aug 6, 2016 at 7:37 AM, Niels de Vos <<a href="mailto:ndevos@redhat.com">ndevos@redhat.com</a>> wrote:<br>
> Hi,<br>
><br>
> As *we* all are aware, striped volumes should not be used anymore. The<br>
> replacement for this is sharding, available and stable since the latest<br>
> 3.7 releases and 3.8. Unfortunately users still create striped volumes,<br>
> and some even write blog posts with examples.<br>
><br>
> We should actively recommend users not to use striping anymore. This is<br>
> a proposal to remove the striping xlator from the GlusterFS sources over<br>
> the next two releases:<br>
><br>
> - 3.9: prevent creation of new striped volumes, warn in the client logs<br>
> when striping is used<br>
><br>
<br>
</span>One possibility would be to recommend sharding instead of striping in<br>
the CLI whenever a stripe volume creation is attempted in 3.9.<br>
<br>
Krutika - how far are we from sharding being used for general workloads?<br>
<br>
Thanks,<br>
Vijay<br>
</blockquote></div><br></div>