<html>
<head>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
<br>
<div class="moz-cite-prefix">On 06/14/2015 11:43 AM, Raghavendra
Talur wrote:<br>
</div>
<blockquote
cite="mid:CALzJ8sOT9j7g5_ux4iu7hBcFM7jN1b5O-3TgCp7r1HeVERq1sA@mail.gmail.com"
type="cite">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Jun 14, 2015 at 11:02 PM,
chris holcombe <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:chris.holcombe@canonical.com"
target="_blank">chris.holcombe@canonical.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Welcome
to the party Matthew! Nice to see you're still keeping an
eye on on the list. I'm excited to see this
collaboration. This is going to turn out great :)<span
class=""><br>
<br>
On 06/14/2015 01:58 AM, Matthew McKeen wrote:<br>
</span>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span
class="">
Hey Craig and Chris:<br>
<br>
I might be interested in collaborating on this as
well.<br>
<br>
Will be useful when I come back to FB in September.<br>
<br>
Let me know where the public repository ends up being.<br>
<br>
Thanks,<br>
Matthew McKeen<br>
<br>
P.S. Tell Richard I said hello<br>
<br>
</span><span class="">
On Fri, Jun 12, 2015 at 11:29 AM chris holcombe <<a
moz-do-not-send="true"
href="mailto:chris.holcombe@canonical.com"
target="_blank">chris.holcombe@canonical.com</a>
<mailto:<a moz-do-not-send="true"
href="mailto:chris.holcombe@canonical.com"
target="_blank">chris.holcombe@canonical.com</a>>>
wrote:<br>
<br>
Yeah I have this repo but it's basically empty:<br>
<a moz-do-not-send="true"
href="https://github.com/cholcombe973/GlusterUtils"
rel="noreferrer" target="_blank">https://github.com/cholcombe973/GlusterUtils</a><br>
<br>
On 06/12/2015 11:27 AM, Craig Cabrey wrote:<br>
> Chris,<br>
><br>
> That sounds good to me.<br>
><br>
> I already have started on implementation,
just to get familiar<br>
with the codebase and GFAPI.<br>
><br>
> Is there a public repo that we can use for
collaboration?<br>
><br>
> Craig<br>
><br>
>> On Jun 12, 2015, at 10:46 AM, chris
holcombe<br>
<<a moz-do-not-send="true"
href="mailto:chris.holcombe@canonical.com"
target="_blank">chris.holcombe@canonical.com</a><br>
</span>
<div>
<div class="h5">
<mailto:<a moz-do-not-send="true"
href="mailto:chris.holcombe@canonical.com"
target="_blank">chris.holcombe@canonical.com</a>>>
wrote:<br>
>><br>
>> Craig,<br>
>><br>
>> I was actually planning on building the
same tool set. I would<br>
like to work with you also on this if that's ok.<br>
>><br>
>> -Chris<br>
>><br>
>> On 06/12/2015 10:43 AM, Jeff Darcy
wrote:<br>
>>>> Hi everyone,<br>
>>>><br>
>>>> This summer I am an intern at
Facebook working on the Gluster<br>
team. Part of<br>
>>>> my project for the summer
includes developing a set of<br>
coreutils that<br>
>>>> utilizes the Gluster C API
natively.<br>
>>>><br>
>>>> This project is similar in
nature to the NFS coreutils that<br>
some of you may<br>
>>>> have heard about from the other
Facebook engineers at the<br>
Gluster summit<br>
>>>> recently. I just wanted to
reach out to the Gluster community<br>
to gather<br>
>>>> ideas, potential features,
feedback, and direction.<br>
>>>><br>
>>>> The initial set of utilities
that I am developing includes<br>
the following:<br>
>>>><br>
>>>> * cat<br>
>>>> * mkdir<br>
>>>> * put (read from stdin and
write to a file)<br>
>>>> * mv<br>
>>>> * ls<br>
>>>> * rm<br>
>>>> * tail<br>
>>>><br>
>>>> Again, any feedback will be
welcome.<br>
>>> Hi, Craig, and welcome to the
project. :)<br>
>>><br>
>>> There seems to be some overlap with
a proposal Ragahavendra<br>
Talur sent out<br>
>>> a couple of days ago.<br>
>>><br>
>>><br>
<a moz-do-not-send="true"
href="https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharing&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162"
rel="noreferrer" target="_blank">https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharing&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162</a><br>
>>><br>
>>> This seems like an excellent
opportunity to collaborate. Ideally, I think<br>
>>> it would be useful to have both an
FTP-client-like "shell" and<br>
a set of<br>
>>> standalone "one shot" commands,
based on as much common code<br>
as possible.<br>
>>><br>
>>>
_______________________________________________<br>
>>> Gluster-devel mailing list<br>
</div>
</div>
>>> <a moz-do-not-send="true"
href="mailto:Gluster-devel@gluster.org"
target="_blank">Gluster-devel@gluster.org</a>
<mailto:<a moz-do-not-send="true"
href="mailto:Gluster-devel@gluster.org"
target="_blank">Gluster-devel@gluster.org</a>><span
class=""><br>
>>><br>
<a moz-do-not-send="true"
href="https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3"
rel="noreferrer" target="_blank">https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-devel&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0A&m=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0A&s=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3</a><br>
<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
</span>
<a moz-do-not-send="true"
href="mailto:Gluster-devel@gluster.org"
target="_blank">Gluster-devel@gluster.org</a>
<mailto:<a moz-do-not-send="true"
href="mailto:Gluster-devel@gluster.org"
target="_blank">Gluster-devel@gluster.org</a>><br>
<a moz-do-not-send="true"
href="http://www.gluster.org/mailman/listinfo/gluster-devel"
rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
<br>
</blockquote>
<div class="">
<div class="h5">
<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a moz-do-not-send="true"
href="mailto:Gluster-devel@gluster.org"
target="_blank">Gluster-devel@gluster.org</a><br>
<a moz-do-not-send="true"
href="http://www.gluster.org/mailman/listinfo/gluster-devel"
rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
</div>
</div>
</blockquote>
</div>
<br>
<br>
<br>
Hi Craig, Chris and Matthew,</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">Welcome to the project :)</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">We are really excited to see so many
interested in getting core utils like feature in Gluster.</div>
<div class="gmail_extra">As Jeff mentioned earlier, we have put
up a very similar proposal recently. He also shared</div>
<div class="gmail_extra">the design doc in the same mail.</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">Here is an illustration of how we
imagined it:</div>
<div class="gmail_extra"><br>
<img src="cid:part16.08000207.04070101@julianfamily.org"
height="533" width="562"><br>
<br>
</div>
<div class="gmail_extra">In gist, all the core utils commands
would be functions in what we are calling</div>
<div class="gmail_extra">glusterclientd. The functions would
return the output in a format like JSON or XML.</div>
<div class="gmail_extra">It would be the handlers which will
send the data to a *real* client.</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">To support one-off commands, we were
thinking of having a cli-direct handler,</div>
<div class="gmail_extra">which when invoked will behave like a
one-off command and output directly to cli.</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">Also, we were of the opinion that
python would be a good language to get this done.</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">As you can see, core-utils would be
part of a bigger project and it would be really useful</div>
<div class="gmail_extra">for all of us to have same code base.</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">Please read the design doc and give
your reviews either in doc or here in mail.</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">
<div><br>
</div>
Thanks!<br>
<div class="gmail_signature">
<div dir="ltr"><font color="#666666"><b>Raghavendra Talur </b></font>
<div><br>
</div>
</div>
</div>
</div>
</div>
<br>
</blockquote>
One issue to keep in mind is (potentially) tens of thousands of
clients connecting simultaneously. This would be a huge load on
glusterd and potentially use up all the available ports (depending
on tcp _fin_timeout).<br>
<br>
See
<a class="moz-txt-link-freetext" href="https://docs.google.com/document/d/15IiPVIPMzgGwkt1sKuIusRE2l3pQY6NnA4WmWaMsFJE/edit">https://docs.google.com/document/d/15IiPVIPMzgGwkt1sKuIusRE2l3pQY6NnA4WmWaMsFJE/edit</a>
for a potential solution.<br>
</body>
</html>