<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Aug 10, 2016 at 1:35 AM, Vijay Bellur <span dir="ltr"><<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span>On 08/08/2016 04:57 AM, Alok Srivastava wrote:<br>
</span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span>
Reviving the old thread..<br>
<br>
I was thinking about a possible NDMP based migration tool built into<br>
GlusterFS.<br>
Migration from any other file system storage (source) to gluster storage<br>
(target) can be challenging because of lack of a tool built into<br>
GlusterFS. Host based migration is a common approach but it can be<br>
painful for large datasets.<br>
<br>
The proposed migration tool will transfer data over the Network Data<br>
Management Protocol (NDMP). This tool will make use of the snapshots<br>
feature on the source system to ensure that a point-in- time copy of the<br>
file system is transferred to the target. The proposed tool can also be<br>
utilized to migrate from gluster on old hardware to gluster on new hardware.<br>
<br>
Following is the proposed workflow:<br>
<br></span>
*1) **First copy*<span><br>
<br>
Migrate recursively from source directory to the gluster cluster. This<br>
is expected to be a time consuming step.<br>
<br></span>
* 2) Incremental copy*<span><br>
<br>
Migrating any changes that occur after the first copy.<br>
<br>
3) Cutover<br>
<br>
Restrict clients from accessing data on the source , migrate remaining<br>
changes , and redirect clients to access their data on the gluster cluster.<br>
<br>
<br>
Note that there may be issues with migrating existing file permissions,<br>
quota enforcements, etc on the source.<br>
<br>
Missing pieces in gluster<br>
<br>
<br>
-NDMP support<br>
<br>
-May have to revive “ndmp-server” project?<br>
<br>
<br>
</span></blockquote>
<br>
<br>
Why is NDMP better than rsync from NFS (src) to FUSE (destination)?. Is it owing to the incremental copy that NDMP can handle better?<br></blockquote><div><br></div><div>Right, Determining the files for incremental migration will take longer with rsync. Also, the proposed approach is based on NDMP + Snapshots, Hence it's not a one size fits all approach. However, Making use of the snapshots will ensure that a point in time copy is migrated and the in-flight directories are also accessible to the clients connected to the source.<br></div><div><br></div><div>NDMP support with gluster will help in integration with other backup utilities as well.</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<br>
I have not seen the ndmp-server project in action or the code to comment on how functional it was. We might have to implement from scratch if we decide to go down this route.<br>
<br>
Aravinda - do you remember the state of this project?<br>
<br>
Thanks,<br>
Vijay<br>
<br>
<br>
</blockquote></div><br></div></div>