<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0//EN" "http://www.w3.org/TR/REC-html40/strict.dtd">
<html><head><meta name="qrichtext" content="1" /><style type="text/css">
p, li { white-space: pre-wrap; }
</style></head><body style=" font-family:'Sans Serif'; font-size:12pt; font-weight:400; font-style:normal;">
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Hi,</p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Gluster version is 3.5.3-1.</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/var/log/gluster.log (client log) gives during the rm -rf the following logs:</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.180091] W [client-rpc-fops.c:696:client3_3_rmdir_cbk] 0-md1-client-2: remote operation failed: Directory not empty</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.180134] W [client-rpc-fops.c:696:client3_3_rmdir_cbk] 0-md1-client-3: remote operation failed: Directory not empty</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.180740] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-5: remote operation failed: File exists. Path: /linux/suse/12.1/KDE4.7.4/i586</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.180772] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-4: remote operation failed: File exists. Path: /linux/suse/12.1/KDE4.7.4/i586</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.181129] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-3: remote operation failed: File exists. Path: /linux/suse/12.1/KDE4.7.4/i586</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.181160] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-2: remote operation failed: File exists. Path: /linux/suse/12.1/KDE4.7.4/i586</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.319213] W [client-rpc-fops.c:696:client3_3_rmdir_cbk] 0-md1-client-3: remote operation failed: Directory not empty</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.319762] W [client-rpc-fops.c:696:client3_3_rmdir_cbk] 0-md1-client-2: remote operation failed: Directory not empty</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.320501] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-0: remote operation failed: File exists. Path: /linux/suse/12.1/src-oss/suse/src</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.320552] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-1: remote operation failed: File exists. Path: /linux/suse/12.1/src-oss/suse/src</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.320842] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-2: remote operation failed: File exists. Path: /linux/suse/12.1/src-oss/suse/src</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.320884] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-3: remote operation failed: File exists. Path: /linux/suse/12.1/src-oss/suse/src</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.438982] W [client-rpc-fops.c:696:client3_3_rmdir_cbk] 0-md1-client-3: remote operation failed: Directory not empty</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.439347] W [client-rpc-fops.c:696:client3_3_rmdir_cbk] 0-md1-client-2: remote operation failed: Directory not empty</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.440235] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-0: remote operation failed: File exists. Path: /linux/suse/12.1/oss/suse/noarch</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.440344] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-1: remote operation failed: File exists. Path: /linux/suse/12.1/oss/suse/noarch</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.440603] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-2: remote operation failed: File exists. Path: /linux/suse/12.1/oss/suse/noarch</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.440665] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-3: remote operation failed: File exists. Path: /linux/suse/12.1/oss/suse/noarch</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.680827] W [client-rpc-fops.c:696:client3_3_rmdir_cbk] 0-md1-client-2: remote operation failed: Directory not empty</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.681721] W [client-rpc-fops.c:696:client3_3_rmdir_cbk] 0-md1-client-3: remote operation failed: Directory not empty</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.682482] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-3: remote operation failed: File exists. Path: /linux/suse/12.1/oss/suse/i586</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">[2015-02-23 14:42:50.682517] W [client-rpc-fops.c:322:client3_3_mkdir_cbk] 0-md1-client-2: remote operation failed: File exists. Path: /linux/suse/12.1/oss/suse/i586</p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Thanks,</p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">A.</p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">On Monday 23 February 2015 20:06:17 Ravishankar N wrote:<br /></p>
<p style=" margin-top:12px; margin-bottom:12px; margin-left:40px; margin-right:40px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> <br /> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:40px; margin-right:40px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">On 02/23/2015 07:04 PM, Alessandro Ipe wrote:<br /> </p>
<p style=" margin-top:12px; margin-bottom:12px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Hi Ravi, </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">gluster volume status md1 returns </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Status of volume: md1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Gluster process Port Online Pid </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">------------------------------------------------------------------------------ </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami1:/data/glusterfs/md1/brick1 49157 Y 2260 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami2:/data/glusterfs/md1/brick1 49152 Y 2320 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami3:/data/glusterfs/md1/brick1 49156 Y 20715 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami4:/data/glusterfs/md1/brick1 49156 Y 10544 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami5:/data/glusterfs/md1/brick1 49152 Y 12588 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami6:/data/glusterfs/md1/brick1 49152 Y 12242 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Self-heal Daemon on localhost N/A Y 2336 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Self-heal Daemon on tsunami2 N/A Y 2359 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Self-heal Daemon on tsunami5 N/A Y 27619 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Self-heal Daemon on tsunami4 N/A Y 12318 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Self-heal Daemon on tsunami3 N/A Y 19118 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Self-heal Daemon on tsunami6 N/A Y 27650 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Task Status of Volume md1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">------------------------------------------------------------------------------ </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Task : Rebalance </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">ID : 9dfee1a2-49ac-4766-bdb6-00de5e5883f6 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Status : completed </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">so it seems that all brick server are up. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">gluster volume heal md1 info returns </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami1.oma.be:/data/glusterfs/md1/brick1/ </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Number of entries: 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami2.oma.be:/data/glusterfs/md1/brick1/ </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Number of entries: 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami3.oma.be:/data/glusterfs/md1/brick1/ </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Number of entries: 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami4.oma.be:/data/glusterfs/md1/brick1/ </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Number of entries: 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami5.oma.be:/data/glusterfs/md1/brick1/ </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Number of entries: 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick tsunami6.oma.be:/data/glusterfs/md1/brick1/ </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Number of entries: 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Should I run "gluster volume heal md1 full" ? </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> Hi Alessandro,<br /> <br /> Looks like there is no pending-self heals, so no need to run the heal command. Can you share the output of the client (mount) log when you get the ENOTEMPTY during the rm -rf?<br /> <br /> What version of gluster are you using?<br /> Thanks,<br /> Ravi<br /> <br /> </p>
<p style=" margin-top:12px; margin-bottom:12px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Thanks, </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">A. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">On Monday 23 February 2015 18:12:43 Ravishankar N wrote:<br /> </p>
<p style=" margin-top:12px; margin-bottom:12px; margin-left:120px; margin-right:120px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> <br /> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:120px; margin-right:120px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">On 02/23/2015 05:42 PM, Alessandro Ipe wrote:<br /> </p>
<p style=" margin-top:12px; margin-bottom:12px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Hi, </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">We have a "md1" volume under gluster 3.5.3 over 6 servers configured as distributed and replicated. When trying on a client, thourgh fuse mount (which turns out to be also a brick server) to delete (as root) recursively a directory with "rm -rf /home/.md1/linux/suse/12.1", I get the error messages </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">rm: cannot remove ‘/home/.md1/linux/suse/12.1/KDE4.7.4/i586’: Directory not empty </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">rm: cannot remove ‘/home/.md1/linux/suse/12.1/src-oss/suse/src’: Directory not empty </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">rm: cannot remove ‘/home/.md1/linux/suse/12.1/oss/suse/noarch’: Directory not empty </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">rm: cannot remove ‘/home/.md1/linux/suse/12.1/oss/suse/i586’: Directory not empty </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">(the same occurs as unprivileged user but with "Permission denied".) </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">while a "ls -Ral /home/.md1/linux/suse/12.1" gives me </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 5 gerb users 151 Feb 20 16:22 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxr-xr-x 6 gerb users 245 Feb 23 12:55 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 95 Feb 23 13:03 KDE4.7.4 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 311 Feb 20 16:57 oss </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 86 Feb 20 16:20 src-oss </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/KDE4.7.4: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 28 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 95 Feb 23 13:03 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 5 gerb users 151 Feb 20 16:22 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">d--------- 2 root root 61452 Feb 23 13:03 i586 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/KDE4.7.4/i586: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 28 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">d--------- 2 root root 61452 Feb 23 13:03 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 95 Feb 23 13:03 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/oss: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 311 Feb 20 16:57 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 5 gerb users 151 Feb 20 16:22 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 4 gerb users 90 Feb 23 13:03 suse </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/oss/suse: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 536 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 4 gerb users 90 Feb 23 13:03 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 311 Feb 20 16:57 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">d--------- 2 root root 368652 Feb 23 13:03 i586 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">d--------- 2 root root 196620 Feb 23 13:03 noarch </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/oss/suse/i586: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 360 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">d--------- 2 root root 368652 Feb 23 13:03 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 4 gerb users 90 Feb 23 13:03 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/oss/suse/noarch: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 176 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">d--------- 2 root root 196620 Feb 23 13:03 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 4 gerb users 90 Feb 23 13:03 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/src-oss: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 0 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 86 Feb 20 16:20 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 5 gerb users 151 Feb 20 16:22 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 48 Feb 23 13:03 suse </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/src-oss/suse: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 220 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 48 Feb 23 13:03 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 86 Feb 20 16:20 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">d--------- 2 root root 225292 Feb 23 13:03 src </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">/home/.md1/linux/suse/12.1/src-oss/suse/src: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">total 220 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">d--------- 2 root root 225292 Feb 23 13:03 . </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">drwxrwxrwx 3 gerb users 48 Feb 23 13:03 .. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Is there a cure such as manually forcing a healing on that directory ? </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> <br /> Are all bricks up? Are there any pending self-heals ? Does `gluster volume heal md1` info show any output? If it does, run 'gluster volume heal md1' to manually trigger heal. <br /> -Ravi<br /> <br /> </p>
<p style=" margin-top:12px; margin-bottom:12px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Many thanks, </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Alessandro. </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">gluster volume info md1 outputs: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Volume Name: md1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Type: Distributed-Replicate </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Volume ID: 6da4b915-1def-4df4-a41c-2f3300ebf16b </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Status: Started </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Number of Bricks: 3 x 2 = 6 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Transport-type: tcp </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Bricks: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick1: tsunami1:/data/glusterfs/md1/brick1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick2: tsunami2:/data/glusterfs/md1/brick1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick3: tsunami3:/data/glusterfs/md1/brick1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick4: tsunami4:/data/glusterfs/md1/brick1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick5: tsunami5:/data/glusterfs/md1/brick1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Brick6: tsunami6:/data/glusterfs/md1/brick1 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">Options Reconfigured: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">performance.write-behind: on </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">performance.write-behind-window-size: 4MB </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">performance.flush-behind: off </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">performance.io-thread-count: 64 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">performance.cache-size: 512MB </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">nfs.disable: on </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">features.quota: off </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">cluster.read-hash-mode: 2 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">server.allow-insecure: on </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">cluster.lookup-unhashed: off </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> <br /> <br /> </p>
<p style=" margin-top:12px; margin-bottom:12px; margin-left:160px; margin-right:160px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">_______________________________________________Gluster-users mailing list<a href="mailto:Gluster-users@gluster.org"><span style=" font-family:'Courier New,courier'; text-decoration: underline; color:#006e28;">Gluster-users@gluster.org</span></a><a href="http://www.gluster.org/mailman/listinfo/gluster-users"><span style=" font-family:'Courier New,courier'; text-decoration: underline; color:#006e28;">http://www.gluster.org/mailman/listinfo/gluster-users</span></a> <br /> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:80px; margin-right:80px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"><br /> <br /> <br /> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"><br /><br /></p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;">-- </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> Dr. Ir. Alessandro Ipe </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> Department of Observations Tel. +32 2 373 06 31</p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> Remote Sensing from Space Fax. +32 2 374 67 88 </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> Royal Meteorological Institute </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> Avenue Circulaire 3 Email: </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> B-1180 Brussels Belgium Alessandro.Ipe@meteo.be </p>
<p style=" margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; -qt-user-state:0;"> Web: http://gerb.oma.be </p>
<p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px; "> </p></body></html>