<div dir="ltr">Had missed out gluster-devel.</div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Feb 16, 2016 at 10:50 AM, Raghavendra G <span dir="ltr"><<a href="mailto:raghavendra@gluster.com" target="_blank">raghavendra@gluster.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>The thread is blocked on ctx->lock. Looking at the definition of pl_ctx_get, I found that two operations<br></div><div><br></div><div>1. Check whether ctx is not present.</div><div>2. Create and set the ctx.</div><div><br></div><div>are not atomic. This can result in a non-zero ctx (ctx1) being overwritten (by say ctx2) by a racing thread. And if somebody has already acquired lock ctx1, they would be doing an unlock on ctx2 resulting in a corrupted lock. This can result in hangs. Below is the definition of pl_ctx_get:</div><div><br></div><div>pl_ctx_t*</div><div>pl_ctx_get (client_t *client, xlator_t *xlator)</div><div>{</div><div> void *tmp = NULL;</div><div> <span style="white-space:pre-wrap"> </span>pl_ctx_t *ctx = NULL;</div><div><br></div><div><span style="white-space:pre-wrap"> </span>client_ctx_get (client, xlator, &tmp);</div><div><br></div><div><span style="white-space:pre-wrap"> </span>ctx = tmp;</div><div><br></div><div><span style="white-space:pre-wrap"> </span>if (ctx != NULL)</div><div><span style="white-space:pre-wrap"> </span> goto out;</div><div><br></div><div><span style="white-space:pre-wrap"> </span>ctx = GF_CALLOC (1, sizeof (pl_ctx_t), gf_locks_mt_posix_lock_t);</div><div><br></div><div><span style="white-space:pre-wrap"> </span>if (ctx == NULL)</div><div><span style="white-space:pre-wrap"> </span>goto out;</div><div><br></div><div> pthread_mutex_init (&ctx->lock, NULL);</div><div><span style="white-space:pre-wrap"> </span>INIT_LIST_HEAD (&ctx->inodelk_lockers);</div><div><span style="white-space:pre-wrap"> </span>INIT_LIST_HEAD (&ctx->entrylk_lockers);</div><div><br></div><div> if (client_ctx_set (client, xlator, ctx) != 0) {</div><div> pthread_mutex_destroy (&ctx->lock);</div><div><span style="white-space:pre-wrap"> </span> GF_FREE (ctx);</div><div> ctx = NULL;</div><div><span style="white-space:pre-wrap"> </span>}</div><div>out:</div><div> <span style="white-space:pre-wrap"> </span>return ctx;</div><div>}</div><div><br></div><div>Though this is a bug, I am not sure whether this is the RCA for the issue pointed out in this thread. I'll send out a patch for the issue identified here.</div><div><br></div></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Sat, Feb 13, 2016 at 8:46 AM, Joe Julian <span dir="ltr"><<a href="mailto:joe@julianfamily.org" target="_blank">joe@julianfamily.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I've also got several glusterfsd processes that have stopped responding.<br>
<br>
A backtrace from a live core, strace, and state dump follow:<br>
<br>
Thread 10 (LWP 31587):<br>
#0 0x00007f81d384289c in __lll_lock_wait () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81d383e065 in _L_lock_858 () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#2 0x00007f81d383deba in pthread_mutex_lock () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#3 0x00007f81ce600ff8 in pl_inodelk_client_cleanup ()<br>
from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/features/locks.so<br>
#4 0x00007f81ce5fe84a in ?? () from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/features/locks.so<br>
#5 0x00007f81d3ef573d in gf_client_disconnect () from /usr/lib/x86_64-linux-gnu/libglusterfs.so.0<br>
#6 0x00007f81cd74e270 in server_connection_cleanup ()<br>
from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/protocol/server.so<br>
#7 0x00007f81cd7486ec in server_rpc_notify ()<br>
from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/protocol/server.so<br>
#8 0x00007f81d3c70f1b in rpcsvc_handle_disconnect () from /usr/lib/x86_64-linux-gnu/libgfrpc.so.0<br>
#9 0x00007f81d3c710b0 in rpcsvc_notify () from /usr/lib/x86_64-linux-gnu/libgfrpc.so.0<br>
#10 0x00007f81d3c74257 in rpc_transport_notify () from /usr/lib/x86_64-linux-gnu/libgfrpc.so.0<br>
#11 0x00007f81cf4d4077 in ?? () from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/rpc-transport/socket.so<br>
#12 0x00007f81d3ef793b in ?? () from /usr/lib/x86_64-linux-gnu/libglusterfs.so.0<br>
#13 0x00007f81d4348f71 in main ()<br>
<br>
Thread 9 (LWP 3385):<br>
#0 0x00007f81d353408d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1 0x00007f81d3533f2c in sleep () from /lib/x86_64-linux-gnu/libc.so.6<br>
#2 0x00007f81cee50c38 in ?? () from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/storage/posix.so<br>
#3 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#4 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#5 0x0000000000000000 in ?? ()<br>
<br>
Thread 8 (LWP 20656):<br>
#0 0x00007f81d38400fe in pthread_cond_timedwait@@GLIBC_2.3.2 ()<br>
from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81ce3ea032 in iot_worker ()<br>
from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/performance/io-threads.so<br>
#2 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#3 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#4 0x0000000000000000 in ?? ()<br>
<br>
Thread 7 (LWP 31881):<br>
#0 0x00007f81d383fd84 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81cee50f3b in posix_fsyncer_pick ()<br>
from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/storage/posix.so<br>
#2 0x00007f81cee51155 in posix_fsyncer ()<br>
from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/storage/posix.so<br>
#3 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#4 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#5 0x0000000000000000 in ?? ()<br>
<br>
Thread 6 (LWP 31880):<br>
#0 0x00007f81d38400fe in pthread_cond_timedwait@@GLIBC_2.3.2 ()<br>
from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81cee4de5a in ?? () from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/storage/posix.so<br>
---Type <return> to continue, or q <return> to quit---<br>
#2 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#3 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#4 0x0000000000000000 in ?? ()<br>
<br>
Thread 5 (LWP 31842):<br>
#0 0x00007f81d383fd84 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81cdfd77fb in index_worker ()<br>
from /usr/lib/x86_64-linux-gnu/glusterfs/3.6.8/xlator/features/index.so<br>
#2 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#3 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#4 0x0000000000000000 in ?? ()<br>
<br>
Thread 4 (LWP 31591):<br>
#0 0x00007f81d38400fe in pthread_cond_timedwait@@GLIBC_2.3.2 ()<br>
from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81d3eddfe3 in syncenv_task () from /usr/lib/x86_64-linux-gnu/libglusterfs.so.0<br>
#2 0x00007f81d3ede440 in syncenv_processor () from /usr/lib/x86_64-linux-gnu/libglusterfs.so.0<br>
#3 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#4 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#5 0x0000000000000000 in ?? ()<br>
<br>
Thread 3 (LWP 31590):<br>
#0 0x00007f81d38400fe in pthread_cond_timedwait@@GLIBC_2.3.2 ()<br>
from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81d3eddfe3 in syncenv_task () from /usr/lib/x86_64-linux-gnu/libglusterfs.so.0<br>
#2 0x00007f81d3ede440 in syncenv_processor () from /usr/lib/x86_64-linux-gnu/libglusterfs.so.0<br>
#3 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#4 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#5 0x0000000000000000 in ?? ()<br>
<br>
Thread 2 (LWP 31589):<br>
#0 0x00007f81d38439f7 in do_sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81d3843a79 in sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#2 0x00007f81d434be12 in glusterfs_sigwaiter ()<br>
#3 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#4 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#5 0x0000000000000000 in ?? ()<br>
<br>
Thread 1 (LWP 31588):<br>
#0 0x00007f81d384352d in nanosleep () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#1 0x00007f81d3ebc4dc in gf_timer_proc () from /usr/lib/x86_64-linux-gnu/libglusterfs.so.0<br>
#2 0x00007f81d383be9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br>
#3 0x00007f81d35683fd in clone () from /lib/x86_64-linux-gnu/libc.so.6<br>
#4 0x0000000000000000 in ?? ()<br>
<br>
<br>
<br>
Process 31587 attached with 10 threads - interrupt to quit<br>
[pid 3385] 03:09:19 restart_syscall(<... resuming interrupted call ...> <unfinished ...><br>
[pid 20656] 03:09:19 restart_syscall(<... resuming interrupted call ...> <unfinished ...><br>
[pid 31881] 03:09:19 futex(0x7f81d5f538bc, FUTEX_WAIT_PRIVATE, 23707, NULL <unfinished ...><br>
[pid 31880] 03:09:19 restart_syscall(<... resuming interrupted call ...> <unfinished ...><br>
[pid 31842] 03:09:19 futex(0x7f81d5f4889c, FUTEX_WAIT_PRIVATE, 41409, NULL <unfinished ...><br>
[pid 31591] 03:09:19 restart_syscall(<... resuming interrupted call ...> <unfinished ...><br>
[pid 31590] 03:09:19 restart_syscall(<... resuming interrupted call ...> <unfinished ...><br>
[pid 31589] 03:09:19 rt_sigtimedwait([HUP INT USR1 USR2 TERM], NULL, NULL, 8 <unfinished ...><br>
[pid 31588] 03:09:19 restart_syscall(<... resuming interrupted call ...> <unfinished ...><br>
[pid 31587] 03:09:19 futex(0x7f81900023b0, FUTEX_WAIT_PRIVATE, 2, NULL <unfinished ...><br>
[pid 31588] 03:09:19 <... restart_syscall resumed> ) = 0<br>
[pid 31588] 03:09:19 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:20 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:21 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:22 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:23 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:24 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:25 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:26 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:27 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:28 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:29 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:30 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:31 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:32 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:33 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:34 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:35 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:36 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:37 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:38 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:39 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:40 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:41 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:42 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:43 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:44 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:45 nanosleep({1, 0}, <unfinished ...><br>
[pid 3385] 03:09:46 <... restart_syscall resumed> ) = 0<br>
[pid 3385] 03:09:46 open("/gluster/brick03/cinder-std-01/.glusterfs/health_check", O_RDWR|O_CREAT, 0644) = 27<br>
[pid 3385] 03:09:46 write(27, "2016-02-13 03:09:46", 19) = 19<br>
[pid 3385] 03:09:46 lseek(27, 0, SEEK_SET) = 0<br>
[pid 3385] 03:09:46 read(27, "2016-02-13 03:09:46", 19) = 19<br>
[pid 3385] 03:09:46 close(27) = 0<br>
[pid 3385] 03:09:46 rt_sigprocmask(SIG_BLOCK, [CHLD], ~[ILL ABRT BUS FPE KILL SEGV STOP SYS RTMIN RT_1], 8) = 0<br>
[pid 3385] 03:09:46 nanosleep({30, 0}, <unfinished ...><br>
[pid 31588] 03:09:46 <... nanosleep resumed> NULL) = 0<br>
[pid 31588] 03:09:46 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:47 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:48 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:49 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:50 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:51 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:52 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:53 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:54 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:55 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:56 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:57 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:58 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:09:59 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:10:00 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:10:01 nanosleep({1, 0}, NULL) = 0<br>
[pid 31588] 03:10:02 nanosleep({1, 0}, NULL) = 0<br>
<br>
<br>
<br>
<br>
<br>
<br>
DUMP-START-TIME: 2016-02-13 02:42:44.670135<br>
<br>
[mallinfo]<br>
mallinfo_arena=1187840<br>
mallinfo_ordblks=260<br>
mallinfo_smblks=1<br>
mallinfo_hblks=12<br>
mallinfo_hblkhd=16060416<br>
mallinfo_usmblks=0<br>
mallinfo_fsmblks=112<br>
mallinfo_uordblks=1036864<br>
mallinfo_fordblks=150976<br>
mallinfo_keepcost=97488<br>
<br>
[global.glusterfs - Memory usage]<br>
num_types=122<br>
<br>
[global.glusterfs - usage-type gf_common_mt_dnscache6 memusage]<br>
size=16<br>
num_allocs=1<br>
max_size=16<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_event_pool memusage]<br>
size=144<br>
num_allocs=1<br>
max_size=144<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_reg memusage]<br>
size=393216<br>
num_allocs=1<br>
max_size=393216<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_epoll_event memusage]<br>
size=3096<br>
num_allocs=1<br>
max_size=3096<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_fd_ctx memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=192<br>
max_num_allocs=1<br>
total_allocs=2<br>
<br>
[global.glusterfs - usage-type gf_common_mt_inode_ctx memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=288<br>
max_num_allocs=1<br>
total_allocs=32<br>
<br>
[global.glusterfs - usage-type gf_common_mt_xlator_t memusage]<br>
size=28600<br>
num_allocs=11<br>
max_size=57200<br>
max_num_allocs=22<br>
total_allocs=55<br>
<br>
[global.glusterfs - usage-type gf_common_mt_xlator_list_t memusage]<br>
size=320<br>
num_allocs=20<br>
max_size=640<br>
max_num_allocs=40<br>
total_allocs=100<br>
<br>
[global.glusterfs - usage-type gf_common_mt_volume_opt_list_t memusage]<br>
size=312<br>
num_allocs=13<br>
max_size=576<br>
max_num_allocs=24<br>
total_allocs=57<br>
<br>
[global.glusterfs - usage-type gf_common_mt_gf_timer_t memusage]<br>
size=112<br>
num_allocs=2<br>
max_size=168<br>
max_num_allocs=3<br>
total_allocs=39761<br>
<br>
[global.glusterfs - usage-type gf_common_mt_gf_timer_registry_t memusage]<br>
size=168<br>
num_allocs=1<br>
max_size=168<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_iobuf memusage]<br>
size=109536<br>
num_allocs=8<br>
max_size=109536<br>
max_num_allocs=8<br>
total_allocs=8<br>
<br>
[global.glusterfs - usage-type gf_common_mt_iobuf_arena memusage]<br>
size=1872<br>
num_allocs=9<br>
max_size=1872<br>
max_num_allocs=9<br>
total_allocs=9<br>
<br>
[global.glusterfs - usage-type gf_common_mt_iobref memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=48<br>
max_num_allocs=2<br>
total_allocs=39<br>
<br>
[global.glusterfs - usage-type gf_common_mt_iobuf_pool memusage]<br>
size=1776<br>
num_allocs=1<br>
max_size=1776<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_memdup memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=118<br>
max_num_allocs=7<br>
total_allocs=7<br>
<br>
[global.glusterfs - usage-type gf_common_mt_asprintf memusage]<br>
size=265<br>
num_allocs=12<br>
max_size=680<br>
max_num_allocs=90<br>
total_allocs=524<br>
<br>
[global.glusterfs - usage-type gf_common_mt_strdup memusage]<br>
size=3781<br>
num_allocs=172<br>
max_size=4264<br>
max_num_allocs=196<br>
total_allocs=708<br>
<br>
[global.glusterfs - usage-type gf_common_mt_socket_private_t memusage]<br>
size=1344<br>
num_allocs=3<br>
max_size=1344<br>
max_num_allocs=3<br>
total_allocs=3<br>
<br>
[global.glusterfs - usage-type gf_common_mt_ioq memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=312<br>
max_num_allocs=1<br>
total_allocs=14<br>
<br>
[global.glusterfs - usage-type gf_common_mt_char memusage]<br>
size=13504<br>
num_allocs=151<br>
max_size=35426<br>
max_num_allocs=217<br>
total_allocs=698<br>
<br>
[global.glusterfs - usage-type gf_common_mt_mem_pool memusage]<br>
size=1200<br>
num_allocs=10<br>
max_size=1200<br>
max_num_allocs=10<br>
total_allocs=10<br>
<br>
[global.glusterfs - usage-type gf_common_mt_long memusage]<br>
size=9034400<br>
num_allocs=10<br>
max_size=9034400<br>
max_num_allocs=10<br>
total_allocs=10<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpcsvc_auth_list memusage]<br>
size=288<br>
num_allocs=4<br>
max_size=288<br>
max_num_allocs=4<br>
total_allocs=4<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpcsvc_t memusage]<br>
size=200<br>
num_allocs=1<br>
max_size=200<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpcsvc_program_t memusage]<br>
size=240<br>
num_allocs=2<br>
max_size=240<br>
max_num_allocs=2<br>
total_allocs=2<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpcsvc_listener_t memusage]<br>
size=160<br>
num_allocs=1<br>
max_size=160<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpcsvc_wrapper_t memusage]<br>
size=32<br>
num_allocs=1<br>
max_size=32<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpcclnt_t memusage]<br>
size=296<br>
num_allocs=1<br>
max_size=296<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpcclnt_savedframe_t memusage]<br>
size=200<br>
num_allocs=1<br>
max_size=200<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpc_trans_t memusage]<br>
size=8352<br>
num_allocs=3<br>
max_size=8352<br>
max_num_allocs=3<br>
total_allocs=3<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpc_trans_pollin_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=296<br>
max_num_allocs=1<br>
total_allocs=25<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpc_trans_reqinfo_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=64<br>
max_num_allocs=1<br>
total_allocs=13<br>
<br>
[global.glusterfs - usage-type gf_common_mt_glusterfs_graph_t memusage]<br>
size=192<br>
num_allocs=1<br>
max_size=384<br>
max_num_allocs=2<br>
total_allocs=5<br>
<br>
[global.glusterfs - usage-type gf_common_mt_rpcclnt_cb_program_t memusage]<br>
size=88<br>
num_allocs=1<br>
max_size=88<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_cliententry_t memusage]<br>
size=2048<br>
num_allocs=1<br>
max_size=2048<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_clienttable_t memusage]<br>
size=32<br>
num_allocs=1<br>
max_size=32<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gf_common_mt_iobrefs memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=256<br>
max_num_allocs=2<br>
total_allocs=39<br>
<br>
[global.glusterfs - usage-type gf_sock_mt_lock_array memusage]<br>
size=1640<br>
num_allocs=1<br>
max_size=1640<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gfd_mt_server_cmdline_t memusage]<br>
size=40<br>
num_allocs=1<br>
max_size=40<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[global.glusterfs - usage-type gfd_mt_xlator_cmdline_option_t memusage]<br>
size=80<br>
num_allocs=2<br>
max_size=80<br>
max_num_allocs=2<br>
total_allocs=2<br>
<br>
[global.glusterfs - usage-type gfd_mt_char memusage]<br>
size=53<br>
num_allocs=4<br>
max_size=53<br>
max_num_allocs=4<br>
total_allocs=4<br>
<br>
[global.glusterfs - usage-type gfd_mt_call_pool_t memusage]<br>
size=48<br>
num_allocs=1<br>
max_size=48<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[mempool]<br>
-----=-----<br>
pool-name=gv-cinder-server:fd_t<br>
hot-count=2<br>
cold-count=1022<br>
padded_sizeof=108<br>
alloc-count=27465<br>
max-alloc=6<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=gv-cinder-server:dentry_t<br>
hot-count=30<br>
cold-count=16354<br>
padded_sizeof=84<br>
alloc-count=1689<br>
max-alloc=31<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=gv-cinder-server:inode_t<br>
hot-count=32<br>
cold-count=16352<br>
padded_sizeof=156<br>
alloc-count=23516<br>
max-alloc=35<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=gv-cinder-changelog:changelog_local_t<br>
hot-count=0<br>
cold-count=64<br>
padded_sizeof=116<br>
alloc-count=0<br>
max-alloc=0<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=gv-cinder-locks:pl_local_t<br>
hot-count=0<br>
cold-count=32<br>
padded_sizeof=148<br>
alloc-count=119146<br>
max-alloc=5<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=gv-cinder-marker:marker_local_t<br>
hot-count=0<br>
cold-count=128<br>
padded_sizeof=332<br>
alloc-count=25101<br>
max-alloc=2<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=gv-cinder-quota:quota_local_t<br>
hot-count=0<br>
cold-count=64<br>
padded_sizeof=412<br>
alloc-count=0<br>
max-alloc=0<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=gv-cinder-server:rpcsvc_request_t<br>
hot-count=0<br>
cold-count=512<br>
padded_sizeof=2828<br>
alloc-count=134951621<br>
max-alloc=43<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:struct saved_frame<br>
hot-count=0<br>
cold-count=8<br>
padded_sizeof=124<br>
alloc-count=13<br>
max-alloc=3<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:struct rpc_req<br>
hot-count=0<br>
cold-count=8<br>
padded_sizeof=588<br>
alloc-count=13<br>
max-alloc=3<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:rpcsvc_request_t<br>
hot-count=0<br>
cold-count=8<br>
padded_sizeof=2828<br>
alloc-count=1<br>
max-alloc=1<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:log_buf_t<br>
hot-count=0<br>
cold-count=256<br>
padded_sizeof=140<br>
alloc-count=1<br>
max-alloc=1<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:data_t<br>
hot-count=152<br>
cold-count=16232<br>
padded_sizeof=52<br>
alloc-count=88386649<br>
max-alloc=219<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:data_pair_t<br>
hot-count=110<br>
cold-count=16274<br>
padded_sizeof=68<br>
alloc-count=2103720<br>
max-alloc=191<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:dict_t<br>
hot-count=58<br>
cold-count=4038<br>
padded_sizeof=140<br>
alloc-count=85559811<br>
max-alloc=101<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:call_stub_t<br>
hot-count=0<br>
cold-count=1024<br>
padded_sizeof=3756<br>
alloc-count=135291560<br>
max-alloc=27<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:call_stack_t<br>
hot-count=0<br>
cold-count=1024<br>
padded_sizeof=1836<br>
alloc-count=134886246<br>
max-alloc=43<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
-----=-----<br>
pool-name=glusterfs:call_frame_t<br>
hot-count=0<br>
cold-count=4096<br>
padded_sizeof=172<br>
alloc-count=455460023<br>
max-alloc=156<br>
pool-misses=0<br>
cur-stdalloc=0<br>
max-stdalloc=0<br>
<br>
[iobuf.global]<br>
iobuf_pool=0x7f81d5ebc980<br>
iobuf_pool.default_page_size=131072<br>
iobuf_pool.arena_size=12976128<br>
iobuf_pool.arena_cnt=8<br>
iobuf_pool.request_misses=0<br>
<br>
[purge.1]<br>
purge.1.mem_base=0x7f81d430f000<br>
purge.1.active_cnt=0<br>
purge.1.passive_cnt=1024<br>
purge.1.alloc_cnt=318736820<br>
purge.1.max_active=12<br>
purge.1.page_size=128<br>
<br>
[purge.2]<br>
purge.2.mem_base=0x7f81d42cf000<br>
purge.2.active_cnt=0<br>
purge.2.passive_cnt=512<br>
purge.2.alloc_cnt=85775611<br>
purge.2.max_active=8<br>
purge.2.page_size=512<br>
<br>
[purge.3]<br>
purge.3.mem_base=0x7f81d41cf000<br>
purge.3.active_cnt=0<br>
purge.3.passive_cnt=512<br>
purge.3.alloc_cnt=25248<br>
purge.3.max_active=1<br>
purge.3.page_size=2048<br>
<br>
[purge.4]<br>
purge.4.mem_base=0x7f81d2976000<br>
purge.4.active_cnt=0<br>
purge.4.passive_cnt=128<br>
purge.4.alloc_cnt=1208704<br>
purge.4.max_active=11<br>
purge.4.page_size=8192<br>
<br>
[purge.5]<br>
purge.5.mem_base=0x7f81d2776000<br>
purge.5.active_cnt=0<br>
purge.5.passive_cnt=64<br>
purge.5.alloc_cnt=330835<br>
purge.5.max_active=6<br>
purge.5.page_size=32768<br>
<br>
[purge.6]<br>
purge.6.mem_base=0x7f81d2376000<br>
purge.6.active_cnt=0<br>
purge.6.passive_cnt=32<br>
purge.6.alloc_cnt=47899288<br>
purge.6.max_active=4<br>
purge.6.page_size=131072<br>
<br>
[purge.7]<br>
purge.7.mem_base=0x7f81d2176000<br>
purge.7.active_cnt=0<br>
purge.7.passive_cnt=8<br>
purge.7.alloc_cnt=212<br>
purge.7.max_active=1<br>
purge.7.page_size=262144<br>
<br>
[arena.8]<br>
arena.8.mem_base=0x7f81d1f76000<br>
arena.8.active_cnt=0<br>
arena.8.passive_cnt=2<br>
arena.8.alloc_cnt=0<br>
arena.8.max_active=0<br>
arena.8.page_size=1048576<br>
<br>
[global.callpool]<br>
callpool_address=0x7f81d5ed8630<br>
callpool.cnt=0<br>
<br>
[active graph - 5]<br>
<br>
[protocol/server.gv-cinder-server - Memory usage]<br>
num_types=127<br>
<br>
[protocol/server.gv-cinder-server - usage-type 0 memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=96<br>
max_num_allocs=3<br>
total_allocs=450<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_fdentry_t memusage]<br>
size=51200<br>
num_allocs=25<br>
max_size=81920<br>
max_num_allocs=40<br>
total_allocs=403<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_fdtable_t memusage]<br>
size=1536<br>
num_allocs=24<br>
max_size=2496<br>
max_num_allocs=39<br>
total_allocs=150<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_fd_ctx memusage]<br>
size=384<br>
num_allocs=2<br>
max_size=1152<br>
max_num_allocs=6<br>
total_allocs=27465<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_inode_ctx memusage]<br>
size=1728<br>
num_allocs=6<br>
max_size=2592<br>
max_num_allocs=9<br>
total_allocs=23477<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_list_head memusage]<br>
size=1273488<br>
num_allocs=2<br>
max_size=1273488<br>
max_num_allocs=2<br>
total_allocs=2<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_inode_table_t memusage]<br>
size=200<br>
num_allocs=1<br>
max_size=200<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_volume_opt_list_t memusage]<br>
size=264<br>
num_allocs=11<br>
max_size=264<br>
max_num_allocs=11<br>
total_allocs=11<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_auth_handle_t memusage]<br>
size=48<br>
num_allocs=2<br>
max_size=48<br>
max_num_allocs=2<br>
total_allocs=10<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_iobref memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=1056<br>
max_num_allocs=44<br>
total_allocs=221069677<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_memdup memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=779<br>
max_num_allocs=35<br>
total_allocs=1937699<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_asprintf memusage]<br>
size=144<br>
num_allocs=5<br>
max_size=3125<br>
max_num_allocs=10<br>
total_allocs=834957<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_strdup memusage]<br>
size=10972<br>
num_allocs=284<br>
max_size=11475<br>
max_num_allocs=303<br>
total_allocs=84802827<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_socket_private_t memusage]<br>
size=11200<br>
num_allocs=25<br>
max_size=17920<br>
max_num_allocs=40<br>
total_allocs=151<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_ioq memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=936<br>
max_num_allocs=3<br>
total_allocs=134951621<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_char memusage]<br>
size=149<br>
num_allocs=7<br>
max_size=3525<br>
max_num_allocs=61<br>
total_allocs=173345106<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_mem_pool memusage]<br>
size=480<br>
num_allocs=4<br>
max_size=480<br>
max_num_allocs=4<br>
total_allocs=4<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_long memusage]<br>
size=5490688<br>
num_allocs=4<br>
max_size=5490688<br>
max_num_allocs=4<br>
total_allocs=4<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_rpcsvc_auth_list memusage]<br>
size=288<br>
num_allocs=4<br>
max_size=288<br>
max_num_allocs=4<br>
total_allocs=4<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_rpcsvc_t memusage]<br>
size=200<br>
num_allocs=1<br>
max_size=200<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_rpcsvc_program_t memusage]<br>
size=360<br>
num_allocs=3<br>
max_size=360<br>
max_num_allocs=3<br>
total_allocs=3<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_rpcsvc_listener_t memusage]<br>
size=160<br>
num_allocs=1<br>
max_size=160<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_rpcsvc_wrapper_t memusage]<br>
size=64<br>
num_allocs=2<br>
max_size=64<br>
max_num_allocs=2<br>
total_allocs=128<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_rpc_trans_t memusage]<br>
size=69600<br>
num_allocs=25<br>
max_size=111360<br>
max_num_allocs=40<br>
total_allocs=151<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_rpc_trans_pollin_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=296<br>
max_num_allocs=1<br>
total_allocs=134951621<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_fd_lk_ctx_t memusage]<br>
size=48<br>
num_allocs=2<br>
max_size=144<br>
max_num_allocs=6<br>
total_allocs=27465<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_client_t memusage]<br>
size=3072<br>
num_allocs=48<br>
max_size=4992<br>
max_num_allocs=78<br>
total_allocs=300<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_client_ctx memusage]<br>
size=3072<br>
num_allocs=24<br>
max_size=4992<br>
max_num_allocs=39<br>
total_allocs=150<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_common_mt_iobrefs memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=5632<br>
max_num_allocs=44<br>
total_allocs=221069677<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_server_mt_server_conf_t memusage]<br>
size=50088<br>
num_allocs=25<br>
max_size=50568<br>
max_num_allocs=40<br>
total_allocs=151<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_server_mt_state_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=87376<br>
max_num_allocs=43<br>
total_allocs=134886335<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_server_mt_dirent_rsp_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=3040<br>
max_num_allocs=19<br>
total_allocs=26251<br>
<br>
[protocol/server.gv-cinder-server - usage-type gf_server_mt_rsp_buf_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=961<br>
max_num_allocs=19<br>
total_allocs=644<br>
<br>
[xlator.protocol.server.priv]<br>
server.total-bytes-read=11424142224<br>
server.total-bytes-write=3014661265649<br>
conn.2.bound_xl./gluster/brick03/cinder-std-01.hashsize=14057<br>
conn.2.bound_xl./gluster/brick03/<a href="http://cinder-std-01.name" rel="noreferrer" target="_blank">cinder-std-01.name</a>=/gluster/brick03/cinder-std-01/inode<br>
conn.2.bound_xl./gluster/brick03/cinder-std-01.lru_limit=16384<br>
conn.2.bound_xl./gluster/brick03/cinder-std-01.active_size=3<br>
conn.2.bound_xl./gluster/brick03/cinder-std-01.lru_size=29<br>
conn.2.bound_xl./gluster/brick03/cinder-std-01.purge_size=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.active.1]<br>
gfid=8f787374-3b1a-4a0e-8ec5-41f41724c22d<br>
nlookup=10372<br>
fd-count=1<br>
ref=4<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-820679f7-4d6a-4397-a522-6fff941ab862<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.active.2]<br>
gfid=b8b58762-fd76-4d23-9683-50abf6447d2e<br>
nlookup=11355<br>
fd-count=1<br>
ref=1<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-ad3357ba-c264-4e58-a1ac-1d90cb0f960d<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.active.3]<br>
gfid=00000000-0000-0000-0000-000000000001<br>
nlookup=13<br>
fd-count=0<br>
ref=1<br>
ia_type=2<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.1]<br>
gfid=8bbcfe88-b91e-4643-bb7a-49d2e7a15bcf<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.2]<br>
gfid=97a98f35-d5c2-4a2c-b900-cacb0b74720e<br>
nlookup=13<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.3]<br>
gfid=4ffec429-231f-4e27-a227-72388d607eed<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-afa9bc2c-5666-422b-88c4-2cb6b1f1fcaa<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.4]<br>
gfid=1e2f6504-5c49-4dda-9a20-5f47f11b7f78<br>
nlookup=13<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.5]<br>
gfid=ddd4bec4-d73b-4649-ab05-63c7219a9c2c<br>
nlookup=13<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.6]<br>
gfid=02b80a30-76d8-4c30-9575-6fbec905d8d3<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.7]<br>
gfid=43bc1a78-c9b7-471b-9721-4da560745a6e<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.8]<br>
gfid=396b00de-be60-4700-b617-3d3edfc5aeed<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.9]<br>
gfid=9f654186-ca48-4e08-8fdd-dd86c9e5dbce<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.10]<br>
gfid=09d93e82-012b-4e06-abee-34c0d05ca6e8<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.11]<br>
gfid=ba5986bb-7e18-4d5f-a9e7-04aa08e732c1<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-8a05b90e-820a-4b97-817c-35d9e3a32c20<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.12]<br>
gfid=e298ffe1-49bd-473e-8707-56031118b196<br>
nlookup=30<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.13]<br>
gfid=f83ac264-2cca-4ef6-bbf9-25e0c1c2e307<br>
nlookup=30<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.14]<br>
gfid=22f1caad-537b-4309-b9ca-b23068bc5ca6<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.15]<br>
gfid=6ae80d7a-76b2-4650-be55-7bee4fb5fd49<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.16]<br>
gfid=d0e7b11a-ca37-4905-ba87-2b7e5b2e7198<br>
nlookup=30<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.17]<br>
gfid=a8bdac1f-39e3-4d5a-8b96-0da4900dfa91<br>
nlookup=30<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.18]<br>
gfid=edb13fa6-59a3-4374-8645-a17e319559d1<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.19]<br>
gfid=e13a41d1-2945-486f-9016-8e8ec9e5889d<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-3aee038f-2ba9-4195-883c-62978b0d394d<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.20]<br>
gfid=fc021567-c228-4a7b-ad47-b4b4eaca7fd7<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/<a href="http://vol-3aee038f-2ba9-4195-883c-62978b0d394d.info" rel="noreferrer" target="_blank">vol-3aee038f-2ba9-4195-883c-62978b0d394d.info</a><br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.21]<br>
gfid=337d82da-1104-4f2c-9ad1-900265386532<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-92d4c940-409a-4bfa-ad1f-9c87690dc0f0<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.22]<br>
gfid=989060f7-6bb1-4052-a811-c3136eae0395<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-4d03e51a-da7f-4a53-ae85-6f05e36d4d07<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.23]<br>
gfid=07398a28-6a92-4243-a0e5-d3e03eba4fa5<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.24]<br>
gfid=50d3c83a-d670-4359-939c-3601abc6ef07<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.25]<br>
gfid=5b810982-131a-4ab7-8986-034e1f5fec3e<br>
nlookup=17<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.26]<br>
gfid=cfc8019d-69c7-45fb-b95c-1dddbe4e24bb<br>
nlookup=26<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-4d46d6d6-3d34-4243-bb86-e4faeae5ba75<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.27]<br>
gfid=99c346af-7edf-4978-b020-af70eba07607<br>
nlookup=7013<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-cdf2ad03-e114-4f73-b38d-117c08f2545c<br>
mandatory=0<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.28]<br>
gfid=c5915f07-8d1f-45df-8409-f3ea0f7b3da9<br>
nlookup=5768<br>
fd-count=0<br>
ref=0<br>
ia_type=2<br>
<br>
[conn.2.bound_xl./gluster/brick03/cinder-std-01.lru.29]<br>
gfid=4a7eb4bb-10a9-43b9-a4dd-d8256697b044<br>
nlookup=6981<br>
fd-count=0<br>
ref=0<br>
ia_type=1<br>
<br>
[xlator.features.locks.gv-cinder-locks.inode]<br>
path=/vol-f0e0740f-4e07-4a62-a2b4-9e6ce18496a5<br>
mandatory=0<br>
<a href="http://conn.2.id" rel="noreferrer" target="_blank">conn.2.id</a>=controller01-8035-2016/02/11-21:48:33:714247-gv-cinder-client-2-0-0<br>
conn.2.ref=1<br>
conn.2.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.4.id" rel="noreferrer" target="_blank">conn.4.id</a>=compute015-24816-2016/02/11-21:56:23:422938-gv-cinder-client-2-0-0<br>
conn.4.ref=1<br>
conn.4.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.6.id" rel="noreferrer" target="_blank">conn.6.id</a>=compute013-12886-2016/02/11-22:41:00:857700-gv-cinder-client-2-0-0<br>
conn.6.ref=1<br>
conn.6.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.7.id" rel="noreferrer" target="_blank">conn.7.id</a>=compute015-20555-2016/02/11-21:54:15:924117-gv-cinder-client-2-0-0<br>
conn.7.ref=1<br>
conn.7.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.8.id" rel="noreferrer" target="_blank">conn.8.id</a>=storage07-29222-2016/02/12-08:16:20:52268-gv-cinder-client-2-0-0<br>
conn.8.ref=1<br>
conn.8.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.9.id" rel="noreferrer" target="_blank">conn.9.id</a>=storage07-31653-2016/01/29-06:43:27:2595-gv-cinder-client-2-0-2<br>
conn.9.ref=1<br>
conn.9.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.11.id" rel="noreferrer" target="_blank">conn.11.id</a>=compute015-7236-2016/02/11-22:03:52:865440-gv-cinder-client-2-0-0<br>
conn.11.ref=1<br>
conn.11.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.13.id" rel="noreferrer" target="_blank">conn.13.id</a>=storage03-7760-2016/02/11-20:45:51:151440-gv-cinder-client-2-0-0<br>
conn.13.ref=1<br>
conn.13.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.14.id" rel="noreferrer" target="_blank">conn.14.id</a>=compute021-12040-2016/02/11-22:49:59:497964-gv-cinder-client-2-0-0<br>
conn.14.ref=1<br>
conn.14.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.19.id" rel="noreferrer" target="_blank">conn.19.id</a>=compute016-3457-2016/02/11-23:05:18:739493-gv-cinder-client-2-0-0<br>
conn.19.ref=1<br>
conn.19.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.21.id" rel="noreferrer" target="_blank">conn.21.id</a>=compute011-17350-2016/02/12-00:04:46:704199-gv-cinder-client-2-0-0<br>
conn.21.ref=1<br>
conn.21.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.22.id" rel="noreferrer" target="_blank">conn.22.id</a>=compute014-2359-2016/02/11-22:37:08:48705-gv-cinder-client-2-0-0<br>
conn.22.ref=1<br>
conn.22.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.23.id" rel="noreferrer" target="_blank">conn.23.id</a>=storage04-23521-2016/02/11-20:45:50:904106-gv-cinder-client-2-0-0<br>
conn.23.ref=1<br>
conn.23.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.25.id" rel="noreferrer" target="_blank">conn.25.id</a>=storage08-20934-2016/02/11-20:45:47:836024-gv-cinder-client-2-0-0<br>
conn.25.ref=1<br>
conn.25.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.26.id" rel="noreferrer" target="_blank">conn.26.id</a>=storage04-23562-2016/02/11-20:45:51:830750-gv-cinder-client-2-0-0<br>
conn.26.ref=1<br>
conn.26.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.27.id" rel="noreferrer" target="_blank">conn.27.id</a>=compute018-31965-2016/02/11-21:35:27:794540-gv-cinder-client-2-0-0<br>
conn.27.ref=1<br>
conn.27.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.28.id" rel="noreferrer" target="_blank">conn.28.id</a>=compute018-16969-2016/02/11-21:43:33:877210-gv-cinder-client-2-0-0<br>
conn.28.ref=1<br>
conn.28.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.29.id" rel="noreferrer" target="_blank">conn.29.id</a>=compute017-21189-2016/02/11-22:53:39:559720-gv-cinder-client-2-0-0<br>
conn.29.ref=1<br>
conn.29.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.31.id" rel="noreferrer" target="_blank">conn.31.id</a>=compute018-4161-2016/02/11-21:37:35:723582-gv-cinder-client-2-0-0<br>
conn.31.ref=1<br>
conn.31.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.34.id" rel="noreferrer" target="_blank">conn.34.id</a>=storage03-1915-2016/02/02-16:51:43:144253-gv-cinder-client-2-0-1<br>
conn.34.ref=1<br>
conn.34.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.35.id" rel="noreferrer" target="_blank">conn.35.id</a>=storage08-20965-2016/02/11-20:45:48:848917-gv-cinder-client-2-0-0<br>
conn.35.ref=1<br>
conn.35.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.36.id" rel="noreferrer" target="_blank">conn.36.id</a>=compute019-15495-2016/02/11-22:58:56:961354-gv-cinder-client-2-0-0<br>
conn.36.ref=1<br>
conn.36.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.37.id" rel="noreferrer" target="_blank">conn.37.id</a>=storage04-29111-2016/02/11-18:26:13:30717-gv-cinder-client-2-0-0<br>
conn.37.ref=1<br>
conn.37.bound_xl=/gluster/brick03/cinder-std-01<br>
<a href="http://conn.38.id" rel="noreferrer" target="_blank">conn.38.id</a>=storage03-7806-2016/02/11-20:45:52:54804-gv-cinder-client-2-0-0<br>
conn.38.ref=1<br>
conn.38.bound_xl=/gluster/brick03/cinder-std-01<br>
<br>
[debug/io-stats./gluster/brick03/cinder-std-01 - Memory usage]<br>
num_types=121<br>
<br>
[debug/io-stats./gluster/brick03/cinder-std-01 - usage-type gf_common_mt_asprintf memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=109<br>
max_num_allocs=1<br>
total_allocs=7<br>
<br>
[debug/io-stats./gluster/brick03/cinder-std-01 - usage-type gf_common_mt_strdup memusage]<br>
size=258<br>
num_allocs=6<br>
max_size=406<br>
max_num_allocs=10<br>
total_allocs=10239<br>
<br>
[debug/io-stats./gluster/brick03/cinder-std-01 - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=154<br>
max_num_allocs=1<br>
total_allocs=7<br>
<br>
[debug/io-stats./gluster/brick03/cinder-std-01 - usage-type gf_io_stats_mt_ios_conf memusage]<br>
size=5424<br>
num_allocs=1<br>
max_size=5424<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[debug/io-stats./gluster/brick03/cinder-std-01 - usage-type gf_io_stats_mt_ios_fd memusage]<br>
size=1104<br>
num_allocs=2<br>
max_size=2760<br>
max_num_allocs=5<br>
total_allocs=9361<br>
<br>
[debug/io-stats./gluster/brick03/cinder-std-01 - usage-type gf_io_stats_mt_ios_stat memusage]<br>
size=928<br>
num_allocs=14<br>
max_size=1080<br>
max_num_allocs=15<br>
total_allocs=888<br>
<br>
[debug/io-stats./gluster/brick03/cinder-std-01 - usage-type gf_io_stats_mt_ios_stat_list memusage]<br>
size=512<br>
num_allocs=16<br>
max_size=512<br>
max_num_allocs=16<br>
total_allocs=16<br>
cumulative.data_read=6270431573049<br>
cumulative.data_written=4366462976<br>
incremental.data_read=6270431573049<br>
incremental.data_written=4366462976<br>
/gluster/brick03/cinder-std-01.cumulative.NULL=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.NULL=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.STAT=399758,32878860,21.000,9986.000,82.247<br>
/gluster/brick03/cinder-std-01.incremental.STAT=399758,32878860,21.000,9986.000,82.247<br>
/gluster/brick03/cinder-std-01.cumulative.READLINK=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.READLINK=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.MKNOD=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.MKNOD=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.MKDIR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.MKDIR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.UNLINK=1659,210449,32.000,375.000,126.853<br>
/gluster/brick03/cinder-std-01.incremental.UNLINK=1659,210449,32.000,375.000,126.853<br>
/gluster/brick03/cinder-std-01.cumulative.RMDIR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.RMDIR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.SYMLINK=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.SYMLINK=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.RENAME=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.RENAME=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.LINK=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.LINK=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.TRUNCATE=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.TRUNCATE=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.OPEN=8487,926077,36.000,260.000,109.117<br>
/gluster/brick03/cinder-std-01.incremental.OPEN=8487,926077,36.000,260.000,109.117<br>
/gluster/brick03/cinder-std-01.cumulative.READ=48833565,<a href="tel:12708669647" value="+12708669647" target="_blank">12708669647</a>,14.000,1602328.000,260.245<br>
/gluster/brick03/cinder-std-01.incremental.READ=48833565,<a href="tel:12708669647" value="+12708669647" target="_blank">12708669647</a>,14.000,1602328.000,260.245<br>
/gluster/brick03/cinder-std-01.cumulative.WRITE=303078,62499624,17.000,172831.000,206.216<br>
/gluster/brick03/cinder-std-01.incremental.WRITE=303078,62499624,17.000,172831.000,206.216<br>
/gluster/brick03/cinder-std-01.cumulative.STATFS=11584,1266007,21.000,55380.000,109.289<br>
/gluster/brick03/cinder-std-01.incremental.STATFS=11584,1266007,21.000,55380.000,109.289<br>
/gluster/brick03/cinder-std-01.cumulative.FLUSH=882,54202,16.000,221.000,61.454<br>
/gluster/brick03/cinder-std-01.incremental.FLUSH=882,54202,16.000,221.000,61.454<br>
/gluster/brick03/cinder-std-01.cumulative.FSYNC=63714,6442491979,50.000,906161.000,101115.798<br>
/gluster/brick03/cinder-std-01.incremental.FSYNC=63714,6442491979,50.000,906161.000,101115.798<br>
/gluster/brick03/cinder-std-01.cumulative.SETXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.SETXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.GETXATTR=25101,2796339,19.000,59253.000,111.403<br>
/gluster/brick03/cinder-std-01.incremental.GETXATTR=25101,2796339,19.000,59253.000,111.403<br>
/gluster/brick03/cinder-std-01.cumulative.REMOVEXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.REMOVEXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.OPENDIR=15586,1103872,1.000,275.000,70.825<br>
/gluster/brick03/cinder-std-01.incremental.OPENDIR=15586,1103872,1.000,275.000,70.825<br>
/gluster/brick03/cinder-std-01.cumulative.FSYNCDIR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FSYNCDIR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.ACCESS=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.ACCESS=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.CREATE=874,50472530,232.000,207796.000,57748.890<br>
/gluster/brick03/cinder-std-01.incremental.CREATE=874,50472530,232.000,207796.000,57748.890<br>
/gluster/brick03/cinder-std-01.cumulative.FTRUNCATE=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FTRUNCATE=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.FSTAT=17,2177,79.000,171.000,128.059<br>
/gluster/brick03/cinder-std-01.incremental.FSTAT=17,2177,79.000,171.000,128.059<br>
/gluster/brick03/<a href="http://cinder-std-01.cumulative.LK" rel="noreferrer" target="_blank">cinder-std-01.cumulative.LK</a>=0,0,0.000,0.000,0.000<br>
/gluster/brick03/<a href="http://cinder-std-01.incremental.LK" rel="noreferrer" target="_blank">cinder-std-01.incremental.LK</a>=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.LOOKUP=125661,33305278,11.000,85401.000,265.041<br>
/gluster/brick03/cinder-std-01.incremental.LOOKUP=125661,33305278,11.000,85401.000,265.041<br>
/gluster/brick03/cinder-std-01.cumulative.READDIR=9962,733765,11.000,22711.000,73.656<br>
/gluster/brick03/cinder-std-01.incremental.READDIR=9962,733765,11.000,22711.000,73.656<br>
/gluster/brick03/cinder-std-01.cumulative.INODELK=84548282,8422980210,10.000,3541049.000,99.623<br>
/gluster/brick03/cinder-std-01.incremental.INODELK=84548282,8422980210,10.000,3541049.000,99.623<br>
/gluster/brick03/cinder-std-01.cumulative.FINODELK=160805,38053301587,10.000,160453695.000,236642.527<br>
/gluster/brick03/cinder-std-01.incremental.FINODELK=160805,38053301587,10.000,160453695.000,236642.527<br>
/gluster/brick03/cinder-std-01.cumulative.ENTRYLK=13410,926496,12.000,202.000,69.090<br>
/gluster/brick03/cinder-std-01.incremental.ENTRYLK=13410,926496,12.000,202.000,69.090<br>
/gluster/brick03/cinder-std-01.cumulative.FENTRYLK=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FENTRYLK=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.XATTROP=3719,655734,42.000,17867.000,176.320<br>
/gluster/brick03/cinder-std-01.incremental.XATTROP=3719,655734,42.000,17867.000,176.320<br>
/gluster/brick03/cinder-std-01.cumulative.FXATTROP=361596,56177842,27.000,142536.000,155.361<br>
/gluster/brick03/cinder-std-01.incremental.FXATTROP=361596,56177842,27.000,142536.000,155.361<br>
/gluster/brick03/cinder-std-01.cumulative.FGETXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FGETXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.FSETXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FSETXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.RCHECKSUM=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.RCHECKSUM=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.SETATTR=23,3450,93.000,178.000,150.000<br>
/gluster/brick03/cinder-std-01.incremental.SETATTR=23,3450,93.000,178.000,150.000<br>
/gluster/brick03/cinder-std-01.cumulative.FSETATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FSETATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.READDIRP=39,421236,40.000,97679.000,10800.923<br>
/gluster/brick03/cinder-std-01.incremental.READDIRP=39,421236,40.000,97679.000,10800.923<br>
/gluster/brick03/cinder-std-01.cumulative.FORGET=874,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FORGET=874,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.RELEASE=9359,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.RELEASE=9359,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.RELEASEDIR=15586,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.RELEASEDIR=15586,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.GETSPEC=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.GETSPEC=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.FREMOVEXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FREMOVEXATTR=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.FALLOCATE=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.FALLOCATE=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.DISCARD=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.DISCARD=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.cumulative.ZEROFILL=0,0,0.000,0.000,0.000<br>
/gluster/brick03/cinder-std-01.incremental.ZEROFILL=0,0,0.000,0.000,0.000<br>
<br>
[features/quota.gv-cinder-quota - Memory usage]<br>
num_types=128<br>
<br>
[features/quota.gv-cinder-quota - usage-type gf_common_mt_asprintf memusage]<br>
size=30<br>
num_allocs=1<br>
max_size=124<br>
max_num_allocs=2<br>
total_allocs=6<br>
<br>
[features/quota.gv-cinder-quota - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=133<br>
max_num_allocs=1<br>
total_allocs=5<br>
<br>
[features/quota.gv-cinder-quota - usage-type gf_common_mt_mem_pool memusage]<br>
size=120<br>
num_allocs=1<br>
max_size=120<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/quota.gv-cinder-quota - usage-type gf_common_mt_long memusage]<br>
size=26368<br>
num_allocs=1<br>
max_size=26368<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/quota.gv-cinder-quota - usage-type gf_quota_mt_quota_priv_t memusage]<br>
size=96<br>
num_allocs=1<br>
max_size=96<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[xlators.features.quota.priv]<br>
soft-timeout=60<br>
hard-timeout=5<br>
alert-time=86400<br>
quota-on=0<br>
statfs=0<br>
volume-uuid=gv-cinder<br>
validation-count=0<br>
<br>
[features/marker.gv-cinder-marker - Memory usage]<br>
num_types=124<br>
<br>
[features/marker.gv-cinder-marker - usage-type gf_common_mt_asprintf memusage]<br>
size=32<br>
num_allocs=1<br>
max_size=115<br>
max_num_allocs=2<br>
total_allocs=1745<br>
<br>
[features/marker.gv-cinder-marker - usage-type gf_common_mt_strdup memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=42<br>
max_num_allocs=2<br>
total_allocs=25101<br>
<br>
[features/marker.gv-cinder-marker - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=99<br>
max_num_allocs=1<br>
total_allocs=1744<br>
<br>
[features/marker.gv-cinder-marker - usage-type gf_common_mt_mem_pool memusage]<br>
size=120<br>
num_allocs=1<br>
max_size=120<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/marker.gv-cinder-marker - usage-type gf_common_mt_long memusage]<br>
size=42496<br>
num_allocs=1<br>
max_size=42496<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/marker.gv-cinder-marker - usage-type gf_marker_mt_marker_conf_t memusage]<br>
size=80<br>
num_allocs=1<br>
max_size=80<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/index.gv-cinder-index - Memory usage]<br>
num_types=120<br>
<br>
[features/index.gv-cinder-index - usage-type gf_common_mt_gf_dirent_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=3826<br>
max_num_allocs=19<br>
total_allocs=25757<br>
<br>
[features/index.gv-cinder-index - usage-type gf_common_mt_strdup memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=162<br>
max_num_allocs=3<br>
total_allocs=21020<br>
<br>
[features/index.gv-cinder-index - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=29<br>
max_num_allocs=1<br>
total_allocs=4981<br>
<br>
[features/index.gv-cinder-index - usage-type gf_index_mt_priv_t memusage]<br>
size=152<br>
num_allocs=1<br>
max_size=152<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/index.gv-cinder-index - usage-type gf_index_inode_ctx_t memusage]<br>
size=160<br>
num_allocs=5<br>
max_size=192<br>
max_num_allocs=6<br>
total_allocs=791<br>
<br>
[features/index.gv-cinder-index - usage-type gf_index_fd_ctx_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=32<br>
max_num_allocs=2<br>
total_allocs=4981<br>
<br>
[features/barrier.gv-cinder-barrier - Memory usage]<br>
num_types=118<br>
<br>
[features/barrier.gv-cinder-barrier - usage-type gf_common_mt_asprintf memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=96<br>
max_num_allocs=1<br>
total_allocs=4<br>
<br>
[features/barrier.gv-cinder-barrier - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=138<br>
max_num_allocs=1<br>
total_allocs=4<br>
<br>
[features/barrier.gv-cinder-barrier - usage-type gf_barrier_mt_priv_t memusage]<br>
size=56<br>
num_allocs=1<br>
max_size=56<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[xlator.features.barrier.priv]<br>
barrier.enabled=0<br>
barrier.timeout=120<br>
<br>
[performance/io-threads.gv-cinder-io-threads - Memory usage]<br>
num_types=118<br>
<br>
[performance/io-threads.gv-cinder-io-threads - usage-type gf_common_mt_iovec memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=208<br>
max_num_allocs=13<br>
total_allocs=303078<br>
<br>
[performance/io-threads.gv-cinder-io-threads - usage-type gf_common_mt_asprintf memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=176<br>
max_num_allocs=2<br>
total_allocs=410217<br>
<br>
[performance/io-threads.gv-cinder-io-threads - usage-type gf_common_mt_strdup memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=212<br>
max_num_allocs=8<br>
total_allocs=169882954<br>
<br>
[performance/io-threads.gv-cinder-io-threads - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=238<br>
max_num_allocs=2<br>
total_allocs=410217<br>
<br>
[performance/io-threads.gv-cinder-io-threads - usage-type gf_iot_mt_iot_conf_t memusage]<br>
size=376<br>
num_allocs=1<br>
max_size=376<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[performance/io-threads.gv-cinder-io-threads]<br>
maximum_threads_count=16<br>
current_threads_count=1<br>
sleep_count=1<br>
idle_time=120<br>
stack_size=1048576<br>
high_priority_threads=16<br>
normal_priority_threads=16<br>
low_priority_threads=16<br>
least_priority_threads=1<br>
cached least rate=24<br>
least rate limit=0<br>
<br>
[features/locks.gv-cinder-locks - Memory usage]<br>
num_types=126<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_common_mt_asprintf memusage]<br>
size=27<br>
num_allocs=1<br>
max_size=145<br>
max_num_allocs=7<br>
total_allocs=271430<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_common_mt_strdup memusage]<br>
size=286<br>
num_allocs=10<br>
max_size=4023<br>
max_num_allocs=66<br>
total_allocs=84845125<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=201<br>
max_num_allocs=6<br>
total_allocs=251416<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_common_mt_mem_pool memusage]<br>
size=120<br>
num_allocs=1<br>
max_size=120<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_common_mt_long memusage]<br>
size=4736<br>
num_allocs=1<br>
max_size=4736<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_locks_mt_pl_dom_list_t memusage]<br>
size=880<br>
num_allocs=10<br>
max_size=880<br>
max_num_allocs=10<br>
total_allocs=10<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_locks_mt_pl_inode_t memusage]<br>
size=2112<br>
num_allocs=12<br>
max_size=2288<br>
max_num_allocs=13<br>
total_allocs=886<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_locks_mt_posix_lock_t memusage]<br>
size=504<br>
num_allocs=7<br>
max_size=576<br>
max_num_allocs=8<br>
total_allocs=25<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_locks_mt_pl_entry_lock_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=3552<br>
max_num_allocs=3<br>
total_allocs=13410<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_locks_mt_pl_inode_lock_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=125440<br>
max_num_allocs=56<br>
total_allocs=84709087<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_locks_mt_posix_locks_private_t memusage]<br>
size=16<br>
num_allocs=1<br>
max_size=16<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/locks.gv-cinder-locks - usage-type gf_locks_mt_pl_fdctx_t memusage]<br>
size=48<br>
num_allocs=3<br>
max_size=96<br>
max_num_allocs=6<br>
total_allocs=19966<br>
<br>
[features/access-control.gv-cinder-access-control - Memory usage]<br>
num_types=121<br>
<br>
[features/access-control.gv-cinder-access-control - usage-type gf_common_mt_asprintf memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=20<br>
max_num_allocs=10<br>
total_allocs=238292<br>
<br>
[features/access-control.gv-cinder-access-control - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=245<br>
max_num_allocs=10<br>
total_allocs=237822<br>
<br>
[features/access-control.gv-cinder-access-control - usage-type gf_posix_acl_mt_ctx_t memusage]<br>
size=992<br>
num_allocs=31<br>
max_size=1024<br>
max_num_allocs=32<br>
total_allocs=921<br>
<br>
[features/access-control.gv-cinder-access-control - usage-type gf_posix_acl_mt_posix_ace_t memusage]<br>
size=32<br>
num_allocs=1<br>
max_size=32<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/access-control.gv-cinder-access-control - usage-type gf_posix_acl_mt_conf_t memusage]<br>
size=16<br>
num_allocs=1<br>
max_size=16<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/changelog.gv-cinder-changelog - Memory usage]<br>
num_types=127<br>
<br>
[features/changelog.gv-cinder-changelog - usage-type gf_common_mt_asprintf memusage]<br>
size=38<br>
num_allocs=1<br>
max_size=136<br>
max_num_allocs=2<br>
total_allocs=7<br>
<br>
[features/changelog.gv-cinder-changelog - usage-type gf_common_mt_strdup memusage]<br>
size=84<br>
num_allocs=2<br>
max_size=84<br>
max_num_allocs=2<br>
total_allocs=6<br>
<br>
[features/changelog.gv-cinder-changelog - usage-type gf_common_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=186<br>
max_num_allocs=1<br>
total_allocs=6<br>
<br>
[features/changelog.gv-cinder-changelog - usage-type gf_common_mt_mem_pool memusage]<br>
size=120<br>
num_allocs=1<br>
max_size=120<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/changelog.gv-cinder-changelog - usage-type gf_common_mt_long memusage]<br>
size=7424<br>
num_allocs=1<br>
max_size=7424<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/changelog.gv-cinder-changelog - usage-type gf_changelog_mt_priv_t memusage]<br>
size=760<br>
num_allocs=1<br>
max_size=760<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[features/changelog.gv-cinder-changelog - usage-type gf_changelog_mt_rt_t memusage]<br>
size=4<br>
num_allocs=1<br>
max_size=4<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[storage/posix.gv-cinder-posix - Memory usage]<br>
num_types=125<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_common_mt_gf_dirent_t memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=4055<br>
max_num_allocs=19<br>
total_allocs=494<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_common_mt_inode_ctx memusage]<br>
size=7488<br>
num_allocs=26<br>
max_size=7776<br>
max_num_allocs=27<br>
total_allocs=39<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_common_mt_iobref memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=144<br>
max_num_allocs=6<br>
total_allocs=48833565<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_common_mt_asprintf memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=95<br>
max_num_allocs=7<br>
total_allocs=201906<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_common_mt_strdup memusage]<br>
size=31<br>
num_allocs=1<br>
max_size=166<br>
max_num_allocs=2<br>
total_allocs=5110<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_common_mt_char memusage]<br>
size=256<br>
num_allocs=1<br>
max_size=691<br>
max_num_allocs=16<br>
total_allocs=522677<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_common_mt_iobrefs memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=768<br>
max_num_allocs=6<br>
total_allocs=48833565<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_posix_mt_posix_fd memusage]<br>
size=96<br>
num_allocs=2<br>
max_size=240<br>
max_num_allocs=5<br>
total_allocs=22484<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_posix_mt_char memusage]<br>
size=0<br>
num_allocs=0<br>
max_size=345<br>
max_num_allocs=15<br>
total_allocs=1011303<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_posix_mt_posix_private memusage]<br>
size=608<br>
num_allocs=1<br>
max_size=608<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[storage/posix.gv-cinder-posix - usage-type gf_posix_mt_trash_path memusage]<br>
size=51<br>
num_allocs=1<br>
max_size=51<br>
max_num_allocs=1<br>
total_allocs=1<br>
<br>
[storage/posix.gv-cinder-posix]<br>
base_path=/gluster/brick03/cinder-std-01<br>
base_path_length=30<br>
max_read=-220679111<br>
max_write=71495680<br>
nr_files=-2516<br>
<br>
DUMP-END-TIME: 2016-02-13 02:42:44.674718<br>
<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="http://www.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://www.gluster.org/mailman/listinfo/gluster-devel</a><br>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br><div>Raghavendra G<br></div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature">Raghavendra G<br></div>
</div>