[Gluster-users] booster with apache permission denied

Raghavendra G raghavendra at gluster.com
Tue Jan 12 05:42:06 UTC 2010


Hi,

Can you send the glusterfs server logs? The logs you've sent are of booster
(which is glusterfs client). Looking at the configuration, there is a
protocol/client in configuration and hence you need a glusterfs server
running.

We'll work on issue of md5sums being different.

regards,
On Tue, Jan 12, 2010 at 2:20 AM, Liam Slusser <lslusser at gmail.com> wrote:

> Logs are below.  I also noticed this while trying to debug this
> issue...Notice the md5sum do not match up below?
>
> On the fuse mounted system:
>
> [root at server test]# ls -al test.mp3
> -rw-r--r-- 1 user group 3692251 Aug 27  2007 test.mp3
>
> [root at server test]# md5sum test.mp3
> d480d794882c814ae1a2426b79cf8b3e  test.mp3
>
> Using glusterfs-boost.so:
>
> [root at server tmp]#
>
> LD_PRELOAD="/home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/glusterfs-booster.so"
> ls -al /pub/data/tnsc/test/test.mp3
> ls: /pub/data/tnsc/test/test.mp3: Invalid argument
> -rw-r--r-- 1 tcode tcode 3692251 Aug 27  2007 /pub/data/tnsc/test/test.mp3
>
> [root at server tmp]#
>
> LD_PRELOAD="/home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/glusterfs-booster.so"
> cp /pub/data/tnsc/test/test.mp3 /tmp/test.mp3
>
> [root at server tmp]# md5sum /tmp/test.mp3
> 9bff3bb90b6897fc19b6b4658b83f3f8  /tmp/test.mp3
>
> [root at server tmp]# ls -al /tmp/test.mp3
> -rw-r--r-- 1 root root 3690496 Jan 11 14:10 /tmp/test.mp3
>
> Here are the gluster logs from a clean apache start and one request to
> test.mp3 with wget:
>
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads:
> io-threads: Autoscaling: off, min_threads: 32, max_threads: 32
> [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using
> conf->page_count = 16
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume
> 'brick1a' came back up; going online.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume
> 'brick1a' came back up; going online.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient:
> New Entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient:
> New VMP entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient:
> Empty list
> [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is
> inited
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/conf/httpd.conf, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/conf/httpd.conf, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /home/httpd/apps/httpd-2.2.14,
> type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/bin/suexec
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/bin/suexec, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14/bin/suexec
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/htdocs
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/htdocs, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14/htdocs
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/logs/www/llfeed-error_log.new
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/logs/www/llfeed-error_log.new, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/logs/www/llfeed-error_log.new
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/logs/www/llfeed-error_log.new
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/logs/www/llfeed-access_log.new
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/logs/www/llfeed-access_log.new, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/logs/www/llfeed-access_log.new
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/logs/www/llfeed-access_log.new
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/mime.types
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/conf/mime.types, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/conf/mime.types
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/apps/httpd-2.2.14/conf/mime.types
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/conf/httpd.conf, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/conf/httpd.conf, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/apps/httpd-2.2.14/conf/httpd.conf
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /home/httpd/apps/httpd-2.2.14,
> type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done
> [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil)
> [2010-01-11 14:16:02] D [booster_fstab.c:46:glusterfs_fstab_init]
> booster-fstab: FSTAB file: /etc/booster.fstab
> [2010-01-11 14:16:02] D [booster_fstab.c:385:booster_mount]
> booster-fstab: Mount entry: volfile:
>
> /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pubstore.booster,
> VMP: /pub/, Type: glusterfs, Options:
>
> subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pubstore.log,loglevel=DEBUG,attr_timeout=0
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:869:libgf_resolve_path_light]
> libglusterfsclient: Path: /pub/, Resolved Path: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1544:_libgf_vmp_search_entry]
> libglusterfsclient: Virtual Mount Point list is empty.
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1603:libgf_vmp_search_exact_entry]
> libglusterfsclient: VMP Entry not found: path: /pub/
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads:
> io-threads: Autoscaling: off, min_threads: 32, max_threads: 32
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done
> [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil)
> [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using
> conf->page_count = 16
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume
> 'brick1a' came back up; going online.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume
> 'brick1a' came back up; going online.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient:
> New Entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient:
> New VMP entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient:
> Empty list
> [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is
> inited
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/bin/suexec
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/bin/suexec, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14/bin/suexec
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/htdocs
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/htdocs, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14/htdocs
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/logs/www/llfeed-error_log.new
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/logs/www/llfeed-error_log.new, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/logs/www/llfeed-error_log.new
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/logs/www/llfeed-error_log.new
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/logs/www/llfeed-access_log.new
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/logs/www/llfeed-access_log.new, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /home/httpd/logs/www/llfeed-access_log.new
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/logs/www/llfeed-access_log.new
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/mime.types
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/conf/mime.types, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/conf/mime.types
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/apps/httpd-2.2.14/conf/mime.types
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done
> [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil)
> [2010-01-11 14:16:02] D [booster_fstab.c:46:glusterfs_fstab_init]
> booster-fstab: FSTAB file: /etc/booster.fstab
> [2010-01-11 14:16:02] D [booster_fstab.c:385:booster_mount]
> booster-fstab: Mount entry: volfile:
>
> /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pubstore.booster,
> VMP: /pub/, Type: glusterfs, Options:
>
> subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pubstore.log,loglevel=DEBUG,attr_timeout=0
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:869:libgf_resolve_path_light]
> libglusterfsclient: Path: /pub/, Resolved Path: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1544:_libgf_vmp_search_entry]
> libglusterfsclient: Virtual Mount Point list is empty.
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1603:libgf_vmp_search_exact_entry]
> libglusterfsclient: VMP Entry not found: path: /pub/
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads:
> io-threads: Autoscaling: off, min_threads: 32, max_threads: 32
> [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/logs/httpd.pid
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/logs/httpd.pid, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/logs/httpd.pid
> [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/logs/httpd.pid
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/logs/httpd.pid, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/logs/httpd.pid
> [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed
> [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using
> MPB: /home/httpd/apps/httpd-2.2.14/logs/httpd.pid
> [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using
> conf->page_count = 16
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done
> [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil)
> [2010-01-11 14:16:02] D [booster_fstab.c:46:glusterfs_fstab_init]
> booster-fstab: FSTAB file: /etc/booster.fstab
> [2010-01-11 14:16:02] D [booster_fstab.c:385:booster_mount]
> booster-fstab: Mount entry: volfile:
>
> /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pubstore.booster,
> VMP: /pub/, Type: glusterfs, Options:
>
> subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pubstore.log,loglevel=DEBUG,attr_timeout=0
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:869:libgf_resolve_path_light]
> libglusterfsclient: Path: /pub/, Resolved Path: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1544:_libgf_vmp_search_entry]
> libglusterfsclient: Virtual Mount Point list is empty.
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1603:libgf_vmp_search_exact_entry]
> libglusterfsclient: VMP Entry not found: path: /pub/
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads:
> io-threads: Autoscaling: off, min_threads: 32, max_threads: 32
> [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using
> conf->page_count = 16
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done
> [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done
> [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil)
> [2010-01-11 14:16:02] D [booster_fstab.c:46:glusterfs_fstab_init]
> booster-fstab: FSTAB file: /etc/booster.fstab
> [2010-01-11 14:16:02] D [booster_fstab.c:385:booster_mount]
> booster-fstab: Mount entry: volfile:
>
> /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pubstore.booster,
> VMP: /pub/, Type: glusterfs, Options:
>
> subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pubstore.log,loglevel=DEBUG,attr_timeout=0
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:869:libgf_resolve_path_light]
> libglusterfsclient: Path: /pub/, Resolved Path: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/, type: Exact
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1544:_libgf_vmp_search_entry]
> libglusterfsclient: Virtual Mount Point list is empty.
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1603:libgf_vmp_search_exact_entry]
> libglusterfsclient: VMP Entry not found: path: /pub/
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator:
> dlsym(notify) on
>
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so:
> undefined symbol: notify -- neglecting
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a:
> defaulting frame-timeout to 30mins
> [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a:
> defaulting ping-timeout to 10
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport:
> attempt to load file
> /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so
> [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads:
> io-threads: Autoscaling: off, min_threads: 32, max_threads: 32
> [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using
> conf->page_count = 16
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume
> 'brick2a' came back up; going online.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume
> 'brick2a' came back up; going online.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume
> 'brick2a' came back up; going online.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got
> GF_EVENT_CHILD_UP
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume
> 'brick1a' came back up; going online.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick1a: Connected to 192.168.12.30:6996, attached to remote volume
> 'brick1a'.
> [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk]
> brick2a: Connected to 192.168.12.35:6996, attached to remote volume
> 'brick2a'.
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient:
> New Entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient:
> New VMP entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient:
> Empty list
> [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is
> inited
> [2010-01-11 14:16:02] D [libglusterfsclient.c:5318:glusterfs_chmod]
> libglusterfsclient: path
> /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127
> [2010-01-11 14:16:02] D [libglusterfsclient.c:5443:glusterfs_chown]
> libglusterfsclient: path
> /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path
> /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127, type: LongestPrefix
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path:
> /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient:
> New Entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient:
> New VMP entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient:
> Empty list
> [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is
> inited
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient:
> New Entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient:
> New VMP entry: /pub
> [2010-01-11 14:16:02] D
> [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient:
> Empty list
> [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is
> inited
> [2010-01-11 14:16:12] D [libglusterfsclient.c:4866:glusterfs_stat]
> libglusterfsclient: path /pub/data/tnsc/test/test.mp3
> [2010-01-11 14:16:12] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/data/tnsc/test/test.mp3,
> type: LongestPrefix
> [2010-01-11 14:16:12] D
> [libglusterfsclient.c:1628:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry found: path :/pub/data/tnsc/test/test.mp3 vmp: /pub/
> [2010-01-11 14:16:12] D [libglusterfsclient.c:4788:__glusterfs_stat]
> libglusterfsclient: path /data/tnsc/test/test.mp3, op: 2
> [2010-01-11 14:16:12] D
> [libglusterfsclient.c:869:libgf_resolve_path_light]
> libglusterfsclient: Path: /data/tnsc/test/test.mp3, Resolved Path:
> /data/tnsc/test/test.mp3
> [2010-01-11 14:16:12] D
> [libglusterfsclient-dentry.c:268:__do_path_resolve]
> libglusterfsclient-dentry: resolved path(/data/tnsc/test/test.mp3)
> till 1(/). sending lookup for remaining path
> [2010-01-11 14:16:12] D [libglusterfsclient.c:4725:libgf_client_stat]
> libglusterfsclient: path /data/tnsc/test/test.mp3, status 0, errno 0
> [2010-01-11 14:16:12] D [libglusterfsclient.c:3001:glusterfs_open]
> libglusterfsclient: path /pub/data/tnsc/test/test.mp3
> [2010-01-11 14:16:12] D
> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /pub/data/tnsc/test/test.mp3,
> type: LongestPrefix
> [2010-01-11 14:16:12] D
> [libglusterfsclient.c:1628:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry found: path :/pub/data/tnsc/test/test.mp3 vmp: /pub/
> [2010-01-11 14:16:12] D
> [libglusterfsclient.c:869:libgf_resolve_path_light]
> libglusterfsclient: Path: /data/tnsc/test/test.mp3, Resolved Path:
> /data/tnsc/test/test.mp3
> [2010-01-11 14:16:12] D
> [libglusterfsclient-dentry.c:389:libgf_client_path_lookup]
> libglusterfsclient: resolved path(/data/tnsc/test/test.mp3) to
> 1118653312/1118655564
> [2010-01-11 14:16:12] D [libglusterfsclient.c:2752:libgf_client_open]
> libglusterfsclient: open: path /data/tnsc/test/test.mp3, status: 0,
> errno 117
>
>
> On Mon, Jan 11, 2010 at 1:23 PM, Raghavendra G <raghavendra.hg at gmail.com>
> wrote:
> > Hi Liam,
> >
> > Can you send glusterfs server logs?
> >
> > regards,
> > On Sat, Jan 9, 2010 at 1:46 AM, Liam Slusser <lslusser at gmail.com> wrote:
> >>
> >> I believe i posted this here before but never got any replies.  I'm in
> >> the middle of upgrading to Gluster 2.0.9 and would like to move away
> >> from having to use fuse to serve up files out of apache so im working
> >> again on getting boosting working correctly.
> >>
> >> Everything appears to load and work fine but i always get permission
> >> denied, 403, in my apache logs.  Works fine under fuse.  I'm running
> >> Apache under the user nobody which does have read access to all the
> >> files.
> >>
> >> I'm not sure where to start debugging this?  Ideas?
> >>
> >> thanks,
> >> liam
> >>
> >> I can run things from the command line...
> >>
> >> [root at server]#
> >>
> LD_PRELOAD="/home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/glusterfs-booster.so"
> >> file /pub/data/tnsc/test/test.mp3
> >> /pub/data/tnsc/test/test.mp3: MPEG ADTS, layer III, v1, 128 kBits,
> >> 44.1 kHz, JntStereo
> >>
> >> [root at server]#
> >>
> LD_PRELOAD="/home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/glusterfs-booster.so"
> >> ls -agl /pub/data/tnsc/test/test.mp3
> >> ls: /pub/data/tnsc/test/test.mp3: Invalid argument
> >> -rw-r--r-- 1 user 3692251 Aug 27  2007 /pub/data/tnsc/test/test.mp3
> >>
> >> [root at server]# wget -S http://x.x.x.x/tnsc/test/test.mp3
> >> --2010-01-08 13:34:55--  http://x.x.x.x/tnsc/test/test.mp3
> >> Connecting to x.x.x.x:80... connected.
> >> HTTP request sent, awaiting response...
> >>  HTTP/1.1 403 Forbidden
> >>  Date: Fri, 08 Jan 2010 21:34:55 GMT
> >>  Server: Apache/2.2.14 (Unix)
> >>  Content-Length: 228
> >>  Keep-Alive: timeout=5, max=100
> >>  Connection: Keep-Alive
> >>  Content-Type: text/html; charset=iso-8859-1
> >> 2010-01-08 13:34:55 ERROR 403: Forbidden.
> >>
> >> Apache access log:
> >>
> >> x.x.x.x - - [08/Jan/2010:12:50:46 -0800] "GET /tnsc/test/test.mp3
> >> HTTP/1.0" 403 228 "-" "Wget/1.11.4 Red Hat modified"
> >>
> >> Apache error log:
> >>
> >> [Fri Jan 08 12:50:46 2010] [error] [client x..x.x.x] (22)Invalid
> >> argument: file permissions deny server access:
> >> /pub/data/tnsc/test/test.mp3
> >>
> >> Gluster error log:
> >>
> >> [2010-01-08 12:50:46] D [libglusterfsclient.c:4866:glusterfs_stat]
> >> libglusterfsclient: path /pub/data/tnsc/test/test.mp3
> >> [2010-01-08 12:50:46] D
> >> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> >> libglusterfsclient: VMP Search: path /pub/data/tnsc/test/test.mp3,
> >> type: LongestPrefix
> >> [2010-01-08 12:50:46] D
> >> [libglusterfsclient.c:1628:libgf_vmp_search_entry] libglusterfsclient:
> >> VMP Entry found: path :/pub/data/tnsc/test/test.mp3 vmp: /pub/
> >> [2010-01-08 12:50:46] D [libglusterfsclient.c:4788:__glusterfs_stat]
> >> libglusterfsclient: path /data/tnsc/test/test.mp3, op: 2
> >> [2010-01-08 12:50:46] D
> >> [libglusterfsclient.c:869:libgf_resolve_path_light]
> >> libglusterfsclient: Path: /data/tnsc/test/test.mp3, Resolved Path:
> >> /data/tnsc/test/test.mp3
> >> [2010-01-08 12:50:46] D
> >> [libglusterfsclient-dentry.c:389:libgf_client_path_lookup]
> >> libglusterfsclient: resolved path(/data/tnsc/test/test.mp3) to
> >> 1118653312/1118655564
> >> [2010-01-08 12:50:46] D [libglusterfsclient.c:4710:libgf_client_stat]
> >> libglusterfsclient: Cache will be used
> >> [2010-01-08 12:50:46] D [libglusterfsclient.c:3001:glusterfs_open]
> >> libglusterfsclient: path /pub/data/tnsc/test/test.mp3
> >> [2010-01-08 12:50:46] D
> >> [libglusterfsclient.c:1541:_libgf_vmp_search_entry]
> >> libglusterfsclient: VMP Search: path /pub/data/tnsc/test/test.mp3,
> >> type: LongestPrefix
> >> [2010-01-08 12:50:46] D
> >> [libglusterfsclient.c:1628:libgf_vmp_search_entry] libglusterfsclient:
> >> VMP Entry found: path :/pub/data/tnsc/test/test.mp3 vmp: /pub/
> >> [2010-01-08 12:50:46] D
> >> [libglusterfsclient.c:869:libgf_resolve_path_light]
> >> libglusterfsclient: Path: /data/tnsc/test/test.mp3, Resolved Path:
> >> /data/tnsc/test/test.mp3
> >> [2010-01-08 12:50:46] D
> >> [libglusterfsclient-dentry.c:389:libgf_client_path_lookup]
> >> libglusterfsclient: resolved path(/data/tnsc/test/test.mp3) to
> >> 1118653312/1118655564
> >> [2010-01-08 12:50:46] D [libglusterfsclient.c:2752:libgf_client_open]
> >> libglusterfsclient: open: path /data/tnsc/test/test.mp3, status: 0,
> >> errno 117
> >>
> >> Booster.fstab:
> >>
> >>
> /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pub.booster
> >> /pub/ glusterfs
> >>
> >>
> subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pub.log,loglevel=DEBUG,attr_timeout=0
> >>
> >> glusterfs.vol-pub.booster:
> >>
> >> volume brick1a
> >>  type protocol/client
> >>  option transport-type tcp
> >>  option remote-host x.x.x.30
> >>  option remote-subvolume brick1a
> >> end-volume
> >>
> >> volume brick2a
> >>  type protocol/client
> >>  option transport-type tcp
> >>  option remote-host x.x.x.35
> >>  option remote-subvolume brick2a
> >> end-volume
> >>
> >> volume replicate
> >>  type cluster/replicate
> >>  subvolumes brick1a brick2a
> >> end-volume
> >>
> >> volume iothreads
> >>  type performance/io-threads
> >>  option thread-count 32
> >>  subvolumes replicate
> >> end-volume
> >>
> >> volume readahead
> >>  type performance/read-ahead
> >>  option page-count 16       # cache per file  = (page-count x page-size)
> >>  option force-atime-update off
> >>  subvolumes iothreads
> >> end-volume
> >>
> >> volume cache
> >>  type performance/io-cache
> >>  option cache-size 512MB
> >>  subvolumes readahead
> >> end-volume
> >>
> >> httpd.conf:
> >>
> >> Alias /tnsc/ "/pub/data/tnsc/"
> >> <Directory "/pub/data/tnsc/">
> >>    Options FollowSymLinks
> >>    AllowOverride None
> >>    Order allow,deny
> >>    Allow from all
> >> </Directory>
> >> _______________________________________________
> >> Gluster-users mailing list
> >> Gluster-users at gluster.org
> >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
> >
> >
> >
> > --
> > Raghavendra G
> >
> >
>



-- 
Raghavendra G


More information about the Gluster-users mailing list