Every once in a while , hadoop goes totally haywire when I play with it in psuedodistributed mode.Problems include :1) Data not being replicated to nodes (i.e. you do a namenode format, and the data nodes are now out of sync). 2) No connection ava…
When your editing files on the fly, you need a tool like VIM. I use VIM almost exclusively for clojure and python.However, to really be efficient, you can’t rely on the arrow keys -> you need to know the shortcuts.So heres my favorites :Inside…
Okay so… in the last post, i tried to build a non-trivial map/r from scratch, and ran it on my machine. I ran into some issues involving the “glue” that held my map/reduce jobs together. For example, configuring the classes declared…
Today I’m writing a new map/r job, from scratch, trying to minimally copy code from other jobs. The principles behind hadoop are simple : you separately map records into key->value[] arrays, and then you convert those keys to integers, and dis…
My Fedora 17 Beefy Miracle alpha1 ARM system does not any contents in /var/log/messages. This is very impractical for troubleshooting. The command systemd-journalctl –no-tail shows that rsyslog.service fails to start correctly. Bummer!Starting the dae…
This is a simple one. I just renewed my love for regular expressions… Sometimes I forget about them and I get lost in a world of if statements.A Quick refresher : Getting the “FOO” out of FOO_BAR The regex for this is “.*(?=_)”But what if…
Slow but steadily I am improving the packet dissector for Gluster. Once it is in a more complete state, it’ll be submitted for inclusion in Wireshark. Until that time (which will likely take some more months), updated versions of Wireshark for RHEL6 an…
Slow but steadily I am improving the packet dissector for Gluster. Once it is in a more complete state, it’ll be submitted for inclusion in Wireshark. Until that time (which will likely take some more months), updated versions of Wireshark for RHEL6 an…
As part of my job, I am doing some tests with the Red Hat Storage Software Appliance. The current version of RHSSA is based on Gluster 3.2.5. After some experiments, it seem that Gluster is pretty cool and surprisingly easy to setup.In order to see wha…
As part of my job, I am doing some tests with the Red Hat Storage Software Appliance. The current version of RHSSA is based on Gluster 3.2.5. After some experiments, it seem that Gluster is pretty cool and surprisingly easy to setup.In order to see wha…
Nixpanic has created a wireshark decoder for GlusterFS/Redhat Storage. This should help immensely in debugging and tuning!
Amazon has built a huge business listing everything imaginable. They have successfully built a brand where you know you can go to find anything. It’s a good move for what Bezos intended.
At Ed Wyse, I’m building the opposite.
Rather than bringing in sm…
This is a quick and dirty script I threw together to list files with dirty flags from a GlusterFS brick.
#!/bin/env python
#
# (C) 2011, Joe Julian
#
# License: GPLv2 http://www.gnu.org/licenses/gpl-2.0.html
#
import os,socket,xattr,sys,time
from sta…
I had a problem where /lib/dri/r600_dri.so was left behind on a x86_64 system during an upgrade from F14 to F15 using the Anaconda DVD upgrade. Not noticing this was a 32 bit app, when I couldn’t figure out why the error message was showing up from a l…
One of the questions that I come across in IRC and other places often is how to obtain a list of gluster volumes that can be mounted from a client machine. NFS provides showmount which helps in figuring out the list of exports from a server amongst other things. GlusterFS currently does not have an […]
Been wanting to get back to blogging for a while. Over the past year or so, I have frequently been inhibited by what can be expressed in 140 characters. Hence this new start. Let me explore how far this attempt goes!
My daughter was born on March 19th 2010, 7 lbz 5 oz (3.3 kg), 19 1/4 inches (49 cm) and healthy and happy.I’m back to work now and making progress on LocationFinder again. Be sure to check the project page for development details!
Thought I thought I was going to be able to continue working at my previous pace, however, as we approach March 19th I found my wife has several things that she needs to have done before the baby arrives. This has pushed back my schedule dramatically. …
I’ve discovered that clickExplorer, a javascript plugin that claims to protects your content, interferes with the submission clicks necessary to retrieve the location markers.It doesn’t really help anyway. Anybody who wants to steal your content can d…
That’s embarrassing. I told myself the last time that I need to install the release myself before posting, and with a dozen people in the house for a baby shower and wanting to meet my deadline, I popped into my office and zipped up the build tree and …