<html>
<head>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">
<pre wrap="">You should submit jobs as a user other than yarn which is also a member of the hadoop group. We usually add a mapred user.
Also check your <Hadoop Home>/etc/hadoop/container-executor.cfg:
yarn.nodemanager.linux-container-executor.group=hadoop
banned.users=yarn
min.user.id=1000
allowed.system.users=mapred
You'll want the mapred UID > 1000 or else adjust the setting in the file.</pre>
Regards,<br>
Shubhendu<br>
<br>
On 06/08/2015 07:44 AM, 中川智之 wrote:<br>
</div>
<blockquote
cite="mid:9C36F1DD-7403-46D1-AE29-9B685CA8AE3A@gmail.com"
type="cite">
<pre wrap="">Hi EveryOne.
I want to use Hadoop 2.x with GlusterFS. To testing, Prepare these
softwares.
<Cnfiguration>
- CentOS 7.1(on VMWare)
- Gluster FS 3.7
- Hadoop 2.x
- Glusterfs-Hadoop plugin 2.3.13
Test Process is this.
<Test Process>
1. Install CentOS 7.1. (3 VM Machine)
- 1 Machine is GlusterFS Client, and hadoop Namenode
- 2 Machine is GlusterFS BrickNode, and hadoop Datanode
2. Install GlusterFS 3.7, and cnfigure brick.
3. Mount Gluster volume from client Machine.
4. Install Hadoop 2.x, and HDFS configure.
* Hadoop installed by root.
5. Starting and testing HDFS and Mapreduce.
6. Configure Hadoop 2.0 with GlusterFS
Finish and Succcess Test 5, and I started Test 6 with this Note.
<Note>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/community/documentation/index.php/Hadoop">http://www.gluster.org/community/documentation/index.php/Hadoop</a>
<a class="moz-txt-link-freetext" href="https://forge.gluster.org/hadoop/pages/Configuration">https://forge.gluster.org/hadoop/pages/Configuration</a>
But I'm not entirely the way.
- How to use glusterfs-hadoop-2.3.13.jar ?
- Only put glusterfs-hadoop-2.3.13.jar and edit core-site.xml, Hadoop can
use on GlusterFS?
- If Finished Configuration, Hadoop can access on GlusterFS Volume by hadoop
command ?
ex)
$ bin/hadoop dfs -cat <GlusterVolume>/data
$ bin/hadoop jar
share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jar grep
<GlusteVolume>/data <GlusteVolume>/dataout '[a-z.]+'
Please tll me the way of Configuring.
I'm a hadoop Beginner, and I'm not so good at English.
</pre>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://www.gluster.org/mailman/listinfo/gluster-users">http://www.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</body>
</html>