Skip to content

Commit

Permalink
Merge pull request #38 from theclaymethod/bump-cdh5-version
Browse files Browse the repository at this point in the history
Bumped CDH5 to 5.2.0 and Mesos to 0.21.0
  • Loading branch information
brndnmtthws committed Nov 26, 2014
2 parents afda125 + 7bf6369 commit 4022866
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 10 deletions.
16 changes: 8 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,24 +44,24 @@ guide, we'll use [CDH5][CDH5.1.3]. First grab the tar archive and
extract it.

```shell
wget http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.3.0-cdh5.1.3.tar.gz
wget http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.5.0-cdh5.2.0.tar.gz
...
tar zxf hadoop-2.3.0-cdh5.1.3.tar.gz
tar zxf hadoop-2.5.0-cdh5.2.0.tar.gz
```

> **Take note**, the extracted directory is `hadoop-2.3.0-cdh5.1.3`.
> **Take note**, the extracted directory is `hadoop-2.5.0-cdh5.2.0`.
Now copy `hadoop-mesos-0.0.8.jar` into the `share/hadoop/common/lib` folder.

```shell
cp /path/to/hadoop-mesos-0.0.8.jar hadoop-2.3.0-cdh5.1.3/share/hadoop/common/lib/
cp /path/to/hadoop-mesos-0.0.8.jar hadoop-2.5.0-cdh5.2.0/share/hadoop/common/lib/
```

Since CDH5 includes both MRv1 and MRv2 (YARN) and is configured for YARN by
default, we need update the symlinks to point to the correct directories.

```shell
cd hadoop-2.3.0-cdh5.1.3
cd hadoop-2.5.0-cdh5.2.0

mv bin bin-mapreduce2
mv examples examples-mapreduce2
Expand Down Expand Up @@ -90,8 +90,8 @@ that Mesos can access in order to launch each `TaskTracker`. For
example, if you're already running HDFS:

```
$ tar czf hadoop-2.3.0-cdh5.1.3.tar.gz hadoop-2.3.0-cdh5.1.3
$ hadoop fs -put hadoop-2.3.0-cdh5.1.3.tar.gz /hadoop-2.3.0-cdh5.1.3.tar.gz
$ tar czf hadoop-2.5.0-cdh5.2.0.tar.gz hadoop-2.5.0-cdh5.2.0
$ hadoop fs -put hadoop-2.5.0-cdh5.2.0.tar.gz /hadoop-2.5.0-cdh5.2.0.tar.gz
```

> **Consider** any permissions issues with your uploaded location
Expand Down Expand Up @@ -131,7 +131,7 @@ operation](http://hadoop.apache.org/docs/stable/single_node_setup.html#PseudoDis
</property>
<property>
<name>mapred.mesos.executor.uri</name>
<value>hdfs://localhost:9000/hadoop-2.3.0-cdh5.1.3.tar.gz</value>
<value>hdfs://localhost:9000/hadoop-2.5.0-cdh5.2.0.tar.gz</value>
</property>
```

Expand Down
4 changes: 2 additions & 2 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -15,8 +15,8 @@
<!-- runtime deps versions -->
<commons-logging.version>1.1.3</commons-logging.version>
<commons-httpclient.version>3.1</commons-httpclient.version>
<hadoop-client.version>2.3.0-mr1-cdh5.1.3</hadoop-client.version>
<mesos.version>0.20.0</mesos.version>
<hadoop-client.version>2.5.0-mr1-cdh5.2.0</hadoop-client.version>
<mesos.version>0.21.0</mesos.version>
<protobuf.version>2.5.0</protobuf.version>
<metrics.version>3.1.0</metrics.version>
<snappy-java.version>1.0.5</snappy-java.version>
Expand Down

0 comments on commit 4022866

Please sign in to comment.