mirror of
https://github.com/apache/zeppelin
synced 2026-05-24 09:38:26 +00:00
c7ce709f35
### What is this PR for? This PR is for the documentation of running zeppelin with CDH docker environment. and This PR is the part of https://issues.apache.org/jira/browse/ZEPPELIN-1198. Tested CDH5.7 on ubuntu. ### What type of PR is it? Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1281 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <hsshim@nflabs.com> Author: AhyoungRyu <ahyoungryu@apache.org> Author: HyungSung <hsshim@nflabs.com> Closes #1451 from astroshim/ZEPPELIN-1281 and squashes the following commits:5dcb8c1[astroshim] move configurations to right path and add excluding rat-plugin09408e3[HyungSung] Merge pull request #11 from AhyoungRyu/ZEPPELIN-1281-ahyoung850119c[AhyoungRyu] Generate TOC & change some sentencese687a53[AhyoungRyu] Replace zeppelin_with_cdh.png to crop the url partcc9a023[AhyoungRyu] Remove main title link anchorb525f68[astroshim] separate cdh doc with spark_cluster_mode.mde66993f[astroshim] fix doca7b5b2d[astroshim] cdh docker environment
100 lines
2.8 KiB
Markdown
100 lines
2.8 KiB
Markdown
---
|
|
layout: page
|
|
title: "Apache Zeppelin on CDH"
|
|
description: "This document will guide you how you can build and configure the environment on CDH with Apache Zeppelin using docker scripts."
|
|
group: install
|
|
---
|
|
<!--
|
|
Licensed under the Apache License, Version 2.0 (the "License");
|
|
you may not use this file except in compliance with the License.
|
|
You may obtain a copy of the License at
|
|
|
|
http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
Unless required by applicable law or agreed to in writing, software
|
|
distributed under the License is distributed on an "AS IS" BASIS,
|
|
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
See the License for the specific language governing permissions and
|
|
limitations under the License.
|
|
-->
|
|
{% include JB/setup %}
|
|
|
|
# Apache Zeppelin on CDH
|
|
|
|
<div id="toc"></div>
|
|
|
|
### 1. Import Cloudera QuickStart Docker image
|
|
|
|
>[Cloudera](http://www.cloudera.com/) has officially provided CDH Docker Hub in their own container. Please check [this guide page](http://www.cloudera.com/documentation/enterprise/latest/topics/quickstart_docker_container.html#cloudera_docker_container) for more information.
|
|
|
|
You can import the Docker image by pulling it from Cloudera Docker Hub.
|
|
|
|
```
|
|
docker pull cloudera/quickstart:latest
|
|
```
|
|
|
|
|
|
### 2. Run docker
|
|
|
|
```
|
|
docker run -it \
|
|
-p 80:80 \
|
|
-p 4040:4040 \
|
|
-p 8020:8020 \
|
|
-p 8022:8022 \
|
|
-p 8030:8030 \
|
|
-p 8032:8032 \
|
|
-p 8033:8033 \
|
|
-p 8040:8040 \
|
|
-p 8042:8042 \
|
|
-p 8088:8088 \
|
|
-p 8480:8480 \
|
|
-p 8485:8485 \
|
|
-p 8888:8888 \
|
|
-p 9083:9083 \
|
|
-p 10020:10020 \
|
|
-p 10033:10033 \
|
|
-p 18088:18088 \
|
|
-p 19888:19888 \
|
|
-p 25000:25000 \
|
|
-p 25010:25010 \
|
|
-p 25020:25020 \
|
|
-p 50010:50010 \
|
|
-p 50020:50020 \
|
|
-p 50070:50070 \
|
|
-p 50075:50075 \
|
|
-h quickstart.cloudera --privileged=true \
|
|
agitated_payne_backup /usr/bin/docker-quickstart;
|
|
```
|
|
|
|
### 3. Verify running CDH
|
|
|
|
To verify the application is running well, check the web UI for HDFS on `http://<hostname>:50070/` and YARN on `http://<hostname>:8088/cluster`.
|
|
|
|
|
|
### 4. Configure Spark interpreter in Zeppelin
|
|
Set following configurations to `conf/zeppelin-env.sh`.
|
|
|
|
```
|
|
export MASTER=yarn-client
|
|
export HADOOP_CONF_DIR=[your_hadoop_conf_path]
|
|
export SPARK_HOME=[your_spark_home_path]
|
|
```
|
|
|
|
`HADOOP_CONF_DIR`(Hadoop configuration path) is defined in `/scripts/docker/spark-cluster-managers/cdh/hdfs_conf`.
|
|
|
|
Don't forget to set Spark `master` as `yarn-client` in Zeppelin **Interpreters** setting page like below.
|
|
|
|
<img src="../assets/themes/zeppelin/img/docs-img/zeppelin_yarn_conf.png" />
|
|
|
|
### 5. Run Zeppelin with Spark interpreter
|
|
After running a single paragraph with Spark interpreter in Zeppelin,
|
|
|
|
<img src="../assets/themes/zeppelin/img/docs-img/zeppelin_with_cdh.png" />
|
|
|
|
<br/>
|
|
|
|
browse `http://<hostname>:8088/cluster/apps` to check Zeppelin application is running well or not.
|
|
|
|
<img src="../assets/themes/zeppelin/img/docs-img/cdh_yarn_applications.png" />
|
|
|