Commit graph

10 commits

Author SHA1 Message Date
1ambda
d25639caae [ZEPPELIN-2938] Can't build docker image for bin due to missing wget cmd (master, branch-0.7)
### What is this PR for?

Can't build docker image for bin due to missing wget cmd

![image](https://user-images.githubusercontent.com/4968473/30482870-b6c9344a-9a5f-11e7-913f-b67d67a49a66.png)

### What type of PR is it?
[Bug Fix]

### What is the Jira issue?

[ZEPPELIN-2938](https://issues.apache.org/jira/browse/ZEPPELIN-2938)

### How should this be tested?

- `cd scripts/docker/zeppelin/bin/`
- `docker build . -t test`
- should fail here

![image](https://user-images.githubusercontent.com/4968473/30483594-5ee7fc72-9a62-11e7-8472-1fdf3115fa0f.png)

### Screenshots (if appropriate)

#### Before

![image](https://user-images.githubusercontent.com/4968473/30482783-5d344d70-9a5f-11e7-8407-de039ccfd16a.png)

#### After

### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO

Author: 1ambda <1amb4a@gmail.com>

Closes #2590 from 1ambda/fix/install-wget-for-docker-container-dep and squashes the following commits:

66463343 [1ambda] fix: Install wget
2017-09-16 16:24:59 +02:00
Jinkyu Yi
cbdaf22a92 [ZEPPELIN-2861] Use OpenJDK in docker image.
### What is this PR for?
Using OpenJDK at distributing docker image will reduce legal threats.

### What type of PR is it?
Bug Fix

### Todos

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-2861

### How should this be tested?
`docker build scripts/docker/zeppelin/bin`

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? **NO**
* Is there breaking changes for older versions? **NO**
* Does this needs documentation? **NO**

Author: Jinkyu Yi <jincreator@jincreator.net>

Closes #2536 from jincreator/ZEPPELIN-2861 and squashes the following commits:

3b4fbcb [Jinkyu Yi] [ZEPPELIN-2861] Use OpenJDK in docker image.
2017-08-17 14:02:24 -07:00
sven0726
f10b71cc15 change the spark version of dockerfile
### What is this PR for?
A few sentences describing the overall goals of the pull request's commits.
First time? Check out the contributing guide - https://zeppelin.apache.org/contribution/contributions.html

### What type of PR is it?
[Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring]

### Todos
* [ ] - Task

### What is the Jira issue?
* Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/
* Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533]

### How should this be tested?
Outline the steps to test the PR here.

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?

Author: sven0726 <sven0726@gmail.com>

Closes #2370 from sven0726/master and squashes the following commits:

15af90e [sven0726] change hadoop profile version
3b68a5f [sven0726] change the spark version of dockerfile
2017-06-07 10:19:51 -07:00
1ambda
e902801773 [ZEPPELIN-2492] Use single Dockerfile for each tag
### What is this PR for?

Use single `Dockerfile` for each release since [apache infra uses tag pushes](https://issues.apache.org/jira/browse/INFRA-12781) to build an image.

- https://issues.apache.org/jira/browse/INFRA-12781

After release process finishes, dockerhub will build using the pushed tag.

### What type of PR is it?
[Improvement]

### What is the Jira issue?

[ZEPPELIN-2492](https://issues.apache.org/jira/browse/ZEPPELIN-2492)

### How should this be tested?

1. `./dev/change_zeppelin_version.sh 0.8.0-SNAPSHOT 0.7.1`
2. Check that version is properly set: `vi scrtips/docker/zeppelin/bin/Dockerfile`
3. Build docker image `cd scripts/docker/zeppelin/bin; docker build -t zeppelin:0.7.1 ./`
4. Run the image: `docker run -p 8080:8080  --rm --name zeppelin zeppelin:0.7.1`

### Screenshots (if appropriate)

NONE

### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO

Author: 1ambda <1amb4a@gmail.com>

Closes #2318 from 1ambda/ZEPPELIN-2492/use-single-dockerfile-for-each-tag and squashes the following commits:

483bec3 [1ambda] docs: Update README for Dockerfile
5826c8c [1ambda] fix: Use single dockerfile for tag push
2017-05-06 14:57:07 -04:00
1ambda
5c3291c71a [ZEPPELIN-1711] Create Dockerfiles for released bin
### What is this PR for?

Created `Dockerfile` for released bin

- based on **Ubuntu:16.04 (LTS)** for desktop usage
- **JDK 8**
- **R** with basic packages
- **Python 2** with basic packages
- **miniconda2** for `%python.conda`

### Details

We already discussed about using alpine image in https://github.com/apache/zeppelin/pull/1761.

- However, it's not designed for desktop usage
- Doesn't have some official packages (R, ...)
- Not familiar to users for desktop OS

That the reason why ubuntu is used in base image

```
zeppelin                  base                b3818f9ae4b1        11 hours ago        1.67 GB
zeppelin                  0.6.2               c0a4d8556f92        7 hours ago         2.29 GB
zeppelin                  0.7.0               c4a5ad0d04bd        8 hours ago         2.5 GB
zeppelin                  0.7.1               54173b77743b        7 hours ago         2.49 GB
```

### What type of PR is it?
[Feature]

### Todos
* [x] - base image
* [x] - script for creating bin images
* [x] - bin image template

### What is the Jira issue?

[ZEPPELIN-1711](https://issues.apache.org/jira/browse/ZEPPELIN-1711)

### How should this be tested?

1. build base image `cd scripts/docker/zeppelin/base; docker build -t zeppelin:base ./`
2. build bin image `cd scripts/docker/zeppelin/0.7.1; docker build -t zeppelin:0.7.1 ./`
3. execute docker images

```
docker run -p 8080:8080 --rm --name zeppelin zeppelin:0.7.1
```

since it takes time to build, you can use already [published docker images](https://hub.docker.com/r/1ambda/docker-zeppelin/)

```
docker run -p 8080:8080 --rm --name zeppelin 1ambda/docker-zeppelin:0.7.1
```

4. should be able to run spark, python and R tutorials

### Screenshots (if appropriate)

NO

### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - YES, updated

Author: 1ambda <1amb4a@gmail.com>

Closes #2264 from 1ambda/ZEPPELIN-1711/bin-dockerfile and squashes the following commits:

69a0b1f [1ambda] docs: Update docker.md
ced897f [1ambda] fix: DON'T remove /tmp
1f6da76 [1ambda] feat: Dockerfiles for 060, 070, 071
0fc3f75 [1ambda] feat: Add template for bin image
5cba56e [1ambda] feat: Use ubuntu for base image
2017-04-28 02:56:04 -07:00
mahmoudelgamal
a8ea9e1a26 [ZEPPELIN-1386] Docker images for running Apache Zeppelin releases
### What is this PR for?

This PR is for making docker images for zeppelin releases. It contains a script for building image for each release. Another script is used for publishing images to zeppelin Dockerhub account.

This repo, https://github.com/mfelgamal/zeppelin-dockers, is a demonstration of this PR. It contains zeppelin-base image and an image for each zeppelin release.
### What type of PR is it?

[Feature]
### Todos
- Review Comments
- Documentation
### What is the Jira issue?

https://issues.apache.org/jira/browse/ZEPPELIN-1386
### How should this be tested?
- run create_release script or publish_release script.
### Screenshots (if appropriate)
### Questions:
- Does the licenses files need update? no
- Is there breaking changes for older versions? no
- Does this needs documentation? yes

Author: mahmoudelgamal <mahmoudf.elgamal@gmail.com>
Author: mfelgamal <mahmoudf.elgamal@gmail.com>
Author: Mahmoud Elgamal <mahmoudf.elgamal@gmail.com>
Author: 1ambda <1amb4a@gmail.com>

Closes #1538 from mfelgamal/zeppelin-dockers and squashes the following commits:

cc8493f [Mahmoud Elgamal] Merge pull request #3 from 1ambda/fix/remove-startzeppelinsh
d48ecef [1ambda] fix: Remove start-zeppelin.sh
b64c680 [mahmoudelgamal] Remove gcc and g++ for decreasing the size
1f093d4 [mahmoudelgamal] Add script start-zeppelin to zeppelin-base
d2c744e [mahmoudelgamal] add scala to zeppelin-base
fd23970 [mahmoudelgamal] remove bash erorr message.
e1d4b77 [mahmoudelgamal] add R and python to zeppelin-base
e731cb4 [mahmoudelgamal] Add java-cacerts to zeppelin-base
e642309 [mahmoudelgamal] Add documentation and some modifications
231a414 [mahmoudelgamal] Add zeppelin-base image
ac06f3a [mahmoudelgamal] Make docker image for zeppelin release
48d0a01 [mfelgamal] Merge pull request #1 from apache/master
2016-12-14 12:59:51 +09:00
astroshim
c7ce709f35 [ZEPPELIN-1279] Zeppelin with CDH5.x docker document.
### What is this PR for?
This PR is for the documentation of running zeppelin with CDH docker environment.
and This PR is the part of https://issues.apache.org/jira/browse/ZEPPELIN-1198.

Tested CDH5.7 on ubuntu.

### What type of PR is it?
Documentation

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1281

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <ahyoungryu@apache.org>
Author: HyungSung <hsshim@nflabs.com>

Closes #1451 from astroshim/ZEPPELIN-1281 and squashes the following commits:

5dcb8c1 [astroshim] move configurations to right path and add excluding rat-plugin
09408e3 [HyungSung] Merge pull request #11 from AhyoungRyu/ZEPPELIN-1281-ahyoung
850119c [AhyoungRyu] Generate TOC & change some sentences
e687a53 [AhyoungRyu] Replace zeppelin_with_cdh.png to crop the url part
cc9a023 [AhyoungRyu] Remove main title link anchor
b525f68 [astroshim] separate cdh doc with spark_cluster_mode.md
e66993f [astroshim] fix doc
a7b5b2d [astroshim] cdh docker environment
2016-09-29 21:01:31 +09:00
astroshim
cee58aa038 [ZEPPELIN-1279] Spark on Mesos Docker.
### What is this PR for?
This PR is for the documentation of running zeppelin on production environments especially spark on mesos via Docker.
Related issue is https://github.com/apache/zeppelin/pull/1227 and https://github.com/apache/zeppelin/pull/1318 and I got a lot of hints from https://github.com/sequenceiq/hadoop-docker.
Tested on ubuntu.

### What type of PR is it?
Documentation

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1279

### How should this be tested?
You can refer to https://github.com/apache/zeppelin/blob/master/docs/README.md#build-documentation.

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Author: HyungSung <hsshim@nflabs.com>

Closes #1389 from astroshim/ZEPPELIN-1279 and squashes the following commits:

974366a [HyungSung] Merge pull request #10 from AhyoungRyu/ZEPPELIN-1279-ahyoung
076fdba [AhyoungRyu] Change zeppelin_mesos_conf.png file
1cbe9d3 [astroshim] fix spark version and mesos
2b821b4 [astroshim] fix docs
159bafc [astroshim] fix anchor
d8c43b4 [astroshim] add navigation
c808350 [astroshim] add image file and doc
a3b0ded [astroshim] create dockerfile for mesos
2016-09-03 11:41:40 +09:00
astroshim
eccfe0076b [ZEPPELIN-1280][Spark on Yarn] Documents for running zeppelin on production environments using docker.
### What is this PR for?
This PR is for the documentation of running zeppelin on production environments especially spark on yarn.
Related issue is https://github.com/apache/zeppelin/pull/1227 and I got a lot of hints from https://github.com/sequenceiq/hadoop-docker.
Tested on ubuntu.

### What type of PR is it?
Documentation

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1280

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Author: HyungSung <hsshim@nflabs.com>

Closes #1318 from astroshim/ZEPPELIN-1280 and squashes the following commits:

60958cd [astroshim] small changes for doc
6c44b7b [astroshim] Merge branch 'master' into ZEPPELIN-1280
dad297c [astroshim] update version
4c8d72d [astroshim] merge with Ayoung's
8c62cf1 [astroshim] fixed felixcheung pointed out.
86ca513 [HyungSung] Merge pull request #9 from AhyoungRyu/ZEPPELIN-1280-ahyoung
cde5f8d [AhyoungRyu] Modify document description so that this docs can be searched
9e9390c [AhyoungRyu] Minor update for spark_cluster_mode.md
633c930 [astroshim] running zeppelin on yarn
2016-08-29 16:05:14 +09:00
astroshim
b965503291 [ZEPPELIN-1198][Spark Standalone] Documents for running zeppelin on production environments.
### What is this PR for?
This PR is for documentation for running zeppelin on production environments.

### What type of PR is it?
Documentation

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1198

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

Author: astroshim <hsshim@nflabs.com>

Closes #1227 from astroshim/ZEPPELIN-1198/standalone and squashes the following commits:

53a32f2 [astroshim] add 'via Docker'
61a0e5e [astroshim] add apache license header
83fdef6 [astroshim] doc for spark standalone
2016-08-03 18:47:21 +09:00