### What is this PR for?
Currently a paragraph can display only a single type of result.
For example
```
print("""
%text textout
%html htmlout
""")
```
will display only last display system detected, "htmlout".
This pr implements multiple results supports, so not only the last, but also all the display systems in a paragraph outputs can be displayed.
To do that, Note.json format need to be changed. from
```
paragraph : [
{
result : {
code: "",
type: "",
msg: ""
},
config : {
graph : {},
...
},
...
},
...
],
...
```
to
```
paragraph : [
{
results : {
{
code: "",
msg: [
{
type: "",
data: ""
},
{
type: "",
data: ""
},
...
]
},
config : {
results : [
{
graph : {},
},
{
graph : {},
},
...
]
},
...
},
...
],
...
```
### What type of PR is it?
Improvement
### Todos
* [x] - Make InterpreterResult and InterpreterOutput support multiple display system
* [x] - Automatic migration old format to new format
* [x] - Render multiple results in front-end
* [x] - Take care Importing old notebook format
* [x] - Make helium framework support multiple results
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-212
### How should this be tested?
run following code in a single spark paragraph.
```
%spark
// default output is text
(1 to 3).foreach{i=>
println(new java.util.Date())
Thread.sleep(1000)
}
// print something in html
println(s"""%html <h3><font style="color:blue">Some HTML</font></h3>""")
// create table
println(s"""%table key\tvalue
sun\t100
moon\t200
""")
// display text again
println("""%text""")
(1 to 3).foreach{i=>
println(new java.util.Date())
Thread.sleep(1000)
}
// another table
Thread.sleep(1000)
println(s"""%table key\tvalue
apple\t100
banana\t200
""")
```
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? yes
* Does this needs documentation? yes
Author: Lee moon soo <moon@apache.org>
Closes#1658 from Leemoonsoo/ZEPPELIN-212 and squashes the following commits:
0c6a13c [Lee moon soo] Merge remote-tracking branch 'origin/master' into ZEPPELIN-212
519cf23 [Lee moon soo] Update PythonInterpreterPandasSqlTest
e6268ac [Lee moon soo] Update PythonInterpreterMatplotlibTest.java
f5034b8 [Lee moon soo] Merge remote-tracking branch 'origin/master' into ZEPPELIN-212
d5981d5 [Lee moon soo] Merge remote-tracking branch 'origin/master' into ZEPPELIN-212
a1fe729 [Lee moon soo] document note format change
282504e [Lee moon soo] Merge remote-tracking branch 'origin/master' into ZEPPELIN-212
7ab6679 [Lee moon soo] update selenium test
6a897a5 [Lee moon soo] Update rest-api doc
cbbd58a [Lee moon soo] update unittest
e89c9b8 [Lee moon soo] restore tutoral note
3ba37b7 [Lee moon soo] Let old version import note without error
d09e03f [Lee moon soo] enable helium only in the last result
6682908 [Lee moon soo] Remove unnecessary listener method
0f1d28f [Lee moon soo] Merge branch 'master' into ZEPPELIN-212
73b3a81 [Lee moon soo] update selenium test
e69f1a1 [Lee moon soo] update test
f12230f [Lee moon soo] Remove unnecessary newline in test
26e201a [Lee moon soo] Update testcase
b01d70f [Lee moon soo] Make helium app work
0a5b4d1 [Lee moon soo] Update HeliumApplicationFactoryTest
d8ca07f [Lee moon soo] update NotebookTest
aaf9778 [Lee moon soo] fix r test
3e43df4 [Lee moon soo] make zeppelin-web test pass
1d6fd3e [Lee moon soo] fix compile errors
0156ffc [Lee moon soo] take care angular object
804768d [Lee moon soo] Take care output streaming
57d6b2f [Lee moon soo] Render multiple results
95b6037 [Lee moon soo] Multiple results
### What is this PR for?
Inspired by ZEPPELIN-1671 conda interpreter.
Docker can provides kind of virtual environment for python like conda does.
This PR implements %python.docker interpreter that helps run python process in docker container.
This PR implements feature on top of https://github.com/apache/zeppelin/pull/1645
### What type of PR is it?
Feature
### Todos
* [x] - basic feature
* [x] - unittest
* [x] - documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1683
### How should this be tested?
see screenshot
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Lee moon soo <moon@apache.org>
Closes#1654 from Leemoonsoo/pydocker and squashes the following commits:
22507e6 [Lee moon soo] Add new line at the end of the file
41c09d9 [Lee moon soo] Run python process in docker container
### What is this PR for?
Conda interpreter that manages conda environment for PythonInterpreter
### What type of PR is it?
Feature
### Todos
* [x] - Basic impl
* [x] - update doc
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1671
### How should this be tested?
Recreate(or create new) your python interpreter setting in gui.
List all conda env
```
%python.conda
```
Activate env
```
%python.conda activate [name]
```
Deactivate env
```
%python.conda deactivate
```
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Lee moon soo <moon@apache.org>
Closes#1645 from Leemoonsoo/conda and squashes the following commits:
4842b0a [Lee moon soo] Add usage in doc
d979c6a [Lee moon soo] Add unittest
b889443 [Lee moon soo] add usage template
9ae553b [Lee moon soo] Format output and add usage command
171cbeb [Lee moon soo] make sure single char interpreter name can be parsed
6b9525f [Lee moon soo] Fix unittest
1223796 [Lee moon soo] Remove unnecessary log
394cf8c [Lee moon soo] Conda interpreter implementation
### What is this PR for?
In multi-user environment when users create a notebook normally they would expect that notebook be listed only in their list/workbench. Currently Zeppelin creates/imports notes as public by default. There should be at least a way to pass through configuration to make this behaviour private be default. Should discuss whether it's public or private by default.
### What type of PR is it?
Improvement
### Todos
* [x] - set permissions on create/import
* [x] - test
* [x] - review, feedback, decide whether public/private by default
* [x] - pass through env. config
### What is the Jira issue?
[ZEPPELIN-1657](https://issues.apache.org/jira/browse/ZEPPELIN-1657)
### How should this be tested?
1. set `zeppelin.notebook.public` property as false in `zeppelin-site.xml`
2. login as user1 and create noteA, note should appear in your list of notes
3. logout and login as user2, shouldn't be able to see noteA
### Screenshots (if appropriate)
TBD
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? maybe
Author: Khalid Huseynov <khalidhnv@gmail.com>
Closes#1625 from khalidhuseynov/feat/public-note-create and squashes the following commits:
010c262 [Khalid Huseynov] fix test: set state back
fc91b2f [Khalid Huseynov] add description to install config
f862ae1 [Khalid Huseynov] fix InterpreterFactory test
876b798 [Khalid Huseynov] fix vfs testSave npe
1a945e8 [Khalid Huseynov] add test
496b80c [Khalid Huseynov] read env var from conf file directly
28abffa [Khalid Huseynov] set permissions on note create and import
44297a4 [Khalid Huseynov] set new note permissions
9732409 [Khalid Huseynov] add variable to ZeppelinConfiguration
4062af0 [Khalid Huseynov] add var to env.sh
b7f28b3 [Khalid Huseynov] add property to site.xml
### What is this PR for?
This adds note to configuration to make clear about `sparkmaster` hostname defined in `/etc/hosts`
### What type of PR is it?
Improvement | Documentation
### Todos
* [x] - add note
### What is the Jira issue?
n/a
### How should this be tested?
see documentation
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Khalid Huseynov <khalidhnv@gmail.com>
Closes#1636 from khalidhuseynov/docs/spark-yarn-add-note-hostname and squashes the following commits:
9648e08 [Khalid Huseynov] address feedback, fix path
78e7907 [Khalid Huseynov] add note about sparkmaster to each section
887b499 [Khalid Huseynov] update docker file path yarn mode
9e4ad68 [Khalid Huseynov] add sparkmaster hostname note
### What is this PR for?
Remove unmanaged, old library markdown4j dep which exists just for Websequence and YUML plugins.
(related to https://github.com/apache/zeppelin/pull/1384)
By adding Websequence and YUML plugins to pegdown
- Removing markdown4j dependency which is unmanaged library currently.
- Addtionally, we can remove `markdown.parser.type` options in **markdown interpreter**
- Fixing some bugs in Websequence and YUML plugins
- Enable others to add more plugins using pegdown sytnax.
### What type of PR is it?
Improvement
### Todos
Nothing
### What is the Jira issue?
[JIRA - ZEPPELIN-1614](https://issues.apache.org/jira/browse/ZEPPELIN-1614)
### How should this be tested?
Some functional tests are included.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? - YES
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - YES
Author: 1ambda <1amb4a@gmail.com>
Closes#1594 from 1ambda/feat/remove-markdown4j-dep and squashes the following commits:
5af1607 [1ambda] fix: Failed tests in InterpreterRestApiTest
c57fdcb [1ambda] docs: Update markdown.md
5c62236 [1ambda] docs: Update upgrade.md for '%md'
a1e779d [1ambda] style: Use zeppelin checkstyle.xml
13e0dc4 [1ambda] Update: interpreter setting and docs
de3549d [1ambda] chore: Cleanup duplicated markdown4j license
7c5d41e [1ambda] fix: Parse style param optionally in webseq
8831ca1 [1ambda] fix: Wrap exceptions in catch stmt
9268695 [1ambda] Revert "fix: Cleanup unused Markdown4j Parser"
33fb800 [1ambda] Revert "docs: Remove markdown.parser.type option"
fddc459 [1ambda] Revert "chore: Remove markdown4j dep and update license"
a59ebbd [1ambda] Revert "fix: Set {} to avoid 503"
4e48933 [1ambda] Revert "fix: Parse style param optionally in webseq"
8cfb2c8 [1ambda] Revert "fix: style and misspell in docs"
73956e0 [1ambda] Revert "fix: Propagate exception in YUML plugin"
1b7787f [1ambda] fix: Propagate exception in YUML plugin
c656d08 [1ambda] fix: style and misspell in docs
dc4f110 [1ambda] fix: Parse style param optionally in webseq
b43e14e [1ambda] fix: Set {} to avoid 503
c48cc53 [1ambda] chore: Remove markdown4j dep and update license
81fdfcc [1ambda] docs: Remove markdown.parser.type option
cf19f0b [1ambda] fix: Cleanup unused Markdown4j Parser
98b2809 [1ambda] fix: Add missing docs
3e9716d [1ambda] feat: Yuml markdown plugin
3247c67 [1ambda] feat: Support webseq markdown plugin
### What is this PR for?
Doc should deliver key features and recommended usage more simple and easy way.
- docs/install/install.md has lots of duplicated section with README.md.
- docs/install/install.md includes install from binary as well as build from source. I've seen that makes some beginners try download binary and then source build it again.
- recommended and key usage need to be highlighted.
- Be less verbose in key instructions. Move optional, additional info from in the middle of key instruction to end of the each page.
### What type of PR is it?
Improvement
### Todos
* [x] - improve doc
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1644
### How should this be tested?
Run doc locally
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Lee moon soo <moon@apache.org>
Closes#1615 from Leemoonsoo/ZEPPELIN-1644 and squashes the following commits:
e554216 [Lee moon soo] Add build item in index.md
c6b25f8 [Lee moon soo] Update suggested build command.
c7a19eb [Lee moon soo] Add build.md
e59fe3f [Lee moon soo] make document easier to follow key instructions
### What is this PR for?
removing support on old versions of Spark including testing and building them.
### What type of PR is it?
[Feature]
### Todos
* [x] - Remove .travis.yml
* [x] - Remove pom.xml
* [x] - Remove some docs
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1599
### How should this be tested?
No test. Check travis simplified
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? You cannot use spark from 1.1 to 1.3 any longer
* Does this needs documentation? Yes, should remove some docs
Removed some profiles concerning old versions of Spark
Author: Jongyoul Lee <jongyoul@gmail.com>
Closes#1578 from jongyoul/ZEPPELIN-1599 and squashes the following commits:
acf514f [Jongyoul Lee] Fixed the script not for recognizing old versions
4bc11d6 [Jongyoul Lee] Added some docs for the deprecation on support for old versions of Spark
207502d [Jongyoul Lee] Removed some tests for old versions of Spark Removed some profiles concerning old versions of Spark
### What is this PR for?
This PR enables edit on double click for markdown/angular paragraph. Users can change `editOnDblClick` field to be `false` by editting `interpreter/md/interpreter-setting.json` or `conf/interpreter.json`. In the same context, users can set other type paragraphs to be editable on double click by setting `editOnDblClick` to be true.
This PR also fixes bug that syntax highlight doesn't work on pasted code.
### What type of PR is it?
Feature
### Todos
* [x] Create test
* [x] Update docs
### What is the Jira issue?
[ZEPPELIN-1566](https://issues.apache.org/jira/browse/ZEPPELIN-1566)
### How should this be tested?
1. Create new markdown interpreter
2. Create notebook and run markdown paragraph
3. Double click markdown paragraph to edit
### Screenshots (if appropriate)
**Edit on double click and hide editor on paragraph run**
**Syntax highlight on paste**
Before
After
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Mina Lee <minalee@apache.org>
Closes#1540 from minahlee/ZEPPELIN-1566 and squashes the following commits:
89ea628 [Mina Lee] Remove redundant code
4ffc446 [Mina Lee] Enable focus first paragraph on note reload
c566706 [Mina Lee] Check null condition of editor setting and return default setting
38d5e35 [Mina Lee] Update document about how to make paragraph editable on double click
b42039e [Mina Lee] Add integration test for editOnDblClick
0a26207 [Mina Lee] Add editOnDblClick field in interpreter-setting.json
93abe6a [Mina Lee] Make paragraph editable on doubleclick if editOnDblClick set true in interpreter-setting.json
359dc0b [Mina Lee] Split getAndSetEditorSetting method into getEditorSetting and setEditorLanguage method
### What is this PR for?
This PR fixes wrong written NotebookID to NoteID.
### What type of PR is it?
[Improvement]
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1549
### Questions:
* Does the licenses files need update? No.
* Is there breaking changes for older versions? No.
* Does this needs documentation? No
Author: hyonzin <hyeonjin507@gmail.com>
Author: 정현진 <hyeonjin507@gmail.com>
Author: Mina Lee <minalee@apache.org>
Closes#1518 from hyonzin/ZEPPELIN-1549 and squashes the following commits:
2c5d461 [hyonzin] fix pullNoteID to pullNoteId
f843abd [hyonzin] Fix missed line
22aecb3 [hyonzin] Merge branch 'master' of https://github.com/apache/zeppelin into ZEPPELIN-1549
ac03666 [정현진] Merge pull request #1 from minahlee/ZEPPELIN-1549
8b3fffd [Mina Lee] Change notebook to note and fix indentation
000605f [hyonzin] Change clonedNotebookId to clonedNoteId
496695c [hyonzin] Change noteID to noteId
1e87463 [hyonzin] Remove tab indent
5647d37 [hyonzin] Rebase and solve conflicts
09bacd8 [hyonzin] Fix more lines unchanged
070bc2d [hyonzin] fix more in ZeppelinRestApiTest.java
24822a3 [hyonzin] Fix more code not changed (notebookIndex to noteSearchService)
4b4e1e8 [hyonzin] Fix detail (function's name) & Change some placeholder
429203d [hyonzin] Fix details & convention to camel
5fa270d [hyonzin] pull upstream master & fix some details
294bea5 [hyonzin] Fix some wrong written term: Notebook -> Note
cc0d315 [hyonzin] Change NotebookID variable name to NoteID
### What is this PR for?
Fix minor typos in docs
### What type of PR is it?
Documentation
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: k <K@kui-MacBook-Pro.local>
Author: Mina Lee <minalee@apache.org>
Author: laesunk <laesunk@gmail.com>
Closes#1542 from laesunk/fix_typo and squashes the following commits:
7b703a7 [laesunk] Merge pull request #1 from minahlee/fix_typo
28fc9ce [Mina Lee] Fix more typos
a55ae4a [Mina Lee] Restore wrong changes during rebase
190ac05 [k] fix words
01ce71b [k] fix likly
### What is this PR for?
This PR sets default value for ZEPPELIN_INTP_MEM to avoid OOM Exception in SparkInterpreter when Zeppelin has zero configuration. This PR should be merged to both branch-0.6 and master.
### What type of PR is it?
Bug Fix
### How should this be tested?
1. Build with:
```
mvn clean package -DskipTests -pl '!zeppelin-distribution,!file,!alluxio,!livy,!hbase,!bigquery,!python,!jdbc,!ignite,!lens,!postgresql,!cassandra,!kylin,!elasticsearch,!flink,!markdown,!shell,!angular'
```
2. Unset SPARK_HOME in conf/zeppelin-env.sh if you have.
3. Run Zeppelin with java 1.7.
4. Run tutorial and see if it doesn't hang.
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Mina Lee <minalee@apache.org>
Closes#1505 from minahlee/hotfix/default_intp_jvm and squashes the following commits:
0dfda4f [Mina Lee] Set default ZEPPELIN_INTP_MEM
### What is this PR for?
Use a different variable for ssl port number
- add new property for ssl port
### What type of PR is it?
Improvement
### Todos
* [x] - Add documentation in upgrade.md
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1321
### How should this be tested?
Add ZEPPELIN_SSL_PORT or zeppelin.server.ssl.port in zeppelin env or site xml and configure the rest of ssl properties and start zeppelin.
### Screenshots (if appropriate)
n/a
### Questions:
* Does the licenses files need update? n/a
* Is there breaking changes for older versions? n/a
* Does this needs documentation? Updated install doc
Author: Renjith Kamath <renjith.kamath@gmail.com>
Closes#1489 from r-kamath/ZEPPELIN-1321 and squashes the following commits:
8f9006a [Renjith Kamath] ZEPPELIN-1321 update zeppelin upgrade guide
41899b1 [Renjith Kamath] ZEPPELIN-1321 Zeppelin HTTP and HTTPS port should be managed seperately
### What is this PR for?
This PR is for the documentation of running zeppelin with CDH docker environment.
and This PR is the part of https://issues.apache.org/jira/browse/ZEPPELIN-1198.
Tested CDH5.7 on ubuntu.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1281
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <ahyoungryu@apache.org>
Author: HyungSung <hsshim@nflabs.com>
Closes#1451 from astroshim/ZEPPELIN-1281 and squashes the following commits:
5dcb8c1 [astroshim] move configurations to right path and add excluding rat-plugin
09408e3 [HyungSung] Merge pull request #11 from AhyoungRyu/ZEPPELIN-1281-ahyoung
850119c [AhyoungRyu] Generate TOC & change some sentences
e687a53 [AhyoungRyu] Replace zeppelin_with_cdh.png to crop the url part
cc9a023 [AhyoungRyu] Remove main title link anchor
b525f68 [astroshim] separate cdh doc with spark_cluster_mode.md
e66993f [astroshim] fix doc
a7b5b2d [astroshim] cdh docker environment
### What is this PR for?
A few sentences describing the overall goals of the pull request's commits.
First time? Check out the contributing guide - https://github.com/apache/zeppelin/blob/master/CONTRIBUTING.md
This is a rewrite of the "Quick Start" page, fixing syntax/grammar issues while trying to keep to the original content. I may look at other pages, but I wanted my first PR to be very small.
### What type of PR is it?
Documentation
### Todos
Verify the accuracy of the configuration settings section
### What is the Jira issue?
(Does this apply to documentation PRs?)
### How should this be tested?
Do documentation changes like this need to be tested?
If so, is the github preview sufficient for these changes? How is Zeppelin's markdown interpreter different than Github's?
If Github's MD preview isn't sufficient, is it possible to build the documentation locally?
### Screenshots (if appropriate)
### Questions:
* Since this is my first PR on the project, I limited the scope of my changes. Is there any desire to change the content of these pages in any way? Do we have documentation conventions?
Author: Roger Filmyer <roger.filmyer@gmail.com>
Closes#1416 from rfilmyer/master and squashes the following commits:
f2c126b [Roger Filmyer] Rewrite of "Quick Start"
### What is this PR for?
This PR is for the documentation of running zeppelin on production environments especially spark on mesos via Docker.
Related issue is https://github.com/apache/zeppelin/pull/1227 and https://github.com/apache/zeppelin/pull/1318 and I got a lot of hints from https://github.com/sequenceiq/hadoop-docker.
Tested on ubuntu.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1279
### How should this be tested?
You can refer to https://github.com/apache/zeppelin/blob/master/docs/README.md#build-documentation.
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Author: HyungSung <hsshim@nflabs.com>
Closes#1389 from astroshim/ZEPPELIN-1279 and squashes the following commits:
974366a [HyungSung] Merge pull request #10 from AhyoungRyu/ZEPPELIN-1279-ahyoung
076fdba [AhyoungRyu] Change zeppelin_mesos_conf.png file
1cbe9d3 [astroshim] fix spark version and mesos
2b821b4 [astroshim] fix docs
159bafc [astroshim] fix anchor
d8c43b4 [astroshim] add navigation
c808350 [astroshim] add image file and doc
a3b0ded [astroshim] create dockerfile for mesos
### What is this PR for?
Removing old JDBC sugar
### What type of PR is it?
[Feature]
### Todos
* [x] - Removed codes to check jdbc alias enabled
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1366
### How should this be tested?
* No longer available
* `%jdbc(mysql)` -> `%mysql`
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? Yes
* Does this needs documentation? Yes, but I don't know where the proper location is.
Author: Jongyoul Lee <jongyoul@gmail.com>
Closes#1360 from jongyoul/ZEPPELIN-1366 and squashes the following commits:
f9df86e [Jongyoul Lee] Changed description
302825c [Jongyoul Lee] Removed effectiveText and related test
929bad2 [Jongyoul Lee] Updated docs for breaking changes
e52521f [Jongyoul Lee] Removed test for jdbc sugar
9f46bbd [Jongyoul Lee] Resolved codes conflicted
### What is this PR for?
fix some spelling mistakes just like this: zepplin -> zeppelin
### What type of PR is it?
[Documentation]
### Todos
* [ ] - Task
### What is the Jira issue?
* No jira created
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Liu Xiang <lxmtlab@gmail.com>
Closes#1386 from sloth2012/master and squashes the following commits:
fdb4e51 [Liu Xiang] fix some word spell errors
### What is this PR for?
Don't use ZEPPELIN_JAVA_OPTS as the default value of ZEPPELIN_INTP_JAVA_OPTS
### What type of PR is it?
Improvement
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1185
### How should this be tested?
Tested manually. By exporting the following variable, I can debug zeppelin server correctly and remote interpreter process can ran successfully. (Before this PR, the remote interpreter process will fail to launch because it would also listen the same debug port)
```
export ZEPPELIN_JAVA_OPTS="-agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=5005"
```
Author: Jeff Zhang <zjffdu@apache.org>
Closes#1189 from zjffdu/ZEPPELIN-1185 and squashes the following commits:
9e48ad7 [Jeff Zhang] change for windows
3ff5561 [Jeff Zhang] update doc format
e82d889 [Jeff Zhang] add migration doc
ef5a360 [Jeff Zhang] ZEPPELIN-1185. ZEPPELIN_INTP_JAVA_OPTS should not use ZEPPELIN_JAVA_OPTS as default value
### What is this PR for?
This PR is for the documentation of running zeppelin on production environments especially spark on yarn.
Related issue is https://github.com/apache/zeppelin/pull/1227 and I got a lot of hints from https://github.com/sequenceiq/hadoop-docker.
Tested on ubuntu.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1280
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Author: HyungSung <hsshim@nflabs.com>
Closes#1318 from astroshim/ZEPPELIN-1280 and squashes the following commits:
60958cd [astroshim] small changes for doc
6c44b7b [astroshim] Merge branch 'master' into ZEPPELIN-1280
dad297c [astroshim] update version
4c8d72d [astroshim] merge with Ayoung's
8c62cf1 [astroshim] fixed felixcheung pointed out.
86ca513 [HyungSung] Merge pull request #9 from AhyoungRyu/ZEPPELIN-1280-ahyoung
cde5f8d [AhyoungRyu] Modify document description so that this docs can be searched
9e9390c [AhyoungRyu] Minor update for spark_cluster_mode.md
633c930 [astroshim] running zeppelin on yarn
### What is this PR for?
Currently, if there are two notebook storages configured, the sync process treats them equally and can pull changes from either storage. This can cause confusions if there is a clear distinction between primary and secondary storages, and the primary storage is managed outside of Zeppelin itself, such as a local folder that's git controlled. If a notebook is deleted or reverted to an older version in the primary storage behind Zeppelin's back, the sync process will overwrite the change with data from the secondary storage, likely against the user's intention.
The proposal is to enable the scenario with a one-way sync flag, where the primary storage is treated as the only source of truth and the secondary storage is merely a mirror of the primary.
### What type of PR is it?
Improvement
### Todos
### What is the Jira issue?
<https://issues.apache.org/jira/browse/ZEPPELIN-1294>
### How should this be tested?
1. Setup two notebook storages through `ZEPPELIN_NOTEBOOK_STORAGE`, with the first is local file storage, i.e. `org.apache.zeppelin.notebook.repo.VFSNotebookRepo`. The second storage can be anything, e.g. `org.apache.zeppelin.notebook.repo.zeppelinhub.ZeppelinHubRepo`.
2. Add `export ZEPPELIN_NOTEBOOK_ONE_WAY_SYNC=true` to `zeppelin-env.sh`.
3. Start Zeppelin server.
4. Delete a notebook directly from the notebook folder.
5. Refresh notebooks from Zeppelin UI.
6. Observe from the secondary storage that the notebook has been deleted.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? Documentation for the new flag has been added to `install.md`
Author: Hao Xia <hao@optimizely.com>
Closes#1286 from jasonxh/hao/one-way-sync and squashes the following commits:
75a0670 [Hao Xia] Address PR comments
566b0ed [Hao Xia] Implement one-way sync for notebook repos
### What is this PR for?
Change maven version from 3.3.3 to 3.3.9 in vagrant script and its documentation due to path to 3.3.3 doesn't exist (return 404 from apache mirror)
### What type of PR is it?
Bug Fix | Documentation
### What is the Jira issue?
ZEPPELIN-1299
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Jesang Yoon <yoonjs2@kanizsalab.com>
Closes#1294 from yoonjs2/ZEPPELIN-1299 and squashes the following commits:
1d2591f [Jesang Yoon] Change all appearances 3.3.3 to 3.3.9 in documentation
5ac7de7 [Jesang Yoon] Change maven version from 3.3.3 to 3.3.9
### What is this PR for?
As more and more document pages are added, it's really hard to find specific pages. So I added searching feature to Zeppelin documentation site([jekyll](https://jekyllrb.com/) based site) using [lunr.js](http://lunrjs.com/).
- **How does it work?**
I created [`search_data.json`](6e02423f54/docs/search_data.json) which is used for docs info template. `lunr.js` combines all of the text from all of the docs in `docs/` into `_site/search_data.json`. It looks like below.
All the info are comes from [Jekyll YAML front matter](https://jekyllrb.com/docs/frontmatter/) variables. (i.e. title, group, description.. that's why I rewrote all docs' title and description.)
[search.js](6e02423f54/docs/assets/themes/zeppelin/js/search.js) will do this job using this data!
### What type of PR is it?
Improvement & Feature
### Todos
* [x] - Keep consistency for all docs pages' `Title`
* [x] - Add some overview sentences to all docs pages' `Description` section (this will be used as the result preview)
* [x] - Add apache license header to all docs page (some pages are missing the license header currently)
* [x] - Add LICENSE for `lunr.min.js`
### What is the Jira issue?
[ZEPPELIN-1219](https://issues.apache.org/jira/browse/ZEPPELIN-1219)
### How should this be tested?
1. Apply this patch and build `ZEPPELIN_HOME/docs` dir -> please see [docs/README.md#build-documentation](https://github.com/apache/zeppelin/tree/master/docs#build-documentation)
2. Click `search` icon in navbar and go to `search.html` page
3. Type anything you want to search in the search bar (i.e. type `python`, `spark`, `dynamic` ... )
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? Yes, for `lunr.min.js`
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Closes#1266 from AhyoungRyu/ZEPPELIN-1219 and squashes the following commits:
7ec8854 [AhyoungRyu] Modify 'no result' sentence
91b71a7 [AhyoungRyu] Remove Apache license header since JSON doesn't allow comment
34afd5d [AhyoungRyu] Add Apache license header to search_data.json
6784282 [AhyoungRyu] Minor search page UI update
0389d28 [AhyoungRyu] Make index.md not to be searched
9f1ba42 [AhyoungRyu] Disable enterkey press & change icon
bd4956a [AhyoungRyu] Add docs.js & search.js to exclude list in pom.xml
624b051 [AhyoungRyu] Add Apache license header to search.js
1381152 [AhyoungRyu] Fix search result skipping issue
6e775f5 [AhyoungRyu] Make pleasecontribute.md not to be searched
ee11136 [AhyoungRyu] Fix some typos
fa01299 [AhyoungRyu] Refine 'description' in some docs as @bzz suggested
da0cff9 [AhyoungRyu] Exclude lunr.min.js
36ba7f1 [AhyoungRyu] Add lunr.min.js license info
f6a05a6 [AhyoungRyu] Apply css style for the search results
68eb997 [AhyoungRyu] Attach 'Apache Zeppelin ZEPPELIN_VERSION Documentation: ' to title
d908c37 [AhyoungRyu] Add searching page
a951fa6 [AhyoungRyu] Add search icon to navbar
0688a79 [AhyoungRyu] Keep consistency all docs' front matter for the right search result
040f532 [AhyoungRyu] Add template for storing docs info based on jekyll front matter
0705bd6 [AhyoungRyu] Add js files: lunr.min.js & search.js
### What is this PR for?
- build distribution package with Spark 2.0 and Scala 2.11
- change travis profile to use spark 2.0 instead of 2.0.0-preview by removing `-Dspark.version=2.0.0-preview` property
- Change profile activation rule
* current way of profile activation is not proper for supporting more than three scala version
* -Pscala-2.11 activates both scala-2.10 and scala-2.11 profile without this patch
### What type of PR is it?
Build
### What is the Jira issue?
[ZEPPELIN-1256](https://issues.apache.org/jira/browse/ZEPPELIN-1256)
### How should this be tested?
**Before**
Run `mvn help:active-profiles -Pscala-2.11`:
```
Active Profiles for Project 'org.apache.zeppelin:zeppelin:pom:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-interpreter:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-zengine:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-display_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-display_2.11:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark-dependencies_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- spark-2.0 (source: org.apache.zeppelin:zeppelin-spark-dependencies_2.11:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- exclude-sparkr (source: org.apache.zeppelin:zeppelin-spark_2.11:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-markdown:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-angular:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-shell:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-livy:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-hbase:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-postgresql:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-jdbc:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-file:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-flink_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-ignite_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-kylin:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-python:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-lens:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-cassandra_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-elasticsearch:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-alluxio:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-web:war:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-server:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-server:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-distribution:pom:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-distribution:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
```
**After**
Run `mvn help:active-profiles -Dscala-2.11`:
```
Active Profiles for Project 'org.apache.zeppelin:zeppelin:pom:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-interpreter:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-zengine:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-display_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-display_2.11:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark-dependencies_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- spark-2.0 (source: org.apache.zeppelin:zeppelin-spark-dependencies_2.11:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- exclude-sparkr (source: org.apache.zeppelin:zeppelin-spark_2.11:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-markdown:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-angular:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-shell:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-livy:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-hbase:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-postgresql:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-jdbc:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-file:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-flink_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-ignite_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-kylin:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-python:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-lens:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-cassandra_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-elasticsearch:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-alluxio:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-web:war:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-server:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-server:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-distribution:pom:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-distribution:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
```
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes (for scala 2.11 build)
Author: Mina Lee <minalee@apache.org>
Closes#1251 from minahlee/ZEPPELIN-1256 and squashes the following commits:
ff034c6 [Mina Lee] change scala-2.10 and scala-2.11 profile activation rule
99d91bf [Mina Lee] Update interpreter installation for the user who use Spark version <= 1.6.2
4ca3e7f [Mina Lee] Build distribution package with Spark 2.0 and Scala 2.11
### What is this PR for?
This PR is for documentation for running zeppelin on production environments.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1198
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hsshim@nflabs.com>
Closes#1227 from astroshim/ZEPPELIN-1198/standalone and squashes the following commits:
53a32f2 [astroshim] add 'via Docker'
61a0e5e [astroshim] add apache license header
83fdef6 [astroshim] doc for spark standalone
### What is this PR for?
This PR implement spark 2.0 support based on #747.
This PR has approach from #980 which is reimplementing code in scala.
You can try build this branch
```
mvn clean package -Dscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0-preview -Ppyspark -Psparkr -Pyarn -Phadoop-2.6 -DskipTests
```
### What type of PR is it?
Improvements
### Todos
* [x] - Spark 2.0 support
* [x] - Rebase after #747 merge
* [x] - Update LICENSE file
* [x] - Update related document (build)
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-759
### How should this be tested?
Build and try
```
mvn clean package -Dscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0-preview -Ppyspark -Psparkr -Pyarn -Phadoop-2.6 -DskipTests
```
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? yes
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Lee moon soo <moon@apache.org>
Closes#1195 from Leemoonsoo/spark-20 and squashes the following commits:
d78b322 [Lee moon soo] trigger ci
8017e8b [Lee moon soo] Remove unnecessary spark.version property
e3141bd [Lee moon soo] restart sparkcluster before sparkr test
1493b2c [Lee moon soo] print spark standalone cluster log when ci test fails
a208cd0 [Lee moon soo] Debug sparkRTest
31369c6 [Lee moon soo] Update license
293896a [Lee moon soo] Update build instruction
862ff6c [Lee moon soo] Make ZeppelinSparkClusterTest.java work with spark 2
839912a [Lee moon soo] Update SPARK_HOME directory detection pattern for 2.0.0-preview in the test
3413707 [Lee moon soo] Update .travis.yml
02bcd5d [Lee moon soo] Update SparkSqlInterpreterTest
f06a2fa [Lee moon soo] Spark 2.0 support
### What is this PR for?
I added auto TOC(Table of Contents) generator for Zeppelin documentation website. TOC can help people looking through whole contents at a glance and finding what they want quickly.
I just added `<div id="toc"></div>` to the each documentation header. [`toc`](https://github.com/apache/zeppelin/compare/master...AhyoungRyu:ZEPPELIN-1018?expand=1#diff-85af09fb498a5667ea455391533f945dR3) recognize `<h2>` & `<h3>` as a title in the docs and it automatically generate TOC. So I set a rule for this work. (I'll write this rule on `docs/CONTRIBUTING.md` or [docs/howtocontributewebsite](https://zeppelin.apache.org/docs/0.6.0-SNAPSHOT/development/howtocontributewebsite.html)).
```
# Level-1 Heading <- Use only for the main title of the page
## Level-2 Heading <- Start with this one
### Level-3 heading <- Only use this one for child of Level-2
toc only recognize Level-2 & Level-3
```
Please see the below attached screenshot image.
### What type of PR is it?
Improvement & Documentation
### Todos
* [x] - Add TOC generator
* [x] - Apply TOC(`<div id="toc"></div>`) to every documentation and reorganize each headers(apply the above rule)
* [x] - Fix some broken code block in several docs
* [x] - Apply TOC to `r.md` (Currently R docs has some duplicated info since [this one](d5e87fb8ba) and [this one](7d6cc7e991) )
* [x] - Apply TOC to `install.md` after #1010 merged
* [x] - Apply TOC to `interpreterinstallation.md` after #1042 merged
### What is the Jira issue?
[ZEPPELIN-1018](https://issues.apache.org/jira/browse/ZEPPELIN-1018)
### How should this be tested?
1. Apply this patch and build `docs/` with [this guide](https://github.com/apache/zeppelin/tree/master/docs#build-documentation)
2. Visit some docs page. Then you can see TOC in the header of page.
### Screenshots (if appropriate)
- Automatically generated TOC in Spark interpreter docs page
<img width="831" alt="screen shot 2016-06-16 at 9 37 18 pm" src="https://cloud.githubusercontent.com/assets/10060731/16140902/945b9c7a-340a-11e6-91f3-b6174738bed0.png">
### Questions:
* Does the licenses files need update?
No. Actually I used [jekyll-table-of-contents#copyright](https://github.com/ghiculescu/jekyll-table-of-contents#copyright). But I don't need to add a license for this :)
* Is there breaking changes for older versions? No
* Does this needs documentation? Maybe
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Closes#1031 from AhyoungRyu/ZEPPELIN-1018 and squashes the following commits:
e66397b [AhyoungRyu] Apply TOC to interpreterinstallation.md
009579b [AhyoungRyu] Add more info to 'What is the next?' in install.md
04cf501 [AhyoungRyu] Revert 'where to start' section
b7cbe5f [AhyoungRyu] Fix typo
cf0911c [AhyoungRyu] Rename license file
388f35a [AhyoungRyu] Add jekyll-table-of-contents license info
6394c70 [AhyoungRyu] Fix image path in python.md
d00e4b1 [AhyoungRyu] Move interpreter/screenshot/ -> asset/../img/docs-img/
3ffb383 [AhyoungRyu] Remove duplicated info in r.md & apply toc
a03ca99 [AhyoungRyu] Exclude toc.js from pom.xml
3fae7df [AhyoungRyu] Apply auto generated toc to install.md
d114a9d [AhyoungRyu] Address @felixcheung feedback
6a788fe [AhyoungRyu] Resize TOC tab indent
6760c00 [AhyoungRyu] Apply auto TOC to all of docs under docs/storage/
fbde57f [AhyoungRyu] Apply auto TOC to all of docs under docs/quickstart/
db76eb6 [AhyoungRyu] Apply auto TOC to all of docs under docs/install/
f35db47 [AhyoungRyu] Apply auto TOC to all of docs under docs/displaysystem/
b05365f [AhyoungRyu] Apply auto TOC to all of docs under docs/rest-api/
163691c [AhyoungRyu] Apply auto TOC to all of docs under docs/manual/
bef398e [AhyoungRyu] Apply auto TOC to all of docs under docs/development/
9c5f76b [AhyoungRyu] Apply auto TOC to all of docs under docs/interpreter/
587d4ba [AhyoungRyu] Apply auto TOC to all of docs under docs/security/
1f10b97 [AhyoungRyu] Change toc configuration
78dca9e [AhyoungRyu] Add toc.js for auto generating TOC
### What is this PR for?
Implementation of bin/install-interpreter.sh for netinst package which suggested in the [discussion](http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Ask-opinion-regarding-0-6-0-release-package-tp3298p3314.html).
Some usages will be
```
# download all interpreters provided by Apache Zeppelin project
bin/install-interpreter.sh --all
# download an interpreter with name (for example markdown interpreter)
bin/install-interpreter.sh --name md
# download an (3rd party) interpreter with specific maven artifact name
bin/install-interpreter.sh --name md -t org.apache.zeppelin:zeppelin-markdown:0.6.0-SNAPSHOT
```
If it looks fine, i'll continue the work (refactor code, and add test)
### What type of PR is it?
Feature
### Todos
* [x] - working implementation
* [x] - refactor
* [x] - add test
### What is the Jira issue?
* Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/
* Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533]
### How should this be tested?
Outline the steps to test the PR here.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?
Author: Lee moon soo <moon@apache.org>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Closes#1042 from Leemoonsoo/netinst and squashes the following commits:
f81d16e [Lee moon soo] address mina's comment
049bc89 [Lee moon soo] Update docs
7307c67 [Lee moon soo] Merge remote-tracking branch 'AhyoungRyu/netinst-docs' into netinst
7e749ad [Lee moon soo] Address mina's comment
0eedd2a [AhyoungRyu] Address @minahlee feedback
13f2d04 [Lee moon soo] generate netinst package
03c664e [AhyoungRyu] Add a new line
5d0a971 [AhyoungRyu] Revert install.md to latest version
13899fb [AhyoungRyu] Reorganize interpreter installation docs
4c1f029 [Lee moon soo] Proxy support
9079580 [Lee moon soo] fix artifact name
1077296 [Lee moon soo] update test
aebca17 [Lee moon soo] Add docs
d547551 [Lee moon soo] Remove test entries
6ee06b8 [Lee moon soo] Make DependencyResolver in zeppelin-interpreter module not aware of ZEPPELIN_HOME
7b1b36a [Lee moon soo] update usage
49f0568 [Lee moon soo] Add conf/interpreter-list
1b558fd [Lee moon soo] update some text
ec7d152 [Lee moon soo] add tip
2c81a3f [Lee moon soo] update
78a7c52 [Lee moon soo] Refactor and add test
47f5706 [Lee moon soo] Install multiple interpreters at once
38e2556 [Lee moon soo] Initial implementation of install-interpreter.sh
### What is this PR for?
Merging TajoInterpreter into JdbcInterpreter, and removing TajoInterprete
### What type of PR is it?
[Feature]
### Todos
* [x] - Remove TajoInterpreter and Document jdbc.md
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-974
### How should this be tested?
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jongyoul Lee <jongyoul@gmail.com>
Closes#985 from jongyoul/ZEPPELIN-974 and squashes the following commits:
5aed86b [Jongyoul Lee] Fixed typo
dbdd90e [Jongyoul Lee] - Removed TajoInterpreter from master - Added example for using Tajo through JDBC
### What is this PR for?
This is extension to https://github.com/apache/zeppelin/pull/983, with missing references of incubation.
### What type of PR is it?
[Improvement]
### What is the Jira issue?
[ZEPPELIN-980](https://issues.apache.org/jira/browse/ZEPPELIN-980)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Prabhjyot Singh <prabhjyotsingh@gmail.com>
Closes#992 from prabhjyotsingh/ZEPPELIN-980 and squashes the following commits:
5fa97b7 [Prabhjyot Singh] missing "incubation-" references
### What is this PR for?
git repo infra have moved from incubator-zeppelin to zeppelin
### What type of PR is it?
Hot Fix
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Mina Lee <minalee@apache.org>
Closes#983 from minahlee/ZEPPELIN-980 and squashes the following commits:
7542c31 [Mina Lee] remove travis url after travis migration is done
3793b38 [Mina Lee] Move git repository from incubator-zeppelin to zeppelin
### What is this PR for?
This removes hive module and adds example setting for using Hive in a JdbcInterpreter by using loading dynamic dependencies. It reduces Zeppelin's binary size.
There's no codes' modification except removing hive directory and remove the module from pom.xml
### What type of PR is it?
[Feature]
### Todos
* [x] - Remove hive module
* [x] - Add an example for using Hive in JDBC
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-925
### How should this be tested?
Set the interpreter properties and test it
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jongyoul Lee <jongyoul@gmail.com>
Closes#943 from jongyoul/ZEPPELIN-925 and squashes the following commits:
eb50c78 [Jongyoul Lee] Fixed typo
45ec667 [Jongyoul Lee] Updated style of jdbc.md
f6b94d6 [Jongyoul Lee] Update hive.md
6aa9c7b [Jongyoul Lee] Revert "Remove hive.md from docs/interpreter"
f6573e3 [Jongyoul Lee] Deleted hive module from pom.xml
f720ed5 [Jongyoul Lee] Updated Documentation
9c58640 [Jongyoul Lee] Remove hive.md from docs/interpreter
cdf1cfc [Jongyoul Lee] Remove hive module and its directory
a38dc28 [Jongyoul Lee] Update example for hive in jdbc.md
### What is this PR for?
Update resources to use Zeppelin TLP links
### What type of PR is it?
[Bug Fix]
### What is the Jira issue?
[ZEPPELIN-898](https://issues.apache.org/jira/browse/ZEPPELIN-898)
Author: Luciano Resende <lresende@apache.org>
Closes#927 from lresende/incubator-links and squashes the following commits:
8fca07c [Luciano Resende] [ZEPPELIN-898] Update resources to use Zeppelin TLP links
### What is this PR for?
Adds support for using the AWS KMS or a custom encryption materials
provider class to encrypt data stored in Amazon S3. Also a minor
improvement to logic inside the S3 notebook repo when dealing with local files.
### What type of PR is it?
Improvement
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-848
### How should this be tested?
Running in EMR or another system in AWS is easiest. Make appropriate changes to the config and use an AWS KMS key
### Questions:
* Does the licenses files need update? -- NO
* Is there breaking changes for older versions? -- NO
* Does this needs documentation? -- YES, changes in storage.md and zeppelin-site.xml.template
Author: Nate Sammons <Nate.Sammons@nasdaq.com>
Author: Nate Sammons <nate.sammons@nasdaq.com>
Closes#886 from natesammons-nasdaq/master and squashes the following commits:
a6e074f [Nate Sammons] Merge remote-tracking branch 'origin/master'
cdd3107 [Nate Sammons] Merge remote-tracking branch 'apache/master'
48b89c0 [Nate Sammons] Update install.md
ff1540b [Nate Sammons] Merge remote-tracking branch 'apache/master'
84709c4 [Nate Sammons] Merge remote-tracking branch 'apache/master'
513361f [Nate Sammons] Update line length
b318c79 [Nate Sammons] Merge remote-tracking branch 'apache/master'
ceb5847 [Nate Sammons] Merge remote-tracking branch 'apache/master'
1475aa0 [Nate Sammons] Merge remote-tracking branch 'apache/master'
84ddd3b [Nate Sammons] Log exception when reloading notebooks
b55b98c [Nate Sammons] Updated exception handling
8628d95 [Nate Sammons] ZEPPELIN-848: Add support for encrypted data stored in Amazon S3
### What is this PR for?
1. Fix some typos in docs.
2. Remove trailing white spaces for each line.
3. Remove leading white spaces if a line contains no content.
4. Add trailing new line for each file.
### What type of PR is it?
Improvement | Documentation
### Todos
None
### What is the Jira issue?
N/A
### How should this be tested?
Build the doc site and check.
### Screenshots (if appropriate)
N/A
### Questions:
* Does the licenses files need update? *no*
* Is there breaking changes for older versions? *no*
* Does this needs documentation? *no*
Author: Cheng-Yu Hsu <m@cyhsu.me>
Closes#852 from cyhsutw/fix-typos-in-docs and squashes the following commits:
6f5f46b [Cheng-Yu Hsu] fix typos in docs
### What is this PR for?
Updates Virtual Machine documentation to include SparkR information.
### What type of PR is it?
Documentation
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Steinmetz <jeffrey.steinmetz@gmail.com>
Closes#826 from jeffsteinmetz/sparkr-doc-updates and squashes the following commits:
5d34ffb [Jeff Steinmetz] Include r packages in last paragraph
d8f7827 [Jeff Steinmetz] Include r packages in last paragraph
3f38a5a [Jeff Steinmetz] remove extranious brackets
0fc8a11 [Jeff Steinmetz] add r packages list per comment. use anchor links consistent with markdown documenation per github
2e419fe [Jeff Steinmetz] vagrant download like changed. update to a link that doesn not 404.
d8a1fa4 [Jeff Steinmetz] update VM readme and VM install docs to reference R interpreter additions
679e87a [Jeff Steinmetz] update VM readme and VM install docs to reference R interpreter additions
### What is this PR for?
Allow the user to modify the value for websocket maxTextMessageSize via conf. Recently a user filed an issue asking for the size to be configurable.
### What type of PR is it?
Improvement
### Todos
* [ ] - Task
### What is the Jira issue?
[ZEPPELIN-748](https://issues.apache.org/jira/browse/ZEPPELIN-748)
### How should this be tested?
modify the value for maxTextMessageSize in zeppelin-site.xml or zeppelin-env.sh
### Screenshots (if appropriate)
<img width="990" alt="screen shot 2016-03-18 at 3 35 19 pm" src="https://cloud.githubusercontent.com/assets/2031306/13874611/1297844c-ed1f-11e5-8512-7307f6c4177d.png">
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes. updated.
Author: Renjith Kamath <renjith.kamath@gmail.com>
Closes#784 from r-kamath/ZEPPELIN-748 and squashes the following commits:
d3ac141 [Renjith Kamath] update property name
07b38f1 [Renjith Kamath] ZEPPELIN-748 make websocket maxTextMessageSize configurable
### What is this PR for?
Add setting to set endpoint in S3 storage.
[S3 Endpoint](http://docs.aws.amazon.com/es_es/general/latest/gr/rande.html#s3_region)
### What type of PR is it?
Improvement
### Todos
### What is the Jira issue?
* [ZEPPELIN-692](https://issues.apache.org/jira/browse/ZEPPELIN-692)
### How should this be tested?
set endpoint for your bucket in zeppelin-site.xml
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: vgmartinez <viktor.manuel.garcia@gmail.com>
This patch had conflicts when merged, resolved by
Committer: Lee moon soo <moon@apache.org>
Closes#793 from vgmartinez/ZEPPELIN-692 and squashes the following commits:
c02c8af [vgmartinez] add new configuration
6015d66 [vgmartinez] Add setting to set s3 endpoint
### What is this PR for?
This is to give Windows first-class support for running Zeppelin without the need for Cygwin or other hacks.
### What type of PR is it?
Improvement
### Todos
* [x] - Fix notebook dir path handling which right now assumes URI compatible string (see https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/repo/VFSNotebookRepo.java#L63)
* [x] - Add documentation for configuring and running on Windows
* [x] - Independent code review of the CMD scripts to ensure they're correct
### Is there a relevant Jira issue?
ZEPPELIN-647
### How should this be tested?
* Pull this PR
* Build
* Override default ZEPPELIN_NOTEBOOK_DIR in zeppelin-env.cmd to be an absolute file URI such as file:///c:/notebook
* Start with bin\zeppelin.cmd
* If using any Hadoop system ensure you have winutils.exe in your HADOOP_HOME\bin, see (https://github.com/steveloughran/winutils)
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? Yes
Author: Silvio Fiorito <silvio.fiorito@granturing.com>
Author: Silvio Fiorito <Silvio Fiorito>
Closes#734 from granturing/windows-support and squashes the following commits:
8aadd45 [Silvio Fiorito] Fixes to handle spaces in paths properly, both for ZEPPELIN_HOME and CLASSPATH
73aaf4f [Silvio Fiorito] Default to the appropriate interpreter when running on Windows
db28fe9 [Silvio Fiorito] Support for running unit tests on Windows using the appropriate interpreter script
a1e3097 [Silvio Fiorito] Support for Windows CMD shell interpreter
82acdcf [Silvio Fiorito] Merge branch 'master' into windows-support
9e8b309 [Silvio Fiorito] Initital doc updates for running on Windows
03baf62 [Silvio Fiorito] Additional fix for embedded pyspark environment variables
2b9f01c [Silvio Fiorito] Fix for pyspark PYTHONPATH environment variable not being set properly due to delayed expansion
c700808 [Silvio Fiorito] Check for Windows path before creating URI to prevent URISyntaxExecption
d30e4b9 [Silvio Fiorito] And again fix indentations missed last time
5b49d3e [Silvio Fiorito] Cleaned up indentation
9e40482 [Silvio Fiorito] Initial support for Windows platform, startup scripts
### What is this PR for?
Describe Manual upgrade procedure for Zeppelin.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-498
### How should this be tested?
Install jekyll on a local machine.
Run website.
Check new page in localhost.
### Screenshots
<img width="1032" alt="2016-02-27" src="https://cloud.githubusercontent.com/assets/10624086/13371882/230f5f94-dd74-11e5-9c2d-82ceec57c8b1.png">
Author: Minwoo Kang <minwoo.kang@outlook.com>
Closes#753 from mwkang/master and squashes the following commits:
916bb7a [Minwoo Kang] [ZEPPELIN-498]Upgrade Version instead of just Upgrade
c7b24d5 [Minwoo Kang] [ZEPPELIN-498]Manual upgrade procedure for Zeppelin
### What is this PR for?
pyspark.zip, py4j-\*.zip should be distributed to yarn nodes to make pyspark function but this hasn't been working after #463 because [`if (pythonLibs.length == pythonLibUris.size())`](https://github.com/apache/incubator-zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java#L329) condition will never be true. This PR fixes this issue by changing this if condition to be `pythonlibUris.size() == 2`, while integer 2 refers pyspark.zip and py4j-\*.zip.
In addition, yarn-install documentation has been updated.
### What type of PR is it?
Bug Fix
### Is there a relevant Jira issue?
No. But the issue has reported via [user mailing list](http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Can-t-get-Pyspark-1-4-1-interpreter-to-work-on-Zeppelin-0-6-td2229.html#a2259) by Ian Maloney
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Mina Lee <minalee@nflabs.com>
Closes#736 from minahlee/fix/pyspark_on_yarn and squashes the following commits:
e588f7b [Mina Lee] Merge branch 'master' of https://github.com/apache/incubator-zeppelin into fix/pyspark_on_yarn
2710c46 [Mina Lee] [DOC] Remove invalid information of installation location
c544dec [Mina Lee] [DOC] Remove redundant Zeppelin build information from yarn_install.md [DOC] Guide users to set SPARK_HOME to use spark in yarn mode [DOC] Change spark version to the latest in yarn config example [DOC] Add note that spark for cdh4 doesn't support yarn [DOC] Remove spark properties `spark.home` and `spark.yarn.jar` from doc which doesn't work on zeppelin anymore [DOC] Fix typos [DOC] Add info that embedded spark doesn't work on yarn mode anymore when Spark version is 1.5.0 or higher in README.md
6465ba8 [Mina Lee] Change condition to make pyspark, py4j libraries be distributed to yarn executors
### What is this PR for?
allows zeppelin to be run and managed as a service, does not start in background via nohup
the service manager handles process instead
### What type of PR is it?
Improvement
### Todos
* None, should work as is
### Is there a relevant Jira issue?
ZEPPELIN-641
### How should this be tested?
bin/zeppelin-daemon.sh upstart
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? updated
Author: Jeff Steinmetz <jeffrey.steinmetz@gmail.com>
Closes#722 from jeffsteinmetz/ZEPPELIN-641 and squashes the following commits:
205f8f0 [Jeff Steinmetz] add zeppelin.conf example to docs
1aab016 [Jeff Steinmetz] allows zeppelin to be run and managed as a service. Jira Ticket ZEPPELIN-641
06ed0a3 [Jeff Steinmetz] allows zeppelin to be run and managed as a service. Jira Ticket ZEPPELIN-641
### What is this PR for?
This is to allow the usage of Azure for notebook storage.
### What type of PR is it?
Improvement
### Todos
N/A
### Is there a relevant Jira issue?
[ZEPPELIN-656](https://issues.apache.org/jira/browse/ZEPPELIN-656)
### How should this be tested?
A full integration test will require an Azure storage account. I could provide an account offline if necessary unless someone already has one. I based this off the S3 storage repo. I did not see any integration tests for the S3 storage repo, but let me know if I need to add some for this.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? Yes, license added
* Is there breaking changes for older versions? No
* Does this needs documentation? Yes, updates were made to zeppelin-site.xml.template explaining config settings as well as in the install doc
Author: Silvio Fiorito <silvio.fiorito@granturing.com>
Closes#697 from granturing/azure-storage-backend and squashes the following commits:
433bdc0 [Silvio Fiorito] Fix typo in enum name for user and share
659e7f3 [Silvio Fiorito] Additional locations where we have to block Azure credentials from being exposed
0691472 [Silvio Fiorito] Don't expose Azure storage connection string in UI since it contains credentials
cbfbe4d [Silvio Fiorito] Clarified optional setting for Azure user folder and fixed Azure error handling
928c8b5 [Silvio Fiorito] Added license info and docs for Azure storage settings, also added Azure-specific setting for user base path
ce61f0e [Silvio Fiorito] Add support for using Azure storage
### What is this PR for?
About a month ago, Shiro authentication for Zeppelin is merged by #586. Even though we already have [SECURITY-README.md](https://github.com/apache/incubator-zeppelin/blob/master/SECURITY-README.md), many people do not know about the existence of this file. So I wrote a docs based on `SECURITY-README.md` to the Zeppelin documentation website to guide step by step for Zeppelin users.
### What type of PR is it?
Documentation
### Todos
* [x] - Add shiro authentication docs
* [x] - Add **zeppelin.anonymous.allowed** property in `zeppelin-site.md`
* [x] - Indent **Websocket security** section in `SECURITY-README.md`
### Is there a relevant Jira issue?
[ZEPPELIN-661](https://issues.apache.org/jira/browse/ZEPPELIN-661)
### How should this be tested?
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Ryu Ah young <fbdkdud93@hanmail.net>
Closes#711 from AhyoungRyu/ZEPPELIN-661 and squashes the following commits:
482fc65 [Ryu Ah young] ZEPPELIN-661: ping travis
4fbc5e5 [Ryu Ah young] ZEPPELIN-661: Add the default status information of anon and authcBasic
795f177 [Ryu Ah young] ZEPPELIN-661: indent 'Websocket security' section in SECURITY-README.md
f050f8d [Ryu Ah young] ZEPPELIN-661: Add 'zeppelin.anonymous.allowed' property in zeppelin-site.xml to install.md
d841a8a [Ryu Ah young] ZEPPELIN-661: Add shiro authentication docs
### What is this PR for?
Lately, an official location of Zeppelin was changed from **https://github.com/apache/incubator-zeppelin.git** to **http://git.apache.org/incubator-zeppelin.git**. So I changed the old location in several documentations to the latest one.
### What type of PR is it?
Documentation
### Todos
### Is there a relevant Jira issue?
[ZEPPELIN-657](https://issues.apache.org/jira/browse/ZEPPELIN-657)
### How should this be tested?
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Ryu Ah young <fbdkdud93@hanmail.net>
Closes#700 from AhyoungRyu/ZEPPELIN-657 and squashes the following commits:
2144bcc [Ryu Ah young] ZEPPELIN-657: Change 'release' -> 'branch' in howtocontribute.md
813b438 [Ryu Ah young] ZEPPELIN-657: Change 'release' -> 'branch'
23646e5 [Ryu Ah young] ZEPPELIN-657: Fix the wrong locations
c4bef6c [Ryu Ah young] ZEPPELIN-657: fix a typo in howtocontribute.md
a5fb130 [Ryu Ah young] ZEPPELIN-657: Change the official location of Zeppelin
