### What is this PR for?
This PR adds Mahout functionality for the Spark Interpreter.
### What type of PR is it?
Improvement
### Todos
- [x] Implement Mahout Interpreter in Spark
- [x] Add Unit Tests
- [x] Add Documentation
- [x] Add Example Notebook
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-116
### How should this be tested?
Open a Spark Notebook with Mahout enabled and run a few simple commands using the R-Like DSL and Spark Distributed Context (Mahout Specific)
### Screenshots (if appropriate)
### Questions:
- Does the licenses files need update?
No
- Is there breaking changes for older versions?
No
- Does this needs documentation?
Yes
Author: rawkintrevo <trevor.d.grant@gmail.com>
Closes#928 from rawkintrevo/mahout-terp and squashes the following commits:
ed6eff0 [rawkintrevo] [ZEPPELIN-116] renamed add_mahout_interpreters.py and overwrite_existing feature
e7d4e12 [rawkintrevo] [ZEPPELIN-116] Made add_mahout.py script more resilient
7e83832 [rawkintrevo] [ZEPPELIN-116] Add Mahout Interpreters
### What is this PR for?
This PR fixes wrong written NotebookID to NoteID.
### What type of PR is it?
[Improvement]
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1549
### Questions:
* Does the licenses files need update? No.
* Is there breaking changes for older versions? No.
* Does this needs documentation? No
Author: hyonzin <hyeonjin507@gmail.com>
Author: 정현진 <hyeonjin507@gmail.com>
Author: Mina Lee <minalee@apache.org>
Closes#1518 from hyonzin/ZEPPELIN-1549 and squashes the following commits:
2c5d461 [hyonzin] fix pullNoteID to pullNoteId
f843abd [hyonzin] Fix missed line
22aecb3 [hyonzin] Merge branch 'master' of https://github.com/apache/zeppelin into ZEPPELIN-1549
ac03666 [정현진] Merge pull request #1 from minahlee/ZEPPELIN-1549
8b3fffd [Mina Lee] Change notebook to note and fix indentation
000605f [hyonzin] Change clonedNotebookId to clonedNoteId
496695c [hyonzin] Change noteID to noteId
1e87463 [hyonzin] Remove tab indent
5647d37 [hyonzin] Rebase and solve conflicts
09bacd8 [hyonzin] Fix more lines unchanged
070bc2d [hyonzin] fix more in ZeppelinRestApiTest.java
24822a3 [hyonzin] Fix more code not changed (notebookIndex to noteSearchService)
4b4e1e8 [hyonzin] Fix detail (function's name) & Change some placeholder
429203d [hyonzin] Fix details & convention to camel
5fa270d [hyonzin] pull upstream master & fix some details
294bea5 [hyonzin] Fix some wrong written term: Notebook -> Note
cc0d315 [hyonzin] Change NotebookID variable name to NoteID
### What is this PR for?
This PR is for the documentation of running zeppelin with CDH docker environment.
and This PR is the part of https://issues.apache.org/jira/browse/ZEPPELIN-1198.
Tested CDH5.7 on ubuntu.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1281
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <ahyoungryu@apache.org>
Author: HyungSung <hsshim@nflabs.com>
Closes#1451 from astroshim/ZEPPELIN-1281 and squashes the following commits:
5dcb8c1 [astroshim] move configurations to right path and add excluding rat-plugin
09408e3 [HyungSung] Merge pull request #11 from AhyoungRyu/ZEPPELIN-1281-ahyoung
850119c [AhyoungRyu] Generate TOC & change some sentences
e687a53 [AhyoungRyu] Replace zeppelin_with_cdh.png to crop the url part
cc9a023 [AhyoungRyu] Remove main title link anchor
b525f68 [astroshim] separate cdh doc with spark_cluster_mode.md
e66993f [astroshim] fix doc
a7b5b2d [astroshim] cdh docker environment
### What is this PR for?
This PR is for the documentation of running zeppelin on production environments especially spark on mesos via Docker.
Related issue is https://github.com/apache/zeppelin/pull/1227 and https://github.com/apache/zeppelin/pull/1318 and I got a lot of hints from https://github.com/sequenceiq/hadoop-docker.
Tested on ubuntu.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1279
### How should this be tested?
You can refer to https://github.com/apache/zeppelin/blob/master/docs/README.md#build-documentation.
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Author: HyungSung <hsshim@nflabs.com>
Closes#1389 from astroshim/ZEPPELIN-1279 and squashes the following commits:
974366a [HyungSung] Merge pull request #10 from AhyoungRyu/ZEPPELIN-1279-ahyoung
076fdba [AhyoungRyu] Change zeppelin_mesos_conf.png file
1cbe9d3 [astroshim] fix spark version and mesos
2b821b4 [astroshim] fix docs
159bafc [astroshim] fix anchor
d8c43b4 [astroshim] add navigation
c808350 [astroshim] add image file and doc
a3b0ded [astroshim] create dockerfile for mesos
### What is this PR for?
This PR is for the documentation of running zeppelin on production environments especially spark on yarn.
Related issue is https://github.com/apache/zeppelin/pull/1227 and I got a lot of hints from https://github.com/sequenceiq/hadoop-docker.
Tested on ubuntu.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1280
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Author: HyungSung <hsshim@nflabs.com>
Closes#1318 from astroshim/ZEPPELIN-1280 and squashes the following commits:
60958cd [astroshim] small changes for doc
6c44b7b [astroshim] Merge branch 'master' into ZEPPELIN-1280
dad297c [astroshim] update version
4c8d72d [astroshim] merge with Ayoung's
8c62cf1 [astroshim] fixed felixcheung pointed out.
86ca513 [HyungSung] Merge pull request #9 from AhyoungRyu/ZEPPELIN-1280-ahyoung
cde5f8d [AhyoungRyu] Modify document description so that this docs can be searched
9e9390c [AhyoungRyu] Minor update for spark_cluster_mode.md
633c930 [astroshim] running zeppelin on yarn
### What is this PR for?
Change maven version from 3.3.3 to 3.3.9 in vagrant script and its documentation due to path to 3.3.3 doesn't exist (return 404 from apache mirror)
### What type of PR is it?
Bug Fix | Documentation
### What is the Jira issue?
ZEPPELIN-1299
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Jesang Yoon <yoonjs2@kanizsalab.com>
Closes#1294 from yoonjs2/ZEPPELIN-1299 and squashes the following commits:
1d2591f [Jesang Yoon] Change all appearances 3.3.3 to 3.3.9 in documentation
5ac7de7 [Jesang Yoon] Change maven version from 3.3.3 to 3.3.9
### What is this PR for?
This PR is for documentation for running zeppelin on production environments.
### What type of PR is it?
Documentation
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1198
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hsshim@nflabs.com>
Closes#1227 from astroshim/ZEPPELIN-1198/standalone and squashes the following commits:
53a32f2 [astroshim] add 'via Docker'
61a0e5e [astroshim] add apache license header
83fdef6 [astroshim] doc for spark standalone
### What is this PR for?
This is extension to https://github.com/apache/zeppelin/pull/983, with missing references of incubation.
### What type of PR is it?
[Improvement]
### What is the Jira issue?
[ZEPPELIN-980](https://issues.apache.org/jira/browse/ZEPPELIN-980)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Prabhjyot Singh <prabhjyotsingh@gmail.com>
Closes#992 from prabhjyotsingh/ZEPPELIN-980 and squashes the following commits:
5fa97b7 [Prabhjyot Singh] missing "incubation-" references
### What is this PR for?
Updates Virtual Machine documentation to include SparkR information.
### What type of PR is it?
Documentation
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Steinmetz <jeffrey.steinmetz@gmail.com>
Closes#826 from jeffsteinmetz/sparkr-doc-updates and squashes the following commits:
5d34ffb [Jeff Steinmetz] Include r packages in last paragraph
d8f7827 [Jeff Steinmetz] Include r packages in last paragraph
3f38a5a [Jeff Steinmetz] remove extranious brackets
0fc8a11 [Jeff Steinmetz] add r packages list per comment. use anchor links consistent with markdown documenation per github
2e419fe [Jeff Steinmetz] vagrant download like changed. update to a link that doesn not 404.
d8a1fa4 [Jeff Steinmetz] update VM readme and VM install docs to reference R interpreter additions
679e87a [Jeff Steinmetz] update VM readme and VM install docs to reference R interpreter additions
### What is this PR for?
Improvement of Virtual Machine Script to support R interpretor
### What type of PR is it?
Improvement of Virtual Machine Script to support R interpretor
### Todos
* [x] - Test with #208
* [x] - Test with #702
### Is there a relevant Jira issue?
Zeppelin-700
### How should this be tested?
Follow the steps in this Read Me to build a VM from scratch:
https://github.com/apache/incubator-zeppelin/blob/master/scripts/vagrant/zeppelin-dev/README.md
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? Added to all headers
* Is there breaking changes for older versions? No
* Does this needs documentation? Yes, this will be a separate PR to update docs and README
Author: Jeff Steinmetz <jeffrey.steinmetz@gmail.com>
Closes#751 from jeffsteinmetz/ZEPPELIN-700 and squashes the following commits:
e03dba5 [Jeff Steinmetz] update to support R interpreter sparkr build profile
a9a2052 [Jeff Steinmetz] add base64enc, repr and htmltools
bdcdf5f [Jeff Steinmetz] removed packages not required for pr702. repr not needed - base64encode not needed - htmltools not needed
d497994 [Jeff Steinmetz] fix so that devtools will install
5643fc6 [Jeff Steinmetz] plotting in r interpreter requires the repr package. install devtools package first so repr can be installed.
fb18a2b [Jeff Steinmetz] plotting in r interpreter requires the repr package. install devtools package first so repr can be installed.
ef8f638 [Jeff Steinmetz] ZEPPELIN-700. Add Ansible R role to Virtual Machine to support dependencies for the R Interpreter
b940bcd [Jeff Steinmetz] ZEPPELIN-700. Add Ansible R role to Virtual Machine to support dependencies for the R Interpreter
### What is this PR for?
Lately, an official location of Zeppelin was changed from **https://github.com/apache/incubator-zeppelin.git** to **http://git.apache.org/incubator-zeppelin.git**. So I changed the old location in several documentations to the latest one.
### What type of PR is it?
Documentation
### Todos
### Is there a relevant Jira issue?
[ZEPPELIN-657](https://issues.apache.org/jira/browse/ZEPPELIN-657)
### How should this be tested?
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Ryu Ah young <fbdkdud93@hanmail.net>
Closes#700 from AhyoungRyu/ZEPPELIN-657 and squashes the following commits:
2144bcc [Ryu Ah young] ZEPPELIN-657: Change 'release' -> 'branch' in howtocontribute.md
813b438 [Ryu Ah young] ZEPPELIN-657: Change 'release' -> 'branch'
23646e5 [Ryu Ah young] ZEPPELIN-657: Fix the wrong locations
c4bef6c [Ryu Ah young] ZEPPELIN-657: fix a typo in howtocontribute.md
a5fb130 [Ryu Ah young] ZEPPELIN-657: Change the official location of Zeppelin
Realized I used an older Ubuntu 12 vm box file in Vagrant script.
Should be Ubuntu 14.04
Author: Jeff Steinmetz <jeffrey.steinmetz@gmail.com>
Closes#567 from jeffsteinmetz/vagrant-vm and squashes the following commits:
3b81445 [Jeff Steinmetz] use ubuntu/trusty64 Official Ubuntu Server 14.04 LTS (Trusty Tahr) build
fbaf2bd [Jeff Steinmetz] use ubuntu/trusty64 Official Ubuntu Server 14.04 LTS (Trusty Tahr) build
This script creates a virtual machine that launches a repeatable, known set of core dependencies required for developing Zeppelin. It can also be used to run an existing Zeppelin build if you don't plan to build from source. For pyspark users, this script also includes several helpful Python Libraries and one obscure configuration to help with matplotlib plotting inside Zeppelin.
The virtual machine consists of:
- Ubuntu Server 14.04 LTS
- Node.js 0.12.7
- npm 2.11.3
- ruby 1.9.3 + bundler, rake, make (only required for building jekyll documentation)
- Maven 3.3.3
- Git
- Unzip
- libfontconfig to avoid phatomJs missing dependency issues
- openjdk-7-jdk
- Python addons: pip, matplotlib, scipy, numpy, pandas
- Changes are made to the python backend configuration so that pyspark can render matplotlib plots without an interactive window
Author: Jeff Steinmetz <jeffrey.steinmetz@gmail.com>
Closes#460 from jeffsteinmetz/master and squashes the following commits:
cfb1034 [Jeff Steinmetz] add ruby 1.9.3 install + bundler, make and rake for jekyll doc support. Add vagrant port 4000 forwarding for jekyll documentation build watcher
9a78355 [Jeff Steinmetz] remove apache python script from commit
97a5819 [Jeff Steinmetz] remove apache python script. remove nodesource and use official node.js distribution download
0b169a6 [Jeff Steinmetz] remove license from apache-mirror-selector.py. Simplify node install
a86c55f [Jeff Steinmetz] typo fixed. licenses in supporting readme and apache mirror python script
3ec6a6b [Jeff Steinmetz] add virtual machine to docs
4b70e63 [Jeff Steinmetz] remove reference to python backend config in readme.
5c31125 [Jeff Steinmetz] add apache-mirror-selector to ansible playbook
11fdc0d [Jeff Steinmetz] removed matplotlib global Agg config. Updated vagrant virtual box settings with hostname and vm name. upated python example to set Agg
afc26a4 [Jeff Steinmetz] roll back to original top level README.md
de07f00 [Jeff Steinmetz] update readme based on comments. Add license
853ddca [Jeff Steinmetz] vagrant virtual machine and readme
ff8078a [Jeff Steinmetz] vagrant virtual machine and readme
fb31785 [Jeff Steinmetz] initial commit of vagrant virtual machine script
5888360 [Jeff Steinmetz] merge upstream
1eb27eb [Jeff Steinmetz] expanded build instructions to include pyspark, and clarified maven and node.js requirements
