zeppelin/docs
mahmoudelgamal 403c8c4e79 [ZEPPELIN-682] New interpreter for Apache Beam (incubating)/DataFlow
## What is this PR for?
The PR is a interpreter for [Apache Beam](http://beam.incubator.apache.org) which is an open source unified platform for data processing pipelines. A pipeline can be build using one of the Beam SDKs.
The execution of the pipeline is done by different Runners . Currently, Beam supports Apache Flink Runner, Apache Spark Runner, and Google Dataflow Runner.

### What type of PR is it?
- Feature

### Todos
* Test case
* Review Comments
* Documentation

### What is the Jira issue?
* [ZEPPELIN-682]

### How should this be tested?
- Start the Zeppelin server
- The prefix of interpreter is `%beam` and then write your code with required imports and the runner

### Screenshots (if appropriate)
![](https://s9.postimg.org/s6eiwrbxb/beam_interpreter.png)
![](https://s9.postimg.org/eq3h8wsrz/visualisation_with_table.png)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes

Author: mahmoudelgamal <mahmoudf.elgamal@gmail.com>
Author: mfelgamal <mahmoudf.elgamal@gmail.com>
Author: Fouad <fuad.assayadi@gmail.com>

Closes #1334 from mfelgamal/beam-interpreter-static-repl-7 and squashes the following commits:

da66c27 [mahmoudelgamal] Modify condition of checking static modifier
55c1322 [mahmoudelgamal] set spark version to 1.6.2 and throw original exception
27d7690 [mahmoudelgamal] set spark version to 1.6.1 and some modifications
750041c [mahmoudelgamal] Add readme file and modify pom file and travis.yml
ca88f94 [mahmoudelgamal] edit pom file and .travis.yml
3d65427 [mahmoudelgamal] update .travis.yml file
f19f98d [mahmoudelgamal] Make easy example with imports ands some modifications
74c14ca [mahmoudelgamal] Update the licenses
acc7afb [mahmoudelgamal] Change beam to version 0.2.0
e821614 [mahmoudelgamal] Removing hadoop-core and print stack trace to failure
5cb7c7b [mahmoudelgamal] Add some changes to doc and pom file
75fc4f7 [mahmoudelgamal] add interpreter to navigation.html and remove extra spaces and lines
9b1b385 [mahmoudelgamal] put beam in alphabetical order
9c1e25d [mahmoudelgamal] Adding changes like logging and conventions and license
2aa6d65 [mahmoudelgamal] changing class name to StaticRepl and adding some modifications
7cf25fb [mahmoudelgamal] Adding some tests
3c5038f [mahmoudelgamal] Modifying the documentation
5695077 [mahmoudelgamal] Modifying pom file and Making documentation
26fc59b [mahmoudelgamal] Refactoring of the code
3a2bd85 [mahmoudelgamal] Adding the beam to zeppelin 7
ab7ee2d [mahmoudelgamal] beam interpreter
85957ff [mfelgamal] Merge pull request #10 from apache/master
852c3d3 [mfelgamal] Merge pull request #9 from apache/master
a4bcc0d [mfelgamal] Merge pull request #8 from apache/master
858f1e1 [mfelgamal] Merge pull request #7 from apache/master
03a1e80 [mfelgamal] Merge pull request #4 from apache/master
2586651 [Fouad] Merge pull request #2 from apache/master
2016-09-26 20:11:42 -07:00
..
_includes [ZEPPELIN-682] New interpreter for Apache Beam (incubating)/DataFlow 2016-09-26 20:11:42 -07:00
_layouts ZEPPELIN-279: move website w/ docs to master branch 2015-09-05 19:48:22 +09:00
_plugins ZEPPELIN-279: move website w/ docs to master branch 2015-09-05 19:48:22 +09:00
assets/themes/zeppelin [ZEPPELIN-1387] Support table syntax in markdown interpreter 2016-09-22 09:52:31 +09:00
development [ZEPPELIN-1026] set syntax highlight based on default bound interpreter 2016-09-23 16:47:26 +09:00
displaysystem [ZEPPELIN-1219] Add searching feature to Zeppelin docs site 2016-08-10 12:39:22 +09:00
install [Hot Fix] Add a newline for bullet list markdown rendering 2016-09-25 19:10:14 +09:00
interpreter [ZEPPELIN-682] New interpreter for Apache Beam (incubating)/DataFlow 2016-09-26 20:11:42 -07:00
manual [ZEPPELIN-1421] Fix dead link in docs/README.md 2016-09-19 15:50:43 +09:00
quickstart [ZEPPELIN-1219] Add searching feature to Zeppelin docs site 2016-08-10 12:39:22 +09:00
rest-api [ZEPPELIN-699] Add new synchronous paragraph run REST API 2016-08-31 23:56:39 -07:00
security [ZEPPELIN-530] Added changes for Credential Provider, using hadoop commons Credential apis 2016-08-25 14:47:59 +05:30
storage [ZEPPELIN-1219] Add searching feature to Zeppelin docs site 2016-08-10 12:39:22 +09:00
404.html ZEPPELIN-279: move website w/ docs to master branch 2015-09-05 19:48:22 +09:00
_config.yml Bump up version to 0.7.0-SNAPSHOT 2016-07-06 04:45:48 +09:00
atom.xml Fix typos in docs 2016-04-24 18:32:44 +09:00
Gemfile Apply #407 into master branch 2015-11-13 21:12:36 +09:00
Gemfile.lock [ZEPPELIN-813] Update safe_yaml version 0.9.7 -> 1.0.4 2016-07-21 11:01:44 +09:00
index.md [ZEPPELIN-1414] Remove CONTRIBUTING.md files 2016-09-09 08:04:10 +09:00
pleasecontribute.md [ZEPPELIN-1219] Add searching feature to Zeppelin docs site 2016-08-10 12:39:22 +09:00
Rakefile ZEPPELIN-279: move website w/ docs to master branch 2015-09-05 19:48:22 +09:00
README.md [ZEPPELIN-1421] Fix dead link in docs/README.md 2016-09-19 15:50:43 +09:00
robot.txt Apply #407 into master branch 2015-11-13 21:12:36 +09:00
rss.xml ZEPPELIN-279: move website w/ docs to master branch 2015-09-05 19:48:22 +09:00
screenshots.md [ZEPPELIN-1398] Use relative path for search_data.json 2016-09-06 18:22:57 +09:00
search.md [ZEPPELIN-1219] Add searching feature to Zeppelin docs site 2016-08-10 12:39:22 +09:00
search_data.json [ZEPPELIN-1219] Add searching feature to Zeppelin docs site 2016-08-10 12:39:22 +09:00
sitemap.txt Fix typos in docs 2016-04-24 18:32:44 +09:00

Apache Zeppelin documentation

This README will walk you through building the documentation of Apache Zeppelin. The documentation is included here with Apache Zeppelin source code. The online documentation at https://zeppelin.apache.org/docs/<ZEPPELIN_VERSION> is also generated from the files found in here.

Build documentation

Zeppelin is using Jekyll which is a static site generator and Github Pages as a site publisher. For the more details, see help.github.com/articles/about-github-pages-and-jekyll/.

Requirements

# ruby --version >= 2.0.0
# Install Bundler using gem
gem install bundler

cd $ZEPPELIN_HOME/docs
# Install all dependencies declared in the Gemfile
bundle install

For the further information about requirements, please see here.

On OS X 10.9, you may need to do

xcode-select --install

Run website locally

If you don't want to encounter uglily rendered pages, run the documentation site in your local first.

In $ZEPPELIN_HOME/docs,

bundle exec jekyll serve --watch

Using the above command, Jekyll will start a web server at http://localhost:4000 and watch the /docs directory to update.

Contribute to Zeppelin documentation

If you wish to help us and contribute to Zeppelin Documentation, please look at Zeppelin Documentation's contribution guideline.

For committers only

Bumping up version in a new release

  • ZEPPELIN_VERSION and BASE_PATH property in _config.yml

Deploy to ASF svnpubsub infra

  1. generate static website in ./_site

    # go to /docs under Zeppelin source
    bundle exec jekyll build --safe
    
  2. checkout ASF repo

    svn co https://svn.apache.org/repos/asf/zeppelin asf-zeppelin
    
  3. copy zeppelin/docs/_site to asf-zeppelin/site/docs/[VERSION]

  4. svn commit