zeppelin/zeppelin-examples/zeppelin-example-clock/zeppelin-example-clock.json

27 lines
1.2 KiB
JSON
Raw Normal View History

[ZEPPELIN-732] Helium Application ### What is this PR for? This PR implements pluggable Application Framework. Here's summary of the change. **Applicaiton** Base class of user application. User application should extends `org.apache.zeppelin.helium.Application`. It looks like ```java public abstract class Application { /** * When application loaded * params context Application context */ public Application(ApplicationContext context) { this.context = context; } /** * This method can be invoked multiple times before unload(), * Invoked just after application loaded or when paragraph output is updated * param args Required resources from paragraph */ public abstract void run(ResourceSet args) throws ApplicationException, IOException; /** * this method is invoked just before application is removed */ public abstract void unload() throws ApplicationException; } ``` **HeliumPackage** `org.apache.zeppelin.helium.HeliumPackage` keeps information of application package. Package informations includes ``` { type : "APPLICATION", // type of this package name : "zeppelin.app", // application name. [organizationName].[appName] format description : "App description", // description artifact : "groupId:artifactId:version", // artifact name for maven repository className : "org.apache.zeppelin.helium.MyApp", // application class that extends org.apache.zeppelin.helium.Application resources : [[]], // required resource icon : '<i class="fa fa-clock-o"></i>' // icon } ``` `resources` field defines what kind of data this application requires, from ResourcePool. "resourceName" and ":className" works in the array. inner array combines each resourceName, :className with 'AND' outer array combines inner array with 'OR'. For example, ``` resources : [ [ "name1", ":java.util.Date"], [ "name1", "name2"] ] ``` Then Zeppelin searches ResourcePool, first for resource name "name1" and resource type "java.util.Date" from resourcePool then resource name "name1" and "name2". Once resources are found, they'll be passed to `Application.run()` method **Package Registry** `org.apache.zeppelin.helium.HeliumRegistry` provides list of available HeliumPackages. Currently `HeliumLocalRegistry` is implemented and it provides list by reading HeliumPackage json files under ./helium directory in the file system. Later there will be some class like `HeliumOnlineRegistry' which reads available package from a community managed online central registry. **Development mode** `org.apache.zeppelin.interpreter.dev.*` package is provided for development support. Developer can run their app inside of their IDE, that connects to running Zeppelin instance and display output. **Application Suggestion** Once paragraph becomes FINISHED status after run, Zeppelin searches resources from ResourcesPool that belongs to current paragraph. And compare all HeliumPackage if these resources satisfies their requirements ('resources' field). If there're available app, Helium button will be displayed. ![image](https://cloud.githubusercontent.com/assets/1540981/14518452/d8f85d5a-020f-11e6-8313-00b37eb4f077.png) User can see and select available application for this paragraph. ![image](https://cloud.githubusercontent.com/assets/1540981/14518465/ee607fce-020f-11e6-8ad4-fe98723c7c94.png) **Application selection** After application is loaded, application icon will be displayed. So user can select and switch between apps. ![image](https://cloud.githubusercontent.com/assets/1540981/14518547/6f3fd766-0210-11e6-9a08-0dc2ba6d15e3.png) if built-in visualization is available, application icon will be displayed next to built-in visualizations ![image](https://cloud.githubusercontent.com/assets/1540981/14518500/27505746-0210-11e6-9738-fb514376b906.png) **Experimental** While this is new feature and API and specification may change, i'd suggest mark this feature as a experimental for a while. ### What type of PR is it? Feature ### Todos * [x] - Helium Application framework * [x] - App launcher * [x] - App display and selectors * [x] - Package registry * [x] - Development mode * [x] - Make CI green * [x] - Improve comment in source codes * [x] - Documentation * [x] - Examples * [x] - Mark experimental * [ ] - Review ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-732 ### How should this be tested? Will be updated with examples ### Screenshots (if appropriate) ![helium](https://cloud.githubusercontent.com/assets/1540981/14518685/49c2a788-0211-11e6-81c8-6cae48bf8a48.gif) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Lee moon soo <moon@apache.org> Closes #836 from Leemoonsoo/ZEPPELIN-732-up and squashes the following commits: 3577777 [Lee moon soo] Address Ahyoung's comment 0665380 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 83b529c [Lee moon soo] Update unittest e1b0e79 [Lee moon soo] Update unittest 6785441 [Lee moon soo] interpreter order changed 3249ddb [Lee moon soo] Remove incubating 4030fff [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 4e98cfe [Lee moon soo] Update DependencyResolver c714a19 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up d558591 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 0467077 [Lee moon soo] update test d43ab57 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up f999f71 [Lee moon soo] Update getParagraphXpath eaa68c6 [Lee moon soo] print processes 5b5f6c8 [Lee moon soo] trigger ci 1bdea70 [Lee moon soo] Print error message in the test 562f083 [Lee moon soo] CLose interpreter after test 385dab3 [Lee moon soo] Fix xpath in the SparkParagraphIt test ac963ff [Lee moon soo] Remove unnecessary stacktrace and provide more meaningful message 644add4 [Lee moon soo] Takecare csv/tsv download button position after merge 6a5a19e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 5bef173 [Lee moon soo] Update NoteTest e54d633 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 88dbc71 [Lee moon soo] change style 6f1343f [Lee moon soo] add license header 4571781 [Lee moon soo] double quote the keys in json 710487b [Lee moon soo] fix syntax error 6c5019e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 3619afd [Lee moon soo] Exclude test data file from rat check b6811a6 [Lee moon soo] set SPARK_HOME to find bin/interpreter.sh 9110897 [Lee moon soo] arrange buttons 14efb6c [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 76de11c [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up bff2217 [Lee moon soo] Fix SparkParagraphIT e60cd8e [Lee moon soo] Add docs 7f174e3 [Lee moon soo] Add more comments 0671dfd [Lee moon soo] Fix compile error bfcdf34 [Lee moon soo] Fix style 1dc4409 [Lee moon soo] Remove incubating from example pom.xml e36d2fb [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up e0a2046 [Lee moon soo] Add annotation to api 93fa766 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 99dd0b0 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up e89177e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up f782fb0 [Lee moon soo] clean pom.xml file b974eb1 [Lee moon soo] Add horizontal bar visualization example 5225551 [Lee moon soo] let instead of var b068065 [Lee moon soo] Replace . to _ b6e4141 [Lee moon soo] helper for printing javascript and inject $z 8186daf [Lee moon soo] Update Application Status from RemoteInterpreterProcess event f07ada1 [Lee moon soo] Construct classpath correctly 7451479 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up ab1de03 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 51fc113 [Lee moon soo] Include examples in CI build 83eba98 [Lee moon soo] UnloadApp on interpreter restart 3b891de [Lee moon soo] Provide resource pool for testing 0730ece [Lee moon soo] Add license into package json 620f79f [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 01a1646 [Lee moon soo] Add example 1f1a3b5 [Lee moon soo] Fix test 864bea1 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up c30f53c [Lee moon soo] null check 03be3a1 [Lee moon soo] Pass required resource to run() method fade3c1 [Lee moon soo] Handle output update in angular mode 0e4d81c [Lee moon soo] Remove unnecessary log ec2fdea [Lee moon soo] Match classname correctly b4ff52f [Lee moon soo] Put last value of scala repl into resource pool f2ab95d [Lee moon soo] Prevent unnecessary output update 71f814d [Lee moon soo] Better way to find resource dir for InterpreterOutput watcher 024d7fc [Lee moon soo] Dev mode 98f3872 [Lee moon soo] Managed interpreter process and Running interpreter process b47ca74 [Lee moon soo] Fix tests 5503f9c [Lee moon soo] Improved be3a1fa [Lee moon soo] Add license header 412480a [Lee moon soo] Fix style 16f6887 [Lee moon soo] Angular object update for helium app 6223cd4 [Lee moon soo] App output display bd0f467 [Lee moon soo] Style 94b490d [Lee moon soo] initial rest api impl 134bbe6 [Lee moon soo] Change HeliumRegistry constructor argument type 7aeb64a [Lee moon soo] Unload app on paragraph / note removal as well as interpreter unbind 4eaeea7 [Lee moon soo] sync -> async api 9f5c493 [Lee moon soo] Application output b239f1b [Lee moon soo] Helium application factory b891b98 [Lee moon soo] HeliumRegistry 568ee54 [Lee moon soo] ApplicationLoader 7424af2 [Lee moon soo] Remove resource on note / paragraph removal
2016-07-03 14:58:25 +00:00
/*
* Licensed to the Apache Software Foundation (ASF) under one or more
* contributor license agreements. See the NOTICE file distributed with
* this work for additional information regarding copyright ownership.
* The ASF licenses this file to You under the Apache License, Version 2.0
* (the "License"); you may not use this file except in compliance with
* the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
{
"type" : "APPLICATION",
"name" : "zeppelin.clock",
"description" : "Clock (example)",
"artifact" : "zeppelin-examples/zeppelin-example-clock/target/zeppelin-example-clock-0.8.0-SNAPSHOT.jar",
[ZEPPELIN-732] Helium Application ### What is this PR for? This PR implements pluggable Application Framework. Here's summary of the change. **Applicaiton** Base class of user application. User application should extends `org.apache.zeppelin.helium.Application`. It looks like ```java public abstract class Application { /** * When application loaded * params context Application context */ public Application(ApplicationContext context) { this.context = context; } /** * This method can be invoked multiple times before unload(), * Invoked just after application loaded or when paragraph output is updated * param args Required resources from paragraph */ public abstract void run(ResourceSet args) throws ApplicationException, IOException; /** * this method is invoked just before application is removed */ public abstract void unload() throws ApplicationException; } ``` **HeliumPackage** `org.apache.zeppelin.helium.HeliumPackage` keeps information of application package. Package informations includes ``` { type : "APPLICATION", // type of this package name : "zeppelin.app", // application name. [organizationName].[appName] format description : "App description", // description artifact : "groupId:artifactId:version", // artifact name for maven repository className : "org.apache.zeppelin.helium.MyApp", // application class that extends org.apache.zeppelin.helium.Application resources : [[]], // required resource icon : '<i class="fa fa-clock-o"></i>' // icon } ``` `resources` field defines what kind of data this application requires, from ResourcePool. "resourceName" and ":className" works in the array. inner array combines each resourceName, :className with 'AND' outer array combines inner array with 'OR'. For example, ``` resources : [ [ "name1", ":java.util.Date"], [ "name1", "name2"] ] ``` Then Zeppelin searches ResourcePool, first for resource name "name1" and resource type "java.util.Date" from resourcePool then resource name "name1" and "name2". Once resources are found, they'll be passed to `Application.run()` method **Package Registry** `org.apache.zeppelin.helium.HeliumRegistry` provides list of available HeliumPackages. Currently `HeliumLocalRegistry` is implemented and it provides list by reading HeliumPackage json files under ./helium directory in the file system. Later there will be some class like `HeliumOnlineRegistry' which reads available package from a community managed online central registry. **Development mode** `org.apache.zeppelin.interpreter.dev.*` package is provided for development support. Developer can run their app inside of their IDE, that connects to running Zeppelin instance and display output. **Application Suggestion** Once paragraph becomes FINISHED status after run, Zeppelin searches resources from ResourcesPool that belongs to current paragraph. And compare all HeliumPackage if these resources satisfies their requirements ('resources' field). If there're available app, Helium button will be displayed. ![image](https://cloud.githubusercontent.com/assets/1540981/14518452/d8f85d5a-020f-11e6-8313-00b37eb4f077.png) User can see and select available application for this paragraph. ![image](https://cloud.githubusercontent.com/assets/1540981/14518465/ee607fce-020f-11e6-8ad4-fe98723c7c94.png) **Application selection** After application is loaded, application icon will be displayed. So user can select and switch between apps. ![image](https://cloud.githubusercontent.com/assets/1540981/14518547/6f3fd766-0210-11e6-9a08-0dc2ba6d15e3.png) if built-in visualization is available, application icon will be displayed next to built-in visualizations ![image](https://cloud.githubusercontent.com/assets/1540981/14518500/27505746-0210-11e6-9738-fb514376b906.png) **Experimental** While this is new feature and API and specification may change, i'd suggest mark this feature as a experimental for a while. ### What type of PR is it? Feature ### Todos * [x] - Helium Application framework * [x] - App launcher * [x] - App display and selectors * [x] - Package registry * [x] - Development mode * [x] - Make CI green * [x] - Improve comment in source codes * [x] - Documentation * [x] - Examples * [x] - Mark experimental * [ ] - Review ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-732 ### How should this be tested? Will be updated with examples ### Screenshots (if appropriate) ![helium](https://cloud.githubusercontent.com/assets/1540981/14518685/49c2a788-0211-11e6-81c8-6cae48bf8a48.gif) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Lee moon soo <moon@apache.org> Closes #836 from Leemoonsoo/ZEPPELIN-732-up and squashes the following commits: 3577777 [Lee moon soo] Address Ahyoung's comment 0665380 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 83b529c [Lee moon soo] Update unittest e1b0e79 [Lee moon soo] Update unittest 6785441 [Lee moon soo] interpreter order changed 3249ddb [Lee moon soo] Remove incubating 4030fff [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 4e98cfe [Lee moon soo] Update DependencyResolver c714a19 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up d558591 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 0467077 [Lee moon soo] update test d43ab57 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up f999f71 [Lee moon soo] Update getParagraphXpath eaa68c6 [Lee moon soo] print processes 5b5f6c8 [Lee moon soo] trigger ci 1bdea70 [Lee moon soo] Print error message in the test 562f083 [Lee moon soo] CLose interpreter after test 385dab3 [Lee moon soo] Fix xpath in the SparkParagraphIt test ac963ff [Lee moon soo] Remove unnecessary stacktrace and provide more meaningful message 644add4 [Lee moon soo] Takecare csv/tsv download button position after merge 6a5a19e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 5bef173 [Lee moon soo] Update NoteTest e54d633 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 88dbc71 [Lee moon soo] change style 6f1343f [Lee moon soo] add license header 4571781 [Lee moon soo] double quote the keys in json 710487b [Lee moon soo] fix syntax error 6c5019e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 3619afd [Lee moon soo] Exclude test data file from rat check b6811a6 [Lee moon soo] set SPARK_HOME to find bin/interpreter.sh 9110897 [Lee moon soo] arrange buttons 14efb6c [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 76de11c [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up bff2217 [Lee moon soo] Fix SparkParagraphIT e60cd8e [Lee moon soo] Add docs 7f174e3 [Lee moon soo] Add more comments 0671dfd [Lee moon soo] Fix compile error bfcdf34 [Lee moon soo] Fix style 1dc4409 [Lee moon soo] Remove incubating from example pom.xml e36d2fb [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up e0a2046 [Lee moon soo] Add annotation to api 93fa766 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 99dd0b0 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up e89177e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up f782fb0 [Lee moon soo] clean pom.xml file b974eb1 [Lee moon soo] Add horizontal bar visualization example 5225551 [Lee moon soo] let instead of var b068065 [Lee moon soo] Replace . to _ b6e4141 [Lee moon soo] helper for printing javascript and inject $z 8186daf [Lee moon soo] Update Application Status from RemoteInterpreterProcess event f07ada1 [Lee moon soo] Construct classpath correctly 7451479 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up ab1de03 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 51fc113 [Lee moon soo] Include examples in CI build 83eba98 [Lee moon soo] UnloadApp on interpreter restart 3b891de [Lee moon soo] Provide resource pool for testing 0730ece [Lee moon soo] Add license into package json 620f79f [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 01a1646 [Lee moon soo] Add example 1f1a3b5 [Lee moon soo] Fix test 864bea1 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up c30f53c [Lee moon soo] null check 03be3a1 [Lee moon soo] Pass required resource to run() method fade3c1 [Lee moon soo] Handle output update in angular mode 0e4d81c [Lee moon soo] Remove unnecessary log ec2fdea [Lee moon soo] Match classname correctly b4ff52f [Lee moon soo] Put last value of scala repl into resource pool f2ab95d [Lee moon soo] Prevent unnecessary output update 71f814d [Lee moon soo] Better way to find resource dir for InterpreterOutput watcher 024d7fc [Lee moon soo] Dev mode 98f3872 [Lee moon soo] Managed interpreter process and Running interpreter process b47ca74 [Lee moon soo] Fix tests 5503f9c [Lee moon soo] Improved be3a1fa [Lee moon soo] Add license header 412480a [Lee moon soo] Fix style 16f6887 [Lee moon soo] Angular object update for helium app 6223cd4 [Lee moon soo] App output display bd0f467 [Lee moon soo] Style 94b490d [Lee moon soo] initial rest api impl 134bbe6 [Lee moon soo] Change HeliumRegistry constructor argument type 7aeb64a [Lee moon soo] Unload app on paragraph / note removal as well as interpreter unbind 4eaeea7 [Lee moon soo] sync -> async api 9f5c493 [Lee moon soo] Application output b239f1b [Lee moon soo] Helium application factory b891b98 [Lee moon soo] HeliumRegistry 568ee54 [Lee moon soo] ApplicationLoader 7424af2 [Lee moon soo] Remove resource on note / paragraph removal
2016-07-03 14:58:25 +00:00
"className" : "org.apache.zeppelin.example.app.clock.Clock",
"resources" : [[":java.util.Date"]],
[ZEPPELIN-1619] Load js package as a plugin visualization ### What is this PR for? Current helium plugin application api (experimental) requires create library in java class, and need to create both backend / frontend code in the package. Which is good if your plugin requires both frontend and backend code running. However, when user just want to make new visualization which completely runs on front-end side in javascript, creating helium application in java project and taking care of backend code can be bit of overhead and barrier for javascript developers. This PR adds capability to load pure javascript package as a visualization. ### how it works 1. create (copy, download) 'helium package json' file into `ZEPPELIN_HOME/helium` directory. The json file point visualization js package in npm repository or local file system in `artifact` field. `type` field in the json file need to be `VISUALIZATION` Here's an example (zeppelin-examples/zeppelin-example-horizontalbar/zeppelin-example-horizontalbar.json) ``` { "type" : "VISUALIZATION", "name" : "zeppelin_horizontalbar", "description" : "Horizontal Bar chart (example)", "artifact" : "./zeppelin-examples/zeppelin-example-horizontalbar", "icon" : "<i class='fa fa-bar-chart rotate90flipX'></i>" } ``` 2. Go to helium GUI menu. (e.g. http://localhost:8080/#/helium). The menu will list all available packages. <img width="796" alt="writing_visualization_helium_menu" src="https://cloud.githubusercontent.com/assets/1540981/21749660/0f401c10-d558-11e6-9961-b6d0a9c023d8.png"> 3. click 'enable' in any package want to use. Once a visualization package is enabled, `HeliumVisualizationFactory` will collect all enabled visualizations and create js bundle on the fly. 4. js bundle will be loaded on notebook and additional visualization becomes available ![image](https://cloud.githubusercontent.com/assets/1540981/21749729/709b2b3e-d559-11e6-8318-7f2871e7c39a.png) ### Programming API to create new plugin visualization. Simply extends [visualization.js](https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/visualization/visualization.js) and overrides some methods, such as ``` /** * get transformation */ getTransformation() { // override this }; /** * Method will be invoked when data or configuration changed */ render(tableData) { // override this }; /** * Refresh visualization. */ refresh() { // override this }; /** * method will be invoked when visualization need to be destroyed. * Don't need to destroy this.targetEl. */ destroy() { // override this }; /** * return { * template : angular template string or url (url should end with .html), * scope : an object to bind to template scope * } */ getSetting() { // override this }; ``` This is exactly the same api that built-in visualization uses. an example implementation included `zeppelin-examples/zeppelin-example-horizontalbar/horizontalbar.js`. Actually [all built-in visualizations](https://github.com/apache/zeppelin/tree/master/zeppelin-web/src/app/visualization/builtins) are example ### Packaging and publishing visualization Each visualization will need `package.json` file (e.g. `zeppelin-examples/zeppelin-example-horizontalbar/package.json`) to be packaged. Package can be published in npm repository or package can be deployed to the local filesystem. `zeppelin-examples/zeppelin-example-horizontalbar/` is an example package that is deployed in the local filesystem ### Development mode First, locally install and enable your development package by setting `artifact` field to the development directory. Then run zeppelin-web in visualization development mode with following command ``` cd zeppelin-web npm run visdev ``` When you have change in your local development package, just reload your notebook. Then Zeppelin will automatically rebuild / reload the package. Any feedback would be appreciated! ### What type of PR is it? Feature ### Todos * [x] - Load plugin visualization js package on runtime * [x] - Make the feature works in zeppelin Binary package * [x] - Show loading indicator while 'enable' / 'disable' package * [x] - Add document * [x] - Add license of new dependency * [x] - Development mode * [x] - Propagate error to front-end * [x] - Display multiple versions of a package. ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1619 ### How should this be tested? Build Zeppelin with `-Pexamples` flag. That'll install example visualization package `horizontalbar`. You'll able to select `horizontalbar` along with other built-in visualizations ![image](https://cloud.githubusercontent.com/assets/1540981/21655057/27d61740-d26d-11e6-88f2-02c653e102c6.png) To test npm online package install capability, Place [zeppelin-bubble.json](https://github.com/Leemoonsoo/zeppelin-bubble/blob/master/zeppelin-bubble.json) in hour local registry (`ZEPPELIN_HOME/helium`) and enable it in Helium gui menu. And then zeppelin will download package from npm repository and load. ![bubblechart](https://cloud.githubusercontent.com/assets/1540981/21749717/280aa430-d559-11e6-9209-889a4f86d7e2.gif) ### Questions: * Does the licenses files need update? yes * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Lee moon soo <moon@apache.org> Closes #1842 from Leemoonsoo/ZEPPELIN-1619-rebased and squashes the following commits: 7c49bbb [Lee moon soo] Let Zeppelin continue to bootstrap on offline 816bdec [Lee moon soo] Display license of package when enabling 28fb37d [Lee moon soo] beautifulize helium menu 295768e [Lee moon soo] fix drag and drop visualization reorder bb304db [Lee moon soo] Sort version in decreasing order e7f18f1 [Lee moon soo] fix english in docs and labels c7b187f [Lee moon soo] Merge branch 'master' into ZEPPELIN-1619-rebased 4c87983 [Lee moon soo] Merge remote-tracking branch 'apache-github/master' into ZEPPELIN-1619-rebased ecd925b [Lee moon soo] Merge remote-tracking branch 'apache-github/master' into ZEPPELIN-1619-rebased a92cadd [Lee moon soo] Use minifiable syntax cec534c [Lee moon soo] Reduce log message f373f1d [Lee moon soo] Ignore removed package e18d9a4 [Lee moon soo] Ability to customize order of visualization package display cd74396 [Lee moon soo] Add rest api doc 9de5d6d [Lee moon soo] exclude .npmignore and package.json from zeppelin-web rat check 08abded [Lee moon soo] exclude package.json from rat check 661c26b [Lee moon soo] update screenshot and keep experimental tag only in docs 4515805 [Lee moon soo] Display multiple versions of a package 408c512 [Lee moon soo] Make unittest test bundling with proper vis package on npm registry fb7a147 [Lee moon soo] display svg icon 47de6d9 [Lee moon soo] Propagate bundle error to the front-end 0fe5e00 [Lee moon soo] visualization development mode 022e8f6 [Lee moon soo] exclude zeppelin-examples/zeppelin-example-horizontalbar/package.json file from rat check 2ef3b69 [Lee moon soo] Add new dependency license f943d33 [Lee moon soo] Add doc f494dbd [Lee moon soo] package npm dependency module in binary package b655fa6 [Lee moon soo] use any version of dependency in example. so zeppelin version bumpup doesn't need to take care of them 2aec52d [Lee moon soo] show loading indicator while enable/disable package 6c380f6 [Lee moon soo] refactor code to fix HeliumTest e142336 [Lee moon soo] update unittest 7d5e0ae [Lee moon soo] Resolve dependency conflict c50a524 [Lee moon soo] Add conf/helium.json in .gitignore 1c7b73a [Lee moon soo] add result.css d2823ad [Lee moon soo] load visualization and tabledata module from source instead npm if accessible 4e1b061 [Lee moon soo] Convert horizontalbar to VISUALIZATION example a5a935b [Lee moon soo] connect visualization factory with restapi 4b21252 [Lee moon soo] initial implementation of helium menu 0c4da2e [Lee moon soo] pass bundled visualization to result.controller.js f5ce99e [Lee moon soo] import helium service js 1663582 [Lee moon soo] initial implementation of helium menu 74d52d4 [Lee moon soo] bundle visualization package from npm repository on the fly
2017-01-12 18:58:06 +00:00
"license" : "Apache-2.0",
[ZEPPELIN-732] Helium Application ### What is this PR for? This PR implements pluggable Application Framework. Here's summary of the change. **Applicaiton** Base class of user application. User application should extends `org.apache.zeppelin.helium.Application`. It looks like ```java public abstract class Application { /** * When application loaded * params context Application context */ public Application(ApplicationContext context) { this.context = context; } /** * This method can be invoked multiple times before unload(), * Invoked just after application loaded or when paragraph output is updated * param args Required resources from paragraph */ public abstract void run(ResourceSet args) throws ApplicationException, IOException; /** * this method is invoked just before application is removed */ public abstract void unload() throws ApplicationException; } ``` **HeliumPackage** `org.apache.zeppelin.helium.HeliumPackage` keeps information of application package. Package informations includes ``` { type : "APPLICATION", // type of this package name : "zeppelin.app", // application name. [organizationName].[appName] format description : "App description", // description artifact : "groupId:artifactId:version", // artifact name for maven repository className : "org.apache.zeppelin.helium.MyApp", // application class that extends org.apache.zeppelin.helium.Application resources : [[]], // required resource icon : '<i class="fa fa-clock-o"></i>' // icon } ``` `resources` field defines what kind of data this application requires, from ResourcePool. "resourceName" and ":className" works in the array. inner array combines each resourceName, :className with 'AND' outer array combines inner array with 'OR'. For example, ``` resources : [ [ "name1", ":java.util.Date"], [ "name1", "name2"] ] ``` Then Zeppelin searches ResourcePool, first for resource name "name1" and resource type "java.util.Date" from resourcePool then resource name "name1" and "name2". Once resources are found, they'll be passed to `Application.run()` method **Package Registry** `org.apache.zeppelin.helium.HeliumRegistry` provides list of available HeliumPackages. Currently `HeliumLocalRegistry` is implemented and it provides list by reading HeliumPackage json files under ./helium directory in the file system. Later there will be some class like `HeliumOnlineRegistry' which reads available package from a community managed online central registry. **Development mode** `org.apache.zeppelin.interpreter.dev.*` package is provided for development support. Developer can run their app inside of their IDE, that connects to running Zeppelin instance and display output. **Application Suggestion** Once paragraph becomes FINISHED status after run, Zeppelin searches resources from ResourcesPool that belongs to current paragraph. And compare all HeliumPackage if these resources satisfies their requirements ('resources' field). If there're available app, Helium button will be displayed. ![image](https://cloud.githubusercontent.com/assets/1540981/14518452/d8f85d5a-020f-11e6-8313-00b37eb4f077.png) User can see and select available application for this paragraph. ![image](https://cloud.githubusercontent.com/assets/1540981/14518465/ee607fce-020f-11e6-8ad4-fe98723c7c94.png) **Application selection** After application is loaded, application icon will be displayed. So user can select and switch between apps. ![image](https://cloud.githubusercontent.com/assets/1540981/14518547/6f3fd766-0210-11e6-9a08-0dc2ba6d15e3.png) if built-in visualization is available, application icon will be displayed next to built-in visualizations ![image](https://cloud.githubusercontent.com/assets/1540981/14518500/27505746-0210-11e6-9738-fb514376b906.png) **Experimental** While this is new feature and API and specification may change, i'd suggest mark this feature as a experimental for a while. ### What type of PR is it? Feature ### Todos * [x] - Helium Application framework * [x] - App launcher * [x] - App display and selectors * [x] - Package registry * [x] - Development mode * [x] - Make CI green * [x] - Improve comment in source codes * [x] - Documentation * [x] - Examples * [x] - Mark experimental * [ ] - Review ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-732 ### How should this be tested? Will be updated with examples ### Screenshots (if appropriate) ![helium](https://cloud.githubusercontent.com/assets/1540981/14518685/49c2a788-0211-11e6-81c8-6cae48bf8a48.gif) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Lee moon soo <moon@apache.org> Closes #836 from Leemoonsoo/ZEPPELIN-732-up and squashes the following commits: 3577777 [Lee moon soo] Address Ahyoung's comment 0665380 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 83b529c [Lee moon soo] Update unittest e1b0e79 [Lee moon soo] Update unittest 6785441 [Lee moon soo] interpreter order changed 3249ddb [Lee moon soo] Remove incubating 4030fff [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 4e98cfe [Lee moon soo] Update DependencyResolver c714a19 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up d558591 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 0467077 [Lee moon soo] update test d43ab57 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up f999f71 [Lee moon soo] Update getParagraphXpath eaa68c6 [Lee moon soo] print processes 5b5f6c8 [Lee moon soo] trigger ci 1bdea70 [Lee moon soo] Print error message in the test 562f083 [Lee moon soo] CLose interpreter after test 385dab3 [Lee moon soo] Fix xpath in the SparkParagraphIt test ac963ff [Lee moon soo] Remove unnecessary stacktrace and provide more meaningful message 644add4 [Lee moon soo] Takecare csv/tsv download button position after merge 6a5a19e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 5bef173 [Lee moon soo] Update NoteTest e54d633 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 88dbc71 [Lee moon soo] change style 6f1343f [Lee moon soo] add license header 4571781 [Lee moon soo] double quote the keys in json 710487b [Lee moon soo] fix syntax error 6c5019e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 3619afd [Lee moon soo] Exclude test data file from rat check b6811a6 [Lee moon soo] set SPARK_HOME to find bin/interpreter.sh 9110897 [Lee moon soo] arrange buttons 14efb6c [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 76de11c [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up bff2217 [Lee moon soo] Fix SparkParagraphIT e60cd8e [Lee moon soo] Add docs 7f174e3 [Lee moon soo] Add more comments 0671dfd [Lee moon soo] Fix compile error bfcdf34 [Lee moon soo] Fix style 1dc4409 [Lee moon soo] Remove incubating from example pom.xml e36d2fb [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up e0a2046 [Lee moon soo] Add annotation to api 93fa766 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 99dd0b0 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up e89177e [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up f782fb0 [Lee moon soo] clean pom.xml file b974eb1 [Lee moon soo] Add horizontal bar visualization example 5225551 [Lee moon soo] let instead of var b068065 [Lee moon soo] Replace . to _ b6e4141 [Lee moon soo] helper for printing javascript and inject $z 8186daf [Lee moon soo] Update Application Status from RemoteInterpreterProcess event f07ada1 [Lee moon soo] Construct classpath correctly 7451479 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up ab1de03 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 51fc113 [Lee moon soo] Include examples in CI build 83eba98 [Lee moon soo] UnloadApp on interpreter restart 3b891de [Lee moon soo] Provide resource pool for testing 0730ece [Lee moon soo] Add license into package json 620f79f [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up 01a1646 [Lee moon soo] Add example 1f1a3b5 [Lee moon soo] Fix test 864bea1 [Lee moon soo] Merge branch 'master' into ZEPPELIN-732-up c30f53c [Lee moon soo] null check 03be3a1 [Lee moon soo] Pass required resource to run() method fade3c1 [Lee moon soo] Handle output update in angular mode 0e4d81c [Lee moon soo] Remove unnecessary log ec2fdea [Lee moon soo] Match classname correctly b4ff52f [Lee moon soo] Put last value of scala repl into resource pool f2ab95d [Lee moon soo] Prevent unnecessary output update 71f814d [Lee moon soo] Better way to find resource dir for InterpreterOutput watcher 024d7fc [Lee moon soo] Dev mode 98f3872 [Lee moon soo] Managed interpreter process and Running interpreter process b47ca74 [Lee moon soo] Fix tests 5503f9c [Lee moon soo] Improved be3a1fa [Lee moon soo] Add license header 412480a [Lee moon soo] Fix style 16f6887 [Lee moon soo] Angular object update for helium app 6223cd4 [Lee moon soo] App output display bd0f467 [Lee moon soo] Style 94b490d [Lee moon soo] initial rest api impl 134bbe6 [Lee moon soo] Change HeliumRegistry constructor argument type 7aeb64a [Lee moon soo] Unload app on paragraph / note removal as well as interpreter unbind 4eaeea7 [Lee moon soo] sync -> async api 9f5c493 [Lee moon soo] Application output b239f1b [Lee moon soo] Helium application factory b891b98 [Lee moon soo] HeliumRegistry 568ee54 [Lee moon soo] ApplicationLoader 7424af2 [Lee moon soo] Remove resource on note / paragraph removal
2016-07-03 14:58:25 +00:00
"icon" : '<i class="fa fa-clock-o"></i>'
}