346 commits

Author	SHA1	Message	Date
Jun Kim	be20201236	[DOC] Improve documents related to Helium ... ### What is this PR for? What I did for the documents: * Highlight codes * Follow JSON syntax * Remove white spaces And in my opinion, [here](https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/development/writingzeppelinvisualization.html#1-create-a-npm-package) is ambiguous: > "Normally, you can add any dependencies in package.json however Zeppelin Visualization package only allows two dependencies: zeppelin-vis and zeppelin-tabledata." Does it want to say "you can add any dependencies in package.json, but you must include two dependencies: zeppelin-vis and zeppelin-tabledata."? ### What type of PR is it? [Documentation] ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: Jun Kim <i2r.jun@gmail.com> Closes #2236 from tae-jun/helium-doc and squashes the following commits: 63505e9 [Jun Kim] Fix ambiguous sentence 3e775cf [Jun Kim] Highlight codes, follow JSON syntax, and remove white spaces	2017-04-17 15:57:31 +09:00
Tinkoff DWH	4d398ef2a6	[ZEPPELIN-2297] improvements to jdbc autocompleter ... ### What is this PR for? PR contains some improvements for completion (JDBC Interpreter): - types of completion - display of long values - refactoring of search of completions - uniqness of completions with type `keyword` - updating data in completer by pressing `Ctrl + .` - setting the schema filter to generate completions - fix highlighting code when used not default data source ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2297 ### How should this be tested? try to work with new completer ### Screenshots (if appropriate) **1. Types of completion**  **2. Display of long values** before  after  **3. Refactoring of search of completions. Updating data in completer by pressing `Ctrl + .`** before  after  **4. uniqness of completions with type keyword** before  after  **5. fix highlighting code when used not default data source** before  after  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Tinkoff DWH <tinkoff.dwh@gmail.com> Closes #2203 from tinkoff-dwh/ZEPPELIN-2297 and squashes the following commits: b86b57a [Tinkoff DWH] [ZEPPELIN-2297] small fix to compute caption 8552049 [Tinkoff DWH] [ZEPPELIN-2297] schema filters 5308f1e [Tinkoff DWH] [ZEPPELIN-2297] updating completions ef6c9cb [Tinkoff DWH] Merge remote-tracking branch 'origin/ZEPPELIN-2297' into ZEPPELIN-2297 1e05a68 [Tinkoff DWH] [ZEPPELIN-2297] fix uniqueness keywords ec3cd3b [Tinkoff DWH] [ZEPPELIN-2297] fix uniqueness keywords 2b58cc5 [Tinkoff DWH] [ZEPPELIN-2297] refactoring search completions 7b5835d [Tinkoff DWH] [ZEPPELIN-2297] compute caption of copletion 1c74384 [Tinkoff DWH] [ZEPPELIN-2297] add type of completion	2017-04-17 14:18:32 +09:00
soralee	775607f103	[ZEPPELIN-2396] eliminate the 'ctrl/command+L' keyboard shortcut ... ### What is this PR for? This PR is for that eliminate the `Ctrl/Command+L` shortcut keyboard. This function is what the ace editor defined. ### What type of PR is it? [Improvement | Document] ### What is the Jira issue? * [ZEPPELIN-2396](https://issues.apache.org/jira/browse/ZEPPELIN-2396) ### How should this be tested? * **Improvement** - Press `Ctrl + L` key and check if showing the dialog or not * **Document** - Run document development mode and check [this document](http://localhost:4000/install/upgrade.html#upgrading-from-zeppelin-07-to-08) ### Screenshots (if appropriate) [Before]  [After]  [Document]  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes, I did. Please review [this document](http://localhost:4000/install/upgrade.html#upgrading-from-zeppelin-07-to-08) if you run document development mode (localhost:4000) Author: soralee <sora0728@zepl.com> Closes #2248 from soralee/ZEPPELIN-2396_ctrl_l and squashes the following commits: bb0f7d8 [soralee] modify document d1f966a [soralee] modify document 928f179 [soralee] add space between + and who is providing 5f30fe4 [soralee] upgrade eliminate keyboard shortcut feature and add document 4e1b846 [soralee] ZEPPELIN-2396 drop the Ctrl+L shortcut keyboard	2017-04-17 14:16:20 +09:00
1ambda	45cc8a9e8a	[ZEPPELIN-2217] AdvancedTransformation for Visualization ... ### What is this PR for? `AdvancedTransformation` has more detailed options while providing existing features of `PivotTransformation` and `ColumnselectorTransformation` which Zeppelin already has  Here are some features which advanced-transformation can provide. 1. **(screenshot)** multiple sub charts 2. **(screenshot)** parameter widgets: `input`, `checkbox`, `option`, `textarea` 3. **(screenshot)** expand/fold axis and parameter panels 4. **(screenshot)** clear axis and parameter panels 5. **(screenshot)** remove duplicated columns in an axis 6. **(screenshot)** limit column count in an axis 7. configurable char axes: `valueType`, `axisType`, `description`, ... 8. configurable chart parameters 9. lazy transformation 10. parsing parameters automatically based on their type: `int`, `float`, `string`, `JSON` 11. multiple transformation methods 12. re-initialize whole configuration based on spec hash. 13. **(screenshot)** shared axis #### API Details: Spec `AdvancedTransformation` requires `spec` which includes axis and parameter details for charts. - Let's create 2 sub-charts called `simple-line` and `step-line`. - Each sub chart can have different `axis` and `parameter` depending on their requirements. ```js constructor(targetEl, config) { super(targetEl, config) const spec = { charts: { 'simple-line': { sharedAxis: true, /** set if you want to share axes between sub charts, default is `false` */ axis: { 'xAxis': { dimension: 'multiple', axisType: 'key', }, 'yAxis': { dimension: 'multiple', axisType: 'aggregator'}, 'category': { dimension: 'multiple', axisType: 'group', }, }, parameter: { 'xAxisUnit': { valueType: 'string', defaultValue: '', description: 'unit of xAxis', }, 'yAxisUnit': { valueType: 'string', defaultValue: '', description: 'unit of yAxis', }, 'dashLength': { valueType: 'int', defaultValue: 0, description: 'the length of dash', }, }, }, 'step-line': { axis: { 'xAxis': { dimension: 'single', axisType: 'unique', }, 'yAxis': { dimension: 'multiple', axisType: 'value', }, }, parameter: { 'xAxisUnit': { valueType: 'string', defaultValue: '', description: 'unit of xAxis', }, 'yAxisUnit': { valueType: 'string', defaultValue: '', description: 'unit of yAxis', }, 'noStepRisers': { valueType: 'boolean', defaultValue: false, description: 'no risers in step line', widget: 'checkbox', }, }, }, } this.transformation = new AdvancedTransformation(config, spec) } ``` #### API Details: Axis Spec | Field Name | Available Values (type) | Description | | --- | --- | --- | |`dimension` | `single` | Axis can contains only 1 column | |`dimension` | `multiple` | Axis can contains multiple columns | |`axisType` | `key` | Column(s) in this axis will be used as `key` like in `PivotTransformation`. These columns will be served in `column.key` | |`axisType` | `aggregator` | Column(s) in this axis will be used as `value` like in `PivotTransformation`. These columns will be served in `column.aggregator` | |`axisType` | `group` | Column(s) in this axis will be used as `group` like in `PivotTransformation`. These columns will be served in `column.group` | |`axisType` | (string) | Any string value can be used here. These columns will be served in `column.custom` | |`maxAxisCount` | (int) | The maximum column count that this axis can contains. (unlimited if `undefined`) | |`valueType` | (string) | Describe the value type just for annotation | Here is an example. ```js axis: { 'xAxis': { dimension: 'multiple', axisType: 'key', }, 'yAxis': { dimension: 'multiple', axisType: 'aggregator'}, 'category': { dimension: 'multiple', axisType: 'group', maxAxisCount: 2, valueType: 'string', }, }, ``` #### API Details: Parameter Spec | Field Name | Available Values (type) | Description | | --- | --- | --- | |`valueType` | `string` | Parameter which has string value | |`valueType` | `int` | Parameter which has int value | |`valueType` | `float` | Parameter which has float value | |`valueType` | `boolean` | Parameter which has boolean value used with `checkbox` widget usually | |`valueType` | `JSON` | Parameter which has JSON value used with `textarea` widget usually. `defaultValue` should be `""` (empty string). This ||`defaultValue` | (any) | Default value of this parameter. `JSON` type should have `""` (empty string) | |`description` | (string) | Description of this parameter. This value will be parsed as HTML for pretty output | |`widget` | `input` | Use [input](https://developer.mozilla.org/en/docs/Web/HTML/Element/input) widget. This is the default widget (if `widget` is undefined)| |`widget` | `checkbox` | Use [checkbox](https://developer.mozilla.org/en-US/docs/Web/HTML/Element/input/checkbox) widget. | |`widget` | `textarea` | Use [textarea](https://developer.mozilla.org/en-US/docs/Web/HTML/Element/textarea) widget. | |`widget` | `option` | Use [select + option](https://developer.mozilla.org/en-US/docs/Web/HTML/Element/select) widget. This parameter should have `optionValues` field as well. | |`optionValues` | (Array<string>) | Available option values used with the `option` widget | Here is an example. ```js parameter: { // string type, input widget 'xAxisUnit': { valueType: 'string', defaultValue: '', description: 'unit of xAxis', }, // boolean type, checkbox widget 'inverted': { widget: 'checkbox', valueType: 'boolean', defaultValue: false, description: 'invert x and y axes', }, // string type, option widget with `optionValues` 'graphType': { widget: 'option', valueType: 'string', defaultValue: 'line', description: 'graph type', optionValues: [ 'line', 'smoothedLine', 'step', ], }, // HTML in `description` 'dateFormat': { valueType: 'string', defaultValue: '', description: 'format of date (<a href="https://docs.amcharts.com/3/javascriptcharts/AmGraph#dateFormat">doc</a>) (e.g YYYY-MM-DD)', }, // JSON type, textarea widget 'yAxisGuides': { widget: 'textarea', valueType: 'JSON', defaultValue: '', description: 'guides of yAxis ', }, ``` #### API Details: Transformer Spec `AdvancedTransformation` supports 3 transformation methods. The return value will depend on the transformation method type. ```js const spec = { charts: { 'simple': { /** default value of `transform.method` is the flatten cube. */ axis: { ... }, parameter: { ... } }, 'cube-group': { transform: { method: 'cube', }, axis: { ... }, parameter: { ... }, } 'no-group': { transform: { method: 'raw', }, axis: { ... }, parameter: { ... }, } ``` | Field Name | Available Values (type) | Description | | --- | --- | --- | |`method` | `object` | designed for [amcharts: serial](https://www.amcharts.com/demos/date-based-data/) | |`method` | `array` | designed for [highcharts: column](http://jsfiddle.net/gh/get/library/pure/highcharts/highcharts/tree/master/samples/highcharts/demo/column-basic/) | |`method` | `drill-down` | designed for [highcharts: drill-down](http://jsfiddle.net/gh/get/library/pure/highcharts/highcharts/tree/master/samples/highcharts/demo/column-drilldown/) | |`method` | `raw` | will return the original `tableData.rows` | Whatever you specified as `transform.method`, the `transformer` value will be always function for lazy computation. ```js // advanced-transformation.util#getTransformer if (transformSpec.method === 'raw') { transformer = () => { return rows; } } else if (transformSpec.method === 'array') { transformer = () => { ... return { ... } } } ``` #### Feature Details: Automatic parameter parsing Advanced transformation will parse parameter values automatically based on their type: `int`, `float`, `string`, `JSON` - See also `advanced-transformation-util.js#parseParameter` #### Feature Details: re-initialize the whole configuration based on spec hash ```js // advanced-transformation-util#initializeConfig const currentVersion = JSON.stringify(spec) if (!config.spec || !config.spec.version || config.spec.version !== currentVersion) { spec.version = currentVersion // reset config... } ``` #### Feature Details: Shared Axes If you set `sharedAxis` to `true` in chart specification, then these charts will share their axes. (default is `false`) ```js const spec = { charts: { 'column': { transform: { method: 'array', }, sharedAxis: true, axis: { ... }, parameter: { ... }, }, 'stacked': { transform: { method: 'array', }, sharedAxis: true, axis: { ... } parameter: { ... }, }, ```  #### API Details: Usage in Visualization#render() Let's assume that we want to create 2 sub-charts called `basic` and `no-group`. - https://github.com/1ambda/zeppelin-ultimate-line-chart (an practical example) ```js drawBasicChart(parameter, column, transformer) { const { ... } = transformer() } drawNoGroupChart(parameter, column, transformer) { const { ... } = transformer() } render(data) { const { chart, parameter, column, transformer, } = data if (chart === 'basic') { this.drawBasicChart(parameter, column, transformer) } else if (chart === 'no-group') { this.drawNoGroupChart(parameter, column, transformer) } } ``` ### What type of PR is it? [Feature] ### Todos NONE ### What is the Jira issue? [ZEPPELIN-2217](https://issues.apache.org/jira/browse/ZEPPELIN-2217) ### How should this be tested? 1. Clone https://github.com/1ambda/zeppelin-ultimate-line-chart 2. Create a symbolic link `ultimate-line-chart.json` into `$ZEPPELIN_HOME/helium` 3. Modify the `artifact` value to proper absolute path considering your local machine. 4. Install the above visualization in `localhost:9000/#helium` 5. Test it ### Screenshots (if appropriate) #### 1. *(screenshot)* multiple sub charts  #### 2. *(screenshot)* parameter widgets: `input`, `checkbox`, `option`, `textarea`  #### 3. *(screenshot)* expand/fold axis and parameter panels  #### 4. *(screenshot)* clear axis and parameter panels  #### 5. *(screenshot)* remove duplicated columns in an axis  #### 6. *(screenshot)* limit column count in an axis  ### Questions: * Does the licenses files need update? - NO * Is there breaking changes for older versions? - NO * Does this needs documentation? - NO Author: 1ambda <1amb4a@gmail.com> Closes #2098 from 1ambda/ZEPPELIN-2217/advanced-transformation and squashes the following commits: 6cde7c9 [1ambda] fix reset params when spec change c75a3f2 [1ambda] fix: Reset persisted axis 6a2130a [1ambda] fix: clear config only when axis changed 5464e84 [1ambda] fix: Optimize array 2 key method 9beb1e7 [1ambda] fix: Type error 2408225 [1ambda] test: Add test for array 2key bf56761 [1ambda] feat: Add array:2-key transform method 7c6768f [1ambda] feat: Use axisSpec.desc as tooltip f98d4c9 [1ambda] fix: Remove invalid key prop 5cf2ece [1ambda] feat: Add minAxisCount 4887800 [1ambda] fix: Remove local module yarn caches 3e29572 [1ambda] refactor: copyModule func c91a033 [1ambda] fix: Set yarn cache dir in helium-bundles 04b5140 [1ambda] fix: Import a-tr 0a876cf [1ambda] docs: Update index.md 380b1af [1ambda] docs: Fix typo and add desc for existing trs 908214b [1ambda] docs: Move experimental tags a009627 [1ambda] feat: Allow dup aggr axis 3b44e92 [1ambda] fix: Remove unuse const ab6c22e [1ambda] test: Add test for drill-down method 756107a [1ambda] test: Add array transformation method d819c73 [1ambda] test: Add object method bf00fba [1ambda] test: Add MockTableData 39fe5ae [1ambda] test: Add test for getColumnsFromAxis 4c393b4 [1ambda] fix: Add polyfill for es6 funcs in test e92c787 [1ambda] test: Add test for rmDup, aplMaxAxisCount 843f45d [1ambda] test: Add test for getCurrent* funcs ae5277c [1ambda] test: Add test for initializeConfig c14a9dc7 [1ambda] test: Add tests for widget, params c510af1 [1ambda] docs: Add doc for Transformation 52db37b [1ambda] feat: Show panel menus only when opened 17ad4a4 [1ambda] feat: Support chartChanged, parameterChanged c0d33d3 [1ambda] fix: Sort selectors in drilldown method cfd6fef [1ambda] feat: sharedAxis 9af80ce [1ambda] style: Indent 79b5654 [1ambda] fix: return the same info in transform 7bee464 [1ambda] fix: Keynames ee8788e [1ambda] feat: Support drill-down 666025a [1ambda] fix: DON'T reset current chart ae1891f [1ambda] add array:key transform 4167a2e [1ambda] fix: Sort keyNames 912b5b7 [1ambda] fix: Persist initialized config f1f6b0c [1ambda] feat: Support ARRAY transform.method 812f9a2 [1ambda] fix: Set proper aggr value when 0 group 20f9437 [1ambda] fix: getCube func 25d51a9 [1ambda] DON'T display aggr.name when aggrColumns.length == 1 f37e13d [1ambda] fix: Add 'object' transform.method da2370c [1ambda] fix: Add resetAxis, Param funcs 2370682 [1ambda] fix: average is not caculated correctly dd08e38 [1ambda] fix: Set param panel height to 400 881695a [1ambda] feat: clear chart, param separately 4d0d62b [1ambda] fix: DON'T clean panel config 92676d1 [1ambda] fix: limit parameter panel height to 370 cc29060 [1ambda] feat: parse param description as HTML 9a2d227 [1ambda] fix: Stop event propagation in widgets fcc625c [1ambda] feat: Automatic param parsing b4d774c [1ambda] fix: Dont close param panel when enter 088705b [1ambda] refactor: Remove util and add Widget funcs bf88b4f [1ambda] feat: textare widget and update hook 4e73012 [1ambda] feat: widget checkbox 11b7eaa [1ambda] feat: option widget 5d3efc9 [1ambda] fix: Change panel header b1d9d31 [1ambda] feat: Save and close with enter key 53f508c [1ambda] feat: custom axisSpec 0dbc431 [1ambda] feat: Support transformer 94d837a [1ambda] feat: Automatic spec versioning 74b8b4e [1ambda] fix: Duplicated radio btn id, name 5b88f08 [1ambda] fix: Modify margin of subchart radio btns 019892c [1ambda] feat: Support transform: flatten 0484e1e [1ambda] feat: Support maxAxisCount in axisSpec 936901b [1ambda] feat: Support undefined valueType in axisSpec 7a454ff [1ambda] feat: Cube Transformation f0ed02f [1ambda] feat: Support same axis types 49985c6 [1ambda] refactor: Refine axis, param spec d89e223 [1ambda] feat: advanced-transformation-api 75569ce [1ambda] feat: Support multiple charts in UI e1fcc2e [1ambda] feat: Support multiple charts 97be629 [1ambda] fix: Add singleDimensionAggregatorChanged 676bd7e [1ambda] refactor: Refine transform API 9fb398e [1ambda] feat: Add clearConfig a8a4fb1 [1ambda] refactor: Add getAxisInSingleDimension func 9768ecf [1ambda] feat: Add groupBase axis option 91ae54d [1ambda] fix: Overflow issue in single aggr 10c80fc [1ambda] feat: AdvancedTransformation	2017-04-15 07:34:27 +09:00
AhyoungRyu	540ceb87d8	[ZEPPELIN-2373] Remove -Pyarn build profile ... ### What is this PR for? Currently users who build Zeppelin from source need to include `-Pyarn` build profile to enable Yarn for embedded local Spark. This PR is to remove `-Pyarn` and make Yarn related libraries can be automatically downloaded without the profile during build time. ### What type of PR is it? just removed Yarn build profile in `spark-dependencies/pom.xml` ### What is the Jira issue? [ZEPPELIN-2373](https://issues.apache.org/jira/browse/ZEPPELIN-2373) ### How should this be tested? 1. apply this patch and build Zeppelin with below command ``` mvn clean package -DskipTests -pl 'zeppelin-server, spark-dependencies, spark' --am ``` 2. check `spark-yarn_${scala.binary.version}.jar` is downloaded(or included) during build time ``` [INFO] Including org.apache.spark:spark-yarn_2.10🫙2.1.0 in the shaded jar. ``` In current master, the above line won't be shown if you don't use `-Pyarn` build profile. But with this patch, it will be shown without the profile. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #2232 from AhyoungRyu/ZEPPELIN-2373/includeYarnByDefault and squashes the following commits: 59eb2b5 [AhyoungRyu] Remove -Pyarn build profile	2017-04-10 22:56:11 +09:00
LeiWang	5381883ff5	add a configuration zeppelin.jdbc.auth.kerberos.proxy for kerberos proxy behavior ... …e to disable proxy behavior ### What is this PR for? A few sentences describing the overall goals of the pull request's commits. First time? Check out the contributing guide - https://zeppelin.apache.org/contribution/contributions.html ### What type of PR is it? [Improvement] * add a configuration item zeppelin.jdbc.auth.kerberos.proxy.enable to disable kerberos behaviour as we know， in current version of zeppelin， if we have kerberos auth configured，and using zeppelin with a user login，the jdbc interpreter will do a proxy behavior with the login user automatically，but in many cases， we do not want do this，and we do not want bind the zeppelin user system with kerberos auth system. I think it's make senses to add a configuration item to disable this behavior. ### Todos * [ ] - Task ### What is the Jira issue? * Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/ * Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533] [ZEPPELIN-2353] (https://issues.apache.org/jira/browse/ZEPPELIN-2353) ### How should this be tested? Outline the steps to test the PR here. when we have kerberos auth configured, and using zeppelin with a login user add configuration: "zeppelin.jdbc.auth.kerberos.proxy.enable=false" for jdbc iterpreter configuration, the jdbc iterpreter will not do the proxy behavior with the login user ### Screenshots (if appropriate) <img width="1405" alt="2017-04-04 9 12 03" src="https://cloud.githubusercontent.com/assets/869480/24658501/7739e680-197c-11e7-90ab-c1938e31efc7.png"> ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? Author: LeiWang <wanglei6744@163.com> Author: lei wang <lei1989@outlook.com> Closes #2222 from wary/main-master and squashes the following commits: 1f26bc3 [LeiWang] Update jdbc.md ba34a41 [LeiWang] Update JDBCInterpreter.java 444b6ab [LeiWang] Update JDBCInterpreter.java ea11ce4 [LeiWang] Update jdbc.md ee9cd18 [LeiWang] Update jdbc.md e04fb38 [LeiWang] Update jdbc.md 75e4b9f [LeiWang] Update jdbc.md b850a42 [LeiWang] Update JDBCInterpreter.java 067696a [lei wang] add configure zeppelin.jdbc.auth.kerberos.proxy for kerberos auth type to disable proxy behavior	2017-04-08 13:30:58 +09:00
AhyoungRyu	b62e2e01bb	[ZEPPELIN-2341] Remove -Psparkr build profile ... ### What is this PR for? Currently users who build Zeppelin from source need to include `-Psparkr` to use `%r` with embedded local Spark. But it's quite inconvenient to write this build profile every time we build i think. So I removed `-Psparkr` and make `r` related libraries automatically downloaded when we build Zeppelin like I did #2213 ### What type of PR is it? Improvement ### Todos * [x] - remove the rest of `-Psparkr` build profile in `dev/create_release.sh`, `dev/publish_release.sh`, and `docs/install/build.md` after #2213 merged ### What is the Jira issue? [ZEPPELIN-2341](https://issues.apache.org/jira/browse/ZEPPELIN-2341) ### How should this be tested? 1. Apply this patch 2. Build source with below command ``` mvn clean package -DskipTests -pl 'zeppelin-interpreter, zeppelin-zengine, zeppelin-server, zeppelin-display, spark, spark-dependencies' ``` Aftr this step, there will be `R` dir under `ZEPPELIN_HOME/interpreter/spark`. Before this PR, only `dep` dir and `zeppelin-spark_2.10-0.8.0-SNAPSHOT.jar` is generated without `-Psparkr` build profile. 4. Restart Zeppelin. To make sure, run R tutorial note under `Zeppelin Tutorial` folder It should be run successfully without any error ### Screenshots (if appropriate) If we build without `-Psparkr` - before : R related properties are not activated by default in Spark interpreter  - after  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Author: Ahyoung Ryu <ahyoungryu@apache.org> Closes #2215 from AhyoungRyu/ZEPPELIN-2341/includeSparkRByDefault and squashes the following commits: 8db18cc [AhyoungRyu] Remove the rest of '-Psparkr' in docs & sh files f891fd4 [Ahyoung Ryu] Merge branch 'master' into ZEPPELIN-2341/includeSparkRByDefault 445be3e [AhyoungRyu] Add SPARKR env to check each test case need to download r dep or not 67af02a [AhyoungRyu] Remove -PsparkR in travis file a00466c [AhyoungRyu] Remove sparkr build profile in pom files	2017-04-07 00:55:26 +09:00
AhyoungRyu	c87fa53a3a	[ZEPPELIN-2298] Remove -Ppyspark build profile ... ### What is this PR for? Currently users who build Zeppelin from source need to include `-Ppyspark` to use `%pyspark` with embedded local Spark. But it's quite inconvenient to write this build profile every time we build i think. So I removed `-Ppyspark` and make pyspark related libraries automatically downloaded when we build Zeppelin. ### What type of PR is it? Improvement ### Todos * [x] - remove the rest of `-Ppyspark` build profile in `dev/create_release.sh`, `dev/publish_release.sh`, and `docs/install/build.md` after getting feedback ### What is the Jira issue? [ZEPPELIN-2298](https://issues.apache.org/jira/browse/ZEPPELIN-2298) ### How should this be tested? 1. Apply this patch 2. Build source with below command ``` mvn clean package -DskipTests -pl 'zeppelin-interpreter, zeppelin-zengine, zeppelin-server, zeppelin-display, spark, spark-dependencies' ``` Aftr this step, there will be `pyspark` dir under `ZEPPELIN_HOME/interpreter/spark`. Before this PR, only `dep` dir and `zeppelin-spark_2.10-0.8.0-SNAPSHOT.jar` is generated without `-Ppyspark` build profile. 4. Restart Zeppelin. To make sure, run any python code e.g. ``` %pyspark print("Hello "+z.input("name")) ``` It should be run successfully without any error ### Screenshots (if appropriate) tl;dr Without `-Ppyspark` profile - Before <img width="856" alt="screen shot 2017-04-02 at 2 50 57 pm" src="https://cloud.githubusercontent.com/assets/10060731/24584778/0e8ec6b0-17b4-11e7-9f0d-f2599fd7bd63.png"> - After <img width="893" alt="screen shot 2017-04-02 at 2 28 21 pm" src="https://cloud.githubusercontent.com/assets/10060731/24584779/10b7ed68-17b4-11e7-90d4-aa95eb9bba2d.png"> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no I want to include `SparkR` by default(= remove `-PsparkR` build profile) like this as a next step. I want to ask how Zeppelin community think about this. Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #2213 from AhyoungRyu/ZEPPELIN-2298/includePysparkByDefault and squashes the following commits: f7bcf06 [AhyoungRyu] Remove -Ppyspark in virtual_machine.md 458ac02 [AhyoungRyu] Remove the rest of -Ppyspark in blind side of Zeppelin :) cee1e87 [AhyoungRyu] Change py4j.version -> python.py4j.version ce43158 [AhyoungRyu] Change py4j.version -> spark.py4j.version fa4fb36 [AhyoungRyu] Remove the rest of -Ppyspark 30aac81 [AhyoungRyu] Remove -Ppyspark build flag	2017-04-04 15:10:13 +09:00
dlukyanov	53a28a3a91	Groovy Interpreter for Apazhe Zeppelin [ZEPPELIN-2176] ... ### What is this PR for? Groovy Interpreter ### What type of PR is it? Feature ### Todos * [ Tests ] - Task * [ Documentation ] - Task ### What is the Jira issue? [ZEPPELIN-2176] ### How should this be tested? Follow the groovy interpreter documentation samples ### Questions: * Does the licenses files need update? YES * Is there breaking changes for older versions? NO * Does this needs documentation? YES Author: dlukyanov <dlukyanov@ukr.net> Author: dm <dm> Closes #2135 from dlukyanov/master and squashes the following commits: faf213f [dlukyanov] ZEPPELIN-2176 comments from @AhyoungRyu - remove @author - remove commented code 89c3ed5 [dlukyanov] retry ca65947 [dlukyanov] deprecated 3dd53e2 [dlukyanov] ZEPPELIN-2176 comments from @AhyoungRyu - Zeppelin follows Google Java code - interpreter alphabetical order in _navigation.html - direct link to MarkupBuilder in groovy help fe08159 [dlukyanov] retry ca8bea6 [dlukyanov] Update groovy.md a5b37a1 [dlukyanov] ZEPPELIN-2176 https://github.com/apache/zeppelin/pull/2135#issuecomment-289308850 - Inside of docs directory, groovy.md will need some header to be compiled with Jekyll - Menu in docs also need link to groovy - .travis.yml we need add !groovy 4abf649 [dm] Merge branch 'master' of https://github.com/apache/zeppelin 41a1702 [dlukyanov] ZEPPELIN-2176 https://github.com/apache/zeppelin/pull/2135#issuecomment-288829494 - implement shared script variables - move docs - implement run methods dd388b3 [dlukyanov] retry b34b42a [dlukyanov] retry 0d7732a [dlukyanov] retry 2646fa8 [dlukyanov] ZEPPELIN-2176 groovy interpreter, fix unchecked, add to configs, move HTTP.groovy to resources to simplify build, add default z-properties 5fa26e0 [dlukyanov] ZEPPELIN-2176 groovy interpreter, fix unchecked, add to configs, move HTTP.groovy to resources to simplify build, add default z-properties aa427cd [dlukyanov] retry addf167 [dlukyanov] retry db4c35b [dlukyanov] Update README.md fa779ea [dlukyanov] groovy interpreter	2017-04-04 14:59:35 +09:00
Jeff Zhang	e7d41c3497	ZEPPELIN-2324. Add property zeppelin.spark.enableSupportedVersionCheck for trying new spark version ... ### What is this PR for? For now, every time when I want to try new spark version, I have to change file `SparkVersion.java` and rebuild it. It is not so convenient, so I'd like to add property `zeppelin.spark. enableSupportedVersionCheck` for spark interpreter. So that I can try new spark version by setting this property as false, of course it is only for zeppelin developer. ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2324 ### How should this be tested? Verify it in spark master ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #2197 from zjffdu/ZEPPELIN-2324 and squashes the following commits: f821839 [Jeff Zhang] address comments 4193ee3 [Jeff Zhang] ZEPPELIN-2324. Add property zeppelin.spark.unSupportedVersionCheck for trying new spark version	2017-04-03 16:52:50 +08:00
Benoy Antony	1135fb61d2	[ZEPPELIN-1965] Livy SQL Interpreter: Should use df.show(1000, false)… ... … to display results ### What is this PR for? Livy SQL interpreter truncate result strings of size greater than 20. In some cases, we like to see the full string. We are adding a interpreter property **zeppelin.livy.spark.sql.field.truncate** to control whether to truncate strings or not. By default, **zeppelin.livy.spark.sql.field.truncate** is set to **true**. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1965 ### How should this be tested? Set zeppelin.livy.spark.sql.field.truncate to true or false Run a SQL query which produces string values of length greater than 20. Depending on the value of zeppelin.livy.spark.sql.field.truncate, the strings will either get truncated or not. ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Benoy Antony <benoy@apache.org> Closes #2201 from benoyantony/master and squashes the following commits: bb006c0 [Benoy Antony] changed field name and description 9eae68b [Benoy Antony] added a null check to avoid testcase failures, another nullcheck for backward compatibility and added two new testcases ab1ead2 [Benoy Antony] documented zeppelin.livy.spark.sql.truncate b6252be [Benoy Antony] [ZEPPELIN-1965] Livy SQL Interpreter: Should use df.show(1000, false) to display results	2017-04-02 11:53:49 -07:00
AhyoungRyu	9e8d7eb90c	[Minor][ZEPPELIN-2328] Separate Helium related docs from 'Contribution' section ... ### What is this PR for? Actually writing "Visualization", "Spell" or "Application" type of Helium package is not a direct contribution to Zeppelin. So i created "Helium Framework" section and moved "Writing Zeppelin Visualization", "Writing Zeppelin Spell", and "Writing Zeppelin Application" under "Helium Framework" from "Contribution". ### What type of PR is it? Documentation ### What is the Jira issue? [ZEPPELIN-2328](https://issues.apache.org/jira/browse/ZEPPELIN-2328) ### Screenshots (if appropriate) - Before <img src="https://cloud.githubusercontent.com/assets/10060731/24444171/743d8c7e-14a0-11e7-8a10-ec02596d2a19.png" width="300px"> - After <img src="https://cloud.githubusercontent.com/assets/10060731/24444245/aecfe274-14a0-11e7-8488-99086b1db415.png" width="300px"> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #2202 from AhyoungRyu/ZEPPELIN-2328 and squashes the following commits: 6185fcd [AhyoungRyu] Separate Helium related docs from 'Contribution' section	2017-04-01 18:56:51 +09:00
Tinkoff DWH	998c8f35e8	[ZEPPELIN-1999] get interpreter property with replaced context parameters ... ### What is this PR for? Adds posibility to use context parameters (types: String.class, Double.class, Float.class, Short.class, Byte.class, Character.class, Boolean.class, Integer.class, Long.class, ) into property value of interpreter. ### What type of PR is it? Feature ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1999 ### How should this be tested? 1. Add text with markers #{contextFieldNAme} (ex. #{noteId} or #{replName}) to interpreter property value (or add new property of interpreter). 2. Get this property (getProperty(key)), markers should be replaced by context values ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: Tinkoff DWH <tinkoff.dwh@gmail.com> Closes #2085 from tinkoff-dwh/ZEPPELIN-1999 and squashes the following commits: fa1500a [Tinkoff DWH] [ZEPPELIN-1999] fix logic of replace 93c759d [Tinkoff DWH] Merge remote-tracking branch 'origin/master' into ZEPPELIN-1999 be4fada [Tinkoff DWH] [ZEPPELIN-1999] revert gitignore c0110e9 [Tinkoff DWH] [ZEPPELIN-1999] documentation 61ac564 [Tinkoff DWH] [ZEPPELIN-1999] docs a10dc0e [Tinkoff DWH] [ZEPPELIN-1999] skip fields of paragraph ea9c6a3 [Tinkoff DWH] [ZEPPELIN-1999] docs 7c4489c [Tinkoff DWH] Merge remote-tracking branch 'origin/master' into ZEPPELIN-1999 527419a [Tinkoff DWH] Merge remote-tracking branch 'origin/master' into ZEPPELIN-1999 b5424b9 [Tinkoff DWH] [ZEPPELIN-1999] get interpreter property with replaced context parameters	2017-03-25 14:54:12 -07:00
Jeff Zhang	9d40013a99	ZEPPELIN-2261. Support to connect with livy through https ... ### What is this PR for? Livy server support https, but the currently livy interpreter doesn't support it. This PR is for for the supporting to connect with livy through https ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2261 ### How should this be tested? Tested manually on livy server with ssl enabled. ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #2139 from zjffdu/ZEPPELIN-2261 and squashes the following commits: 52fc204 [Jeff Zhang] address comment 53230c3 [Jeff Zhang] [ZEPPELIN-2261]. Support to connect with livy through https	2017-03-22 23:57:55 -07:00
Andrea Peruffo	621c5be2d1	[ZEPPELIN-2278] Env variable to configure Npm registry ... ### What is this PR for? When deploying Zeppelin in private Cloud or within closed networks, it happens that Npm Registry isn't directly reachable, so we want to configure our own proxy/registry otherwise we couldn't fetch dependencies. It is anyhow worth to let user configure npm registry instead of hardcoding the URL. ### What type of PR is it? Improvement ### What is the Jira issue? [ZEPPELIN-2278] ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? Author: Andrea Peruffo <andrea.peruffo1982@gmail.com> Closes #2150 from andreaTP/npmConfig and squashes the following commits: 56fab25 [Andrea Peruffo] [ZEPPELIN-2278] Env variable to configure Npm registry	2017-03-22 16:22:05 -07:00
Remilito	89a1c53f24	[ZEPPELIN-2106] providing paragraph config in create note/paragraph rest call ... ### What is this PR for? * Allow to provide full paragraph config directly in the Create Paragraph and Create Note endpoint. * This saves some calls to [noteId]/paragraph/[paragraphId]/config * Updated doc. ### What type of PR is it? Improvement ### Todos ### What is the Jira issue? [ZEPPELIN-2106](https://issues.apache.org/jira/browse/ZEPPELIN-2106) ### How should this be tested? Outline the steps to test the PR here. 1. Clone the first paragraph of 'Zeppelin Tutorial/Basic Features (Spark)' to get the bank data loaded in a new note. 2. curl -X POST -d testAPI.json http://localhost:8080/api/notebook/$YOURNOTEID/paragraph 3. When running the paragraphes, the graphs will show up with the appropriate settings. testAPI.json: `{ "title":"Example providing config", "text":"%sql\nselect age, marital, count(1) cvalue from bank group by age, marital order by age", "config": { "title":true, "colWidth":6.0, "results": [ { "graph": { "mode": "scatterChart", "optionOpen": true } } ] }, "colWidth":9.0 } ` ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Remilito <remy.gayet@gmail.com> Closes #2099 from Remilito/ZEPPELIN-2106b and squashes the following commits: 0994ac0 [Remilito] [ZEPPELIN-2106]: keeping only the API providing the whole config 76af44a [Remilito] [ZEPPELIN-2106] providing paragraph config in create note/paragraph call * Allow to describe graph, colWidth, showTitle or full paragraph config directly in the Create Paragraph and Create Note endpoint. * Updated doc.	2017-03-21 11:13:46 -07:00
RyuAhyoung	f43d27f0bd	[HOT FIX][MASTER] Fix multi dynamic select forms behaviour ... ### What is this PR for? After #2100 merged, we can control the behaviour of running select form using `Run on selection change` under each paragraph control menu. But currently if user creates multiple dynamic forms in one paragraph, the select form box itself[1] and `Run on selection` menu[2] don't appear as reported in https://github.com/apache/zeppelin/pull/2141#issuecomment-287537706. - [1]  - [2]  Regardless the number of select forms and the types of dynamic form, `Run on selection change` menu should be shown up if the paragraph has at least 1 select form. ### What type of PR is it? Bug Fix & Hot Fix ### What is the Jira issue? N/A ### How should this be tested? 1. Create multiple select forms ``` %md My first selection is ${my selection1=1,1|2|3} My second selection is ${my selection2=4,4|5|6} ``` 2. Create different types of dynamic form (e.g. 1 select form + 1 checkbox) ``` %md My selection is ${my selection=1,1|2|3} My check list is ${checkbox:checkboxTest=list1|list2, list1|list2|list3|list4} ``` There should be `Run on selection change` menu under the paragraph control menu in the above cases. And the select form should appear! ### Screenshots (if appropriate) - When multiple select forms are created  - When different dynamic forms are created (e.g. 1 checkbox + 1 select form)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: RyuAhyoung <ahyoungryu@MacBook-Pro-5.local> Closes #2154 from AhyoungRyu/fix/multiDynamicFormBehaviour and squashes the following commits: 5730796 [RyuAhyoung] Apply same mechanism to checkbox form 266f0c8 [RyuAhyoung] Fix multi dynamicforms behaviour	2017-03-19 20:42:23 +09:00
Andrea Peruffo	cceeaef2a4	[ZEPPELIN-2277] Env variable to configure maven central repo ... ### What is this PR for? When deploying Zeppelin in private Cloud or within closed networks, it happens that Maven Central isn't directly reachable, so we want to configure our own proxy and do not have to wait for minutes long timeouts when importing external libraries. It is anyhow worth to let user configure maven central repo instead of hardcoding the URL. ### What type of PR is it? Improvement ### How should this be tested? Outline the steps to test the PR here. ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? Author: Andrea Peruffo <andrea.peruffo1982@gmail.com> Closes #2093 from andreaTP/mavenRepo and squashes the following commits: af9accc [Andrea Peruffo] [ZEPPELIN-2277] Env variable to configure maven central repo	2017-03-17 08:57:53 -07:00
AhyoungRyu	dcf2c7a2c8	[ZEPPELIN-2060] Make dynamic select form turn on or off using checkbox ... ### What is this PR for? I added "Auto Run" checkbox for select dynamic form to make user turn on / off automatic running after the form value changed. ### What type of PR is it? Improvement ### Todos * [x] - update docs after getting feedback ### What is the Jira issue? [ZEPPELIN-2060](https://issues.apache.org/jira/browse/ZEPPELIN-2060) ### How should this be tested? 1. Apply this patch and run Zeppelin web as dev mode ```bash # under zeppelin-web $ yarn run dev ``` 2. Go to Spark tutorial note and try to change value in select form as below screenshot imgs ### Screenshots (if appropriate) - "Auto Run" checkbox button will be shown only in select dynamic form's dropdown menu  - _**turn on**_ "Auto Run"-> auto run right after the value changed / _**turn off**_ -> need to press `Enter`  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes, maybe [this part](https://github.com/apache/zeppelin/blob/master/docs/manual/dynamicform.md#select-form) Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #2100 from AhyoungRyu/feature/turnOnOrOffAutoRun and squashes the following commits: 4043579 [AhyoungRyu] Add 'setting: {forms: {}}' info to paragraphMock 47dcb5f [AhyoungRyu] Persist 'runOnSelectionChange' under note.json's config field 4904f38 [AhyoungRyu] Update dynamicForm docs 66c6c21 [AhyoungRyu] Add test case for behaviour of 'Run on selection change' 8a0ca30 [AhyoungRyu] Change label to 'Run on selection change' 5075711 [AhyoungRyu] Add a space next to checkbox f2e3259 [AhyoungRyu] Make dynamic select form turn on or off using checkbox	2017-03-17 10:00:55 +09:00
Tinkoff DWH	cf131c8680	[ZEPPELIN-2245] separate precode into JDBCInterpreter ... ### What is this PR for? Separate precode by prefix. Added the ability to set different precode for different data sources ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2245 ### How should this be tested? 1. Set properties ``` default.password 1 default.precode set search_path='test_path' default.url jdbc:postgresql://localhost:5432/ default.user postgres mysql.driver com.mysql.jdbc.Driver mysql.password 1 mysql.precode set v=12 mysql.url jdbc:mysql://localhost:3306/ mysql.user root ``` 2. Run `show search_path` 3. Run ``` %jdbc(mysql) select v ``` ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Tinkoff DWH <tinkoff.dwh@gmail.com> Closes #2121 from tinkoff-dwh/ZEPPELIN-2245 and squashes the following commits: 970c064 [Tinkoff DWH] [ZEPPELIN-2245] editing documentation a136a0e [Tinkoff DWH] [ZEPPELIN-2245] documentation for usage of precode f896ea8 [Tinkoff DWH] [ZEPPELIN-2245] separate precode into JDBCInterpreter	2017-03-14 20:05:15 -07:00
agura	f0cf85f09b	ZEPPELIN-2219 Apache Ignite version updated to 1.9 ... ### What is this PR for? Apache Ignite version update to 1.9 in Ignite interpreter ### What type of PR is it? [Improvement] ### What is the Jira issue? ZEPPELIN-2219 Author: agura <agura@apache.org> Closes #2101 from agura/ZEPPELIN-2219 and squashes the following commits: 7f053d7 [agura] ZEPPELIN-2219 Apache Ignite version updated to 1.9	2017-03-13 20:12:37 +09:00
AhyoungRyu	142597bcf0	[ZEPPELIN-2109][2110] Sortable Helium pkgs & Introduce "INTERPRETER" type ... ### What is this PR for? * Make Helium pkgs sortable For now, we have 3 types of Helium packages: `VISUALIZATION`, `SPELL` and `APPLICATION`. `VISUALIZATION` and `SPELL` type of pkgs can be published [NPM registry](https://www.npmjs.com/). Likewise, `APPLICATION` type pkg can be registered in [Maven central repository](http://search.maven.org/). But all available Helium packages are not sorted and shown in random order in Helium menu. To do this, I put "NPM Packages" & "Maven Artifacts" button at top-right corner of Helium menu. * Introduce "INTERPRETER" type As a first step of [ZEPPELIN-1993: Install interpreter from Helium menu](https://issues.apache.org/jira/browse/ZEPPELIN-1993), I added `INTERPRETER` type as a new Helium pkg type. Like [ZEPPELIN-1973](https://issues.apache.org/jira/browse/ZEPPELIN-1973) did, we can retrieve Maven artifact(which has `zeppelin-interpreter` as its dependency) info and save it to Helium online registry as well. For more detailed explanation, please see [ZEPPELIN-1993](https://issues.apache.org/jira/browse/ZEPPELIN-1993) and [ZEPPELIN-2110](https://issues.apache.org/jira/browse/ZEPPELIN-2110)'s description. ### What type of PR is it? Improvement ### What is the Jira issue? * [ZEPPELIN-2109](https://issues.apache.org/jira/browse/ZEPPELIN-2109) : Make Helium packages sortable in Helium menu * [ZEPPELIN-2110](https://issues.apache.org/jira/browse/ZEPPELIN-2110) : List community & 3rd party interpreter registered at Maven central repo in Helium menu ### How should this be tested? To see how `INTERPRETER` type can be shown in Helium menu, 1. Replace temporarily [ZeppelinConfiguration.java#L46](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/conf/ZeppelinConfiguration.java#L46) with [this url](https://raw.githubusercontent.com/AhyoungRyu/spark-notebook-example/master/helium-test.json) 2. Build \w below command and restart ``` $ mvn clean package -DskipTests -pl 'zeppelin-zengine, zeppelin-server, zeppelin-interpreter' ``` 3. Start web dev server under `ZEPPELIN_HOME/zeppelin-web` and browse `localhost:9000` ``` $ yarn run dev:helium ``` 4. Go to Helium menu ### Screenshots (if appropriate) - How's it look?  - Package selection by types (`VISUALIZATION`, `SPELL`, `INTERPRETER` and `APPLICATION`) <img width="500" alt="screen shot 2017-02-23 at 12 51 22 am" src="https://cloud.githubusercontent.com/assets/10060731/23219377/3c020fb4-f962-11e6-849c-6da193414d87.png"> - Disabled "Enable" button until [ZEPPELIN-1993](https://issues.apache.org/jira/browse/ZEPPELIN-1993) is resolved <img width="580px" alt="screen shot 2017-02-20 at 2 03 23 am" src="https://cloud.githubusercontent.com/assets/10060731/23104412/c95dccb2-f710-11e6-9602-4159c7182e64.png"> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Author: Ahyoung Ryu <ahyoungryu@apache.org> Closes #2037 from AhyoungRyu/ZEPPELIN-2109 and squashes the following commits: 7393c6a [AhyoungRyu] Change '==' to '===' to make CI green 0fd68ba [AhyoungRyu] Remove useless comment code 569f9c9 [AhyoungRyu] Add guide dialog msg for INTERPRETER type pkg e6ccc28 [AhyoungRyu] Fix typo in docs bb34428 [AhyoungRyu] Package orderBy publishedDate a5eb006 [AhyoungRyu] Add 'spell' to description 1707882 [AhyoungRyu] Get publishedDate, artifactId and groupId from online registry data 03312ac [AhyoungRyu] Fix interpreter type name duplication 95b0b87 [AhyoungRyu] Fix mistakes made by resolving conflicts 894a27e [Ahyoung Ryu] Merge branch 'master' into ZEPPELIN-2109 d5ae4e2 [AhyoungRyu] Add default msg to show when each package size is 0 899e8fa [AhyoungRyu] Put license sentences back removed by mistake c68efd2 [AhyoungRyu] Remove unused img files 6d7f4fa [AhyoungRyu] Make packages sortable by type not repository 86e1eda [AhyoungRyu] Remove unnecassary words b74c599 [AhyoungRyu] Remove console.log 4a6eace [AhyoungRyu] Enable Helium pkg type sortable f1c7bac [AhyoungRyu] Add 'INTERPRETER', 'APPLICATION' as helium pkg types 6de9169 [AhyoungRyu] Add img files	2017-03-07 21:02:20 +09:00
Paolo Genissel	79ace932a9	[ZEPPELIN-1968] Added property to disable hive user impersonation ... ### What is this PR for? Added new property "hive.proxy.user" to disable hive impersonation (on some clusters, this option is disabled) in order to make Hive Interpreter even without this ### What type of PR is it? Feature ### Todos ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1968 ### How should this be tested? Set "hive.proxy.user" to true in the jdbc interpreter setttings, and you should see "Using hive proxy user" in the jdbc logs. If "hive.proxy.user" has another value, this is not mentionned in the logs You can also test with the appropriate hive configuration, but this could take longer :) ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: Paolo Genissel <paolo.genissel-monsallier@1000mercis.com> Closes #2051 from gfalcone/hive_impersonation and squashes the following commits: a39d11c [Paolo Genissel] Fixed last NPE 1f7f685 [Paolo Genissel] Fixed NPE when getting hive.proxy.user property 433eefb [Paolo Genissel] Added documentation for feature d6f0c62 [Paolo Genissel] Added property to disable hive user impersonation	2017-03-07 13:32:22 +05:30
Tinkoff DWH	ebd5e1e9b6	[ZEPPELIN-1988] add property "precode" to JDBCInterpreter ... ### What is this PR for? Adds property "precode". Value of property contains SQL which executes while opening connection. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1988 ### How should this be tested? 1) Set property zeppelin.interpreter.precode =` set search_path='test, public' ` 2) Execute `%jdbc show search_path` ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Tinkoff DWH <tinkoff.dwh@gmail.com> Closes #2078 from tinkoff-dwh/ZEPPELIN-1988 and squashes the following commits: cd46cce [Tinkoff DWH] [ZEPPELIN-1988] trim precode 42ffcb7 [Tinkoff DWH] [ZEPPELIN-1988] fix condition 7636b3f [Tinkoff DWH] Merge remote-tracking branch 'origin/master' into ZEPPELIN-1988 66d6ae4 [Tinkoff DWH] [ZEPPELIN-1988] fixes of review items 9d37bc4 [Tinkoff DWH] [ZEPPELIN-1988] fix ba3477a [Tinkoff DWH] [ZEPPELIN-1988] add property "precode" to JDBCInterpreter	2017-03-06 23:15:44 -08:00
soralee	281e326d1c	[ZEPPELIN-2130][Doc]Do not use web development port ... ### What is this PR for? If user uses web application development port such like 9000 which is default value, Zeppelin is not working because of this [line](https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/components/baseUrl/baseUrl.service.js#L27). So, Zeppelin site need to guide this content until fixing this line (I'll improve to flexible web application development port later). ### What type of PR is it? [ Documentation ] ### What is the Jira issue? * [ZEPPELIN-2130](https://issues.apache.org/jira/browse/ZEPPELIN-2130) ### How should this be tested? 1. Run document development mode. 2. Connect `http://localhost:4000/install/configuration.html#zeppelin-properties` on browser. 3. Check the description of `ZEPPELIN_PORT` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: soralee <sora0728@zepl.com> Closes #2073 from soralee/ZEPPELIN-2130_webDevPort_Doc and squashes the following commits: 8ae57cf [soralee] ZEPPELIN-2130_remove_dot 0499bd3 [soralee] ZEPPELIN-2130_update_sentence 094f29e [soralee] ZEPPELIN-2130_update_sentence ee02c62 [soralee] ZEPPELIN-2130_update_sentence ac133ca [soralee] ZEPPELIN-2130_do_not_use_webDebPort	2017-03-05 16:14:26 +09:00
Jeff Zhang	bab985461c	ZEPPELIN-2195. Use PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON over zeppelin.pyspark.python ... ### What is this PR for? `zeppelin.pyspark.python` is zeppelin configuration for the python exec on driver side, it won't affect executor side. It would be better to use `PYSPARK_PYTHON` and `PYSPARK_DRIVER_PYTHON` which is what spark use officially. So that user can define their own python exec in interpreter setting for different version of python rather than defining them `zeppelin-env.sh` which is shared globally. ### What type of PR is it? [ Improvement ] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2195 ### How should this be tested? Tested it manually. ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #2079 from zjffdu/ZEPPELIN-2195 and squashes the following commits: fa71cb2 [Jeff Zhang] address comments fd89a1e [Jeff Zhang] ZEPPELIN-2195. Use PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON over zeppelin.pyspark.python	2017-03-02 22:51:06 -08:00
Daniel Jeon	b13cc38dc7	add zeppelin.dep.localrepo in zeppelin config ... <property> <name>zeppelin.dep.localrepo</name> <value>local-repo</value> <description>Local repository for dependency loader</description> </property> ### What is this PR for? I wanted to change the default directory somewhere else. and then property input 'zeppelin.dep.localrepo'. And I refer to the Zeppelin document and change the location as shown in the screenshot below. reference : https://zeppelin.apache.org/docs/latest/interpreter/spark.html ### What type of PR is it? Improvement ### Todos * [ ] - Task ### What is the Jira issue? * Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/ * Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533] ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Daniel Jeon <oeegee@gmail.com> Closes #2012 from oeegee/master and squashes the following commits: b8d4dc7 [Daniel Jeon] add content of property : "ZEPPELIN_DEP_LOCALREPO", zeppelin.dep.localrepo 2c4ff88 [Daniel Jeon] add zeppelin.dep.localrepo in zeppelin config	2017-03-02 13:24:56 +09:00
Jeff Zhang	a26bd2d76a	[MINOR] add pig wiki page to pig doc ... ### What is this PR for? Add pig wiki page pig doc ### What type of PR is it? [Documentation |] ### Todos * [ ] - Task ### What is the Jira issue? No jira created ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #2004 from zjffdu/pig_doc and squashes the following commits: e5a564a [Jeff Zhang] rename zeppelin to Zeppelin and pig to Pig 65458ff [Jeff Zhang] address comments and minor update on pig tutorial c6cb5ff [Jeff Zhang] update pig tutorial b8542de [Jeff Zhang] [MINOR] add pig wiki page to pig doc	2017-02-28 13:12:02 +09:00
AhyoungRyu	8bb37c2c2e	[DOCS][ZEPPELIN-2140] Add docs for notebookRepo REST API ... ### What is this PR for? Added a docs page for notebookRepo REST API based on [NotebookRepoRestApi.java](https://github.com/apache/zeppelin/blob/master/zeppelin-server/src/main/java/org/apache/zeppelin/rest/NotebookRepoRestApi.java). And this PR will cover "notebook repository reload endpoint" : #2043 as well. ### What type of PR is it? Documentation ### What is the Jira issue? [ZEPPELIN-2140](https://issues.apache.org/jira/browse/ZEPPELIN-2140) ### How should this be tested? Just checking screenshots will be faster! ### Screenshots (if appropriate) - In navbar <img width="300" alt="screen shot 2017-02-25 at 11 02 02 pm" src="https://cloud.githubusercontent.com/assets/10060731/23331707/76551c8a-fbae-11e6-99b8-cc686e208c39.png"> - API description list <img width="751" alt="screen shot 2017-02-25 at 10 54 21 pm" src="https://cloud.githubusercontent.com/assets/10060731/23331704/57dd7d4c-fbae-11e6-8cc2-189fc9e68ece.png"> <img width="715" alt="screen shot 2017-02-25 at 10 54 29 pm" src="https://cloud.githubusercontent.com/assets/10060731/23331708/85f722a0-fbae-11e6-9b40-7f4c98761dd6.png"> <img width="730" alt="screen shot 2017-02-25 at 10 54 38 pm" src="https://cloud.githubusercontent.com/assets/10060731/23331709/8882b93a-fbae-11e6-9fe2-95bc2620e2c9.png"> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #2067 from AhyoungRyu/ZEPPELIN-2140 and squashes the following commits: c73e9b2 [AhyoungRyu] Fix typo :D 7d41435 [AhyoungRyu] Add underscore escaper 8eac3dd [AhyoungRyu] Add a docs page for notebookRepoRestApi	2017-02-28 13:02:02 +09:00
Jun Kim	5e75145ac8	[ZEPPELIN-1859] Add MongoNotebookRepo ... ### What is this PR for? This PR adds Mongo notebook storage. The reason that I made this feature is for HA(High Availability). S3 and Git storage are the only available method for HA as far as I know. I'm managing Ambari cluster in my lab, but Zeppelin is the most vulnerable part of it. Because one server contains all Zeppelin notes. Therefore, by deploying MongoDB's [replica set](https://docs.mongodb.com/manual/replication/) and using it as Zeppelin notebook storage, I would like to achieve HA. #### The way to use Mongo DB as notebook storage ```sh export ZEPPELIN_NOTEBOOK_STORAGE=org.apache.zeppelin.notebook.repo.MongoNotebookRepo ``` or at `zeppelin-site.xml`: ```xml <property> <name>zeppelin.notebook.storage</name> <value>org.apache.zeppelin.notebook.repo.MongoNotebookRepo</value> <description>notebook persistence layer implementation</description> </property> ``` #### Configurable environment variables * `ZEPPELIN_NOTEBOOK_MONGO_URI` MongoDB connection URI * `ZEPPELIN_NOTEBOOK_MONGO_DATABASE` Database name * `ZEPPELIN_NOTEBOOK_MONGO_COLLECTION` Collection name * `ZEPPELIN_NOTEBOOK_MONGO_AUTOIMPORT` If `true`, automatically import your local notes. Default `false` They can be configured at `zeppelin-site.xml` as well: * `zeppelin.notebook.mongo.uri` * `zeppelin.notebook.mongo.database` * `zeppelin.notebook.mongo.collection` * `zeppelin.notebook.mongo.autoimport` #### Future work If we use Mongo DB's [oplog tailing](https://docs.mongodb.com/manual/core/replica-set-oplog/), maybe multi-server architecture is possible. ### What type of PR is it? [Feature] ### Todos * [ ] - Write a documentation for Mongo storage ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1859 ### How should this be tested? #### Install MongoDB (if you don't have) ```sh brew update brew install mongodb ``` #### Build Zepppelin ```sh mvn clean package -DskipTests ``` #### Run Zeppelin wih Mongo storage ```sh export ZEPPELIN_NOTEBOOK_STORAGE=org.apache.zeppelin.notebook.repo.MongoNotebookRepo export ZEPPELIN_NOTEBOOK_MONGO_AUTOIMPORT=true bin/zeppelin-daemon.sh restart ``` The default database and collection names are `zeppelin`, `notes` respectively. And `ZEPPELIN_NOTEBOOK_MONGO_AUTOIMPORT` option will automatically import your `local notes` that don't exist in MongoDB. #### Check whether a document in MongoDB updated Create, update, remove a note and open mongo shell: ```sh mongo zeppelin ``` And check state of the note is the same as you think: ```sh db.notes.findOne({_id: '<NOTE_ID_THAT_YOU_WANT_TO_SEE>'}) ``` #### Confirm that configurations works ```sh export ZEPPELIN_NOTEBOOK_STORAGE=org.apache.zeppelin.notebook.repo.MongoNotebookRepo export ZEPPELIN_NOTEBOOK_MONGO_AUTOIMPORT=true export ZEPPELIN_NOTEBOOK_MONGO_DATABASE=otherdb export ZEPPELIN_NOTEBOOK_MONGO_COLLECTION=mynotes export ZEPPELIN_NOTEBOOK_MONGO_URI=mongodb://localhost:27017 bin/zeppelin-daemon.sh restart ``` The collection `mynotes` should be created in db `otherdb`. Let's check it! ```sh mongo otherdb db.mynotes.count() ``` The result should not be zero. #### Confirm that configurations from `zeppelin-site.xml` works Open your `conf/zeppelin-site.xml` file (copy from `zeppelin-site.xml.template` if you don't have one), and comment lines below: ```xml <!-- <property> <name>zeppelin.notebook.storage</name> <value>org.apache.zeppelin.notebook.repo.VFSNotebookRepo</value> <description>notebook persistence layer implementation</description> </property> --> ``` And add lines below: ```xml <property> <name>zeppelin.notebook.storage</name> <value>org.apache.zeppelin.notebook.repo.MongoNotebookRepo</value> <description>notebook persistence layer implementation</description> </property> <property> <name>zeppelin.notebook.mongo.uri</name> <value>mongodb://localhost</value> <description>MongoDB connection URI used to connect to a MongoDB database server</description> </property> <property> <name>zeppelin.notebook.mongo.database</name> <value>zepl</value> <description>database name for notebook storage</description> </property> <property> <name>zeppelin.notebook.mongo.collection</name> <value>notes</value> <description>collection name for notebook storage</description> </property> <property> <name>zeppelin.notebook.mongo.autoimport</name> <value>false</value> <description>import local notes into MongoDB automatically on startup</description> </property> ``` This time we will import a note via `mongoimport`. I made it possible to import a note from JSON just in case. ```sh cd $ZEPPELIN_HOME/notebook/<NOTE_ID_YOU_WANT_TO_IMPORT> mongoimport --db zepl --collection notes --file note.json ``` Ensure that your environment variables are clean(just reopen your terminal if you are not), and restart zeppelin: ```sh bin/zeppelin-daemon.sh restart ``` Open browser and go to `localhost:8080`. The note that you imported should be shown. ### Questions: * Does the licenses files need update? Maybe...? I used [java-mongodb-driver](https://mvnrepository.com/artifact/org.mongodb/mongo-java-driver/3.4.1) which has *The Apache Software License, Version 2.0* * Is there breaking changes for older versions? NO * Does this needs documentation? YES Author: Jun Kim <i2r.jun@gmail.com> Closes #1826 from tae-jun/ZEPPELIN-1859 and squashes the following commits: 98282ae [Jun Kim] Add a documentation for MongoDB notebook storage 77947b8 [Jun Kim] Add license information of mongo-java-driver 08eee3d [Jun Kim] fix style check error a4fba8c [Jun Kim] Add MongoNotebookRepo	2017-02-21 09:29:09 +09:00
Lee moon soo	ddce5fe0b8	[ZEPPELIN-2123] [DOC] Link contribution guide ... ### What is this PR for? This is minor update that add link to contribution guide ### What type of PR is it? Documentation ### Todos * [x] - add link to contribution guide ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2123 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #2029 from Leemoonsoo/ZEPPELIN-2123-doc and squashes the following commits: d09b447 [Lee moon soo] Link contribution guide	2017-02-19 18:26:19 +09:00
1ambda	90e8b80b56	[ZEPPELIN-2070][DOCS] Create Docs for Spell ... ### What is this PR for? Docs for Spell which was added by #1940 ### What type of PR is it? [Documentation] ### Todos * [x] - Add docs for spell * [x] - Fix typo in vis docs ### What is the Jira issue? [ZEPPELIN-2070](https://issues.apache.org/jira/browse/ZEPPELIN-2070) ### How should this be tested? - `cd docs` - `/usr/local/bin/bundle exec jekyll serve --watch` - Open `http://localhost:4000/development/writingzeppelinspell.html` ### Screenshots (if appropriate)   ### Questions: * Does the licenses files need update? - NO * Is there breaking changes for older versions? - NO * Does this needs documentation? - YES Author: 1ambda <1amb4a@gmail.com> Closes #1998 from 1ambda/ZEPPELIN-2070/docs-for-spell and squashes the following commits: dbb8082 [1ambda] fix: Typo af63ff6 [1ambda] fix: Enhance spell doc 9fd2a3b [1ambda] fix: Typo 0851ad1 [1ambda] fix: Typo in spell doc 00d5158 [1ambda] fix: Indent c7dc9bd [1ambda] fix: Typo in writing in viz bcc9b3e [1ambda] docs: Add docs for spell 83ee050 [1ambda] docs: Add spell doc to nav 04deb81 [1ambda] fix: Invalid desc in vis docs	2017-02-16 10:25:55 +09:00
AhyoungRyu	d053e5b333	[MINOR][ZEPPELIN-2100] Enable to go back to zeppelin.apache.org in docs site ... ### What is this PR for? Currently there is no link to go back to [zeppelin.apache.org](https://zeppelin.apache.org) in each docs site. It's a bit inconvenient. e.g. In [https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/](https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/), if I click Zeppelin main logo, it keeps me staying in docs main page not the root: [zeppelin.apache.org](https://zeppelin.apache.org). So I separated main logo in navbar to "Zeppelin" and "version". And linked [production_url](https://github.com/apache/zeppelin/blob/master/docs/_config.yml#L34) and [BASE_PATH](https://github.com/apache/zeppelin/blob/master/docs/_config.yml#L62) to each of them. Please see the below screenshot img. ### What type of PR is it? Improvement ### What is the Jira issue? [ZEPPELIN-2100](https://issues.apache.org/jira/browse/ZEPPELIN-2100) ### How should this be tested? Run docs site locally under `ZEPPELIN_HOME/docs` as described in here: [Run website locally](https://github.com/apache/zeppelin/blob/master/docs/README.md#run-website-locally) ### Screenshots (if appropriate) In [https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/](https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/), - Before <img width="400px" src="https://cloud.githubusercontent.com/assets/10060731/22860466/6064c964-f142-11e6-9bc1-bbd34fa42c18.png"> - After <img width="500px" src="https://cloud.githubusercontent.com/assets/10060731/22860469/69364568-f142-11e6-963d-7b6ab33330c3.png"> ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #2008 from AhyoungRyu/change/mainLogoUrlToOfficialSite and squashes the following commits: 335e625 [AhyoungRyu] Fix indentation 80f724c [AhyoungRyu] Set main logo url to zeppelin.apache.org not docs site	2017-02-16 10:21:06 +09:00
AhyoungRyu	99f01f7fa0	[MINOR][ZEPPELIN-2090] Remove "zeppelin.interpreters" property related guide msg ... ### What is this PR for? As we won't support `zeppelin.interpreters` property anymore (from `0.7.0`), the related msg should be removed accordingly. So I removed it from [docs/manual/interpreterinstallation.md#install-3rd-party-interpreters](https://github.com/apache/zeppelin/blob/master/docs/manual/interpreterinstallation.md#install-3rd-party-interpreters) & [InstallInterpreter.java#L291](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/install/InstallInterpreter.java#L291). And rewrite some guide msg like below. 1. After successful installation - Before ``` Interpreter spark installed under /Users/ahyoungryu/Dev/zeppelin-bin/zeppelin-0.7.0-bin-netinst/interpreter/spark. Add interpreter class name to 'zeppelin.interpreters' property in your conf/zeppelin-site.xml file Create interpreter setting in 'Interpreter' menu on GUI. And then you can bind interpreter on your notebook ``` - After ``` Interpreter spark installed under /Users/ahyoungryu/Dev/zeppelin-development/zeppelin/interpreter/spark. 1. Restart Zeppelin 2. Create interpreter setting in 'Interpreter' menu on Zeppelin GUI 3. Then you can bind the interpreter on your note ``` 2. If it's skipped (since the interpreter dir already existed) - Before ``` Directory /Users/ahyoungryu/Dev/zeppelin-bin/zeppelin-0.7.0-bin-netinst/interpreter/flink already exists. Skipping Create interpreter setting in 'Interpreter' menu on GUI. And then you can bind interpreter on your notebook ``` - After ``` Directory /Users/ahyoungryu/Dev/zeppelin-development/zeppelin/interpreter/flink already exists Skipped ``` ### What type of PR is it? just removed unnecessary message :) ### What is the Jira issue? [ZEPPELIN-2090](https://issues.apache.org/jira/browse/ZEPPELIN-2090) ### How should this be tested? 1. Apply this patch and build with ``` $ mvn clean package -DskipTests -pl 'zeppelin-interpreter, zeppelin-zengine, zeppelin-server' ``` 2. Remove `interpreter/spark` ``` $ rm -r interpreter/spark ``` 3. Install Spark using `install-interpreter.sh` ``` $ ./bin/install-interpreter.sh --name spark --artifact org.apache.zeppelin:zeppelin-spark_2.10:0.7.0 ``` Then the msg should be like <img width="866" alt="screen shot 2017-02-09 at 5 06 27 pm" src="https://cloud.githubusercontent.com/assets/10060731/22774373/1fc93e9e-eeea-11e6-8055-3594e18c7d96.png"> ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #1999 from AhyoungRyu/remove/deprecatedTipMsg and squashes the following commits: c7305d0 [AhyoungRyu] Rewrite tip msg & remove deprecated setting msg 5058273 [AhyoungRyu] Remove deprecated interpreter setting msg	2017-02-11 21:29:05 +09:00
AhyoungRyu	0f5f9cb5bb	[MINOR][ZEPPELIN-2087] Make each Zeppelin conf property accessible with anchor link ... ### What is this PR for? Sometimes I need to point some Zeppelin configuration property to let sbd know. But as Zeppelin conf table has too many properties now(about 35), it's hard to find where the property that I'm finding located. So I made each Zeppelin conf property accessible by adding anchor icon next to it. And added <img width="527" alt="screen shot 2017-02-09 at 1 04 20 pm" src="https://cloud.githubusercontent.com/assets/10060731/22768874/4c923998-eec8-11e6-9b16-9355bf6624ab.png"> to let ppl know about this. ### What type of PR is it? Improvement | Documentation ### What is the Jira issue? [ZEPPELIN-2087](https://issues.apache.org/jira/browse/ZEPPELIN-2087) ### How should this be tested? 1. Build `/docs` as described in [here](https://github.com/apache/zeppelin/tree/master/docs#build-documentation) 2. Go to "Quick Start" ->"Getting Started" -> "Configuration" 3. Mouse hover on each property and click the anchor icon -> check the url header bar ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #1997 from AhyoungRyu/docs/eachConfWithAnchor and squashes the following commits: 9082f3b [AhyoungRyu] Make each Zeppelin conf accessible with anchor link	2017-02-11 21:07:12 +09:00
jpgbus	db691db998	[ZEPPELIN-1700] Update docs for ZEPPELIN_INTERPRETER_CONNECT_TIMEOUT ... ### What is this PR for? Update docs to let devs know about [ZEPPELIN_INTERPRETER_CONNECT_TIMEOUT](5bb38c89ae/zeppelin-zengine/src/main/java/org/apache/zeppelin/conf/ZeppelinConfiguration.java (L576)) Some use cases are such that this value would need to be quite a bit higher, e.g., exceed the time required to create the spark executors in a mesos cluster. Developers may not know about this var until after they see the error [ZEPPELIN-1700]. ### What type of PR is it? Documentation ### Todos * [ ] - Review and merge ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1700 ### How should this be tested? Review that the documented values reflect code reality 5bb38c89ae/zeppelin-zengine/src/main/java/org/apache/zeppelin/conf/ZeppelinConfiguration.java (L576) ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No. * Is there breaking changes for older versions? No. * Does this needs documentation? Yes; it is documentation. Author: jpgbus <jpgbus@users.noreply.github.com> Closes #1993 from jpgbus/patch-1 and squashes the following commits: 22aad28 [jpgbus] This timeout should be included in docs	2017-02-10 02:00:02 +09:00
soralee	4ef14956a6	[HOTFIX] Change the screenshot path in custom page document ... ### What is this PR for? After merging [PR1804](https://github.com/apache/zeppelin/pull/1804), the following screenshot path is fault.   I fixed to change from absolute path to relative path. ### What type of PR is it? [Bug Fix | Hot Fix] ### What is the Jira issue? * None ### How should this be tested? 1. Run website locally 2. Please check [Show note list in your custom homepage](http://localhost:4000/manual/notebookashomepage.html#show-note-list-in-your-custom-homepage)  ### Questions: * Does the licenses files need update? * Is there breaking changes for older versions? * Does this needs documentation? Author: soralee <sora0728@zepl.com> Closes #1984 from soralee/notelist_png_path and squashes the following commits: ea6f51f [soralee] change png path	2017-02-08 10:59:49 +09:00
Lee moon soo	304842a3fc	[ZEPPELIN-2042] Document how to run selenium test ... ### What is this PR for? This PR document how to run selenium test in development environment ### What type of PR is it? Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2042 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1967 from Leemoonsoo/doc_run_selenium_test and squashes the following commits: 3e39c29 [Lee moon soo] Some info how to install firefox 31.0 295b700 [Lee moon soo] fix typo e1312f3 [Lee moon soo] Add 'Run Selenium test' section	2017-02-07 14:00:14 +09:00
Jeff Plourde	5bb38c89ae	[ZEPPELIN-1465] Add an option to allow S3 server-side encryption ... ### What is this PR for? Provide a configuration option that will cause the S3 Notebook repo to request server-side encryption of saved notebooks. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1465 ### How should this be tested? Enable the configuration option, save a notebook in zeppelin, and confirm in the AWS S3 Console that the related file was saved with AES-256 encryption on the server-side. (Properties tab, Detail section) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No. * Does this needs documentation? I added mentions of the new option in existing documentation. Thank you! Author: Jeff Plourde <jplourde@cyft.io> Closes #1969 from jeff-cyft/s3_sse and squashes the following commits: 26f5264 [Jeff Plourde] code style - remove tab 3c657ac [Jeff Plourde] Configuration option to request S3 SSE when notebooks are saved.	2017-02-05 15:55:08 +09:00
Viktor Boginskii	e42a8c5c16	[ZEPPELIN-2014] Jetty Directory Listing on app, assets, components, and scripts ... ### What is this PR for? Added property for enable/disable public access to directories on server from Web ### What type of PR is it? [Bug Fix] ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2014 ### How should this be tested? Run application and try get list of files in app directory from web. You will see a response with the code 403. Previously, we saw all files in the directory. Change property "zeppelin.server.default.dir.allowed" to true and restart server. Try again, all files should be visible. ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: Viktor Boginskii <Viktor_Boginskii@epam.com> Closes #1962 from vboginskii/ZEPPELIN-2014 and squashes the following commits: c06ec30 [Viktor Boginskii] [ZEPPELIN-2014] Added property for control public access to directories on server.	2017-02-04 09:16:42 +09:00
Khalid Huseynov	20fd2a9c8c	[ZEPPELIN-2036] add documentation on separating workspaces (public/private) ... ### What is this PR for? This is to add more description in documentation about notebook workspaces. Also some details from user mailing list [here](https://lists.apache.org/thread.html/d94276521942c90cca1325514ea93b737a517679dd0f6f7eb287492a%3Cusers.zeppelin.apache.org%3E) ### What type of PR is it? Improvement | Documentation ### Todos * [x] - add desc ### What is the Jira issue? [ZEPPELIN-2036](https://issues.apache.org/jira/browse/ZEPPELIN-2036) ### How should this be tested? green CI/ if description clear ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Khalid Huseynov <khalidhnv@gmail.com> Closes #1965 from khalidhuseynov/docs/private-workspace and squashes the following commits: fae6410 [Khalid Huseynov] fix formating: add lines c85ee6e [Khalid Huseynov] rewording cec8bbd [Khalid Huseynov] add public vs. private 8703770 [Khalid Huseynov] add description on separating workspaces	2017-02-03 21:14:23 +09:00
Jongyoul Lee	9d90ccca69	[ZEPPELIN-2003] Remove PostgresqlInterpreter ... ### What is this PR for? We don't have to maintain PostgresqlInterpreter because JDBCInterpreter covers all functions of PostgresqlInterpreter. It reduces maintenance costs. ### What type of PR is it? [Feature] ### Todos * [x] - Remove files and lines related to PostgresqlInterpreter ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-2003 ### How should this be tested? N/A ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? Yes * Does this needs documentation? Yes, but already documented in jdbc docs Author: Jongyoul Lee <jongyoul@gmail.com> Closes #1945 from jongyoul/ZEPPELIN-2003 and squashes the following commits: 5dc58f2 [Jongyoul Lee] Fixed doc ec31f78 [Jongyoul Lee] Change docs to make a link to jdbc.md bfd70ef [Jongyoul Lee] Removed Postgresql from docs and configurations 98a106e [Jongyoul Lee] Removed whole packages about Postgresql	2017-02-02 15:54:19 +09:00
soralee	42be8396c3	[ZEPPELIN-1578] notes list in customizing zeppelin homepage isn't working ... ### What is this PR for? Customizing the Zeppelin Homepage to show the notebook list does not work as [0.6.2 document](http://zeppelin.apache.org/docs/0.6.2/manuala/notebookashomepage.html#show-notebooks-list-in-your-custom-homepage). Furthermore, it is not working on 0.7.0 version ([0.7.0 document](http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/manual/notebookashomepage.html#show-notes-list-in-your-custom-homepage)). That reason is that get_home message of zeppelin websocket is called in zeppelin-web twice. At this chance, I suggest to split role to HomeCtrl and CustomHomeCtrl because when "Home.controller.js" is update, It could be conflicted like current issue. So I think it would be more convenient to manage the roles separately. ### What type of PR is it? [Bug Fix | Feature | Documentation ] ### Todos * None ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1578 ### How should this be tested? - After write the following code in paragraph, run it. ``` println( """%angular <div ng-include="'app/home/notebook.html'"></div> """) ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: soralee <sora0728@nflabs.com> Closes #1804 from soralee/ZEPPELIN-1578 and squashes the following commits: 1422ebe [soralee] modify document and screenshot da5b852 [soralee] modify document and screenshot c228f61 [soralee] enable homescreen without browser error 6b3881f [soralee] enable homescreen 8b605c8 [soralee] rm old files e752e48 [soralee] modify screenshot a9036a8 [soralee] rename files 473bce4 [soralee] using home-template both home.html and customHome.html 028f873 [soralee] resolve conflict 55b7ddc [soralee] resolve conflict 229ed37 [soralee] bug fix d18e513 [soralee] for rebase it b933784 [soralee] apply homepage template f4917eb [soralee] remove old img file f7e6bc6 [soralee] remove file f77a32c [soralee] improve customer hompage b836354 [soralee] rebase master cad590f [soralee] fix to show text after searching note 58d08f8 [soralee] notes list in custom homepage isn't working	2017-02-01 21:03:03 +09:00
Bruno Bonnin	e763b3bf3e	[ZEPPELIN-1821] Add HTTP client to elasticsearch interpreter ... ### What is this PR for? Add HTTP client to elasticsearch interpreter. ### What type of PR is it? Feature ### Todos * [X] - Source code * [X] - Tests * [X] - License * [X] - Docs ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1821 ### How should this be tested? * Start an Elasticsearch node * Configure the elasticsearch interpreter to use http * Create queries in a note using elasticsearch ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? Yes * Is there breaking changes for older versions? No * Does this needs documentation? Yes Author: Bruno Bonnin <bbonnin@gmail.com> Author: Bruno Bonnin <bruno.bonnin@myscript.com> Closes #1902 from bbonnin/master and squashes the following commits: f5a539e [Bruno Bonnin] Remove commented code lines 86153a8 [Bruno Bonnin] Merge remote-tracking branch 'upstream/master' 2e1bbbd [Bruno Bonnin] Merge remote-tracking branch 'upstream/master' 19e888e [Bruno Bonnin] Remove bad code in test 523d155 [Bruno Bonnin] Replace Java 8 methods 6bcf369 [Bruno Bonnin] Fix issue with id containing special chars (/, #) 4e9812e [Bruno Bonnin] Merge elasticsearch/pom.xml 5a96ae0 [Bruno Bonnin] Merge branch 'master' into master e2365fb [Bruno Bonnin] Update elasticsearch/pom.xml 28b9805 [Bruno Bonnin] Update img 549db39 [Bruno Bonnin] Add HTTP client to elasticsearch interpreter f4c5ac3 [Bruno Bonnin] HTTP-based Elasticsearch client	2017-01-30 08:04:49 +09:00
Lee moon soo	940a8b7d36	[ZEPPELIN-2004] List all helium packages in Zeppelin GUI ... ### What is this PR for? ZEPPELIN-1973 will provides catalogue for all available helium (visualization) packages in npm registry. And https://github.com/apache/zeppelin/pull/1935 shows available packages in Zeppelin website. This PR make Zeppelin reads package information and display in Zeppelin's helium gui menu. To do that, this PR changes configuration environment variable (java property) from ``` ZEPPELIN_HELIUM_LOCALREGISTRY_DEFAULT (zeppelin.helium.localregistry.default) ``` to ``` ZEPPELIN_HELIUM_REGISTRY (zeppelin.helium.registry) ``` and allow multiple comma separated items. Registry is either filesystem directory (e.g. `/helium`) or http location. default value is `helium,https://s3.amazonaws.com/helium-package/helium.json` ### What type of PR is it? Feature ### Todos * [x] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-2004 ### How should this be tested? Go to helium menu and check if you can see packages available. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? yes `ZEPPELIN_HELIUM_LOCALREGISTRY_DEFAULT` changed to `ZEPPELIN_HELIUM_REGISTRY` * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1936 from Leemoonsoo/ZEPPELIN-2004 and squashes the following commits: 80bbebd [Lee moon soo] update doc 53f0caa [Lee moon soo] update test 65c6092 [Lee moon soo] Cache online registry under local-repo for offline support b2985e9 [Lee moon soo] Add user agent f562b12 [Lee moon soo] Use only local helium registry to run test 9fabeae [Lee moon soo] implement online registry	2017-01-29 07:45:28 +09:00
Mina Lee	7b7625db10	[ZEPPELIN-2000] Run paragraph on enter when select dynamic form value changed ... ### What is this PR for? Run paragraph on enter when select dynamic form value changed to make paragraph runnable in report mode. ### What type of PR is it? Bug Fix | Hot Fix ### What is the Jira issue? [ZEPPELIN-2000](https://issues.apache.org/jira/browse/ZEPPELIN-2000) ### How should this be tested? 1. Go to `Zeppelin Tutorial/Basic Features (Spark)` notebook 2. Change view mode to `report`. 3. Change selected value from `married` to `single` in 5th paragraph and hit enter. 4. See if paragraph runs ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes. docs update included. Author: Mina Lee <minalee@apache.org> Closes #1932 from minahlee/ZEPPELIN-2000 and squashes the following commits: a9f02d2 [Mina Lee] Update docs 66b513c [Mina Lee] Run paragraph onEnter when select value changed	2017-01-24 09:59:21 +09:00
Lee moon soo	14d13de06d	[ZEPPELIN-1976] Text-Output too large, causing crash ... ### What is this PR for? This PR implements interpreter output message limit. `ZEPPELIN_INTERPRETER_OUTPUT_LIMIT` env variable or `zeppelin.interpreter.output.limit` jvm property can set limit of the interpreter output message in byte. The limit applied to only TEXT and TABLE type output, not in HTML or other types. ### What type of PR is it? Improvement ### Todos * [x] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1976 ### How should this be tested? try to print more than the limit ``` %spark (1 to 10000).foreach(i=> println(s"Print line ${i} times") ) ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1908 from Leemoonsoo/ZEPPELIN-1976 and squashes the following commits: 639868b [Lee moon soo] update description a9b4139 [Lee moon soo] Truncate output	2017-01-23 01:32:13 -08:00
cloverhearts	5eeebeb0aa	[ZEPPELIN-1869] changed the API response to generate to 200. ... ### What is this PR for? A few sentences describing the overall goals of the pull request's commits. First time? Check out the contributing guide - https://zeppelin.apache.org/contribution/contributions.html ### What type of PR is it? Documentation | change ### Todos - [x] replace to doc - [x] change response 201 -> 200 ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1869 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: cloverhearts <cloverheartsdev@gmail.com> Closes #1814 from cloverhearts/ZEPPELIN-STATUS-CHANGE-API and squashes the following commits: 0f2f5bd [cloverhearts] change test case in notebooksecurity 1be0968 [cloverhearts] fixed more isCreated to isAllowed cfcb6fd [cloverhearts] change test case in zeppelin rest api test 7bbfcd1 [cloverhearts] change status value in test case http f9fcbc8 [cloverhearts] Revert "refix" ed31788 [cloverhearts] refix 754309e [cloverhearts] Apply to api success status code 200	2017-01-19 22:22:26 -08:00
Mina Lee	26808e3a07	[DOCS] Update interpter installation guide ... ### What is this PR for? * Update Scio interpreter's artifact name from `scio` to `scio_2.11`, which will be used for installing scio interpreter from netinst binary package. * Fix typos ### What type of PR is it? Documentation | Hotfix ### What is the Jira issue? ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Mina Lee <minalee@apache.org> Closes #1906 from minahlee/docs/interpreterInstall and squashes the following commits: 56eeab3 [Mina Lee] Update interpter installation guide	2017-01-19 13:58:40 +09:00
Mina Lee	61aeeaf10f	Bump up version to 0.8.0-SNAPSHOT ... ### What is this PR for? Bump up version to 0.8.0-SNAPSHOT Author: Mina Lee <minalee@apache.org> Closes #1883 from minahlee/0.8.0-SNAPSHOT and squashes the following commits: b28ebe8 [Mina Lee] Bump up table/visualization plugin package version fcaaa46 [Mina Lee] Bump up helium-dev version 180d2c6 [Mina Lee] Bump up version to 0.8.0-SNAPSHOT	2017-01-19 02:04:24 +09:00