### What is this PR for?
While removing duplication of specifying build profile in #1321, build profile has been changed from `-Ppublish-distr` to `-Pbuild-distr`. We need to restore this change and use `-Ppublish-distr` profile to publish `*.javadoc.jar ` and `*.sources.jar`.
### What type of PR is it?
Hot Fix
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Mina Lee <minalee@apache.org>
Closes#1506 from minahlee/build_profile and squashes the following commits:
b84b371 [Mina Lee] Change build profile for distributing artifact to maven repository
### What is this PR for?
In `dev/publish_release.sh` there are two mvn build. Second build fails with follow error:
```
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (start-zeppelin) on project zeppelin-server: An Ant BuildException has occured: The directory /private/tmp/zeppelin-release/zeppelin/zeppelin-server/${zeppelin.daemon.package.base} does not exist
[ERROR] around Ant part ...<exec spawn="true" dir="${zeppelin.daemon.package.base}" executable="./zeppelin-daemon.sh">... 4:94 in /private/tmp/zeppelin-release/zeppelin/zeppelin-server/target/antrun/build-main.xml
```
This PR skip tests to fix this issue as hotfix. In addition, it will reduce build time
### What type of PR is it?
Build
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Mina Lee <minalee@apache.org>
Closes#1321 from minahlee/build_skipTests and squashes the following commits:
c1aa845 [Mina Lee] Add -DskipTests property to reduce build time
### What is this PR for?
Remove bigquery interpreter from netinst package
### What type of PR is it?
Build
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Mina Lee <minalee@apache.org>
Closes#1306 from minahlee/netinst/remove_bigquery and squashes the following commits:
0604840 [Mina Lee] Remove bigquery interpreter from netinst package
### What is this PR for?
- build distribution package with Spark 2.0 and Scala 2.11
- change travis profile to use spark 2.0 instead of 2.0.0-preview by removing `-Dspark.version=2.0.0-preview` property
- Change profile activation rule
* current way of profile activation is not proper for supporting more than three scala version
* -Pscala-2.11 activates both scala-2.10 and scala-2.11 profile without this patch
### What type of PR is it?
Build
### What is the Jira issue?
[ZEPPELIN-1256](https://issues.apache.org/jira/browse/ZEPPELIN-1256)
### How should this be tested?
**Before**
Run `mvn help:active-profiles -Pscala-2.11`:
```
Active Profiles for Project 'org.apache.zeppelin:zeppelin:pom:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-interpreter:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-zengine:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-display_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-display_2.11:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark-dependencies_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- spark-2.0 (source: org.apache.zeppelin:zeppelin-spark-dependencies_2.11:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- exclude-sparkr (source: org.apache.zeppelin:zeppelin-spark_2.11:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-markdown:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-angular:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-shell:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-livy:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-hbase:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-postgresql:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-jdbc:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-file:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-flink_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-ignite_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-kylin:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-python:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-lens:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-cassandra_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-elasticsearch:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-alluxio:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-web:war:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-server:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-server:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-distribution:pom:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-distribution:0.7.0-SNAPSHOT)
- scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
```
**After**
Run `mvn help:active-profiles -Dscala-2.11`:
```
Active Profiles for Project 'org.apache.zeppelin:zeppelin:pom:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-interpreter:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-zengine:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-display_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-display_2.11:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark-dependencies_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- spark-2.0 (source: org.apache.zeppelin:zeppelin-spark-dependencies_2.11:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- exclude-sparkr (source: org.apache.zeppelin:zeppelin-spark_2.11:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-markdown:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-angular:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-shell:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-livy:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-hbase:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-postgresql:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-jdbc:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-file:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-flink_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-ignite_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-kylin:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-python:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-lens:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-cassandra_2.11🫙0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-elasticsearch:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-alluxio:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-web:war:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-server:jar:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-server:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
Active Profiles for Project 'org.apache.zeppelin:zeppelin-distribution:pom:0.7.0-SNAPSHOT':
The following profiles are active:
- scala-2.11 (source: org.apache.zeppelin:zeppelin-distribution:0.7.0-SNAPSHOT)
- scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT)
```
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes (for scala 2.11 build)
Author: Mina Lee <minalee@apache.org>
Closes#1251 from minahlee/ZEPPELIN-1256 and squashes the following commits:
ff034c6 [Mina Lee] change scala-2.10 and scala-2.11 profile activation rule
99d91bf [Mina Lee] Update interpreter installation for the user who use Spark version <= 1.6.2
4ca3e7f [Mina Lee] Build distribution package with Spark 2.0 and Scala 2.11
### What is this PR for?
- Update publish_release.sh to publish scala 2.10 and scala 2.11 artifacts to maven repository.
- Set build spark version to 2.0
This PR supposed to work once #1186 and #1195 is merged
### What type of PR is it?
Improvement
### What is the Jira issue?
[ZEPPELIN-1180](https://issues.apache.org/jira/browse/ZEPPELIN-1180)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Mina Lee <minalee@apache.org>
Closes#1209 from minahlee/ZEPPELIN-1180 and squashes the following commits:
40e5718 [Mina Lee] Use underscore as word separator in file name for consistency
0a91932 [Mina Lee] Include all module for scala 2.11 artifact build
c1d6439 [Mina Lee] publish 2.11 artifact to maven
a7918f0 [Mina Lee] Fix mod from 755 to 644
bca1af1 [Mina Lee] Fix indentation
### What is this PR for?
Now that we have support for both Scala 2.10 and 2.11 we need to append Scala version to the maven artifact id in order to properly publish artifacts for both Scala releases.
### What type of PR is it?
[Improvement]
### What is the Jira issue?
[ZEPPELIN-1179](https://issues.apache.org/jira/browse/ZEPPELIN-1179)
Author: Luciano Resende <lresende@apache.org>
Closes#1186 from lresende/scala-version and squashes the following commits:
27ec9fe [Luciano Resende] [ZEPPELIN-1179] Properly set scala version during builds
4594607 [Luciano Resende] [ZEPPELIN-1179] Append scala version to remaining maven artifacts
7bed3ec [Luciano Resende] [ZEPPELIN-1179] Append scala version to maven artifacts
### What is this PR for?
Maven artifact publish script fails to close staging repository programmatically because of the duplicate closing braces.
### What type of PR is it?
Bug Fix
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Mina Lee <minalee@apache.org>
Closes#1127 from minahlee/hotfix/removeDuplBrace and squashes the following commits:
608d648 [Mina Lee] Remove duplicate closing brace
### What is this PR for?
- Add sparkr, r profile to netinst release build
- Exit release_publish.sh in case creating staging repository fails
### What type of PR is it?
Hot Fix
### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?
Author: Mina Lee <minalee@apache.org>
Closes#1098 from minahlee/fix/release_script and squashes the following commits:
bf25d5b [Mina Lee] remove quote to make sed works properly
2fee082 [Mina Lee] Add sparkr, r profile to netinst binary package build
### What is this PR for?
Implementation of bin/install-interpreter.sh for netinst package which suggested in the [discussion](http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Ask-opinion-regarding-0-6-0-release-package-tp3298p3314.html).
Some usages will be
```
# download all interpreters provided by Apache Zeppelin project
bin/install-interpreter.sh --all
# download an interpreter with name (for example markdown interpreter)
bin/install-interpreter.sh --name md
# download an (3rd party) interpreter with specific maven artifact name
bin/install-interpreter.sh --name md -t org.apache.zeppelin:zeppelin-markdown:0.6.0-SNAPSHOT
```
If it looks fine, i'll continue the work (refactor code, and add test)
### What type of PR is it?
Feature
### Todos
* [x] - working implementation
* [x] - refactor
* [x] - add test
### What is the Jira issue?
* Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/
* Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533]
### How should this be tested?
Outline the steps to test the PR here.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?
Author: Lee moon soo <moon@apache.org>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Closes#1042 from Leemoonsoo/netinst and squashes the following commits:
f81d16e [Lee moon soo] address mina's comment
049bc89 [Lee moon soo] Update docs
7307c67 [Lee moon soo] Merge remote-tracking branch 'AhyoungRyu/netinst-docs' into netinst
7e749ad [Lee moon soo] Address mina's comment
0eedd2a [AhyoungRyu] Address @minahlee feedback
13f2d04 [Lee moon soo] generate netinst package
03c664e [AhyoungRyu] Add a new line
5d0a971 [AhyoungRyu] Revert install.md to latest version
13899fb [AhyoungRyu] Reorganize interpreter installation docs
4c1f029 [Lee moon soo] Proxy support
9079580 [Lee moon soo] fix artifact name
1077296 [Lee moon soo] update test
aebca17 [Lee moon soo] Add docs
d547551 [Lee moon soo] Remove test entries
6ee06b8 [Lee moon soo] Make DependencyResolver in zeppelin-interpreter module not aware of ZEPPELIN_HOME
7b1b36a [Lee moon soo] update usage
49f0568 [Lee moon soo] Add conf/interpreter-list
1b558fd [Lee moon soo] update some text
ec7d152 [Lee moon soo] add tip
2c81a3f [Lee moon soo] update
78a7c52 [Lee moon soo] Refactor and add test
47f5706 [Lee moon soo] Install multiple interpreters at once
38e2556 [Lee moon soo] Initial implementation of install-interpreter.sh
### What is this PR for?
This PR is to automate release publish to maven repository.
We used to use maven-deploy-plugin and maven-release-plugin for release but somehow it didn't work well with Zeppelin so 0.5.5 and 0.5.6 haven't been published to maven repository.
Publishing release to maven repository will eventually help zeppelin to reduce binary package size by leading users to use Dynamic interpreter loading(#908).
Originally below modules were skipped for maven release
- all interpreters(except spark)
- zeppelin-display
- zeppelin-server
- zeppelin-distribution
on the other hand this pr will skip only:
- zeppelin-distribution
### What type of PR is it?
Infra
### Todos
- [x] Include SparkR/R interpreter in release
- [x] Create common_release.sh to remove build configuration duplication
- [x] Check curl networking failure
### What is the Jira issue?
[ZEPPELIN-986](https://issues.apache.org/jira/browse/ZEPPELIN-986)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? Yes, https://cwiki.apache.org/confluence/display/ZEPPELIN/Preparing+Zeppelin+Release will be updated accordingly once this pr is merged.
Author: Mina Lee <minalee@apache.org>
Closes#994 from minahlee/ZEPPELIN-986 and squashes the following commits:
b0e8e67 [Mina Lee] Revert "Add geode, scalding profile in maven artifact build"
cd4cbcd [Mina Lee] curl failure check
c0ea07c [Mina Lee] Fix wrong indentation
a88bc1d [Mina Lee] Add geode, scalding profile in maven artifact build
2cced61 [Mina Lee] Add r to binary package and maven build
903bc12 [Mina Lee] Move duplicate code to common_release.sh
a3eb676 [Mina Lee] Include zeppelin-server module in publish artifiact
48d338f [Mina Lee] Rollback mistakenly removed plugin
aafaf42 [Mina Lee] Follow google shell style guide
30dcc65 [Mina Lee] remove deploy plugin from pom since custom script will be used instead for deploy
cd1f08c [Mina Lee] Refactor create release script
e764f5f [Mina Lee] Add maven publish release script
### What is this PR for?
git repo infra have moved from incubator-zeppelin to zeppelin
### What type of PR is it?
Hot Fix
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Mina Lee <minalee@apache.org>
Closes#983 from minahlee/ZEPPELIN-980 and squashes the following commits:
7542c31 [Mina Lee] remove travis url after travis migration is done
3793b38 [Mina Lee] Move git repository from incubator-zeppelin to zeppelin
### What is this PR for?
Changed the regex to find a issue number from title. This doesn't change any code about Zeppelin, but this will effect helper script for committers
### What type of PR is it?
[Bug Fix]
### Todos
* [x] - Fixed the bug
### What is the Jira issue?
N/A
### How should this be tested?
```
>>> import re
>>> re.findall("ZEPPELIN-[0-9]{3,4}", "ZEPPELIN-123")
['ZEPPELIN-123']
>>> re.findall("ZEPPELIN-[0-9]{4,5}", "ZEPPELIN-123")
[]
>>> re.findall("ZEPPELIN-[0-9]{3,4,5}", "ZEPPELIN-123")
[]
>>> re.findall("ZEPPELIN-[0-9]{3}", "ZEPPELIN-123")
['ZEPPELIN-123']
>>> re.findall("ZEPPELIN-[0-9]{3,5}", "ZEPPELIN-123")
['ZEPPELIN-123']
>>> re.findall("ZEPPELIN-[0-9]{4,5}", "ZEPPELIN-123")
[]
>>> re.findall("ZEPPELIN-[0-9]{3,5}", "ZEPPELIN-123")
['ZEPPELIN-123']
```
### Screenshots (if appropriate)
N/A
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jongyoul Lee <jongyoul@gmail.com>
Closes#936 from jongyoul/minor-find-issue-number-from-title and squashes the following commits:
63f37af [Jongyoul Lee] [MINOR] fixed logic to find issue number from title
c16117b [Jongyoul Lee] [MINOR] fixed logic to find issue number from title
### What is this PR for?
When using merge_zeppelin_pr.py utility the comment that shows up on issues.apache.org is wrong. The URL that prints is "pulls", it should be "pull"
It shows up as :
Issue resolved by pull request 874
https://github.com/apache/incubator-zeppelin/pulls/874
It should be :
Issue resolved by pull request 874
https://github.com/apache/incubator-zeppelin/pull/874
### What type of PR is it?
[Bug Fix]
### Todos
N/A
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-843
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Prabhjyot Singh <prabhjyotsingh@gmail.com>
Closes#879 from prabhjyotsingh/ZEPPELIN-843 and squashes the following commits:
189f468 [Prabhjyot Singh] fix : Comment showing up on issues.apache.org is wrong
Small update - jira package name has changed
Author: Felix Cheung <felixcheung_m@hotmail.com>
Closes#674 from felixcheung/mergescript and squashes the following commits:
384868b [Felix Cheung] update merge script
### What is this PR for?
Change embedded Spark dependency in binary package for the release from 1.5 to 1.6.
### What type of PR is it?
Improvement
### Todos
### Is there a relevant Jira issue?
### How should this be tested?
build package using dev/create_release.sh and run created package with default configuration. And see output of 'sc.version' if it is based on spark 1.6
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Lee moon soo <moon@apache.org>
Closes#618 from Leemoonsoo/create_release.sh and squashes the following commits:
dc4e2a3 [Lee moon soo] change build profile for binary package release from -Pspark-1.5 to -Pspark-1.6
This PR address https://issues.apache.org/jira/browse/ZEPPELIN-484.
We've got discussions recently about impasse of pullrequest and speeding up of accepting pullrequest.
This small utility can be used when reviewer want to test the pullrequest.
Usage is
```
dev/test.py [#PR]
```
for example
```
dev/test.py 500
```
will create local branch `pr500` and add remote repository of contribution, fetch and merge it for the test.
This script will help reduce small bit of time of reviewing.
Author: Lee moon soo <moon@apache.org>
Closes#513 from Leemoonsoo/ZEPPELIN-484 and squashes the following commits:
76f0ddf [Lee moon soo] Add description
e8a0e8e [Lee moon soo] Rename
1adb356 [Lee moon soo] Handle non-ascii char
39d81ba [Lee moon soo] Add utility for pr test
#407 addressed https://issues.apache.org/jira/browse/ZEPPELIN-406 and merged into branch-0.5.5
This PR applies it to the master branch
Author: Lee moon soo <moon@apache.org>
Closes#424 from Leemoonsoo/ZEPPELIN-406-master and squashes the following commits:
64b6550 [Lee moon soo] Add apache header and inline json message example into doc
ba72645 [Lee moon soo] ZEPPELIN-406 Handle license issue found in 0.5.5-incubating rc2
https://issues.apache.org/jira/browse/ZEPPELIN-397
Activate spark-1.5 and hadoop-2.4 by default
That'll enable use sc.textFile("s3...") with default configuration without specify SPARK_HOME.
Author: Lee moon soo <moon@apache.org>
This patch had conflicts when merged, resolved by
Committer: Lee moon soo <moon@apache.org>
Closes#397 from Leemoonsoo/ZEPPELIN-397 and squashes the following commits:
9855dde [Lee moon soo] Activate spark-1.5 and hadoop-2.4 by default
https://issues.apache.org/jira/browse/ZEPPELIN-396
Add -Ppyspark to enable pyspark in default configuration (without SPARK_HOME specified).
Author: Lee moon soo <moon@apache.org>
Closes#396 from Leemoonsoo/ZEPPELIN-396 and squashes the following commits:
4e599af [Lee moon soo] Add -Pypspark profile for release binary
This PR addresses https://issues.apache.org/jira/browse/ZEPPELIN-366
This patch creates single binary package instead of multiple binary package with different version of Spark / Hadoop combinations.
Also it's removing redundant directory structure from it's tar archive.
Author: Lee moon soo <moon@apache.org>
Closes#373 from Leemoonsoo/ZEPPELIN-366 and squashes the following commits:
366bbf4 [Lee moon soo] Create a single binary package with default build flags. Remove redundant directory structure in binary package.
Zeppelin currently embeds all spark dependencies under interpreter/spark and loading them on runtime.
Which is useful because of user can try Zeppelin + Spark with local mode without installation and configuration of spark.
However, when user has existing spark and hadoop installation, it'll be really helpful to just pointing them instead of build zeppelin with specific version of spark and hadoop combination.
This PR implements ability to use external spark and hadoop installation, by doing
* spark-dependencies module packages spark/hadoop dependencies under interpreter/spark/dep, to support local mode (current behavior)
* When SPARK_HOME and HADOOP_HOME is defined, bin/interpreter.sh exclude interpreter/spark/dep from classpath and include system installed spark and hadoop into the classpath.
This patch makes Zeppelin binary independent from spark version. Once Zeppelin is been built, SPARK_HOME can point any version of spark.
Author: Lee moon soo <moon@apache.org>
Closes#244 from Leemoonsoo/spark_provided and squashes the following commits:
654c378 [Lee moon soo] use consistant, simpler expressions
57b3f96 [Lee moon soo] Add comment
eb4ec09 [Lee moon soo] fix reading spark-*.conf file
bacfd93 [Lee moon soo] Update readme
3a88c77 [Lee moon soo] Test use explicitly %spark
5a17d9c [Lee moon soo] Call sqlContext.sql using reflection
615c395 [Lee moon soo] get correct method
0c28561 [Lee moon soo] call listenerBus() using reflection
62b8c45 [Lee moon soo] Print all logs
5edb6fd [Lee moon soo] Use reflection to call addListener
af7a925 [Lee moon soo] add pyspark flag
5f8a734 [Lee moon soo] test -> package
a0150cf [Lee moon soo] not use travis-install for mvn test
cd4519c [Lee moon soo] try sys.stdout.write instead of print
6304180 [Lee moon soo] enable 1.2.x test
797c0e2 [Lee moon soo] enable 1.3.x test
8de7add [Lee moon soo] trying to find why travis is not closing the test
cf0a61e [Lee moon soo] rm -rf only interpreter directory instead of mvn clean
2606c04 [Lee moon soo] bringing travis-install.sh back
df8f0ba [Lee moon soo] test more efficiently
9d6b40f [Lee moon soo] Update .travis
2ca3d95 [Lee moon soo] set SPARK_HOME
2a61ecd [Lee moon soo] Clear interpreter directory on mvn clean
f1e8789 [Lee moon soo] update travis config
9e812e7 [Lee moon soo] Use reflection not to use import org.apache.spark.scheduler.Stage
c3d96c1 [Lee moon soo] Handle ZEPPELIN_CLASSPATH proper way
0f9598b [Lee moon soo] py4j version as a property
1b7f951 [Lee moon soo] Add dependency for compile and test
b1d62a5 [Lee moon soo] Add scala-library in test scope
c49be62 [Lee moon soo] Add hadoop jar and spark jar from HADOOP_HOME, SPARK_HOME when they are defined
2052aa3 [Lee moon soo] Load interpreter/spark/dep only when SPARK_HOME is undefined
54fdf0d [Lee moon soo] Separate spark-dependency into submodule
Author: caofangkun <caofangkun@gmail.com>
Closes#186 from caofangkun/zeppelin-207 and squashes the following commits:
a2d155a [caofangkun] ZEPPELIN-207: travis-ci build log is too long to be displayed
713ce5a [caofangkun] ZEPPELIN-207: travis-ci build log is too long to be displayed
3ee6a15 [caofangkun] ZEPPELIN-207: travis-ci build log is too long to be displayed
aa2568d [caofangkun] ZEPPELIN-207: travis-ci build log is too long to be displayed
e5b0067 [caofangkun] ZEPPELIN-207: travis-ci build log is too long to be displayed
https://issues.apache.org/jira/browse/ZEPPELIN-174
* [x] change suffix to sha512
* [x] change to sha512sum command verifiable format
Author: Lee moon soo <moon@apache.org>
Closes#161 from Leemoonsoo/ZEPPELIN-174 and squashes the following commits:
7ba4577 [Lee moon soo] Create sha512sum command verifiable format checksum
fee7757 [Lee moon soo] sha512 suffix for sha checksum
It'll be nice Zeppelin projects has tool that helps making releases. https://issues.apache.org/jira/browse/ZEPPELIN-130
* [x] Ability to create a source release.
* [x] Ability to create binary releases.
Author: Lee moon soo <moon@apache.org>
Closes#119 from Leemoonsoo/release_tool and squashes the following commits:
4c55022 [Lee moon soo] Make and sign bin packages
0a48cfc [Lee moon soo] create source release
Since apache/incubator-zeppelin is a mirror, we can not simply click merge button for pull request.
Here's pullrequest merge tool, i modified little bit for Zeppelin, based on Spark's one.
Author: Lee moon soo <moon@apache.org>
Closes#3 from Leemoonsoo/merge_tool and squashes the following commits:
918e85f [Lee moon soo] Change JIRA project name to ZEPPELIN
1a70af5 [Lee moon soo] Add pull request merge tool
