Commit graph

178 commits

Author SHA1 Message Date
조형준
4e40c11312
[ZEPPELIN-6410] Fix typo in PythonInterpreter comment: "sever" to "server"
### What is this PR for?
Fix a typo in `PythonInterpreter.java` where the comment reads "sever" instead of "server".

### What type of PR is it?
Improvement

### Todos
* [x] Fix typo: "sever" → "server"

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-6410

### How should this be tested?
* No functional change — comment-only fix. Visual inspection is sufficient.

### Screenshots (if appropriate)
N/A

### Questions:
* Does the license files need to update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Closes #5210 from xxxxxxjun/fix-zeppelin-6410.

Signed-off-by: Jongyoul Lee <jongyoul@gmail.com>
2026-04-07 12:56:41 +09:00
YeonKyung Ryu
4297661d8f
[ZEPPELIN-6308] Extract hardcoded py4j values to constants
### What is this PR for?
This PR extracts hardcoded py4j values to constants in Python interpreters to improve maintainability. It creates a new PythonConstants class to centralize py4j version and file path constants, replacing hardcoded strings across multiple Python interpreter classes. This addresses the TODO comment requesting to avoid hardcoded py4j values.


### What type of PR is it?
Refactoring


### Todos
* [x] - Create PythonConstants class with py4j constants
* [x] - Replace hardcoded py4j values in IPythonInterpreter
* [x] - Replace hardcoded py4j values in PythonInterpreter
* [x] - Replace hardcoded py4j values in PythonDockerInterpreter

### What is the Jira issue?
[ZEPPELIN-6308](https://issues.apache.org/jira/browse/ZEPPELIN-6308)

### How should this be tested?

### Screenshots (if appropriate)

### Questions:
* Does the license files need to update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


Closes #5056 from celinayk/ZEPPELIN-6308.

Signed-off-by: ParkGyeongTae <gyeongtae@apache.org>
2025-09-07 19:44:44 +09:00
Jongyoul Lee
1b90f318a3
[MINOR] Bump up version to 0.13.0-SNAPSHOT
### What is this PR for?
Change the version to 0.13.0-SNAPSHOT

### What type of PR is it?
Improvement

### Todos
* [x] - Change versions to 0.13.0-SNAPSHOT

### How should this be tested?
The version should show 0.13.0-SNAPSHOT when building it.

### Screenshots (if appropriate)

### Questions:
* Does the license files need to update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


Closes #4995 from jongyoul/minor/bump-up-0.13.0-snapshot.

Signed-off-by: Jongyoul Lee <jongyoul@gmail.com>
2025-08-02 22:05:06 +09:00
Gyeongtae Park
32f2a8e67b
[ZEPPELIN-6038] Unification of the Logger variable (#4793)
* [ZEPPELIN-6038] Unify the Logger variable to LOGGER in all files

* [ZEPPELIN-6038] Set all logger constants to private static final

* [ZEPPELIN-6038] Adjust code character length

* [ZEPPELIN-6038] Refactor logger variable

* [ZEPPELIN-6038] Revert code for automatically generated files

* [ZEPPELIN-6038] Fix code syntax
2024-08-26 19:48:26 +02:00
Cheng Pan
f2253f1ee6
[ZEPPELIN-6008] Fix parameter usage of bokeh in test case (#4748)
* [ZEPPELIN-6008] Pin plotly 5.19.0

* Revert "[ZEPPELIN-6008] Pin plotly 5.19.0"

This reverts commit 60d9ce92c8.

* Pin bokeh=3.3.4

* Revert "Pin bokeh=3.3.4"

This reverts commit 44ccc988de.

* Remove usage of deprecated paramater legend
2024-04-02 09:04:59 +02:00
PJ Fanning
207d47f431
[MINOR] Set Snapshot version to 0.12.0-SNAPSHOT (#4720)
* change version to 0.11.1-SNAPSHOT

* change version

* change to 0.12.0-SNAPSHOT
2024-02-21 10:58:13 +09:00
Matthias Koch
4352a10ab9
[ZEPPELIN-5875] Add: z.show works with subtypes of DataFrame (#4683) 2023-11-08 11:47:37 +09:00
Cheng Pan
b9cb004515
[ZEPPELIN-5946][FOLLOWUP] Clean up code for legacy Spark versions (#4668)
* [ZEPPELIN-5946][FOLLOWUP] Clean up code for legacy Spark versions

* eliminate the reflection

* address
2023-10-11 10:12:15 +02:00
Philipp Dallig
11f6aa6f29
[ZEPPELIN-5848] Junit5 Migration (#4641)
* Migrate zeppelin-interpreter-integration

* migrate hbase

* migrate java

* migrate jdbc

* migrate kotlin interpreter

* Migrate python interpreter

* migrate rlang

* migrate zeppelin-jupyter-interpreter

* migrate zeppelin-jupyter

* migrate spark-interpreter

* Migrate file interpreter

* Delete empty flink test

* Migrate zeppelin-integration

* Remove junit-vintage-engine where it's not needed

* Add vintage engine for flink

* migrate flink partially to junit5

* Update license
2023-09-14 12:37:28 +02:00
matthias-koch
df5d827193
[ZEPPELIN-5920] Fix deprecation warnings (#4609)
* [ZEPPELIN-5920] Fix deprecation warnings

* [ZEPPELIN-5920] Filter deprecationWarnings only

* [ZEPPELIN-5920] Replace warning supression with a counter

---------

Co-authored-by: Matthias Koch <matthias-a.koch@rohde-schwarz.com>
2023-05-31 14:42:40 +02:00
Philipp Dallig
45b15fe971
[ZEPPELIN-5861] Correct shading Prefix (#4545)
* Add Process ErrorMessage

* change shade prefix

* Run with pre modules to fill the maven reactor

* spark-interpreter has no scala test so we can remove the maven plugin

* Fix flaky python test

* Use shaded version of io.grpc:grpc-netty (io.grrpc:grpc-netty-shaded)

* Adjust interpreter tests

* Remove maven-dependency-plugin, because downloaded artefacts are attached to classpath
2023-01-23 21:33:18 +09:00
Cheng Pan
09bd93877b
[ZEPPELIN-5857] Bump gRPC and protobuf to support build on macOS M1 chips (#4523)
* [ZEPPELIN-5857] Bump gRPC and protobuf to support build on macOS M1 chips

* fix

* nit
2022-12-29 14:17:16 +09:00
Philipp Dallig
36aebade0d
[ZEPPELIN-5839] Update mockito and powermock (#4499) 2022-10-27 08:47:11 +02:00
Philipp Dallig
2731527c0d
[ZEPPELIN-5824] Checkstyle (#4466) 2022-09-30 19:09:10 +09:00
Philipp Dallig
23f3acf208
[ZEPPELIN-5810] Allow both package names jupyter_client and jupyter-client (#4455) 2022-09-12 10:53:53 +02:00
Jiyun Park
f42943c6d5
[ZEPPELIN-5804] support python 3.10 (#4453) 2022-09-06 18:23:28 +09:00
Jeff Zhang
a6769cbddf [HOTFIX] Fix Python plotting test failure 2022-04-23 21:44:42 +08:00
Jongyoul Lee
26162dc395 [MINOR] Adopt maven wrapper to use the same version of Maven
### What is this PR for?
Using maven wrapper when building and testing

### What type of PR is it?
[Improvement]

### Todos
* [ ] - Change `mvn` to `./mvnw`

### What is the Jira issue?
N/A

### How should this be tested?
Pass CI

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jongyoul Lee <jongyoul@gmail.com>

Closes #4242 from jongyoul/minor/add-mvnw and squashes the following commits:

a606683ee [Jongyoul Lee] [MINOR] adopt maven wrapper to use the same version of Maven
d5e9bbb95 [Jongyoul Lee] [MINOR] adopt maven wrapper to use the same version of Maven
75300ced5 [Jongyoul Lee] [MINOR] Add mvnw in order to use the same version of maven
2021-10-07 17:19:34 +09:00
Jeff Zhang
fa1f72891f [ZEPPELIN-5525] Python vanillar interpreter doesn't' work in Python 3.8
### What is this PR for?

The root cause is due to ast api is changed after python 3.8, see https://github.com/ipython/ipython/pull/11593.
* The PR fixed this issue in `zeppelin_python.py`.
* This PR add tests for Python 3.8 for both python interpreter & spark interpreter (spark 2.4 doesn't support python 3.8, so there's no python 3.8 test for spark 2.4).  `jupyter_client` 5 is used because jupyter_client 7 doesn't work (tracked in ZEPPELIN-5533)
* bokeh test is disabled for flink interpreter. Because pyflink's dependencies conflicts with bokeh2.

### What type of PR is it?
[Bug Fix ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5525

### How should this be tested?
* Ci pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #4230 from zjffdu/ZEPPELIN-5525 and squashes the following commits:

b816a530c0 [Jeff Zhang] [ZEPPELIN-5525] Python vanillar interpreter doesn't' work in Python 3.8
2021-09-28 11:54:27 +08:00
Philipp Dallig
d071e4b66f
[ZEPPELIN-5514] Use java8
### What is this PR for?
This PR is using normal java 8 features to reduce the usage of thrid-party dependecies.

examples:
guava Joiner -> String.join
guava Lists.newArrayList(...) -> Arrays.asList(...)
guava Sets.newHashSet(...) -> new HashSet<>(Arrays.asList(...))
guava Lists.newArrayList() -> new ArrayList<>();
....

### What type of PR is it?
 -Refactoring

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5514

### How should this be tested?
* via CI

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Philipp Dallig <philipp.dallig@gmail.com>

Closes #4217 from Reamer/useJava8 and squashes the following commits:

3a700d0a2 [Philipp Dallig] Use try-with-resources for ZipOutputStream
72e7c010f [Philipp Dallig] Logger cleanup
b180bfc7b [Philipp Dallig] Replace some guava methods with native jdk methods or with Apache libs
2021-09-17 09:20:38 +02:00
Jongyoul Lee
5dd5a6584b [MINOR] Version up to 0.11.0-SNAPSHOT
### What is this PR for?
Version up to the next version of 0.11.0-SNAPSHOT

Author: Jongyoul Lee <jongyoul@gmail.com>

Closes #4221 from jongyoul/minor-version-up and squashes the following commits:

c38c9910a [Jongyoul Lee] Version up to the latest stable version
a962b08ec [Jongyoul Lee] [MINOR] Version up to 0.11.0-SNAPSHOT
2021-09-14 18:31:39 +09:00
Jeff Zhang
a8021f0e72 [ZEPPELIN-5479] %python.sql doesn't work with ipython interpreter
### What is this PR for?

This PR make %python.sql work with both vanilla python interpreter and ipython interpreter. It depends on whether ipython prerequisites are met.

### What type of PR is it?
[ Improvement ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5479

### How should this be tested?
* CI pass

### Screenshots (if appropriate)
![image](https://user-images.githubusercontent.com/164491/128589268-c016ebe1-a484-4f04-846b-df8a75e3f31f.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #4198 from zjffdu/ZEPPELIN-5479 and squashes the following commits:

df963616a3 [Jeff Zhang] fix unit test
46c4f08059 [Jeff Zhang] trim sql
183660aeb6 [Jeff Zhang] fix code style
7a3e54e539 [Jeff Zhang] fix code style
c9e63fa4e0 [Jeff Zhang] [ZEPPELIN-5479] %python.sql doesn't work with ipython interpreter
2021-08-11 12:08:24 +08:00
cuspymd
919f030a8a [ZEPPELIN-5370] Polish pom.xml files
### What is this PR for?
Polish pom.xml files
- Delete unnecessary tags
- Delete duplicated dependencies

### What type of PR is it?
[Refactoring]

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5370

### How should this be tested?
* CI

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: cuspymd <cuspymd@gmail.com>

Closes #4118 from cuspymd/polish-poms and squashes the following commits:

766278338 [cuspymd] Fix integration test error
385fcf2fd [cuspymd] Delete duplicated version of sub-modules
ba127bf16 [cuspymd] Recover duplicated dependencies related to spark interpreter
6fa7e1d51 [cuspymd] Polish pom.xml
2021-07-07 14:59:21 +02:00
Jeff Zhang
b9118fd47e
[ZEPPELIN-5417] Unable to set conda env in pyspark (#4147)
* [ZEPPELIN-5417] Unable to set conda env in pyspark
2021-07-04 14:55:17 +08:00
Jeff Zhang
dfc36a4d53 [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode
### What is this PR for?

This is to run python interpreter in yarn mode and you can also customize the python runtime via conda. Check the `python.md` for more details

### What type of PR is it?
[Feature | Documentation]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5330

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #4097 from zjffdu/ZEPPELIN-5330 and squashes the following commits:

b6a957fd3e [Jeff Zhang] address code review comments
bdb4dcbbfa [Jeff Zhang] support hdfs file for
ee8d11b8fd [Jeff Zhang] minor code refacotring
a7dca0fd35 [Jeff Zhang] address comments
5fc3e86543 [Jeff Zhang] Fix Ci
e4a6c7146a [Jeff Zhang] address comments
f7e6b13d4d [Jeff Zhang] save
d5828d203b [Jeff Zhang] update python
3c963b6b61 [Jeff Zhang] update
fa36c5b997 [Jeff Zhang] update jupyter
e25c6b3f3b [Jeff Zhang] address comment
d27f580216 [Jeff Zhang] [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode
2021-06-21 22:37:15 +08:00
Jeff Zhang
4cb0a02ed0 [HOTFIX] CI failed due to dns reverse lookup issue
### What is this PR for?

This is a hotfix to fix the ci failure due to dns reverse lookup issue. Some of the code is copied from pulsar project.
b4300db307

### What type of PR is it?
[ Hot Fix ]

### Todos
* [ ] - Task

### What is the Jira issue?
*

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? No
* Does this needs documentation? NO

Author: Jeff Zhang <zjffdu@apache.org>

Closes #4096 from zjffdu/ci_test and squashes the following commits:

ed91ba328 [Jeff Zhang] fix comment
6a0d9fd1c [Jeff Zhang] save
2021-04-19 12:04:21 +08:00
Philipp Dallig
71d250800a
[ZEPPELIN-5187] Use new constructor introduced with ZEPPELIN-5170
### What is this PR for?
This PR fixes NPE exceptions in our tests.

### What type of PR is it?
 - Hot Fix

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5187

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Philipp Dallig <philipp.dallig@gmail.com>

Closes #4012 from Reamer/npe_interpreter_output and squashes the following commits:

b45c0f570 [Philipp Dallig] Use new constructor introduced with ZEPPELIN-5170
2021-01-04 16:33:35 +01:00
Jeff Zhang
a89ba61fae [minor] update version in pom 2020-12-25 11:43:04 +08:00
Jeff Zhang
5746f6cb20 [ZEPPELIN-5160]. Improve github action CI
### What is this PR for?

This PR improve the github action CI
* Disable unstable test BasePythonInterpreterTest#testRedefinitionZeppelinContext
* Fix the failure of flink 1.10, this is due to python package issue.

The github action still fails sometimes, because of network issue or other weird issue, we have to rerun it again.

### What type of PR is it?
[ Improvement]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5160

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? No
* Does this needs documentation? NO

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3994 from zjffdu/ZEPPELIN-5160 and squashes the following commits:

491e1409f [Jeff Zhang] address comment
6edcfe692 [Jeff Zhang] [ZEPPELIN-5160]. Improve github action CI
2020-12-15 22:00:04 +08:00
Philipp Dallig
9e3b4eb9ae [ZEPPELIN-4385] Migrate to GitHub actions
### What is this PR for?
This PR will change the CI-System from [Travis](https://travis-ci.com/) to [GitHub Actions](https://github.com/features/actions)
**Advantages:**
 - [high usage limits](https://docs.github.com/en/free-pro-teamlatest/actions/reference/usage-limits-billing-and-administration#usage-limits)
 - No CI setup is required from the contributors
 - good integration with GitHub Pull request

**Disadvantage:**
 - At the moment we have some flappy tests and external dependencies. Both can cause a failed test, but we cannot restart a single job, only the entire workflow.

**Miscellaneous:**
 - CI is triggered with every push event
 - CI is triggered when PR event is open and synchronized
 - Selenium test is updated to python3
 - The Livy-Python2 test is dropped because Python2 has reached [the end of its lifetime](https://www.python.org/doc/sunset-python-2/)

### What type of PR is it?
 - Improvement

### Todos
* [ ] - Feedback for job splitting
* [x] - What is the purpose of the Jenkins job?

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4385

### How should this be tested?
* Strongly recommended: add automated unit tests for any new or changed behavior
* Outline any manual steps to test the PR here.

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Philipp Dallig <philipp.dallig@gmail.com>

Closes #3986 from Reamer/github_actions and squashes the following commits:

eb13433a8 [Philipp Dallig] Goodbye travis
3de27c699 [Philipp Dallig] Adjust README
8302f5349 [Philipp Dallig] Adjust template for pull request
76d9bb22e [Philipp Dallig] Adjustments documentation
08155783e [Philipp Dallig] Remove travis_check.py
e865f2fc1 [Philipp Dallig] Remove "travis" in source code
6790b6e42 [Philipp Dallig] Add core.yml
27330791f [Philipp Dallig] Rewrite selenium tests to python3
1772024fc [Philipp Dallig] Add frontend tests
c81f48492 [Philipp Dallig] Add github actions workflow (rat)
18d5dbecb [Philipp Dallig] some cleanup
2020-12-09 12:28:25 +01:00
Jeff Zhang
6981c4dd74 [ZEPPELIN-5103]. Simply jdbc interpreter error message
### What is this PR for?

In this PR, I would only print exception message when it is SQLException, otherwise would print the full stacktrace, because in this case it is most likely due to jdbc interpreter's internal error.

### What type of PR is it?
[Improvement]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-5103

### How should this be tested?
* CI pass

### Screenshots (if appropriate)
![image](https://user-images.githubusercontent.com/164491/96952163-c0a35b00-1520-11eb-9bcf-c7355a151184.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3952 from zjffdu/ZEPPELIN-5103 and squashes the following commits:

4001e1b84 [Jeff Zhang] [ZEPPELIN-5103]. Simply jdbc interpreter error message
2020-10-29 10:03:20 +08:00
Jeff Zhang
4088295639 [hotfix] Fix python unit test 2020-10-26 19:39:43 +08:00
Jeff Zhang
0a27eee0b9 [ZEPPELIN-4771]. Bokeh output in IPythonInterpreter is not in correct format
### What is this PR for?

Without this PR, the bokeh output will is not in correct format (see below screenshot). This root cause is the output type is not correct. We should only use html when it is ir kernel for jupyter interpreter.

### What type of PR is it?
[Bug Fix ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4771

### How should this be tested?
* CI pass

### Screenshots (if appropriate)
Before
![image](https://user-images.githubusercontent.com/164491/80295130-b76c4800-87a2-11ea-8cb2-f7d213d6b714.png)

After
![image](https://user-images.githubusercontent.com/164491/80295171-2cd81880-87a3-11ea-9a80-bffffc4accc0.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3750 from zjffdu/ZEPPELIN-4771 and squashes the following commits:

da6578e0e [Jeff Zhang] [ZEPPELIN-4771]. Bokeh output in IPythonInterpreter is not in correct format
2020-04-27 10:05:08 +08:00
Alex Ott
8815eec026 [ZEPPELIN-4700] Cleanup Maven warnings & unify plugin management
### What is this PR for?

This commit declares all plugins in the `pluginManagement` section and unifies versions of
all plugins - they are now declared as properties in the top-level `pom.xml`.  All other
`pom.xml` files shouldn't specify version explicitly.

### What type of PR is it?
Improvement

### What is the Jira issue?

* ZEPPELIN-4700

### How should this be tested?
* One build was clean: https://travis-ci.org/github/alexott/zeppelin/builds/668812389, but after removing the not necessary files from commit, some tests began to fail: https://travis-ci.org/github/alexott/zeppelin/builds/669129366 - not sure if it's a case of flaky tests (yes, it looks like it the case - after restart of failed builds - they are all green)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Alex Ott <alexott@gmail.com>

Closes #3707 from alexott/ZEPPELIN-4700 and squashes the following commits:

6de1eb393 [Alex Ott] [ZEPPELIN-4700] Cleanup Maven warnings & unify plugin management
2020-04-09 08:45:24 +02:00
Jeff Zhang
7bd8e288b7 [ZEPPELIN-4714]. Flink table api doesn't work in multiple threads
### What is this PR for?
This PR is to fix the issue of FLINK-16936 by a workaround, already creating tableenv before execution scala or python code. Building tablenv is pretty light which won't cost much time. So it is acceptable for this workaround. Another this PR try to fix is the ClassLoader issue for PyFlinkInterpreter. This PR will always set classloader before executing python code so that pyflink api can call udf defined in scala.

### What type of PR is it?
[Bug Fix ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4714

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3715 from zjffdu/ZEPPELIN-4714 and squashes the following commits:

55d613576 [Jeff Zhang] [ZEPPELIN-4714]. Flink table api doesn't work in multiple threads
2020-04-07 15:39:08 +08:00
Jeff Zhang
6cdcc5b012 [ZEPPELIN-4692]. zeppelin pyspark doesn't print java output
### What is this PR for?

The root cause of this issue is that we didn't redirect java output to interpreter output. This PR fix it via redirect java output before interpreting python code in both PySparkInterpreter & IPySparkInterpreter. Unit test is also added to verify this feature.

### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4692

### How should this be tested?
* Unit test is added, also manually tested it

### Screenshots (if appropriate)

![image](https://user-images.githubusercontent.com/164491/77384871-78249300-6dc1-11ea-9cdd-98d17a2ebbf6.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? NO

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3696 from zjffdu/ZEPPELIN-4692 and squashes the following commits:

e1a5ead7e [Jeff Zhang] [ZEPPELIN-4692]. zeppelin pyspark doesn't print java output
2020-03-30 11:44:51 +08:00
Philipp Dallig
f6f2bbcd64 [ZEPPELIN-4686] Update commons-lang to commons-lang3
### What is this PR for?
I noticed that the Zeppelin project mixes "commons-lang" and "commons-lang3". I have (hopefully) changed all imports to `commons-lang3`
I use `commons-lang3` 3.7, because this version was used in several submodules.

### What type of PR is it?
Improvement

### Todos
* [ ] - Is the replacement of `getFullStackTrace` to `getStackTrace` right?
* [ ] - commons-lang isn't deleted from main `pom.xml`. Okay?

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4686

### How should this be tested?
* Unit-Tests withTravis CI https://travis-ci.org/github/Reamer/zeppelin/builds/663565663

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Philipp Dallig <philipp.dallig@gmail.com>

Closes #3691 from Reamer/commons-lang3 and squashes the following commits:

bf12fc07c [Philipp Dallig] Update to org.apache.commons commons-lang3
2020-03-19 22:21:13 +08:00
Jeff Zhang
78eeb56a99 [minor] Description update of interpreter-setting.json 2020-03-11 16:24:50 +08:00
Jeff Zhang
8b5bab08d6 [hotfix] Fix z.show(df, show_index) in PySpark & PyFlink 2020-02-19 13:42:53 +08:00
Jeff Zhang
10566159e4 [hotfix] fix code style issue 2020-02-18 11:11:38 +08:00
Jeff Zhang
c8bfb51116 [minor] defaultInterpreter is missing in python interpreter 2020-02-18 09:57:54 +08:00
Jeff Zhang
fd8989334b [minor] Add test for z.show(df, show_index=True) 2020-02-18 09:55:00 +08:00
Jeff Zhang
ff161f8edc [ZEPPELIN-4616]. Rename BaseZeppelinContext to ZeppelinContext
### What is this PR for?
Straightforward PR to just rename BaseZeppelinContext to ZeppelinContext

### What type of PR is it?
[ Refactoring]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4616

### How should this be tested?
* Not necessary

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3646 from zjffdu/ZEPPELIN-4616 and squashes the following commits:

f4eb0f5ba [Jeff Zhang] [ZEPPELIN-4616]. Rename BaseZeppelinContext to ZeppelinContext
2020-02-17 10:08:42 +08:00
Jeff Zhang
496477e0ce [ZEPPELIN-4611]. Fetching rows with newline character (\n) breaks entire table
### What is this PR for?
This PR would replace all the special characters(\t, \n, \r\n) in table content with white space. so that it won't break the table format display.

### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4611

### How should this be tested?
* Unit test is added

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3643 from zjffdu/ZEPPELIN-4611 and squashes the following commits:

d12eea943 [Jeff Zhang] [ZEPPELIN-4611]. Fetching rows with newline character (\n) breaks entire table
2020-02-14 16:15:39 +08:00
Jeff Zhang
d6fa09e5b9 [ZEPPELIN-4544]. Rename zeppelin-interpreter-api to zeppelin-interpreter-shaded
### What is this PR for?
Straightforward PR which rename zeppelin-interpreter-api to zeppelin-interpreter-shaded

### What type of PR is it?
[Refactoring]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4544

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? NO

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3619 from zjffdu/ZEPPELIN-4544 and squashes the following commits:

380d8484f [Jeff Zhang] [ZEPPELIN-4544]. Rename zeppelin-interpreter-api to zeppelin-interpreter-shaded
2020-02-07 11:40:09 +08:00
Muhammad Taufiq
586e823e16 [ZEPPELIN-4564] Changed path separator in Python interpreter to allow it to work on windows as well
### What is this PR for?
Python Interpreter fails on Windows because of classpath issue

### What type of PR is it?
Bug Fix

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4564#

THIS SOFTWARE IS CONTRIBUTED SUBJECT TO THE TERMS OF THE APACHE SOFTWARE FOUNDATION SOFTWARE GRANT AND CORPORATE CONTRIBUTOR LICENSE AGREEMENT VERSION R190612.
THIS SOFTWARE IS LICENSED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE AND ANY WARRANTY OF NON-INFRINGEMENT, ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. THIS SOFTWARE MAY BE REDISTRIBUTED TO OTHERS ONLY BY EFFECTIVELY USING THIS OR ANOTHER EQUIVALENT DISCLAIMER IN ADDITION TO ANY OTHER REQUIRED LICENSE TERMS.

Author: Muhammad Taufiq <Muhammad.Taufiq@morganstanley.com>

Closes #3604 from Muhammad-ms/zeppelin9_file_separator and squashes the following commits:

a09b6463a [Muhammad Taufiq] Changed path separator to allow it to work on windows as well
2020-01-19 16:47:59 +08:00
Jeff Zhang
974f986068 [ZEPPELIN-4532]. Add a shaded version of zeppelin-jupyter-interpreter
### What is this PR for?

This PR add a new module `zeppelin-jupyter-interpreter-shaded` which shaded the guava so that other module (python and r ) won't be bothered by the problem of guava conflict.

### What type of PR is it?
[Improvement ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://jira.apache.org/jira/browse/ZEPPELIN-4532

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3585 from zjffdu/ZEPPELIN-4532 and squashes the following commits:

12afc937b [Jeff Zhang] [ZEPPELIN-4532]. Add a shaded version of zeppelin-jupyter-interpreter
2020-01-03 10:26:58 +08:00
Jeff Zhang
737d1626d0 [ZEPPELIN-4522]. Support multiple sql statements for SparkSqlInterpreter
### What is this PR for?

Use the SqlSplitter in `zeppelin-interpreter` to split sql and execute in SparkSqlInterpreter. Nothing changes for the previous single sql statement paragraph. But just multiple result will be displayed for multiple sql statements.

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4522

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3579 from zjffdu/ZEPPELIN-4522 and squashes the following commits:

eda573649 [Jeff Zhang] fix failed test
68d5a30c8 [Jeff Zhang] Add test for no sql but just 2 comments
4ff15e4fb [Jeff Zhang] address comment
bc3c1feff [Jeff Zhang] [ZEPPELIN-4522]. Support multiple sql statements for SparkSqlInterpreter
2019-12-31 09:30:03 +08:00
Jeff Zhang
3fdc590cdc [ZEPPELIN-4497] Change zeppelin-jupyter-adapter to zeppelin-jupyter-interpreter
### What is this PR for?
In ZEPPELIN-4480, we introduce zeppelin-jupyter-adapter which build a bridge between zeppelin and jupyter, zeppelin can extends this class to leverage any kernel of jupyter.
After a second thought, I think it is not enough. We can allow user to use jupyter kernel directly instead of implement one by one. So the purpose is to allow user use jupyter kernel like this

```
%jupyter(kernel=ipython)

python_code
...
```

Of course user can enhance the jupyter kernel in Zeppelin, e.g. IPythonInterpreter of Zeppelin can enhance the ipython kernel by adding support of ZeppelinContext

### What type of PR is it?
[Refactoring]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://jira.apache.org/jira/browse/ZEPPELIN-4497#

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

![image](https://user-images.githubusercontent.com/164491/71322469-c8f6c800-2502-11ea-9ad1-15c8dc78771a.png)

![image](https://user-images.githubusercontent.com/164491/71322797-833bfe80-2506-11ea-84e3-64d037cc739e.png)

![image](https://user-images.githubusercontent.com/164491/71322800-8fc05700-2506-11ea-92fb-be802b3a8b07.png)

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3558 from zjffdu/ZEPPELIN-4497 and squashes the following commits:

2efdc1e0e [Jeff Zhang] [ZEPPELIN-4497] Change zeppelin-jupyter-adapter to zeppelin-jupyter-interpreter
2019-12-23 15:18:42 +08:00
Jeff Zhang
1a6bce627a ZEPPELIN-4437. Update python document
### What is this PR for?

This PR is to polish the python interpreter document.

### What type of PR is it?
[Documentation]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4437

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3538 from zjffdu/ZEPPELIN-4437 and squashes the following commits:

48163d089 [Jeff Zhang] ZEPPELIN-4437. Update python document
2019-12-23 14:03:02 +08:00