Elgato_dark/zeppelin
1
0
Fork 0
mirror of https://github.com/apache/zeppelin synced 2026-05-24 09:38:26 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Adding livy.spark.jars.packages property

Browse source
This commit is contained in:
mahmoudelgamal 2016-08-03 17:09:37 +02:00
parent 98090abc07
commit d7f68187af
2 changed files with 9 additions and 24 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

22
docs/interpreter/livy.md
View file

@ -103,19 +103,14 @@ Example: `spark.master` to `livy.spark.master`
<td>Upper bound for the number of executors.</td>
</tr>
<tr>
<td>livy.spark.executor.extraClassPath</td>
<td>livy.spark.jars.packages</td>
<td></td>
<td>Adding extra libraries to the executors</td>
<td>Adding extra libraries to livy interpreter</td>
</tr>
<tr>
<td>livy.spark.driver.extraClassPath</td>
<td></td>
<td>Adding extra libraries to the driver</td>
</tr>
</table>
## Adding External libraries
You should put the libraries manually on the livy server and then set the paths of the libraries to those properties `livy.spark.executor.extraClassPath` and `livy.spark.driver.extraClassPath`
You can load dynamic library to livy interpreter by set `livy.spark.jars.packages` property to comma-separated list of maven coordinates of jars to include on the driver and executor classpaths. The format for the coordinates should be groupId:artifactId:version.
Example
@ -126,15 +121,10 @@ Example
<th>Description</th>
</tr>
<tr>
<td>livy.spark.executor.extraClassPath</td>
<td>path/to/jar1.jar:path/to/jar2.jar</td>
<td>Adding extra libraries to the executors</td>
<td>livy.spark.jars.packages</td>
<td>io.spray:spray-json_2.10:1.3.1</td>
<td>Adding extra libraries to livy interpreter</td>
</tr>
<tr>
<td>livy.spark.driver.extraClassPath</td>
<td>path/to/jar1.jar:path/to/jar2.jar</td>
<td>Adding extra libraries to the driver</td>
<tr>
</table>
## How to use

11
livy/src/main/resources/interpreter-setting.json
View file

@ -82,15 +82,10 @@
"defaultValue": "",
"description": "Kerberos keytab to authenticate livy"
},
"livy.spark.executor.extraClassPath": {
"propertyName": "livy.spark.executor.extraClassPath",
"livy.spark.jars.packages": {
"propertyName": "livy.spark.jars.packages",
"defaultValue": "",
"description": "Adding extra libraries to the executors"
},
"livy.spark.driver.extraClassPath": {
"propertyName": "livy.spark.driver.extraClassPath",
"defaultValue": "",
"description": "Adding extra libraries to the driver"
"description": "Adding extra libraries to livy interpreter"
}
}
},