zeppelin/docs/interpreter/python.md

layout	title	description	group
page	Python 2 & 3 Interpreter for Apache Zeppelin	Python is a programming language that lets you work quickly and integrate systems more effectively.	interpreter

{% include JB/setup %}

Python 2 & 3 Interpreter for Apache Zeppelin

Configuration

Property	Default	Description
zeppelin.python	python	Path of the already installed Python binary (could be python2 or python3). If python is not in your $PATH you can set the absolute directory (example : /usr/bin/python)
zeppelin.python.maxResult	1000	Max number of dataframe rows to display.

Enabling Python Interpreter

In a notebook, to enable the Python interpreter, click on the Gear icon and select Python

Using the Python Interpreter

In a paragraph, use %python to select the Python interpreter and then input all commands.

The interpreter can only work if you already have python installed (the interpreter doesn't bring it own python binaries).

To access the help, type help()

Python modules

The interpreter can use all modules already installed (with pip, easy_install...)

Using Zeppelin Dynamic Forms

You can leverage Zeppelin Dynamic Form inside your Python code.

Zeppelin Dynamic Form can only be used if py4j Python library is installed in your system. If not, you can install it with pip install py4j.

Example :

%python
### Input form
print (z.input("f1","defaultValue"))

### Select form
print (z.select("f1",[("o1","1"),("o2","2")],"2"))

### Checkbox form
print("".join(z.checkbox("f3", [("o1","1"), ("o2","2")],["1"])))

Zeppelin features not fully supported by the Python Interpreter

• Interrupt a paragraph execution (cancel() method) is currently only supported in Linux and MacOs. If interpreter runs in another operating system (for instance MS Windows) , interrupt a paragraph will close the whole interpreter. A JIRA ticket (ZEPPELIN-893) is opened to implement this feature in a next release of the interpreter.
• Progression bar in webUI (getProgress() method) is currently not implemented.
• Code-completion is currently not implemented.

Matplotlib integration

The python interpreter can display matplotlib graph with the function z.show(). You need to have matplotlib module installed and a XServer running to use this functionality!

%python
import matplotlib.pyplot as plt
plt.figure()
(.. ..)
z.show(plt)
plt.close()

The z.show() function can take optional parameters to adapt graph dimensions (width and height) as well as output format (png or optionally svg).

%python
z.show(plt, width='50px')
z.show(plt, height='150px', fmt='svg')

Pandas integration

Apache Zeppelin Table Display System provides built-in data visualization capabilities. Python interpreter leverages it to visualize Pandas DataFrames though similar z.show() API, same as with Matplotlib integration.

Example:

import pandas as pd
rates = pd.read_csv("bank.csv", sep=";")
z.show(rates)

SQL over Pandas DataFrames

There is a convenience %python.sql interpreter that matches Apache Spark experience in Zeppelin and enables usage of SQL language to query Pandas DataFrames and visualization of results though built-in Table Display System.

Pre-requests

• Pandas pip install pandas
• PandaSQL pip install -U pandasql

In case default binded interpreter is Python (first in the interpreter list, under the Gear Icon), you can just use it as %sql i.e

• first paragraph

import pandas as pd
rates = pd.read_csv("bank.csv", sep=";")

• next paragraph

%sql
SELECT * FROM rates WHERE age < 40

Otherwise it can be referred to as %python.sql

Technical description

For in-depth technical details on current implementation please refer to python/README.md.