zeppelin: Apache Zeppelin 是一个让交互式数据分析变得可行的基于网页的开源框架。Zeppelin提供了数据分析、数据可视化等功能

代码拉取完成,页面将自动刷新

开源项目 > 程序开发 > 图表组件 &&

扫描微信二维码支付

取消

支付完成

richgiteeai

Watch

不关注关注所有动态仅关注版本发行动态关注但不提醒动态

15 Star 37 Fork 2

Apache/zeppelin

代码 Wiki 统计流水线

服务

加入 Gitee

与超过 1400万开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)

免费加入

已有帐号? 立即登录

文件

master

分支 (284)

标签 (66)

管理

master

dependabot/maven/zeppelin-server/org.apache.shiro-shiro-core-2.2.1

dependabot/npm_and_yarn/zeppelin-web-angular/projects/zeppelin-react/undici-7.28.0

dependabot/npm_and_yarn/zeppelin-web-angular/projects/zeppelin-react/webpack-dev-server-5.2.5

dependabot/npm_and_yarn/zeppelin-web-angular/projects/zeppelin-react/shell-quote-1.8.4

branch-0.12

dependabot/npm_and_yarn/zeppelin-web/zeppelin-web-security-updates-e66bd0067e

dependabot/npm_and_yarn/zeppelin-web-angular/zeppelin-web-angular-security-updates-58fb326068

dependabot/npm_and_yarn/zeppelin-web-angular/projects/zeppelin-react/multi-f792d6d6d9

dependabot/npm_and_yarn/zeppelin-web-angular/projects/zeppelin-react/webpack-dev-server-5.2.4

dependabot/bundler/docs/docs-security-updates-acac26ccc4

dependabot/pip/dev/dev-security-updates-c30c77f42d

dependabot/maven/shell/shell-security-updates-9b33c9f5e8

dependabot/npm_and_yarn/zeppelin-web-angular/projects/zeppelin-react/postcss-8.5.13

dependabot/npm_and_yarn/zeppelin-web-angular/projects/zeppelin-react/fast-uri-3.1.2

dependabot/bundler/docs/docs-security-updates-0f2c7447a1

dependabot/maven/alluxio/alluxio-security-updates-86fe81666c

dependabot/maven/flink/flink-scala-2.12/flink-scala-security-updates-5233481f85

dependabot/maven/jdbc/org.postgresql-postgresql-42.7.11

dependabot/maven/zeppelin-plugins/launcher/docker/launcher-docker-security-updates-9b33c9f5e8

v0.12.1

v0.12.1-rc1

v0.12.0

v0.12.0-rc1

v0.11.2-rc4

v0.11.2

v0.11.2-rc3

v0.11.2-rc2

v0.11.2-rc1

v0.11.1

v0.11.1-rc1

v0.11.0

v0.11.0-rc1

v0.10.1

v0.10.1-rc2

v0.10.1-rc1

v0.10.0

v0.10.0-rc2

v0.10.0-rc1

v0.9.0-docker

克隆/下载

HTTPS SSH SVN SVN+SSH 下载ZIP

提示

下载代码请复制以下命令到终端执行

为确保你提交的代码身份被 Gitee 正确识别,请执行以下命令完成配置

git config --global user.name userName 
git config --global user.email userEmail

初次使用 SSH 协议进行代码克隆、推送等操作时,需按下述提示完成 SSH 配置

1 生成 RSA 密钥

2 获取 RSA 公钥内容,并配置到 SSH公钥中

在 Gitee 上使用 SVN,请访问使用指南

使用 HTTPS 协议时,命令行会出现如下账号密码验证步骤。基于安全考虑,Gitee 建议配置并使用私人令牌替代登录密码进行克隆、推送等操作

Username for 'https://gitee.com': userName

Password for 'https://userName@gitee.com': # 私人令牌

分支 284

标签 66

贡献代码

同步代码

创建 Pull Request

了解更多

对比差异通过 Pull Request 同步

同步更新到分支

通过 Pull Request 同步

将会在向当前分支创建一个 Pull
Request,合入后将完成同步

조형준 [ZEPPELIN-6410] Fix typo in PythonInterpre... 4e40c11

5654 次提交

File empty ...

src

README.md

pom.xml

README

# Overview
Python interpreter for Apache Zeppelin

# Architecture
Current interpreter implementation spawns new system python process through `ProcessBuilder` and re-directs it's stdin\strout to Zeppelin

# Details

- **UnitTests**

To run full suit of tests, including ones that depend on real Python interpreter AND external libraries installed (like Pandas, Pandasql, etc) do

```
./mvnw -Dpython.test.exclude='' test -pl python -am
 ```

- **Py4j support**

[Py4j](https://www.py4j.org/) enables Python programs to dynamically access Java objects in a JVM.
 It is required in order to use Zeppelin [dynamic forms](https://zeppelin.apache.org/docs/latest/manual/dynamicform.html) feature.

### Dev prerequisites

* Python 2 or 3 installed with py4j (0.9.2) and matplotlib (1.31 or later) installed on each

* Tests only checks the interpreter logic and starts any Python process! Python process is mocked with a class that simply output its input.

* Code wrote in `bootstrap.py` and `bootstrap_input.py` should always be Python 2 and 3 compliant.

* Use PEP8 convention for python code.

### Technical overview

* When interpreter is starting it launches a python process inside a Java ProcessBuilder. Python is started with -i (interactive mode) and -u (unbuffered stdin, stdout and stderr) options. Thus the interpreter has a "sleeping" python process.

* Interpreter sends command to python with a Java `outputStreamWiter` and read from an `InputStreamReader`. To know when stop reading stdout, interpreter sends `print "*!?flush reader!?*"`after each command and reads stdout until he receives back the `*!?flush reader!?*`.

* When interpreter is starting, it sends some Python code (bootstrap.py and bootstrap_input.py) to initialize default behavior and functions (`help(), z.input()...`). bootstrap_input.py is sent only if py4j library is detected inside Python process.

* [Py4J](https://www.py4j.org/) Python and Java libraries are used to load input zeppelin Java class into the python process (make java code with python code !). Therefore the interpreter can directly create Zeppelin input form inside the Python process (and eventually with some python variable already defined). JVM opens a random open port to be accessible from python process.

* JavaBuilder can't send SIGINT signal to interrupt paragraph execution. Therefore interpreter will directly send a `kill SIGINT PID` to python process to interrupt execution. Python process catches SIGINT signal with some code defined in bootstrap.py

* Matplotlib figures are displayed inline with the notebook automatically using a built-in backend for zeppelin in conjunction with a post-execute hook.

* `%python.sql` support for Pandas DataFrames is optional but can be downloaded from [here](https://github.com/yhat/pandasql) if user does not have one installed.

# IPython Overview
IPython interpreter for Apache Zeppelin

# IPython Requirements
You need to install the following python packages to make the IPython interpreter work.
 * jupyter 5.x
 * IPython
 * ipykernel
 * grpcio
 
If you have installed anaconda, then you just need to install grpc.

# IPython Architecture
Current interpreter delegate the whole work to ipython kernel via `jupyter_client`. Zeppelin would launch a python process which host the ipython kernel.
Zeppelin interpreter process will communicate with the python process via `grpc`. Ideally every feature works in IPython should work in Zeppelin as well.