开源 企业版 高校版 私有云 模力方舟 AI 队友
代码拉取完成,页面将自动刷新
捐赠
捐赠前请先登录
扫描微信二维码支付
取消
支付完成
支付提示
将跳转至支付宝完成支付
确定
取消
1 Star 0 Fork 6

readerloop/MLflow

加入 Gitee
与超过 1400万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
已有帐号? 立即登录
文件
master
分支 (15)
标签 (16)
master
pr-template
disable_sagemaker_docker_build
branch-0.9
revert-968-notebook-link-query-params
readme-patch
branch-0.8
mateiz-jackson-databind
branch-0.7
h2o_model_snippets
pytorch_model_snippets
dbczumar-model-arg
java-client
branch-0.5
v0.5.2_release_branch
v0.9.0
v0.8.2
v0.8.1
v0.8.0
v0.7.0
v0.7
v0.6.0
v0.5.2
v0.5.1
v0.5.0
v0.4.2
v0.4.1
v0.4.0
v0.3.0
v0.2.1
v0.2.0
master
分支 (15)
标签 (16)
master
pr-template
disable_sagemaker_docker_build
branch-0.9
revert-968-notebook-link-query-params
readme-patch
branch-0.8
mateiz-jackson-databind
branch-0.7
h2o_model_snippets
pytorch_model_snippets
dbczumar-model-arg
java-client
branch-0.5
v0.5.2_release_branch
v0.9.0
v0.8.2
v0.8.1
v0.8.0
v0.7.0
v0.7
v0.6.0
v0.5.2
v0.5.1
v0.5.0
v0.4.2
v0.4.1
v0.4.0
v0.3.0
v0.2.1
v0.2.0
克隆/下载
克隆/下载
提示
下载代码请复制以下命令到终端执行
为确保你提交的代码身份被 Gitee 正确识别,请执行以下命令完成配置
初次使用 SSH 协议进行代码克隆、推送等操作时,需按下述提示完成 SSH 配置
1 生成 RSA 密钥
2 获取 RSA 公钥内容,并配置到 SSH公钥
在 Gitee 上使用 SVN,请访问 使用指南
使用 HTTPS 协议时,命令行会出现如下账号密码验证步骤。基于安全考虑,Gitee 建议 配置并使用私人令牌 替代登录密码进行克隆、推送等操作
Username for 'https://gitee.com': userName
Password for 'https://userName@gitee.com': # 私人令牌
master
分支 (15)
标签 (16)
master
pr-template
disable_sagemaker_docker_build
branch-0.9
revert-968-notebook-link-query-params
readme-patch
branch-0.8
mateiz-jackson-databind
branch-0.7
h2o_model_snippets
pytorch_model_snippets
dbczumar-model-arg
java-client
branch-0.5
v0.5.2_release_branch
v0.9.0
v0.8.2
v0.8.1
v0.8.0
v0.7.0
v0.7
v0.6.0
v0.5.2
v0.5.1
v0.5.0
v0.4.2
v0.4.1
v0.4.0
v0.3.0
v0.2.1
v0.2.0
MLflow
/
examples
/
flower_classifier
贡献代码
同步代码
对比差异 通过 Pull Request 同步
同步更新到分支
通过 Pull Request 同步
将会在向当前分支创建一个 Pull
Request,合入后将完成同步
File empty ...
提示: 由于 Git 不支持空文件夾,创建文件夹后会生成空的 .keep 文件
Loading...
README

How To Train and Deploy Image Classifier with MLflow and Keras

In this example we demonstrate how to train and deploy image classification models with MLflow. We train a VGG16 deep learning model to classify flower species from photos using a tensorflow.org. Note that although we use Keras to train the model in this case, a similar approach can be applied to other deep learning frameworks such as PyTorch.

The MLflow model produced by running this example can be deployed to any MLflow supported endpoints. All the necessary image preprocessing is packaged with the model. The model can therefore be applied to image data directly. All that is required in order to pass new data to the model is to encode the image binary data as base64 encoded string in pandas DataFrame (standard interface for MLflow python function models). The included Python scripts demonstrate how the model can be deployed to a REST API endpoint for realtime evaluation or to Spark for batch scoring..

In order to include custom image pre-processing logic with the model, we define the model as a custom python function model wrapping around the underlying Keras model. The wrapper provides necessary preprocessing to convert input data into multidimensional arrays expected by the Keras model. The preprocessing logic is stored with the model as a code dependency. Here is an example of the output model directory layout:

tree model
model
├── MLmodel
├── code
│  └── image_pyfunc.py
├── data
│  └── image_model
│  ├── conf.yaml
│  └── keras_model
│  ├── MLmodel
│  ├── conda.yaml
│  └── model.h5
└── mlflow_env.yml

The example contains the following files:

  • MLproject Contains definition of this project. Contains only one entry point to train the model.
  • conda.yaml Defines project dependencies. NOTE: You might want to change tensorflow package to tensorflow-gpu if you have gpu(s) available.
  • train.py Main entry point of the projects. Handles command line arguments and possibly downloads the dataset.
  • keras_image_classifier.py The implementation of the model train and also of the outputed custom python flavor model. Note that the same preprocessing code that is used during model training is packaged with the output model and is used during scoring.
  • score_images_rest.py Score an image or a directory of images using a model deployed to a REST endpoint.
  • score_images_spark.py Score an image or a directory of images using model deployed to Spark.

Running this Example

To train the model, run the example as a standard MLflow project:

mlflow run examples/flower_classifier

This will download the training dataset from tensorflow.org, train a classifier using Keras and log results with Mlflow.

To test your model, run the included scoring scripts. For example, say your model was trained with run_id 101.

  • To test REST api scoring do the following two steps:

    1. Deploy the model as a local REST endpoint by running mlflow pyfunc serve:
    # deploy the model to local REST api endpoint
    mlflow pyfunc serve -p 54321 -r 101 -m model
    
    1. Apply the model to new data using the provided score_images_rest.py script:
    # score the deployed model
    python score_images_rest.py --port 54321 http://127.0.0.1 ./my_images_to_score
    
  • To test batch scoring in Spark, run score_images_spark.py to score the model in Spark like this:

python score_images_spark.py ./my_images_to_score model --run-id 101
举报
举报成功
我们将于2个工作日内通过站内信反馈结果给你!
请认真填写举报原因,尽可能描述详细。
请选择举报类型
取消
发送
误判申诉

此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。

如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。

取消
提交

简介

MLflow 是由 Apache Spark 技术团队开源的一个机器学习平台,主打开放性: 开放接口:可与任意 ML 库、算法、部署工具或编程语言一起使用
取消

发行版

暂无发行版

贡献者

全部

近期动态

不能加载更多了
编辑仓库简介
简介内容
主页
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
JavaScript
1
https://gitee.com/readerloop/MLflow.git
git@gitee.com:readerloop/MLflow.git
readerloop
MLflow
MLflow
master
点此查找更多帮助

搜索帮助

评论
仓库举报
回到顶部
登录提示
该操作需登录 Gitee 帐号,请先登录后再操作。
立即登录
没有帐号,去注册

AltStyle によって変換されたページ (->オリジナル) /