Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings
This repository was archived by the owner on Nov 27, 2024. It is now read-only.

v0.15.0 - VideoToVideo Diffusion + ControlNet Support #91

saddam213 started this conversation in General
Discussion options

VideoToVideo Diffusion + ControlNet Support

Video2Video - Pass Videos or GIF images though your favorite Stable-Diffusion pipeline and get Video output
ControlNet - Highly requested feature, initial support includes ControlNet, ImageToImage and VideoToVideo

What's Changed

Nuget Packages Updated

https://www.nuget.org/packages/OnnxStack.Core/0.15.0
https://www.nuget.org/packages/OnnxStack.ImageUpscaler/0.15.0
https://www.nuget.org/packages/OnnxStack.StableDiffusion/0.15.0

Full Changelog: v0.14.3...v0.15.0

Example UI Builds

Name ONNX EP Device Requirements Status
OnnxStack_UI.zip DirectML CPU, AMD GPU, Nvidia GPU At least Windows10 Stable
OnnxStack_UI_Cuda.zip CUDA CPU, Nvidia GPU CUDA 11 and cuDNN toolkit Experimental
OnnxStack_UI_TensorRT.zip TensorRT CPU, Nvidia GPU CUDA 11 , cuDNN and TensorRT libraries Experimental

This discussion was created from the release v0.15.0 - VideoToVideo Diffusion + ControlNet Support.
You must be logged in to vote

Replies: 1 comment

Comment options

saddam213
Jan 5, 2024
Maintainer Author

OnnxStack UI Setup Steps for ControlNet

Onnx ControlNet
Download or clone all files
Onnx ControlNet

Onnx ControlNet enabled StableDiffusion models
Download or clone one of these models
Stable Diffusion 1.5 with ControlNet
Realistic Vision with ControlNet

Install the ControlNet enabled StableDiffusion model using the SD-ControlNet template
image

Then install one or more of the desired ControlNet models
image
Some models support Annotation models they help pre-process the image for control net, these are optional and can be left blank

When you select a ControlNet enabled StableDiffusion model a dropdown with the ControlNet models available is shown
image

Once you have loaded both models you can now use control net.

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
1 participant

AltStyle によって変換されたページ (->オリジナル) /