-
Notifications
You must be signed in to change notification settings - Fork 432
App #909
-
Am on the road of creating a comfyui like app for this backend.
The goal is memory control and low-end devices. Because my PC is grumpy and I want Flux-generated goth babes.
The implementation is premature. And am by no means perceptive at optimization or coding oriented toward that.
Welcome to a design or code discussion.
(Two models setup workflow. My VRAM would never fit in 2 models. Basic automatic model release)
image
Beta Was this translation helpful? Give feedback.
All reactions
-
🎉 2
Replies: 1 comment 2 replies
-
Is this all using the stable-diffusion.h API?
Beta Was this translation helpful? Give feedback.
All reactions
-
No not strictly. The api does not allow for internal tensor manipulation or isolated decoding + encoding or batch processing.
I forked an older version that am tinkering with. As of writing this message, the implementation is quick and dirty. Using a mediator between the frontend and the backend to manage GGML contexts and stuff.
Locally though, I'm refactoring towards an event response system and a restructure of context management & memory.
Beta Was this translation helpful? Give feedback.
All reactions
-
👀 1
-
Got it, that makes more sense. It would be neat to develop a proper lower level API to make projects like this one easier.
Beta Was this translation helpful? Give feedback.
All reactions
-
👍 2