-
Notifications
You must be signed in to change notification settings - Fork 432
-
Hello, just going to keep this short but essentially the problem is that sd.cpp is using my CPU instead of GPU via the Vulkan backend to generate the images, which is very time consuming, but the results are promising, here are a few screenshots and my system information, please help:
# System Details Report
---
## Report details
- **Date generated:** 2025年07月24日 13:34:13
## Hardware Information:
- **Hardware Model:** Lenovo IdeaPad Slim 5 16AHP9
- **Memory:** 16.0 GiB
- **Processor:** AMD RyzenTM 7 8845HS w/ RadeonTM 780M Graphics ×ばつ 16
- **Graphics:** AMD RadeonTM Graphics
- **Disk Capacity:** 512.1 GB
## Software Information:
- **Firmware Version:** NGCN28WW
- **OS Name:** Bazzite 42 (FROM Fedora Silverblue)
- **OS Build:** Stable (F42.20250603)
- **OS Type:** 64-bit
- **GNOME Version:** 48
- **Windowing System:** Wayland
- **Kernel Version:** Linux 6.14.6-106.bazzite.fc42.x86_64
Beta Was this translation helpful? Give feedback.
All reactions
Replies: 1 comment 20 replies
-
Could you share the first few lines of the logs? The information about the devices used is there.
Also what does it say when you run vulkaninfo --summary?
Beta Was this translation helpful? Give feedback.
All reactions
-
About your sd2 issue, it looks like you don't have enough VRAM available, or at least the driver is not able to allocate any more? In which case there's no way it will work with Flux, which takes a lot more VRAM.
You could try running sd2 with --type q4_0 and see if it works (it will take a long time to load)
Beta Was this translation helpful? Give feedback.
All reactions
-
--type q4_0 just made my PC just almost OOM, GNOME force killed off things including terminal to save it, this is depressing honestly, as for FLUX1, willing to try if it magically works, can I get any VAE and use it for it?
Beta Was this translation helpful? Give feedback.
All reactions
-
You need to use Flux VAE, which can be found on Huggingface pretty easily. I think SD3's vae might technically work with Flux, but the output will look completely broken.
Beta Was this translation helpful? Give feedback.
All reactions
-
--type q4_0just made my PC just almost OOM, GNOME force killed off things including terminal to save it, this is depressing honestly, as for FLUX1, willing to try if it magically works, can I get any VAE and use it for it?
Better only specify type when converting model files, otherwise it needs to convert it in memory everytime.
Beta Was this translation helpful? Give feedback.
All reactions
-
@LePichu can you grab the sd_turbo-f16-q8_0.gguf from https://huggingface.co/Green-Sky/SD-Turbo-GGUF and post a log with minimal command line parameters? (also use model specific params mentioned in the readme)
Beta Was this translation helpful? Give feedback.