-
Notifications
You must be signed in to change notification settings - Fork 199
-
Hey guys,
I know there is somewhat of an auto integration of Llama.cpp. When I set it up and ran a model via the built-in llama.cpp, it ran via CPU instead of Nvidia GPU. I am using RTX 5090. What settings should be configured for openwebui + llama.cpp to pickup and use the gpu instead?
Beta Was this translation helpful? Give feedback.
All reactions
Replies: 2 comments
-
Any update on this? I notice that the Windows version offers cuda 12 an 13 after installation, but Linux doesnt offer cuda at all on my end. Im using Fedora 43 and tried appimage and flatpak version. Both have the same issue
Beta Was this translation helpful? Give feedback.
All reactions
-
Any update on this? Is there any support on this software version?
Beta Was this translation helpful? Give feedback.