-
Notifications
You must be signed in to change notification settings - Fork 435
Is it still possible to generate GGML quants? #137
Unanswered
walking-octopus
asked this question in
Q&A
-
Laptops have quite little disk space. Since all they can run are quants anyway, it makes sense to just quantize once and reuse instead of even keeping raw weights.
Beta Was this translation helpful? Give feedback.
All reactions
-
❤️ 2
Replies: 1 comment
-
At the moment, it's not supported. I'll add it later.
Beta Was this translation helpful? Give feedback.
All reactions
-
👍 2
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment