-
-
Notifications
You must be signed in to change notification settings - Fork 791
Any plans to implement mxfp4 and/or nvfp4? #1783
Unanswered
davidmezzetti
asked this question in
Q&A
-
Hello. I'm a big fan of bitsandbytes
, torch and the general HF ecosystem!
I'm aware of torchao but I'm wondering if there are any plans to support mxfp4 and/or nvfp4? Obviously the native support for GPUs is great but a really nice thing about bitsandbytes
is it has a basic fallback to cpu. That makes it much easier to implement the functionality and ensure it works, even if it's slow.
Thank you!
Beta Was this translation helpful? Give feedback.
All reactions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment