Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Any plans to implement mxfp4 and/or nvfp4? #1783

Unanswered
davidmezzetti asked this question in Q&A
Discussion options

Hello. I'm a big fan of bitsandbytes, torch and the general HF ecosystem!

I'm aware of torchao but I'm wondering if there are any plans to support mxfp4 and/or nvfp4? Obviously the native support for GPUs is great but a really nice thing about bitsandbytes is it has a basic fallback to cpu. That makes it much easier to implement the functionality and ensure it works, even if it's slow.

Thank you!

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant

AltStyle によって変換されたページ (->オリジナル) /