Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Add Q4_0 and Q8_0 quantization support for 310p npu Ascend CANN #16484

cecuca started this conversation in Ideas
Discussion options

Add support for launching quantized weights on 310p NPU like Atlas 300i duo cards. There is none backends which supports quantization for 310p except mindIE(only INT8 with special format convertion). Quant support will make this card best value for local inference.

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Ideas
Labels
None yet
1 participant

AltStyle によって変換されたページ (->オリジナル) /