Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Sign up
Appearance settings

Releases: turboderp-org/exllamav2

0.3.2

13 Jul 22:14
@github-actions github-actions

Choose a tag to compare 

Actions: Remove sentencepiece from other workflows
Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
Assets 109

0.3.1

27 May 15:16
@github-actions github-actions

Choose a tag to compare 

v0.3.1
Merge branch 'dev'
Loading

0.3.0

12 May 14:20
@github-actions github-actions

Choose a tag to compare

  • Add Qwen3 and Qwen3MoE support

Full Changelog: v0.2.9...v0.3.0

Loading
blackcat1402, erlidev, and Maykeye reacted with thumbs up emoji MRGRD56, gabinguo, blackcat1402, and dillonroach reacted with heart emoji
6 people reacted

0.2.9

23 Apr 22:58
@github-actions github-actions

Choose a tag to compare

  • Add Torch 2.7.0 wheels (big thanks to @kingbri1 for unborking the build action)
  • Support Gemma3, text + vision
  • Support Mistral 3.1, text + vision
  • Support partial_rotary_factor (Phi-4 mini etc.)
  • Support GLM4 (32B model still broken)
  • Various fixes

Full Changelog: v0.2.8...v0.2.9

Contributors

kingbri1
Loading
SampleGHUsername and firengate reacted with thumbs up emoji BatteredBunny, ivanbaldo, karlsolomon, and firengate reacted with hooray emoji BatteredBunny, ivanbaldo, and firengate reacted with heart emoji firengate reacted with rocket emoji
5 people reacted

0.2.8

08 Feb 00:01
@github-actions github-actions

Choose a tag to compare

  • Support Qwen2.5-VL
  • Minor bugfixes

Full Changelog: v0.2.7...v0.2.8

Loading
firengate reacted with thumbs up emoji firengate reacted with hooray emoji firengate reacted with heart emoji dclipca, JuggyMcNutty, and firengate reacted with rocket emoji
3 people reacted

0.2.7

30 Dec 01:28
@github-actions github-actions

Choose a tag to compare

  • Basic video support for Qwen2-VL
  • Support Cohere2 arch
  • Support Granite3 arch
  • Couple of bugfixes

Full Changelog: v0.2.6...v0.2.7

Loading
firengate, stormwine1986, flflow, alicat22, and QRcode1337 reacted with thumbs up emoji flflow and firengate reacted with laugh emoji BatteredBunny, firengate, Thireus, flflow, and LPCTSTR reacted with hooray emoji firengate, flflow, and alicat22 reacted with heart emoji firengate, flflow, and SyderAkaris reacted with rocket emoji firengate, Thireus, and flflow reacted with eyes emoji
9 people reacted

0.2.6

07 Dec 14:58
@github-actions github-actions

Choose a tag to compare

  • Some small fixes, most notably for Qwen2-VL inference on Windows

Full Changelog: v0.2.5...v0.2.6

Loading
flflow, firengate, and pabl-o-ce reacted with thumbs up emoji flflow and firengate reacted with laugh emoji flflow, firengate, and pabl-o-ce reacted with hooray emoji flflow, firengate, and pabl-o-ce reacted with heart emoji flflow, firengate, and pabl-o-ce reacted with rocket emoji flflow and firengate reacted with eyes emoji
3 people reacted

0.2.5

01 Dec 13:32
@github-actions github-actions

Choose a tag to compare

  • Initial support for Qwen2-VL (images for now, no video)
  • Some bugfixes

Full Changelog: v0.2.4...v0.2.5

Loading
flflow, firengate, and gabinguo reacted with thumbs up emoji flflow, firengate, and gabinguo reacted with laugh emoji flflow, firengate, and gabinguo reacted with hooray emoji flflow, firengate, gabinguo, and Thireus reacted with heart emoji flflow, firengate, and gabinguo reacted with rocket emoji
4 people reacted

0.2.4

12 Nov 03:21
@github-actions github-actions

Choose a tag to compare

  • Support Pixtral
  • Refactoring for more multimodal support
  • Faster filter evaluation
  • Various optimizations and bugfixes
  • Various quality of life improvements

Full Changelog: v0.2.3...v0.2.4

Loading
firengate, ThomasBaruzier, JoeySalmons, hacksmith-CA, flflow, and Ednaordinary reacted with thumbs up emoji firengate and flflow reacted with laugh emoji erlidev, rwwrwr, firengate, ThomasBaruzier, JoeySalmons, flflow, and Ednaordinary reacted with hooray emoji firengate, LemgonUltimate, WouterGlorieux, flflow, and Ednaordinary reacted with heart emoji firengate and flflow reacted with rocket emoji xonfour, flflow, and firengate reacted with eyes emoji
11 people reacted

0.2.3

29 Sep 11:04
@github-actions github-actions

Choose a tag to compare

  • No longer use safetensors for loading weights (fix virtual memory issues on Windows especially)
  • Disable fasttensors option (now redundant)
  • Prioritize HF Tokenizers model when both HF and SPM models available
  • Add XTC sampler
  • Add YaRN support
  • Various fixes and QoL improvements

Full Changelog: v0.2.2...v0.2.3

Loading
firengate, Thireus, and flflow reacted with thumbs up emoji firengate, Originalimoc, and flflow reacted with laugh emoji firengate, mamei16, and flflow reacted with hooray emoji flflow, firengate, MikeLP, LemgonUltimate, Julianlaue, and matthu017 reacted with heart emoji firengate and flflow reacted with rocket emoji
9 people reacted
Previous 1 3 4 5
Previous

AltStyle によって変換されたページ (->オリジナル) /