DEV Community

# quantization

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Fine-Tuning LLMs: LoRA, Quantization, and Distillation Simplified

iamfaham profile

Syed Mohammed Faham

Syed Mohammed Faham

Fine-Tuning LLMs: LoRA, Quantization, and Distillation Simplified

#llm #finetuning #ai #quantization

5 min read

Unleash AI on Tiny Hardware: Quantization for Embedded Reinforcement Learning by Arvind Sundararajan

arvind_sundararajan profile

Arvind SundaraRajan

Arvind SundaraRajan

Unleash AI on Tiny Hardware: Quantization for Embedded Reinforcement Learning by Arvind Sundararajan

#machinelearning #embedded #ai #quantization

2 min read

Squeezing AI into Tiny Spaces: The Integer Revolution

arvind_sundararajan profile

Arvind SundaraRajan

Arvind SundaraRajan

Squeezing AI into Tiny Spaces: The Integer Revolution

#machinelearning #deeplearning #quantization #optimization

2 min read

How to Calculate Perplexity (PPL) the Right Way (and Avoid Common Pitfalls)

edsonke profile

How to Calculate Perplexity (PPL) the Right Way (and Avoid Common Pitfalls)

#llm #ai #quantization

2 min read

Extended RaBitQ: an Optimized Scalar Quantization Method

gaoj0017 profile

Extended RaBitQ: an Optimized Scalar Quantization Method

#rabitq #vectordatabase #quantization #rag

7 min read

Quantization in The Counterintuitive High-Dimensional Space

gaoj0017 profile

Quantization in The Counterintuitive High-Dimensional Space

#vectordatabase #rag #quantization #rabitq

11 min read

Understanding Quantization in AI: A Comprehensive Guide Including LoRA and QLoRA

jackrover profile

Understanding Quantization in AI: A Comprehensive Guide Including LoRA and QLoRA

#quantization #ai

3 min read

loading...