Popular repositories Loading

1. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

   Python

2. GPTQModel GPTQModel Public

   Forked from ModelCloud/GPTQModel

   Python

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. lm-evaluation-harness lm-evaluation-harness Public

   Forked from EleutherAI/lm-evaluation-harness

   A framework for few-shot evaluation of language models.

   Python

5. optimum optimum Public

   Forked from huggingface/optimum

   🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

   Python

6. templui templui Public

   Forked from templui/templui

   The UI Kit for templ

   templ