Pinned Loading

1. xlite-dev/LeetCUDA xlite-dev/LeetCUDA Public

   📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

   Cuda 9.3k 920

2. xlite-dev/lite.ai.toolkit xlite-dev/lite.ai.toolkit Public

   🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

   C++ 4.3k 767

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 67.4k 12.6k

4. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 22.4k 4k

5. huggingface/diffusers huggingface/diffusers Public

   🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

   Python 32.4k 6.7k

6. vipshop/cache-dit vipshop/cache-dit Public

   🤗A PyTorch-native and Flexible Inference Engine with Hybrid Cache Acceleration and Parallelism for DiTs.

   Python 895 50