Pinned Loading

1. runpod-workers/worker-vllm runpod-workers/worker-vllm Public

   The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

   Python 401 276

2. runpod/flash runpod/flash Public

   Application framework for Multimodal Distributed inference & Orchestration.

   Python 18 6

3. runpod-workers/worker-sglang runpod-workers/worker-sglang Public

   SGLang is fast serving framework for large language models and vision language models.

   Python 33 20

4. NumexaHQ/frugal NumexaHQ/frugal Public

   ⚡️ Transform AI/ML operations: Transparency, Control and Cost Optimization. ⚡️

   JavaScript 23 2

5. NumexaHQ/captainCache NumexaHQ/captainCache Public

   prompt caching to save dollars on generative AI API usage.

   Go 6

6. HalfUnet-ImageSegmentation HalfUnet-ImageSegmentation Public

   Jupyter Notebook 3