Skip to content

#

mooncake

Here are 9 public repositories matching this topic...

Language: All

Filter by language

All 9 Python 4 Go 1 Rust 1 Shell 1 MoonBit 1

lightseekorg / TorchSpec

A PyTorch native library for training speculative decoding models

pytorch mooncake llm vllm fsdp tokenspeed eagle3 lightseek dspark

Updated Sep 4, 2026
Python

Tele-AI / Fluxon

An AI-native distributed data plane built in Rust that supports high performance RPC, KV Cache, Message Queue, and File & Object Acceleration

training redis nosql inference rpc message-queue rdma distributed-file-system data-processing observability alluxio memory-pool distributed-cache mooncake multi-cluster shared-memory-communication s3-compatible kv-cache ai-infra ai-native

Updated Aug 10, 2026
Rust

lalawue / MoocHelper

MoocHelper is a High-performance MoonCake/Lua plugin, Language Server Protocol for MoonCake/Lua, on the shoulders of LuaHelper.

lua luajit lsp-server mooncake lsp-client moocscript

Updated Jun 21, 2025
Go

jiahaoliang / mooncake-learning

Mooncake、vLLM、vLLM Ascend 相关的中文教程。

mooncake vllm vllm-ascend

Updated Jun 23, 2026

fanyi-zhao / cloud-llm-dev-scripts

Instant setup scripts for cloud-based LLM development.

devops aws-s3 developer-tools cloud-development setup-script mooncake llm gpu-inference open-webui sglang

Updated Jan 19, 2026
Shell

Bemly / mbt-cstdio-ffi

standard C library I/O FFI binding. 对C标准库中stdio的绑定

c ffi io ffi-bindings warpper mooncake moonbit

Updated Apr 10, 2026
MoonBit

JohnScheuer / request-routing-sim

Discrete-event simulation of LLM request routing across multiple serving instances: round-robin, least-load, prefix-aware, and hybrid cache-aware routing with queue-depth threshold sweep.

python simulation latency inference load-balancing multi-instance request-routing mooncake kv-cache llm-serving serving-infrastructure prefix-caching s-lora mlsystems

Updated Jul 19, 2026
Python

Lorry1024 / ccf2026-mooncake-engineering-log

KVCache Forge 的 CCF 2026 Mooncake 赛题工程日志、设计决策、实验记录与决赛路线图。

distributed-systems performance mooncake kvcache engineering-log ccf2026

Updated Aug 6, 2026
Python

karthikarunapuram8-dot / kv-cache-side-channel-poc

Self-contained PoC: cross-tenant timing oracle against shared content-hashed KV caches (Mooncake, Perplexity KV Messenger, DeepSeek 3FS).

side-channel ai-security mooncake kv-cache llm-inference agentic-ai security-poc

Updated May 17, 2026
Python

Add this topic to your repo

To associate your repository with the mooncake topic, visit your repo's landing page and select "manage topics."