Beta self-hosted HTTP and LLM proxy with Redis-backed caching, non-streaming LLM idempotency, and budget guardrails.
-
Updated
Sep 7, 2026 - Python
Beta self-hosted HTTP and LLM proxy with Redis-backed caching, non-streaming LLM idempotency, and budget guardrails.
Wayground is a full-stack AI-powered quiz platform where teachers can create and manage quizzes, generate questions with AI, and track student results. Students can browse quizzes, take timed assessments, review their answers, and see their score history.
Production-minded Go API reliability lab: idempotency, tenant isolation, retries, circuit breaking, WebSocket replay, Prometheus and Grafana.
Pinned API Retry-After reliability task for an Agent Bounties child
Validating, idempotent ingestion gateway for FHIR-shaped healthcare data: cross-field validation at the door (claim totals must equal item sums), Idempotency-Key replay/409 semantics, batch vs transaction bundles, and a requeueable dead-letter queue. ~600 resources/s measured; bad data never 500s.
Drop-in idempotency layer for POST endpoints: atomic Redis claiming, byte-identical replay, in-flight collapsing. Proof asserted in tests: 50 concurrent duplicate payment requests, exactly one charge. Includes the crash-window test middleware demos hide, closed with a DB uniqueness constraint (ADR explains which layer owns which guarantee).
Cost-Aware API Reliability RL Environment using OpenEnv
Model-serving gateway with dynamic micro-batching (fill-to-32 or 4ms deadline) and load shedding: +54% throughput and p99 cut from 2,289ms to 915ms at 64-way concurrency vs naive serving. Documents, with measurements, when batching is pure loss.
Production-oriented Python example for retries, backoff, response validation, and multi-model fallback with CometAPI.
ComtradeBench OpenEnv: execution-grounded benchmark for reliable LLM tool-use under adversarial trade-data API conditions.
Briza — independent third-party profile of a public API surface, by API Evangelist. Briza helps insurance carriers stop losing premium to slow integrations and submission errors, treating carrier API reliability as a manufacturing discipline. A team of Six Sigma Black Belts, Briza applies Kaizen principles to API connectivity across commercial insu
To associate your repository with the api-reliability topic, visit your repo's landing page and select "manage topics."