Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
Deliver safe & effective language models
Framework for testing vulnerabilities of large language models (LLM).
MIT-licensed Framework for LLMs, RAGs, Chatbots testing. Configurable via YAML and integrable into CI pipelines for automated testing.
A tool for testing and comparing the performance of different Large Language Model APIs. 一个用于测试和比较不同大语言模型API性能的工具。
g4f-working is a daily-updated list of working no-auth AI providers and models from @xtekky/gpt4free. It helps developers, testers, and AI enthusiasts instantly find which models are currently online and accessible without any API keys, tokens, or cookies.
Open-source framework for stress-testing LLMs and conversational AI. Identify hallucinations, policy violations, and edge cases with scalable, realistic simulations. Join the discord: https://discord.gg/ssd4S37WNW
Test your production LLMs and simulate users
Test, compare, and optimize your AI prompts in minutes
Tiny QA Benchmark++ a micro-benchmark suite (52-item gold + on-demand multilingual synthetic packs), generator CLI, and CI-ready eval harness for ultra-fast LLM smoke-testing & regression-catching.
Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.
LLM Performance Testing | K6 + Grafana + InfluxDB | A tiny toolkit for load testing and benchmarking OpenAI-like inference endpoints using K6 + Grafana + InfluxDB
⚡ Streamline AI development with a multi-agent framework that integrates 80+ prompt engineering techniques for effective team coordination and automation.
🐙 Multi-armed mocks for LLM apps - Drop-in replacement for OpenAI/Anthropic APIs for deterministic testing
Rage4j is a java library thats helps evaluate LLM's based on scientifically grounded metrics
API Ninja simplifies API testing by allowing users to define test flows in plain English.
VerifyAI is a simple UI application to test GenAI outputs
A lightweight, console-based Python tool for AI-driven code generation and project management. Optimized for resource-constrained systems, it supports multiple AI providers and self-regeneration.
The prompt engineering, prompt management, and prompt evaluation tool for Go.
Add a description, image, and links to the llm-testing topic page so that developers can more easily learn about it.
To associate your repository with the llm-testing topic, visit your repo's landing page and select "manage topics."