Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
Test, compare, and optimize your AI prompts in minutes
The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.
Prompture is an API-first library for requesting structured JSON output from LLMs (or any structure), validating it against a schema, and running comparative tests between models.
LLM Prompt Test helps you test Large Language Models (LLMs) prompts to ensure they consistently meet your expectations.
Community Plugin for Genkit to use Promptfoo
EvalWise is a developer-friendly platform for LLM evaluation and red teaming that helps test AI models for safety, compliance, and performance issues
A collection of prompts that I use on a day-to-day basis for work and leisure.
Sample project demonstrates how to use Promptfoo, a test framework for evaluating the output of generative AI models
Quickstart guide for using PromptFoo to evaluate LLM prompts via CLI or Colab.
A pytest-based framework for testing multi AI agents systems. It provides a flexible and extensible platform for complex multi-agent simulations. Supports many integrations like LiteLLM, CrewAI, LangChain etc.
Sample implementation demonstrating how to use Firebase Genkit with Promptfoo
A dynamic and interactive playground for testing and refining prompts with OpenAI's language models. Includes customizable inputs for prompts, advanced model settings, and live response streaming for seamless experimentation.
🐙 Team Agents unifica 82 especialistas en IA para resolver desafíos con chat inteligente, analista de requisitos y subida de documentos. Plataforma futurista y modular.
Add a description, image, and links to the prompt-testing topic page so that developers can more easily learn about it.
To associate your repository with the prompt-testing topic, visit your repo's landing page and select "manage topics."