Skip to content

#

llm-test

Here are 16 public repositories matching this topic...

Language: All

Filter by language

All 16 Python 8 HTML 2 TypeScript 2 JavaScript 1 Jupyter Notebook 1

Sort: Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

uptrain-ai / uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

machine-learning monitoring evaluation experimentation jailbreak-detection autoevaluation root-cause-analysis prompt-engineering llmops openai-evals llm-prompting llm-eval llm-test hallucination-detection

Updated Aug 18, 2024
Python

georgian-io / LLM-Finetuning-Toolkit

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

nlp unit-testing falcon classification summarization lora nlp-machine-learning zephyr fine-tuning finetuning ablation-study large-language-models flan-t5 redpajama qlora llm-test llama2 mistral-7b

Updated Oct 25, 2024
Python

Pacific-AI-Corp / langtest

Deliver safe & effective language models

nlp artificial-intelligence benchmarks benchmark-framework model-assessment ai-safety mlops responsible-ai ml-safety trustworthy-ai ethics-in-ai ml-testing large-language-models llm ai-testing llm-test llm-evaluation-toolkit llm-as-evaluator llm-testing

Updated Feb 18, 2026
Python

athina-ai / athina-sdk

LLM Testing SDK that helps you write and run tests to monitor your LLM app in production

monitoring testing-tools aiops mlops llm llmops llm-test

Updated Jan 22, 2024
Python

qjr87 / llm-api-test

A tool for testing and comparing the performance of different Large Language Model APIs. 一个用于测试和比较不同大语言模型API性能的工具。

api-performance-testing llm-test llm-testing llm-api-performance

Updated Dec 9, 2025
HTML

levitation-opensource / Manipulative-Expression-Recognition

MER is a software that identifies and highlights manipulative communication in text from human conversations and AI-generated responses. MER benchmarks language models for manipulative expressions, fostering development of transparency and safety in AI. It also supports manipulation victims by detecting manipulative patterns in human communication.

benchmarking sentiment-analysis manipulation transparency fraud-prevention human-computer-interaction human-robot-interaction expression-recognition sentiment-classification fraud-detection psychometrics misinformation conversation-analysis conversation-analytics llm prompt-engineering prompt-injection llm-security llm-training llm-test

Updated Jan 16, 2026
HTML

aralyekta / prompttester

Test, compare, and optimize your AI prompts in minutes

prompt-testing llm-tools llm-test llm-evaluation prompt-test llm-testing

Updated Aug 13, 2025
JavaScript

pyladiesams / eval-llm-based-apps-jan2025

Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

workshop llm llms llmops llm-eval llm-test llm-evaluation-framework llm-evaluation-metrics llm-monitoring llm-testing llm-evals

Updated May 6, 2025
Jupyter Notebook

prompt-foundry / typescript-sdk

The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

typescript gpt open-ai gpt-3 gpt-4 llm prompt-engineering llmops prompt-testing prompt-manager prompt-management llm-eval llm-test llm-ops llm-evaluation prompt-evaluation

Updated Nov 15, 2025
TypeScript

Coldwave96 / LLM-Sec-Evaluation

Scripts for evaluating LLM security abilities.

llm-test chatglm2-6b baichuan-13b

Updated Jul 24, 2023
Python

lalitkpal / VerifyAI

VerifyAI is a simple UI application to test GenAI outputs

ai-evaluation llm generative-ai genai llm-test llm-evaluation llm-evaluation-framework llm-evaluation-metrics llm-testing ai-metrics ai-evaluation-framework generative-ai-evaluation

Updated Sep 5, 2025
Python

prompt-foundry / go-sdk

The prompt engineering, prompt management, and prompt evaluation tool for Go.

go golang open-api gpt gpt-4 prompt-engineering prompt-manager prompt-management llm-eval llm-test llm-evaluation prompt-test llm-testing prompt-eva

Updated Jun 16, 2024

awesome-software / nlptest

Deliver safe & effective language models

Updated Jun 29, 2023
Python

thatoldfarm / logos-infinitum-artifact

A comprehensive corpus of interconnected texts and protocols designed as a conceptual stress-test for advanced AI.

ai ai-testing ai-test llm-prompting llm-test llm-testing ai-testing-tool llm-prompt-engineering llm-prompts llm-prompt-logic

Updated Jul 17, 2025

qbxlvnf11 / llm-test-page

LLM (GPT, Gemini etc.) Test Page: Chat, Parameters, GCP Cloud Run, Inference Time/Token/Cost Calculation etc.

chat-application llm llm-test

Updated Jan 1, 2026
Python

awesome-software / promptfoo

Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.

Updated Jun 28, 2023
TypeScript

Improve this page

Add a description, image, and links to the llm-test topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-test topic, visit your repo's landing page and select "manage topics."