Tune your AI Agent to best meet its KPI with a cyclic process of analyze, improve and simulate
Exploratory data analysis and interactive model-understanding and evaluation tool for chatbot training data and feedback
An open-source framework for robust, LLM-powered testing and tracing of conversational AI applications.
Evaluation results and experimental data for TRACER, demonstrating its effectiveness in discovering chatbot functionalities and detecting errors with coverage analysis and mutation testing.
This is a repository for a Jupyter based tool to calculate Greedy Matching, Vector Extrema and Average Embedding evaluation metrics for generative AI chatbots
AI chatbot evaluation benchmark for mental health and suicide prevention with rule-based ethical alignment, inclusivity scoring, and sentiment analysis. Research paper submitted to AI & Society (Springer Nature) under review.
Privacy-aware chatbot evaluation pipeline for Human-AI Interaction Design
Trustworthy AI evaluation tool for testing chatbot safety, reliability, hallucination behavior, privacy risk, and instruction-following quality.
LLM-as-a-judge evaluation demo for conversational AI: scores chats on a 4-dimension rubric into a single 0–100 quality score and calibrates the automated judge against human labels. Synthetic demo data.
First publication & part of Master’s thesis at HCMUS: End-to-end automatic evaluation framework for retrieval-augmented chatbots (accepted at ACIIDS 2026)
Structured evaluation of 30 support bot conversations measuring containment, escalation rate, intent accuracy, and CSAT correlation, LLM-assisted qualitative coding, edge cases, and recommendations.
Self-hosted LLM/Agent batch evaluation platform with OpenAI-compatible API testing, streaming response parsing, LLM-as-a-Judge scoring, Docker deployment, and CSV/XLSX export.
Add a description, image, and links to the chatbot-evaluation topic page so that developers can more easily learn about it.
To associate your repository with the chatbot-evaluation topic, visit your repo's landing page and select "manage topics."