A large-scale 7B pretraining language model developed by BaiChuan-Inc.
natural-language-processing artificial-intelligence chinese llama huggingface ceval gpt-4 large-language-models chatgpt mmlu
-
Updated
Jul 18, 2024 - Python
#
mmlu
Here are 27 public repositories matching this topic...
Sort: Most stars
Sort options
A series of large language models developed by Baichuan Intelligent Technology
benchmark natural-language-processing artificial-intelligence chinese gpt huggingface ceval gpt-4 large-language-models chatgpt mmlu llama2
-
Updated
Nov 8, 2024 - Python
A 13B large language model developed by Baichuan Intelligent Technology
benchmark natural-language-processing artificial-intelligence chinese huggingface ceval gpt-4 large-language-models chatgpt mmlu
-
Updated
Sep 6, 2023 - Python
A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]
-
Updated
May 17, 2025
[NeurIPS 2023 Spotlight] In-Context Impersonation Reveals Large Language Models' Strengths and Biases
chatbot text-generation artificial-intelligence llama clip reasoning bandit neurips-2023 mmlu llama2 in-context-impersonation
-
Updated
Nov 30, 2024 - Python
Production-grade LLM Evaluation & Benchmarking Framework — GPT-4, Claude, Gemini, Mistral. Accuracy, latency, cost, hallucination, reasoning metrics.
python nlp benchmarking machine-learning ai latency gemini accuracy llama mistral claude hallucination fastapi streamlit gpt4 large-language-models mmlu llm-evaluation litellm truthfulqa
-
Updated
Jun 7, 2026 - Python
[NeurIPS 2025] AGI-Elo: How Far Are We From Mastering A Task?
benchmark leaderboard agi imagenet coco artificial-general-intelligence datasets evaluation-metrics elo-rating rating-system evaluation-framework sota ai-benchmarks waymo-open-dataset mmlu vision-language-action ai-evaluation-framework livecodebench navsim
-
Updated
Oct 28, 2025 - Python
Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.
python benchmarking machine-learning cuda nvidia fastapi llm lm-evaluation-harness llama-cpp vllm mmlu gguf
-
Updated
Jun 13, 2026 - Python
A Massive Multitask Benchmark for Urdu Language Understanding
-
Updated
Jun 8, 2026 - Jupyter Notebook
Code and data accompanying the article "The impact of quantising a small open source LLM". This repository explores how quantisation affects performance, VRAM usage, and inference speed in Qwen3 1.7B.
-
Updated
Jul 5, 2025 - Python
Enterprise-grade LLM evaluation framework | Multi-model benchmarking, honest dashboards, system profiling | Academic metrics: MMLU, TruthfulQA, HellaSwag | Zero fake data | PyPI: llm-benchmark-toolkit | Blog: https://dev.to/nahuelgiudizi/building-an-honest-llm-evaluation-framework-from-fake-metrics-to-real-benchmarks-2b90
visualization python benchmarking machine-learning performance-testing academic-metrics mmlu ollama llm-evaluation truthfulqa hellaswag
-
Updated
Dec 5, 2025 - Python
Benchmark suite for open-source language models on the edge. Evaluates inference efficiency, MMLU accuracy, and LLM-rated teaching effectiveness.
python raspberry-pi benchmark language-models reproducibility edge-computing social-robots educational-robotics llm mmlu ollama teaching-effectiveness arso2026
-
Updated
Jun 11, 2026 - Python
CLI tool to evaluate LLM factuality on MMLU benchmark.
-
Updated
Nov 26, 2025 - Python
An easy-to-use and standardised framework for evaluating Large Language Models (LLMs) on the Massive Multitask Language Understanding (MMLU) dataset. Currently supported: Hugging Face transformer models and Bedrock models.
-
Updated
Jul 12, 2025 - Python
大模型评测平台 — 本地/API/HuggingFace/OpenCompass 三路后端,支持数据生产(Self-Instruct/Evol-Instruct)、长尾场景生成、弱项挖掘、回归分析、污染检测、Bad Case归因。可扩展的 Benchmark 系统和 LLM-as-Judge 自动评分。
python flask humaneval ai-evaluation gsm8k mmlu llm-evaluation benchmark-platform rag-evaluation llm-as-judge opencompass llm-benchmark data-contamination-detection
-
Updated
Jun 7, 2026 - Python
A tool to evaluate and compare local LLMs running on Ollama or LM Studio under identical conditions using deepeval's public benchmarks (MMLU, TruthfulQA, GSM8K).
python macos benchmark quantization model-evaluation apple-silicon llm gsm8k local-llm mmlu ollama lmstudio truthfulqa deepeval
-
Updated
Mar 14, 2026 - Python
LLMs' performance analysis on CPU, GPU, Execution Time and Energy Usage
-
Updated
Apr 1, 2024 - Java
Dataset management library for ML experiments—loaders for SciFact, FEVER, GSM8K, HumanEval, MMLU, TruthfulQA, HellaSwag; git-like versioning with lineage tracking; transformation pipelines; quality validation with schema checks and duplicate detection; GenStage streaming for large datasets. Built for reproducible AI research.
machine-learning streaming elixir otp data-validation beam fever versioning benchmarks data-management datasets reproducibility genstage data-quality humaneval gsm8k mmlu scifact nshkr-crucible north-shore-ai
-
Updated
Apr 23, 2026 - Elixir
Improve this page
Add a description, image, and links to the mmlu topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mmlu topic, visit your repo's landing page and select "manage topics."