Skip to content

#

exllama

Here are 15 public repositories matching this topic...

Language: All

Filter by language

All 15 Python 10 C++ 1 Jupyter Notebook 1 PowerShell 1 TypeScript 1

Sort: Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

sybil-solutions / local-studio

Control panel for VLLM, Sglang, llama.cpp, exllamav3

ai local hosting self llamacpp vllm exllama local-ai sglang

Updated Sep 2, 2026
TypeScript

gotzmann / booster

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

openai llama gpt llm chatgpt llamacpp llama-cpp vllm ggml exllama oobabooga ollama

Updated Aug 15, 2024
C++

innightwolfsleep / llm_telegram_bot

LLM telegram bot

bot telegram telegram-bot aiogram large-language-models llm text-generation-webui llamacpp exllama

Updated Sep 4, 2026
Python

c0sogi / llama-api

An OpenAI-like LLaMA inference API

api llama fastapi llamacpp exllama

Updated Sep 17, 2023
Python

ethicals7s / awesome-local-ai

152 open-source tools to run LLMs 100% locally – no cloud, no API keys, no censorship

voice inference self-hosted awesome-list quantization multi-modal fine-tuning llama-cpp vllm local-llm private-gpt exllama local-ai ollama crewai offline-ai rag-agents machine-learning-ai

Updated Nov 30, 2025

shinomakoi / magi_llm_gui

A Qt GUI for large language models

python gui qt llama llm llamacpp exllama

Updated Nov 17, 2023
Python

shinomakoi / AI-Messenger

A QT GUI for large language models

llama qt6 llamacpp exllama

Updated Dec 27, 2023
Python

seyf1elislam / OneClick_LLM_API_onColab

Run gguf LLM models in Latest Version TextGen-webui and koboldcpp

python colab-notebook llm llms gptq localllm exllama gguf localllama

Updated Aug 6, 2025
Jupyter Notebook

silphendio / sliced_llama

Simple LLM inference server

llm llm-inference exllama

Updated Jun 13, 2024
Python

NO-ob / simpleLlama

A Simple webserver for generating text with exllamav2

Updated Dec 18, 2023
Python

Aqirito / A.L.I.C.E

A.L.I.C.E (Artificial Labile Intelligence Cybernated Existence). A REST API of A.I companion for creating more complex system

text-to-speech anime rest-api text-generation artificial-intelligence tts waifu otaku pygmalion fastapi huggingface-transformers genshin-impact vits llm llms langchain gptq langchain-python exllama

Updated Feb 6, 2025
Python

ForgetMeAI / local-inference-optimizer-skill

Skill для Hermes / Claude Code / Codex-агентов: автоматический выбор и настройка LLM inference engine под железо, модель и workload — MLX, llama.cpp, ExLlama, vLLM, SGLang, TensorRT-LLM.

kv-cache ai-agent llama-cpp vllm local-llm llm-inference exllama sglang hermes-agent

Updated Jun 28, 2026
Python

kooten111 / EasyEXL

A Python script designed to streamline the process of quantizing models to exllamav2 format

quantization llm exllama

Updated May 17, 2024
Python

countzero / windows_exllama

This is a playground to explore the ExLlama project in a Windows environment.

python cuda conda torch exllama

Updated Jul 20, 2023
PowerShell

alexkreidler / quote-constraint

A constrained generation filter for local LLMs that makes them quote properly from a source document

llm local-llm exllama constrained-generation

Updated May 14, 2024
Python

Add this topic to your repo

To associate your repository with the exllama topic, visit your repo's landing page and select "manage topics."