llm-deployment

Star

Here are 11 public repositories matching this topic...

Language: All

Filter by language

All 11 Python 4 Jupyter Notebook 2 JavaScript 1 Shell 1

Sort: Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

trustgraph-ai / trustgraph

Star 679

The agentic AI platform for enterprise. Built for availability, scalability, and security. Complete end-to-end context engineering and LLM orchestration infrastructure. Run anywhere - local, cloud, or bare metal.

data context data-engineering data-extraction data-sovereignty model-serving etl-pipeline ai-native llm-deployment context-management graphrag llm-orchestration agentic-rag agentic-ai agentic-ai-development knowledge-core trustgraph agentic-graphrag context-engineering

Updated Oct 11, 2025
Python

little51 / llm-dev

Star 184

《大模型项目实战:多领域智能应用开发》配套资源

chat-application llm llm-training llm-inference llm-deployment

Updated Oct 16, 2025
JavaScript

eos3-ai / bubble-rag

Star 120

rag llm-training llm-deployment rag-chatbot

Updated Sep 25, 2025
Python

saucam / Awesome-LLM-Prod

Star 7

A curated collection of open-source Large Language Model (LLM) projects that are production-ready and can be used for solving real-world problems. This repository focuses on high-performance, scalable LLM solutions across various industries and applications.

data-science production agents fine-tuning rag large-language-models llm llm-deployment

Updated May 17, 2025

BjornMelin / local-llm-workbench

Star 3

🧠 A comprehensive toolkit for benchmarking, optimizing, and deploying local Large Language Models. Includes performance testing tools, optimized configurations for CPU/GPU/hybrid setups, and detailed guides to maximize LLM performance on your hardware.

cuda gpu-acceleration model-management inference-optimization model-quantization cpu-inference llama-cpp local-llm llm-deployment llm-benchmarking ollama-optimization hybrid-inference wsl-ai-setup context-window-scaling

Updated Mar 27, 2025
Shell

davide97l / LLM-deploy-API

Star 2

API to efficiently deploy Language Model (LLM) applications using Flask API

flask-application flask-api llm-inference llm-deployment

Updated Feb 26, 2024

samanthajmichael / baymax_tc

Star 0

LLM App for summarization of Terms and Conditions agreements available on the internet.

python terms-and-conditions terms-of-service-agreements large-language-models llm llm-deployment

Updated Nov 18, 2024
Jupyter Notebook

ajithvcoder / emlo4-session-16-ajithvcoder

Star 0

AWS EKS + IRSA, Volumes, ISTIO & KServe+ NextJS App + Fastapi Serve + kubernetes + Helm charts + Multimodel or LLM-Deployment The School of AI EMLO-V4 course assignment https://theschoolof.ai/#programs

docker kubernetes nextjs istio aws-eks fastapi kserve llm-deployment