Apertus (Swiss LLM) hosted on FastAPI with Hugging Face transformers
- Python 94.6%
- Dockerfile 5.4%
|
|
||
|---|---|---|
| .gitattributes | HF style README | |
| .gitignore | Initial release 🫂 | |
| .python-version | Added pyproject | |
| app.py | Quantization config | |
| Dockerfile | Dockerfile | |
| LICENSE | Xielu support | |
| pyproject.toml | Updated requirements | |
| README.md | Requirements | |
| requirements.txt | Updated requirements | |
| system_prompt.md | Recommended system prompt | |
| uv.lock | Updated requirements | |
| title | emoji | colorFrom | colorTo | sdk | app_port | fullWidth | suggested_storage | suggested_hardware | tags | license |
|---|---|---|---|---|---|---|---|---|---|---|
| Apertus on FastAPI | 🌖 | red | gray | docker | 8000 | false | small | t4-medium |
apertus
|
apache-2.0 |
Apertus transformer on FastAPI
A FastAPI-based Python application that provides an API to interface with the Apertus LLM from the Swiss AI Initiative.
The OpenAI-compatible API is inspired by openai-compatible-fastapi.
The goal is to use the Apertus Format API in a lightweight service with an efficient, paged attention mechanism.
If you're debugging locally, it may help you to use tiny-random/apertus instead of the full model.
Terms of use
For more information on Apertus, go to https://huggingface.co/swiss-ai
This is an open source project under the Apache 2.0 License
If you have further suggestions please leave them on Codeberg Issues