XMPP chat bot to interact with LLaMA.cpp
- Java 100%
|
|
||
|---|---|---|
| gradle | Gradle verification | |
| src | Add some goodies | |
| .gitignore | Initial commit | |
| .gitlab-ci.yml | Initial commit | |
| 0001-llamabot.patch | Add some goodies | |
| build.gradle | Initial commit | |
| gradle.properties | Gradle verification | |
| gradlew | Initial commit | |
| gradlew.bat | Initial commit | |
| LICENSE | Initial commit | |
| README.md | Actually note the start command | |
| XMPP-Filter.iml | Initial commit | |
Llamabot
Overview
LLaMA over XMPP
Quick Start
- Setup llama.cpp
- Apply the included patch file to llama.cpp:
git am 0001-llamabot.patch - Run the program once to generate example configs
- Populate Rooms.txt with rooms you want to interact with
- Populate Account.txt with first line JID and second line password for the bot account
- You can also message the bot 1:1, but it has issues with MAM and repeating itself
- Run it!
java -jar XMPP-LLaMA-*.jar config
Known Issues
- Underlying jaxmpp library can sometimes spew the entire message buffer again
Prebuilts
Credits
- Facebook for the model itself
- llama.cpp (MIT), https://github.com/ggerganov/llama.cpp
- Tigase Java XMPP Client Library (AGPL-3.0), https://github.com/tigase/jaxmpp