Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings
/ oke Public

a collection of libraries for interacting with llamacpp

License

Notifications You must be signed in to change notification settings

oofdere/oke

Repository files navigation

oke >< (wiiiiip)

not the best, but an oke way to use llamacpp

packages

all packages are on jsr under the @oke scope. if you use pnpm or yarn (or deno obviously) they already support jsr.

universal

  • JSR @oke/grammar: dynamically generate gbnf grammars. this is the only one that isn't designed for exclusively function calling!
  • TODO [@oke/pedantic]: generate a standard schema and a gbnf at the same time
  • JSR @oke/client: llama-server api client

for deno

  • JSR @oke/manage: start and stop llama-server from within your application

for the browser

  • TODO [@oke/stores]: reactive stores for frontend stuff
  • TODO [@oke/hump]: an example frontend built on sveltekit

license

oke is licensed under BSL 1.1 with an Additional Use Grant permitting use (including commercially!) as long as your software doesn't interface with closed source models. see license.md for more info.


give me money if you find this useful or your employer hates the license

About

a collection of libraries for interacting with llamacpp

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

AltStyle によって変換されたページ (->オリジナル) /