Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Cortex.cpp: Built-in model library format #1178

freelerobot started this conversation in Architecture Specs
Discussion options

Problem

  • our current corteso branches, model variant aliases have become a clusterneuken and is unmaintainable
  • lets define some basic rules for how we plan to handle built in models and their variants.

Questions

  • How should we organize the repo?
  • How do model variants map to respective branches?
  • Model variants have a declarative long form q4_k_s_8b vs an alias 8b, how should we design this?
  • Do we need a metadata.yaml or metadata.json in the main branch to indicate all supported variants? And also to include decorator attrs like license author tags?
  • Should we remove all the remote model.yamls, like gpt/claude (seems like a bad previous decision)?
  • How can we leverage HF's collections feature? https://huggingface.co/collections/cortexso/curated-models-6687ab2fbec843c68109bd51

cc @louis-jan @hiento09 @dan-homebrew @nguyenhoangthuan99

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
1 participant

AltStyle によって変換されたページ (->オリジナル) /