This repository was archived by the owner on Jul 4, 2025. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 179
Cortex.cpp: Built-in model library format #1178
freelerobot
started this conversation in
Architecture Specs
-
Problem
- our current corteso branches, model variant aliases have become a clusterneuken and is unmaintainable
- lets define some basic rules for how we plan to handle built in models and their variants.
Questions
- How should we organize the repo?
- How do model variants map to respective branches?
- Model variants have a declarative long form
q4_k_s_8b
vs an alias8b
, how should we design this? - Do we need a
metadata.yaml
ormetadata.json
in the main branch to indicate all supported variants? And also to include decorator attrs likelicense
author
tags
? - Should we remove all the remote model.yamls, like gpt/claude (seems like a bad previous decision)?
- How can we leverage HF's collections feature? https://huggingface.co/collections/cortexso/curated-models-6687ab2fbec843c68109bd51
cc @louis-jan @hiento09 @dan-homebrew @nguyenhoangthuan99
Beta Was this translation helpful? Give feedback.
All reactions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment