Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Really struggling, latest version of llama-server, Mistral Nemo Instruct 2407, adding tool capability #16652

Unanswered
linuxmagic-mp asked this question in Q&A
Discussion options

Okay, after three days.. now probably a .jinja file expert, but still struggling. Start the server with a custom .jinja file, modeled on the on mistralai-Mistral-Nemo-Instruct-2407.jinja, tools successfully load, the LLM can run the tool, but it won't do it in inline, instead I keep getting the one turn problem, it outputs the TOOL_CALL JSON only, instead of represssing that and responding based on TOOL_RESULTS. Whatever input I add, then it replies with the user friendly response of the previous query. Anyone get this working?

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant

AltStyle によって変換されたページ (->オリジナル) /