Skip to content

make bot --model parameter function correctly #29

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open

tijszwinkels wants to merge 1 commit into togethercomputer:main

from tijszwinkels:fix-model-cli-option

Open

make bot --model parameter function correctly #29

Changes from all commits

Commits

Show all changes

Select commit

make bot --model parameter function correctly

tijszwinkels Jul 7, 2024

File filter

Filter by extension

Conversations

Jump to

Jump to file

Failed to load files.

Loading

Diff view

Diff view

7 changes: 4 additions & 3 deletions bot.py

Show comments View file Open in desktop

Original file line number	Diff line number	Diff line change
Expand Up		@@ -118,7 +118,7 @@ def main(

		model = Prompt.ask(
		"\n1. What main model do you want to use?",
	default="Qwen/Qwen2-72B-Instruct",
	default=model,
		)
		console.print(f"Selected {model}.", style="yellow italic")
		temperature = float(
Expand Down Expand Up		@@ -199,8 +199,9 @@ def main(

		for chunk in output:
		out = chunk.choices[0].delta.content
	console.print(out, end="")
	all_output += out
	if out is not None:
	console.print(out, end="")
	all_output += out
		print()

		if DEBUG:
Expand Down

1 change: 1 addition & 0 deletions requirements.txt

Show comments View file Open in desktop

Original file line number	Diff line number	Diff line change
Expand Up		@@ -4,3 +4,4 @@ loguru
		datasets
		typer
		rich
	cffi