Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Sometimes responses are blank #258

Unanswered
SouljaVR asked this question in Q&A
Discussion options

Hi,

Firstly, thanks for your work with ChatterUI. It's the best frontend on android for interacting with LLM's by far, been having a ton of fun with it and it has been great for my workflow. I just had a question/need some help with an issue I can't quite figure out.

For some reason, with certain characters I import, the responses from the character is always blank. It does not seem to be a context length issue as I am using a locally hosted model that has the context set to 16k via the sampler settings.

Here is an example of a character card that gives me this issue:

https://pygmalion.chat/character/286733db-af9c-4b12-bfc3-b15ed147a7ea

And here is a character that has no issues for me and gives me replies:

https://www.chub.ai/characters/cptpants/Gorou

When I use this, the models response is just empty. I noticed it doesn't happen if I use external API's like GroqCloud etc, but if i use my own API hosted locally on my network via Msty, some models will break like this while others are completely fine. But again, other models do work fine. I just wonder what is different between the working character cards and non-working cards. I have looked at them as thoroughly as I can to see the differences in the configuration but I honestly can't see anything problematic that would cause no response at all.

Any ideas what the issue could be? Thank you.
I don't think it's a problem with ChatterUI itself, but I am not sure where else to get support for something like this so I'm asking here, I hope that is okay.

Is it just an issue with Msty? Should I use something else? Thank you.

You must be logged in to vote

Replies: 1 comment 1 reply

Comment options

Any ideas what the issue could be? Thank you.

It's hard to say, what are you using to connect to msty? If its Text Completions, you may need to configure the Formatting depending on the model.

You must be logged in to vote
1 reply
Comment options

Thanks for the reply. Yes, this is exactly how I have it set up.

Screenshot_20250302_023020_ChatterUI

And weirdly enough, enabling "wrap in newline" in the formatting seems to have fixed the output issue. I can't quite wrap my head around why a character card could affect this, but I will look into it more. Thank you for your help and your work once again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants

AltStyle によって変換されたページ (->オリジナル) /