AI Character Reaching Character Limit in Responses
closed
Ruby Maelstrom
Recently the method for sending out text responses has changed on the bots. Previously, the bots would send multiple shorter messages in response to a prompt, but now the behavior is to send out one longer message instead. This is generally preferable.
However, this has caused a new issue where the text generated runs up against some sort of maximum length and the end of the message is cut off. From the testing that I've done, this limit is around 1000 characters. I'm not sure that is a limit of the LLM itself or because of the character limit of IMs in SL.
Additionally, the bot is now more likely to become unresponsive given a prompt that would require a longer response. I'm guessing that it's generating some sort of error that we can't see, but it never gives a reply and also no longer responds to any further prompts by that particular user until it is restarted manually.
One possible solution to this that retains the new behavior is to break the response up into several messages if it looks like the generated response will be greater than ~800 characters. That will retain the longer potential responses of the previous method while still preventing most multiple-message replies.
Log In
Darcy Linden
closed
This has been completed, longer messages are now cut ~500 characters in the reply.
Ginger Pudding
upvoted, mine feels like it writes an entire book. shorter would be better
Arrow SpiritWeaver
They need to turn up the maximum tokens setting to fix this issue. Also this depends on the model used; some models support more tokens than others. Models based on Llama3.1 or later are great since they support a max of 128000 tokens in all sizes from 8B upward.
ButtonGirl Resident
I saw this happening last night. I would IM the character, and would get a paragraph of information, which is fine with me. It continued to do this for awhile, sometimes not responding no a question, but then I would say after that in another IM-“did you hear me?” and then the responses would start flowing again.
My biggest problem seems to be I cannot get the character to interact with an object, like sit on the chair. I followed the directions exactly, and I get a response
none
. Lastly, I encountered a problem that I didn’t in previous sessions. After, about 10 minutes, the character loses their entire body, all you can see is the head and feet. Not sure why this is happening when it good in previous times. No problems teleporting.Daya Vyper
I have encountered the same issue and have just upvoted.