Skip to content

[Feature Request] "Wrap in Quotes" for local models. #218

@xzuyn

Description

@xzuyn

Is your feature request related to a problem? Please describe.
lllama
Not exactly a problem, but depending on the model, it naturally likes speech to be in quotes, and the default characters already use quotes. So replying without quotes is not optimal for consistency in my opinion, and I feel it will cause the story to spiral into nonsense easier since it may see your messages as non-messages.

Describe the solution you'd like
quotes
Similar to the OpenAI "Wrap in Quotes" toggle for automatically adding quotes, I would like this feature to be an option for local use too. I'm unsure how it handles * actions, but I assume a good way to handle it is to encase the entire message in quotes, and break the quotes on the *.

For users who only send message replies, without * actions, this should work well, and be fairly easy to implement.

For the users who use multiple dialog blocks and/or * actions, and/or 3rd person narration all at once, I am unsure of the best way to handle it. Any implementation would be better than none, and the kinks could be ironed out later as this would be an optional toggle which should probably be off by default so it wouldn't be an issue for users who don't enable it.

Describe alternatives you've considered
Only alternative I see is manually typing them. Which I can do, but it would be much nicer to have it happen automatically if a toggle is enabled.

Additional context
Models like GPT4-x-Alpaca apparently work better when your messages are in quotes, and although you are using more tokens using those quotes, I still think it should be optional for users. Especially since its already an option for OpenAI, and when replying to the AI without quotes it will respond with quotes if that's how its been set up. So I would like to keep that styling for best results.

Metadata

Metadata

Assignees

No one assigned

    Labels

    ✨ Feature Changes[PR] Changing or tweaking an existing feature in its functionality👍 Approved[ISSUE] This issue has been marked by maintainers for contributors as approval to implement🚧 Alternative Exists[ISSUE] There is an alternative way in ST that works similarly or good enough

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions