-
-
Notifications
You must be signed in to change notification settings - Fork 222
Context Shift #444
-
So what is this new feature, is it related to sliding window? Wasn't the app already able to continue even if you exceed the context by dropping older tokens (which aren't part of the system prompt). Is this supposed to improve performance? I did a very quick Google search but didn't find something.
Beta Was this translation helpful? Give feedback.
All reactions
Its just a feature to disable context shifting since some models like gemini use SWA which needs shifting disabled.
Replies: 1 comment 2 replies
-
Its just a feature to disable context shifting since some models like gemini use SWA which needs shifting disabled.
Beta Was this translation helpful? Give feedback.
All reactions
-
Its just a feature to disable context shifting since some models like gemini use SWA which needs shifting disabled.
Oh so enabling it is the same behavior we had before? Because it's disabled for me since I updated.
Beta Was this translation helpful? Give feedback.
All reactions
-
Yep pretty much!
Beta Was this translation helpful? Give feedback.
All reactions
-
👍 1