You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[FEATURE] Gate server-side compaction through model metadata capabilities #5466
Whether a model can compact server-side, and whether its thinking is bound to history, should come from model metadata rather than a hardcoded list in AnthropicModel.
SDK Language
Both / Not language-specific
Problem Statement
#5401 gates native compaction on a private list of model IDs and a temporary AnthropicModelConfig.serverCompaction override. That has to be kept by hand, is specific to Anthropic, and doesn't let other providers declare the capability.
Replace the temporary config key with the metadata config key, for example metadata: { capabilities: { serverCompaction: true } }. Keep the old key as a deprecated alias for one release.
BedrockModel declares serverCompaction: false.
Done when:
No compaction code reads the private ID list or the temporary key.
Unit tests cover declared, overridden, and unknown capability values.
Use Case
A gateway user sets serverCompaction: false through model metadata, the same way they override any other capability.
Activity