-
Notifications
You must be signed in to change notification settings - Fork 4.1k
Configure context compression per session #4132
Copy link
Copy link
Open
Labels
core[Component] This issue is related to the core interface and implementation[Component] This issue is related to the core interface and implementationneeds review[Status] The PR/issue is awaiting review from the maintainer[Status] The PR/issue is awaiting review from the maintainer
Description
Activity
Metadata
Metadata
Assignees
Labels
core[Component] This issue is related to the core interface and implementation[Component] This issue is related to the core interface and implementationneeds review[Status] The PR/issue is awaiting review from the maintainer[Status] The PR/issue is awaiting review from the maintainer
Is your feature request related to a problem? Please describe.
Currently, context compression is defined on an
Applevel. So every session on that app will share the same compression config (including on/off).I want to control whether compression is turned on/off on a per session bases, based on the user/other metadata.
Describe the solution you'd like
Maybe have a lifecycle callback on the
Applayer to configure these options. Somethingbefore_session_start.Describe alternatives you've considered
Create my own compaction events, using
after_agentcallback.Additional context
I am deploying using Vertex AI AgentEngine, so want to be aligned with the possibilities there.