-
Notifications
You must be signed in to change notification settings - Fork 46
Open
Labels
Description
Valkey - https://valkey.io - is a community forked version of Redis from when Redis licensing became "source available". It remains under the original BSD license and is backed by the major cloud vendors and Linux Foundation. Redis has since changed its license again, most recently adding the (cloud vendor unfriendly) AGPLv3 as its only open source option.
From a llm-d-kv-cache-manager POV, Valkey may be of particular interest because in the last year it gained initial support for RDMA - https://valkey.io/topics/RDMA/ - which is used already in other parts of llm-d for improving latency.
It'd be great to have valkey either as another option alongside redis in kv-cache-manager, or as a global replacement.