Skip to content

Valkey and RDMA support #134

@natoscott

Description

@natoscott

Valkey - https://valkey.io - is a community forked version of Redis from when Redis licensing became "source available". It remains under the original BSD license and is backed by the major cloud vendors and Linux Foundation. Redis has since changed its license again, most recently adding the (cloud vendor unfriendly) AGPLv3 as its only open source option.

From a llm-d-kv-cache-manager POV, Valkey may be of particular interest because in the last year it gained initial support for RDMA - https://valkey.io/topics/RDMA/ - which is used already in other parts of llm-d for improving latency.

It'd be great to have valkey either as another option alongside redis in kv-cache-manager, or as a global replacement.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions