Skip to content

Commit 0b018d8

Browse files
authored
[ROCm][Bugfix] Add missing parameter to ROCm backend (#26029)
Signed-off-by: Gregory Shtrasberg <[email protected]>
1 parent c312468 commit 0b018d8

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/v1/attention/backends/rocm_attn.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -175,6 +175,7 @@ def get_kv_cache_shape(
175175
block_size: int,
176176
num_kv_heads: int,
177177
head_size: int,
178+
cache_dtype_str: str = "auto",
178179
) -> tuple[int, ...]:
179180
if block_size % 16 != 0:
180181
raise ValueError("Block size must be a multiple of 16.")

0 commit comments

Comments
 (0)