refactor(attn): let the bucketer define the batched decode kernel's buckets - #792
Closed
jvlunteren wants to merge 2 commits into
Closed
refactor(attn): let the bucketer define the batched decode kernel's buckets#792jvlunteren wants to merge 2 commits into
jvlunteren wants to merge 2 commits into
