Skip to content

Update KV Cache to use num_kv_heads instead of num_heads #5050

Update KV Cache to use num_kv_heads instead of num_heads

Update KV Cache to use num_kv_heads instead of num_heads #5050

Annotations

1 warning

lint (3.10)

succeeded Nov 9, 2024 in 32s