Skip to content

Update KV Cache to use num_kv_heads instead of num_heads (#1961) #2549

Update KV Cache to use num_kv_heads instead of num_heads (#1961)

Update KV Cache to use num_kv_heads instead of num_heads (#1961) #2549

Annotations

1 warning

gpu_test (3.10, nightly)

succeeded Nov 10, 2024 in 33m 15s