Skip to content

Update KV Cache to use num_kv_heads instead of num_heads (#1961) #2549

Update KV Cache to use num_kv_heads instead of num_heads (#1961)

Update KV Cache to use num_kv_heads instead of num_heads (#1961) #2549

Annotations

1 warning

gpu_test (3.10, stable)

succeeded Nov 10, 2024 in 32m 11s