Skip to content
Back to pull request #1961

Update KV Cache to use num_kv_heads instead of num_heads #2547

Sign in to view logs

Update KV Cache to use num_kv_heads instead of num_heads

Update KV Cache to use num_kv_heads instead of num_heads #2547

Annotations

1 warning

gpu_test (3.10, stable)

gpu_test (3.10, stable)
succeeded Nov 9, 2024 in 29m 21s