Skip to content

Update KV Cache to use num_kv_heads instead of num_heads #5786

Update KV Cache to use num_kv_heads instead of num_heads

Update KV Cache to use num_kv_heads instead of num_heads #5786