Skip to content

Update KV Cache to use num_kv_heads instead of num_heads #5942

Update KV Cache to use num_kv_heads instead of num_heads

Update KV Cache to use num_kv_heads instead of num_heads #5942