Skip to content

Update KV Cache to use num_kv_heads instead of num_heads (#1961) #2549

Update KV Cache to use num_kv_heads instead of num_heads (#1961)

Update KV Cache to use num_kv_heads instead of num_heads (#1961) #2549