Skip to content

Update KV Cache to use num_kv_heads instead of num_heads#1961

Merged
SalmanMohammadi merged 6 commits intopytorch:mainfrom mirceamironenco:kv-cacheNov 10, 2024
+28-43

Commits

Commits on Nov 9, 2024