Awesome-LLM-Inference v0.5

DefTruth released this 23 Mar 06:08

· 195 commits to main since this release

What's Changed

correct affiliation error by @liyucheng09 in #3
fix typo by @lkm2835 in #6
add context compression & new papers KV compression by @liyucheng09 in #7

New Contributors

@liyucheng09 made their first contribution in #3
@lkm2835 made their first contribution in #6

Full Changelog: v0.4...v0.5

Contributors

liyucheng09 and lkm2835

Assets 2