TorchAC CUDA/ROCm

For now this is a fork of torchac_cuda Github

This library is needed by LMCache repositories.

Setup

python3 setup.py develop

HCC_AMDGPU_TARGET=<HIP_ARCHITECTURE> python3 setup.py develop
# e.g. MI210 MI250
HCC_AMDGPU_TARGET=gfx90a python3 setup.py develop

Name		Name	Last commit message	Last commit date
Latest commit History 9 Commits
tests		tests
.gitignore		.gitignore
MANIFEST.in		MANIFEST.in
README.md		README.md
build-bdist.sh		build-bdist.sh
build-sdist.sh		build-sdist.sh
cal_cdf.cu		cal_cdf.cu
compile_torchac_rocm.sh		compile_torchac_rocm.sh
hipify.py		hipify.py
main.cpp		main.cpp
pyproject.toml		pyproject.toml
requirements.txt		requirements.txt
setup.py		setup.py
torchac_kernel.cuh		torchac_kernel.cuh
torchac_kernel_dec_new.cu		torchac_kernel_dec_new.cu
torchac_kernel_enc_new.cu		torchac_kernel_enc_new.cu