GitHub - kakao-steve-ai/quant_triton

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
extension		extension
.gitignore		.gitignore
README.md		README.md
dequant.py		dequant.py
kernels.py		kernels.py
setup.py		setup.py
splitk_dequant_gemm.py		splitk_dequant_gemm.py
triton_vs_marlin.py		triton_vs_marlin.py

Repository files navigation

코드는 AutoGPTQ, vLLM 에서 가져왔습니다.

new triton 코드 https://github.com/foundation-model-stack/foundation-model-stack/blob/triton/triton/kernels/gptq/small_benchmark_cuda_graphs.py
triton 코드 https://github.com/AutoGPTQ/AutoGPTQ/blob/main/auto_gptq/nn_modules/triton_utils/dequant.py
marlin 코드 https://github.com/AutoGPTQ/AutoGPTQ/blob/main/autogptq_extension/marlin/marlin_cuda_kernel.cu
new_marlin 코드 vllm-project/vllm#6612

About

No description, website, or topics provided.

Report repository

Releases

No releases published

Packages

No packages published

Languages