Skip to content

Allow GPTQModel to auto select Marlin or faster kernels for inference… #908

Allow GPTQModel to auto select Marlin or faster kernels for inference…

Allow GPTQModel to auto select Marlin or faster kernels for inference… #908

build (ubuntu-20.04, 3.9)

succeeded Jan 8, 2025 in 1m 33s