Skip to content

Allow GPTQModel to auto select Marlin or faster kernels for inference… #908

Allow GPTQModel to auto select Marlin or faster kernels for inference…

Allow GPTQModel to auto select Marlin or faster kernels for inference… #908

build (macos-13, 3.9)

succeeded Jan 8, 2025 in 3m 7s