Skip to content

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #4491

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #4491

Annotations

1 error

build (3.9, macos-13)

failed Jan 7, 2025 in 2m 55s