Skip to content

If quant_inference=True and device != DEVICE.CPU, use torch.float16 (… #236

If quant_inference=True and device != DEVICE.CPU, use torch.float16 (…

If quant_inference=True and device != DEVICE.CPU, use torch.float16 (… #236

ruff-check (3.11, ubuntu-22.04)

succeeded Dec 21, 2024 in 6s