From a6bacc47248929622068a572d0d60bdd5191c5e0 Mon Sep 17 00:00:00 2001 From: mint Date: Fri, 27 Oct 2023 06:43:24 -0500 Subject: [PATCH] Flash ttn --- README.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/README.md b/README.md index cdb2a2c11c..a0080f5aaf 100644 --- a/README.md +++ b/README.md @@ -21,6 +21,13 @@ https://github.com/Ph0rk0z/GPTQ-Merged (dual module branch) ~~https://github.com/sterlind/peft~~ (now auto patches) +10/27/23 +``` +If loading fails due to flash attention and your system doesn't support it: +please pip uninstall flash-attn and flash_attn. +``` + + 10/16/23 ``` Update exllamav2 to use the new 8bit cache. So far no issues.