Skip to content

Commit

Permalink
Flash ttn
Browse files Browse the repository at this point in the history
  • Loading branch information
mint committed Oct 27, 2023
1 parent e5a3131 commit a6bacc4
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,13 @@ https://github.com/Ph0rk0z/GPTQ-Merged (dual module branch)

~~https://github.com/sterlind/peft~~ (now auto patches)

10/27/23
```
If loading fails due to flash attention and your system doesn't support it:
please pip uninstall flash-attn and flash_attn.
```


10/16/23
```
Update exllamav2 to use the new 8bit cache. So far no issues.
Expand Down

0 comments on commit a6bacc4

Please sign in to comment.