- Run
pnpm iand start withpnpm run start - Get a model.
Some that work well are Luna AI Llama2 Uncensored or OpenHermes Mistral - Run LM Studio Local Inference Server.
Make sure the model has correct settings and prompt formatting preset.
You should also increase the number of cpu threads. (default is 4, 10-14 works fine)
-
Notifications
You must be signed in to change notification settings - Fork 0
Spejik/pepa-discord-ai-bot
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Discord Bot interface for inferencing model, with a premade personality.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published