- Run
pnpm i
and start withpnpm run start
- Get a model.
Some that work well are Luna AI Llama2 Uncensored or OpenHermes Mistral - Run LM Studio Local Inference Server.
Make sure the model has correct settings and prompt formatting preset.
You should also increase the number of cpu threads. (default is 4, 10-14 works fine)