Skip to content

llamafile v0.9.0

Latest
Compare
Choose a tag to compare
@jart jart released this 06 Jan 00:05
ef7321e

We've solved all the known issues with the new llamafiler server, and
improved its web gui. In addition to the llamafiler binary below, the
new server is available as llamafile --server --v2. Its manual can be
accessed via llamafile --server --v2 --help.

  • e64c7e2 Include llamafiler in llamafile binary
  • a8fd4d2 Improve management of multiple slots
  • 4158265 Show progress bar for prompt processing in web ui
  • 38677b5 Support relocating matching suffixes in KV cache
  • 956e62c Visually indicate messages truncated by context
  • 08e7a21 Forget old messages when running out of context
  • 59a5d97 8fa1702 Make pledge() security not break things
  • 1fc35e2 Add upload button and support text files
  • 43bc1eb fe514ef Improve buttons in web ui

This change upgrades our cosmocc toolchain, whose recent release has
fixed all known issues and made performance improvements to memory
allocation. See the cosmopolitan releases page.

  • c293359 Upgrade to Cosmopolitan v4.0.2

The following improvements have been made to the terminal --chat bot.

  • f51e535 Fix emoji editing in chatbot

Additional changes: