New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Since llama3 uses other token delimeters than llama2, a switch should be added so that both chat and generate can be tuned to work with both models. #6

Open

jameswdelancey opened this issue May 5, 2024 · 0 comments

Owner

jameswdelancey commented May 5, 2024

Currently chat is tuned to work with instruct and generate is tuned to work with base. Using instruct with the generate mode is hit and miss.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment