Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

eos token setting #1

Open
Mineru98 opened this issue Oct 31, 2023 · 1 comment
Open

eos token setting #1

Mineru98 opened this issue Oct 31, 2023 · 1 comment

Comments

@Mineru98
Copy link

gguf 모델로 text generation web ui 통해서 테스트 해보려는데요.
혹시 eos 토큰 설정이 제대로 동작하는지 궁금합니다... eos가 제대로 안먹는것 같아요

@jwj7140
Copy link
Owner

jwj7140 commented Oct 31, 2023

gugugo 모델은 "</끝>"을 eos 대신 사용합니다. text generation webui의 경우 stopping_strings 옵션으로 해결하실 수 있을 것 같습니다.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants