Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

35b推理的prompt和7b的不一样吗，35b推理出来的答案有问题 #20

Open
xudong-jason opened this issue Dec 3, 2024 · 2 comments
Open

35b推理的prompt和7b的不一样吗，35b推理出来的答案有问题 #20

xudong-jason opened this issue Dec 3, 2024 · 2 comments

Comments

@xudong-jason
Copy link

No description provided.

@shunxing12345
Copy link
Contributor

35b具体怎么推理的呢 用的是哪个模型呢 prompt 用的是什么呢 方便贴一下吗

@xudong-jason
Copy link
Author

35b具体怎么推理的呢 用的是哪个模型呢 prompt 用的是什么呢 方便贴一下吗
目前我用的模型是11月份最新的35B，推理是基于vllm的，最初用的是下图1中注释掉的方式拼接的，是正常的；
image
后面想把7B也写进去，按照下图的方式拼接的，
image
回答正常
但是35b的回答就有问题了，回答他是openai开发的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@xudong-jason @shunxing12345