New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[QA] 关于使用张量并行或流水线并行的模型切分与合并问题 #176

Open

BaiBlanc opened this issue Apr 2, 2024 · 0 comments

Assignees

Labels

question

BaiBlanc commented Apr 2, 2024

描述问题

请问基于一个书生格式的ckpt希望做张量并行或流水线并行，需要自己切分模型以适配对应的并行度吗？
直接加载会报错，官方有提供相应的脚本吗？

BaiBlanc added the question label

mm-assistant bot assigned yhcc

gaoyang07 assigned SolenoidWGT and unassigned yhcc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment