Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NVIDIA] Update XLA-fp8 docs for ninja user guide #478

Merged
merged 6 commits into from
Jun 3, 2024

Conversation

kaixih
Copy link
Contributor

@kaixih kaixih commented Jan 17, 2024

This PR adds two subsections on how to use the FP8 gemm and FP8 params directly.

cc @mingxu1067

rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
@yhtang
Copy link
Collaborator

yhtang commented Jan 22, 2024

@nouiz Could you please submit your review as request for change so as to ensure the merge is blocked until all comments are resolved?

@kaixih
Copy link
Contributor Author

kaixih commented May 30, 2024

Sorry for the late response. Just made a couple of changes and PTAL and then we can forward to more people who are interested in the pipeline parallelism + fp8. @yhtang @nouiz

rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Show resolved Hide resolved
rosetta/docs/NATIVE_FP8.md Outdated Show resolved Hide resolved
@kaixih kaixih merged commit 967ebc0 into NVIDIA:main Jun 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants