Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bigmodel pipeline update cp38 to cp310 #22793

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

bigmodel pipeline update cp38 to cp310 #22793

wants to merge 12 commits into from
+89 −11

Conversation

kailums
Copy link
Contributor

@kailums kailums commented Nov 11, 2024

Description

when updating from cp38 to cp310, there has some issues for bigmodel pipeine. there are two jobs failed: stable_diffusion and whisper.

  1. for stable_diffusion, we are now using "nvcr.io/nvidia/pytorch:22.11-py3" from nvidia repo. it is for cuda11 and python3.8. and they are not providing python3.10 version for cuda 11. the latest version of this docker image is for cuda12 and python3.10. To solve this problem, i use a docker image of ubuntu22.04, and then install all need python package for this job.
  2. for whisper. the original docker image is ubuntu20.04 which doesn't have python3.10, and has to update to ubuntu22.04.

Motivation and Context

@kailums kailums requested a review from a team as a code owner November 11, 2024 02:15
@snnn
Copy link
Member

snnn commented Nov 11, 2024

@mszhanyi , please help review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@tianleiwu tianleiwu tianleiwu left review comments

@snnn snnn snnn left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@kailums @snnn @tianleiwu