Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cache CI/CD prerequisites #354

Open
hidmic opened this issue May 9, 2024 · 3 comments
Open

Cache CI/CD prerequisites #354

hidmic opened this issue May 9, 2024 · 3 comments
Labels
backlog Low priority work infra Related to infrastructure and CI needs-work Ready to be worked on

Comments

@hidmic
Copy link
Collaborator

hidmic commented May 9, 2024

Feature description

Our CI/CD workflows install the same dependencies on every run, which means longer runtimes and heat somewhere around the world. We should leverage regular containers and GHA caching to reuse them.

Implementation considerations

Containers make sense for environment and tooling dependencies as those almost never change and we can rebuild on demand. For package dependencies that may change on every PR, package manager caching would work best.

@hidmic hidmic added infra Related to infrastructure and CI needs-work Ready to be worked on backlog Low priority work labels May 9, 2024
@hidmic hidmic mentioned this issue May 9, 2024
7 tasks
@hidmic
Copy link
Collaborator Author

hidmic commented May 9, 2024

FYI @nahueespinosa. Also @JADC362. We could use a containerization expert.

@nahueespinosa
Copy link
Member

FWIW, we have a docker build pipeline: https://github.com/Ekumen-OS/beluga/blob/main/.github/workflows/docker_ci_pipeline.yml

It might just be a matter of re-using those images in regular CI.

@nahueespinosa
Copy link
Member

which means longer runtimes and heat somewhere around the world

For reference, the install step takes 2 to 3 minutes on CI.

It seems like we can push our images to GitHub Packages for free. Should we use that or do we have another docker registry to push these things?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backlog Low priority work infra Related to infrastructure and CI needs-work Ready to be worked on
Projects
None yet
Development

No branches or pull requests

2 participants