Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Flaky tests when run in GitHub Actions Workflow #724

Open
1 task done
spydon opened this issue Jun 6, 2024 · 2 comments
Open
1 task done

fix: Flaky tests when run in GitHub Actions Workflow #724

spydon opened this issue Jun 6, 2024 · 2 comments
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@spydon
Copy link
Collaborator

spydon commented Jun 6, 2024

Is there an existing issue for this?

  • I have searched the existing issues.

Version

main

Description

We currently have some flaky tests (they pass sometimes, and sometimes not) especially on MacOS, but also Linux.
For some reason the windows tests seem to always pass.

Steps to reproduce

Run the test suite as a GitHub Actions Workflow:
https://github.com/invertase/melos/actions/runs/9396915772/attempts/2

Expected behavior

The test suite should pass.

Screenshots

No response

Additional context and comments

No response

@spydon spydon added bug Something isn't working help wanted Extra attention is needed labels Jun 6, 2024
@spydon
Copy link
Collaborator Author

spydon commented Jun 6, 2024

The windows tests fail too, they just report as green...
https://github.com/invertase/melos/actions/runs/9396915772/job/25884262129#step:5:432

spydon pushed a commit that referenced this issue Jun 26, 2024
## Description

Hey everyone! I initially attempted to resolve this issue by following
the approach mentioned in [this
issue](dart-lang/pub#3998) by setting the
environment variable `PUB_SUMMARY_ONLY=1` in the workflow. However, this
did not work as expected.

Then, I decided to solve it by updating the `ignoringDependencyMessages`
method in the matcher file, and this approach seems to be working fine.

**Changes:**

- Remove unnecessary TODO comment in the workflow file
- Update test command in workflow to remove unnecessary `|| true`
- Update dependency messages matcher in `matchers.dart` test file

Issue: #724

## Type of Change

- [ ] ✨ `feat` -- New feature (non-breaking change which adds
functionality)
- [x] 🛠️ `fix` -- Bug fix (non-breaking change which fixes an issue)
- [ ] ❌ `!` -- Breaking change (fix or feature that would cause existing
functionality to change)
- [ ] 🧹 `refactor` -- Code refactor
- [x] ✅ `ci` -- Build configuration change
- [ ] 📝 `docs` -- Documentation
- [ ] 🗑️ `chore` -- Chore
@spydon
Copy link
Collaborator Author

spydon commented Sep 6, 2024

The macOS tests are failing pretty much every run now too:
https://github.com/invertase/melos/actions/runs/10684306363/job/29614413657?pr=753

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant