Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run with test results that contain flaky tests. #541

Closed
wants to merge 3 commits into from

Conversation

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Test File)

97 tests  ±0   80 ✔️ ±0   3m 25s ⏱️ ±0s
  1 suites ±0   17 💤 ±0 
  1 files   ±0     0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (macOS python 3.8)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Dockerfile)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Test Files)

   147 files  +2       13 errors  737 suites  +2   2h 12m 37s ⏱️ ±0s
1 815 tests +4  1 519 ✔️ +2    73 💤 ±0  211 +1  12 🔥 +1 
4 121 runs  +4  3 428 ✔️ ±0  214 💤 ±0  456 +2  23 🔥 +2 

For more details on these parsing errors, failures and errors, see this check.

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Docker Image amd64)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (macOS python installed)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (macOS 11 python installed)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Linux python 3.8)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Linux python installed)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Linux 20.04 python installed)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Windows python installed)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Docker Image arm64)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (Windows 2019 python installed)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Dec 15, 2023

Test Results (reference)

     135 files  ±0       135 suites  ±0   43m 28s ⏱️ -3s
     432 tests ±0       432 ✔️ ±0         0 💤 ±0  0 ±0 
58 320 runs  ±0  56 976 ✔️ ±0  1 344 💤 ±0  0 ±0 

Results for commit 907a02f. ± Comparison against base commit f0b959b.

♻️ This comment has been updated with latest results.

@LorenzoBettini
Copy link

Do you plan to merge this soon?

@EnricoMi
Copy link
Owner Author

Do you plan to merge this soon?

This was just an attempt to trigger the action on the example test result file and see how it handles it. Details in #539.

Supporting the flaky annotations is not yet been attempted.

@EnricoMi EnricoMi closed this Aug 18, 2024
@EnricoMi EnricoMi changed the title Support flaky tests Test test results with flaky tests. Aug 18, 2024
@EnricoMi EnricoMi changed the title Test test results with flaky tests. Run with test results that contain flaky tests. Aug 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support Maven Surefire Plugin rerunning flaky tests
2 participants