Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add --no-fail-fast to keep executing tests even if there are error #3354

Open
jcamiel opened this issue Oct 29, 2024 · 3 comments
Open

Add --no-fail-fast to keep executing tests even if there are error #3354

jcamiel opened this issue Oct 29, 2024 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@jcamiel
Copy link
Collaborator

jcamiel commented Oct 29, 2024

When a Hurl file is in error, we stop the tests run as soon as we can (the default is "fail fast")

For instance:

$ hurl --jobs 1 --test a.hurl b.hurl c.hurl d.hurl

Given b.hurl is in error, executed tests will only be a.hurl and b.hurl.

We have an option called --continue-on-error that, if one Hurl file is in error, will try to execute this file until the end.

As the doc tells:

Note that this option does not affect the behavior with multiple input Hurl files.

All the input files are executed independently. The result of one file does not affect the execution of the other Hurl files.

So we need another option to run all Hurl files, regardless of there are error or not => --no-fail-fast.

@jcamiel jcamiel added the enhancement New feature or request label Oct 29, 2024
@krakenbite
Copy link

Hi,

I would like to work on this issue. Can I take this on?

@jcamiel
Copy link
Collaborator Author

jcamiel commented Nov 10, 2024

Hi @krakenbite

You can of course but be warned that this one can be more difficult that it seems.

For a starter, you can also work on issues labeled "good first issues" good first issue Good for newcomers

@jcamiel jcamiel self-assigned this Nov 13, 2024
@krakenbite
Copy link

@jcamiel Thanks for your response!

I already had a look at the code and I think I already found the right places which need modification.

As we currently bail-out on errors, question is how we want to handle errors in the future. How do we want to display them to the user if one or several files have issues?

Also, I think I can have a look at this issue as I like to challenge myself with difficult problems and don't need an issue labeled good first issue Good for newcomers .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants