Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: Raise step error on n task error count #57

Open
evamaxfield opened this issue May 27, 2020 · 0 comments
Open

Feature: Raise step error on n task error count #57

evamaxfield opened this issue May 27, 2020 · 0 comments
Labels
enhancement New feature or request

Comments

@evamaxfield
Copy link
Contributor

Use Case

Please provide a use case to help us understand your request in context
Related to #55, with the introduction of the errors.json file, the underlying reason for that issue and this one is that in the case where 10000 tasks are being run in a single task and only few error, we don't want to error the entire downstream pipeline. This would allow us to set some integer limit on raising an overall step error on the tail end of run.

Solution

Please describe your ideal solution
Add a post run check to the log_run_params wrapper function that compares the length of the errors.json file if present to the integer value set.

Alternatives

Please describe any alternatives you've considered, even if you've dismissed them

@evamaxfield evamaxfield added the enhancement New feature or request label May 27, 2020
@evamaxfield evamaxfield self-assigned this May 27, 2020
@evamaxfield evamaxfield removed their assignment Dec 12, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant