-
Notifications
You must be signed in to change notification settings - Fork 25k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Better names and types for ingest stats #93533
Conversation
Pinging @elastic/es-data-management (Team:Data Management) |
Hi @joegallo, I've created a changelog YAML for you. |
|
||
static final String TYPE = "on_failure"; | ||
|
||
public OnFailureProcessor(boolean ignoreFailure, Processor processor, List<Processor> onFailureProcessors) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think we have any test coverage (in OnFailureProcessorTests or IngestStatsNamesAndTypesIT) for when onFailureProcessors
is not empty, do we? Might also be worth documenting that that is non-empty if there is an on_failure
block, and empty if ignore_failure
= true.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I pulled this out into its own PR, see #93573.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As discussed offline, there are countless things that this PR doesn't fix (and it's not trying to fix them), but it's definitely better than what we have right now.
Closes #80763
Follow up to #93483
Adds a specialized internal
OnFailureProcessor
wrapper that formalizeson_failure
andignore_failure
handling, and then adds unwrapping of that class when we calculate stats (similar to howConditionalProcessor
is already unwrapped). The result is greatly improved clarity and consistency for the names and types that we report for ingest stats.