Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Logs UI] Display a warning on the categories tab based on ML job stats #60385

Closed
mukeshelastic opened this issue Mar 17, 2020 · 1 comment · Fixed by #60551
Closed

[Logs UI] Display a warning on the categories tab based on ML job stats #60385

mukeshelastic opened this issue Mar 17, 2020 · 1 comment · Fixed by #60551
Assignees
@weltenwort
Labels
Feature:Logs UI Logs UI feature Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services v7.7.0

Comments

@mukeshelastic
Copy link

Describe the feature:
We decided to break this issue into sub-issues for easier implementation

Here,

  • we will check the categorization_status stat field as available in ML from PR

  • If the status is warn, Display a warning that summarizes the results. The warning will look similar to what was described here but the text will be a specific reason behind the warning. Below is a list of possible reasons for warn status

Categorization is detecting a distribution of categories
that suggests the input data is inappropriate for categorization.
Problems could be that there is only one category, more than 90% of
categories are rare, the number of categories is greater than 50% of
the number of categorized documents, there are no frequently
matched categories, or more than 50% of categories are dead
@mukeshelastic mukeshelastic added the Feature:Logs UI Logs UI feature label Mar 17, 2020
@weltenwort weltenwort added Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services v7.7.0 labels Mar 18, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/logs-metrics-ui (Team:logs-metrics-ui)

@weltenwort weltenwort self-assigned this Mar 18, 2020
@weltenwort weltenwort changed the title If the categorization_status is warn then display a warning in Logs UI [Logs UI] Display a warning on the categories tab based on ML job stats Mar 18, 2020
@weltenwort weltenwort mentioned this issue Mar 18, 2020
Merged
weltenwort added a commit that referenced this issue Mar 27, 2020
@weltenwort
[Logs UI] Add category data quality warning based on ML job st… (#60551)
878ab20 
This adds warnings to the categories tab when the stats of the underlying ML job indicate a potential problem with the data quality.

closes #60385
weltenwort added a commit to weltenwort/kibana that referenced this issue Mar 27, 2020
@weltenwort
[Logs UI] Add category data quality warning based on ML job st… (elas…
8cd2f2f 
…tic#60551)

This adds warnings to the categories tab when the stats of the underlying ML job indicate a potential problem with the data quality.

closes elastic#60385
@mukeshelastic mukeshelastic mentioned this issue Mar 29, 2020
Closed
weltenwort added a commit that referenced this issue Mar 30, 2020
@weltenwort @elasticmachine
[Logs UI] Add category data quality warning based on ML job st… (#60551…
d27eeed 
…) (#61687)

This adds warnings to the categories tab when the stats of the underlying ML job indicate a potential problem with the data quality.

closes #60385

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
@zube zube bot removed the [zube]: Done label Oct 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@weltenwort weltenwort

Labels
Feature:Logs UI Logs UI feature Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services v7.7.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Logs UI] Add category data quality warning based on ML job stats weltenwort/kibana
3 participants
@weltenwort @elasticmachine @mukeshelastic