Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve observability for non-indexed labels usage #9993

Merged
merged 6 commits into from
Jul 21, 2023

Conversation

salvacorts
Copy link
Contributor

@salvacorts salvacorts commented Jul 20, 2023

What this PR does / why we need it:
In #9700, we support encoding and decoding metadata for each entry into the chunks.
In this PR we:

  • Update the bytes processed stats to account for the bytes from those non-indexed labels
  • Add new stats for bytes processed for those non-indexed labels
  • Add new ingestion metrics to track ingested non-indexed bytes

Checklist

  • Reviewed the CONTRIBUTING.md guide (required)
  • Documentation added
  • Tests updated
  • CHANGELOG.md updated
    • If the change is worth mentioning in the release notes, add add-to-release-notes label
  • Changes that require user attention or interaction to upgrade are documented in docs/sources/upgrading/_index.md
  • For Helm chart changes bump the Helm chart version in production/helm/loki/Chart.yaml and update production/helm/loki/CHANGELOG.md and production/helm/loki/README.md. Example PR

@salvacorts salvacorts marked this pull request as ready for review July 20, 2023 09:36
@salvacorts salvacorts requested a review from a team as a code owner July 20, 2023 09:36
@pull-request-size pull-request-size bot added size/L and removed size/M labels Jul 20, 2023
@salvacorts salvacorts changed the title Add non-indexed labels to bytes processed stats Improve observability for non-indexed labels usage Jul 20, 2023
Copy link
Contributor

@vlad-diachenko vlad-diachenko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@salvacorts salvacorts merged commit 3f161f5 into main Jul 21, 2023
@salvacorts salvacorts deleted the salvacorts/fix-decompressed-bytes-stats branch July 21, 2023 09:41
LinTechSo pushed a commit to LinTechSo/loki that referenced this pull request Jul 21, 2023
**What this PR does / why we need it**:
In grafana#9700, we support encoding and
decoding metadata for each entry into the chunks.
In this PR we:
- Update the bytes processed stats to account for the bytes from those
non-indexed labels
- Add new stats for bytes processed for those non-indexed labels
- Add new ingestion metrics to track ingested non-indexed bytes

**Checklist**
- [ ] Reviewed the
[`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md)
guide (**required**)
- [ ] Documentation added
- [x] Tests updated
- [ ] `CHANGELOG.md` updated
- [ ] If the change is worth mentioning in the release notes, add
`add-to-release-notes` label
- [ ] Changes that require user attention or interaction to upgrade are
documented in `docs/sources/upgrading/_index.md`
- [ ] For Helm chart changes bump the Helm chart version in
`production/helm/loki/Chart.yaml` and update
`production/helm/loki/CHANGELOG.md` and
`production/helm/loki/README.md`. [Example
PR](grafana@d10549e)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants