Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add prometheus and counter for testing #1092

Merged
merged 1 commit into from
Jan 13, 2025

Conversation

jmhodges
Copy link
Contributor

Our statsd integration with prometheus has been turning counters that
should be 1 into 0. It's unclear why this is happening and this patch is
an attempt to debug the issue further.

The foobar_test counter added here is to help determine why. It's
incremented once on boot in both the prometheus and in statsd. We'll
determine if the problem is in prometheus, grafana, telegraf, or in our
statsd client (unlikely this last one) by emitting in both and seeing
how they're captured.

The rest of the org is standardizing on prometheus for metrics up and
down the stack, so we should do the same, anyway. We don't commit to
migrating all of the existing metrics here, but make it plausible to do
so.

This adds the port 2112 to Dockerfile for autograph as the place where
the prometheus metrics are served from.

Follow up patches in our infra-as-code will add the fetching of
prometheus metrics.

Updates AUT-393
Updates AUT-199

Base automatically changed from upgrade-datadog-explicitly-v5-gnight to main January 13, 2025 18:51
@jmhodges jmhodges force-pushed the aut-393-prom-statsd-counter-debug branch 2 times, most recently from 22f33bc to bfe30b9 Compare January 13, 2025 18:56
@jmhodges jmhodges marked this pull request as ready for review January 13, 2025 19:12
@jmhodges jmhodges requested review from a team as code owners January 13, 2025 19:12
@jmhodges jmhodges requested review from say-yawn and removed request for a team January 13, 2025 19:12
@jmhodges jmhodges force-pushed the aut-393-prom-statsd-counter-debug branch from bfe30b9 to ec3267e Compare January 13, 2025 22:07
@jmhodges jmhodges force-pushed the aut-393-prom-statsd-counter-debug branch from ec3267e to 5f86805 Compare January 13, 2025 22:22
Our statsd integration with prometheus has been turning counters that
should be 1 into 0. It's unclear why this is happening and this patch is
an attempt to debug the issue further.

The foobar_test counter added here is to help determine why. It's
incremented once on boot in both the prometheus and in statsd. We'll
determine if the problem is in prometheus, grafana, telegraf, or in our
statsd client (unlikely this last one) by emitting in both and seeing
how they're captured.

The rest of the org is standardizing on prometheus for metrics up and
down the stack, so we should do the same, anyway. We don't commit to
migrating all of the existing metrics here, but make it plausible to do
so.

This adds the port 2112 to Dockerfile for autograph as the place where
the prometheus metrics are served from.

Follow up patches in our infra-as-code will add the fetching of
prometheus metrics.

Updates AUT-393
Updates AUT-199
@jmhodges jmhodges force-pushed the aut-393-prom-statsd-counter-debug branch from 5f86805 to d61a8cb Compare January 13, 2025 22:22
@jmhodges jmhodges merged commit 6387728 into main Jan 13, 2025
14 checks passed
@jmhodges jmhodges deleted the aut-393-prom-statsd-counter-debug branch January 13, 2025 22:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants