Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Test Cases for Metric Rollup Addition of [RemoteService, RemoteTarget, ...] #41

Merged
merged 9 commits into from
May 7, 2024

Conversation

jj22ee
Copy link
Contributor

@jj22ee jj22ee commented Apr 16, 2024

Issue #, if available:
aws/amazon-cloudwatch-agent#1010
Recently the following metric rollups were added to 2 AppSignal Configuration files. Tests need to be added for them

  • [RemoteService, RemoteTarget]
  • [HostedIn.<Attributes>, Service, RemoteService, RemoteTarget]

Description of changes:

Add tests for new metric rollups

  • Update Java+Python EKS/EC2 e2e tests workflows
    • Provide testingId=${{ env.TESTING_ID }} to the sample app via request-body to generate new metrics and pass new Metric Validations
    • Provide --remote-target-name ::s3:::e2e-test-bucket-name-${{ env.TESTING_ID }} to validator so it can query new metrics
  • Update Validator and validations for both Java and Python
    • Metric validation test cases now checks for a new S3 RemoteTarget value that includes testingId
      • (::s3:::e2e-test-bucket-name-{{testingId}})
    • Add new test cases for the new metric rollups
    • Query metrics that have RemoteTarget=<s3_bucket_name_input>

Testing done:
15 minute canaries running successfully for 12+ hours:
EC2 Java in IAD: https://github.com/jj22ee/aws-application-signals-test-framework/actions/workflows/test-ec2-java.yml
EKS Java in IAD: https://github.com/jj22ee/aws-application-signals-test-framework/actions/workflows/test-eks-java.yml
EC2 Python in IAD: https://github.com/jj22ee/aws-application-signals-test-framework/actions/workflows/test-ec2-python.yml
EKS Python in IAD: https://github.com/jj22ee/aws-application-signals-test-framework/actions/workflows/test-eks-python.yml

  • uses same workflows in this PR, but updated to use personal aws account info

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@jj22ee
Copy link
Contributor Author

jj22ee commented Apr 16, 2024

***Must be merged at the same time as: aws-observability/aws-otel-python-instrumentation#164
This PR is now standalone

@jj22ee jj22ee force-pushed the metric-rollup-tests branch from debb2a2 to c1019cf Compare April 27, 2024 01:00
@jj22ee jj22ee force-pushed the metric-rollup-tests branch from c1019cf to 12f4634 Compare April 27, 2024 01:40
Copy link
Contributor

@majanjua-amzn majanjua-amzn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good work, just some cleanup and potential improvements.

Copy link
Contributor

@majanjua-amzn majanjua-amzn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, please ensure that the sample app images in the E2E testing accounts contain the changes necessary to support this change

@jj22ee jj22ee merged commit 1690fde into aws-observability:main May 7, 2024
zzhlogin pushed a commit to zzhlogin/aws-application-signals-test-framework that referenced this pull request Jun 6, 2024
Add Test Cases for Metric Rollup Addition of [RemoteService, RemoteTarget, ...]
zzhlogin pushed a commit to zzhlogin/aws-application-signals-test-framework that referenced this pull request Jun 6, 2024
Add Test Cases for Metric Rollup Addition of [RemoteService, RemoteTarget, ...]
zzhlogin pushed a commit to zzhlogin/aws-application-signals-test-framework that referenced this pull request Jun 6, 2024
Add Test Cases for Metric Rollup Addition of [RemoteService, RemoteTarget, ...]
zzhlogin pushed a commit to zzhlogin/aws-application-signals-test-framework that referenced this pull request Jun 6, 2024
Add Test Cases for Metric Rollup Addition of [RemoteService, RemoteTarget, ...]
georgeboc pushed a commit to georgeboc/aws-application-signals-test-framework that referenced this pull request Jul 8, 2024
In this commmit we are removing support for Python 3.7, to align with
upstream:
open-telemetry/opentelemetry-python-contrib#2152


By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants