Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate "Golden Data" trace spans #967

Merged
merged 22 commits into from
May 26, 2020
Merged

Generate "Golden Data" trace spans #967

merged 22 commits into from
May 26, 2020

Conversation

kbrockhoff
Copy link
Member

@kbrockhoff kbrockhoff commented May 13, 2020

Description: This pull request has two items:

  1. PICT tool input files for trace data and resulting output files from running pict from the command line. These are in internal/goldendataset/testdata. See: Pairwise Independent Combinatorial Testing
  2. Generator for fully-populated OLTP ResourceSpans from PICT output files.

This has all the intended functionality for this PR. It has no impact on other functionality so there should be no problem in merging to master. I will follow up with other PRs to complete full "Golden Dataset" testing functionality.

Link to tracking Issue: #652

Testing: Unit tests exist for all functionality which has been coded so far

Documentation: None yet. Will do so after golden dataset generation coding is complete.

@codecov-io
Copy link

codecov-io commented May 13, 2020

Codecov Report

Merging #967 into master will increase coverage by 0.44%.
The diff coverage is 96.24%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #967      +/-   ##
==========================================
+ Coverage   85.61%   86.06%   +0.44%     
==========================================
  Files         189      193       +4     
  Lines       13167    13749     +582     
==========================================
+ Hits        11273    11833     +560     
- Misses       1441     1455      +14     
- Partials      453      461       +8     
Impacted Files Coverage Δ
internal/goldendataset/traces_generator.go 86.66% <86.66%> (ø)
internal/goldendataset/generator_commons.go 89.28% <89.28%> (ø)
internal/goldendataset/resource_generator.go 98.03% <98.03%> (ø)
internal/goldendataset/span_generator.go 98.85% <98.85%> (ø)
translator/internaldata/oc_to_resource.go 100.00% <100.00%> (ø)
translator/internaldata/resource_to_oc.go 73.52% <100.00%> (ø)
... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update daf2fc7...5019ebb. Read the comment docs.

internal/goldendataset/resource_generator.go Outdated Show resolved Hide resolved
internal/goldendataset/resource_generator.go Outdated Show resolved Hide resolved
internal/goldendataset/resource_generator.go Outdated Show resolved Hide resolved
internal/goldendataset/resource_generator.go Outdated Show resolved Hide resolved
internal/goldendataset/resource_generator_test.go Outdated Show resolved Hide resolved
internal/goldendataset/span_generator.go Outdated Show resolved Hide resolved
internal/goldendataset/span_generator.go Outdated Show resolved Hide resolved
@@ -0,0 +1,289 @@
Parent Tracestate Kind Attributes Events Links Status
Copy link
Member

@tigrannajaryan tigrannajaryan May 14, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a generated file? Can we have generated in the name and document how it is generated/can be regenerated?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changed file names to start with generated. I plan to do documentation after the entire solution is coded and I have chance to play around with the best approach for making changes and automating it all.

translator/conventions/opentelemetry.go Outdated Show resolved Hide resolved
translator/conventions/opentelemetry.go Show resolved Hide resolved
@kbrockhoff kbrockhoff changed the title Generate "Golden Data" trace spans [WIP] Generate "Golden Data" trace spans May 16, 2020
@kbrockhoff kbrockhoff requested a review from bogdandrutu May 16, 2020 16:44
Copy link
Member

@tigrannajaryan tigrannajaryan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly looks good. Please address the remaining few open comments and we can merge.

internal/goldendataset/span_generator.go Show resolved Hide resolved
internal/goldendataset/span_generator.go Outdated Show resolved Hide resolved
@tigrannajaryan tigrannajaryan self-assigned this May 20, 2020
@kbrockhoff kbrockhoff requested a review from tigrannajaryan May 20, 2020 19:56
@tigrannajaryan
Copy link
Member

@kbrockhoff please fix the conflicts.

Copy link
Member

@tigrannajaryan tigrannajaryan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, looking forward to the next PR that uses the generator.

@kbrockhoff
Copy link
Member Author

Made two changes:

  1. Switched to struct holding input values so easier to expand in the future
  2. Changed generated span name to a concatenation of input values to make it easier to identify which spans did not translate with equality

@tigrannajaryan tigrannajaryan merged commit ffd4838 into open-telemetry:master May 26, 2020
@kbrockhoff kbrockhoff deleted the golden-data-set-mgmt branch May 27, 2020 13:28
wyTrivail pushed a commit to mxiamxia/opentelemetry-collector that referenced this pull request Jul 13, 2020
1. PICT tool input files for trace data and resulting output files from running pict from the command line. These are in `internal/goldendataset/testdata`. See: [Pairwise Independent Combinatorial Testing](https://github.com/microsoft/pict)
2. Generator for fully-populated OLTP ResourceSpans from PICT output files.

This has all the intended functionality for this PR. It has no impact on other functionality so there should be no problem in merging to master. I will follow up with other PRs to complete full "Golden Dataset" testing functionality.

**Link to tracking Issue:** open-telemetry#652 

**Testing:** Unit tests exist for all functionality which has been coded so far

**Documentation:** None yet. Will do so after golden dataset generation coding is complete.
hughesjj pushed a commit to hughesjj/opentelemetry-collector that referenced this pull request Apr 27, 2023
Troels51 pushed a commit to Troels51/opentelemetry-collector that referenced this pull request Jul 5, 2024
swiatekm pushed a commit to swiatekm/opentelemetry-collector that referenced this pull request Oct 9, 2024
* Add k8s infra monitorig demo example

Signed-off-by: ChrsMark <chrismarkou92@gmail.com>

* Upgrade chart version

Signed-off-by: ChrsMark <chrismarkou92@gmail.com>

* Bump patch version instead of minor

Signed-off-by: ChrsMark <chrismarkou92@gmail.com>

---------

Signed-off-by: ChrsMark <chrismarkou92@gmail.com>
Co-authored-by: Tyler Helmuth <12352919+TylerHelmuth@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants