Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

merging 0.63 to optimization branch #8

Merged
87 commits merged into from
Oct 30, 2022
Merged

merging 0.63 to optimization branch #8

87 commits merged into from
Oct 30, 2022

Conversation

ghost
Copy link

@ghost ghost commented Oct 30, 2022

merging 0.63 to optimization branch

Jacob Marble and others added 30 commits October 17, 2022 08:32
…family incorrectly (open-telemetry#13213)

Fix metrics being grouped into the same metrics family incorrectly

Co-authored-by: David Ashpole <dashpole@google.com>
A few references to with directions were left behind, removing these for clarity.
…ry#15229)

dependabot updates Mon Oct 17 18:39:22 UTC 2022
Bump google.golang.org/grpc from 1.50.0 to 1.50.1 in /exporter/coralogixexporter
Bump google.golang.org/grpc from 1.50.0 to 1.50.1 in /extension/asapauthextension
Bump google.golang.org/grpc from 1.50.0 to 1.50.1 in /extension/basicauthextension
Bump google.golang.org/grpc from 1.50.0 to 1.50.1 in /extension/jaegerremotesampling

Co-authored-by: dmitryax <dmitryax@users.noreply.github.com>
* [exporter/datadog] Add logging example

* fix tests

* Apply suggestions from code review

Co-authored-by: Gabriel Aszalos <gabriel.aszalos@gmail.com>

* PR comments

* Apply suggestions from code review

Co-authored-by: Gabriel Aszalos <gabriel.aszalos@gmail.com>

* PR comments - remove #

* Apply suggestions from code review

Co-authored-by: Gabriel Aszalos <gabriel.aszalos@gmail.com>

Co-authored-by: Gabriel Aszalos <gabriel.aszalos@gmail.com>
…ith Solace PubSub+ Event Broker 10.2.0 (open-telemetry#15244)

* Use modify message instead of reject message to indicate failure

SOL-75279

* Set delivery mode on propagated spans

SOL-75196

* Added character type to user property mapping

SOL-75145

* Changed dropped_user_properties to dropped_application_message_properties

SOL-74920

* Updated protobuf spec, incorporated transactional changes

SOL-75362

* Scoped metrics to receiver instances based on instance name if present

SOL-75870, SOL-74853

* Made delivery mode mapped strings lowercase

SOL-75196

* Use string of length 1 instead of int for character value mapping

SOL-75145

* Gracefully handle enums beyond the current known set

This allows forward compatibility in the event that new entries are added in the future

SOL-78861

* Use the slice type in the attribute map when mapping user properties

OpenTelemetry+backends do not support the Bytes type, and instead support a slice of integers

SOL-78624

* Revert "Use the slice type in the attribute map when mapping user properties"

This reverts commit 48b9730.

* Change name of Enqueue Event in OpenTelemetry Spans to always be '<endpoint name> enqueue', even for anonymous endpoints

Also removes messaging.destination as an attribute on enqueue events as its now redundant

SOL-79098

* Handle the case of an empty payload, returning an error

In this case, the message will be dropped and stats incremented

SOL-79796

* Fixed an issue causing AcceptMessage to hang indefinitely

Working around Azure/go-amqp#126 by batching dispositions

SOL-79806

* Revert "Fixed an issue causing AcceptMessage to hang indefinitely"

This reverts commit bf61326.
…etry#14953)

* Fix validation of some awscloudwatch configs that used named groups
Signed-off-by: Bogdan Drutu <bogdandrutu@gmail.com>

Signed-off-by: Bogdan Drutu <bogdandrutu@gmail.com>
Co-authored-by: Daniel Jaglowski <jaglows3@gmail.com>
)

Co-authored-by: Dmitrii Anoshin <anoshindx@gmail.com>
…ki.tenant` hint. (open-telemetry#14930)

* [pkg/loki] Group Loki requests by attr inferred from `loki.tenant` hint.

* fixup! [pkg/loki] Group Loki requests by attr inferred from `loki.tenant` hint.
Revert "[CI] Reduce cache download timeout (open-telemetry#14689)"

This reverts commit 7429ab6.
…est table (open-telemetry#14477)

Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Co-authored-by: Daniel Jaglowski <jaglows3@gmail.com>
)

Co-authored-by: Evan Bradley <evan-bradley@users.noreply.github.com>
The HTTP Check Receiver can be used for synthethic checks against HTTP endpoints. This receiver will make a request to the specified `endpoint` using the configured `method`.

Fixes open-telemetry#10607
…ry#15259)

dependabot updates Tue Oct 18 17:46:31 UTC 2022
Bump github.com/aws/aws-sdk-go from 1.44.114 to 1.44.117 in /exporter/awsxrayexporter
Bump github.com/aws/aws-sdk-go from 1.44.114 to 1.44.117 in /exporter/datadogexporter
Bump github.com/aws/aws-sdk-go from 1.44.114 to 1.44.117 in /extension/observer/ecsobserver
Bump github.com/aws/aws-sdk-go from 1.44.114 to 1.44.117 in /internal/aws/awsutil
Bump github.com/aws/aws-sdk-go from 1.44.114 to 1.44.117 in /internal/aws/xray
Bump github.com/aws/aws-sdk-go from 1.44.114 to 1.44.117 in /internal/aws/xray/testdata/sampleapp
Bump github.com/docker/docker from 20.10.18+incompatible to 20.10.19+incompatible in /extension/observer/dockerobserver
Bump github.com/docker/docker from 20.10.18+incompatible to 20.10.19+incompatible in /internal/docker
Bump github.com/fsnotify/fsnotify from 1.5.4 to 1.6.0 in /extension/bearertokenauthextension
Bump github.com/tencentcloud/tencentcloud-sdk-go/tencentcloud/common from 1.0.512 to 1.0.515 in /exporter/tencentcloudlogserviceexporter
Bump github.com/tencentcloud/tencentcloud-sdk-go/tencentcloud/common from 1.0.512 to 1.0.516 in /exporter/tencentcloudlogserviceexporter
Bump go.mongodb.org/atlas from 0.17.0 to 0.18.0 in /receiver/mongodbatlasreceiver
Bump go.opentelemetry.io/otel from 1.10.0 to 1.11.0 in /examples/demo/client
Bump go.opentelemetry.io/otel from 1.10.0 to 1.11.0 in /examples/demo/server
Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.10.0 to 1.11.0 in /examples/demo/client
Bump go.opentelemetry.io/otel/metric from 0.32.1 to 0.32.3 in /examples/demo/client
Bump go.opentelemetry.io/otel/sdk from 1.10.0 to 1.11.0 in /examples/demo/client
Bump go.opentelemetry.io/otel/sdk from 1.10.0 to 1.11.0 in /examples/demo/server
Bump go.opentelemetry.io/otel/trace from 1.10.0 to 1.11.0 in /examples/demo/server
Bump google.golang.org/api from 0.98.0 to 0.99.0 in /exporter/googlecloudpubsubexporter
Bump google.golang.org/api from 0.98.0 to 0.99.0 in /receiver/googlecloudpubsubreceiver
Bump google.golang.org/api from 0.98.0 to 0.99.0 in /receiver/googlecloudspannerreceiver
Bump k8s.io/api from 0.25.2 to 0.25.3 in /processor/k8sattributesprocessor
Bump k8s.io/api from 0.25.2 to 0.25.3 in /receiver/k8seventsreceiver
Bump k8s.io/apimachinery from 0.25.2 to 0.25.3 in /processor/k8sattributesprocessor
Bump k8s.io/apimachinery from 0.25.2 to 0.25.3 in /receiver/k8seventsreceiver
Bump k8s.io/client-go from 0.25.2 to 0.25.3 in /internal/aws/k8s
Bump k8s.io/client-go from 0.25.2 to 0.25.3 in /processor/k8sattributesprocessor
Bump k8s.io/client-go from 0.25.2 to 0.25.3 in /receiver/k8seventsreceiver

Co-authored-by: codeboten <codeboten@users.noreply.github.com>
This marks issues as stale after 60 days, exempting issues that are labeled with never stale. Upon being marked stale, code owners for any corresponding package labels are pinged.

Issues are closed after 180 days (roughly 6 months) of total inactivity (4 months after the Stale label is applied), and are given the closed as inactive label so they can be easily found later.
…ry#15279)

dependabot updates Tue Oct 18 22:57:18 UTC 2022
Bump github.com/aws/aws-sdk-go from 1.44.117 to 1.44.118 in /exporter/awsxrayexporter
Bump github.com/aws/aws-sdk-go from 1.44.117 to 1.44.118 in /exporter/datadogexporter
Bump github.com/aws/aws-sdk-go from 1.44.117 to 1.44.118 in /extension/observer/ecsobserver
Bump github.com/aws/aws-sdk-go from 1.44.117 to 1.44.118 in /internal/aws/awsutil
Bump github.com/aws/aws-sdk-go from 1.44.117 to 1.44.118 in /internal/aws/xray
Bump github.com/aws/aws-sdk-go from 1.44.117 to 1.44.118 in /internal/aws/xray/testdata/sampleapp
Bump github.com/docker/docker from 20.10.19+incompatible to 20.10.20+incompatible in /extension/observer/dockerobserver
Bump github.com/docker/docker from 20.10.19+incompatible to 20.10.20+incompatible in /internal/docker
Bump google.golang.org/api from 0.99.0 to 0.100.0 in /exporter/f5cloudexporter
Bump google.golang.org/api from 0.99.0 to 0.100.0 in /exporter/googlecloudexporter
Bump google.golang.org/api from 0.99.0 to 0.100.0 in /exporter/googlecloudpubsubexporter
Bump google.golang.org/api from 0.99.0 to 0.100.0 in /receiver/googlecloudpubsubreceiver
Bump google.golang.org/api from 0.99.0 to 0.100.0 in /receiver/googlecloudspannerreceiver
Bump kentaro-m/auto-assign-action from 1.2.3 to 1.2.4

Co-authored-by: codeboten <codeboten@users.noreply.github.com>
…pen-telemetry#15249)

* [receiver/postgresql] Fix data type for postgresql.bgwriter.duration

This was previously modeled as an int but should have been been a double,
corresponding to pg_stat_bgwriter.checkpoint_*_time.

* Update scraper test ot use double value
…ed (open-telemetry#14343)

* [pkg/winperfcounters] Retry collection when rolloever error is detected
Corbin Phelps and others added 28 commits October 24, 2022 16:14
…framing (open-telemetry#15358)

* Added support for syslog rfc 6587 octet counting and non-transparent-framing

Signed-off-by: Corbin Phelps <corbin.phelps@bluemedora.com>
…ry#15648)

dependabot updates Mon Oct 24 21:11:51 UTC 2022
Bump github.com/Azure/azure-event-hubs-go/v3 from 3.3.18 to 3.3.19 in /receiver/azureblobreceiver
Bump github.com/Azure/azure-event-hubs-go/v3 from 3.3.18 to 3.3.19 in /receiver/azureeventhubreceiver
Bump github.com/SAP/go-hdb from 0.108.3 to 0.109.1 in /receiver/saphanareceiver
Bump github.com/SAP/go-hdb from 0.108.3 to 0.109.1 in /receiver/sqlqueryreceiver
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /exporter/awsemfexporter
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /exporter/awsxrayexporter
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /exporter/datadogexporter
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /exporter/kafkaexporter
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /internal/aws/awsutil
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /internal/aws/cwlogs
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /internal/aws/xray
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /internal/metadataproviders
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /processor/resourcedetectionprocessor
Bump github.com/aws/aws-sdk-go from 1.44.121 to 1.44.122 in /receiver/awsxrayreceiver
Bump github.com/aws/aws-sdk-go-v2 from 1.17.0 to 1.17.1 in /extension/sigv4authextension
Bump github.com/aws/aws-sdk-go-v2/config from 1.17.8 to 1.17.10 in /exporter/awskinesisexporter
Bump github.com/aws/aws-sdk-go-v2/config from 1.17.8 to 1.17.10 in /extension/sigv4authextension
Bump github.com/aws/aws-sdk-go-v2/credentials from 1.12.22 to 1.12.23 in /exporter/awskinesisexporter
Bump github.com/aws/aws-sdk-go-v2/credentials from 1.12.22 to 1.12.23 in /extension/sigv4authextension
Bump github.com/aws/aws-sdk-go-v2/service/sts from 1.17.0 to 1.17.1 in /exporter/awskinesisexporter
Bump github.com/aws/aws-sdk-go-v2/service/sts from 1.17.0 to 1.17.1 in /extension/sigv4authextension
Bump github.com/hashicorp/consul/api from 1.15.2 to 1.15.3 in /internal/metadataproviders
Bump github.com/stretchr/testify from 1.8.0 to 1.8.1 in /exporter/jaegerthrifthttpexporter
Bump github.com/stretchr/testify from 1.8.0 to 1.8.1 in /exporter/prometheusexporter
Bump github.com/stretchr/testify from 1.8.0 to 1.8.1 in /exporter/skywalkingexporter
Bump github.com/stretchr/testify from 1.8.0 to 1.8.1 in /extension/awsproxy
Bump github.com/stretchr/testify from 1.8.0 to 1.8.1 in /extension/observer/ecstaskobserver
Bump github.com/stretchr/testify from 1.8.0 to 1.8.1 in /processor/redactionprocessor
Bump github.com/stretchr/testify from 1.8.0 to 1.8.1 in /receiver/k8seventsreceiver
Bump github.com/testcontainers/testcontainers-go from 0.14.0 to 0.15.0 in /receiver/postgresqlreceiver

Co-authored-by: codeboten <codeboten@users.noreply.github.com>
…ry#15650)

dependabot updates Mon Oct 24 22:43:10 UTC 2022
Bump cloud.google.com/go/pubsub from 1.25.1 to 1.26.0 in /exporter/googlecloudpubsubexporter
Bump cloud.google.com/go/pubsub from 1.25.1 to 1.26.0 in /receiver/googlecloudpubsubreceiver
Bump github.com/aws/aws-sdk-go-v2/service/kinesis from 1.15.19 to 1.15.20 in /exporter/awskinesisexporter
Bump github.com/tencentcloud/tencentcloud-sdk-go/tencentcloud/common from 1.0.518 to 1.0.520 in /exporter/tencentcloudlogserviceexporter
Bump go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc from 0.36.3 to 0.36.4 in /receiver/opencensusreceiver
Bump go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp from 0.36.1 to 0.36.4 in /examples/demo/client
Bump go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp from 0.36.1 to 0.36.4 in /examples/demo/server
Bump kentaro-m/auto-assign-action from 1.2.3 to 1.2.4

Co-authored-by: codeboten <codeboten@users.noreply.github.com>
…allel test to fix race condition (open-telemetry#15369)

Fixes open-telemetry#10292, Added mutext to testdectectresource_paralleltest to fix race condition

Signed-off-by: Maureen <amaka013@gmail.com>

Signed-off-by: Maureen <amaka013@gmail.com>
[receiver] modify deprecated label

Signed-off-by: xin.li <xin.li@daocloud.io>

Signed-off-by: xin.li <xin.li@daocloud.io>
Initial version of a receiver to collect(pull/watch) Kubernetes Objects
Application Insights Severity Level mapping was based on SeverityText which was unique for every language/SDK. The mapping approach has been changed to analyze SeverityNumber, which is supposed to be common across languages/SDKs.
* [pkg/batchperresourceattr] Add CODEOWNERS

* Apply suggestions from code review

Co-authored-by: Dmitrii Anoshin <anoshindx@gmail.com>

* Remove @pmcollins from owners

Co-authored-by: Dmitrii Anoshin <anoshindx@gmail.com>
This change required:

- NewJSONUnmarshaler -> JSONUnmarshaler
- NewProtoUnmarshaler -> ProtoUnmarshaler
- NewClient -> NewGRPCClient
- split of otlp/otlphttp/logging exporters
  - change to update-dep script.
- updated tests that were looking for specific error messages
- updated tests that were setting an invalid endpoint
* SNMP Receiver adds scraper and now is completely functional
…rror (open-telemetry#15649)

* Update ExprFunc to return an error

* fix dependent processors

* Add changelog entry

* Fix lint

* Fix lint

* Apply feedback

* Add error handling all the way through
* [chore] update otel/changelog
* update version file
* Prepare contrib-base for version v0.63.0
Signed-off-by: xin.li <xin.li@daocloud.io>

Signed-off-by: xin.li <xin.li@daocloud.io>

Signed-off-by: xin.li <xin.li@daocloud.io>
…lemetry#15669)

There are many tests in this repository that currently bind to 0.0.0.0. This is not necessary.
… Jaeger spans to OTEL (open-telemetry#14463)

Add refType as attribute to link

Following OTEL's trace semantic conventions for Opentracing traces. When
creating a link the attribute `opentracing.ref_type` will be set with
one of the accepted values, either `child_of` or `follows_from`.

This enables the translator to maintain reference context that enable
features. For example, Jaeger multiple parents for spans.

https://opentelemetry.io/docs/reference/specification/trace/semantic_conventions/compatibility/#opentracing
…elemetry#15676)

Revert previous experiment to configure a setup stage for windows since it takes way too much even when hitting the cache (more than 15mins).
This is a bit different than before, now every job has its own independent cache.

Signed-off-by: Bogdan Drutu <bogdandrutu@gmail.com>

Signed-off-by: Bogdan Drutu <bogdandrutu@gmail.com>
open-telemetry#15698)

Added instructions for including a new component into the distributions of otelcol-contrib

Co-authored-by: Daniel Jaglowski <jaglows3@gmail.com>
… shard aggregation (open-telemetry#14870)

feat: add metrics for merge operations with total shard aggregation
@ghost ghost merged commit 892709a into optimization Oct 30, 2022
opsrampdeveloper pushed a commit that referenced this pull request Oct 29, 2024
… Histo --> Histogram (open-telemetry#33824)

## Description

This PR adds a custom metric function to the transformprocessor to
convert exponential histograms to explicit histograms.

Link to tracking issue: Resolves open-telemetry#33827

**Function Name**
```
convert_exponential_histogram_to_explicit_histogram
```

**Arguments:**

- `distribution` (_upper, midpoint, uniform, random_)
- `ExplicitBoundaries: []float64`

**Usage example:**

```yaml
processors:
  transform:
    error_mode: propagate
    metric_statements:
    - context: metric
      statements:
        - convert_exponential_histogram_to_explicit_histogram("random", [10.0, 20.0, 30.0, 40.0, 50.0, 60.0, 70.0, 80.0, 90.0, 100.0]) 
```

**Converts:**

```
Resource SchemaURL: 
ScopeMetrics #0
ScopeMetrics SchemaURL: 
InstrumentationScope  
Metric #0
Descriptor:
     -> Name: response_time
     -> Description: 
     -> Unit: 
     -> DataType: ExponentialHistogram
     -> AggregationTemporality: Delta
ExponentialHistogramDataPoints #0
Data point attributes:
     -> metric_type: Str(timing)
StartTimestamp: 1970-01-01 00:00:00 +0000 UTC
Timestamp: 2024-07-31 09:35:25.212037 +0000 UTC
Count: 44
Sum: 999.000000
Min: 40.000000
Max: 245.000000
Bucket (32.000000, 64.000000], Count: 10
Bucket (64.000000, 128.000000], Count: 22
Bucket (128.000000, 256.000000], Count: 12
        {"kind": "exporter", "data_type": "metrics", "name": "debug"}
```

**To:**

```
Resource SchemaURL: 
ScopeMetrics #0
ScopeMetrics SchemaURL: 
InstrumentationScope  
Metric #0
Descriptor:
     -> Name: response_time
     -> Description: 
     -> Unit: 
     -> DataType: Histogram
     -> AggregationTemporality: Delta
HistogramDataPoints #0
Data point attributes:
     -> metric_type: Str(timing)
StartTimestamp: 1970-01-01 00:00:00 +0000 UTC
Timestamp: 2024-07-30 21:37:07.830902 +0000 UTC
Count: 44
Sum: 999.000000
Min: 40.000000
Max: 245.000000
ExplicitBounds #0: 10.000000
ExplicitBounds #1: 20.000000
ExplicitBounds #2: 30.000000
ExplicitBounds #3: 40.000000
ExplicitBounds #4: 50.000000
ExplicitBounds #5: 60.000000
ExplicitBounds #6: 70.000000
ExplicitBounds #7: 80.000000
ExplicitBounds #8: 90.000000
ExplicitBounds #9: 100.000000
Buckets #0, Count: 0
Buckets #1, Count: 0
Buckets #2, Count: 0
Buckets #3, Count: 2
Buckets #4, Count: 5
Buckets #5, Count: 0
Buckets #6, Count: 3
Buckets #7, Count: 7
Buckets #8, Count: 2
Buckets #9, Count: 4
Buckets #10, Count: 21
        {"kind": "exporter", "data_type": "metrics", "name": "debug"}
```

### Testing

- Several unit tests have been created. We have also tested by ingesting
and converting exponential histograms from the `statsdreceiver` as well
as directly via the `otlpreceiver` over grpc over several hours with a
large amount of data.

- We have clients that have been running this solution in production for
a number of weeks.

### Readme description:

### convert_exponential_hist_to_explicit_hist

`convert_exponential_hist_to_explicit_hist([ExplicitBounds])`

the `convert_exponential_hist_to_explicit_hist` function converts an
ExponentialHistogram to an Explicit (_normal_) Histogram.

`ExplicitBounds` is represents the list of bucket boundaries for the new
histogram. This argument is __required__ and __cannot be empty__.

__WARNING:__

The process of converting an ExponentialHistogram to an Explicit
Histogram is not perfect and may result in a loss of precision. It is
important to define an appropriate set of bucket boundaries to minimize
this loss. For example, selecting Boundaries that are too high or too
low may result histogram buckets that are too wide or too narrow,
respectively.

---------

Co-authored-by: Kent Quirk <kentquirk@gmail.com>
Co-authored-by: Tyler Helmuth <12352919+TylerHelmuth@users.noreply.github.com>
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.