Upgrade OpenTelemetry components from v0.122.0 to v0.125.0

Author: ptodev

CHANGELOG.md

@@ -17,6 +17,9 @@ Main (unreleased)
   - The previously undocumented argument `custom_metrics` is now expecting a list of paths to custom metrics files.
   - The following metrics are no longer available by default: oracledb_sessions_activity, oracledb_tablespace_free_bytes
 
+- (_Experimental_) The `enable_context_propagation` argument in `beyla.ebpf` has been replaced with the `context_propagation` argument.
+  Set `enable_context_propagation` to `all` to get the same behaviour as `enable_context_propagation` being set to `true`.
+
 ### Features
 
 - Bump snmp_exporter and embedded modules in `prometheus.exporter.snmp` to v0.29.0, add cisco_device module support (@v-zhuravlev)
@@ -107,6 +110,32 @@ Main (unreleased)
 - RPM artifacts in Alloy GitHub releases are no longer signed.
   The artifacts on the `https://rpm.grafana.com` repository used by the `yum` package manager will continue to be signed. (@ptodev)
 
+- Upgrade `otelcol` components from OpenTelemetry v0.122.0 to v0.125.0 (@ptodev):
+  - [`pkg/ottl`] Enhance the Decode OTTL function to support all flavors of Base64.
+  - [`otelcol.processor.resourcedetection`] Adding the `os.version` resource attribute to system processor.
+  - [`otelcol.auth.bearer`] Allow the header name to be customized.
+  - [`otelcol.exporter.awss3`] Add a new `sending_queue` feature.
+  - [`otelcol.exporter.awss3`] Add a new `timeout` argument.
+  - [`otelcol.exporter.awss3`] Add a new `resource_attrs_to_s3` configuration block.
+  - [`otelcol.exporter.awss3`] Fixes an issue where the AWS S3 Exporter was forcing an ACL to be set, leading to unexpected behavior in S3 bucket permissions.
+  - [`otelcol.connector.spanmetrics`] A new `include_instrumentation_scope` configuration argument.
+  - [`otelcol.connector.spanmetrics`] Initialise new `calls_total` metrics at 0.
+  - [`otelcol.connector.spanmetrics`] A new `aggregation_cardinality_limit` configuration argument 
+    to limit the number of unique combinations of dimensions that will be tracked for metrics aggregation.
+  - [`otelcol.connector.spanmetrics`] Deprecate the unused argument `dimensions_cache_size`.
+  - [`otelcol.connector.spanmetrics`] Moving the start timestamp (and last seen timestamp) from the resourceMetrics level to the individual metrics level. 
+  - [`otelcol.processor.k8sattributes`] Add option to configure automatic resource attributes - with annotation prefix.
+    Implements [Specify resource attributes using Kubernetes annotations](https://github.com/open-telemetry/semantic-conventions/blob/main/docs/non-normative/k8s-attributes.md#specify-resource-attributes-using-kubernetes-annotations).
+    This will ensure that each metric has its own accurate start and last seen timestamps, regardless of its relationship to other spans.
+  - [`otelcol.connector.servicegraph`] Change `database_name_attribute` to accept a list of values.
+  - [`otelcol.exporter.kafka`, `otelcol.receiver.kafka`] Deprecating the `auth` > `plain_text` block. Use `auth` > `sasl` with `mechanism` set to `PLAIN` instead.
+  - [`otelcol.exporter.kafka`, `otelcol.receiver.kafka`] Deprecating the `topic` argument. Use `logs` > `topic`, `metrics` > `topic`, or `traces` > `topic` instead.
+  - [`otelcol.exporter.kafka`, `otelcol.receiver.kafka`] Deprecate the `auth` > `tls` block. Use the top-level `tls` block instead.
+  - [`otelcol.receiver.kafka`] Add max_fetch_wait config setting.
+    This setting allows you to specify the maximum time that the broker will wait for min_fetch_size bytes of data 
+    to be available before sending a response to the client.
+  - [ `otelcol.receiver.kafka`] Add support for configuring Kafka consumer rebalance strategy and group instance ID.
+
 v1.8.3
 -----------------
 

docs/sources/reference/components/beyla/beyla.ebpf.md

@@ -295,15 +295,15 @@ beyla.ebpf "default" {
 
 The `ebpf` block configures eBPF-specific settings.
 
-| Name                          | Type          | Description                                                                | Default | Required |
-| ----------------------------- | ------------- | -------------------------------------------------------------------------- | ------- | -------- |
-| `wakeup_len`                  | `int`         | Number of messages to accumulate before wakeup request.                    | `""`    | no       |
-| `track_request_headers`       | `bool`        | Enable tracking of request headers for Traceparent fields.                 | `false` | no       |
-| `http_request_timeout`        | `duration`    | Timeout for HTTP requests.                                                 | `30s`   | no       |
-| `enable_context_propagation`  | `bool`        | Enable context propagation using Linux Traffic Control probes.             | `false` | no       |
-| `high_request_volume`         | `bool`        | Optimize for immediate request information when response is seen.          | `false` | no       |
-| `heuristic_sql_detect`        | `bool`        | Enable heuristic-based detection of SQL requests.                         | `false` | no       |
-| `trace_printer`              | `string`      | Format for printing trace information. | `"disabled"` | no |
+| Name                          | Type          | Description                                                                    | Default      | Required |
+| ----------------------------- | ------------- | ------------------------------------------------------------------------------ | ------------ | -------- |
+| `wakeup_len`                  | `int`         | Number of messages to accumulate before wakeup request.                        | `""`         | no       |
+| `track_request_headers`       | `bool`        | Enable tracking of request headers for Traceparent fields.                     | `false`      | no       |
+| `http_request_timeout`        | `duration`    | Timeout for HTTP requests.                                                     | `30s`        | no       |
+| `context_propagation`         | `string`      | Enables injecting of the Traceparent header value for outgoing HTTP requests.  | `"disabled"` | no       |
+| `high_request_volume`         | `bool`        | Optimize for immediate request information when response is seen.              | `false`      | no       |
+| `heuristic_sql_detect`        | `bool`        | Enable heuristic-based detection of SQL requests.                              | `false`      | no       |
+| `trace_printer`               | `string`      | Format for printing trace information.                                         | `"disabled"` | no       |
 
 `enable_context_propagation` enables context propagation using Linux Traffic Control probes.
 For more information about this topic, refer to [Distributed traces with Beyla][].
@@ -316,6 +316,30 @@ For more information about this topic, refer to [Distributed traces with Beyla][
 * `json` prints the trace information in a JSON format.
 * `json_indent` prints the trace information in a JSON format with indentation.
 
+#### `context_propagation`
+
+`context_propagation` allows Beyla to propagate any incoming context to downstream services. 
+This context propagation support works for any programming language.
+
+For TLS encrypted HTTP requests (HTTPS), the Traceparent header value is encoded at TCP/IP packet level, 
+and requires that Beyla is present on both sides of the communication.
+
+The TCP/IP packet level encoding uses Linux Traffic Control (TC). 
+eBPF programs that also use TC need to chain correctly with Beyla. 
+For more information about chaining programs, refer to the [Cilium compatibility][cilium] documentation.
+
+You can disable the TCP/IP level encoding and TC programs by setting `context_propagation` to `"headers"`. 
+This context propagation support is fully compatible with any OpenTelemetry distributed tracing library.
+
+`context_propagation` can be set to either one of the following values:
+
+* `all`: Enable both HTTP and IP options context propagation.
+* `headers`: Enable context propagation via the HTTP headers only.
+* `ip`: Enable context propagation via the IP options field only.
+* `disabled`: Disable trace context propagation.
+
+[cilium]: https://grafana.com/docs/beyla/latest/cilium-compatibility/
+
 ### `filters`
 
 The `filters` block allows you to filter both application and network metrics by attribute values.

docs/sources/reference/components/otelcol/otelcol.auth.bearer.md

@@ -35,10 +35,11 @@ otelcol.auth.bearer "<LABEL>" {
 
 You can use the following arguments with `otelcol.auth.bearer`:
 
-| Name     | Type     | Description                                      | Default  | Required |
-| -------- | -------- | ------------------------------------------------ | -------- | -------- |
-| `token`  | `secret` | Bearer token to use for authenticating requests. |          | yes      |
-| `scheme` | `string` | Authentication scheme name.                      | "Bearer" | no       |
+| Name     | Type     | Description                                      | Default         | Required |
+| -------- | -------- | ------------------------------------------------ | --------------- | -------- |
+| `token`  | `secret` | Bearer token to use for authenticating requests. |                 | yes      |
+| `header` | `string` | Specifies the auth header name.                  | "Authorization" | no       |
+| `scheme` | `string` | Authentication scheme name.                      | "Bearer"        | no       |
 
 When sending the token, the value of `scheme` is prepended to the `token` value.
 The string is then sent out as either a header for HTTP or as metadata for gRPC.

docs/sources/reference/components/otelcol/otelcol.connector.servicegraph.md

@@ -56,14 +56,15 @@ otelcol.connector.servicegraph "<LABEL>" {
 
 You can use the following arguments with `otelcol.connector.servicegraph`:
 
-| Name                        | Type             | Description                                                                 | Default                                                                                                                      | Required |
-| --------------------------- | ---------------- | --------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------- | -------- |
-| `cache_loop`                | `duration`       | Configures how often to delete series which haven't been updated.           | `"1m"`                                                                                                                       | no       |
-| `database_name_attribute`   | `string`         | The attribute name used to identify the database name from span attributes. | `"db.name"`                                                                                                                  | no       |
-| `dimensions`                | `list(string)`   | A list of dimensions to add with the default dimensions.                    | `[]`                                                                                                                         | no       |
-| `latency_histogram_buckets` | `list(duration)` | Buckets for latency histogram metrics.                                      | `["2ms", "4ms", "6ms", "8ms", "10ms", "50ms", "100ms", "200ms", "400ms", "800ms", "1s", "1400ms", "2s", "5s", "10s", "15s"]` | no       |
-| `metrics_flush_interval`    | `duration`       | The interval at which metrics are flushed to downstream components.         | `"60s"`                                                                                                                      | no       |
-| `store_expiration_loop`     | `duration`       | The time to expire old entries from the store periodically.                 | `"2s"`                                                                                                                       | no       |
+| Name                        | Type             | Description                                                                              | Default                                                                                                                      | Required |
+| --------------------------- | ---------------- | ---------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------- | -------- |
+| `cache_loop`                | `duration`       | Configures how often to delete series which have not been updated.                       | `"1m"`                                                                                                                       | no       |
+| `database_name_attribute`   | `string`         | (Deprecated) The attribute name used to identify the database name from span attributes. | `"db.name"`                                                                                                                  | no       |
+| `database_name_attributes`  | `list(string)`   | The list of attribute names used to identify the database name from span attributes.     | `["db.name"]`                                                                                                                | no       |
+| `dimensions`                | `list(string)`   | A list of dimensions to add with the default dimensions.                                 | `[]`                                                                                                                         | no       |
+| `latency_histogram_buckets` | `list(duration)` | Buckets for latency histogram metrics.                                                   | `["2ms", "4ms", "6ms", "8ms", "10ms", "50ms", "100ms", "200ms", "400ms", "800ms", "1s", "1400ms", "2s", "5s", "10s", "15s"]` | no       |
+| `metrics_flush_interval`    | `duration`       | The interval at which metrics are flushed to downstream components.                      | `"60s"`                                                                                                                      | no       |
+| `store_expiration_loop`     | `duration`       | The time to expire old entries from the store periodically.                              | `"2s"`                                                                                                                       | no       |
 
 Service graphs work by inspecting traces and looking for spans with parent-children relationship that represent a request.
 `otelcol.connector.servicegraph` uses OpenTelemetry semantic conventions to detect a myriad of requests.
@@ -108,6 +109,8 @@ Additional labels can be included using the `dimensions` configuration option:
 
 When `metrics_flush_interval` is set to `0s`, metrics will be flushed on every received batch of traces.
 
+The attributes in `database_name_attributes` are tried in order, selecting the first match.
+
 [Span Kind]: https://opentelemetry.io/docs/concepts/signals/traces/#span-kind
 
 ## Blocks

docs/sources/reference/components/otelcol/otelcol.connector.spanmetrics.md

@@ -66,16 +66,16 @@ You can use the following arguments with `otelcol.connector.spanmetrics`:
 | Name                              | Type           | Description                                                                            | Default                 | Required |
 | --------------------------------- | -------------- | -------------------------------------------------------------------------------------- | ----------------------- | -------- |
 | `aggregation_temporality`         | `string`       | Configures whether to reset the metrics after flushing.                                | `"CUMULATIVE"`          | no       |
-| `dimensions_cache_size`           | `number`       | How many dimensions to cache.                                                          | `1000`                  | no       |
+| `dimensions_cache_size`           | `number`       | (Deprecated: use `aggregation_cardinality_limit` instead) How many dimensions to cache.| `0`                  | no       |
 | `exclude_dimensions`              | `list(string)` | List of dimensions to be excluded from the default set of dimensions.                  | `[]`                    | no       |
 | `metric_timestamp_cache_size`     | `number`       | Controls the size of a cache used to keep track of the last time a metric was flushed. | `1000`                  | no       |
 | `metrics_expiration`              | `duration`     | Time period after which metrics are considered stale and are removed from the cache.   | `"0s"`                  | no       |
 | `metrics_flush_interval`          | `duration`     | How often to flush generated metrics.                                                  | `"60s"`                 | no       |
 | `namespace`                       | `string`       | Metric namespace.                                                                      | `"traces.span.metrics"` | no       |
 | `resource_metrics_cache_size`     | `number`       | The size of the cache holding metrics for a service.                                   | `1000`                  | no       |
 | `resource_metrics_key_attributes` | `list(string)` | Limits the resource attributes used to create the metrics.                             | `[]`                    | no       |
-
-Adjusting `dimensions_cache_size` can improve the {{< param "PRODUCT_NAME" >}} process' memory usage.
+| `aggregation_cardinality_limit`   | `number`       | The maximum number of unique combinations of dimensions that will be tracked for metrics aggregation. | `0`      | no       |
+| `include_instrumentation_scope`   | `list(string)` | A list of instrumentation scope names to include from the traces.                      | `[]`                    | no       |
 
 The supported values for `aggregation_temporality` are:
 
@@ -98,6 +98,9 @@ A resource doesn't need to have all of the attributes.
 The list must include enough attributes to properly identify unique resources or risk aggregating data from more than one service and span.
 For example, `["service.name", "telemetry.sdk.language", "telemetry.sdk.name"]`.
 
+When the `aggregation_cardinality_limit` limit is reached, additional unique combinations will be dropped but registered under a new entry with `otel.metric.overflow="true"`. 
+A value of `0` means no limit is applied.
+
 ## Blocks
 
 You can use the following blocks with `otelcol.connector.spanmetrics`: