Update otel v0.108.0 (#1617)

* gomod

* rename createSettings

* remove customRoundTripper comment because the function has been removed

* remove imp of functions that have been removed on host interface

* remove ReportStatus function

* update converters

* add comment for batching config in otlp exporter

* update datadog receiver

* fix refs

* fix converters

* update vcenter metrics

* add session timeout and heatbeat interval to kafka receiver

* update otelcol.processor.transform doc

* update vcenter receiver by settings the metrics default to true

* update otelcol.processor.transform

* fix otelcol kafka converter

* fix jaeger test

* update static traces config following upgrade of confmap pkg

* update klog replace directives

* update Beyla

* update pyroscope

* update github.com/opencontainers/runc

* force cilium to v0.12.3

* change go version back to 1.22.5

* fix go mod

* test cilium v0.13.1

* fix test in loki.source.aws_firehose after updating prometheus client_golang

* switch cilium back to v0.12.3

* fix faro receiver test

* update test containers pkg

* fix loki process stages test

* add comment in go.mod

* Update docs/sources/reference/components/otelcol/otelcol.receiver.kafka.md

Co-authored-by: Clayton Cornell <[email protected]>

---------

Co-authored-by: Clayton Cornell <[email protected]>

CHANGELOG.md

@@ -9,6 +9,16 @@ internal API changes are not present.
 
 Main (unreleased)
 -----------------
+### Breaking changes
+
+- [otelcol.processor.transform] The functions `convert_sum_to_gauge` and `convert_gauge_to_sum` must now be used in the `metric` `context` rather than in the `datapoint` context.
+  https://github.com/open-telemetry/opentelemetry-collector-contrib/issues/34567 (@wildum)
+
+- Upgrade Beyla from 1.7.0 to 1.8.2. A complete list of changes can be found on the Beyla releases page: https://github.com/grafana/beyla/releases. (@wildum)
+  It contains a few breaking changes for the component `beyla.ebpf`:
+  - renamed metric `process.cpu.state` to `cpu.mode`
+  - renamed metric `beyla_build_info` to `beyla_internal_build_info`
+
 ### Features
 
 - Added Datadog Exporter community component, enabling exporting of otel-formatted Metrics and traces to Datadog. (@polyrain)
@@ -80,6 +90,16 @@ Main (unreleased)
 
 - Aliases for the namespaces are deprecated in the Cloudwatch exporter. For example: "s3" is not allowed, "AWS/S3" should be used. Usage of the aliases will generate warnings in the logs. Support for the aliases will be dropped in the upcoming releases. (@kgeckhart, @andriikushch)
 
+- Update OTel from v0.105.0 vo v0.108.0: (@wildum)
+  - [`otelcol.receiver.vcenter`] New VSAN metrics.
+    https://github.com/open-telemetry/opentelemetry-collector-contrib/issues/33556
+  - [`otelcol.receiver.kafka`] Add `session_timeout` and `heartbeat_interval` attributes.
+    https://github.com/open-telemetry/opentelemetry-collector-contrib/pull/33082
+  - [`otelcol.processor.transform`] Add `aggregate_on_attributes` function for metrics.
+    https://github.com/open-telemetry/opentelemetry-collector-contrib/pull/33334
+  - [`otelcol.receiver.vcenter`] Enable metrics by default
+    https://github.com/open-telemetry/opentelemetry-collector-contrib/issues/33607
+
 v1.3.1
 -----------------
 

docs/sources/reference/components/otelcol/otelcol.processor.transform.md

@@ -23,6 +23,8 @@ there is also a set of metrics-only functions:
 * [convert_summary_count_val_to_sum][]
 * [convert_summary_sum_val_to_sum][]
 * [copy_metric][]
+* [scale_metric][]
+* [aggregate_on_attributes][]
 
 [OTTL][] statements can also contain constructs such as:
 * [Booleans][OTTL booleans]:
@@ -516,6 +518,9 @@ otelcol.processor.transform "default" {
     context = "metric"
     statements = [
       `set(description, "Sum") where type == "Sum"`,
+      `convert_sum_to_gauge() where name == "system.processes.count"`,
+      `convert_gauge_to_sum("cumulative", false) where name == "prometheus_metric"`,
+      `aggregate_on_attributes("sum") where name == "system.memory.usage"`,
     ]
   }
 
@@ -524,8 +529,6 @@ otelcol.processor.transform "default" {
     statements = [
       `limit(attributes, 100, ["host.name"])`,
       `truncate_all(attributes, 4096)`,
-      `convert_sum_to_gauge() where metric.name == "system.processes.count"`,
-      `convert_gauge_to_sum("cumulative", false) where metric.name == "prometheus_metric"`,
     ]
   }
 
@@ -579,6 +582,8 @@ each `"` with a `\"`, and each `\` with a `\\` inside a [normal][strings] {{< pa
 [convert_summary_count_val_to_sum]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/{{< param "OTEL_VERSION" >}}/processor/transformprocessor#convert_summary_count_val_to_sum
 [convert_summary_sum_val_to_sum]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/{{< param "OTEL_VERSION" >}}/processor/transformprocessor#convert_summary_sum_val_to_sum
 [copy_metric]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/{{< param "OTEL_VERSION" >}}/processor/transformprocessor#copy_metric
+[scale_metric]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/{{< param "OTEL_VERSION" >}}/processor/transformprocessor#scale_metric
+[aggregate_on_attributes]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/{{< param "OTEL_VERSION" >}}/processor/transformprocessor#aggregate_on_attributes
 [OTTL booleans]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/{{< param "OTEL_VERSION" >}}/pkg/ottl#booleans
 [OTTL math expressions]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/{{< param "OTEL_VERSION" >}}/pkg/ottl#math-expressions
 [OTTL boolean expressions]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/{{< param "OTEL_VERSION" >}}/pkg/ottl#boolean-expressions

docs/sources/reference/components/otelcol/otelcol.receiver.kafka.md

@@ -48,6 +48,9 @@ Name | Type | Description | Default | Required
 `client_id` | `string` | Consumer client ID to use. | `"otel-collector"` | no
 `initial_offset` | `string` | Initial offset to use if no offset was previously committed. | `"latest"` | no
 `resolve_canonical_bootstrap_servers_only` | `bool` | Whether to resolve then reverse-lookup broker IPs during startup. | `"false"` | no
+`session_timeout` | `duration` | The request timeout for detecting client failures when using Kafka group management. | `"10s"` | no
+`heartbeat_interval` | `duration` | The expected time between heartbeats to the consumer coordinator when using Kafka group management. | `"3s"` | no
+
 
 If `topic` is not set, different topics will be used for different telemetry signals:
 

docs/sources/reference/components/otelcol/otelcol.receiver.vcenter.md

@@ -104,13 +104,17 @@ Name | Type | Description | Default | Required
 `vcenter.cluster.memory.limit` | [metric][] | Enables the `vcenter.cluster.memory.limit` metric. | `true` | no
 `vcenter.cluster.vm.count` | [metric][] | Enables the `vcenter.cluster.vm.count` metric. | `true` | no
 `vcenter.cluster.vm_template.count` | [metric][] | Enables the `vcenter.cluster.vm_template.count` metric. | `true` | no
-`vcenter.datacenter.cluster.count` | [metric][] | Enables the `vcenter.datacenter.cluster.count` metric. | `false` | no
-`vcenter.datacenter.cpu.limit` | [metric][] | Enables the `vcenter.datacenter.cpu.limit` metric. | `false` | no
-`vcenter.datacenter.datastore.count` | [metric][] | Enables the `vcenter.datacenter.datastore.count` metric. | `false` | no
-`vcenter.datacenter.disk.space` | [metric][] | Enables the `vcenter.datacenter.disk.space` metric. | `false` | no
-`vcenter.datacenter.host.count` | [metric][] | Enables the `vcenter.datacenter.host.count` metric. | `false` | no
-`vcenter.datacenter.memory.limit` | [metric][] | Enables the `vcenter.datacenter.memory.limit` metric. | `false` | no
-`vcenter.datacenter.vm.count` | [metric][] | Enables the `vcenter.datacenter.vm.count` metric. | `false` | no
+`vcenter.cluster.vsan.congestions` | [metric][] | Enables the `vcenter.cluster.vsan.congestions` metric. | `true` | no
+`vcenter.cluster.vsan.latency.avg` | [metric][] | Enables the `vcenter.cluster.vsan.latency.avg` metric. | `true` | no
+`vcenter.cluster.vsan.operations` | [metric][] | Enables the `vcenter.cluster.vsan.operations` metric. | `true` | no
+`vcenter.cluster.vsan.throughput` | [metric][] | Enables the `vcenter.cluster.vsan.throughput` metric. | `true` | no
+`vcenter.datacenter.cluster.count` | [metric][] | Enables the `vcenter.datacenter.cluster.count` metric. | `true` | no
+`vcenter.datacenter.cpu.limit` | [metric][] | Enables the `vcenter.datacenter.cpu.limit` metric. | `true` | no
+`vcenter.datacenter.datastore.count` | [metric][] | Enables the `vcenter.datacenter.datastore.count` metric. | `true` | no
+`vcenter.datacenter.disk.space` | [metric][] | Enables the `vcenter.datacenter.disk.space` metric. | `true` | no
+`vcenter.datacenter.host.count` | [metric][] | Enables the `vcenter.datacenter.host.count` metric. | `true` | no
+`vcenter.datacenter.memory.limit` | [metric][] | Enables the `vcenter.datacenter.memory.limit` metric. | `true` | no
+`vcenter.datacenter.vm.count` | [metric][] | Enables the `vcenter.datacenter.vm.count` metric. | `true` | no
 `vcenter.datastore.disk.usage` | [metric][] | Enables the `vcenter.datastore.disk.usage` metric. | `true` | no
 `vcenter.datastore.disk.utilization` | [metric][] | Enables the `vcenter.datastore.disk.utilization` metric. | `true` | no
 `vcenter.host.cpu.capacity` | [metric][] | Enables the `vcenter.host.cpu.capacity` metric. | `true` | no
@@ -127,12 +131,17 @@ Name | Type | Description | Default | Required
 `vcenter.host.network.packet.drop.rate` | [metric][] | Enables the `vcenter.host.network.packet.drop.rate` metric. | `true` | no
 `vcenter.host.network.throughput` | [metric][] | Enables the `vcenter.host.network.throughput` metric. | `true` | no
 `vcenter.host.network.usage` | [metric][] | Enables the `vcenter.host.network.usage` metric. | `true` | no
+`vcenter.host.vsan.cache.hit_rate` | [metric][] | Enables the `vcenter.host.vsan.cache.hit_rate` metric. | `true` | no
+`vcenter.host.vsan.congestions` | [metric][] | Enables the `vcenter.host.vsan.congestions` metric. | `true` | no
+`vcenter.host.vsan.latency.avg` | [metric][] | Enables the `vcenter.host.vsan.latency.avg` metric. | `true` | no
+`vcenter.host.vsan.operations` | [metric][] | Enables the `vcenter.host.vsan.operations` metric. | `true` | no
+`vcenter.host.vsan.throughput` | [metric][] | Enables the `vcenter.host.vsan.throughput` metric. | `true` | no
 `vcenter.resource_pool.cpu.shares` | [metric][] | Enables the `vcenter.resource_pool.cpu.shares` metric. | `true` | no
 `vcenter.resource_pool.cpu.usage` | [metric][] | Enables the `vcenter.resource_pool.cpu.usage` metric. | `true` | no
-`vcenter.resource_pool.memory.ballooned` | [metric][] | Enables the `vcenter.resource_pool.memory.ballooned` metric. | `false` | no
-`vcenter.resource_pool.memory.granted` | [metric][] | Enables the `vcenter.resource_pool.memory.granted` metric. | `false` | no
+`vcenter.resource_pool.memory.ballooned` | [metric][] | Enables the `vcenter.resource_pool.memory.ballooned` metric. | `true` | no
+`vcenter.resource_pool.memory.granted` | [metric][] | Enables the `vcenter.resource_pool.memory.granted` metric. | `true` | no
 `vcenter.resource_pool.memory.shares` | [metric][] | Enables the `vcenter.resource_pool.memory.shares` metric. | `true` | no
-`vcenter.resource_pool.memory.swapped` | [metric][] | Enables the `vcenter.resource_pool.memory.swapped` metric. | `false` | no
+`vcenter.resource_pool.memory.swapped` | [metric][] | Enables the `vcenter.resource_pool.memory.swapped` metric. | `true` | no
 `vcenter.resource_pool.memory.usage` | [metric][] | Enables the `vcenter.resource_pool.memory.usage` metric. | `true` | no
 `vcenter.vm.cpu.readiness` | [metric][] | Enables the `vcenter.vm.cpu.readiness` metric. | `true` | no
 `vcenter.vm.cpu.usage` | [metric][] | Enables the `vcenter.vm.cpu.usage` metric. | `true` | no
@@ -151,6 +160,9 @@ Name | Type | Description | Default | Required
 `vcenter.vm.network.packet.drop.rate` | [metric][] | Enables the `vcenter.vm.network.packet.drop.rate` metric. | `true` | no
 `vcenter.vm.network.throughput` | [metric][] | Enables the `vcenter.vm.network.throughput` metric. | `true` | no
 `vcenter.vm.network.usage` | [metric][] | Enables the `vcenter.vm.network.usage` metric. | `true` | no
+`vcenter.vm.vsan.latency.avg` | [metric][] | Enables the `vcenter.vm.vsan.latency.avg` metric. | `true` | no
+`vcenter.vm.vsan.operations` | [metric][] | Enables the `vcenter.vm.vsan.operations` metric. | `true` | no
+`vcenter.vm.vsan.throughput` | [metric][] | Enables the `vcenter.vm.vsan.throughput` metric. | `true` | no
 
 [metric]: #metric-block