[8.19] (backport #10391) feat: update OTel Collector components to v0.137.0

[mergify]

What does this PR do?

Updates the OpenTelemetry Collector dependencies to the current latest version v0.137.0. See changelogs since v1.41.0/v0.135.0 for Core and Contrib.

Also updates Elastic OTel components to versions compatible with upstream v0.137.0.

Why is it important?

We should be keeping the OTel components up to date with upstream as much as possible.

Checklist

• My code follows the style guidelines of this project
• [ ] I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• [ ] I have made corresponding change to the default configuration files
• [ ] I have added tests that prove my fix is effective or that my feature works
• I have added an entry in ./changelog/fragments using the changelog tool
• [ ] I have added an integration test or an E2E test

How to test this PR locally

go build .
sudo ./elastic-agent otel
```<hr>This is an automatic backport of pull request #10391 done by [Mergify](https://mergify.com).

[mergify]

Cherry-pick of 7ea323e has failed:

On branch mergify/bp/8.19/pr-10391
Your branch is up to date with 'origin/8.19'.

You are currently cherry-picking commit 7ea323ea1.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	new file:   changelog/fragments/1759863922-update-otel-to-v0.137.0.yaml

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   NOTICE-fips.txt
	both modified:   NOTICE.txt
	both modified:   go.mod
	both modified:   go.sum
	both modified:   internal/pkg/otel/README.md

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

[elasticmachine]

Pinging @elastic/elastic-agent-control-plane (Team:Elastic-Agent-Control-Plane)

[pkoutsovasilis]

@ebeahan @cmacknz in order to bump the otel dependencies we have to deprecate also elastictrace-processor as this doesn't exist anymore, any opinions?

[swiatekm]

@ebeahan @cmacknz in order to bump the otel dependencies we have to deprecate also elastictrace-processor as this doesn't exist anymore, any opinions?

We'd need to backport #10378, but reading the comments in that PR, I'm not sure what the final decision was. @gregkalapos are we still replacing the elastic trace processor with a shim?

[mergify]

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b mergify/bp/8.19/pr-10391 upstream/mergify/bp/8.19/pr-10391
git merge upstream/8.19
git push upstream mergify/bp/8.19/pr-10391

[elasticmachine]

⏳ Build in-progress, with failures

• Buildkite Build
• Commit: b308fb9

Failed CI Steps

• Unit tests - Ubuntu 22.04
• Unit tests - Ubuntu 22.04
• Unit tests - Ubuntu 22.04 with requirefips build tag
• Unit tests - Ubuntu 22.04 with requirefips build tag
• Unit tests - fips140=only Ubuntu 22.04
• Unit tests - fips140=only Ubuntu 22.04
• Unit tests - Ubuntu 22.04 ARM64
• Unit tests - Ubuntu 22.04 ARM64
• Unit tests - macOS 15 ARM
• Unit tests - macOS 15 ARM
• Win2022:sudo:default
• Win2022:sudo:default
• Win2022:sudo:fleet
• Win2022:non-sudo:default
• Win2022:non-sudo:default
• Win2025:sudo:default
• Win2025:sudo:default
• Win2025:sudo:fleet
• Win2025:non-sudo:default
• Win2025:non-sudo:default
• x86_64:non-sudo: default
• x86_64:non-sudo: default
• x86_64:sudo: default
• x86_64:sudo: default
• x86_64:sudo: fleet
• arm:sudo: default
• arm:sudo: default
• arm:sudo: fleet
• arm:sudo: fleet
• x86_64:non-sudo: default
• x86_64:non-sudo: default
• x86_64:sudo: default
• x86_64:sudo: default
• x86_64:sudo: fleet
• x86_64:sudo: fleet

History

• 💔 Build #28842 failed 386af85
• 💔 Build #28724 failed 424ae8f
• 💔 Build #28700 failed 06c2dd1
• 💔 Build #28628 failed 987ba16

cc @pkoutsovasilis

[blakerouse]

No conflicts, looks good.