Add user-specified instrumentation volume

[jnarezo]

Description:

Adds the ability for user to specify a custom volume for instrumentation / auto-injection to Instrumentation.spec.<lang>.volumeSizeLimit.

Adds validation to prevent Volume and VolumeSizeLimit being defined simultaneously to prevent overlapping behavior (ex. Do we use Volume.Size or VolumeSizeLimit?)

Link to tracking Issue(s):

• Resolves: Allow references to other volumes (eg. PVCs) for instrumention auto-inject #3267

Testing:

Unit tests for validation with different combinations of Volume/VolumeSizeLimit being defined and not defined

Documentation:

Updated API docs with new spec.

[linux-foundation-easycla]

The committers listed above are authorized under a signed CLA.

• ✅ login: jnarezo / name: Joshua Narezo (bf3d1e8, 9bed7cb, 388b098, 1f4d428, b88b3d0, 29812e0, 0b64efe, daae32a, 717834e, 6811710, 61785b6, 0fbd80d)

[swiatekm]

These changes look good to me overall. Some things missing before we can merge this PR:

• You need to add a changelog entry. Run make chlog-new and fill in the template.
• Run make precommit and fix any issues it brings up. Right now, the CI is failing because the bundle needs to be updated after changes to CRDs.
• We should check this volume mechanism in E2E tests. It's fine to modify an existing test.

[jnarezo]

These changes look good to me overall. Some things missing before we can merge this PR:

• You need to add a changelog entry. Run make chlog-new and fill in the template.
• Run make precommit and fix any issues it brings up. Right now, the CI is failing because the bundle needs to be updated after changes to CRDs.
• We should check this volume mechanism in E2E tests. It's fine to modify an existing test.

Thanks, got it working locally! Was using golang v1.23.x and pipeline was broken on me, so I downgraded.

[swiatekm]

The PR looks great, thanks for the contribution!

There's one big problem with it, and to be clear, this is really Kubernetes' fault. As it turns out, the OpenAPI spec for corev1.Volume is actually quite large, and we're including a copy of it for each language instrumentation. As a result, we're making the Instrumentation CRD much larger. There are consequences to this - for example, if the CRD is too big to fit in a K8s annotation (the limit is ~256kb), then it can't be applied using kubectl apply anymore. Your change pushes the Instrumentation CRD above that limit.

I'm not sure what we can do to alleviate this. We could make the Volume attribute common to all instrumentations. It would make it less flexible, but maybe that's ok? @jaronoff97 @pavolloffay WDYT?