KEP-2170: Initialize runtimes before the manager starts

[tenzen-y]

What this PR does / why we need it:
I fixed the bug that the runtime initialization is performed after the manager starts.

NAME                                    READY   STATUS             RESTARTS      AGE
training-operator-v2-6446df9d8f-dtcmz   0/1     CrashLoopBackOff   6 (19s ago)   6m31s

{"level":"error","ts":"2024-10-24T19:43:24.046731262Z","logger":"setup","caller":"training-operator.v2alpha1/main.go:159","msg":"Could not initialize runtimes","error":"initializing runtime \"TrainingRuntime.kubeflow.org\": setting index on TrainingRuntime for TrainJob: informer has already started","stacktrace":"main.setupControllers\n\t/workspace/cmd/training-operator.v2alpha1/main.go:159"}

The manager starting indicates that informers (including indexers) cache server starts. But, the current implementation tries to add informer parameters to the already launched informer server.

After this implementations, the manager successful to start in the following:

NAME                                    READY   STATUS    RESTARTS   AGE
training-operator-v2-78f898588f-tlgjf   1/1     Running   0          8m16s

Which issue(s) this PR fixes (optional, in Fixes #<issue number>, #<issue number>, ... format, will close the issue(s) when PR gets merged):
Fixes #

Checklist:

• Docs included if any changes are user facing

[andreyvelich]

Thanks for the fix @tenzen-y
/lgtm
/approve

[google-oss-prow]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andreyvelich

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [andreyvelich]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[tenzen-y]

/hold for CI

[coveralls]

Pull Request Test Coverage Report for Build 11506422392

Details

• 0 of 0 changed or added relevant lines in 0 files are covered.
• No unchanged relevant lines lost coverage.
• Overall coverage remained the same at 100.0%

---

Totals
Change from base Build 11506111627:	0.0%
Covered Lines:	77
Relevant Lines:	77

---

💛 - Coveralls

[tenzen-y]

/hold cancel