RHOAIENG-7525: Build opendatahub-io/notebooks in GitHub Action with caching

[jiridanek]

https://issues.redhat.com/browse/RHOAIENG-7525

Description

• create a python script that analyzes dependencies between make targets
• create github actions build for all notebook images
• use caching to speed up the build
• PRs only read from cache, branch builds also push into cache
• build only images that changed compared to the PR target branch and images that depend on these
  • want to postpone this to subsequent PR
• images are named as to distinguish PRs from branch builds
• put PR number into the image name, and also probably git ref hash, so that the build works correctly in presence of multiple concurrent PRs/branches to be tested.
• it is clear to GitHub users that the GHA image builds are not release builds, we release through openshift-ci builds
  • the naming with branch name and hash should make it clear this is not user-facing build; and if somebody uses this anyways, then it is not a big problem, it is as if they did the build from that branch at that commit themselves
• check that the autogenerated gha workflow is still up to date; run generating script again and if there is change, fail

How Has This Been Tested?

See GHA run

• on this PR, which is slow because opendatahub-io/notebooks does not yet have container repository cache populated
• on a PR inside my own repo, which is the same as above except fast https://github.com/jiridanek/notebooks/actions/runs/9322564678
• and on a branch inside my own repo, which is able to push as well as pull into the cache https://github.com/jiridanek/notebooks/actions/runs/9322194970

Merge criteria:

• The commits are squashed in a cohesive manner and have meaningful messages.
• Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
• The developer has manually tested the changes and verified that the changes work

[openshift-ci]

Hi @jiridanek. Thanks for your PR.

I'm waiting for a opendatahub-io member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[jiridanek]

Here's how it runs, https://github.com/jiridanek/notebooks/actions/runs/9206160094

[jiridanek]

/ok-to-test

[jiridanek]

/label tide/merge-method-squash

[openshift-ci]

@jiridanek: The label(s) tide/merge-method-squash cannot be applied, because the repository doesn't have them.

In response to this:

/label tide/merge-method-squash

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[jiridanek]

/override ci/prow/images
/override ci/prow/notebooks-e2e-tests

[openshift-ci]

@jiridanek: jiridanek unauthorized: /override is restricted to Repo administrators, approvers in top level OWNERS file, and the following github teams:.

In response to this:

/override ci/prow/images
/override ci/prow/notebooks-e2e-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[atheo89]

Great work, @jiridanek! I finally had the time to take a look at this, and I don't have any comments to add. Very neat work!

/lgtm

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: atheo89

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [atheo89]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[jiridanek]

/test notebook-jupyter-intel-pyt-ubi9-python-3-9-pr-image-mirror
/test notebook-jupyter-intel-tf-ubi9-python-3-9-pr-image-mirror
/test images

[jiridanek]

/override ci/prow/notebooks-e2e-tests

as it is failing on issue unrelated to GitHub Actions

[openshift-ci]

@jiridanek: jiridanek unauthorized: /override is restricted to Repo administrators, approvers in top level OWNERS file, and the following github teams:.

In response to this:

/override ci/prow/notebooks-e2e-tests

as it is failing on issue unrelated to GitHub Actions

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[atheo89]

/override ci/prow/notebooks-e2e-tests

[openshift-ci]

@atheo89: Overrode contexts on behalf of atheo89: ci/prow/notebooks-e2e-tests

In response to this:

/override ci/prow/notebooks-e2e-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[jiridanek]

/retest

[openshift-ci]

New changes are detected. LGTM label has been removed.

[atheo89]

/override ci/prow/notebooks-e2e-tests

[openshift-ci]

@atheo89: Overrode contexts on behalf of atheo89: ci/prow/notebooks-e2e-tests

In response to this:

/override ci/prow/notebooks-e2e-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.