Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
github,tmt: run the bib integration tests
This commit runs parameterized `bootc-image-builder` integration tests as part of the testing. The parameterization requires [0]. The test matrix right now is to generated a "qcow2" and "ami" image and for both: 1. test_image_is_generated(): just checks that the image can be build 2. test_image_boots(): the image boots in qemu and can be accessed via ssh [1] 3. test_image_build_without_se_linux_denials(): ensure that the image is build without selinux denials Only test (3) strictly requires testing farm because it can only run inside a host that runs with a RHEL/fedora kernel and selinux enabled and it is not relevant for your testing (only required for bootc-image-builder). This is why this commit also adds a normal GH action - they support building the images and booting them with qemu so for this project testing farm is slightly less important. We can run arbitrary post-boot tests in step (2) if we want, at this point we have a ssh connection to the booted image so we can do any post-boot checks we consider important (code for this needs to be written though but shoudl be easy). Caveats: - bootc-image-builder cannot build quay.io/centos-bootc/centos-bootc:stream9 right now [2]. This is being worked on and we could start with testing the quay.io/centos-bootc/fedora-bootc:eln images until bib supports centos. - `BIB_TEST_BOOTC_CONTAINER_TAG` is not set correctly right now, it needs to be parameterized with a reference to the bootc container that just got build and now needs testing. Some ideas for further improvements: - tests could be extracted from bootc-image-builder into a shared bootc-testing repo - post-boot tests - upgrade tests, e.g. by building an image from the current "stable" bootc first and then upgrading to the bootc container that is tested I hope this is helpful! [0] osbuild/bootc-image-builder#87 [1] https://github.com/osbuild/bootc-image-builder/blob/main/test/test_smoke.py#L128 [2] osbuild/bootc-image-builder#20
- Loading branch information