cnf_setup: Exit on setup failure or timeout (#2114)

Fix handling unsuccessful cnf setup, if resources are not ready
after timeout - then setup should fail with exit 1.
Change specs accordingly, replace wait_count=0 with new option
"ignore_setup_timeout".
Add cnf_setup function to ShellCmd and use it for
installation of CNFs during specs.

Refs: #1937 #2083

Signed-off-by: Konstantin Yarovoy <[email protected]>

USAGE.md

@@ -59,6 +59,17 @@ crystal build src/cnf-testsuite.cr
 ./cnf-testsuite validate_config cnf-config=[PATH_TO]/cnf-testsuite.yml
 ```
 
+#### Installing a cnf:
+
+```
+./cnf-testsuite cnf_setup cnf-config=./cnf-testsuite.yml
+```
+
+##### Skip waiting for resource readiness during installation:
+```
+./cnf-testsuite cnf_setup cnf-config=./cnf-testsuite.yml skip_wait_for_install
+```
+
 #### Running all of the platform and workload tests:
 
 ```

sample-cnfs/ndn-reasonable-image-size/cnf-testsuite.yml

@@ -1,4 +1,3 @@
 ---
-helm_chart: oci://docker.io/envoyproxy/gateway-helm --version v0.0.0-latest
-release_name: envoy 
-service_name: envoy
+helm_directory: gateway-helm
+release_name: envoy-gateway

sample-cnfs/ndn-reasonable-image-size/gateway-helm/.helmignore

@@ -0,0 +1,26 @@
+# Patterns to ignore when building packages.
+# This supports shell glob matching, relative path matching, and
+# negation (prefixed with !). Only one pattern per line.
+.DS_Store
+# Common VCS dirs
+.git/
+.gitignore
+.bzr/
+.bzrignore
+.hg/
+.hgignore
+.svn/
+# Common backup files
+*.swp
+*.bak
+*.tmp
+*.orig
+*~
+# Various IDEs
+.project
+.idea/
+*.tmproj
+.vscode/
+
+# Template files
+*.tmpl.*

sample-cnfs/ndn-reasonable-image-size/gateway-helm/Chart.yaml

@@ -0,0 +1,20 @@
+apiVersion: v2
+appVersion: latest
+description: The Helm chart for Envoy Gateway
+home: https://gateway.envoyproxy.io/
+icon: https://raw.githubusercontent.com/envoyproxy/gateway/main/site/assets/icons/logo.svg
+keywords:
+- gateway-api
+- envoyproxy
+- envoy-gateway
+- eg
+maintainers:
+- name: envoy-gateway-steering-committee
+  url: https://github.com/envoyproxy/gateway/blob/main/GOVERNANCE.md
+- name: envoy-gateway-maintainers
+  url: https://github.com/envoyproxy/gateway/blob/main/CODEOWNERS
+name: gateway-helm
+sources:
+- https://github.com/envoyproxy/gateway
+type: application
+version: v0.0.0-latest

sample-cnfs/ndn-reasonable-image-size/gateway-helm/README.md

@@ -0,0 +1,102 @@
+# gateway-helm
+
+![Version: v0.0.0-latest](https://img.shields.io/badge/Version-v0.0.0--latest-informational?style=flat-square) ![Type: application](https://img.shields.io/badge/Type-application-informational?style=flat-square) ![AppVersion: latest](https://img.shields.io/badge/AppVersion-latest-informational?style=flat-square)
+
+The Helm chart for Envoy Gateway
+
+**Homepage:** <https://gateway.envoyproxy.io/>
+
+## Maintainers
+
+| Name | Email | Url |
+| ---- | ------ | --- |
+| envoy-gateway-steering-committee |  | <https://github.com/envoyproxy/gateway/blob/main/GOVERNANCE.md> |
+| envoy-gateway-maintainers |  | <https://github.com/envoyproxy/gateway/blob/main/CODEOWNERS> |
+
+## Source Code
+
+* <https://github.com/envoyproxy/gateway>
+
+## Usage
+
+[Helm](https://helm.sh) must be installed to use the charts.
+Please refer to Helm's [documentation](https://helm.sh/docs) to get started.
+
+### Install from DockerHub
+
+Once Helm has been set up correctly, install the chart from dockerhub:
+
+``` shell
+    helm install eg oci://docker.io/envoyproxy/gateway-helm --version v0.0.0-latest -n envoy-gateway-system --create-namespace
+```
+You can find all helm chart release in [Dockerhub](https://hub.docker.com/r/envoyproxy/gateway-helm/tags)
+
+### Install from Source Code
+
+You can also install the helm chart from the source code:
+
+To install the eg chart along with Gateway API CRDs and Envoy Gateway CRDs:
+
+``` shell
+    make kube-deploy TAG=latest
+```
+
+### Skip install CRDs
+
+You can install the eg chart along without Gateway API CRDs and Envoy Gateway CRDs, make sure CRDs exist in Cluster first if you want to skip to install them, otherwise EG may fail to start:
+
+``` shell
+    helm install eg --create-namespace oci://docker.io/envoyproxy/gateway-helm --version v0.0.0-latest -n envoy-gateway-system --skip-crds
+```
+
+To uninstall the chart:
+
+``` shell
+    helm uninstall eg -n envoy-gateway-system
+```
+
+## Values
+
+| Key | Type | Default | Description |
+|-----|------|---------|-------------|
+| certgen | object | `{"job":{"annotations":{},"resources":{},"ttlSecondsAfterFinished":30},"rbac":{"annotations":{},"labels":{}}}` | Certgen is used to generate the certificates required by EnvoyGateway. If you want to construct a custom certificate, you can generate a custom certificate through Cert-Manager before installing EnvoyGateway. Certgen will not overwrite the custom certificate. Please do not manually modify `values.yaml` to disable certgen, it may cause EnvoyGateway OIDC,OAuth2,etc. to not work as expected. |
+| config.envoyGateway.gateway.controllerName | string | `"gateway.envoyproxy.io/gatewayclass-controller"` |  |
+| config.envoyGateway.logging.level.default | string | `"info"` |  |
+| config.envoyGateway.provider.type | string | `"Kubernetes"` |  |
+| createNamespace | bool | `false` |  |
+| deployment.envoyGateway.image.repository | string | `""` |  |
+| deployment.envoyGateway.image.tag | string | `""` |  |
+| deployment.envoyGateway.imagePullPolicy | string | `""` |  |
+| deployment.envoyGateway.imagePullSecrets | list | `[]` |  |
+| deployment.envoyGateway.resources.limits.cpu | string | `"500m"` |  |
+| deployment.envoyGateway.resources.limits.memory | string | `"1024Mi"` |  |
+| deployment.envoyGateway.resources.requests.cpu | string | `"100m"` |  |
+| deployment.envoyGateway.resources.requests.memory | string | `"256Mi"` |  |
+| deployment.pod.affinity | object | `{}` |  |
+| deployment.pod.annotations."prometheus.io/port" | string | `"19001"` |  |
+| deployment.pod.annotations."prometheus.io/scrape" | string | `"true"` |  |
+| deployment.pod.labels | object | `{}` |  |
+| deployment.pod.tolerations | list | `[]` |  |
+| deployment.pod.topologySpreadConstraints | list | `[]` |  |
+| deployment.ports[0].name | string | `"grpc"` |  |
+| deployment.ports[0].port | int | `18000` |  |
+| deployment.ports[0].targetPort | int | `18000` |  |
+| deployment.ports[1].name | string | `"ratelimit"` |  |
+| deployment.ports[1].port | int | `18001` |  |
+| deployment.ports[1].targetPort | int | `18001` |  |
+| deployment.ports[2].name | string | `"wasm"` |  |
+| deployment.ports[2].port | int | `18002` |  |
+| deployment.ports[2].targetPort | int | `18002` |  |
+| deployment.ports[3].name | string | `"metrics"` |  |
+| deployment.ports[3].port | int | `19001` |  |
+| deployment.ports[3].targetPort | int | `19001` |  |
+| deployment.replicas | int | `1` |  |
+| global.images.envoyGateway.image | string | `nil` |  |
+| global.images.envoyGateway.pullPolicy | string | `nil` |  |
+| global.images.envoyGateway.pullSecrets | list | `[]` |  |
+| global.images.ratelimit.image | string | `"docker.io/envoyproxy/ratelimit:master"` |  |
+| global.images.ratelimit.pullPolicy | string | `"IfNotPresent"` |  |
+| global.images.ratelimit.pullSecrets | list | `[]` |  |
+| kubernetesClusterDomain | string | `"cluster.local"` |  |
+| podDisruptionBudget.minAvailable | int | `0` |  |
+