Skip to content

Releases: cnti-testcatalog/testsuite

v1.3.3

16 Sep 17:00
c0f461e
Compare
Choose a tag to compare

Release Notes for v1.3.3 (Monday, September 16, 2024)

Changes since v1.3.2 (August 19, 2024)

🙌 Kudos

We appreciate everyone who helped with Release v1.3.3! 🎉

Special thanks to contributors committed to this release:

@kosstennbl
@barmull
@martin-mat

Please submit a PR to add your name to the CONTRIBUTORS.md.

🐛 Bug Fixes

  • #2139 - Make helm install failure fatal
  • #2127 - Fix deprecated references to Helm library

🔧 Maintenance

  • #2140 - Bump cluster-tools to v1.0.7 with optimized cluster-tools docker image size

Artifact info:

  • Commit: v1.3.3
  • SHA256SUM: f92910f2800f2a109091af23ddacd0b649cf0212fe54ab99d76c31c5a059188a cnf-testsuite-v1.3.3.tar.gz

Full Changelog: v1.3.2...v1.3.3

v1.3.2 August 19, 2024

19 Aug 07:14
11aeb49
Compare
Choose a tag to compare

Release Notes for v1.3.2 (Monday, August 19, 2024)

Changes since v1.3.1 (July 18, 2024)

🙌 Kudos

We appreciate everyone who helped with Release v1.3.2! 🎉

Special thanks to contributors committed to this release:

@kosstennbl
@svteb
@martin-mat
@barmull
@horecoli

Please submit a PR to add your name to the CONTRIBUTORS.md.

✨ Enhancements

  • #2114 #1937 #2083 - Exit on cnf_setup failure or timeout
  • #2110 #2084 - Optimize single_process_type execution time
  • #2056 - Make helm_install_namespace default value "cnf-default"

🐛 Bug Fixes

  • #2122 - Change installation method of Envoy to Helm directory

🔧 Maintenance

  • #2126 #2117 - Remove cert tag from non-essential tests
  • #2119 #2115 - Removal and exchange duplicate test for privileged containers
  • #2113 - Cancel Github workflows on push
  • #1928 #1906 - Removal of allowlist from priviledged tests
  • #2111 #2105 - Move manifest install to testsuite repo
  • #2109 #2104 - Remove airgap mode

📖 Documentation

  • #2132 - Update links to the cnti slack channel

Artifact info:

  • Commit: v1.3.2
  • SHA256SUM: aea826aaf56ccd0ba92292264a772bbab7b13aaaf9829c055d48f1afc083d8bb cnf-testsuite-v1.3.2.tar.gz

Full Changelog: v1.3.1...v1.3.2

v1.3.1 July 16, 2024

18 Jul 14:25
7f8c910
Compare
Choose a tag to compare

Release Notes for v1.3.1 (Thursday, July 18, 2024)

Changes since v1.3.0 (June 27, 2024)

🙌 Kudos

We appreciate everyone who helped with Release v1.3.1! 🎉

Special thanks to contributors:

@kosstennbl
@svteb
@martin-mat

Please submit a PR to add your name to the CONTRIBUTORS.md.

✨ Enhancements

  • #2096 #2093 - Hardcoded-ip-test: Redesign test, add more info on fail
  • #2102 #2098 - Add possibility to change node drain duration to prevent the test from failing due to timeout

🐛 Bug Fixes

  • #2052 #1947 - Export_published_chart correctly detects and exports tar file

🔧 Maintenance

  • #2055 #1926 - Cluster setup exception message shortened
  • #2097 #2072 #2087 - Rework k8s_tshark functionality to make 5G tests stable

📖 Documentation

  • #2089 - Add linter for the documentation
  • #2082 #2077 - Relocate alpha_k8s_apis to configuration sections across docs

Artifact info:

  • Commit: v1.3.1
  • SHA256SUM: 3934bc00a48f124831bf91cc277def0d18b2077b89422a0e5a4e4238aaf75fa3 cnf-testsuite-v1.3.1.tar.gz

Full Changelog: v1.3.0...v1.3.1

v1.3.0 June 27, 2024

27 Jun 11:10
9497fd6
Compare
Choose a tag to compare

Release Notes for v1.3.0 (Thursday, June 27, 2024)

Changes since v1.2.0 (May 9, 2024)

🙌 Kudos

We appreciate everyone who helped with Release v1.3.0! 🎉

Special thanks to contributors:

@denverwilliams
@horecoli
@kosstennbl
@taylor
@svteb
@lixuna
@martin-mat
@barmull
@collivier

Please submit a PR to add your name to the CONTRIBUTORS.md.

✨ Enhancements

  • #1995 #1964 - add checks for KUBECONFIG and cluster health
  • #2045 - add ERROR result state for tests when an unexpected error occurs
  • #2008 #2000 - Add possibility to direct logs into a file

🐛 Bug Fixes

  • #2086 - Bump k8s_netstat to fix database timeouts
  • #2078 - shared_database2 spec test has inconsistent results in actions
  • #2062 #2085 - Label filtering on StatefulSets is bringing additional pods into the test
  • #2034 #2025 - Routed logs test now correctly checks if CNF is being tailed
  • #2016 - Outdated helm repo path in fluentd bitnami install
  • #2048 #2051 - Test exclusion during certification no longer working (note a changed CLI format for this)
  • #2054 #2038 - Add exclusion of init system from single process check
  • #2030 #2040 - The single process type check is skipped if CNF is deployed in a non-default namespace
  • #2015 - cni_compatible test failing due to outdated Cilium
  • #2033 #2022 #2024 - Node drain test not starting due to unable to get chaos resources
  • #2019 #2020 - Fix bug with Litmus Pod Mem Test

🔧 Maintenance

  • #2028 #2027- remove duplicate test "volume_hostpath_not_found"
  • #2066 #2080 - Enable github actions to be (successfully) run for PRs created from forked repos
  • #2079 - Update registry mirror to UNH infrastructure
  • #2013 - Move off CNCF Equinix Resources
  • #2023 #335 - Redesign and unify timeouts
  • #2067 #2064 - Don't fail on delete cluster in github actions
  • #2037 #2044 - Cilium version update
  • #2018 #2017 - Add removal of pvc in the end of spec test

📖 Documentation

  • #1955 - Unification of documentation
  • #2069 - Remove deprecated capacity tests in docs
  • #2057 #2058 #2043 - Rename MAINTAINERS.md to CONTRIBUTORS.md, updates of CONTRIBUTION_LADDER.md and README.md

Artifact info:

  • Commit: v1.3.0
  • SHA256SUM: 86f42d796d650cc416d7d32d73d692c680ffa086ab15ec2d3863b0e804032168 cnf-testsuite-v1.3.0.tar.gz

Full Changelog: v1.2.0...v1.3.0

main-2024-05-21-003415-b33fa3b0 May 21, 2024

21 May 00:34
b38a005
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #2044 - PR test of #2037 cilium update
  • #2037 - Update: Cilium version update
  • #2015 - [BUG] cni_compatible test failing due to outdated Cilium

Artifact info:

  • Commit: main-2024-05-21-003415-b33fa3b0
  • SHA256SUM: 7dd8911758220967d935157f6dc9e2493390a99fcefd4cc6b8344da84957d6df cnf-testsuite-main-2024-05-21-003415-b33fa3b0.tar.gz

main-2024-05-20-171857-56256e7c May 20, 2024

20 May 17:19
38180f2
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

Artifact info:

  • Commit: main-2024-05-20-171857-56256e7c
  • SHA256SUM: 0f03394de5534f5c2aec3df59581e898424afbf21331c849eb4ab9e67a90d88a cnf-testsuite-main-2024-05-20-171857-56256e7c.tar.gz

main-2024-05-20-171209-595065ac May 20, 2024

20 May 17:12
38180f2
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

Artifact info:

  • Commit: main-2024-05-20-171209-595065ac
  • SHA256SUM: 082702df17a59d4092755e86305ea26937cf3c1e4a48c5d0c5366fcd6cd0a87f cnf-testsuite-main-2024-05-20-171209-595065ac.tar.gz

main-2024-05-20-164221-1464801e May 20, 2024

20 May 16:42
38180f2
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

Artifact info:

  • Commit: main-2024-05-20-164221-1464801e
  • SHA256SUM: f3f37fce502ec179c642b66d7e030e36c0c139e4d4015fcbf4d463fef1c2803d cnf-testsuite-main-2024-05-20-164221-1464801e.tar.gz

main-2024-05-20-162322-e5c795cc May 20, 2024

20 May 16:23
38180f2
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #2019 - [BUG] spec test for pod_memory_hog failing
  • #2020 - Fix bug with Litmus Pod Mem Test #2019

Artifact info:

  • Commit: main-2024-05-20-162322-e5c795cc
  • SHA256SUM: 66ca6656f1b0da73282efd58af08c2cb5cbd60ec0f859349702d51781d894090 cnf-testsuite-main-2024-05-20-162322-e5c795cc.tar.gz

v1.2.0 May 09, 2024

09 May 22:41
47958a0
Compare
Choose a tag to compare

Release Notes for v1.2.0 (Thursday, May 9, 2024)

Changes since v1.1.0 (April 17, 2024)

🙌 Kudos

We appreciate everyone who helped with Release v1.2.0! 🎉

Special thanks to contributors:

Please submit a PR to add your name to the MAINTAINERS.md.

✨ Enhancements

  • #1949 - Remove all hardcoded EOL K8s version
  • #1954 - Spec: removed backticks execution method and use new logging
  • #1997, #2012 - Added option to run Cert command for only Essential Tests,
  • #1962 - Enhancement: Add test name before and after the test in console output
  • #1958 - Add test case identifiers for tests being executed to console output and more informative console output
  • #1984 - Remove -ti in docker and kubectl calls
  • #1988 - Check if cluster-tools are installed untill timeout
  • #1953 - Set helm_install_namespace in all example cnf-testsuite.yml

🐛 Bug Fixes

  • #2011 - Fix human readable task_runtime for time display on console
  • #1495 - [BUG] Remove Log.info wrappers when running shell commands in spec tests
  • #1948 - [BUG] Update all Kubernetes version in Gates (stop pinning v1.23 EOL)
  • #1909 - [BUG] Spec tests are unable to find local Helm installation.
  • #1978 - Minor change to fix immutable configmaps typo
  • #1972 - Prevent microservice tests from passing on errors
  • #1959 - Fixed false-postive (PASSED) result of specialized_init_system on nginx (sample-cnfs/sample-ndn-privileged)
  • #1952 - [BUG] coredns should pass default_namespace
  • #1973, #1987 - Fixed pod_memory_hog spec which was failing in github actions after PR merge to main
  • #1977 - [BUG] pod_dns_error is always SKIPPED when "containerd" runtime is used
  • #1974 - [BUG] pod_delete test outputs API text during cert run

🔧 Maintenance

  • #1998 - #1948 Kind version upgrade
  • #1965, #2006 - cni_compatible installs obsolete cluster (v1.21 and no cgroup v2 support). remove cni_compatible from cert tests
  • #2004 - (#1993, #1999, #2003) Upgrade Kubescape to v3.0.8 and fix affected tests
  • #1986, #1969 - Change location of increase_decrease_capacity task

📖 Documentation

N/A


Artifact info:

  • Commit: v1.2.0
  • SHA256SUM: fdf76c6b7c38fb15d5b0f8fbb9140475f732ea09a0858c9cbb3b5bf2ac91898e cnf-testsuite-v1.2.0.tar.gz