Skip to content

Releases: cnti-testcatalog/testsuite

master-2021-01-27-212917-b0c2e49 January 27, 2021

27 Jan 21:29
b0c2e49
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #582 - [Feature] Add the date or a date+time to the dev snapshots tag for auto sorting on GitHub release page #530
  • #530 - [Feature] Add the date or a date+time to the dev snapshots tag for auto sorting on GitHub release page
  • #557 - Config map immutability checker
  • #508 - Configuration and Lifecycle test: Is K8s ConfigMap immutable?
  • #575 - Update SOURCE_INSTALL.md

Artifact info:

  • Commit: master-2021-01-27-212917-b0c2e49
  • SHA256SUM: 3e40c65d923bbe01bcd249e2915592574df5ed6823f9cd44bcae75ee9ef83811 cnf-conformance-master-2021-01-27-212917-b0c2e49.tar.gz

v0.10.0 January 20, 2021

20 Jan 22:29
1e8a968
Compare
Choose a tag to compare

Changes since v0.9.19

📦 Workload Tests

  • [Resilience test] Is CNF healthy after pod-network-latency Litmus Chaos test? #520

✨ Enhancements

  • [Enhancement] Replace hardcoded emojis with variables #336
  • [Enhancement] Add support for testing multiple deployments found in a helm chart or K8s manifest #494
  • [Enhancement] Use a generated release name for helm #503
  • [Enhancement] Show only the issues addressed since the last development snapshots (master-GITCOMMIT) for new dev snapshots #527
  • [Enhancement] Use markdown bullets and remove unnecessary pre text from dev snapshot UPDATEs section #528
  • [Enhancement] Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset #531
  • [Enhancement] Add existing destructive flag to the reasonable_startup_time and helm_deploy tests #562

💡 Proof of Concepts

  • [Proof of Concept] Add support for testing the 1st level of dependent Helm charts #536

🐛 Bug Fixes

  • [BUG] Rolling update test should derive image from k8s api #489
  • [BUG] helm chart in coredns example not working in latest release #491
  • [BUG] Make helm_chart, helm_directory & manifest_directory mutually exclusive flags #547
  • [BUG] Unable to set-up example CNFs using release 0.9.19 #571
  • [BUG] After running cnf_setup, cnf-conformance errors "you must provide cnf-config or cnf-path" when running tests after the setup #572

📖 Documentation

  • [Documentation] Update INSTALL.md to remove redundancy and make a clearer set of high-level steps and create README-CNF_Setup.md #526
  • [Documentation] Updates to CNF_CONFORMANCE_YML_USAGE.md document #537
  • [Documentation] Update README-testsuite.md #542
  • [Documentation] Check errors in README.md #550

Artifact info:

  • Commit: v0.10.0
  • SHA256SUM: fe90f6c189c85531ae9dc3be76b5995b45af6d48ee5d33353b6e49f6d8646647 cnf-conformance-v0.10.0.tar.gz

master-1e8a968 January 20, 2021

20 Jan 20:57
1e8a968
Compare
Choose a tag to compare
Pre-release

UPDATES

Issues addressed in this release:

  • #573 - [BUG] After running cnf_setup, cnf-conformance errors "you must provide cnf-config or cnf-path" when running tests after the setup. #572
  • #572 - [BUG] After running cnf_setup, cnf-conformance errors "you must provide cnf-config or cnf-path" when running tests after the setup.
  • #569 - [Feature] cnf installation refactor

Artifact info:

  • Commit: master-1e8a968
  • SHA256SUM: f4781f8ddf175724fae9e76656414d2a5625e932960a23114c1f093f24c3499c cnf-conformance-master-1e8a968.tar.gz

master-d9f4fc9 January 15, 2021

15 Jan 23:13
d9f4fc9
Compare
Choose a tag to compare
Pre-release

UPDATES

Issues addressed in this release:

  • #570 - cnf installation refactor #569
  • #569 - [Feature] cnf installation refactor

Artifact info:

  • Commit: master-d9f4fc9
  • SHA256SUM: edd383f7ab1fb650be4d1c946eee2dbea28f0d70177756e12fdf39ccfd1e2b19 cnf-conformance-master-d9f4fc9.tar.gz

master-ac2a398 January 14, 2021

14 Jan 20:19
ac2a398
Compare
Choose a tag to compare
Pre-release

UPDATES

Issues addressed in this release:

  • #568 - [Enhancement] Add existing destructive flag to the reasonable_startup_time and helm_deploy tests #562
  • #562 - [Enhancement] Add existing destructive flag to the reasonable_startup_time and helm_deploy tests

Artifact info:

  • Commit: master-ac2a398
  • SHA256SUM: 55bd9136cb59008eb57c621f602cd1a779e48881c82f52f83d4ac10eb99f30a9 cnf-conformance-master-ac2a398.tar.gz

master-ae14e4b January 13, 2021

13 Jan 22:38
Compare
Choose a tag to compare
Pre-release

UPDATES

Issues addressed in this release:

  • #527 - [Enhancement] Show only the issues addressed since the last development snapshots (master-GITCOMMIT) for new dev snapshots
  • #559 - #336 moved emoji to variables
  • #336 - [Feature] Replace hardcoded emojis with variables
  • #567 - 'master' triggers a snapshot cncf/cnf-conformance#527
  • #566 - Only publish release on 'master'
  • #338 - move some emoji to variables

Artifact info:

  • Commit: master-ae14e4b
  • SHA256SUM: 8929b2e3b5416c528b07058e79635e5a733fe4d8c845c1c5d7352c45085ca451 cnf-conformance-master-ae14e4b.tar.gz

master-b4502fa January 12, 2021

12 Jan 21:32
b4502fa
Compare
Choose a tag to compare
Pre-release

UPDATES

Issues addressed in this release:

  • #560 - #336 moved emoji to variable
  • #336 - [Feature] Replace hardcoded emojis with variables
  • #558 - #528 Update release_manager.cr
  • #528 - [Enhancement] Use markdown bullets and remove unnecessary pre text from dev snapshot UPDATEs section to
  • #561 - #547 instability and configuration lifecycle now use generic config
  • #547 - [BUG] Make helm_chart, helm_directory & manifest_directory mutually exclusive flags
  • #556 - Link to releases/latest for binary download
  • #549 - Doc/cnf conformance yml usage #537
  • #537 - [Documentation] Updates to CNF_CONFORMANCE_YML_USAGE.md document.
  • #551 - #550 checked README.md
  • #550 - [Documentation] Check errors in README.md
  • #553 - [Proof of Concept] Add support for testing the 1st level of dependent Helm charts #536
  • #536 - [Proof of Concept] Add support for testing the 1st level of dependent Helm charts
  • #548 - [Feature] Use a generated release name for helm #503
  • #503 - [Feature] Use a generated release name for helm
  • #531 - [Feature] Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset
  • #542 - Update README-testsuite.md
  • #540 - Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset #531
  • #539 - Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset #531
  • #502 - Feat(resiliency): Add litmus pod network latency test
  • #523 - Updated test-cat and usage to include rollback (rolling_downgrade)
  • #82 - Installable test: Can the CNF perform a rolling downgrade of the CNF version?
  • #534 - Refactoring Install Docs into Source separate from Binary
  • #526 - [Documentation] Update INSTALL.md to remove redundancy and make a clearer set of high-level steps and create README-CNF_Setup.md
  • #535 - Feature/#494 helm namespacing
  • #494 - [Feature] Add support for testing multiple deployments found in a helm chart or K8s manifest
  • #525 - [Feature] Add support for testing multiple deployments found in a helm chart or K8s manifest #494
  • #532 - if git tag is empty, use empty string
  • #485 - [Feature] Add support for testing multiple containers within a deployment

Artifact info:

  • Commit: master-b4502fa
  • SHA256SUM: 2091f44c1039a724398f23d46ef58887a5ad2afce830df59497bacdd6e7e0ad4 cnf-conformance-master-b4502fa.tar.gz

master-a443919 January 12, 2021

12 Jan 22:55
a443919
Compare
Choose a tag to compare
Pre-release

UPDATES

Issues addressed in this release:

Artifact info:

  • Commit: master-a443919
  • SHA256SUM: 9405ff46fc3585728f8586ed03a065cff5d40c411376a01dd54d65393c6cd98a cnf-conformance-master-a443919.tar.gz

master-d379cba January 11, 2021

11 Jan 23:04
b380fa4
Compare
Choose a tag to compare
Pre-release

UPDATES

Issues addressed in this release:

  • #558 - #528 Update release_manager.cr
  • #528 - [Enhancement] Use markdown bullets and remove unnecessary pre text from dev snapshot UPDATEs section to
  • #561 - #547 instability and configuration lifecycle now use generic config
  • #547 - [BUG] Make helm_chart, helm_directory & manifest_directory mutually exclusive flags
  • #556 - Link to releases/latest for binary download
  • #549 - Doc/cnf conformance yml usage #537
  • #537 - [Documentation] Updates to CNF_CONFORMANCE_YML_USAGE.md document.
  • #551 - #550 checked README.md
  • #550 - [Documentation] Check errors in README.md
  • #553 - [Proof of Concept] Add support for testing the 1st level of dependent Helm charts #536
  • #536 - [Proof of Concept] Add support for testing the 1st level of dependent Helm charts
  • #548 - [Feature] Use a generated release name for helm #503
  • #503 - [Feature] Use a generated release name for helm
  • #531 - [Feature] Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset
  • #542 - Update README-testsuite.md
  • #540 - Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset #531
  • #539 - Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset #531
  • #502 - Feat(resiliency): Add litmus pod network latency test
  • #523 - Updated test-cat and usage to include rollback (rolling_downgrade)
  • #82 - Installable test: Can the CNF perform a rolling downgrade of the CNF version?
  • #534 - Refactoring Install Docs into Source separate from Binary
  • #526 - [Documentation] Update INSTALL.md to remove redundancy and make a clearer set of high-level steps and create README-CNF_Setup.md
  • #535 - Feature/#494 helm namespacing
  • #494 - [Feature] Add support for testing multiple deployments found in a helm chart or K8s manifest
  • #525 - [Feature] Add support for testing multiple deployments found in a helm chart or K8s manifest #494
  • #532 - if git tag is empty, use empty string
  • #485 - [Feature] Add support for testing multiple containers within a deployment

Artifact info:

  • Commit: master-d379cba
  • SHA256SUM: 48f1a129f0bbde860870aa7663df463b9cb20d3c17db6b253a2ca394ed850233 cnf-conformance-master-d379cba.tar.gz

master-b380fa4 January 11, 2021

11 Jan 23:10
b380fa4
Compare
Choose a tag to compare
Pre-release

UPDATES

Issues addressed in this release:

  • #558 - #528 Update release_manager.cr
  • #528 - [Enhancement] Use markdown bullets and remove unnecessary pre text from dev snapshot UPDATEs section to
  • #561 - #547 instability and configuration lifecycle now use generic config
  • #547 - [BUG] Make helm_chart, helm_directory & manifest_directory mutually exclusive flags
  • #556 - Link to releases/latest for binary download
  • #549 - Doc/cnf conformance yml usage #537
  • #537 - [Documentation] Updates to CNF_CONFORMANCE_YML_USAGE.md document.
  • #551 - #550 checked README.md
  • #550 - [Documentation] Check errors in README.md
  • #553 - [Proof of Concept] Add support for testing the 1st level of dependent Helm charts #536
  • #536 - [Proof of Concept] Add support for testing the 1st level of dependent Helm charts
  • #548 - [Feature] Use a generated release name for helm #503
  • #503 - [Feature] Use a generated release name for helm
  • #531 - [Feature] Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset
  • #542 - Update README-testsuite.md
  • #540 - Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset #531
  • #539 - Add support for additional K8s workload resource kinds: Pod, ReplicaSet, StatefulSet, Daemonset #531
  • #502 - Feat(resiliency): Add litmus pod network latency test
  • #523 - Updated test-cat and usage to include rollback (rolling_downgrade)
  • #82 - Installable test: Can the CNF perform a rolling downgrade of the CNF version?
  • #534 - Refactoring Install Docs into Source separate from Binary
  • #526 - [Documentation] Update INSTALL.md to remove redundancy and make a clearer set of high-level steps and create README-CNF_Setup.md
  • #535 - Feature/#494 helm namespacing
  • #494 - [Feature] Add support for testing multiple deployments found in a helm chart or K8s manifest
  • #525 - [Feature] Add support for testing multiple deployments found in a helm chart or K8s manifest #494
  • #532 - if git tag is empty, use empty string
  • #485 - [Feature] Add support for testing multiple containers within a deployment

Artifact info:

  • Commit: master-b380fa4
  • SHA256SUM: f1111f566ac13d708954c27f0557bbeed5684ba7e618a4f0eaac5b21ae36e77a cnf-conformance-master-b380fa4.tar.gz