cleanup some smoke tests

[DaanHoogland]

Description

This PR splits the test_vm_life_cycle.py test file and cleans some of the conditional test skipping. This all in an attempt to reduce intermittent integration test failures.

The reason is that a lot of tests are not basic life cycle tests and differnt failures on different platform are mostly pre-conditional instead of genuine positives.

During this work I also noticed that we might gain by eliminating tests as it seems a lot of the same functionalities are tested at different locations. I will not investigate that further or address it in this PR.

I will look at other intermittent failures as well and try to address those as well. This may happen in this PR or in separate PRs.

Types of changes

• Breaking change (fix or feature that would cause existing functionality to change)
• New feature (non-breaking change which adds functionality)
• Bug fix (non-breaking change which fixes an issue)
• Enhancement (improves an existing feature and functionality)
• Cleanup (Code refactoring and cleanup, that may add test cases)
• build/CI

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

• Major
• Minor

Bug Severity

• BLOCKER
• Critical
• Major
• Minor
• Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (08749d8) 13.12% compared to head (251a913) 13.13%.

Additional details and impacted files

@@            Coverage Diff            @@
##               4.18    #8196   +/-   ##
=========================================
  Coverage     13.12%   13.13%           
- Complexity     9141     9142    +1     
=========================================
  Files          2720     2720           
  Lines        257726   257726           
  Branches      40177    40177           
=========================================
+ Hits          33838    33847    +9     
+ Misses       219598   219588   -10     
- Partials       4290     4291    +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 15.81%. Comparing base (a303c7c) to head (29cc73f).

Additional details and impacted files

@@            Coverage Diff             @@
##               main    #8196    +/-   ##
==========================================
  Coverage     15.81%   15.81%            
  Complexity    12553    12553            
==========================================
  Files          5629     5629            
  Lines        492044   492044            
  Branches      63478    63932   +454     
==========================================
  Hits          77822    77822            
  Misses       405901   405901            
  Partials       8321     8321            

Flag	Coverage Δ
uitests	4.48% <ø> (ø)
unittests	16.60% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[blueorangutan]

Packaging result [SF]: ✔️ el7 ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 9791

[DaanHoogland]

@blueorangutan test

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-10373)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 46547 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr8196-t10373-kvm-centos7.zip
Smoke tests completed. 110 look OK, 5 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_add_primary_storage_disabled_host	Error	0.20	test_primary_storage.py
test_03_migration_options_storage_tags	Error	0.02	test_primary_storage.py
ContextSuite context=TestCpuCapServiceOfferings>:setup	Error	0.00	test_service_offerings.py
test_02_list_snapshots_with_removed_data_store	Error	9.49	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	9.49	test_snapshots.py
test_01_deploy_vm_on_specific_host	Error	0.08	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	0.10	test_vm_deployment_planner.py
test_08_migrate_vm	Error	0.06	test_vm_life_cycle.py

[DaanHoogland]

will split this in smaller chunks at some point

[github-actions]

This pull request has merge conflicts. Dear author, please fix the conflicts and sync your branch with the base branch.

[github-actions]

This pull request has merge conflicts. Dear author, please fix the conflicts and sync your branch with the base branch.

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 10779

[DaanHoogland]

@blueorangutan test

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-11173)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 52255 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr8196-t11173-kvm-ol8.zip
Smoke tests completed. 137 look OK, 7 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_add_primary_storage_disabled_host	Error	0.23	test_primary_storage.py
test_03_migration_options_storage_tags	Error	0.02	test_primary_storage.py
test_01_secure_vm_migration	Error	191.29	test_secured_vm_migration.py
test_02_unsecure_vm_migration	Error	450.63	test_secured_vm_migration.py
test_04_nonsecured_to_secured_vm_migration	Error	378.93	test_secured_vm_migration.py
ContextSuite context=TestCpuCapServiceOfferings>:setup	Error	0.00	test_service_offerings.py
test_02_list_snapshots_with_removed_data_store	Error	10.64	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	10.64	test_snapshots.py
test_01_deploy_vm_on_specific_host	Error	0.10	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	0.15	test_vm_deployment_planner.py
test_08_migrate_vm	Error	0.07	test_vm_life_cycle.py
test_13_destroy_and_expunge_vm	Error	0.03	test_vm_life_cycle.py
test_01_migrate_vm_strict_tags_success	Error	0.30	test_vm_strict_host_tags.py
test_02_migrate_vm_strict_tags_failure	Error	0.30	test_vm_strict_host_tags.py
test_01_restore_vm_strict_tags_success	Error	0.30	test_vm_strict_host_tags.py
test_02_restore_vm_strict_tags_failure	Error	0.30	test_vm_strict_host_tags.py
test_01_scale_vm_strict_tags_success	Error	0.29	test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure	Error	0.31	test_vm_strict_host_tags.py
test_01_deploy_vm_on_specific_host_without_strict_tags	Error	0.27	test_vm_strict_host_tags.py
test_02_deploy_vm_on_any_host_without_strict_tags	Error	5.72	test_vm_strict_host_tags.py
test_03_deploy_vm_on_specific_host_with_strict_tags_success	Error	0.24	test_vm_strict_host_tags.py
test_04_deploy_vm_on_any_host_with_strict_tags_success	Error	5.70	test_vm_strict_host_tags.py
test_05_deploy_vm_on_specific_host_with_strict_tags_failure	Failure	0.28	test_vm_strict_host_tags.py

[github-actions]

This pull request has merge conflicts. Dear author, please fix the conflicts and sync your branch with the base branch.

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✖️ el9 ✔️ debian ✖️ suse15. SL-JID 11160