#219 Create virtualization installation validation test cases
Closed: Fixed Opened by adamwill.

As per the Beta criteria survey in https://fedorahosted.org/fedora-qa/ticket/151 , there are no test cases to enforce the Beta release criteria:

"The release must boot successfully as a virtual guest in a situation where the virtual host is running the same release (using Fedora's current preferred virtualization technology)"

"The release must boot successfully as a virtual guest in a situation where the virtual host is running the previous stable Fedora release (using Fedora's current preferred virtualization technology)"

"The release must boot successfully as a virtual guest in a situation where the virtual host is running a supported Xen implementation"

We should create test cases to explicitly cover these criteria, especially the Xen one, which we do not usually test at present (the other two usually get covered in practice, although we don't have explicit test cases for them).


Actually there's a [https://fedoraproject.org/wiki/QA/TestCases/BootMethodsKVM kvm install test] in the install matrix, which just doesn't specify the release version for the host. So I created two tests(current release host and previous release host) based on the existing case:

  • https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_Current_KVM
  • https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_Previous_KVM

For xen, there's a existing test:

  • https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_Xen_Para_Virt

Will update it to satisfy the criterion.

I don't see the Xen test anywhere in the template; it probably needs adding to the template too?

Replying to [comment:3 adamwill]:

I don't see the Xen test anywhere in the template; it probably needs adding to the template too?

Right, the test is existing, but not in the matrix yet. :)

I redesigned the virtual guest tests and now it covers the whole installation instead of just boot methods:

  • https://fedoraproject.org/wiki/QA:Testcase_Install_to_Current_KVM
  • https://fedoraproject.org/wiki/QA:Testcase_Install_to_Previous_KVM

For xen, since Fedora doesn't support it for several releases, I haven't figured out a convenient and official way to set up the environment. Anyone knows about it, feel free to modify the case:

  • https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_Xen_Para_Virt

the KVM tests are now covered, and we have a separate ticket - https://fedorahosted.org/fedora-qa/ticket/263 - for improving the Xen test case set. So let's close this.

Metadata Update from @adamwill:
- Issue untagged with: test review
- Issue tagged with: test cases

This issue has been migrated to Fedora Forge:
https://forge.fedoraproject.org/quality/tickets/issues/219

Please continue any further discussion there.

Metadata