#8202 Azure: add support for multi-container tests
Closed: fixed by abbra. Opened by slev.

Current Azure Pipelines problems:
1) only Fedora Docker image is supported to build packages(rpm) and run tests.
It's maybe extremely useful to allow any distro to run IPA tests on their images or even setup cross-distro (compatibility) environments. It also allows upstream to see CI results not only for current Fedora but for all officially supported (in any degree) platforms (for example, Ubuntu or CentOS).

2) only base and xmlrpc IPA tests are supported.
Sure, base and xmlrpc tests are important, but Integration tests are no less important.
The integration test relies on SSH transport, which is not configured in Docker environment by default.

3) only one IPA environment within VM is supported.
The max capacity of parallel jobs(10) will throttle Gating/Nightly tests since Gating have 20 tests and Nightly 116.


master:

  • ecc398c409e41ff4d1014e6e88bb5c82d6c19f75 Azure: Allow to not provide tests to be ignored
  • 157fa59e7ce29ea3d7f254a102f7af1bfd77e237 Azure: Allow SSH for Docker environments
  • 879855ce705770834d0be8182818ae672bc72063 Azure: Allow to run integration tests
  • b82515562a9b33c2e0fe345a0cc0bdd8c3cc1688 Azure: Make it possible to configure distro-specific stuff
  • fa104daf77902172f087c7026052fd9a59b4861a yamllint: Lint all the YAML files
  • d3f1b9b43d55aafb59945ff9635abb4786e0b51a Azure: Don't collect twice systemd_journal.log
  • 31d05650fbd784cf87e9dd325d2220c69d6f43ef Azure: Add support for testing multi IPA environments
  • e280a2f06ae1e7e78bc86122fbb6d6ceded9e34c pylint: Run Pylint over Azure Python scripts
  • 6daf4d2e10007b5c22a9e491e5372d25fd74fc88 Azure: Sync Gating definitions to current PR-CI
  • 1fa033c32d4c94ea9456a2a728893e206957930e Azure: Preliminary check for provided limits
  • e925148ad9d5d8e36a61c68d0d247283c109a37e Azure: Free Docker resources after usage
  • 9203404cd5d9864bfcf6e5b1f4ae2c054464e757 Azure: Skip tests requiring external DNS
  • 38e0a9f4c0bd38c204be5dde2d689308d9e153d6 Azure: Rebalance tests
  • 0a1e98cdf055867d8a02ed6a8eb65eabe2442a67 Azure: Report elapsed time

ipa-4-8:

  • 11d145300dcd1b9b986f259efa57eddcca9b2e32 Azure: Allow to not provide tests to be ignored
  • 6a6e3f2339c5773f051aaea08922f6853ef5942d Azure: Allow SSH for Docker environments
  • d33b7d61fc8e012ecfd0354a6d3431301a66d768 Azure: Allow to run integration tests
  • 198cd506592c8dc078e7956a42d0d4e0342cf86d Azure: Make it possible to configure distro-specific stuff
  • 2988f5f30c9379f8ac7cbfc56af382f2779479cf yamllint: Lint all the YAML files
  • 685d902ca4cf10c8c440036016c2dd3e05d76222 Azure: Don't collect twice systemd_journal.log
  • 245a9dc93f086b685b09984ea4a3395b93fd5789 Azure: Add support for testing multi IPA environments
  • 3fff86757cfc7a78db33801e3c75e208b01660f7 pylint: Run Pylint over Azure Python scripts
  • 0fbdb1357ca3e861bba14d21ceb6e2a6e753a14c Azure: Sync Gating definitions to current PR-CI
  • 4e6e0c88bb2831b65c1a5a6f1f4a7f09c0b112cf Azure: Preliminary check for provided limits
  • 4b2cdeef29094dd6b3e4f485993ad5f69c8d84b5 Azure: Free Docker resources after usage
  • ec21ecc5c6677f9e87fc8ffa5652645469865230 Azure: Skip tests requiring external DNS
  • 1fe5c04cdd2f5f998f92debc7f3f46f2807ddc88 Azure: Rebalance tests
  • 8fd1eacfb5c49738f9a26124cfa7a2423244637b Azure: Report elapsed time

Metadata Update from @abbra:
- Issue close_status updated to: fixed
- Issue status updated to: Closed (was: Open)

Metadata