#6059 Fedora-Rawhide-20240312.n.0 FINISHED_INCOMPLETE
Closed by jnsamyak. Opened by releng.

pungi.global.log

  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Kinoite, arch aarch64) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/aarch64/Kinoite/ostree-container-3 --name=Fedora-Kinoite-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Kinoite/aarch64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-3/config_repo/fedora-kinoite.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-3/extra_config.json --version=Rawhide.20240312.n.0
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Kinoite, arch x86_64) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/Kinoite/ostree-container-1 --name=Fedora-Kinoite-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Kinoite/x86_64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-1/config_repo/fedora-kinoite.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-1/extra_config.json --version=Rawhide.20240312.n.0
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Kinoite, arch ppc64le) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/ppc64le/Kinoite/ostree-container-2 --name=Fedora-Kinoite-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Kinoite/ppc64le/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-2/config_repo/fedora-kinoite.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-2/extra_config.json --version=Rawhide.20240312.n.0
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Onyx, arch x86_64) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/Onyx/ostree-container-4 --name=Fedora-Onyx-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Onyx/x86_64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-4/config_repo/fedora-onyx.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-4/extra_config.json --version=Rawhide.20240312.n.0
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Sericea, arch x86_64) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/Sericea/ostree-container-5 --name=Fedora-Sericea-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Sericea/x86_64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-5/config_repo/fedora-sericea.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-5/extra_config.json --version=Rawhide.20240312.n.0
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Silverblue, arch ppc64le) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/ppc64le/Silverblue/ostree-container-8 --name=Fedora-Silverblue-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Silverblue/ppc64le/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-8/config_repo/fedora-silverblue.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-8/extra_config.json --version=Rawhide.20240312.n.0
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Silverblue, arch x86_64) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/Silverblue/ostree-container-7 --name=Fedora-Silverblue-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Silverblue/x86_64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-7/config_repo/fedora-silverblue.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-7/extra_config.json --version=Rawhide.20240312.n.0
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Sericea, arch aarch64) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/aarch64/Sericea/ostree-container-6 --name=Fedora-Sericea-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Sericea/aarch64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-6/config_repo/fedora-sericea.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-6/extra_config.json --version=Rawhide.20240312.n.0
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree container (variant Silverblue, arch aarch64) failed, but going on anyway.
[ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/aarch64/Silverblue/ostree-container-9 --name=Fedora-Silverblue-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Silverblue/aarch64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-9/config_repo/fedora-silverblue.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-9/extra_config.json --version=Rawhide.20240312.n.0
[ERROR   ] [FAIL] Ostree (variant Onyx, arch x86_64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 114832906. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/Onyx/ostree-4/runroot.log for more details.
[OSTREE_INSTALLER] [ERROR   ] [FAIL] Ostree installer (variant Silverblue, arch aarch64) failed, but going on anyway.
[OSTREE_INSTALLER] [ERROR   ] Runroot task failed: 114833707. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/aarch64/Silverblue/ostree_installer-6/runroot.log for more details.
[OSTREE_INSTALLER] [ERROR   ] [FAIL] Ostree installer (variant Silverblue, arch ppc64le) failed, but going on anyway.
[OSTREE_INSTALLER] [ERROR   ] Runroot task failed: 114833704. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/ppc64le/Silverblue/ostree_installer-7/runroot.log for more details.
[KIWIBUILD       ] [ERROR   ] [FAIL] Kiwibuild (variant Container, arch *) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 114836186. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/livemedia-Labs-Robotics.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Robotics) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 114836186. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/livemedia-Labs-Robotics.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant Cinnamon) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 114836207. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/livemedia-Spins-Cinnamon.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Design_suite) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 114836182. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/livemedia-Labs-Design_suite.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant Budgie) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 114836232. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/livemedia-Spins-Budgie.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Scientific_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 114836181. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/x86_64/livemedia-Labs-Scientific_KDE.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant LXQt) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 114836225. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/aarch64-x86_64/livemedia-Spins-LXQt.aarch64-x86_64.log for more details.
[KIWIBUILD       ] [ERROR   ] [FAIL] Kiwibuild (variant Cloud, arch *) failed, but going on anyway.
[KIWIBUILD       ] [INFO    ] [DONE ] kiwibuild task for variant Cloud (task id: 114836170)
[ERROR   ] [FAIL] Live media (variant Spins, arch aarch64, subvariant i3) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] [DONE ] Live media: Fedora-i3-Live (arches: aarch64 x86_64, variant: Spins, subvariant: i3) (task id: 114836257)
[ERROR   ] [FAIL] Live media (variant Spins, arch aarch64, subvariant KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] [DONE ] Live media: Fedora-KDE-Live (arches: aarch64 x86_64, variant: Spins, subvariant: KDE) (task id: 114836194)
[ERROR   ] [FAIL] Live media (variant Workstation, arch aarch64, subvariant Workstation) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] [DONE ] Live media: Fedora-Workstation-Live (arches: aarch64 ppc64le x86_64, variant: Workstation, subvariant: Workstation) (task id: 114836283)

Compose Total time: 3:40:52
Compose phase INIT time: 0:00:20.
Compose phase PKGSET time: 0:33:41.
Compose phase WEAVER: FAILED.
Compose phase BUILDINSTALL time: 0:36:04.
Compose phase GATHER time: 0:40:15.
Compose phase OSTREE time: 0:38:14.
Compose phase OSTREE_CONTAINER time: 0:00:06.
Compose phase OSTREE_INSTALLER time: 1:20:54.
Compose phase CREATEREPO time: 0:06:02.
Compose phase REPOCLOSURE time: 0:01:41.
Compose phase CREATEISO time: 0:07:07.
Compose phase IMAGE_BUILD time: 1:00:52.
Compose phase LIVE_MEDIA time: 1:00:43.
Compose phase OSBUILD time: 1:02:44.
Compose phase KIWIBUILD time: 0:22:02.
Compose phase IMAGE_CHECKSUM time: 0:03:29.
Compose phase TEST time: 0:00:01.


So, looks like just 2 kiwi things left:

https://koji.fedoraproject.org/koji/taskinfo?taskID=114836168
(s390x toolbox failed)

and

https://koji.fedoraproject.org/koji/taskinfo?taskID=114836165
Azure cloud failed due to naming still:

BuildError: Unsupported file type: Fedora-Cloud-Base-Azure.aarch64-Rawhide-20240312.n.0.vhdfixed.xz

Bunches of the ostree failures seem like a pungi traceback... ;(

https://pagure.io/koji/pull-request/4049 should work around the vhdfixed problem, I hope. I'll take a look at the ostree ones.

Ugh. So the ostree traceback seems to be telling us a pungi-make-ostree container command is failing, but I can't immediately see anywhere it logs why, we just get:

2024-03-12 05:56:04 [ERROR   ] [FAIL] Ostree container (variant Kinoite, arch aarch64) failed, but going on anyway.
2024-03-12 05:56:04 [ERROR   ] ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/aarch64/Kinoite/ostree-container-3 --name=Fedora-Kinoite-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Kinoite/aarch64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-3/config_repo/fedora-kinoite.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-3/extra_config.json --version=Rawhide.20240312.n.0
2024-03-12 05:56:04 [DEBUG   ] Traceback (most recent call last):
  File "/usr/lib/python3.12/site-packages/pungi/util.py", line 596, in failable
    yield
  File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 68, in process
    self.worker(compose, variant, arch, config)
  File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 113, in worker
    self._run_ostree_container_cmd(
  File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 144, in _run_ostree_container_cmd
    _, runroot_script = shortcuts.run(cmd, universal_newlines=True)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/site-packages/kobo/shortcuts.py", line 408, in run
    raise exc
RuntimeError: ERROR running command: pungi-make-ostree container --log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/logs/aarch64/Kinoite/ostree-container-3 --name=Fedora-Kinoite-Rawhide.20240312.n.0 --path=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/compose/Kinoite/aarch64/images --treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-3/config_repo/fedora-kinoite.yaml --extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20240312.n.0/work/ostree-container-3/extra_config.json --version=Rawhide.20240312.n.0

which is just repeating the same "this command failed" twice...

Metadata Update from @jnsamyak:
- Issue status updated to: Closed (was: Open)

Metadata