#6399 Fedora-Rawhide-20240612.n.0 FINISHED_INCOMPLETE
Closed by jnsamyak. Opened by releng.

pungi.global.log

[ERROR   ] [FAIL] Ostree container (variant Sericea, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 118923665. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/aarch64/Sericea/ostree-container-6/runroot.log for more details.
[ERROR   ] [FAIL] Ostree (variant Silverblue, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 118923656. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/ppc64le/Silverblue/ostree-8/runroot.log for more details.
[ERROR   ] [FAIL] Ostree (variant Kinoite, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 118923654. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/ppc64le/Kinoite/ostree-2/runroot.log for more details.
[ERROR   ] [FAIL] Ostree container (variant Kinoite, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 118923667. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/ppc64le/Kinoite/ostree-container-2/runroot.log for more details.
[ERROR   ] [FAIL] Ostree container (variant Silverblue, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 118923670. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/ppc64le/Silverblue/ostree-container-8/runroot.log for more details.
[OSTREE_INSTALLER] [ERROR   ] [FAIL] Ostree installer (variant Kinoite, arch aarch64) failed, but going on anyway.
[OSTREE_INSTALLER] [ERROR   ] Runroot task failed: 118924874. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/aarch64/Kinoite/ostree_installer-1/runroot.log for more details.
[KIWIBUILD       ] [ERROR   ] [FAIL] Kiwibuild (variant Cloud, arch *) failed, but going on anyway.
[KIWIBUILD       ] [ERROR   ] kiwiBuild task failed: 118928354. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/global/kiwibuild/Cloud-3-watch-task.log for details
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Security) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928371. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Security.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Jam_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928373. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Jam_KDE.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Robotics) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928374. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Robotics.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Design_suite) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928364. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Design_suite.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Comp_Neuro) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928362. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Comp_Neuro.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Scientific_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928369. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Scientific_KDE.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Astronomy_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928361. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Astronomy_KDE.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Games) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928370. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Games.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Python_Classroom) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928375. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Labs-Python_Classroom.x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant SoaS) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 118928384. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/livemedia-Spins-SoaS.x86_64.log for more details.
[KIWIBUILD       ] [ERROR   ] [FAIL] Kiwibuild (variant Cloud, arch *) failed, but going on anyway.
[KIWIBUILD       ] [ERROR   ] kiwiBuild task failed: 118928352. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/global/kiwibuild/Cloud-2-watch-task.log for details
[ERROR   ] [FAIL] Live media (variant Spins, arch aarch64, subvariant LXQt) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] [DONE ] Live media: Fedora-LXQt-Live (arches: aarch64 x86_64, variant: Spins, subvariant: LXQt) (task id: 118928415)
[ERROR   ] [FAIL] Live media (variant Workstation, arch aarch64, subvariant Workstation) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] [DONE ] Live media: Fedora-Workstation-Live (arches: aarch64 ppc64le x86_64, variant: Workstation, subvariant: Workstation) (task id: 118928425)
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Labs, arch *, subvariant Python_Classroom) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 118928363. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/imagebuild-Labs-Python_Classroom-vagrant-libvirt-vagrant-virtualbox.x86_64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Labs, arch *, subvariant Scientific) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 118928372. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/x86_64/imagebuild-Labs-Scientific-vagrant-libvirt-vagrant-virtualbox.x86_64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Spins, arch *, subvariant SoaS) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 118928428. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/aarch64/imagebuild-Spins-SoaS-raw-xz.aarch64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Labs, arch *, subvariant Python_Classroom) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 118928376. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20240612.n.0/logs/aarch64/imagebuild-Labs-Python_Classroom-raw-xz.aarch64.log for more details.

Compose Total time: 4:46:57
Compose phase INIT time: 0:00:20.
Compose phase PKGSET time: 0:37:09.
Compose phase WEAVER: FAILED.
Compose phase BUILDINSTALL time: 1:39:40.
Compose phase GATHER time: 0:42:27.
Compose phase OSTREE time: 0:24:28.
Compose phase OSTREE_CONTAINER time: 0:44:02.
Compose phase OSTREE_INSTALLER time: 0:55:55.
Compose phase CREATEREPO time: 0:07:51.
Compose phase REPOCLOSURE time: 0:01:40.
Compose phase CREATEISO time: 0:05:47.
Compose phase IMAGE_BUILD time: 2:25:30.
Compose phase LIVE_MEDIA time: 0:44:50.
Compose phase OSBUILD time: 1:09:10.
Compose phase KIWIBUILD time: 0:32:08.
Compose phase IMAGE_CHECKSUM time: 0:02:42.
Compose phase TEST time: 0:00:01.


  • Sericea aarch64 - I see "error: Installing packages: While applying overrides for pkg plocate: Could not find group 'plocate' in group file" and "error: compose tree failed: ExitStatus(unix_wait_status(256))". Not totally sure what's going on there, plocate does exist for aarch64
  • ppc64le ostree/ostree container failures - all seem to be a dracut problem, they all wind up at an error "dracut[E]: Module 'systemd-pcrphase' cannot be installed." and bwrap(rpmostree-dracut-wrapper) fails. Not sure why yet
  • Kinoite installer aarch64 - space issue, sent https://pagure.io/pungi-fedora/pull-request/1293
  • Kiwi - it's the Azure images that failed, because they need WALinuxAgent , which was now FTI with Python 3.13 - https://bugzilla.redhat.com/show_bug.cgi?id=2246085 - we have fixed this in https://bodhi.fedoraproject.org/updates/FEDORA-2024-c484b23489 , waiting for signing
  • Security - "nothing provides python(abi) = 3.12 needed by python3-pcp-6.2.2-2.fc41.x86_64", pcp buildrequires pyodbc which failed the 3.13 rebuild, https://bodhi.fedoraproject.org/updates/FEDORA-2024-a0c1c969b4 is waiting for signing then we can rebuild pcp
  • Jam_KDE - python3-pyliblo, pyliblo is FTBFS with 3.13 - https://bugzilla.redhat.com/show_bug.cgi?id=2248131

Will look into pyliblo and the rest of the failures tomorrow, I'm done for today.

  • Robotics - python3-catkin_lint , https://bugzilla.redhat.com/show_bug.cgi?id=2259550 , fixed in https://bodhi.fedoraproject.org/updates/FEDORA-2024-f4ce04a098
  • Design suite - blender and duplicity. blender buildrequires python3-pyproj, which needs python3-xarray, which needs several things that are still on 3.12... duplicity buildrequires python3-keystoneclient, which buildrequires python3-oslo-serialization , python3-os-client-config , python3-keystoneauth1 and python3-oslo-utils , all of which are still on 3.12, so there's two whole messy dep chains to deal with there, will start hacking at it tomorrow I guess.

python-rasterio - https://bugzilla.redhat.com/show_bug.cgi?id=2283521 - is at least one of the things at the bottom of the blender dep chain.

blender
  usd
    python-pyside6 (FTBFS)
    python-pyopengl
      pygame (FTBFS)
  pyproj
    python-xarray
      python-dask
        python-toolz (FTBFS)
        python-partd
          python-toolz^
        python-zarr
          python-fsspec (%with bootstrap)
            jupyterlab
              python-cattrs (FTBFS)
              python-requests-cache
                python-cattrs^
            python-notebook
              jupyterlab^
          python-lmdb (FTBFS)
        python-fsspec^
      python-rasterio (FTBFS)
      python-zarr^
duplicity
  python-oslo-serialization
    python-oslo-utils
      python-eventlet
  python-oslo-utils^
  python-swiftclient
    python-openstacksdk
      python-keystoneauth1
        python-oslo-utils^
    python-oslo-serialization^
    python-oslo-utils^
    python-keystoneauth1
    python-keystoneclient
      python-openstacksdk^
      python-os-client-config
        python-openstacksdk^
        python-oslo-utils^
        python-glanceclient
          python-openstacksdk^
          python-os-client-config^
          python-oslo-utils^
          python-keystoneauth1^
        python-keystoneauth1^
      python-oslo-serialization^
      python-oslo-utils^
      python-keystoneauth1^
  python-keystoneauth1^
  python-keystoneclient^

python-glanceclient has a loop that was supposed to be solvable by setting %with_doc to 0, but apparently isn't'. the conditional needs to be updatyed in spec (but the whole oslso stack is blocked on eventlet, as always).

I unblocked python-fsspec but it did much

Okay, so...we're now down to the oslo-utils -> eventlet mess on duplicity, I believe. For blender, pyproj is solved but usd remains: https://bugzilla.redhat.com/show_bug.cgi?id=2292015 . it seems to be blocked on pyopengl, which is blocked on a mesa bug https://gitlab.freedesktop.org/mesa/mesa/-/issues/11360 .

For Jam_KDE, I looked into it, and while maybe pyliblo is rather dead, the two things that use it seem like actively maintained projects that are of genuine use to audio folks and it'd be a shame to lose them - https://bugzilla.redhat.com/show_bug.cgi?id=2248131#c8 . I think it might be best to go ahead and fix it...

Okay, so...we're now down to the oslo-utils -> eventlet mess on duplicity, I believe.

https://src.fedoraproject.org/rpms/duplicity/pull-request/7 breaks that chain

I picked things up in a more recent compose ticket , https://pagure.io/releng/failed-composes/issue/6484 . we're still stuck on blender for design suite and pyliblo for jam_kde, but others all should be resolved now.

Metadata Update from @jnsamyak:
- Issue status updated to: Closed (was: Open)

Metadata