mbox

[yocto-autobuilder-helper,00/11] Implement 'containers' jobs

Message ID cover.1778202125.git.tim.orling@konsulko.com
State New
Headers show

Pull-request

https://git.yoctoproject.org/yocto-autobuilder-helper contrib/timo/containers-upstream

Message

Tim Orling May 8, 2026, 2 a.m. UTC 
From: Tim Orling <tim.orling@konsulko.com>

This series contains the 'yocto-autobuilder-helper' patches to enable:
* building, testing and publishing of 'vcontainer-tarball'
  - the tarball is checked to see if a newer version exists and if so
    extracts the new version before testing
  - vcontainer-tests, vdkr-tests and vpdmn-tests are run as individual
    jobs
* building and pushing containers from:
  - meta-virtualization
  - meta-yocto-containers-demo
* containers are pushed when the push_containers boolean is set in the
  AutoBuilder UI
  - regstries are set with CONTAINER_REGISTRIES variable
* added getconfigdict() to scripts/utils to allow container names to mapped
  from recipe name to a more commonly used upstream container name (e.g.
  app-container-python -> python)
* authentication uses local user credentials (e.g. ~/.docker/config.json
  or .../auth.json for podman)
* containers are tagged with PV_MAJOR, PV_MAJOR.PV_MINOR, DISTRO_CODENAME
  and yocto-x.y release (yocto-x.y.z for release builds).

Additional features, such as container signing and attaching SLSA provenance
attestations will come in a future series, once this initial functionality
is agreed upon an stable.

This series depends on a related series for 'yocto-autobuilder2'.

The following changes since commit bfc6a42aa4df89878a1b0d950c7d0146ce20672c:

  publish-artefacts: Update to include newer machines (2026-05-06 17:33:36 +0100)

are available in the Git repository at:

  https://git.yoctoproject.org/yocto-autobuilder-helper contrib/timo/containers-upstream
  https://git.yoctoproject.org/yocto-autobuilder-helper/log/?h=contrib/timo/containers-upstream

for you to fetch changes up to 601c281165450b2be14de46bb9601e82229ca5f6:

  config.json: containers-library: add mosquitto and valkey demos (2026-05-07 12:53:00 -0700)

----------------------------------------------------------------

Tim Orling (11):
  scripts/utils: fix stale extraction dir when tarball is updated
  scripts/utils: warn and force re-download for HTTPS sources without
    SHA256
  config.json: add sha256sum for BUILDTOOLS URLs
  scripts/utils: add getconfigdict() for dict-type config values
  scripts: add vcontainer-tarball setup, integration, and publishing
  config.json: add vcontainer-tarball build target
  config.json: add 'containers-' build jobs
  scripts: add run-vcontainer-tests for meta-virtualization
  config.json: add vcontainer-tests, vdkr-tests, vpdmn-tests jobs
  scripts: add container registry push, auth, tagging, runtime selection
  config.json: containers-library: add mosquitto and valkey demos

 config.json                  | 151 ++++++++++++++++++++++++++++++--
 scripts/publish-artefacts    |   5 ++
 scripts/run-config           | 147 +++++++++++++++++++++++++++++++
 scripts/run-vcontainer-tests | 164 +++++++++++++++++++++++++++++++++++
 scripts/shared-repo-unpack   |   1 +
 scripts/utils.py             | 109 +++++++++++++++++------
 6 files changed, 545 insertions(+), 32 deletions(-)
 create mode 100755 scripts/run-vcontainer-tests