From patchwork Wed Mar 5 10:24:56 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58311 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1B91BC19F32 for ; Wed, 5 Mar 2025 10:25:12 +0000 (UTC) Received: from mail-wm1-f52.google.com (mail-wm1-f52.google.com [209.85.128.52]) by mx.groups.io with SMTP id smtpd.web11.10282.1741170310379690693 for ; Wed, 05 Mar 2025 02:25:10 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=Wp2XBQjR; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.52, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f52.google.com with SMTP id 5b1f17b1804b1-43bc48ff815so4259855e9.0 for ; Wed, 05 Mar 2025 02:25:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170308; x=1741775108; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:message-id:date:subject:to :from:from:to:cc:subject:date:message-id:reply-to; bh=rqir7oypro0ZxON4qQ/HeQQkabZqapmVcR5zAD8kvuM=; b=Wp2XBQjRpO8v0b4g08S4hZUywpUusIpEEGeV12IRcjT3htZsafh3l2/YpvXBNKHFwn 0perF3k33NLeMHDN0/EV+fSN3f50/A9YEPnxmJAeOyoK+w77YcpDKjQLeSrkWGWzKhOP H18vXSlhHjGEjCN7OJB+8jQQxtBHQA3CL/B+E= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170308; x=1741775108; h=content-transfer-encoding:mime-version:message-id:date:subject:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=rqir7oypro0ZxON4qQ/HeQQkabZqapmVcR5zAD8kvuM=; b=A9vt8XyBuDsrYfHBHSXOhy4dHJOnq1LN6uhnZUNfQ93f+F6y6ovD1IQ6aroa3OIhqY Qs67fQvxXATbQzKw8N/2hIPVtjj5Yw7fjYU93c8PJS6oBFVMAelbYr9RcDNVqpilQGgn zQtlLOo5nP7ycwSOL7hlIvLjd+pamQXLAL7wok/A1WGRjgujLyv2CyFIDBFXyjghMeb0 dUkwbmy368/TZNLzQzT1FXjaCzP+52lm4tp+iQw7ruaGjl407d1WSMlMlCcQLtQ/BrjG +gTvygJfaq4Y7rfBDGpdILYbh5PchkM3CLZJuJAoxzApCw+iNpNR2H6hTeCJy/apIyz3 fTYQ== X-Gm-Message-State: AOJu0YzVDBLVImqa9IhZ2YD7MMMVO6NFrrIwtFRxl/r8Yo9vd8H2SFU/ YkHPGWAdAqry0e3DjArTf+ptL6Fa1j4Y6+RquObQ3T5/9N7fL+YgeAwHz1aYW1kqyAFRIEoXSwq 2 X-Gm-Gg: ASbGnctGhpcQTLtNPCtB4SH+wdwbt66i2hWkuWtBA+6be1Guha56ogBnI/1ahay+CyU YOxneGZK8uTAZnBxixCTkyi1eKy3geNZ6hyDs4aXD/tTdPUaCzYFl7yLl08NXbLKF0ShRpdhDk7 N4QcqFRcLbxWn3jqBzRqP9p4FyhvHrd892q+QNcUm0pB0f1TP2t9mepTgEaCenR0nouADrBcwUy Fhmi1eMV2Z+pibDT8dytlmSlMG9Y5od6TPYqxtq8P5+KuhTJJJwrECgNDuqRt4JviOEe0CCK47T 6ir9wHUra2SlRsaJg9X13tOAngfD2VvGn9jaBdSmy3pR7/ki8iltKKFj3CAf0m8BoCFFhBH8gQ= = X-Google-Smtp-Source: AGHT+IFqCcsIUwLecdT1qk/F7K9Rw76lwQ9SYzbekUdrwrjv8AcvGE3cLQc2VzwIovArZPe6yVUw1A== X-Received: by 2002:a05:600c:19c7:b0:439:5f04:4f8d with SMTP id 5b1f17b1804b1-43bd21021famr18778995e9.12.1741170308134; Wed, 05 Mar 2025 02:25:08 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.07 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:07 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Subject: [yocto-autobuilder-helper] [PATCH 01/11] scripts/run-dashboard-index: Add basic index page for new dashboard site Date: Wed, 5 Mar 2025 10:24:56 +0000 Message-ID: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:12 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1145 Add a basic index page for the dashboard site and tag onto the indexing job Signed-off-by: Richard Purdie --- config.json | 4 ++++ scripts/dashboard/index.html | 41 ++++++++++++++++++++++++++++++++++++ scripts/run-dashboard-index | 11 ++++++++++ 3 files changed, 56 insertions(+) create mode 100644 scripts/dashboard/index.html create mode 100755 scripts/run-dashboard-index diff --git a/config.json b/config.json index d24da94..c5d3913 100644 --- a/config.json +++ b/config.json @@ -1373,6 +1373,10 @@ "step2" : { "shortname" : "Extract ptest logs", "EXTRACMDS" : ["${SCRIPTSDIR}/generate-ptest-logs.py ${BASE_SHAREDDIR}/pub/non-release/"] + }, + "step3" : { + "shortname" : "Populate/update dashboard site", + "EXTRACMDS" : ["${SCRIPTSDIR}/run-dashboard-index ${BUILDDIR}/../"] } }, "meta-mingw" : { diff --git a/scripts/dashboard/index.html b/scripts/dashboard/index.html new file mode 100644 index 0000000..972bbc9 --- /dev/null +++ b/scripts/dashboard/index.html @@ -0,0 +1,41 @@ + + + +Yocto Project: Valkyrie Build Cluster + + + +

Yocto Project: Valkyrie Autobuilder

+

Please choose from the most frequently used links

+ +

Cluster Buildbot Controller: +valkyrie.yoctoproject.org +
+
+Unreleased Artefacts: +valkyrie.yocto.io/pub +
+
+Build Performance and Autobuilder Test Result Index: +valkyrie.yocto.io/pub/non-release +
+
+OpenEmbedded-Core CVE Status and Patch Metrics: +valkyrie.yocto.io/pub/non-release/patchmetrics +
+
+Meta-OpenEmbedded CVE Status and Patch Metrics: +valkyrie.yocto.io/pub/non-release/patchmetrics-meta-oe +
+
+Auobuilder Intermittent Issue Summary: + + https://valkyrie.yocto.io/pub/non-release/abint/ +

+

+ + diff --git a/scripts/run-dashboard-index b/scripts/run-dashboard-index new file mode 100755 index 0000000..6644ee7 --- /dev/null +++ b/scripts/run-dashboard-index @@ -0,0 +1,11 @@ +#!/bin/bash +# +# SPDX-License-Identifier: GPL-2.0-only +# +# Called with $1 as the build directory + +builddir=$(realpath "$1") +scriptdir="$(dirname "$(readlink -f "${BASH_SOURCE[0]}")")" + +rsync -irlp --checksum --ignore-times $scriptdir/dashboard/index.html docs@docs.yoctoproject.org:dashboard/ + From patchwork Wed Mar 5 10:24:57 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58310 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1A1E4C282D9 for ; Wed, 5 Mar 2025 10:25:12 +0000 (UTC) Received: from mail-wm1-f41.google.com (mail-wm1-f41.google.com [209.85.128.41]) by mx.groups.io with SMTP id smtpd.web11.10283.1741170311420954549 for ; Wed, 05 Mar 2025 02:25:11 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=FP1vGYFH; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.41, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f41.google.com with SMTP id 5b1f17b1804b1-43bbc8b7c65so35289025e9.0 for ; Wed, 05 Mar 2025 02:25:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170309; x=1741775109; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=uXQR2QojCghs1EbqJCyKfPrK2pMDq5KgZYCZGqT7+94=; b=FP1vGYFHq1/EVywsraByDia9CywutHaknt8yFK/C49jh0jviPeSUz5+ot3CCEOrpbH tkBvFwdows1dmfiPe2suUfMp3njgWIYUb2UsE6aVhEwAIKLZnjLnFqHaqeoWmGkK5K9b PLer6VhFplDtP9rnUd130pjQk+k+MDLFgB/oY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170309; x=1741775109; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=uXQR2QojCghs1EbqJCyKfPrK2pMDq5KgZYCZGqT7+94=; b=m77YfZ71Uofo9w40X0SVm7FtwmSN7WxdkPyDHHFerEmuxjJnYBrIrnqlokZhOQMtK/ VbfmIgYDWK05dtUWt2zWhWHlkSGu2Nk8nBPlaJ5BnGeL21aAtLV3QYifeKRm+ftFTp/g r96yG8d0c8qGbZjp72cbR/Lz5aKzMEhNVz/U9wMsHk2n8LfQCQzY7L54BuRHuxyRd5Ae A+Uaaxt516Gg5HEux2QAVsg8F+Ku8IrcQXuLYGu1ubj5qEXV5ZSCiqvwLIeOVCl8eyzw /9R5pG38FUJ2p1v5BY8yJ5TGFZEMlLR43xMo51cUBj75ZU6AyZB4H6Q/1Pb7tez/XzuY NaPg== X-Gm-Message-State: AOJu0Yzzxs4+A5mKuL18SbxfaIpU25HCClN4XFOPxKF3yuYYRto6YBm/ CTlqCrvGB79jjNPE99atriZMcksDC2VZV7TBVmSzdSipSR6yCDwVOL0oevUUETBSTFpICbbKDGl I X-Gm-Gg: ASbGnctYCPe6qthDCZMhjtS8FitGblLYHSIWOb5JTigWGD3J6SAWYHrUai5X4A/yAlp XzuPbX7bbru5hnwYCsOlhQtSHxiUt70ObjNb6OZAaVmdl0GanjpLiSQHT12pbCbNzMDSNyqHSkI VphSHyZN7x7Yq8w9y/vVOa8D1tROfLBXxzAU+eTEW+z18sTYy03hA2wbAirQ1m9hXHNscMzVQ8K NqNPQRtC8wJL5s87yRKR+FblAze87tYrvtrgtJXnt3K+VY+Fwt7YNsZITxaPaGRlNc0+HkrNmPC wLd9O43/s9n110dsryCpzI5zw92atCnPRBZMFgX5kh7r03Id0w2PcQCi61mMdpKL2jbXAiUPYQ= = X-Google-Smtp-Source: AGHT+IGau6wJnIhjhWHhLCHMrjs7KTXg0MpT5IQnxInzGR6mymuOCv27TEHLVnv73ovfl0pb5a6jgQ== X-Received: by 2002:a05:600c:154a:b0:43b:c97f:2679 with SMTP id 5b1f17b1804b1-43bd2991de7mr18979265e9.17.1741170309416; Wed, 05 Mar 2025 02:25:09 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.08 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:08 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Subject: [yocto-autobuilder-helper] [PATCH 02/11] scripts/run-dashboard-index: Generate releases.json from the dashboard script Date: Wed, 5 Mar 2025 10:24:57 +0000 Message-ID: <20250305102506.2043524-2-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:12 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1146 Signed-off-by: Richard Purdie --- scripts/run-dashboard-index | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/scripts/run-dashboard-index b/scripts/run-dashboard-index index 6644ee7..c1f0c78 100755 --- a/scripts/run-dashboard-index +++ b/scripts/run-dashboard-index @@ -7,5 +7,9 @@ builddir=$(realpath "$1") scriptdir="$(dirname "$(readlink -f "${BASH_SOURCE[0]}")")" +cd $builddir +$scriptdir/release-parser.py + +rsync -irlp --checksum --ignore-times releases.json docs@docs.yoctoproject.org:dashboard/ rsync -irlp --checksum --ignore-times $scriptdir/dashboard/index.html docs@docs.yoctoproject.org:dashboard/ From patchwork Wed Mar 5 10:24:58 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58313 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 01268C282DC for ; Wed, 5 Mar 2025 10:25:22 +0000 (UTC) Received: from mail-wm1-f54.google.com (mail-wm1-f54.google.com [209.85.128.54]) by mx.groups.io with SMTP id smtpd.web10.10379.1741170312701040953 for ; Wed, 05 Mar 2025 02:25:13 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=VLgFpt1n; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.54, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f54.google.com with SMTP id 5b1f17b1804b1-43bc0b8520cso20514865e9.1 for ; Wed, 05 Mar 2025 02:25:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170311; x=1741775111; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=kjuQiBOcYY/2s/3COnZxJeGYjZY7UXg+EptVr7tX1/8=; b=VLgFpt1nuTtPACbElivs949U6ZcPV6Vb9qn/TpCRi475RLvqUEKGOskYfQmg65u7E1 Rt3QsfrQg4cVQbhcWe389HvDQxTKGTXfNkELdc94WCNcy8bppjCA2L2Uy2Ev/S3TIPRp G48zQXKzygHcnB0vL+oKEkWVJMHB7dgDfiWJE= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170311; x=1741775111; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=kjuQiBOcYY/2s/3COnZxJeGYjZY7UXg+EptVr7tX1/8=; b=kGHOMbspRP9qPSjMxs6hHtrLFapYoYP//Xr+9Sx0DQOg+rVeyPP40PSfdRxqUZhJnM +ZNsDZWD0VMkaKl1UeTjPRVbCyX9V1LvTB8icq+wgKrFL3ZqpFWpCJ9UG/ko69lATX+m MQqLlAY6TYG8s7LznYBlbaQQg5gnR8ji9j1+CKu+VWzuoIx4jqHqxsMeE3cq6SpeDyYb 2OyeosBT71q8RWVcpthUE/t4fjC99CKD18Sl/KppszLJhQGgStMroN9+83QvW3iwJ3oW 88ZFxU7cGUVetD3Z7hppqi3DnBvzs9Bwu+v242cMSbVOaGgBBvCacIGtnnkdA5aeAE3m Oodg== X-Gm-Message-State: AOJu0Yy4E2t/SJ+4K65H59fg6TGPdVuQeP4mpGP0qBorS7IuFhewn/E5 QIT5soGIWMvqkegJF1tyy0IsOZCD1P2ARo9W+KvuSNUlE1wVtqtZwcznDLiup2uHHtYyG4uxflZ D X-Gm-Gg: ASbGncu9BckYAuXSurYfVfB0QgMb+V5GzR2x39SF9TlYXti3AbYEi3Reqxuj01chiQM 3YFOHO/cU4kcKp4kAPgkPiMwgM1pByIUepsS2KLJgKNYHQk958SGOxh2V2y4aYE2Y9lobzXGlKe G7qwFl6poHrKk73StwB7SVxgW2xI8LJfIKDU55uwjc6Jy/JhrSIi+nTZ3LzbIO8tTdT7DSnSRa/ 23Z49Y0e0Eci/NdwjjvQQ4JfG+qJdCiRUNVqS8KU4U/8MpD1WencVlBDmCwVBR8vS27m83uH1Ng FEGDl9lHXjIVBfyFaHdRMROZKXDZlw01EueAwKEPtFjhGJkk3bVyZHT0nM9YUNgCIOjumIeTKg= = X-Google-Smtp-Source: AGHT+IEeOXwVRmzEBI+uJCknZfnyjybHo3Rxvlv6UF8p0HOrawT6qa+EtwCllckhMXkO8w/XW/EgRw== X-Received: by 2002:a05:600c:198f:b0:43b:c309:da40 with SMTP id 5b1f17b1804b1-43bd294de7dmr17204205e9.4.1741170310639; Wed, 05 Mar 2025 02:25:10 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:09 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Cc: Michael Halstead Subject: [yocto-autobuilder-helper] [PATCH 03/11] scripts/run-dashboard-index: Generate parsed-layers.json from the dashboard script Date: Wed, 5 Mar 2025 10:24:58 +0000 Message-ID: <20250305102506.2043524-3-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:22 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1147 From: Michael Halstead Signed-off-by: Michael Halstead --- scripts/run-dashboard-index | 2 ++ 1 file changed, 2 insertions(+) diff --git a/scripts/run-dashboard-index b/scripts/run-dashboard-index index c1f0c78..7309158 100755 --- a/scripts/run-dashboard-index +++ b/scripts/run-dashboard-index @@ -9,7 +9,9 @@ scriptdir="$(dirname "$(readlink -f "${BASH_SOURCE[0]}")")" cd $builddir $scriptdir/release-parser.py +$scriptdir/layer-parser.py rsync -irlp --checksum --ignore-times releases.json docs@docs.yoctoproject.org:dashboard/ +rsync -irlp --checksum --ignore-times parsed-layers.json docs@docs.yoctoproject.org:dashboard/ rsync -irlp --checksum --ignore-times $scriptdir/dashboard/index.html docs@docs.yoctoproject.org:dashboard/ From patchwork Wed Mar 5 10:24:59 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58312 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id F1E07C19F32 for ; Wed, 5 Mar 2025 10:25:21 +0000 (UTC) Received: from mail-wm1-f46.google.com (mail-wm1-f46.google.com [209.85.128.46]) by mx.groups.io with SMTP id smtpd.web11.10284.1741170313825134351 for ; Wed, 05 Mar 2025 02:25:14 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=dUiWWAzV; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.46, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f46.google.com with SMTP id 5b1f17b1804b1-43996e95114so44756475e9.3 for ; Wed, 05 Mar 2025 02:25:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170312; x=1741775112; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=G8FxDQ20iuWMoa/PNqVHP3/KOFuVca5cpYuJCl8cuXI=; b=dUiWWAzVoswGfA3JUBeMGlRkPh71HSVyOUtPEHaYsXKdhja9+kVrjgZH8e5alFI/Gx wa+vfIoJHmAuz0otmdG3AAAdoYIHUtRzB1TsgkuVsq0cGl+vtnWJlNcIDRSLjNXYWXIR wDmnkL1sKHx06iYiYe7xpinnNHPGtxGDMOZ/4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170312; x=1741775112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=G8FxDQ20iuWMoa/PNqVHP3/KOFuVca5cpYuJCl8cuXI=; b=HOFvl7elUSodc4zG7vHPwotkCVkTyOy7kyKX3jimg8ojKSXl3rltcwiS3w4/9Jo64E pY6qUWnKkMzMwFUV2+leQbemitQtb4KYe9vFWHdSwo2B65/JtvUpfJI0A7bgsCkKLiUy HyXcYwu6ORsyv9p3kSJBqSLOgHLA3Lw/Aa0Bk/o66ouHpu9hTDNbmdi/epT32FMofa0d PQ4POk0ZAPd4qcih6pDMidyNFCw5MUKqtdewO2pXGlA4zPl7spGkoxjSv0cXkNrS2/Yu ByoJVz9fePxKqVk9tCAAcP2vrC6XoalVsHXu9er4qpG7qtzlQLWjYn1OS//jtXD5deZh 7yyw== X-Gm-Message-State: AOJu0Yzrw7VT9x1naGbkLGTAvCfNyamr/wZWP1XerwhtgEaO02R5iAX4 B+1NygGOHSbuRMRKjx81Q1sUIyWAZg7T/1cSImBTQpqkkqSnaktB5cQFUuUHYxuF68SU3v6osqC 1 X-Gm-Gg: ASbGncsfxgJHwp+H5cHRU9RjpjZH0CEbfmkuav2FNqBO6dYAxPoRJUiNurc3e5s62YT fmm/jqOmn2/pskLA+9CxskQASg6byRX46upQjttuJHPItxq9ni1iTWAKVT2HhI6YGLNONoN5l5L 2QVY5i2JGI0zAlyvL46ng1VUj8dAmDC6ZgeiejzukpgmLS7aB4q/owfvO74AbG/AWqCxVkUEAIw ni0wKhKaEcSg81UXeB+TyCWthDmRVgyQ65n88PR0lR3nkSi9jS8v4FtbEV3POyL6cLO3rKakXrL PNb9gySs7TVjixhqegoAZQ5p0ja1jYQsQCdqC4siD1bmgmJuLYYWqkwzDImewJhYVQWQFYgorQ= = X-Google-Smtp-Source: AGHT+IGIpLP2EMdNYZGhvC3JOqJTTi9eV5W7N5W362gEcFLbF7RXNdpyYojtP47tSdbKSbHFJrGezw== X-Received: by 2002:a05:600c:4f06:b0:439:9f42:8652 with SMTP id 5b1f17b1804b1-43bd296df39mr17595975e9.17.1741170311767; Wed, 05 Mar 2025 02:25:11 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.10 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:11 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Subject: [yocto-autobuilder-helper] [PATCH 04/11] scripts/run-dashboard-index: Ensure failures show an error Date: Wed, 5 Mar 2025 10:24:59 +0000 Message-ID: <20250305102506.2043524-4-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:21 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1148 Signed-off-by: Richard Purdie --- scripts/run-dashboard-index | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/scripts/run-dashboard-index b/scripts/run-dashboard-index index 7309158..47c5e9a 100755 --- a/scripts/run-dashboard-index +++ b/scripts/run-dashboard-index @@ -4,6 +4,11 @@ # # Called with $1 as the build directory +set -e +set -u +set -o pipefail +set -x + builddir=$(realpath "$1") scriptdir="$(dirname "$(readlink -f "${BASH_SOURCE[0]}")")" From patchwork Wed Mar 5 10:25:00 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58315 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0F7F7C28B21 for ; Wed, 5 Mar 2025 10:25:22 +0000 (UTC) Received: from mail-wm1-f52.google.com (mail-wm1-f52.google.com [209.85.128.52]) by mx.groups.io with SMTP id smtpd.web11.10286.1741170316489077409 for ; Wed, 05 Mar 2025 02:25:16 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=ZNbMUBA3; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.52, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f52.google.com with SMTP id 5b1f17b1804b1-43bd45e4d91so2450035e9.1 for ; Wed, 05 Mar 2025 02:25:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170314; x=1741775114; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=NXtQZxXFpqNHk4m/FOCme6CHg2JDCRHPwM3tj14QCqc=; b=ZNbMUBA36F1d4Z5qkYEkYnvniEGxbO+IMjCFRNsaKh8zAmJ/hPkgV7vab+g6kgDEis Lv53Lc0wVGVZqwjMD0RWeqJBDFG4n2IGO4a8bs51i/o4/hC4QCojV5MWe7xxnEOODyZQ 9TIKhYT+C93F6lfz25zThOZu98L0LXCE2iIxM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170314; x=1741775114; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=NXtQZxXFpqNHk4m/FOCme6CHg2JDCRHPwM3tj14QCqc=; b=MVrW5ev89z6fCbvKtwyFf+3yaZeUT2D3+vdrEjeinYvbe/Yu+J2lexmO49NSppk4wb EmPbZDy7F+3UbWIutmDh0OX8cBK/N3rKqPCJDxeiPaF875+xyRJgp2UueNxrP/7TlizI 7Z7ITHxU18VFI3hnfULaIknFKkeApWl5kXMakIEi+EM3uNsz6zuy8Vzu4sj51d537fp7 bBUGIa9Cb7vlOTO3iKNo5cgTSBd1cr2zGKPMUoDEDn+cfaBdevElhwpGXegvnt6YTBG1 4ZGYIQvl4iH+MPtiEuk6qvzG1uqdBLtFLCFM56nUCdAp/5PZAGlzUXSgnwrPSG2iqEQY XgvA== X-Gm-Message-State: AOJu0Ywa6/tOyVhl9gEjbOPkrI9ICIUhmt3Vzyz/oGJxJT0h+eHH/Zud ubquEHr39taHFaYU/Ln0kOCoH3AehAE+Fhrtu9nxguvMH99B2BOfwQ2UcuGe0fDOTVjAvMLjlBm c X-Gm-Gg: ASbGnctqtwmpO4jtouO5O45D9cuispt1gmun9KKUuGf1wj9m1eEEv0QaD6LIYFi7rpE S2zIA8txEg4dAub2TRGrZWMVYJczEtMmAWoM/edIg/mhsfwNCkplpMiIr9V0OkLMyBO2cJc0qZc GSK4cyjNNbx7Zs2R4VV42/HyS7ny1xUNCOcxA83LcypuqP83Uk28ZSLOvblVq2pVNMXshSOPGxy +V0n1DuoUl6pGkPm3gZPK/VAK2ZUbhHwqbgcCM4P5ITSQeXa3N7HML9XjrFYKay3K8oKBexvb9p /HGG6GvRu1SmeIxP4LQHHqxeawvfgEtDRSgEn+9uqL69bE16EfPfj9UCDUi1KZFE/YAgk2k8Uw= = X-Google-Smtp-Source: AGHT+IFT8W4laFTBUpSvvl2uCuqPa1q13yS3tyKWvPtagSZPHvM4ybOQoTy49vLfpyhk848GLnfXPQ== X-Received: by 2002:a05:600c:2058:b0:43b:c592:7e16 with SMTP id 5b1f17b1804b1-43bcae04e31mr58586135e9.3.1741170312913; Wed, 05 Mar 2025 02:25:12 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.11 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:12 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Subject: [yocto-autobuilder-helper] [PATCH 05/11] list-yp-compatible-layers: Update to current release branches Date: Wed, 5 Mar 2025 10:25:00 +0000 Message-ID: <20250305102506.2043524-5-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:22 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1150 Signed-off-by: Richard Purdie --- scripts/list-yp-compatible-layers.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/list-yp-compatible-layers.py b/scripts/list-yp-compatible-layers.py index 9d5fc48..0171075 100755 --- a/scripts/list-yp-compatible-layers.py +++ b/scripts/list-yp-compatible-layers.py @@ -39,7 +39,7 @@ def main(): parser.add_argument("-b", "--branches", help = "Branches to find a matching build for in Auto Builder builds query", - action="store", dest="query_branches", default="dunfell,kirkstone,mickledore,nanbield,master") + action="store", dest="query_branches", default="kirkstone,scarthgap,styhead,master") parser.add_argument("-j", "--jobs", help = "Jobs ('Builders') to query on the Auto Builder that perform the actual compatibility checks", action="store", dest="query_jobs", default="check-layer,check-layer-nightly") From patchwork Wed Mar 5 10:25:01 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58316 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0DD7BC282EC for ; Wed, 5 Mar 2025 10:25:22 +0000 (UTC) Received: from mail-wm1-f47.google.com (mail-wm1-f47.google.com [209.85.128.47]) by mx.groups.io with SMTP id smtpd.web11.10285.1741170316234931360 for ; Wed, 05 Mar 2025 02:25:16 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=HT1w/UaN; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.47, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f47.google.com with SMTP id 5b1f17b1804b1-43bcfa6c57fso7132765e9.0 for ; Wed, 05 Mar 2025 02:25:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170314; x=1741775114; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=/dBl+Lczy0ykZno+Bb0zuUOtvjwAH1xJf6Ky6+fPTac=; b=HT1w/UaNlKikHL+pFl0A6/uf43ouP96w2i18+FBiDe6mgTcoJY97xcxzScMDaPpKxK uS5L/sjN/YoVCgZDcEQC6ofFhgO831E55yJ377hdVdkUUGPC7mg9Nr3G1gLr3jXKPzV6 zVQiXW0caS+ky2laY04PPuBtH79zqIotBAuR4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170314; x=1741775114; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=/dBl+Lczy0ykZno+Bb0zuUOtvjwAH1xJf6Ky6+fPTac=; b=p/MjjxXhOwjaIT321hjt4rjDBaiZOg0fI3UMbsWAUdrwBicl7NgUpeKOuXbtMv+w1m rvnS73QdrZvcrHUIzQvKdZWJFVkby5J1J+R4Jsw7SvFYxCaO2r7tim35CMQNzMWnMS7E UIFf9nWmO09w1uFqmrvUoI+Z59YsAVJsG/Rev5lBTNatW5t8+PvJBeqtsVvD8m++wwF2 nvFM3v+4FOGzY05r649OsCTBFigwI7d3flDIVr7K3mjfpLp4pbNIOHoSA9d0GQ8NlzDv ezKx7BhcNYhWWPw+uSWG+saOpNfPDLc2lhySidTG8XAZ8THW7KZtxKnE9fZ58K7SFnZ0 pvpw== X-Gm-Message-State: AOJu0YwGlvU2rtpwCMfGr/NxHSZkAVFD2qbLvaL2Ly9Mv2f2kUTzl762 C0f99j/fyH6exnSHt9zoo9LKaMOOjFttu+cE/Yqne1Nhzb4/Xn94k2ce3ShIR46D0/EKq2t65Xy i X-Gm-Gg: ASbGnctwCc62qwuQBeXpUj1NV+zVIU37yahD2UFmCyzGZAIe3pJ0la2AiktIH2gUz8v 9NVN7zTT1rnsCGqvkCKvjETPEkzZHqXHWdt2g7mzYArpqEfv8PuPFBXvyC6FfmmaiP7GievnJbn Ta8X5c5D87nHmR44VFiaKGvtdbm4AipYPTYLOIuRuo0ahKUDcNDlHRRZ3kJWV5K3EYu9l6+7okz eyhj8wlVQf3h34lptlexTIvN83QWIemy/LTyiQstzPEX1B+a7JXBqOP5opL367cXXbIlr1LaGcA cnXkeGR2JTvPC5gIYFUVxpJu1FjGbyb7CtpMitMxut66HEs9nYD6F3ALJRrxj/g4O7zoSSZhOw= = X-Google-Smtp-Source: AGHT+IHT6cLtC33/N7ET0dyI5gX0fR+T/NoMSFlduc39DHNpsIZCdivB8262VvYU5yulwxMCr5AQIA== X-Received: by 2002:a05:600c:468e:b0:434:fa55:eb56 with SMTP id 5b1f17b1804b1-43bd293f76cmr19728335e9.7.1741170313914; Wed, 05 Mar 2025 02:25:13 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.13 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:13 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Cc: Michael Halstead Subject: [yocto-autobuilder-helper] [PATCH 06/11] scripts/layer-parser.py: remove EOL layers Date: Wed, 5 Mar 2025 10:25:01 +0000 Message-ID: <20250305102506.2043524-6-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:22 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1149 From: Michael Halstead Remove caching and optimize to run on the autobuilder from scripts/run-dashboard-index Signed-off-by: Michael Halstead --- scripts/layer-parser.py | 38 +++++++++++++------------------------- 1 file changed, 13 insertions(+), 25 deletions(-) diff --git a/scripts/layer-parser.py b/scripts/layer-parser.py index 246158d..e53a914 100755 --- a/scripts/layer-parser.py +++ b/scripts/layer-parser.py @@ -2,44 +2,32 @@ import os import time -import requests import json +import urllib.request LAYER_API_URL = "https://layers.openembedded.org/layerindex/api/layers/?filter=yp_compatible_version__isnull:false&format=json" LAYERDATA = "layerdata.json" -RELEASE_URL = "https://docs.yoctoproject.org/releases.json" -RELEASEDATA = "releasedata.json" +# RELEASE_URL = "https://docs.yoctoproject.org/releases.json" +RELEASEDATA = "releases.json" +with open(RELEASEDATA, "r") as file: + releases = json.load(file) -def fetch_data(url, file_path, cache): - if os.path.isfile(file_path): - modification_time = os.path.getmtime(file_path) - time_difference = time.time() - modification_time - else: - time_difference = 1000000 - - # Re-download if the time difference is greater than cache value - if time_difference > cache: - response = requests.get(url) - if response.status_code == 200: - with open(file_path, "w") as file: - file.write(response.text) - return json.loads(response.text) - else: - with open(file_path, "r") as file: - return json.load(file) +with urllib.request.urlopen(LAYER_API_URL) as response: + if response.getcode() == 200: + data = response.read().decode("utf-8") + layers = json.loads(data) -layers = fetch_data(LAYER_API_URL, LAYERDATA, 600) -releases = fetch_data(RELEASE_URL, RELEASEDATA, 600) - # grab the recent release branches and add master, so we can ignore old branches active_releases = [ - e["release_codename"].lower() for e in releases if e["series"] != "full" + e["release_codename"].lower() for e in releases if e["series"] == "current" ] active_releases.append("master") active_releases.append("main") +print(active_releases) + header = dict() header["layer"] = "Layer" header["branches"] = "Branches" @@ -85,7 +73,7 @@ for layer in parsed_layers: parsed_layers[layer]["maintainers"] = "{} and {}".format( ", ".join(maintainers[:-1]), maintainers[-1] ) -sorted_parsed_layers = {"header": header} +sorted_parsed_layers = {"header": header} for layername in sorted(parsed_layers.keys()): sorted_parsed_layers[layername] = parsed_layers[layername] with open("parsed-layers.json", "w") as file: From patchwork Wed Mar 5 10:25:02 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58318 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2A2A7C282D9 for ; Wed, 5 Mar 2025 10:25:22 +0000 (UTC) Received: from mail-wr1-f41.google.com (mail-wr1-f41.google.com [209.85.221.41]) by mx.groups.io with SMTP id smtpd.web11.10288.1741170317688697569 for ; Wed, 05 Mar 2025 02:25:17 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=hrCl6to7; spf=pass (domain: linuxfoundation.org, ip: 209.85.221.41, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wr1-f41.google.com with SMTP id ffacd0b85a97d-390fb1b987fso4626818f8f.1 for ; Wed, 05 Mar 2025 02:25:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170315; x=1741775115; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=yP+8NIGM/2igLj17bN/qI3XSwCdDETnttDiixUnUFCU=; b=hrCl6to7xWPrIo8iY1/bx06QoTs7TYAar2IuA+N5Bz0x8AJrwjqEi9TLFSN+oTEHgs KtmA+fTb+5WGswyrSHwr+U2+ZVL+vLmqI0ryZwxZNA8+neLnn0j3wW4RmFlmbY0O/hh/ ncGObmfuftS2JHE/vhuTBnhmrlP4zRdDVJ8HE= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170315; x=1741775115; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=yP+8NIGM/2igLj17bN/qI3XSwCdDETnttDiixUnUFCU=; b=dBttqtQPWHpaAgDSV6szNXRDu0wFNiSpizruuLeKa7RRmRchsw5mI5VOvvWmLyxv8/ WmhSuYQXSUaeeZlowO5yH/kGVu6hXTGhWSwFdsvgrpZKJRt2Mj5k0cJPtTkWxsQ+FnIB 1JAjtbvSLgSCPFS+kAgBoIWX5QAKuq4Ph9yQ7/IQf7blHHxdhZOyvOkUCs7qon3Isibu tsqez6yvx/z2ZFzb73Hsy+mUCOiWygi16/cNGse0nH3XKpjR2ur/Ys4su1WEopsgpipx AYuv3h7gZbCcOixRIc9heJNFlxNMX+/4ikrYYdgn1DhZJ/VVLbFkLpzlQzXOHrBPA42f 6biA== X-Gm-Message-State: AOJu0YwVevyzqoxPIVLBAGscRI6C7NNj9o+fkbyescMfYV6lefJSFWnh xpioEvruzS93x6FuvUYJkXAsMo0tfh2DouD4vFfkUEO4CrzeE0b7F0P2IUGtn/SFJTvLg7K6t6Q 2 X-Gm-Gg: ASbGncsIz+sqbr2y6XMWkqk7VKdvvN8zUFGsebht8uY+SOqpFB56qtNOaWhDGWuOM7Q kehzVnAhTcMzUNxG5SZW+8Ht05LGBwseZ/NW+sAW+p5MgeFXYv05FIpyDTSt/l9IjTMC10PXosa Sn7rc8tsQOi1cpGTDRfOcLzmoX8ecsVHrPlPqlAbSgSQqUhInDfXyn9gaev112Cg9k/9YcFAV1q GAMyuEaTdquGPv9xU6y+OD2dzvJIHpcnSK/SX49hfabEDh7i2oQxtv/p6nmnug/YgAc8O8koyip UApG4MF7eX/4Q/JjAMG3X5GBC5eDI0nCfhb3DRjEbGC/d/2R69jg/22o1EwR5SOzmHhYua+gUw= = X-Google-Smtp-Source: AGHT+IGYQkp5F/Aw1wtxa36XHqRA6Zz6Pvux0Udj8wvBCZ54O02fcB/8L/aJQ3KxWCrkHyYYuPpAhw== X-Received: by 2002:a05:6000:1886:b0:390:e8bf:55a8 with SMTP id ffacd0b85a97d-3911f7412f1mr1814069f8f.18.1741170315547; Wed, 05 Mar 2025 02:25:15 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.14 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:14 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Cc: Michael Halstead Subject: [yocto-autobuilder-helper] [PATCH 07/11] scripts/release-parser.py: changed exceptions after tag clean up Date: Wed, 5 Mar 2025 10:25:02 +0000 Message-ID: <20250305102506.2043524-7-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:22 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1151 From: Michael Halstead Signed-off-by: Michael Halstead --- scripts/release-parser.py | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-) diff --git a/scripts/release-parser.py b/scripts/release-parser.py index e0de351..1e46315 100755 --- a/scripts/release-parser.py +++ b/scripts/release-parser.py @@ -32,9 +32,7 @@ def get_git_tags(): tag_list = [] branches = sorted(set([tag.name[:9] for tag in tags])) # Remove bad tags - branches.remove("yocto-1.9") - branches.remove("yocto_1.5") - branches.remove("yocto-1.4") + branches.remove("yocto-1.9") # To deal with milestone 1 before 1.9 was renamed 2.0. odd_commit_strings = ["rc", "final", "docs"] for branch in branches: From patchwork Wed Mar 5 10:25:03 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58314 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0216CC282E3 for ; Wed, 5 Mar 2025 10:25:22 +0000 (UTC) Received: from mail-wm1-f46.google.com (mail-wm1-f46.google.com [209.85.128.46]) by mx.groups.io with SMTP id smtpd.web10.10380.1741170319144320678 for ; Wed, 05 Mar 2025 02:25:19 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=P1oZZjmy; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.46, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f46.google.com with SMTP id 5b1f17b1804b1-43bd45e4d91so2450345e9.1 for ; Wed, 05 Mar 2025 02:25:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170317; x=1741775117; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=PoaxDWaC2U1gpYDd4yPoakWqQy2zvlKmplBy2bzBI0g=; b=P1oZZjmyr0UB9bb7qj2YyjHk9Nj01T1QgVQsZnJ228XlfHuQ8HtQmXvudM3FINdb0X cJ9KMkqzutAU5ueALmDZ1ssIfsBFNLrjYNSWqrc2AJGpjtQ7ZVEAnTW2Wi6dFXx+yiUI R/tGm92rrs9mmhmthj/2WEZxkeez6fbV7+5og= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170317; x=1741775117; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=PoaxDWaC2U1gpYDd4yPoakWqQy2zvlKmplBy2bzBI0g=; b=ucguLPnprRLt+xDagaQAIybFpgN0Nk5HICug70iN8+ZYe1852IxsSt/dncp17RmrSA GLV6BJbG2wVNPERNWhDpnP6F4Gnxs4Nivq6dOHyTE8+dE5ONr5CzexJzi5Rsqa+XwZgs Psx6LloPduZRg9IEArbFZCQF5orlQu24tfkF7OV7h6M2S5cE6RiH/fQ7UQ6bM3ZZ9S7E +ElGggKAZEkvEsxW140SqorTNk1lf1ZOw1PYLDdEe/87Yu2wN3X7CQyZsHjmtK9BiyF8 3hPXp0Me4bcOxxymGl74qMvSE12qg68pjPKOJ6tnfusejZUF1gnMT3baPw4e2L6JXQjc TYOw== X-Gm-Message-State: AOJu0YytuqjeJEJg9W5KyCtbIu6CJcpO25WVAjnultBLprf/19KvJ6tW JBlxnO2qUgxCcpmqsr5NPu9h0PAb5+1roy2xjT8D+MD1IQWwnCJeZ0R4+IwhdH5uNemLhaGbBw2 l X-Gm-Gg: ASbGnctJMRvGdIefiILpqqnM3EXn7nQvsFBFs3boLEHaQX2i84kY6tjcjV7+WRA/PRf 5TtDrpkFiUUdYscDaOvAraEmOqFfYXcXA/2mjZYir6GXX7j4YkYn2m1H8IXFayEuNkuquvw05HV ZcQhnjVTMBTF+kUCgH8kdkguKf2oensEAK8A/j6fWOd9SDogcNi2q78tmErOo2qvDIw2fGFYbXC Rf3r04DbRbR076RIeH5YeJ6hbbFsZfJUk4a1TMM6OayVnRtoR7ENzO7omf80130D090D1VGgkXI UBrnQqPTymhncWfj1VWSi0qQx/drjIrji0hG8r3X96B6j66bOFLNWc9CLfc+6+FzfJbi0stRhQ= = X-Google-Smtp-Source: AGHT+IEltNCLoPxK47RCVsWJRgnhbx/K/ABNf49TvXwu9nvzTu23I6kBAdIV0DZGxuXOzbufyxS/gg== X-Received: by 2002:a05:600c:54c2:b0:439:9536:fa6b with SMTP id 5b1f17b1804b1-43bcb04ef6fmr60465815e9.13.1741170316732; Wed, 05 Mar 2025 02:25:16 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.15 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:15 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Subject: [yocto-autobuilder-helper] [PATCH 08/11] setup-config: Add support for removevars Date: Wed, 5 Mar 2025 10:25:03 +0000 Message-ID: <20250305102506.2043524-8-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:22 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1152 Signed-off-by: Richard Purdie --- scripts/setup-config | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/scripts/setup-config b/scripts/setup-config index 76f4639..594ff5e 100755 --- a/scripts/setup-config +++ b/scripts/setup-config @@ -96,6 +96,13 @@ extravars = utils.getconfiglistfilter("extravars", ourconfig, args.target, stepn if extravars: variables.extend(extravars) +removevars = utils.getconfiglistfilter("removevars", ourconfig, args.target, stepnum) +if removevars: + for var in variables[:]: + for remove in removevars: + if remove in var: + variables.remove(var) + bh_path, remoterepo, remotebranch, baseremotebranch = utils.getbuildhistoryconfig(ourconfig, args.builddir, args.target, args.reponame, args.branchname, stepnum) if bh_path: variables.append('INHERIT += "buildhistory"') From patchwork Wed Mar 5 10:25:04 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58317 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 32474C28B23 for ; Wed, 5 Mar 2025 10:25:22 +0000 (UTC) Received: from mail-wr1-f44.google.com (mail-wr1-f44.google.com [209.85.221.44]) by mx.groups.io with SMTP id smtpd.web11.10290.1741170320414519882 for ; Wed, 05 Mar 2025 02:25:20 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=aYvUJwv6; spf=pass (domain: linuxfoundation.org, ip: 209.85.221.44, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wr1-f44.google.com with SMTP id ffacd0b85a97d-38f2f391864so3664551f8f.3 for ; Wed, 05 Mar 2025 02:25:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170318; x=1741775118; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=ybsoC9JuIDqD3mMD9sebBQhtbyPmJu1RqGbOajCVTVU=; b=aYvUJwv6jrajT4hIUYRbeZAOKw65QgOTR94wCkb5WQae7H3jYxpBPJVbt1yI4uKcH2 ew95O7Pw9AdtA+dHg8m6zrEO516+nEhg+69ywfv5xnKXRwALWyda3vb93I3Qcf5oe65q 9/sRaOYh/O8HXZ9vIfzezIttLJwY4mtrA6RmM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170318; x=1741775118; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=ybsoC9JuIDqD3mMD9sebBQhtbyPmJu1RqGbOajCVTVU=; b=NVsVDjfoF1+T8wPwD3Z3Ek0pzRg+IWaOkrauF57Rn6K8gjN/tCabGVDa80PCN4da62 S2j7VNmPzBJ2/hUu2TDdKYuxES6IPznABaokeF4gFvuKBcRVQRd5xi/mUSostxbx2caX hl7jy5x1tHZuuP4W8cB8IYwiyUbLztJh/dJ1nrUuIwWGsNihd9RN4hGXvIP7zwlLXdDS HQDmP6XM7Zt8dVM9UNV0IEK8lv1sjt5uqEuUAy0AdNozn02QMMDzauvYCEp7PImFLcGr 8Zv+/IrUugU+s+VsA6xA/q8EG1LAJ7Ymo6N8kt6eEaG9korFgbWSE53SZIDMT7Z+sBud paZQ== X-Gm-Message-State: AOJu0YwywyZDDMSqB39oABBkAoN62/Iq4yn+BfhdRVDG0lZih+IEIrT3 t3VNlyIZRli1/fPbBWXTNYWk93vD2SCqejjIqOrjhEq5V2JRD6WMRPyMh6PvS1MOseUa1HlyCGS l X-Gm-Gg: ASbGncuXS2KR9/C8OTY9C0C6mAkb8s/w27f5NugGbtbIvls5NxNfLWlOS9KtrgsLEUt awiYg2ElkBjNHxVEjFFoWizfgxWyE4GpNOH1GE6wxbsJItr7TGmjU6SN+Hil/nqdeGjA9y0X+a6 vcnutJ0EgU6y4ZIyH3yRw0fG/90i1JeDopXBxjNj/tf03PvUGsrpB69EbVSRdV8VfGG8KTow+ia P09Gc2/D9TbDLMBm7xkofgT3TBOHgE45gE3d6Gfhplhe6N+KbxOhN9HbdGKCysQojS0CvF89tGd la85YquuTr+MihCF0EPXS9YQCAUIvptr5f/MqN8mxFol3U/tBeOjN4rFRTPuq2tQF+Si0vy0cg= = X-Google-Smtp-Source: AGHT+IHUJZHYaBm2BTEK72qiNjFOJG5x4ec1zDzrg4dHA14AwyJnn+AaKD0SU50eFBd+dC9Hc/O7VQ== X-Received: by 2002:a05:6000:401f:b0:38f:3c8a:4c0a with SMTP id ffacd0b85a97d-3911f725934mr1838717f8f.7.1741170318448; Wed, 05 Mar 2025 02:25:18 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.16 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:17 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Subject: [yocto-autobuilder-helper] [PATCH 09/11] config.json: Fix SANITY_TESTED_DISTROS and run earlier Date: Wed, 5 Mar 2025 10:25:04 +0000 Message-ID: <20250305102506.2043524-9-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:22 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1153 Signed-off-by: Richard Purdie --- config.json | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/config.json b/config.json index c5d3913..adb85d1 100644 --- a/config.json +++ b/config.json @@ -511,6 +511,11 @@ "extravars" : [ "SOURCE_MIRROR_FETCH = '1'" ] + }, + "step2" : { + "removevars" : ["SANITY_TESTED_DISTROS"], + "shortname" : "Compare AB workers and SANITY_TESTED_DISTROS", + "EXTRACMDS" : ["${SCRIPTSDIR}/yocto-supported-distros --config-from-web --release-from-env --compare"] } }, "trigger-build-posttrigger" : { @@ -519,10 +524,6 @@ "shortname" : "Source Mirror Selftest", "EXTRACMDS" : ["${SCRIPTSDIR}/checkvnc; DISPLAY=:1 oe-selftest -a -t yocto-mirrors -j 15"], "ADDLAYER" : ["${BUILDDIR}/../meta-selftest"] - }, - "step2" : { - "shortname" : "Compare AB workers and SANITY_TESTED_DISTROS", - "EXTRACMDS" : ["${SCRIPTSDIR}/yocto-supported-distros --config-from-web --release-from-env --compare"] } } From patchwork Wed Mar 5 10:25:05 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58319 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 272FCC282DC for ; Wed, 5 Mar 2025 10:25:32 +0000 (UTC) Received: from mail-wm1-f52.google.com (mail-wm1-f52.google.com [209.85.128.52]) by mx.groups.io with SMTP id smtpd.web10.10381.1741170321805090837 for ; Wed, 05 Mar 2025 02:25:22 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=aTSNnHiC; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.52, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f52.google.com with SMTP id 5b1f17b1804b1-43bc4b16135so18884375e9.1 for ; Wed, 05 Mar 2025 02:25:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170320; x=1741775120; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=0eg04w3vbnkTk5fL4VQwraFB5LVLLWgZMm+PF+J9RXA=; b=aTSNnHiC9oiCkPsKdUQXIqtlKbocUXf3jBCPfFfGvJoPCosoSazvNTbZpv/MY2g0CH +K1ssCSX4+q6/bfUle42PRzcpwcVeY36f+2H6bVZqM+qQOiSNLJh2gPM5xDYoV4+TmpA SbX9ReTYKNmdPDzs9WaEuLnwXa8gRexizHQsw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170320; x=1741775120; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=0eg04w3vbnkTk5fL4VQwraFB5LVLLWgZMm+PF+J9RXA=; b=Z4AOMsKi/WYvx1ZGbg1hcuTO2Vx4j62uzGkx0yBbH+txj8f6I8f1tOKqRWURije1OB RBqWc/uJdvyEI8r8cq5Y80AKWceOAKCQxDFJIwUk53Ci4MYNi3epdHFQAw4aY+qj4eoI gJ6xlfvDMBg2SpM7suM3Kq5xy1H5x0P+5Rm4EpVRGu0flwurx72+p0CZsGp1b4LYui+B 9+gofJoOhcfQ7F4WUnXem1q9pvq6SBPXyk7XjTDxq1deO8IbFtEMP95u9Y48S7CGzoXK PMoady4yDaI5n+1yzJjFGmNEBLvaD35wR4fPDBAMiXvRo/bRI/qFJZ1mfIeOC5LqQXQV F6rw== X-Gm-Message-State: AOJu0YxoyeibWXXfOZ0PA4GToxrtf/QDV+RX1ilWYJecAacNv7j2IBIt DMNndD3fq6sZ3OG3LS2WBmBpNi8kQYNDSlCCfxXrdSrLPR6bCUBY81DVggrDLYFXfSoGKQOV/zU d X-Gm-Gg: ASbGnctGWHfoWDMBmmEiw4WUrR8bFWZedIwOddxL9Tpw/GLmU5vtu5UzUQgJL/WCfxR 46T9FtB8/WV5MG5HIawAeGUUP9veCbCOum6QiXZeDNnvo0a1V9H/pU2UuzazHwngX7whbamMgpM BMIN11HYPTCKrGjVgsUHTW3q3xN2PGJtUyoBd0wQ8ri0Z3UHdFuE+9bBt6aIaoIwd1CqqHVQRkP wZbqFumrERh/BG7KEaYz2bEIalRhdmQ4G3ts/3txlRIioYiUNDZheux3m1RDsvfP/3cCpWjKMFl TkaMnDXg9SkZmn7iwqI2Ow85vY9rT/JibcWTrengQ9uXbGIwnmsOHWcr+WNcsoIDyfn7pPMBtA= = X-Google-Smtp-Source: AGHT+IEDjcms7f8LBFHZUOdZEDA58saCnVp0KG63A8vWNBw7pyQ0EodT16iNAu/jOEPvytT/UY6AhA== X-Received: by 2002:a05:600c:468e:b0:43b:bdf4:1c9 with SMTP id 5b1f17b1804b1-43bd2af4b26mr16867515e9.29.1741170319783; Wed, 05 Mar 2025 02:25:19 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.18 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:18 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Subject: [yocto-autobuilder-helper] [PATCH 10/11] config.json/utils: Disable buildtools and poky repo for indexing Date: Wed, 5 Mar 2025 10:25:05 +0000 Message-ID: <20250305102506.2043524-10-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:32 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1154 Signed-off-by: Richard Purdie --- config.json | 1 + scripts/run-config | 4 +++- 2 files changed, 4 insertions(+), 1 deletion(-) diff --git a/config.json b/config.json index adb85d1..cdcb2f8 100644 --- a/config.json +++ b/config.json @@ -1367,6 +1367,7 @@ } }, "indexing" : { + "NEEDEDREPOS" : [], "step1" : { "shortname" : "Generate non-release index", "EXTRACMDS" : ["${SCRIPTSDIR}/generate-testresult-index.py ${BASE_SHAREDDIR}/pub/non-release/"] diff --git a/scripts/run-config b/scripts/run-config index fb71721..bf2855f 100755 --- a/scripts/run-config +++ b/scripts/run-config @@ -136,7 +136,9 @@ def addstepentry(name, taskdesc, shortname, description, detail, phase, usepty=F bbdesc = bbdesc + ": " + detail jsonconfig.append({"name" : name, "bbname" : bbname[:46], "phase" : phase, "description" : bbdesc, "usepty" : usepty}) -if jcfg: +if args.target == "indexing": + pass +elif jcfg: buildtools = utils.setup_buildtools_tarball(ourconfig, args.workername, None, checkonly=True) if buildtools: addentry("buildtools", "Setup buildtools tarball", "init") From patchwork Wed Mar 5 10:25:06 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 58320 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 20AFBC19F32 for ; Wed, 5 Mar 2025 10:25:32 +0000 (UTC) Received: from mail-wm1-f41.google.com (mail-wm1-f41.google.com [209.85.128.41]) by mx.groups.io with SMTP id smtpd.web10.10382.1741170323134046847 for ; Wed, 05 Mar 2025 02:25:23 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=cF7IyTlD; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.41, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f41.google.com with SMTP id 5b1f17b1804b1-43bccfa7b89so12636655e9.2 for ; Wed, 05 Mar 2025 02:25:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1741170321; x=1741775121; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=4LRSdb7W6bF/3xqHfxvSaRBCkGgivdW/NtiN9hl4VFg=; b=cF7IyTlDWyufkmrvNPxakLQxhbIxZOq0BwyWfPdsMP1TcbWzsOUJexDGGcTCWed8Qq REgC/75D/m0/VhUjt9GcbYOuFgiOBGGrTcImd2P9GORzJtFrpsMeQqly9aPApFO26dB4 jcHu2IWctTA7BAfl+ZUzW+aIeFXP0F2mnrOdA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741170321; x=1741775121; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=4LRSdb7W6bF/3xqHfxvSaRBCkGgivdW/NtiN9hl4VFg=; b=nKwx1+emeFw9TbgpoACpe0nyuBax3001YF2vXaOOiztWUIoB7uO2tXJ7GErGeP6/Jl pSnL6MPi0x8Q7QBcbU2ohX0e1t51hIrS+E1sdd6ySaw5gd/aFCOxe/DFRx06TLHQmLFD FgSSC28V8f58AB5dK34DnAlCKri2fADMHDEwamQdxlqC23/Ln/NXkvdsQfhObdU0kHBv tD6Z27xDv19IA+3JQxfK2KjYednmyOu4gqZa3uMq9px7H15Sc1ddUrV50r246HO20B0U YeC8eVMmWg3s1TU7WAc/SzVeW7sDjIsnLdBs/S1g5wA+PWWusqcr9DpHnoPpRua83p0e M4tw== X-Gm-Message-State: AOJu0YzN3NpTKHEl5Qgr2h340b9DamLJ0O51FEBmyOe4Txk4N18VpMQB zc1Ba430GUpaEWduLqcmhbIieKRAyB1kvyXslHYkW6OG3Q14dpUkcTnIIr0ry1a8D18xwb/IAUZ b X-Gm-Gg: ASbGncs3KOgxO1jzNb8gJBUpxV3L5op7fV0TB3ZXqz+dV1/VqVwN06RlhhkF02Z7O2o CvvDqBeVksNr7J1vDcnzt6IYDKatLcJGcxupLeblbTbYKu145yxzsxw4fSKifybq7lTtJYPbu5o nsMygj/MDpjK5/66HJ2m5Z8+Fv6EWeokCZs/AISnF4qNrpr08b3eoXXmCQ8UBDX0OviRoN8ZEGn Js/E5c7bWeqboY4eAnIX2YZaJLclsXO3vUninFvDO5IJQ1v6fnvDjbGgyDDBcUnjgmNBswGusHY 0CnBJcvBDO112g882sJKwfCnDFHDdHDucOagAn5uGpgcpjGf5rZWUEy4ISns4WTcQ0rJcd7Mbw= = X-Google-Smtp-Source: AGHT+IEVThEUuvFP19JTldxCZ29sAHpwI9WjE9WQA2mMTLrZ/3WLm43k4U6UEIRao3Ftj6qa8m4YuA== X-Received: by 2002:a05:600c:511c:b0:43b:c0fa:f9cd with SMTP id 5b1f17b1804b1-43bd2972e1dmr18495265e9.7.1741170321093; Wed, 05 Mar 2025 02:25:21 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:939e:c44d:2366:e8da]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-43bd4352eb1sm12973495e9.31.2025.03.05.02.25.19 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Mar 2025 02:25:20 -0800 (PST) From: Richard Purdie To: yocto-patches@lists.yoctoproject.org Subject: [yocto-autobuilder-helper] [PATCH 11/11] scripts/run-toaster-tests: Add check of toaster fixtures against current release data Date: Wed, 5 Mar 2025 10:25:06 +0000 Message-ID: <20250305102506.2043524-11-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> References: <20250305102506.2043524-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 05 Mar 2025 10:25:32 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/1155 Add a check of the fixture data to try and ensure we don't release with incorrect configuration for toaster. Signed-off-by: Richard Purdie --- scripts/run-toaster-tests | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/scripts/run-toaster-tests b/scripts/run-toaster-tests index fbbdd51..014c714 100755 --- a/scripts/run-toaster-tests +++ b/scripts/run-toaster-tests @@ -31,3 +31,9 @@ source venv/bin/activate python3 -m pip install -r $pokydir/bitbake/toaster-requirements.txt -r $pokydir/bitbake/lib/toaster/tests/toaster-tests-requirements.txt python3 -m pytest -c $pokydir/bitbake/lib/toaster/pytest.ini $pokydir/bitbake/lib/toaster/tests/ + +if [ -e $pokydir/bitbake/lib/toaster/orm/fixtures/check_fixtures.py ]; then + echo "Checking toaster fixtures" + cd $pokydir/bitbake/lib/toaster/orm/fixtures/ + $pokydir/bitbake/lib/toaster/orm/fixtures/check_fixtures.py +fi