From patchwork Fri Sep 4 13:38:12 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 97316 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id E9371C61DD6 for ; Fri, 4 Sep 2026 13:38:27 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.msgproc02-g2.13886.1788529099001381789 for ; Fri, 04 Sep 2026 06:38:19 -0700 Authentication-Results: mx.groups.io; dkim=fail reason="dkim: body hash did not verify" header.i=@arm.com header.s=foss header.b=vNhVpy2u; spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id C8609152B for ; Fri, 4 Sep 2026 06:38:14 -0700 (PDT) Received: from cesw-amp-gbt-1s-m12830-04.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 246003F7D8 for ; Fri, 4 Sep 2026 06:38:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1788529098; bh=OJDLPjjnIACLhS0hrM5tOYlwgDi+iesO84nKzAUHdHk=; h=From:To:Subject:Date:From; b=vNhVpy2uD4faYmHwfZTTTWRZCqAiOlDJ/J5kEd6wHyg6IaqhEdKFe89lNUx5l8L7x YctLjqbpREthq3goPmy/YI421Mhmum0B5s+lG5KmKta2FTCCthoJ/E5jR48A6MQljo mOlEJqNgZsA6rCHL2SNrWCcyaTrYM8Jc26NXy/JA= From: Ross Burton To: openembedded-core@lists.openembedded.org Subject: [PATCH v2 1/4] python/*: remove spurious CLEANBROKENs Date: Fri, 4 Sep 2026 14:38:12 +0100 Message-ID: <20260904133815.778303-1-ross.burton@arm.com> X-Mailer: git-send-email 2.43.0 MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 04 Sep 2026 13:38:27 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/245110 CLEANBROKEN doesn't do anything with the current build classes as they override base_do_configure(). Signed-off-by: Ross Burton --- meta/recipes-devtools/python/python3-babel_2.18.0.bb | 2 -- meta/recipes-devtools/python/python3-click_8.5.0.bb | 2 -- meta/recipes-devtools/python/python3-jinja2_3.1.6.bb | 2 -- meta/recipes-devtools/python/python3-lxml_6.1.2.bb | 2 -- 4 files changed, 8 deletions(-) diff --git a/meta/recipes-devtools/python/python3-babel_2.18.0.bb b/meta/recipes-devtools/python/python3-babel_2.18.0.bb index 26847372bf3..cf2752f6a23 100644 --- a/meta/recipes-devtools/python/python3-babel_2.18.0.bb +++ b/meta/recipes-devtools/python/python3-babel_2.18.0.bb @@ -11,8 +11,6 @@ CVE_PRODUCT = "pocoo:babel" S = "${UNPACKDIR}/babel-${PV}" -CLEANBROKEN = "1" - RDEPENDS:${PN} += " \ python3-codecs \ python3-difflib \ diff --git a/meta/recipes-devtools/python/python3-click_8.5.0.bb b/meta/recipes-devtools/python/python3-click_8.5.0.bb index 88844676928..05a8fb343a7 100644 --- a/meta/recipes-devtools/python/python3-click_8.5.0.bb +++ b/meta/recipes-devtools/python/python3-click_8.5.0.bb @@ -25,8 +25,6 @@ do_install_ptest:append() { cp -rf ${S}/docs ${D}${PTEST_PATH}/ } -CLEANBROKEN = "1" - RDEPENDS:${PN} += "\ python3-io \ python3-threading \ diff --git a/meta/recipes-devtools/python/python3-jinja2_3.1.6.bb b/meta/recipes-devtools/python/python3-jinja2_3.1.6.bb index 2e96eb0dcb3..add266095df 100644 --- a/meta/recipes-devtools/python/python3-jinja2_3.1.6.bb +++ b/meta/recipes-devtools/python/python3-jinja2_3.1.6.bb @@ -10,8 +10,6 @@ PYPI_PACKAGE = "jinja2" CVE_PRODUCT = "jinja2 jinja" -CLEANBROKEN = "1" - inherit pypi python_flit_core ptest-python-pytest do_install_ptest:append() { diff --git a/meta/recipes-devtools/python/python3-lxml_6.1.2.bb b/meta/recipes-devtools/python/python3-lxml_6.1.2.bb index a0162cab3ff..17c5d769a0c 100644 --- a/meta/recipes-devtools/python/python3-lxml_6.1.2.bb +++ b/meta/recipes-devtools/python/python3-lxml_6.1.2.bb @@ -40,5 +40,3 @@ BBCLASSEXTEND = "native nativesdk" RDEPENDS:${PN} += "libxml2 libxslt python3-compression" CVE_PRODUCT = "lxml:lxml" - -CLEANBROKEN = "1" From patchwork Fri Sep 4 13:38:13 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 97315 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 410A1C624D3 for ; Fri, 4 Sep 2026 13:38:28 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.msgproc02-g2.13887.1788529099753454006 for ; Fri, 04 Sep 2026 06:38:19 -0700 Authentication-Results: mx.groups.io; dkim=fail reason="dkim: body hash did not verify" header.i=@arm.com header.s=foss header.b=m7lUNIiB; spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 8D8AF152B for ; Fri, 4 Sep 2026 06:38:15 -0700 (PDT) Received: from cesw-amp-gbt-1s-m12830-04.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id D3C413F7D8 for ; Fri, 4 Sep 2026 06:38:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1788529099; bh=0dX4NtREhaRB/Aei7eEDxpMoK/NdbCQuToowNQ0MHQE=; h=From:To:Subject:Date:In-Reply-To:References:From; b=m7lUNIiBfKDtYTtOw5eW713wEhAFgrwE7cb9it22Qc6pxusQEe+DNf1dOFn3pSiYT i5iKAxRFubmKk2TCJI7cDYMMZHs/QNOcNqCr5aBkxnq23Au+Kc+0uXDTRiYFJVL5bB Wka7AU37m8PzUQwZNMSaVtmWe2+6Aswl7Rq0dOR0= From: Ross Burton To: openembedded-core@lists.openembedded.org Subject: [PATCH v2 2/4] classes/pypi: only set downloadprefix in SRC_URI if needed Date: Fri, 4 Sep 2026 14:38:13 +0100 Message-ID: <20260904133815.778303-2-ross.burton@arm.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20260904133815.778303-1-ross.burton@arm.com> References: <20260904133815.778303-1-ross.burton@arm.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 04 Sep 2026 13:38:28 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/245111 Don't bloat the SRC_URI by setting a redundant downloadprefix if it is not required. Signed-off-by: Ross Burton --- meta/classes-recipe/pypi.bbclass | 9 +++++++-- 1 file changed, 7 insertions(+), 2 deletions(-) diff --git a/meta/classes-recipe/pypi.bbclass b/meta/classes-recipe/pypi.bbclass index 0897994bb65..b42b171e151 100644 --- a/meta/classes-recipe/pypi.bbclass +++ b/meta/classes-recipe/pypi.bbclass @@ -25,8 +25,13 @@ def pypi_src_uri(d): """ package = d.getVar('PYPI_PACKAGE') archive_name = d.expand('${PYPI_PACKAGE}-${PV}.${PYPI_PACKAGE_EXT}') - archive_downloadname = d.getVar('PYPI_ARCHIVE_NAME_PREFIX') + archive_name - return 'https://files.pythonhosted.org/packages/source/%s/%s/%s;downloadfilename=%s' % (package[0], package, archive_name, archive_downloadname) + url = 'https://files.pythonhosted.org/packages/source/%s/%s/%s' % (package[0], package, archive_name) + + download_prefix = d.getVar("PYPI_ARCHIVE_NAME_PREFIX") + if download_prefix: + url += ";downloadfilename=" + download_prefix + archive_name + + return url def pypi_normalize(d): """" From patchwork Fri Sep 4 13:38:14 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 97317 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 5C639C79F82 for ; Fri, 4 Sep 2026 13:38:28 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.msgproc02-g2.13889.1788529100520856390 for ; Fri, 04 Sep 2026 06:38:20 -0700 Authentication-Results: mx.groups.io; dkim=fail reason="dkim: body hash did not verify" header.i=@arm.com header.s=foss header.b=nvBDLOUC; spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 5228F152B for ; Fri, 4 Sep 2026 06:38:16 -0700 (PDT) Received: from cesw-amp-gbt-1s-m12830-04.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 97D283F7D8 for ; Fri, 4 Sep 2026 06:38:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1788529100; bh=CNgXIB5DljLDY3RSidcTRnJezIFFTRMq7gs4yZf+ZWw=; h=From:To:Subject:Date:In-Reply-To:References:From; b=nvBDLOUCx0r3nKkX2T1PiojpSwBhx7yrOZodFyixYjdkSpNiG/Z19LkpxKawrW3r9 aOhGqycoNJM+32V+3wedZiaDGOSpIiKDELRmerSByFxVyRpbmV6LtZfOPb+zht9nP7 xWYhUu+VETUTdiNq25/tpHLxD1uumY2ZIUmXeAmA= From: Ross Burton To: openembedded-core@lists.openembedded.org Subject: [PATCH v2 3/4] classes/pypi: rename pypi_package() to pypi_default_package() Date: Fri, 4 Sep 2026 14:38:14 +0100 Message-ID: <20260904133815.778303-3-ross.burton@arm.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20260904133815.778303-1-ross.burton@arm.com> References: <20260904133815.778303-1-ross.burton@arm.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 04 Sep 2026 13:38:28 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/245112 Make it clear that this function returns a default value. Signed-off-by: Ross Burton --- meta/classes-recipe/pypi.bbclass | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/meta/classes-recipe/pypi.bbclass b/meta/classes-recipe/pypi.bbclass index b42b171e151..eb13ffe7e71 100644 --- a/meta/classes-recipe/pypi.bbclass +++ b/meta/classes-recipe/pypi.bbclass @@ -4,7 +4,11 @@ # SPDX-License-Identifier: MIT # -def pypi_package(d): +def pypi_default_package(d): + """ + Return a reasonable guess for the PyPI package name by + stripping any python- prefix from PN. + """ bpn = d.getVar('BPN') if bpn.startswith('python-'): return bpn[7:] @@ -13,7 +17,7 @@ def pypi_package(d): return bpn # The PyPi package name (defaults to PN without the python3- prefix) -PYPI_PACKAGE ?= "${@pypi_package(d)}" +PYPI_PACKAGE ?= "${@pypi_default_package(d)}" # The file extension of the source archive PYPI_PACKAGE_EXT ?= "tar.gz" # An optional prefix for the download file in the case of name collisions From patchwork Fri Sep 4 13:38:15 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ross Burton X-Patchwork-Id: 97318 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6AF17C79F88 for ; Fri, 4 Sep 2026 13:38:28 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by mx.groups.io with SMTP id smtpd.msgproc01-g2.14076.1788529101185685236 for ; Fri, 04 Sep 2026 06:38:21 -0700 Authentication-Results: mx.groups.io; dkim=fail reason="dkim: body hash did not verify" header.i=@arm.com header.s=foss header.b=TV3QmtEZ; spf=pass (domain: arm.com, ip: 217.140.110.172, mailfrom: ross.burton@arm.com) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 0BA72152B for ; Fri, 4 Sep 2026 06:38:17 -0700 (PDT) Received: from cesw-amp-gbt-1s-m12830-04.lab.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 5CED23F7D8 for ; Fri, 4 Sep 2026 06:38:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1788529100; bh=PuDrsPA72b2M+Fe/H4N5AvOk015S+LfOHJN0yeUxZrw=; h=From:To:Subject:Date:In-Reply-To:References:From; b=TV3QmtEZSED9hjRaGAG9/1mPvKGEHZl9M1JzANMXypx14TfcLwU7xiIqziPD6pfeV nU21ZWj7ClMNPBT3kDjGcimlAoyjYv7noqMq5mGw7xqGXiYwCVSkSET4MGn0yXE9t4 RitCp938DkjIyCO1ydgEbo4kNN8g0J5lWPuaNWyk= From: Ross Burton To: openembedded-core@lists.openembedded.org Subject: [PATCH v2 4/4] pypi: improve upstream check regex Date: Fri, 4 Sep 2026 14:38:15 +0100 Message-ID: <20260904133815.778303-4-ross.burton@arm.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20260904133815.778303-1-ross.burton@arm.com> References: <20260904133815.778303-1-ross.burton@arm.com> MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 04 Sep 2026 13:38:28 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/245113 Currently the upstream release checker fetches the Simple API release index which lists all of the uploaded files. However the naming rules have evolved over time[1] so matching the value of PYPI_PACKAGE fails if the sdist filename was not normalised but then is normalised. Remove UPSTREAM_CHECK_PYPI_PACKAGE which is realistically unused[2] and instead transform the PYPI_PACKAGE into a regular expression that handles both - and _ being used in the filename. Change the version number match so that it handles .postN suffixes, as defined in the Version Specifiers documentation[3]. We don't want to match any alphanumeric characters as this would also match development snapshots and release candidates. Finally escape the . between the version and the extension, so this matches a literal . and not any character. Across oe-core and meta-oe this improves the upstream detection quite significantly: - 93 recipes move from a broken check to up-to-date - 21 recipes move from a broken check to needing an update - 30 recipes move from up-to-date to needing an update [1] Specifically PEP-0427 introduced normalisation of special characters to underscores and lowercasing. [2] No users in oe-core, three in meta-oe which are no longer needed after this change. [3] https://packaging.python.org/en/latest/specifications/version-specifiers/ Signed-off-by: Ross Burton --- meta/classes-recipe/pypi.bbclass | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-) diff --git a/meta/classes-recipe/pypi.bbclass b/meta/classes-recipe/pypi.bbclass index eb13ffe7e71..08788fcb9a9 100644 --- a/meta/classes-recipe/pypi.bbclass +++ b/meta/classes-recipe/pypi.bbclass @@ -39,8 +39,7 @@ def pypi_src_uri(d): def pypi_normalize(d): """" - Normalize the package names to match PEP625 (https://peps.python.org/pep-0625/). - For non-compliant packages, maintainers can set UPSTREAM_CHECK_PYPI_PACKAGE to override the normalization + Normalize the package names to match PEP625 (https://peps.python.org/pep-0625/). """ import re return re.sub(r"[-_.]+", "-", d.getVar('PYPI_PACKAGE')).lower() @@ -52,7 +51,10 @@ SECTION = "devel/python" SRC_URI:prepend = "${PYPI_SRC_URI} " S = "${UNPACKDIR}/${PYPI_PACKAGE}-${PV}" -UPSTREAM_CHECK_PYPI_PACKAGE ?= "${PYPI_PACKAGE}" +def pypi_normalize_regex(d): + # Use a regex wildcard instead of hyphen as the filenames + # may or may not have been normalised properly. + return pypi_normalize(d).replace("-", "[_-]") # Use the simple repository API rather than the potentially unstable project URL # More information on the pypi API specification is avaialble here: @@ -60,7 +62,7 @@ UPSTREAM_CHECK_PYPI_PACKAGE ?= "${PYPI_PACKAGE}" # # NOTE: All URLs for the simple API MUST request canonical normalized URLs per the spec UPSTREAM_CHECK_URI ?= "https://pypi.org/simple/${@pypi_normalize(d)}/" -UPSTREAM_CHECK_REGEX ?= "(?i)${UPSTREAM_CHECK_PYPI_PACKAGE}-(?P(\d+[\.\-_]*)+).(tar\.gz|tgz|zip|tar\.bz2)" +UPSTREAM_CHECK_REGEX ?= "(?i)${@pypi_normalize_regex(d)}-(?P(\d+(\.[\d\-]+)*(\.post\d+)?))\.(tar\.gz|tgz|zip|tar\.bz2)" CVE_PRODUCT ?= "python:${PYPI_PACKAGE}"