From patchwork Fri Sep 11 22:18:03 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 98060 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4F516C88E50 for ; Fri, 11 Sep 2026 22:18:12 +0000 (UTC) Received: from mail-wm1-f43.google.com (mail-wm1-f43.google.com [209.85.128.43]) by mx.groups.io with SMTP id smtpd.msgproc01-g2.50926.1789165091507943916 for ; Fri, 11 Sep 2026 15:18:11 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=U8NX83xv; spf=pass (domain: smile.fr, ip: 209.85.128.43, mailfrom: yoann.congal@smile.fr) Received: by mail-wm1-f43.google.com with SMTP id 5b1f17b1804b1-49e6bad7b79so2060405e9.1 for ; Fri, 11 Sep 2026 15:18:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1789165090; x=1789769890; darn=lists.openembedded.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to:content-type; bh=axi61h0WHCdVUY9vUSJp256LW2U73rjmepsQYD4aJX8=; b=U8NX83xvZ8HoMy1gAzooi4jtNENCiEpg4+rua+kaDYI5G8d/Q8ClLkpvQmr3+sKnnL rncBcgdLD9HMT8Oyj0mpyeNU3wPOGfSRvBiIxR72FNAGGqDcP7o+vvAl4calvh08Q7B6 NVwYD011NcUR166W5jbN3CldKQBgpiENg64Uo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1789165090; x=1789769890; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to:content-type; bh=axi61h0WHCdVUY9vUSJp256LW2U73rjmepsQYD4aJX8=; b=NU+4yY7oSQuG+C0kbkkCglCfckDOO9790W4fJ1dLBN7A4isUDda411R/XS/4WkwOt8 GxhAZtlyfSL2Vo2imXInSEmF4ohmVEahMLBqjOcQD+1T2onxv1JeKj+NiE12zD8TjePx gBPQ/gaofPQ/kwvm6dT0gvXf7pR46yBuzwiH/hRtSKbKGsGiAMARwFNIJQaHZILfRqaU jrMiwtvlebnVp6BqcHU+zYuXd0R44z/qnjUyUTsXL32qmRnPWc90p8wegzOlWyo+hNFa +NaVD8GFgVU+Es/X7LXn+nY852SBh/8pcZ/IOuElGEmoc+Ym0Fe9kXD5aPJDDI5iKiio Ctlg== X-Gm-Message-State: AFuF++ljDp8hU7urtxg1NrZtnQ9j6Z5QIIj7Wk0v8XXbx2aGX+Bv147T qYTOOVgREECEYYOFPDcrnxDCJKbrf0SIyEAS84amcTC7jD8kXGUdNb7ND8/OXMUwurKHw9t13Mj 6W71R7dQ= X-Gm-Gg: AYBFou3tZQoeiPgjbumidg51Bn+esS2Z03WBrFTiPQ8Gd4cgy6FF8XPFSxG1viqGxal AaPQXqObhhywTsgPcHfhPWbRLSV2AFy/TFG4p6z5zAgwoULXzg2l8coKWBIvx5/SJGwj2NxfXyy 299hzcjI6JOtyeOR23kAO2qWyvvdlIEWOQQBqcEEZ3ZndKR0eTpIXNI+oqF1ylIsoW1QSrfQgMl 5XcEFlRcR0tFSaxQytabNKvC3L0ue8Pi0+nKkWQoxa7xoPqLF8GPfHD5R9IR4v5/RW0q9xJKmRH paxCC78yNcdQlbFMxcQ7puks3J4J+AfQVDJ1NDlVXA4pAThty1+Te7RxigvI8SGtu38l3dp1Jq3 f695mPP9AE0Eig1VdI0Elfw6iM1+HV+1QHSmQRK563+zElFjOL4wjVQ1yh5r0sibXyaKuT+i+Zk gQ/7RZhlwCaMh1xtMrPgTQU7JdGs35VjDGTLtbOoW4IS5bXiwTHf3hDtT/C0BAahovnJbeg9frk pSYX59Jrowg5msIJDE6hhQb2ntWhjLbvU3C1Py7/vp07CM0pSOOt5gbcg/xrTZgpLICyTI4AOI= X-Received: by 2002:a05:600d:8485:20b0:49d:1e3d:3b3f with SMTP id 5b1f17b1804b1-49e6198bd27mr19422855e9.8.1789165089709; Fri, 11 Sep 2026 15:18:09 -0700 (PDT) Received: from FRSMI25-LASER.home (2a01cb001331aa00a2e4fb7b0d887544.ipv6.abo.wanadoo.fr. [2a01:cb00:1331:aa00:a2e4:fb7b:d88:7544]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-49e61a33e34sm78235165e9.0.2026.09.11.15.18.09 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Sep 2026 15:18:09 -0700 (PDT) From: Yoann Congal To: bitbake-devel@lists.openembedded.org Subject: [bitbake][scarthgap][2.8][PATCH 1/4] fetch2/gcp: treat GatewayTimeout as fetch failure Date: Sat, 12 Sep 2026 00:18:03 +0200 Message-ID: X-Mailer: git-send-email 2.47.3 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 11 Sep 2026 22:18:12 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/bitbake-devel/message/20184 From: Sebastian Muxel blob.exists() and blob.download_to_filename() can raise google.api_core.exceptions.GatewayTimeout after the GCS client's own retries. Uncaught, that escapes as a hard error instead of a normal fetch/checkstatus failure (and blocks mirror fallback on download). Catch GatewayTimeout in checkstatus() and download(), log a warning so the timeout is visible, and raise FetchError. (cherry-picked from commit 251f01e9afa1dcb9a49f8a31981e698017a43754) AI-Generated: Cursor with Grok 4.5 Signed-off-by: Sebastian Muxel Signed-off-by: Etienne Cordonnier Signed-off-by: Mathieu Dubois-Briand Signed-off-by: Richard Purdie Signed-off-by: Etienne Cordonnier Signed-off-by: Yoann Congal --- lib/bb/fetch2/gcp.py | 24 ++++++++++++++++++++++-- 1 file changed, 22 insertions(+), 2 deletions(-) diff --git a/lib/bb/fetch2/gcp.py b/lib/bb/fetch2/gcp.py index 2ee9ed219..c3cbc948f 100644 --- a/lib/bb/fetch2/gcp.py +++ b/lib/bb/fetch2/gcp.py @@ -57,7 +57,7 @@ class GCP(FetchMethod): Fetch urls using the GCP API. Assumes localpath was called first. """ - from google.api_core.exceptions import NotFound + from google.api_core.exceptions import GatewayTimeout, NotFound logger.debug2(f"Trying to download gs://{ud.host}{ud.path} to {ud.localpath}") if self.gcp_client is None: self.get_gcp_client() @@ -71,6 +71,13 @@ class GCP(FetchMethod): blob.download_to_filename(ud.localpath) except NotFound: raise FetchError("The GCP API threw a NotFound exception") + except GatewayTimeout as e: + # The GCS client already retries GatewayTimeout internally. + # Raise FetchError so mirror fallback can proceed. + logger.warning( + f"GCP API GatewayTimeout while downloading gs://{ud.host}{ud.path}: {e}" + ) + raise FetchError(f"Transient GCP API GatewayTimeout for gs://{ud.host}{ud.path}") # Additional sanity checks copied from the wget class (although there # are no known issues which mean these are required, treat the GCP API @@ -88,6 +95,8 @@ class GCP(FetchMethod): """ Check the status of a URL. """ + from google.api_core.exceptions import GatewayTimeout + logger.debug2(f"Checking status of gs://{ud.host}{ud.path}") if self.gcp_client is None: self.get_gcp_client() @@ -96,7 +105,18 @@ class GCP(FetchMethod): # Path sometimes has leading slash, so strip it path = ud.path.lstrip("/") - if self.gcp_client.bucket(ud.host).blob(path).exists() == False: + try: + exists = self.gcp_client.bucket(ud.host).blob(path).exists() + except GatewayTimeout as e: + # The GCS client already retries GatewayTimeout internally. + # Surface a normal checkstatus failure and warn so the timeout + # is visible to operators. + logger.warning( + f"GCP API GatewayTimeout while checking gs://{ud.host}{ud.path}; treating as unavailable: {e}" + ) + raise FetchError(f"Transient GCP API GatewayTimeout for gs://{ud.host}{ud.path}") + + if exists == False: raise FetchError(f"The GCP API reported that gs://{ud.host}{ud.path} does not exist") else: return True From patchwork Fri Sep 11 22:18:04 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 98063 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 22DE1C88E50 for ; Fri, 11 Sep 2026 22:18:22 +0000 (UTC) Received: from mail-wm1-f41.google.com (mail-wm1-f41.google.com [209.85.128.41]) by mx.groups.io with SMTP id smtpd.msgproc01-g2.50927.1789165091942869887 for ; Fri, 11 Sep 2026 15:18:12 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=QYfB0q0h; spf=pass (domain: smile.fr, ip: 209.85.128.41, mailfrom: yoann.congal@smile.fr) Received: by mail-wm1-f41.google.com with SMTP id 5b1f17b1804b1-4998b5a63e2so15587015e9.1 for ; Fri, 11 Sep 2026 15:18:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1789165090; x=1789769890; darn=lists.openembedded.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to:content-type; bh=kkI2oZvPkujyEJtYMkC2DwOuibdL1lKhe8C44FKDAeA=; b=QYfB0q0hodJ47ZSw35UhpmRnpLUjx2EfUDRvDamtpOpnd9nAvfTe23Y+59VBQjUUlZ faNGeHWdrS3Kqk7e80DNTqkC6tYrbkUnjLDFnnyyYkQPgR1SR2cVQxSmTZbHwOmZYyst 2B133cEa/aOUTr7a7ZeS37WdRM8STR6SznLuQ= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1789165090; x=1789769890; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to:content-type; bh=kkI2oZvPkujyEJtYMkC2DwOuibdL1lKhe8C44FKDAeA=; b=H8cVsYIP3BuCR5nIYxuKHiUX3Pq0Vl09LzZYuFHWvot5fSIi1GPEjQygMtVeqeHHX8 FLnw4aZ4/VdR82XbZdWwbrLV0Nt6Wm7o/MLodmccpbhOXkxRyt832xWsxON+gVmbUSO6 iI2gjGjXwfuD7UIO3NGze7Kt5w1vGnhlXqw1sWt+76/UXHS4H9uAsYAhKePEgH1jxVvm V9TkWDA4M+iQo6m6LyS0ChyMhy69uIf6/X6nkdHQljMYP26nXh50goEG0blUHvtqg6mj +A5KqMKdjn5I6HPltRuj927hqlBMfeyDod5Cu/60UwopnOhSx1MpknAPUIfMSlvkmUNK TOnw== X-Gm-Message-State: AFuF++l8lvXB58UHQtZErv3BobD4JDI8ljMvEzFE0EEV84HwpDBDtr1G OwKjqA7GUxghZucGZOMR+PWoUib6LGWgLKX6Qpl3FQJ1pDV4F653NZGZXG5/Hx/eaujKcc2xcJM blA881mk= X-Gm-Gg: AYBFou2XrgqxDy28j5pW4XP/YlkEL0Gy2SMrjPnjhko0gqERciZP/LJ82T8hzvNAQak AEPyTqcj3nkIYo23HfAvjLyRCsa1yrry7CrcZLfSklXFXbB7H42rqpXmSJ9l5KW2lOydC7ZxV9p DvUccV2Yw2loEIYL+HPO3ffdHTn8zMDNdv60w295vxEQ8Qv5umfHIg0uP+NzLB1YF+DY2XZXX6U UTmwJocmAGWtLR0CNKownYvSE8PZdLFGxHA+ll/Jjwees5c491kgyWpUpvwaMnTeB7WVMkLQtv3 AzVPkxC6RQ3ccRfdz55ejYMnrtaW6XMtYSSkLMdDttHRVCHBte11t0qy6C6LnpKBkAMlJZreax3 44JXZOFEINiwfobZL2xZUkBr2l4pjkjQoWJ6ou+VAcwxhrh0KwrwaWTQCixslStaUz+F9zBhxpY zPVHU5MjtZgNCuK7uahaUQ9HuUW2KJt6NjxP30sj/yM3tc3oDK++npmE8kaPQgkXVvkprxTWfe+ HDb5U2YAC8tC4r0TlnnKeJpOELmcXaetpiHPQaj90wZqLu6nnA77344NtVJsi+51Bfq0Li+Sag= X-Received: by 2002:a05:600d:6501:20b0:495:48d7:f178 with SMTP id 5b1f17b1804b1-49e61988e73mr53699555e9.11.1789165090122; Fri, 11 Sep 2026 15:18:10 -0700 (PDT) Received: from FRSMI25-LASER.home (2a01cb001331aa00a2e4fb7b0d887544.ipv6.abo.wanadoo.fr. [2a01:cb00:1331:aa00:a2e4:fb7b:d88:7544]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-49e61a33e34sm78235165e9.0.2026.09.11.15.18.09 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Sep 2026 15:18:09 -0700 (PDT) From: Yoann Congal To: bitbake-devel@lists.openembedded.org Subject: [bitbake][scarthgap][2.8][PATCH 2/4] fetch/gitsm: Store the original url data to fix relative gitsm paths Date: Sat, 12 Sep 2026 00:18:04 +0200 Message-ID: X-Mailer: git-send-email 2.47.3 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 11 Sep 2026 22:18:22 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/bitbake-devel/message/20185 From: Richard Purdie If the gitsm:// url contains a git submodule with a relative "../" path and the fetcher is configured to use a premirror, it will fail as the host name encoded in the original url is lost and the correct paths can't be found. Save the original url data in the new data so that it can be consulted to fix this kind of edge case. The test case change that follows this provides a test of this functionality. Signed-off-by: Richard Purdie (cherry picked from commit 58872250f72f5760b4126552bdec5497f5a1a1f4) Signed-off-by: Yoann Congal --- lib/bb/fetch2/__init__.py | 1 + lib/bb/fetch2/gitsm.py | 5 ++++- 2 files changed, 5 insertions(+), 1 deletion(-) diff --git a/lib/bb/fetch2/__init__.py b/lib/bb/fetch2/__init__.py index f2835397a..e89f5be2a 100644 --- a/lib/bb/fetch2/__init__.py +++ b/lib/bb/fetch2/__init__.py @@ -1011,6 +1011,7 @@ def build_mirroruris(origud, mirrors, ld): newud = FetchData(newuri, ld) newud.ignore_checksums = True newud.setup_localpath(ld) + newud.origud = ud except bb.fetch2.BBFetchException as e: logger.debug("Mirror fetch failure for url %s (original url: %s)" % (newuri, origud.url)) logger.debug(str(e)) diff --git a/lib/bb/fetch2/gitsm.py b/lib/bb/fetch2/gitsm.py index ef1905333..e866edeb8 100644 --- a/lib/bb/fetch2/gitsm.py +++ b/lib/bb/fetch2/gitsm.py @@ -89,7 +89,10 @@ class GitSM(Git): # Convert relative to absolute uri based on parent uri if uris[m].startswith('..') or uris[m].startswith('./'): - newud = copy.copy(ud) + if hasattr(ud, "origud"): + newud = copy.copy(ud.origud) + else: + newud = copy.copy(ud) newud.path = os.path.normpath(os.path.join(newud.path, uris[m])) uris[m] = Git._get_repo_url(self, newud) From patchwork Fri Sep 11 22:18:05 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 98062 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2FBDCC88E4D for ; Fri, 11 Sep 2026 22:18:22 +0000 (UTC) Received: from mail-wr2-f12.google.com (mail-wr2-f12.google.com [74.125.225.76]) by mx.groups.io with SMTP id smtpd.msgproc01-g2.50928.1789165092640360076 for ; Fri, 11 Sep 2026 15:18:12 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=P7mWoMQA; spf=pass (domain: smile.fr, ip: 74.125.225.76, mailfrom: yoann.congal@smile.fr) Received: by mail-wr2-f12.google.com with SMTP id ffacd0b85a97d-4843cedd129so180721f8f.0 for ; Fri, 11 Sep 2026 15:18:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1789165091; x=1789769891; darn=lists.openembedded.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to:content-type; bh=loeJ5fVOWhUbPJHW+NFKkRMe/jUZcegdPqWwrAB0h+s=; b=P7mWoMQAHl/AEnApHaS4xT7umqWqzL/jljmSwaJDXflg4zQGhB/0Rvm4k3axdiTdHZ tQdovyzY0acznxH0mqAkYy4ddQiL5kzjhswCyPy0w7362ea8Cd2gECobiK+VtPhHMc3h 2ngQxwOsPq1aWrspp8JMOgvG89U1ZOi9CFMxU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1789165091; x=1789769891; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to:content-type; bh=loeJ5fVOWhUbPJHW+NFKkRMe/jUZcegdPqWwrAB0h+s=; b=rpeOjjjulQmavJ/pafgA/ciiFA8WvUmoCBXzns9451O3ibI4/tV6D3ImZxr8G7UMIF utSNkoI2hY9Q95e72wDxoycLZv24h7gDKtaPsi1d9A6+c3PJrR3oy0qCr2bdB05uWmtT V+c04p/TynMDhXSq5Dlz/t3XfWbrazBxgPw7oFcWPiFGsebXZGUl9wDsp9+QUU+Dw8lK aun/siNoRRtn6dQGxnXlVg93ckBt2+TTj/gALULTYO/huYOeo0H8P+Aempv24RF88JRo 2B6vGzOllfmAz72+4ufvw/8Wak7SMmBfkrACBOuYLcW9RG2QG15lHwRoWxKc8tCX6XdR Uyvw== X-Gm-Message-State: AFuF++lH+eKvhlNdbEBvRAxS0Ln09G2X0N+t6/ucd2SKQun8XEceyMR+ SkeOGn50oY8aSzfKrF4MtcABZqFhNel6UQ6stgXXC+R8N4dDTQZ77qo8n1SLU3Xxw4PYgjODtkR NTkOKNuI= X-Gm-Gg: AYBFou2FFJiD4OGFP4tsk1eafSE30v/74nOkNcLAAcBVkEmod8INXA/LZXq9RBDnToe vUQ7Y/qeDLzyeXNj0uMS6XtHL9yoI2+s3d5aIONuLMgUF5JMf6sHD2+S5ER26XV3x4Aa0eF+3ln UOUTs4B0TfrBBmMsC2IgFdsttBVxof+VPoQp+noqTAwuOjkbQ/efH6L2b68fQt+eRyCiUHH5bYQ H+V0JBOUGSYsjL2JEYYtF9BsP87kpTG9HGg+Y/dchEHf4qWSLKaAB5z+92eFCrGeQCMmhgsE7dl WKu8Nn9m9Yzli+X2TG8QwE56lroIG1FlGVSo9b1T1z47hE0cKxWhwdBRJbtAn+0nPZ8GYNB/4Tg EISFL3R0zT0PAVEJE6vRTyKbdJZoReB/qolutkyu1+1CATs1Xkcti/aQA5U4W9Tnd4vVu6jiOJ8 lC6JpaGedfvzIeNgo9WeRPhT8Wm5aUFYzBqJoi2OhPV9XgfnL3HjsoQn+ml3Km7aDQGnRBqrTvT 1HJKkVHq86AHx6WsCs3MWx8epgg6rZdZfdJL6X4n2wwoOfoFrEXjgiyzSe38ptU0kfEZUYCt1mj MxtWm94oLQ== X-Received: by 2002:a05:600c:a0b:b0:49c:e1f1:3dd5 with SMTP id 5b1f17b1804b1-49e618863bcmr130283265e9.4.1789165090724; Fri, 11 Sep 2026 15:18:10 -0700 (PDT) Received: from FRSMI25-LASER.home (2a01cb001331aa00a2e4fb7b0d887544.ipv6.abo.wanadoo.fr. [2a01:cb00:1331:aa00:a2e4:fb7b:d88:7544]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-49e61a33e34sm78235165e9.0.2026.09.11.15.18.10 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Sep 2026 15:18:10 -0700 (PDT) From: Yoann Congal To: bitbake-devel@lists.openembedded.org Subject: [bitbake][scarthgap][2.8][PATCH 3/4] tests/fetch: Swap github grpc repo for our own small test repo Date: Sat, 12 Sep 2026 00:18:05 +0200 Message-ID: <24b0e0bf27183cfb5ca61984c4d8f4b02242b9f6.1789165002.git.yoann.congal@smile.fr> X-Mailer: git-send-email 2.47.3 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 11 Sep 2026 22:18:22 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/bitbake-devel/message/20186 From: Richard Purdie The grpc repo is 1GB in size and makes a poor choice of test repo. With github rate limiting, it is proving probematic. Swap if for our own gitsm test repo which is smaller but can serve the purposes of the test. Signed-off-by: Richard Purdie (cherry picked from commit a64b3157d74f883002318cc46c70bfa1c3609110) Signed-off-by: Yoann Congal --- lib/bb/tests/fetch.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/lib/bb/tests/fetch.py b/lib/bb/tests/fetch.py index a658b89a8..3ed98593d 100644 --- a/lib/bb/tests/fetch.py +++ b/lib/bb/tests/fetch.py @@ -1193,7 +1193,7 @@ class FetcherNetworkTest(FetcherTest): def test_git_submodule_restricted_network_premirrors(self): # this test is to ensure that premirrors will be tried in restricted network # that is, BB_ALLOWED_NETWORKS does not contain the domain the url uses - url = "gitsm://github.com/grpc/grpc.git;protocol=https;name=grpc;branch=v1.60.x;rev=0ef13a7555dbaadd4633399242524129eef5e231" + url = "gitsm://git.yoctoproject.org/git-submodule-test;branch=master;rev=38e61644af90dccd73c03ed3acaed98c8dda9294;branch=master;protocol=https" # create a download directory to be used as premirror later tempdir = tempfile.mkdtemp(prefix="bitbake-fetch-") dl_premirror = os.path.join(tempdir, "download-premirror") From patchwork Fri Sep 11 22:18:06 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 98064 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id ADDFDC88E53 for ; Fri, 11 Sep 2026 22:18:22 +0000 (UTC) Received: from mail-wm2-f12.google.com (mail-wm2-f12.google.com [74.125.225.140]) by mx.groups.io with SMTP id smtpd.msgproc02-g2.51009.1789165093178261655 for ; Fri, 11 Sep 2026 15:18:13 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=l7KbWnWx; spf=pass (domain: smile.fr, ip: 74.125.225.140, mailfrom: yoann.congal@smile.fr) Received: by mail-wm2-f12.google.com with SMTP id 5b1f17b1804b1-49b912e2406so1714255e9.1 for ; Fri, 11 Sep 2026 15:18:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1789165091; x=1789769891; darn=lists.openembedded.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to:content-type; bh=QVmAnHVEa3K/Yzgwg+0mv/jE3a+nDsyFiUXn3as6vrE=; b=l7KbWnWxNeIe1E8bT/fW7oCJfNw6JkBirHWVSld29H1ZPE4RzMt9aY7fTbzo5KJEuR K0pSVhTaET/b82/LXQLUoglKcEwaAF3cIQCcJyePB+5PXmbCfUXsPyjbkHhntxrrVeXP vLzg+rYjMQszgDFxIRkzFDPqS0mRTGdpey4fc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1789165091; x=1789769891; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to:content-type; bh=QVmAnHVEa3K/Yzgwg+0mv/jE3a+nDsyFiUXn3as6vrE=; b=F2UCanq5CbmEH6AVhpUi8cE6L/qll9i6mgSf9MQlL6y8xmOL4w8TatKVxYXCbtrqbN 2SLvmXM2fB3nUFFBIjLHE29365T0zuJRaJA8lcLcq1dr+OBGQdvQceO7CfkMDyCp0JWv PmmuK8kP9fzSS1eNfTPJ7Dw4nJl4Fi2j4Ey0+ZT6GDv2kdmHmDVw1TSbzT9gBxdlBiLV 1gCGi/0uS0+3o73Cv261kKOvKeIZdnZJ4Fpnr1U9YWAXVSordJk+DGF+mc6RgoVVCkLy 5tU9zIxTdL8as2pcRvdAqEW6oQrpVHL1dSpGAYfIV7XXc5N/+uNTBpuyUNn2X6z+Btg1 AwWg== X-Gm-Message-State: AFuF++m9kkG7v+EWBTcNfY4qneSmKkD4e8vugstsl+mLa1EolghxAEvl IsDCFXr6k+1R+gSRPX5BLVg5MI9ulwOuWQWa2phdwYSB3/pUj25rZMPZsXowWTAPTjyo9Kb4NaM coUObpk4= X-Gm-Gg: AYBFou24hw9hIU9QjFCzMpJ4Wks0M3g3JvMaKgqYGsFhDXhGrSFsNhwSY5XG7shOfCy FlVnUJIpU/csFO8QgjOaP6wed0J4kzud7xqIEG1o/dX4ze96fy6ClPi22tslGxZb8o8uCJhUlMp c507RFvsOzyhjj6PU4/HG9E3Yv36LGNvF3tI7Wn7r7vrNXXPWeOYnmJPo6hECN56flAYwVU4T3Z e6l6PgNiWoXJKArEButBZJFj7jOcDP9BtIvLgE333gEw0sERvsMmkSBF6+FxSCHaurjj4cEKYRw AuZKwlW0eEYp9PZYnzs/uvBAfdh3g/x+AiYJfzmUb4NvQc1UWsoVFrT0Vkj52whNMmDtKGxJto9 ouCf+uuW7TVJRnboQuEHY4QdTVL6zmlfmLhOGN0txBXBxnH2UAjTEbjS+yzizSk0LRb36DaCS3r GAIbHxNedL5XtbSn/RTdeWYwNDlN6o8DEqYMixsZZy4PFwfgWseOtQFfp7vj+TahNtkKEMEm8Xv U1zKmJQozTP8kchS+HBGxcgDn1lm5HNrPA5qhsCiKyHz3K1nH0ibqBoQAOK4vh6tpMp+gela3w= X-Received: by 2002:a05:600c:3b1f:b0:49c:e37e:4389 with SMTP id 5b1f17b1804b1-49e60f6955cmr80007105e9.4.1789165091410; Fri, 11 Sep 2026 15:18:11 -0700 (PDT) Received: from FRSMI25-LASER.home (2a01cb001331aa00a2e4fb7b0d887544.ipv6.abo.wanadoo.fr. [2a01:cb00:1331:aa00:a2e4:fb7b:d88:7544]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-49e61a33e34sm78235165e9.0.2026.09.11.15.18.10 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Sep 2026 15:18:11 -0700 (PDT) From: Yoann Congal To: bitbake-devel@lists.openembedded.org Subject: [bitbake][scarthgap][2.8][PATCH 4/4] tests/fetch: Swap bitbake github mirror for YP one Date: Sat, 12 Sep 2026 00:18:06 +0200 Message-ID: X-Mailer: git-send-email 2.47.3 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 11 Sep 2026 22:18:22 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/bitbake-devel/message/20187 From: Richard Purdie We need a reliable mirror of the bitbake repo and github is no longer that. Swap to use the bitbake-contrib repo which carrys enough bitbake data to work for the tests we need. Signed-off-by: Richard Purdie (cherry picked from commit f311ff38b4bf79675f677f73f1d390723b1c4490) Signed-off-by: Yoann Congal --- lib/bb/tests/fetch.py | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/lib/bb/tests/fetch.py b/lib/bb/tests/fetch.py index 3ed98593d..3e2c6f8c1 100644 --- a/lib/bb/tests/fetch.py +++ b/lib/bb/tests/fetch.py @@ -568,8 +568,8 @@ class GitDownloadDirectoryNamingTest(FetcherTest): super(GitDownloadDirectoryNamingTest, self).setUp() self.recipe_url = "git://git.openembedded.org/bitbake;branch=master;protocol=https" self.recipe_dir = "git.openembedded.org.bitbake" - self.mirror_url = "git://github.com/openembedded/bitbake.git;protocol=https;branch=master" - self.mirror_dir = "github.com.openembedded.bitbake.git" + self.mirror_url = "git://git.openembedded.org/bitbake-contrib.git;protocol=https;branch=master" + self.mirror_dir = "git.openembedded.org.bitbake-contrib.git" self.d.setVar('SRCREV', '82ea737a0b42a8b53e11c9cde141e9e9c0bd8c40') @@ -616,8 +616,8 @@ class TarballNamingTest(FetcherTest): super(TarballNamingTest, self).setUp() self.recipe_url = "git://git.openembedded.org/bitbake;branch=master;protocol=https" self.recipe_tarball = "git2_git.openembedded.org.bitbake.tar.gz" - self.mirror_url = "git://github.com/openembedded/bitbake.git;protocol=https;branch=master" - self.mirror_tarball = "git2_github.com.openembedded.bitbake.git.tar.gz" + self.mirror_url = "git://git.openembedded.org/bitbake-contrib.git;protocol=https;branch=master" + self.mirror_tarball = "git2_git.openembedded.org.bitbake-contrib.git.tar.gz" self.d.setVar('BB_GENERATE_MIRROR_TARBALLS', '1') self.d.setVar('SRCREV', '82ea737a0b42a8b53e11c9cde141e9e9c0bd8c40') @@ -650,8 +650,8 @@ class GitShallowTarballNamingTest(FetcherTest): super(GitShallowTarballNamingTest, self).setUp() self.recipe_url = "git://git.openembedded.org/bitbake;branch=master;protocol=https" self.recipe_tarball = "gitshallow_git.openembedded.org.bitbake_82ea737-1_master.tar.gz" - self.mirror_url = "git://github.com/openembedded/bitbake.git;protocol=https;branch=master" - self.mirror_tarball = "gitshallow_github.com.openembedded.bitbake.git_82ea737-1_master.tar.gz" + self.mirror_url = "git://git.openembedded.org/bitbake-contrib.git;protocol=https;branch=master" + self.mirror_tarball = "gitshallow_git.openembedded.org.bitbake-contrib.git_82ea737-1_master.tar.gz" self.d.setVar('BB_GIT_SHALLOW', '1') self.d.setVar('BB_GENERATE_SHALLOW_TARBALLS', '1') @@ -2367,7 +2367,7 @@ class GitShallowTest(FetcherTest): @skipIfNoNetwork() def test_bitbake(self): - self.git('remote add --mirror=fetch origin https://github.com/openembedded/bitbake', cwd=self.srcdir) + self.git('remote add --mirror=fetch origin https://git.openembedded.org/bitbake-contrib', cwd=self.srcdir) self.git('config core.bare true', cwd=self.srcdir) self.git('fetch', cwd=self.srcdir)