From patchwork Thu Apr 16 06:56:31 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 86256 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 61E21F88089 for ; Thu, 16 Apr 2026 06:56:44 +0000 (UTC) Received: from mail-wr1-f68.google.com (mail-wr1-f68.google.com [209.85.221.68]) by mx.groups.io with SMTP id smtpd.msgproc01-g2.7710.1776322600838414142 for ; Wed, 15 Apr 2026 23:56:41 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=fU70ruy2; spf=pass (domain: smile.fr, ip: 209.85.221.68, mailfrom: yoann.congal@smile.fr) Received: by mail-wr1-f68.google.com with SMTP id ffacd0b85a97d-43d74086e5bso3159230f8f.0 for ; Wed, 15 Apr 2026 23:56:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1776322599; x=1776927399; darn=lists.openembedded.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=OUNajfwsU4HRcIffa6taXms3gSvKGc5MxUub1Dbvkf8=; b=fU70ruy2XQAjzeprz4qlqC4SiRFaemobc09jqbTLz7FRvgdLAlNIlwA/GA8Fq09zMe Vp/opz30I9WwOipDzmEaCKM+GcTdi0UM1iAw6Yob57NbbhtCJtEQzcIE+z0RF9FFLp3e CWUoD2Eq9Nz3/GwJyVGmqyzF40G2h0isqwC/8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1776322599; x=1776927399; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=OUNajfwsU4HRcIffa6taXms3gSvKGc5MxUub1Dbvkf8=; b=GVkNXI2XrEKpI96augJ5dPBXsIoI2d3QmpKgpjDYwLNF9yUNGQv6s+ekHwXObboZDZ ackLcVXb2OJcEjiMker0gDvSsYAeHRFV9dZ3nAc9/7SPqHRy3z54LtwhEEajWMoybs8s OCdwwSC3Fy8BsDbssSc3clw4ApyCYBYIo8NeZSh1y5A/Ud7Ym3q2a/t+bUiIcTlFXG3i AI12y1JCWCs7JxR0+pGm54kB7RVSDT9hxyCX/4VlRplQZLD4JLsjR8nzLHPCRR7u7HdV fw90DFmwVQ+cC9AXjYMfiUG6gcOT2xwaWRsIqLYrgK1dwag+Z4rcxZ7WWyapzdygbbtQ KA5g== X-Gm-Message-State: AOJu0YxbVVf6tvgFMf6N4vBQi2vEaKRCA/qJafGFjH3nlDAA/7Ls8GIZ CXV1TSMOo5X/ztVq+jtoDR75EF+d1OT1PLciJZhZO8QUFikSueZ68lh7lAKE1etl47RIfQvNWmN sk3tHUqKWRyTd X-Gm-Gg: AeBDievUEALWOgVX6BfGTtc90bEFJ2YSU1Ht8oqvKTqcRJaCgS5L/ERmFSoAyP+hTtg evDgS9xXT1hoNu2rEDH4qWBh2AqY3GokBfKMhLWk4MM7814fdKa/pjUkenM8BmUnlxLIM3lplwj sDRQSbwH67SG8Z9FKcVb2Lqz0FmwthAXtjO2ADyVn/y4yH8u0ST/RXRVS1B70yepruBQkE2cwRY mk7LRS3NALDsrn3sgxy9IC+8mh9U5Vrl480cbpJrsRdJ6XBWRqcUeFjWa/k1EMDi2CVyqHCZKn1 vw5msVSqelhk1MtRNrKcjA9/MtvFlTCPcb+tee19NBa5PN6JqrqEv8pLSNYM6CmlF1Illryt5OK JL8qMxpHTyFCyS+iUa1lnuKU0DYN1snUN3uSLDLL0dg1Y/pJx413R5LQoBg6H8nzNR68MGTW9l/ 68D5ewjZaEVty88FDs48lCoTyOJVSxfn9eLxFW+B6X2t/jRcPNS0seFsy4CsU0fT9rCdtpbO6wO HAqSJkHfU13Sg9OTWzvty5N/d6ICUYaVq+iTg== X-Received: by 2002:a05:6000:2010:b0:437:711c:8754 with SMTP id ffacd0b85a97d-43d642978e4mr37603776f8f.7.1776322598866; Wed, 15 Apr 2026 23:56:38 -0700 (PDT) Received: from FRSMI25-LASER.home (2a01cb001331aa00a2e4fb7b0d887544.ipv6.abo.wanadoo.fr. [2a01:cb00:1331:aa00:a2e4:fb7b:d88:7544]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-43ead3e0091sm9838195f8f.25.2026.04.15.23.56.38 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 15 Apr 2026 23:56:38 -0700 (PDT) From: Yoann Congal To: bitbake-devel@lists.openembedded.org Subject: [bitbake][whinlatter][2.16][PATCH 1/2] tests/fetch: Avoid using git protocol in tests Date: Thu, 16 Apr 2026 08:56:31 +0200 Message-ID: <34a0e469414595ae145ee15f551245fb346d552e.1776322491.git.yoann.congal@smile.fr> X-Mailer: git-send-email 2.47.3 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 16 Apr 2026 06:56:44 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/bitbake-devel/message/19368 From: Richard Purdie Two of the tests were still using git protocol to access git services. For the submodule test, the upstream repo has been updated. In the other case, we need to pass the correct command to the manual git commandline, we can't use a recipe url that previously just happened to work. Signed-off-by: Richard Purdie (cherry picked from commit 5d722b5d65e4eef7befe6376983385421e993f86) Signed-off-by: Yoann Congal --- lib/bb/tests/fetch.py | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/lib/bb/tests/fetch.py b/lib/bb/tests/fetch.py index e027705bf..3fca583e9 100644 --- a/lib/bb/tests/fetch.py +++ b/lib/bb/tests/fetch.py @@ -1148,7 +1148,7 @@ class FetcherNetworkTest(FetcherTest): # URL with ssh submodules url = "gitsm://git.yoctoproject.org/git-submodule-test;branch=ssh-gitsm-tests;rev=049da4a6cb198d7c0302e9e8b243a1443cb809a7;branch=master;protocol=https" # Original URL (comment this if you have ssh access to git.yoctoproject.org) - url = "gitsm://git.yoctoproject.org/git-submodule-test;branch=master;rev=a2885dd7d25380d23627e7544b7bbb55014b16ee;branch=master;protocol=https" + url = "gitsm://git.yoctoproject.org/git-submodule-test;branch=master;rev=38e61644af90dccd73c03ed3acaed98c8dda9294;branch=master;protocol=https" fetcher = bb.fetch.Fetch([url], self.d) fetcher.download() # Previous cwd has been deleted @@ -3487,6 +3487,7 @@ class FetchPremirroronlyNetworkTest(FetcherTest): self.reponame = "fstests" self.clonedir = os.path.join(self.tempdir, "git") self.gitdir = os.path.join(self.tempdir, "git", "{}.git".format(self.reponame)) + self.giturl = "https://git.yoctoproject.org/fstests" self.recipe_url = "git://git.yoctoproject.org/fstests;protocol=https;branch=master" self.d.setVar("BB_FETCH_PREMIRRORONLY", "1") self.d.setVar("BB_NO_NETWORK", "0") @@ -3495,7 +3496,7 @@ class FetchPremirroronlyNetworkTest(FetcherTest): def make_git_repo(self): self.mirrorname = "git2_git.yoctoproject.org.fstests.tar.gz" os.makedirs(self.clonedir) - self.git("clone --bare {}".format(self.recipe_url), self.clonedir) + self.git("clone --bare {}".format(self.giturl), self.clonedir) self.git("update-ref HEAD 15413486df1f5a5b5af699b6f3ba5f0984e52a9f", self.gitdir) bb.process.run('tar -czvf {} .'.format(os.path.join(self.mirrordir, self.mirrorname)), cwd = self.gitdir) shutil.rmtree(self.clonedir) From patchwork Thu Apr 16 06:56:32 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 86257 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 610D0F88084 for ; Thu, 16 Apr 2026 06:56:44 +0000 (UTC) Received: from mail-wr1-f52.google.com (mail-wr1-f52.google.com [209.85.221.52]) by mx.groups.io with SMTP id smtpd.msgproc01-g2.7711.1776322601415274869 for ; Wed, 15 Apr 2026 23:56:41 -0700 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=SA0dZke+; spf=pass (domain: smile.fr, ip: 209.85.221.52, mailfrom: yoann.congal@smile.fr) Received: by mail-wr1-f52.google.com with SMTP id ffacd0b85a97d-43d73352cf2so3804440f8f.1 for ; Wed, 15 Apr 2026 23:56:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1776322599; x=1776927399; darn=lists.openembedded.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=k3ybz3ru6dDjpQIG/kx4gXAjA+6IOk+cPP6jKKJR2Kk=; b=SA0dZke+aqzAPRE78GuQ7GIITnlXi16X2DBg2aul3FrzBj1iT3xoxhAjjFq/RGVHTZ X7bNZyx/Li25BdaH6waKthkzmbm/VsEu+L9me/sOJLitskmn+HsuftjctGyMvViYeRs0 MWuW7SLkkOBYjjYTQqPQHcM8cGYG0iYKBA82I= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1776322599; x=1776927399; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=k3ybz3ru6dDjpQIG/kx4gXAjA+6IOk+cPP6jKKJR2Kk=; b=P/R0xCtZL4nqzibdV3VV+eqGi/C92resFbLoWo0cRW/v7CL81fhH8My570xC2DGlfR bSpZ/HTf9NADOJGYiWEcTHHYhepx9x4YIqnWK7e1HyzPO6yr4qaPCils/2L5A8zqOCt/ BcOSV7vjGyrvX5Nf6lZbFqfOkGWO4piajh1+yolnE5my7b3lShxN00p81sP1sYlvsFmB U6XI7iQPHEb/6wrtuXUyeRGsHG4MZfdSnjceFGUIKhwUPDUkWtFyH0dKARDy9s4UmTVX xnvCHXdfCXOqe8OxKbpl9dmSVy8l90x1McZt8tgvUtpL2GbnNF0lAKfr5UUuxOXxdCWo gTEA== X-Gm-Message-State: AOJu0YxsaN7WdQLZu/k3FickVXn3Cf+1ahhCjDO4TbDYlAY4HHoX0aNF LsHAnvLmOiQAo2Wd/k4zKC2fC4Tb4rp47fN/2CIy+DWkFuihPSKzIsUtMBSUef9yDyZFMka6ihb UUEzVCbIvaQ== X-Gm-Gg: AeBDievauyOEh5aoFQ5/w0+aSLU2VWlY7Obusq1lyF1cePr9Jl5JVUzw7p+aGqrfp/5 SptyMRYEoow71sVy1ffxxwUz36G/S+1VgDhg3OFv5vebnjE2T2YEGl0bOE7FS95dk379dhMJJ2a ZsF7s9LZeQmrAbOGuGJhjW8pkUI+pfCGN2VB3zd5NQJkf9/azJ/NwIdJL85k/09I9fBcLOWiqDn BnPTopxK0wrKpaVfeylVYMlbDAEwkRpik+EWpCd2ZmDCrWOtFMiLNeBtbYJrp43fR0yGZWQpuel gVhom4MJlnSxRDYkThkiT660AMZFUviymDCT9AXjGjm/exIjn74S/IM5KCOVeNQeQs5bi3vuLPh OtLtYoXEYI4ymAaWU3KPaaHCJgVtb+axMLCARv3waXe6moGQs8FYYw/Af9lVEH8f59NP2v6gV0J QSgFF2AMd7NOBYb4sliYq/WNermghfxXWCw6e2f4y43vHbW4gi26ye0wQTZ5u8xqBHmXUGxRKpP txqKAFvPSBwn6nfG012PfL8i75kKyr6DaYzFQ== X-Received: by 2002:a5d:5d85:0:b0:43d:73de:abd2 with SMTP id ffacd0b85a97d-43d73dead51mr24852169f8f.26.1776322599443; Wed, 15 Apr 2026 23:56:39 -0700 (PDT) Received: from FRSMI25-LASER.home (2a01cb001331aa00a2e4fb7b0d887544.ipv6.abo.wanadoo.fr. [2a01:cb00:1331:aa00:a2e4:fb7b:d88:7544]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-43ead3e0091sm9838195f8f.25.2026.04.15.23.56.38 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 15 Apr 2026 23:56:39 -0700 (PDT) From: Yoann Congal To: bitbake-devel@lists.openembedded.org Subject: [bitbake][whinlatter][2.16][PATCH 2/2] runqueue.py: make sure we use bb multiprocessing Date: Thu, 16 Apr 2026 08:56:32 +0200 Message-ID: <713fbbdb9ecc195ceb2216a2345e0d79dbee2135.1776322491.git.yoann.congal@smile.fr> X-Mailer: git-send-email 2.47.3 In-Reply-To: References: MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 16 Apr 2026 06:56:44 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/bitbake-devel/message/19369 From: Trevor Gamblin Otherwise, we see errors like: |ERROR: An uncaught exception occurred in runqueue |Traceback (most recent call last): | File "/srv/pokybuild/yocto-worker/check-layer/build/layers/bitbake/lib/bb/runqueue.py", line 1663, in execute_runqueue | return self._execute_runqueue() | ~~~~~~~~~~~~~~~~~~~~~~^^ | File "/srv/pokybuild/yocto-worker/check-layer/build/layers/bitbake/lib/bb/runqueue.py", line 1607, in _execute_runqueue | retval = self.dump_signatures(dumpsigs) | File "/srv/pokybuild/yocto-worker/check-layer/build/layers/bitbake/lib/bb/runqueue.py", line 1718, in dump_signatures | p.start() | ~~~~~~~^^ | File "/usr/lib64/python3.14/multiprocessing/process.py", line 121, in start | self._popen = self._Popen(self) | ~~~~~~~~~~~^^^^^^ | File "/usr/lib64/python3.14/multiprocessing/context.py", line 224, in _Popen | return _default_context.get_context().Process._Popen(process_obj) | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ | File "/usr/lib64/python3.14/multiprocessing/context.py", line 300, in _Popen | return Popen(process_obj) | File "/usr/lib64/python3.14/multiprocessing/popen_forkserver.py", line 35, in __init__ | super().__init__(process_obj) | ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ | File "/usr/lib64/python3.14/multiprocessing/popen_fork.py", line 20, in __init__ | self._launch(process_obj) | ~~~~~~~~~~~~^^^^^^^^^^^^^ | File "/usr/lib64/python3.14/multiprocessing/popen_forkserver.py", line 47, in _launch | reduction.dump(process_obj, buf) | ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ | File "/usr/lib64/python3.14/multiprocessing/reduction.py", line 60, in dump | ForkingPickler(file, protocol).dump(obj) | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^ |_pickle.PicklingError: Can't pickle local object . at 0x7f7925667d70> |when serializing tuple item 0 |when serializing collections.defaultdict reconstructor arguments |when serializing collections.defaultdict object |when serializing dict item 'rundeps' |when serializing bb.cache.CacheData state |when serializing bb.cache.CacheData object |when serializing dict item '' |when serializing dict item 'recipecaches' |when serializing bb.cooker.BBCooker state |when serializing bb.cooker.BBCooker object |when serializing dict item 'cooker' |when serializing bb.runqueue.RunQueue state |when serializing bb.runqueue.RunQueue object |when serializing tuple item 0 |when serializing method reconstructor arguments |when serializing method object |when serializing dict item '_target' |when serializing multiprocessing.context.Process state |when serializing multiprocessing.context.Process object Fixes: [YOCTO #16184] Signed-off-by: Trevor Gamblin Signed-off-by: Richard Purdie (cherry picked from commit 35866d55908009df429870b28cda0d2266074b48) Signed-off-by: Yoann Congal --- lib/bb/runqueue.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/lib/bb/runqueue.py b/lib/bb/runqueue.py index a880a0d54..239fa770e 100644 --- a/lib/bb/runqueue.py +++ b/lib/bb/runqueue.py @@ -23,11 +23,12 @@ from bb import msg, event from bb import monitordisk import subprocess import pickle -from multiprocessing import Process import shlex import pprint import time +Process = bb.multiprocessing.Process + bblogger = logging.getLogger("BitBake") logger = logging.getLogger("BitBake.RunQueue") hashequiv_logger = logging.getLogger("BitBake.RunQueue.HashEquiv")