From patchwork Thu Feb 6 21:57:09 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 56822 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id EBE7EC02194 for ; Thu, 6 Feb 2025 21:57:37 +0000 (UTC) Received: from mail-wm1-f44.google.com (mail-wm1-f44.google.com [209.85.128.44]) by mx.groups.io with SMTP id smtpd.web11.54854.1738879048284599325 for ; Thu, 06 Feb 2025 13:57:28 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=l9CC0cgY; spf=pass (domain: smile.fr, ip: 209.85.128.44, mailfrom: yoann.congal@smile.fr) Received: by mail-wm1-f44.google.com with SMTP id 5b1f17b1804b1-4361b6f9faeso8549055e9.1 for ; Thu, 06 Feb 2025 13:57:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1738879046; x=1739483846; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=tIcv9mnMozJmU98vJxxjWQXwmEds5SL9q2rGDbhoAs4=; b=l9CC0cgYElgCOEVM9RhYiidNrY/l3XFv7pNL8Xp8+9k1f/3af7wWBjirbu3h6OpI0w XXeyD4/qMzZP02DJ22pWxVP8833YNhW7gfYvh5qorKFpF4fPnclEbnRMn+VVD/cUCfKy 6oXw0rqAsZ9oighJzFpJjRHx49f9Red6zvnGg= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1738879046; x=1739483846; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=tIcv9mnMozJmU98vJxxjWQXwmEds5SL9q2rGDbhoAs4=; b=D5P0uzRzNzITfST94bgt+pREaorlvqKby5WTP6dGI1In2hHILzIQ+zuGnZamxueL2y w406GBrAQBNzkJm0fvKu81AsKQ/8kUwlrrsA6yiepS5rYfyf1LDAMfuKjALelo6m4wL4 khwMVFFWH3jxeQBc6MjnPsRxSWh9komom+lgMK6dwD8HTowFilWsL0fECFsMLD5KO2us WYu9ex7LAQVFVOw7RqWSv8qjyoN38eGk5+QmeMam9/KT4VYAbCvY7gR61D+q59zTlIXV m9Vc/+x0+fUMzVtq4WU0M7Z5EjbPcZTRr/1CO/uHvBUN8Y63lYTAL7u4S9O7IlW9YvGC rgJQ== X-Gm-Message-State: AOJu0YyqWTBA5NExgw5oXAhJMu7c4Ou3t8LuH7aV7WHu5JUn0G+8otYZ BLZ9u1b8C5Qr35ql7DH45LLomVvHGEsD66edf28hD8zLw2KhFEojU1JgLME+U+9BC1wZdp3AxbQ f X-Gm-Gg: ASbGnctaFV0V/8WXdBJj0XIpeHhoQQ/kgY7pkGnEavcwFYsPV9k9cBJ2J9YJ+hZn5Vm i2QTVtDllK5DbCWCb5/AUPCiYtBGGKr8XasJTGYqDRPkhjp0D4GvmvtrmyBvf54527fSgvlHDYD wDID2phUQMK/Se6Xdt+hSfT6MkzXeDIv+8Xi39C34dWBByUqV71wWI3htwytms51UWEE8sGfyvj XZwOF0zur32guFxRgmk/mp2q0HRNbhGcBRBLUj2+mpQjVuGrdVUJxQs/CWxkVdKUinMo6R8LZ4j DRQ1tuBuQyqk64+72NIiexycQq2GIgjXIPiGwMtcuwjZg1CaLvn/IDxpzxxL4ivt9bwrOzSgnyP nxQuGeQ== X-Google-Smtp-Source: AGHT+IH3Q6wR2GIBDlGsckH0OEngZv1N9HOwkwvckwp2gGfuUUNyF0uhGY6d8JOpeyhoUkmhApv8GA== X-Received: by 2002:a05:600c:6c01:b0:436:1b77:b5aa with SMTP id 5b1f17b1804b1-43912d22565mr37747525e9.8.1738879046528; Thu, 06 Feb 2025 13:57:26 -0800 (PST) Received: from P-ASN-ECS-830T8C3.local (lfbn-idf1-1-865-143.w86-245.abo.wanadoo.fr. [86.245.70.143]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-4390db11064sm67210855e9.37.2025.02.06.13.57.26 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 06 Feb 2025 13:57:26 -0800 (PST) From: Yoann Congal To: docs@lists.yoctoproject.org Cc: Yoann Congal , Guillaume Swaenepoel Subject: [PATCH v2 1/3] ref-manual/variables: document OEQA_REPRODUCIBLE_TEST_LEAF_TARGETS Date: Thu, 6 Feb 2025 22:57:09 +0100 Message-Id: <20250206215711.154194-1-yoann.congal@smile.fr> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 06 Feb 2025 21:57:37 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/docs/message/6267 From: Yoann Congal This documents the variable used in the "automate testing a single recipe's reproducibility" feature [YOCTO #15701] Signed-off-by: Yoann Congal Reviewed-by: Guillaume Swaenepoel --- documentation/ref-manual/variables.rst | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/documentation/ref-manual/variables.rst b/documentation/ref-manual/variables.rst index 47d4e814f..32e91b6db 100644 --- a/documentation/ref-manual/variables.rst +++ b/documentation/ref-manual/variables.rst @@ -5802,6 +5802,11 @@ system and gives an overview of their function and contents. For additional information on how this variable is used, see the initialization script. + :term:`OEQA_REPRODUCIBLE_TEST_LEAF_TARGETS` + Set build target for build reproducibility testing but activate + :ref:`shared state ` build + for most dependencies. See :doc:`/test-manual/reproducible-builds`. + :term:`OEQA_REPRODUCIBLE_TEST_PACKAGE` Set the package manager(s) for build reproducibility testing. See :yocto_git:`reproducible.py ` From patchwork Thu Feb 6 21:57:10 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 56821 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id EDF1EC0219B for ; Thu, 6 Feb 2025 21:57:37 +0000 (UTC) Received: from mail-wm1-f46.google.com (mail-wm1-f46.google.com [209.85.128.46]) by mx.groups.io with SMTP id smtpd.web11.54855.1738879049470623875 for ; Thu, 06 Feb 2025 13:57:29 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=SN/3Smk5; spf=pass (domain: smile.fr, ip: 209.85.128.46, mailfrom: yoann.congal@smile.fr) Received: by mail-wm1-f46.google.com with SMTP id 5b1f17b1804b1-438a3216fc2so14042325e9.1 for ; Thu, 06 Feb 2025 13:57:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1738879047; x=1739483847; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=mTKhopSaVB3vrcGBZnza1DCHhdCiWhGIPMQGDNM9k8g=; b=SN/3Smk5Exx/54wQ6WXl3uX3FGCvZJmM68lm25sA/dYWWv3iDtj1H0qB/zG1MXN8qD Kqk/dGcaclwp0cJ56K+TFelpnImMHUn6yQxefZjyxZHEqkkHPxmfALeFLeAVkjru0yGG xc/bnjK3vzYYyQBwPrrK5GGV73qOmGrLvQJZ4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1738879047; x=1739483847; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=mTKhopSaVB3vrcGBZnza1DCHhdCiWhGIPMQGDNM9k8g=; b=UsXa7Jwz80Gnh1i3KfZcqjyHzyN4tO9mQvHR7NtCkzyqJ7ch+jAOimhiWdCJAsiDTC cXXzuo8IfNUwAhrUxWI6LfWWwI2JLKOUjzSYin9fHhFkfs5PtHKqVIRFaZbv/ckM41ct I9cFVi5VI5v7VAAa916cU8F6lqEyOjvW2DaZDjK+3LpAQrFUxYk1xef6GAnmrk9fUjkn rlES0uyKsoMQY+oD/6EI5U0YEn8QZ+Ah5CfqV3CwiMQ4xsyoaZ01wlj0C7BOU9Fj/+4N /KbLcOvMO7vQqcYo/8+g3zjDvclbdLrqItJ0CLsE/KyKoU7y8QmjaOO1F8m1EIEoDjOT dMyQ== X-Gm-Message-State: AOJu0YzgRI+QLZcanj05IR6WbAVS8YI8BxQcfguBx/AVhS03uON3dPk1 TND2TzBGNrrgCJGrF8ZmdI0KihQMFYB+EbcoYRA3Hm6zry5tuINKYL/GiTXs6+ds1m9q7tnvl0T 8 X-Gm-Gg: ASbGncvG+FJgOkxajlOFbLbmkKvutpem922FNolHlLKDKqOL7gWxD6JZMI8Efo7msyz SiN4sZimRK0nyi6G/jq53t+ZJljn0zcziZ/FjJJe0HYxIWKiYwqCDWFh7QTFwq5ANXFC1G1MdAH hDmkmYBh2/vzCqGx4l/1BqKyC5zNlbzZULQzuIoZoK5IEHeDYPerkPVbXwfFjPVbjlTSFe0fKdL IdqGnHfOZCx9GCrVPqZvSHzgPIU/3lbi7d4yUYXI2ON/ixk/PQdhWvyciABxZSLdnNBOzbCbAJy 3jRYIDZyJKoMmJ6Muxk6U5CaXXtkUlMRrQS4cO+tyyTPlq+MVEoftyDBWOctFWa4G/awo4w299O LkkwCJg== X-Google-Smtp-Source: AGHT+IGbBOSG3qmk0Tsf8t3QARBDScrpoma/al4wMwysQcJZhdSwEjVYzzsnPtcQplfsnfhJ/Lrg8Q== X-Received: by 2002:a05:600c:1e02:b0:434:fa73:a907 with SMTP id 5b1f17b1804b1-43924992054mr9117785e9.13.1738879047289; Thu, 06 Feb 2025 13:57:27 -0800 (PST) Received: from P-ASN-ECS-830T8C3.local (lfbn-idf1-1-865-143.w86-245.abo.wanadoo.fr. [86.245.70.143]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-4390db11064sm67210855e9.37.2025.02.06.13.57.26 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 06 Feb 2025 13:57:26 -0800 (PST) From: Yoann Congal To: docs@lists.yoctoproject.org Cc: Yoann Congal , Guillaume Swaenepoel Subject: [PATCH v2 2/3] reproducible-builds: change/add titles in the "How" section Date: Thu, 6 Feb 2025 22:57:10 +0100 Message-Id: <20250206215711.154194-2-yoann.congal@smile.fr> X-Mailer: git-send-email 2.39.5 In-Reply-To: <20250206215711.154194-1-yoann.congal@smile.fr> References: <20250206215711.154194-1-yoann.congal@smile.fr> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 06 Feb 2025 21:57:37 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/docs/message/6268 From: Yoann Congal This is preparation work for the following commit. Signed-off-by: Yoann Congal Reviewed-by: Guillaume Swaenepoel --- documentation/test-manual/reproducible-builds.rst | 12 +++++++++--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/documentation/test-manual/reproducible-builds.rst b/documentation/test-manual/reproducible-builds.rst index aaf2e4541..b9f671d68 100644 --- a/documentation/test-manual/reproducible-builds.rst +++ b/documentation/test-manual/reproducible-builds.rst @@ -122,9 +122,12 @@ The project's current reproducibility status can be seen at You can also check the reproducibility status on the Autobuilder: :yocto_ab:`/valkyrie/#/builders/reproducible`. -=============================== -Can I test my layer or recipes? -=============================== +=================================== +How can I test my layer or recipes? +=================================== + +With world build +~~~~~~~~~~~~~~~~ Once again, you can run a ``world`` test using the :ref:`oe-selftest ` @@ -132,6 +135,9 @@ command provided above. This functionality is implemented in :oe_git:`meta/lib/oeqa/selftest/cases/reproducible.py `. +Subclassing the test +~~~~~~~~~~~~~~~~~~~~ + You could subclass the test and change ``targets`` to a different target. You may also change ``sstate_targets`` which would allow you to "pre-cache" some From patchwork Thu Feb 6 21:57:11 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yoann Congal X-Patchwork-Id: 56820 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id F06E1C0219C for ; Thu, 6 Feb 2025 21:57:37 +0000 (UTC) Received: from mail-wm1-f41.google.com (mail-wm1-f41.google.com [209.85.128.41]) by mx.groups.io with SMTP id smtpd.web10.54488.1738879050202655470 for ; Thu, 06 Feb 2025 13:57:30 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@smile.fr header.s=google header.b=zRWgJXbo; spf=pass (domain: smile.fr, ip: 209.85.128.41, mailfrom: yoann.congal@smile.fr) Received: by mail-wm1-f41.google.com with SMTP id 5b1f17b1804b1-436341f575fso16674125e9.1 for ; Thu, 06 Feb 2025 13:57:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smile.fr; s=google; t=1738879048; x=1739483848; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=1ad2vTO4TDer++VTch+SjxSmTtW86GPac2J3EWJbUAk=; b=zRWgJXboGDAlV9IUF4TWCtWRcsTHcm/0Aalnr1ZqutzNW3W5AxJDB/U5csxTpa9UHE RrqxFgqSSot2bzttakYxynU1s2UIM1V+tt6KMKJ6QhYZcz0pbSIymVt/2R1Hdf5jlg57 9bKmOGQjxORpjC1VjDQGSi8m2J4KiJJvr7rs0= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1738879048; x=1739483848; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=1ad2vTO4TDer++VTch+SjxSmTtW86GPac2J3EWJbUAk=; b=IA6iUu0Am2NNYlsrXhiAkgTqB66meZLYjGCwOl+ySV2+p8hWwkpKv1qCVs+G+pZN+G coxn1khIborl5f0AonF3iX3dz6J5FgHmN8BkdgfIySvJhqQBfNYc4Hr7sU+iVVg0sbQO TOvTb4v4XQ8xAZEt+wSe2b8aXExXp1CnN4Ib66ZnZb5pxQvIBDdRiGrmVLIW9HPAgs8B 7XwAFSabVsw86yypZox73fEBeWfURvNhaV2rW+p5Yx6myeqgVNfh3hJ69YtnJwXAja4w wORoc3S3rzSQc7MPx1FlNENYaiNzLOxlhOy6Ik2nHQOZ1mmNx5jslxRGSSROmzezBZoM Ntlw== X-Gm-Message-State: AOJu0Ywv4fAHSO5AhiP/LQHKyLap/TTDdCAq5wlsOyekgS8Ao+LB7HXD /etJemLtWA+UKZSvuc4TLeOqROqC/OqNYXmYpOYsl9NVTHGPXQTlLiZTeOGUufNJczxctOJySfv g X-Gm-Gg: ASbGncvgPsKzCntM/YR8O9FTrF/DKDYXaN8QL3p4WeNkcfIuILi620NkZqbPYOmvQuJ pJBYL/fh4tlsjX3rb4+OEmH7qVo95MY7XBTbqoXnbIwcyjaIeQsxfvjX4VKaoTdWHnFIKhQdhF4 IkBbwFm26qJS+1uo44YSglzdoZcmEoRbIOddqEZDoBvdVI0teWm5CCRENoPyuEWyTnEkdap9HBc i+UCvtAIuFvlI9xeo5tC3sEKl3AtYZxxRUCqqULk+73wnE9fdaLuVJJjHsZbY0wTYy09xMRSwAA SwxwE7mvar1C6UroBt0LYsJ57NPCfT7T9sCjTvmVGVwjHQMPoSTOUAcdTNGMGUCZf7ROfKOU4N6 NBoupxg== X-Google-Smtp-Source: AGHT+IEX2T3krYnQXTezhyNWDIl1FkLhaVTf7VFUCXt6FHz/liQQgLgtHnS5NuRewtW9sXs66WM+MQ== X-Received: by 2002:a05:600c:384c:b0:434:fddf:5c0c with SMTP id 5b1f17b1804b1-4392497d1d9mr10480235e9.4.1738879048479; Thu, 06 Feb 2025 13:57:28 -0800 (PST) Received: from P-ASN-ECS-830T8C3.local (lfbn-idf1-1-865-143.w86-245.abo.wanadoo.fr. [86.245.70.143]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-4390db11064sm67210855e9.37.2025.02.06.13.57.27 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 06 Feb 2025 13:57:27 -0800 (PST) From: Yoann Congal To: docs@lists.yoctoproject.org Cc: Yoann Congal , Guillaume Swaenepoel Subject: [PATCH v2 3/3] reproducible-builds: add a "How to" section with OEQA* variables Date: Thu, 6 Feb 2025 22:57:11 +0100 Message-Id: <20250206215711.154194-3-yoann.congal@smile.fr> X-Mailer: git-send-email 2.39.5 In-Reply-To: <20250206215711.154194-1-yoann.congal@smile.fr> References: <20250206215711.154194-1-yoann.congal@smile.fr> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 06 Feb 2025 21:57:37 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/docs/message/6269 From: Yoann Congal Shows an example of the new variable OEQA_REPRODUCIBLE_TEST_LEAF_TARGETS and still mention OEQA_REPRODUCIBLE_TEST_TARGET/SSTATE_TARGETS that were shown earlier. Signed-off-by: Yoann Congal Reviewed-by: Guillaume Swaenepoel --- v1->v2: Quentin's review * tick-quote variable in title * a set of recipeS * 3 spaces to align a code block (not 4) --- .../test-manual/reproducible-builds.rst | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) diff --git a/documentation/test-manual/reproducible-builds.rst b/documentation/test-manual/reproducible-builds.rst index b9f671d68..77c15d6e2 100644 --- a/documentation/test-manual/reproducible-builds.rst +++ b/documentation/test-manual/reproducible-builds.rst @@ -145,3 +145,21 @@ set of recipes before the test, meaning they are excluded from reproducibility testing. As a practical example, you could set ``sstate_targets`` to ``core-image-sato``, then setting ``targets`` to ``core-image-sato-sdk`` would run reproducibility tests only on the targets belonging only to ``core-image-sato-sdk``. + +Using `OEQA_REPRODUCIBLE_TEST_*` variables +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +If you want to test the reproducibility of a set of recipes, you can define +:term:`OEQA_REPRODUCIBLE_TEST_LEAF_TARGETS`, in your local.conf:: + + OEQA_REPRODUCIBLE_TEST_LEAF_TARGETS = "my-recipe" + +This will test the reproducibility of ``my-recipe`` but will use the +:ref:`Shared State ` for most its +dependencies. + +You can have finer control on the test with: + +- :term:`OEQA_REPRODUCIBLE_TEST_TARGET`: lists recipes to be built, +- :term:`OEQA_REPRODUCIBLE_TEST_SSTATE_TARGETS`: lists recipes that will + be built using :ref:`Shared State `.