From patchwork Sun Nov 15 00:35:00 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tim Orling X-Patchwork-Id: 3119 Received: from mail-pj1-f49.google.com (mail-pj1-f49.google.com [209.85.216.49]) by mx.groups.io with SMTP id smtpd.msgproc01-g2.7624.1794702920554576606 for ; Sat, 14 Nov 2026 16:35:20 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@gmail.com header.s=20260707 header.b=C/riCllm; spf=pass (domain: gmail.com, ip: 209.85.216.49, mailfrom: ticotimo@gmail.com) Received: by mail-pj1-f49.google.com with SMTP id 98e67ed59e1d1-3ae6b4c669fso2053641a91.0 for ; Sat, 14 Nov 2026 16:35:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20260707; t=1794702920; x=1795307720; darn=lists.yoctoproject.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to:content-type; bh=79TcD/HhcdRWTl/cesxj0ZeL8cTO2z286HPwqjS03i0=; b=C/riCllmV+/Io5Ry/duvfyVZ4SRfJGuj7MsPfNoIrAeIQnHZgzIJUPxsjh7/MmREty yPhHP48Wr1Z8O9n/FQCUhTXhh4qdvrKAVsclhSlx5QfHSTXVc5woIHFsBAKKNtL+CyYt GtURaXVK9yP6BP010D1MrRxw2XrCo63Rt7odZW9pUSR8xIQh3MQ8paf/W6faq39GCLE+ hdrWP59edHztfxo2YJ+DA+rMPw9hjzmXcihpiyccuIbpkfsVwc6dt93hHzgnqhpIKAVT EOAWUe0g4zxJqB/B7aEIrOgnXB97nC54VzWg44Pn/p9rkmny9plz1NWJKEbxBeawx76u Zj+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1794702920; x=1795307720; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to:content-type; bh=79TcD/HhcdRWTl/cesxj0ZeL8cTO2z286HPwqjS03i0=; b=RArOmcsRehLYagUx5qjIfcOgV2KAqW7JnfnJX9iLEFemEX86zS3xi7yxztsRm0WZ/A x/WTj5NxMRIqdJQwW5NemfGLNF5DFThcZ9/jcXzrx3TwLaLNKdJirYS+/xGSWD2zcslF ouJEtvS4QfwUrhRLLWvZ9Z0o1jYkS+3OEVkxpGL5LVN5DOvMT6YhOpTXYhq5dcGhQKkm eLV5sgC4b+4saesCP0rVzS/0bCTOQNuDEZUSJNu3YoKsFte52+l1QlKOGAiKDWm32QH8 7V2fKEK5z0fcls9tWgNDwzKcbazm2N0wq+0A/ktrWTGKJ1/7jjViEc8BLu+IAamZS7LI A5PA== X-Gm-Message-State: APuU4Z8nFrGA2G8nZ5xj5MieeVOUwHJX2oIlRnWORb55JGagctLqXuad AzM4MKlpBpjn7ulGb8WLikI6RgrMsGYrvdQNqlQW4cRiK9yTDS20WJpA70zceJFU X-Gm-Gg: AYBFou2IgS+J4mqltvstJFWS9eOJmyaThppBMtiY0AzStdN4ca+Fg+aOBJV89te5kTs SXdee+m6zahrRaoLxUeVggBCkjJ08gkIK/4Ua8bDAXL063yvrZoyUMN554p74J1oMCntHS7s6cj sBCtZOSZhZALjis1O0FefCmH0X2jxalyIbh1pinQhoH8meeWG5pLHA4wSB6E0+hHTzGGkuv0fMF mRHOAPwSFqfEAiT5e80T85GmPay3pLOBbEzKvuYVE/oKDCeZ5zT+VdVxZhKeDnzIb8YLx2TTobG qhNaPQ4xg3hrspyXyTyFe5U7Rig1okvoWQqmd1TOGpouSruYXEQxlA+nLkXoM0cMxyVU7WNxYkT Wfqmj64ugneCyO7AH2Epzbs7BYPuWERyb8ni41y8k50iBwdtdzY9hgtUpEcfXlqiRdpPKKHA4NZ VpJrEEiQjL/NQUbYCo8ban3TfKrYLIWcQkCN96olQBnVgXDvMcR7gKwg+aNbXqPMSRi2p9BJczc Ra77J6rcC9CxANXyhOtxXqrwI43ju3cboY5TdKVu8L5rW+K6tXKWqRvUcbawZ8ACzYsJ3KtO06j aFFjgJGvaS/o58TwefRvJLgjhx3kTxHLYieEMhe+VRZFADG6LmM0psd50MB4ZA== X-Received: by 2002:a17:90a:c88f:b0:3b0:e388:d9c9 with SMTP id 98e67ed59e1d1-3b1b0b5d690mr4298989a91.12.1794702919272; Sat, 14 Nov 2026 16:35:19 -0800 (PST) Return-Path: Received: from localhost.localdomain ([69.9.132.159]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-3b1b39fb9a3sm5464089a91.3.2026.11.14.16.35.18 (version=TLS1_3 cipher=TLS_CHACHA20_POLY1305_SHA256 bits=256/256); Sat, 14 Nov 2026 16:35:18 -0800 (PST) From: Tim Orling X-Google-Original-From: Tim Orling To: yocto-patches@lists.yoctoproject.org Cc: Tim Orling Subject: [layerindex-web][PATCH 0/6] Get the RRS update scripts working again Date: Sat, 14 Nov 2026 16:35:00 -0800 Message-ID: <20261115003506.53654-1-tim.orling@konsulko.com> X-Mailer: git-send-email 2.56.1 MIME-Version: 1.0 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by lin-tor-korg-lkml-alma10-1 with HTTPS for ; Sun, 15 Nov 2026 00:35:26 -0000 X-Groupsio-URL: https://lists.yoctoproject.org/g/yocto-patches/message/5378 The RRS data on layers.openembedded.org has not been updated for a long time: in a copy of its database the latest upstream history is 2024-12-28 and the latest recipe upgrade 2025-06-16, so every milestone since 5.3 M1 shows 0%. These fix the problems that stopped each RRS script, found by running them on a test instance loaded with that database copy (layers.moto-timo.net). 1: Bug 16499: every RRS script crashed at startup in the Docker image, where TOOLS_LOG_DIR is empty. 2: Bug 16501: load_recipes() imported bb.fetch before init_parser() had checked out the right BitBake revision. 3: Bug 16500: upgrade history hung for ever on the OE-Core commit that changed the addfragments syntax (8dca5305); use a BitBake from before that change for older commits. 4: Bug 16502: upstream history and distros parsed each layer at whatever branch the layer index update had left it on (e.g. meta-openembedded at dunfell), so most of its recipes failed to parse. 5: Bug 16504: upgrade history hung on OE-Core 3c00ad5d3b, the one commit where OEEquivHash is the default but BB_HASHSERVE is not set. Parsing doesn't need hash equivalence, so use OEBasicHash. 6: Bug 16506: rrs_distros.py failed on the second layer branch, because OE-Core's distro_check leaves the build's PATH in the environment. With these on the test instance, upgrade history has caught up on OE-Core and meta-intel, upstream history has run for all eight layer branches (0 recipes that couldn't be parsed, against 2051 before), and rrs_distros.py has completed for all eight. The test suite passes in the Docker image. rrs_distros.py also needs the OE-Core distro_check fixes for bug 16503, sent separately to openembedded-core: https://lore.kernel.org/all/20261114200810.31078-1-tim.orling@konsulko.com/ Tim Orling (6): rrs/tools/common.py: don't write a log file without TOOLS_LOG_DIR rrs/tools/common.py: import BitBake after checking out its revision rrs_upgrade_history: use the right BitBake around the 2025 fragments change rrs/tools/common.py: check out the layer branch before parsing it conf/local.conf: use OEBasicHash for parsing rrs_distros: keep the environment when fetching distro package lists conf/local.conf | 4 ++ docker/settings.py | 2 +- rrs/tools/common.py | 49 ++++++++++++++++--- rrs/tools/rrs_distros.py | 5 +- rrs/tools/rrs_upgrade_history.py | 32 ++++++++++--- settings.py | 2 +- tests/test_rrs_distros_environ.py | 45 +++++++++++++++++ tests/test_rrs_load_recipes.py | 80 +++++++++++++++++++++++++++++++ tests/test_rrs_logger.py | 38 +++++++++++++++ tests/test_rrs_upgrade_history.py | 43 +++++++++++++++++ 10 files changed, 282 insertions(+), 18 deletions(-) create mode 100644 tests/test_rrs_distros_environ.py create mode 100644 tests/test_rrs_load_recipes.py create mode 100644 tests/test_rrs_logger.py create mode 100644 tests/test_rrs_upgrade_history.py