From patchwork Thu Nov 21 16:35:07 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 52913 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 74826D7878E for ; Thu, 21 Nov 2024 16:35:19 +0000 (UTC) Received: from mail-wm1-f50.google.com (mail-wm1-f50.google.com [209.85.128.50]) by mx.groups.io with SMTP id smtpd.web10.2796.1732206911696132961 for ; Thu, 21 Nov 2024 08:35:12 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=YsW/3vCU; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.50, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f50.google.com with SMTP id 5b1f17b1804b1-43162cf1eaaso13184115e9.0 for ; Thu, 21 Nov 2024 08:35:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1732206910; x=1732811710; darn=lists.openembedded.org; h=content-transfer-encoding:mime-version:message-id:date:subject:to :from:from:to:cc:subject:date:message-id:reply-to; bh=wJ5J7nY5YY5zrDpAakXcfgWvRAj9gXMzHNSXZmioOv0=; b=YsW/3vCUUvkMrSijLNQS+PAyNU/P9N7GEQ4kTvYWQ6wdwZZUnfltjdGIeo1wWZyF51 oaLbcCqRH5UgPQaVnKGwmxrAJzGMlqNKQlGs+SBWm0BCLL+oyN+MyHyADJ/V9z/ayEEV 6hFPzu3ayM/t1wRLe/8p1dDscmlpl7s16gzQw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1732206910; x=1732811710; h=content-transfer-encoding:mime-version:message-id:date:subject:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=wJ5J7nY5YY5zrDpAakXcfgWvRAj9gXMzHNSXZmioOv0=; b=oveeu1UTek44oBHUaCk2HavwSevpbJAiEab5tPiMKsXZ9pLH309m+zk6h8KnzFleTw DbDkUG7iRVAC/XVsHg6vtP+6bpnlErwzvsqpmWdOHm/I4OYrALfJjIcbsgffUy+LBQUB HBY7StOvBTU5kUeFGiYX7PndQ4e9EujV7FlmjWnAfEU2+a8JLxmAvG4LuPkL7bTKB1Fq MNEEVVM8KFiMEU86KQtO0iEd6lOagPy/dsvX8Ecpu9e5+rMIldIVgfzvdCvXNiyHz7B1 zYx5mgoxDl+wLpvkuOokn0VsDaDqmq5BEOR7BvUJAeSJkclMSCEySIO4F7CBD/aPpDVm jc7g== X-Gm-Message-State: AOJu0YzK0VILHiCW9EKHkBlG3FnVURwTkKfwmUD9m2Fhsv02mmJFHZz6 6b0mR3pdfGHkF/86kNCgOKmQznBUenosDPGXfbAc/k/hZtKjNorkU1rtH4yaw0Cx7vi+AEPecbP Y9zI= X-Gm-Gg: ASbGncusr69BV17fXgoMquwZR7VfkgYNweJu7cCrXbSHkQynqYTtxqkK0FfTlvgHm5W cfK1GMBGslr3Ie2/E84AELdH8QUkrraSJZ4eVvrM9p/jg50q///xuDuJyHNMEqn/+PsyE9fBQCU ErZvMQEG2yqRvoA+Xg6ZRYYZ4oWgeCw5w34JdlEHffeGkBbT5ThMIMjl5JYps/qQLaR1Q4FnnLx uNqPMO906A5aMptX+4C6436uBhh2ha8r8BfAkU8ml82MbMX3sxudbZs69fN3EsYSoEvcnX/7rCo 7y0= X-Google-Smtp-Source: AGHT+IEjPxOo7oXsWKB/imV7+tQH2/Gl/HM5vvgDYZtw9EmZ/nbcMYX8BgZNF1vXKwJTjaXHTFBx+w== X-Received: by 2002:a05:600c:a02:b0:431:557e:b40c with SMTP id 5b1f17b1804b1-4334f01d3c3mr72873805e9.27.1732206909662; Thu, 21 Nov 2024 08:35:09 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:a4ee:c091:1f03:6404]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-433b01e1046sm64034945e9.4.2024.11.21.08.35.08 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 21 Nov 2024 08:35:09 -0800 (PST) From: Richard Purdie To: openembedded-core@lists.openembedded.org Subject: [PATCH 1/2] selftest/reproducible: Drop rawlogs Date: Thu, 21 Nov 2024 16:35:07 +0000 Message-ID: <20241121163508.2628148-1-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 21 Nov 2024 16:35:19 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/207548 The "rawlogs" data consists of a long string of results data which is already in a structured data format. I can't see this is adding much value in duplciating the data but it does create a huge string with a lot of long problematic pathnames and inflates the results data size. I suggest we drop this data as obsolete and not necessary. Signed-off-by: Richard Purdie --- meta/lib/oeqa/selftest/cases/reproducible.py | 6 ------ 1 file changed, 6 deletions(-) diff --git a/meta/lib/oeqa/selftest/cases/reproducible.py b/meta/lib/oeqa/selftest/cases/reproducible.py index 415a1ef577e..1ea33cbe786 100644 --- a/meta/lib/oeqa/selftest/cases/reproducible.py +++ b/meta/lib/oeqa/selftest/cases/reproducible.py @@ -177,12 +177,8 @@ class ReproducibleTests(OESelftestTestCase): self.sstate_targets = bb_vars['OEQA_REPRODUCIBLE_TEST_SSTATE_TARGETS'].split() self.extraresults = {} - self.extraresults.setdefault('reproducible.rawlogs', {})['log'] = '' self.extraresults.setdefault('reproducible', {}).setdefault('files', {}) - def append_to_log(self, msg): - self.extraresults['reproducible.rawlogs']['log'] += msg - def compare_packages(self, reference_dir, test_dir, diffutils_sysroot): result = PackageCompareResults(self.oeqa_reproducible_excluded_packages) @@ -341,8 +337,6 @@ class ReproducibleTests(OESelftestTestCase): self.logger.info('Reproducibility summary for %s: %s' % (c, result)) - self.append_to_log('\n'.join("%s: %s" % (r.status, r.test) for r in result.total)) - self.write_package_list(package_class, 'missing', result.missing) self.write_package_list(package_class, 'different', result.different) self.write_package_list(package_class, 'different_excluded', result.different_excluded) From patchwork Thu Nov 21 16:35:08 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 52914 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 76706D78793 for ; Thu, 21 Nov 2024 16:35:19 +0000 (UTC) Received: from mail-wm1-f53.google.com (mail-wm1-f53.google.com [209.85.128.53]) by mx.groups.io with SMTP id smtpd.web11.2829.1732206912767950002 for ; Thu, 21 Nov 2024 08:35:13 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linuxfoundation.org header.s=google header.b=V3/AlRfE; spf=pass (domain: linuxfoundation.org, ip: 209.85.128.53, mailfrom: richard.purdie@linuxfoundation.org) Received: by mail-wm1-f53.google.com with SMTP id 5b1f17b1804b1-431616c23b5so6510375e9.0 for ; Thu, 21 Nov 2024 08:35:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; t=1732206911; x=1732811711; darn=lists.openembedded.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=gx3/8RGkU2n7vHvSEBxPPN4uLeeGnupd7bGwEFpjL6M=; b=V3/AlRfEYquIgjMuU2USvtRJl+zVFKH7bU/mQsb/hY3Qf1qxCMg4W8P1pTm/dhTLeB Uxo4Wau28lzB4JkjHWrrQgtMiKwh24xTWkrfA+LH6u9HSRB/c169+YuBAoS9qd9fh95o lXLUrIKQGL47LcPr67D90anqJ7vnnOOXSbOkc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1732206911; x=1732811711; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=gx3/8RGkU2n7vHvSEBxPPN4uLeeGnupd7bGwEFpjL6M=; b=F3lFCkEg8yMGdKTqWwgJh5NRXRVpCkXexdmcveIDWhIWWOvcBgryW9AOyYie4nt/E/ z6Sbc9QIkZZy1QiiYRAMr7roAXgpCSoCKNsnX4oRWZqGkaEnHJcAn3qRAdynTCQfg7fd rVBHx2kBPLkUe2WjkBH8CmUiKKeltAexFWP+3ABYBu98/3HDQ9RuMxkPYYuq/cxMr5jC mXZBTsHeevvDE5+JlGZK2gGdRN15cDfvPwhwRx7+cPhdA3gdzwAnha/5u+YYXJPAHm/W saapKptWQ5f04uqiswilI4G4m2Mdl7zToC+pCgHgR43rXgxw9x7xbAJ85xCvpUZl3OzP 9Dqw== X-Gm-Message-State: AOJu0YzNBbgs9NRWddJayYOE90UlL72YkciujbthWVocqdhcD2z10xSC OehBaHmfhAVmyFpix9Y2PirERRNoDGylj+jxJiWE4y39QBIfJyK1Js7qk2zYnLkbSF22A7UuNI+ wR0Y= X-Gm-Gg: ASbGncvKCO1MrakIlj/j8z8nGVSFCglR8u2xZIZo2VF+B4nn8D4Lswm16M3jJiTM36M QwTclDOCOHzsyyy0cQugn84M5LCi+DXQ/k8BtMmm0b4WeyvoteKqYTm28d/dSXlKtc6HX4q/Hq7 18WR9lREjS9X2STZhVp4SfUJF22eHc8QxeABwynrrThvWHNS5BRr3YPATZ25qyrjp0xeX+Z7b3D NbA0aTgfap41KP12NteTKoRQ2WzGav7vGCPpiKXx6W4qeOBLZzu51QSFnxwQEzfKQ0w+8Hz2ThP DEc= X-Google-Smtp-Source: AGHT+IF144ei1zCe2BRMl/koNKAkVT+iA2heJY8gYvDWF+EQ6AuWh+Fu2JsjcSEc6Kc5EL2v4ebivA== X-Received: by 2002:a7b:c355:0:b0:42c:b697:a62c with SMTP id 5b1f17b1804b1-433c5c956eamr32890335e9.5.1732206910822; Thu, 21 Nov 2024 08:35:10 -0800 (PST) Received: from max.int.rpsys.net ([2001:8b0:aba:5f3c:a4ee:c091:1f03:6404]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-433b01e1046sm64034945e9.4.2024.11.21.08.35.09 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 21 Nov 2024 08:35:10 -0800 (PST) From: Richard Purdie To: openembedded-core@lists.openembedded.org Subject: [PATCH 2/2] selftest/reproducible: Clean up pathnames Date: Thu, 21 Nov 2024 16:35:08 +0000 Message-ID: <20241121163508.2628148-2-richard.purdie@linuxfoundation.org> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20241121163508.2628148-1-richard.purdie@linuxfoundation.org> References: <20241121163508.2628148-1-richard.purdie@linuxfoundation.org> MIME-Version: 1.0 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Thu, 21 Nov 2024 16:35:19 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/207549 There are several problems with these paths. Firstly they contain full system paths which depend upon where the test was run. These are pretty pointless and just take up a lot of space making the results files large. Secondly, they contain the same path twice. The reference and target path will always be the same thing in two different locations. Strip off the prefix and remove the duplication. This does change the output data but that can't really be avoided. It does shrink the results data and makes it more readable. Signed-off-by: Richard Purdie --- meta/lib/oeqa/selftest/cases/reproducible.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/selftest/cases/reproducible.py b/meta/lib/oeqa/selftest/cases/reproducible.py index 1ea33cbe786..ee6f8cbdc25 100644 --- a/meta/lib/oeqa/selftest/cases/reproducible.py +++ b/meta/lib/oeqa/selftest/cases/reproducible.py @@ -205,7 +205,7 @@ class ReproducibleTests(OESelftestTestCase): def write_package_list(self, package_class, name, packages): self.extraresults['reproducible']['files'].setdefault(package_class, {})[name] = [ - {'reference': p.reference, 'test': p.test} for p in packages] + p.reference.split("/./")[1] for p in packages] def copy_file(self, source, dest): bb.utils.mkdirhier(os.path.dirname(dest))