diff mbox series

[v2] gawk: skip randtest in ptest suite

Message ID 20260727093530.83107-1-HimaniRamesh.Barde@windriver.com
State Under Review
Headers show
Series [v2] gawk: skip randtest in ptest suite | expand

Commit Message

Himani Barde July 27, 2026, 9:35 a.m. UTC
From: Himani Ramesh Barde <HimaniRamesh.Barde@windriver.com>

randtest performs autocorrelation analysis on random number sequences
and fails intermittently on overloaded CI/autobuilder systems where
CPU scheduling and floating point conditions vary between runs.

An upstream fix was previously merged (ccabae3036a7) to improve sigma
threshold handling, but the test failed again on qemux86-64-musl-ptest
on 2026-07-21 with 'Tau= 162, Autocorr= 5.15181 sigma'.

The test is inherently unsuitable for shared overloaded build
infrastructure. Skip it, consistent with how 'time' and 'timeout'
are already handled.

[YOCTO #16254]

Signed-off-by: Himani Barde <HimaniRamesh.Barde@windriver.com>
---
 meta/recipes-extended/gawk/gawk_5.4.1.bb | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

Comments

Joao Marcos Costa July 27, 2026, 9:57 a.m. UTC | #1
Hello, Himani

Thanks for the v2!

On 7/27/26 11:35, Himani Barde via lists.openembedded.org wrote:
> From: Himani Ramesh Barde <HimaniRamesh.Barde@windriver.com>
> 
> randtest performs autocorrelation analysis on random number sequences
> and fails intermittently on overloaded CI/autobuilder systems where
> CPU scheduling and floating point conditions vary between runs.
> 
> An upstream fix was previously merged (ccabae3036a7) to improve sigma
> threshold handling, but the test failed again on qemux86-64-musl-ptest
> on 2026-07-21 with 'Tau= 162, Autocorr= 5.15181 sigma'.
> 
> The test is inherently unsuitable for shared overloaded build
> infrastructure. Skip it, consistent with how 'time' and 'timeout'
> are already handled.
> 
> [YOCTO #16254]
> 
> Signed-off-by: Himani Barde <HimaniRamesh.Barde@windriver.com>
> ---
>   meta/recipes-extended/gawk/gawk_5.4.1.bb | 5 ++++-
>   1 file changed, 4 insertions(+), 1 deletion(-)
> 
> diff --git a/meta/recipes-extended/gawk/gawk_5.4.1.bb b/meta/recipes-extended/gawk/gawk_5.4.1.bb
> index 56930498e3..89b73a1641 100644
> --- a/meta/recipes-extended/gawk/gawk_5.4.1.bb
> +++ b/meta/recipes-extended/gawk/gawk_5.4.1.bb
> @@ -80,7 +80,10 @@ do_install_ptest() {
>   	# https://bugzilla.yoctoproject.org/show_bug.cgi?id=14371
>   	rm -f ${D}${PTEST_PATH}/test/time.*
>   	rm -f ${D}${PTEST_PATH}/test/timeout.*
> -	for t in time timeout; do
> +	# randtest is a statistical test that intermittently fails on overloaded systems
> +	# https://bugzilla.yoctoproject.org/show_bug.cgi?id=16254
> +	rm -f ${D}${PTEST_PATH}/test/randtest.*
> +	for t in time timeout randtest; do
>   		echo $t >> ${D}${PTEST_PATH}/test/skipped.txt
>   	done
>   }
Reviewed-by: João Marcos Costa <joaomarcos.costa@bootlin.com>
diff mbox series

Patch

diff --git a/meta/recipes-extended/gawk/gawk_5.4.1.bb b/meta/recipes-extended/gawk/gawk_5.4.1.bb
index 56930498e3..89b73a1641 100644
--- a/meta/recipes-extended/gawk/gawk_5.4.1.bb
+++ b/meta/recipes-extended/gawk/gawk_5.4.1.bb
@@ -80,7 +80,10 @@  do_install_ptest() {
 	# https://bugzilla.yoctoproject.org/show_bug.cgi?id=14371
 	rm -f ${D}${PTEST_PATH}/test/time.*
 	rm -f ${D}${PTEST_PATH}/test/timeout.*
-	for t in time timeout; do
+	# randtest is a statistical test that intermittently fails on overloaded systems
+	# https://bugzilla.yoctoproject.org/show_bug.cgi?id=16254
+	rm -f ${D}${PTEST_PATH}/test/randtest.*
+	for t in time timeout randtest; do
 		echo $t >> ${D}${PTEST_PATH}/test/skipped.txt
 	done
 }