[kirkstone] curl: add ptests

From: Andrej Kozemcak <andrej.kozemcak@siemens.com>

Ptest was copy from scarthgap and then edit for kirkstone.
For kirstone we disable this test (which is already failing in kirstone):
- 418
- 722
and remove this tests (which not exist in kirstone):
- 412
- 413
- 1478
- 1477
- 1222
- 1279

Signed-off-by: Andrej Kozemcak <andrej.kozemcak@siemens.com>
---
 .../distro/include/ptest-packagelists.inc     |  1 +
 meta/recipes-support/curl/curl/disable-tests  | 37 ++++++++++++++++
 meta/recipes-support/curl/curl/run-ptest      | 13 ++++++
 meta/recipes-support/curl/curl_7.82.0.bb      | 42 ++++++++++++++++++-
 4 files changed, 92 insertions(+), 1 deletion(-)
 create mode 100644 meta/recipes-support/curl/curl/disable-tests
 create mode 100644 meta/recipes-support/curl/curl/run-ptest

This did not pass autobuilder testing:

https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/1671

While it looks like there were many warnings and failures, there is a
lot of repetition.

All the warnings seem to be of this type:

WARNING: curl-7.82.0-r0 do_package_qa: QA Issue: supports ptests but
is not included in oe-core's ptest-packagelists.inc [missing-ptest]

Below are a couple of examples of the errors encountered, you can
browse the above link to the build to see others):

Error:
 Problem: conflicting requests
  - nothing provides perl-module-b needed by curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-base needed by curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-cwd needed by curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-digest needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-digest-md5 needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-file-basename needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-file-spec needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-file-temp needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-io-socket needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-ipc-open2 needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-list-util needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-memoize needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-storable needed by
curl-ptest-7.82.0-r0.x86_64_x32
  - nothing provides perl-module-time-hires needed by
curl-ptest-7.82.0-r0.x86_64_x32


ERROR: Nothing RPROVIDES 'locale-base-en-us' (but
mc:musl:/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/meta/recipes-support/curl/curl_7.82.0.bb
RDEPENDS on or otherwise requires it)

Can you address the issues in a V2?

Thanks!

Steve

On Mon, May 26, 2025 at 4:05 AM Andrej Kozemcak via
lists.openembedded.org
<andrej.kozemcak=siemens.com@lists.openembedded.org> wrote:
>
> From: Andrej Kozemcak <andrej.kozemcak@siemens.com>
>
> Ptest was copy from scarthgap and then edit for kirkstone.
> For kirstone we disable this test (which is already failing in kirstone):
> - 418
> - 722
> and remove this tests (which not exist in kirstone):
> - 412
> - 413
> - 1478
> - 1477
> - 1222
> - 1279
>
> Signed-off-by: Andrej Kozemcak <andrej.kozemcak@siemens.com>
> ---
>  .../distro/include/ptest-packagelists.inc     |  1 +
>  meta/recipes-support/curl/curl/disable-tests  | 37 ++++++++++++++++
>  meta/recipes-support/curl/curl/run-ptest      | 13 ++++++
>  meta/recipes-support/curl/curl_7.82.0.bb      | 42 ++++++++++++++++++-
>  4 files changed, 92 insertions(+), 1 deletion(-)
>  create mode 100644 meta/recipes-support/curl/curl/disable-tests
>  create mode 100644 meta/recipes-support/curl/curl/run-ptest
>
> diff --git a/meta/conf/distro/include/ptest-packagelists.inc b/meta/conf/distro/include/ptest-packagelists.inc
> index 5c6a30635f..1471aba940 100644
> --- a/meta/conf/distro/include/ptest-packagelists.inc
> +++ b/meta/conf/distro/include/ptest-packagelists.inc
> @@ -78,6 +78,7 @@ PTESTS_FAST:remove:riscv32 = "qemu-ptest"
>  PTESTS_PROBLEMS:append:riscv32 = " qemu-ptest"
>
>  PTESTS_SLOW = "\
> +    curl \
>      babeltrace-ptest \
>      babeltrace2-ptest \
>      busybox-ptest \
> diff --git a/meta/recipes-support/curl/curl/disable-tests b/meta/recipes-support/curl/curl/disable-tests
> new file mode 100644
> index 0000000000..64d59d0d8e
> --- /dev/null
> +++ b/meta/recipes-support/curl/curl/disable-tests
> @@ -0,0 +1,37 @@
> +# Intermittently fails e.g. https://autobuilder.yocto.io/pub/non-release/20231220-28/testresults/qemux86-64-ptest/curl.log
> +# https://autobuilder.yocto.io/pub/non-release/20231220-27/testresults/qemux86-64-ptest/curl.log
> +337
> +# These CRL test (alt-avc) are failing
> +356
> +# These were failing kirkstone version when adding ptest
> +418
> +722
> +# These CRL tests are scanning docs
> +971
> +# Intermittently hangs e.g http://autobuilder.yocto.io/pub/non-release/20231228-18/testresults/qemux86-64-ptest/curl.log
> +1091
> +# Intermittently hangs e.g https://autobuilder.yocto.io/pub/non-release/20231220-27/testresults/qemux86-64-ptest/curl.log
> +1096
> +# These CRL tests are scanning docs
> +1119
> +1132
> +1135
> +# These CRL tests are scanning headers
> +1167
> +# These CRL tests are scanning man pages
> +1139
> +1140
> +1173
> +1177
> +# This CRL test is looking for m4 files
> +1165
> +# This CRL test is looking for src files
> +1185
> +# These CRL tests need --libcurl option to be enabled
> +1400
> +1401
> +1402
> +1403
> +1404
> +1405
> +1465
> diff --git a/meta/recipes-support/curl/curl/run-ptest b/meta/recipes-support/curl/curl/run-ptest
> new file mode 100644
> index 0000000000..5e8d90087a
> --- /dev/null
> +++ b/meta/recipes-support/curl/curl/run-ptest
> @@ -0,0 +1,13 @@
> +#!/bin/sh
> +
> +cd tests
> +
> +# Run all tests, don't stop on first failure
> +# Don't use valgrind if it is found
> +# Use automake-style output
> +# Run four tests in parallel
> +# Print log output on failure
> +
> +# Don't run the flaky or timing dependent tests
> +# Until https://github.com/curl/curl/issues/13350 is resolved, don't run FTP tests
> +./runtests.pl -a -n -am -p !flaky !timing-dependent !FTP
> diff --git a/meta/recipes-support/curl/curl_7.82.0.bb b/meta/recipes-support/curl/curl_7.82.0.bb
> index cda42da4d3..ecf6334fb1 100644
> --- a/meta/recipes-support/curl/curl_7.82.0.bb
> +++ b/meta/recipes-support/curl/curl_7.82.0.bb
> @@ -10,6 +10,8 @@ LICENSE = "curl"
>  LIC_FILES_CHKSUM = "file://COPYING;md5=190c514872597083303371684954f238"
>
>  SRC_URI = "https://curl.se/download/${BP}.tar.xz \
> +           file://run-ptest \
> +           file://disable-tests \
>             file://CVE-2022-22576.patch \
>             file://CVE-2022-27775.patch \
>             file://CVE-2022-27776.patch \
> @@ -74,7 +76,7 @@ CVE_CHECK_IGNORE += "CVE-2023-42915"
>  # ignored: CURLOPT_SSL_VERIFYPEER was disabled on google cloud services causing a potential man in the middle attack
>  CVE_CHECK_IGNORE += "CVE-2024-32928"
>
> -inherit autotools pkgconfig binconfig multilib_header
> +inherit autotools pkgconfig binconfig multilib_header ptest
>
>  # Entropy source for random PACKAGECONFIG option
>  RANDOM ?= "/dev/urandom"
> @@ -139,6 +141,44 @@ do_install:append:class-target() {
>             ${D}${bindir}/curl-config
>  }
>
> +do_compile_ptest() {
> +       oe_runmake -C ${B}/tests
> +}
> +
> +do_install_ptest() {
> +       cat  ${WORKDIR}/disable-tests >> ${S}/tests/data/DISABLED
> +       rm -f ${B}/tests/configurehelp.pm
> +       cp -rf ${B}/tests ${D}${PTEST_PATH}
> +        rm -f ${D}${PTEST_PATH}/tests/libtest/.libs/libhostname.la
> +        rm -f ${D}${PTEST_PATH}/tests/libtest/libhostname.la
> +        mv ${D}${PTEST_PATH}/tests/libtest/.libs/* ${D}${PTEST_PATH}/tests/libtest/
> +        mv ${D}${PTEST_PATH}/tests/libtest/libhostname.so ${D}${PTEST_PATH}/tests/libtest/.libs/
> +       cp -rf ${S}/tests ${D}${PTEST_PATH}
> +       find ${D}${PTEST_PATH}/ -type f -name Makefile.am -o -name Makefile.in -o -name Makefile -delete
> +       install -d ${D}${PTEST_PATH}/src
> +       ln -sf ${bindir}/curl   ${D}${PTEST_PATH}/src/curl
> +       cp -rf ${D}${bindir}/curl-config ${D}${PTEST_PATH}
> +}
> +
> +RDEPENDS:${PN}-ptest += " \
> +       bash \
> +       locale-base-en-us \
> +       perl-module-b \
> +       perl-module-base \
> +       perl-module-cwd \
> +       perl-module-digest \
> +       perl-module-digest-md5 \
> +       perl-module-file-basename \
> +       perl-module-file-spec \
> +       perl-module-file-temp \
> +       perl-module-io-socket \
> +       perl-module-ipc-open2 \
> +       perl-module-list-util \
> +       perl-module-memoize \
> +       perl-module-storable \
> +       perl-module-time-hires \
> +"
> +
>  PACKAGES =+ "lib${BPN}"
>
>  FILES:lib${BPN} = "${libdir}/lib*.so.*"
> --
> 2.39.5
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#217266): https://lists.openembedded.org/g/openembedded-core/message/217266
> Mute This Topic: https://lists.openembedded.org/mt/113307017/3620601
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [steve@sakoman.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>