diff mbox series

[meta-lts-mixins,scarthgap/go,RFC,34/34] readme: add QA chapter

Message ID 20251113125712.18914-35-peter.marko@siemens.com
State New
Headers show
Series initial scarthgap/go version | expand

Commit Message

Peter Marko Nov. 13, 2025, 12:57 p.m. UTC
Describe QA done when accepting patches.

Note that oe-selftest fail when additional parameters (like -j) is not
present. When that is fixed, we can simplify the oe-selftest QA example.

Expected results:
* runtime
RESULTS - go.GoCompileTest.test_go_compile: PASSED (67.87s)
RESULTS - go.GoCompileTest.test_go_module: PASSED (6.17s)
RESULTS - go.GoHelloworldTest.test_gohelloworld: PASSED (1.24s)
RESULTS - ping.PingTest.test_ping: PASSED (0.02s)
RESULTS - ssh.SSHTest.test_ssh: PASSED (0.67s)
* sdk
RESULTS - go.GoCompileTest.test_go_build: PASSED (0.35s)
RESULTS - go.GoCompileTest.test_go_module: PASSED (0.33s)
RESULTS - go.GoHostCompileTest.test_go_cross_compile: PASSED (0.22s)
RESULTS - go.GoHostCompileTest.test_go_module_cross_compile: PASSED (0.37s)
* oe-selftest
2025-11-13 11:55:23,485 - oe-selftest - INFO - gotoolchain.oeGoToolchainSelfTest.test_go_dep_build (subunit.RemotedTestCase)
2025-11-13 11:55:23,485 - oe-selftest - INFO -  ... ok
2025-11-13 11:55:23,485 - oe-selftest - INFO - 0: 1/1 1/1 (3.17s) (0 failed) (gotoolchain.oeGoToolchainSelfTest.test_go_dep_build)

Signed-off-by: Peter Marko <peter.marko@siemens.com>
---
 README.md | 44 ++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 44 insertions(+)

Comments

Jose Quaresma Nov. 14, 2025, 11:37 a.m. UTC | #1
Peter Marko via lists.yoctoproject.org <peter.marko=
siemens.com@lists.yoctoproject.org> escreveu (quinta, 13/11/2025 à(s)
12:57):

> Describe QA done when accepting patches.
>
> Note that oe-selftest fail when additional parameters (like -j) is not
> present. When that is fixed, we can simplify the oe-selftest QA example.
>
> Expected results:
> * runtime
> RESULTS - go.GoCompileTest.test_go_compile: PASSED (67.87s)
> RESULTS - go.GoCompileTest.test_go_module: PASSED (6.17s)
> RESULTS - go.GoHelloworldTest.test_gohelloworld: PASSED (1.24s)
> RESULTS - ping.PingTest.test_ping: PASSED (0.02s)
> RESULTS - ssh.SSHTest.test_ssh: PASSED (0.67s)
> * sdk
> RESULTS - go.GoCompileTest.test_go_build: PASSED (0.35s)
> RESULTS - go.GoCompileTest.test_go_module: PASSED (0.33s)
> RESULTS - go.GoHostCompileTest.test_go_cross_compile: PASSED (0.22s)
> RESULTS - go.GoHostCompileTest.test_go_module_cross_compile: PASSED (0.37s)
> * oe-selftest
> 2025-11-13 11:55:23,485 - oe-selftest - INFO -
> gotoolchain.oeGoToolchainSelfTest.test_go_dep_build
> (subunit.RemotedTestCase)
> 2025-11-13 11:55:23,485 - oe-selftest - INFO -  ... ok
> 2025-11-13 11:55:23,485 - oe-selftest - INFO - 0: 1/1 1/1 (3.17s) (0
> failed) (gotoolchain.oeGoToolchainSelfTest.test_go_dep_build)
>
> Signed-off-by: Peter Marko <peter.marko@siemens.com>
> ---
>  README.md | 44 ++++++++++++++++++++++++++++++++++++++++++++
>  1 file changed, 44 insertions(+)
>
> diff --git a/README.md b/README.md
> index e316fc6..06a948d 100644
> --- a/README.md
> +++ b/README.md
> @@ -41,3 +41,47 @@ Maintenance
>  Layer maintainers:
>  * Jose Quaresma <jose.quaresma@foundries.io>
>  * Peter Marko <peter.marko@siemens.com>
> +
> +Quality Assurance
> +-----------------
> +
> +QA tests are using original openembedded-core testsuites.
> +Current plan is to backport QA test changes to openembedded-core
> scarthgap branch.
> +When that is no longer possible, changes will picked here.
> +
> +Automated tests to verify go toolchain functionality are being executed
> with following configurations and commands:
> +
> +* OEQA runtime
> +
> +    ```
> +    IMAGE_INSTALL:append = " packagegroup-core-ssh-dropbear go-helloworld
> packagegroup-go-sdk-target"
>

Is the go-helloworld running automatically or does it need to be launched
manually?

Jose


> +    IMAGE_CLASSES += "testimage"
> +    TEST_SUITES = "ping ssh go"
> +    QB_MEM = "-m 2048"
> +    ```
> +
> +    ```
> +    bitbake core-image-minimal && bitbake core-image-minimal:do_testimage
> +    ```
> +
> +* OEQA SDK
> +
> +    ```
> +    IMAGE_CLASSES += "testimage"
> +    SDK_TOOLCHAIN_LANGS = "go"
> +    TESTSDK_SUITES = "go"
> +    ```
> +
> +    ```
> +    bitbake core-image-minimal:do_populate_sdk && bitbake
> core-image-minimal:do_testsdk
> +    ```
> +
> +* OEQA selftest
> +
> +    ```
> +    SANITY_TESTED_DISTROS = ""
> +    ```
> +
> +    ```
> +    oe-selftest -r gotoolchain -j $(grep -c ^processor /proc/cpuinfo)
> +    ```
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#2533):
> https://lists.yoctoproject.org/g/yocto-patches/message/2533
> Mute This Topic: https://lists.yoctoproject.org/mt/116273420/5052612
> Group Owner: yocto-patches+owner@lists.yoctoproject.org
> Unsubscribe:
> https://lists.yoctoproject.org/g/yocto-patches/leave/13170708/5052612/1504338242/xyzzy
> [quaresma.jose@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>
>
Peter Marko Nov. 14, 2025, 11:55 a.m. UTC | #2
> -----Original Message-----
> From: Jose Quaresma <quaresma.jose@gmail.com>
> Sent: Friday, November 14, 2025 12:37
> To: yocto-patches@lists.yoctoproject.org
> Cc: Marko, Peter (FT D EU SK BFS1) <Peter.Marko@siemens.com>;
> jose.quaresma@foundries.io
> Subject: Re: [yocto-patches] [meta-lts-mixins][scarthgap/go][RFC PATCH 34/34]
> readme: add QA chapter
> 
> 
> 
> Peter Marko via lists.yoctoproject.org <http://lists.yoctoproject.org>
> <peter.marko=siemens.com@lists.yoctoproject.org
> <mailto:siemens.com@lists.yoctoproject.org> > escreveu (quinta, 13/11/2025 à(s)
> 12:57):
> 
> 
> 	Describe QA done when accepting patches.
> 
> 	Note that oe-selftest fail when additional parameters (like -j) is not
> 	present. When that is fixed, we can simplify the oe-selftest QA example.
> 
> 	Expected results:
> 	* runtime
> 	RESULTS - go.GoCompileTest.test_go_compile: PASSED (67.87s)
> 	RESULTS - go.GoCompileTest.test_go_module: PASSED (6.17s)
> 	RESULTS - go.GoHelloworldTest.test_gohelloworld: PASSED (1.24s)
> 	RESULTS - ping.PingTest.test_ping: PASSED (0.02s)
> 	RESULTS - ssh.SSHTest.test_ssh: PASSED (0.67s)
> 	* sdk
> 	RESULTS - go.GoCompileTest.test_go_build: PASSED (0.35s)
> 	RESULTS - go.GoCompileTest.test_go_module: PASSED (0.33s)
> 	RESULTS - go.GoHostCompileTest.test_go_cross_compile: PASSED
> (0.22s)
> 	RESULTS - go.GoHostCompileTest.test_go_module_cross_compile:
> PASSED (0.37s)
> 	* oe-selftest
> 	2025-11-13 11:55:23,485 - oe-selftest - INFO -
> gotoolchain.oeGoToolchainSelfTest.test_go_dep_build
> (subunit.RemotedTestCase)
> 	2025-11-13 11:55:23,485 - oe-selftest - INFO -  ... ok
> 	2025-11-13 11:55:23,485 - oe-selftest - INFO - 0: 1/1 1/1 (3.17s) (0 failed)
> (gotoolchain.oeGoToolchainSelfTest.test_go_dep_build)
> 
> 	Signed-off-by: Peter Marko <peter.marko@siemens.com
> <mailto:peter.marko@siemens.com> >
> 	---
> 	 README.md | 44
> ++++++++++++++++++++++++++++++++++++++++++++
> 	 1 file changed, 44 insertions(+)
> 
> 	diff --git a/README.md b/README.md
> 	index e316fc6..06a948d 100644
> 	--- a/README.md
> 	+++ b/README.md
> 	@@ -41,3 +41,47 @@ Maintenance
> 	 Layer maintainers:
> 	 * Jose Quaresma <jose.quaresma@foundries.io
> <mailto:jose.quaresma@foundries.io> >
> 	 * Peter Marko <peter.marko@siemens.com
> <mailto:peter.marko@siemens.com> >
> 	+
> 	+Quality Assurance
> 	+-----------------
> 	+
> 	+QA tests are using original openembedded-core testsuites.
> 	+Current plan is to backport QA test changes to openembedded-core
> scarthgap branch.
> 	+When that is no longer possible, changes will picked here.
> 	+
> 	+Automated tests to verify go toolchain functionality are being executed
> with following configurations and commands:
> 	+
> 	+* OEQA runtime
> 	+
> 	+    ```
> 	+    IMAGE_INSTALL:append = " packagegroup-core-ssh-dropbear go-
> helloworld packagegroup-go-sdk-target"
> 
> 
> 
> Is the go-helloworld running automatically or does it need to be launched
> manually?

go.GoHelloworldTest.test_gohelloworld executes it in qemu and checks both exit code and printed message.
See https://git.openembedded.org/openembedded-core/tree/meta/lib/oeqa/runtime/cases/go.py?h=scarthgap

Peter

> 
> Jose
> 
> 
> 	+    IMAGE_CLASSES += "testimage"
> 	+    TEST_SUITES = "ping ssh go"
> 	+    QB_MEM = "-m 2048"
> 	+    ```
> 	+
> 	+    ```
> 	+    bitbake core-image-minimal && bitbake core-image-
> minimal:do_testimage
> 	+    ```
> 	+
> 	+* OEQA SDK
> 	+
> 	+    ```
> 	+    IMAGE_CLASSES += "testimage"
> 	+    SDK_TOOLCHAIN_LANGS = "go"
> 	+    TESTSDK_SUITES = "go"
> 	+    ```
> 	+
> 	+    ```
> 	+    bitbake core-image-minimal:do_populate_sdk && bitbake core-image-
> minimal:do_testsdk
> 	+    ```
> 	+
> 	+* OEQA selftest
> 	+
> 	+    ```
> 	+    SANITY_TESTED_DISTROS = ""
> 	+    ```
> 	+
> 	+    ```
> 	+    oe-selftest -r gotoolchain -j $(grep -c ^processor /proc/cpuinfo)
> 	+    ```
> 
> 
> 	-=-=-=-=-=-=-=-=-=-=-=-
> 	Links: You receive all messages sent to this group.
> 	View/Reply Online (#2533): https://lists.yoctoproject.org/g/yocto-
> patches/message/2533
> 	Mute This Topic: https://lists.yoctoproject.org/mt/116273420/5052612
> 	Group Owner: yocto-patches+owner@lists.yoctoproject.org <mailto:yocto-
> patches%2Bowner@lists.yoctoproject.org>
> 	Unsubscribe: https://lists.yoctoproject.org/g/yocto-
> patches/leave/13170708/5052612/1504338242/xyzzy [quaresma.jose@gmail.com
> <mailto:quaresma.jose@gmail.com> ]
> 	-=-=-=-=-=-=-=-=-=-=-=-
> 
> 
> 
> 
> 
> 
> --
> 
> Best regards,
> 
> José Quaresma
Jose Quaresma Nov. 14, 2025, 11:57 a.m. UTC | #3
Marko, Peter <Peter.Marko@siemens.com> escreveu (sexta, 14/11/2025 à(s)
11:55):

>
>
> > -----Original Message-----
> > From: Jose Quaresma <quaresma.jose@gmail.com>
> > Sent: Friday, November 14, 2025 12:37
> > To: yocto-patches@lists.yoctoproject.org
> > Cc: Marko, Peter (FT D EU SK BFS1) <Peter.Marko@siemens.com>;
> > jose.quaresma@foundries.io
> > Subject: Re: [yocto-patches] [meta-lts-mixins][scarthgap/go][RFC PATCH
> 34/34]
> > readme: add QA chapter
> >
> >
> >
> > Peter Marko via lists.yoctoproject.org <http://lists.yoctoproject.org>
> > <peter.marko=siemens.com@lists.yoctoproject.org
> > <mailto:siemens.com@lists.yoctoproject.org> > escreveu (quinta,
> 13/11/2025 à(s)
> > 12:57):
> >
> >
> >       Describe QA done when accepting patches.
> >
> >       Note that oe-selftest fail when additional parameters (like -j) is
> not
> >       present. When that is fixed, we can simplify the oe-selftest QA
> example.
> >
> >       Expected results:
> >       * runtime
> >       RESULTS - go.GoCompileTest.test_go_compile: PASSED (67.87s)
> >       RESULTS - go.GoCompileTest.test_go_module: PASSED (6.17s)
> >       RESULTS - go.GoHelloworldTest.test_gohelloworld: PASSED (1.24s)
> >       RESULTS - ping.PingTest.test_ping: PASSED (0.02s)
> >       RESULTS - ssh.SSHTest.test_ssh: PASSED (0.67s)
> >       * sdk
> >       RESULTS - go.GoCompileTest.test_go_build: PASSED (0.35s)
> >       RESULTS - go.GoCompileTest.test_go_module: PASSED (0.33s)
> >       RESULTS - go.GoHostCompileTest.test_go_cross_compile: PASSED
> > (0.22s)
> >       RESULTS - go.GoHostCompileTest.test_go_module_cross_compile:
> > PASSED (0.37s)
> >       * oe-selftest
> >       2025-11-13 11:55:23,485 - oe-selftest - INFO -
> > gotoolchain.oeGoToolchainSelfTest.test_go_dep_build
> > (subunit.RemotedTestCase)
> >       2025-11-13 11:55:23,485 - oe-selftest - INFO -  ... ok
> >       2025-11-13 11:55:23,485 - oe-selftest - INFO - 0: 1/1 1/1 (3.17s)
> (0 failed)
> > (gotoolchain.oeGoToolchainSelfTest.test_go_dep_build)
> >
> >       Signed-off-by: Peter Marko <peter.marko@siemens.com
> > <mailto:peter.marko@siemens.com> >
> >       ---
> >        README.md | 44
> > ++++++++++++++++++++++++++++++++++++++++++++
> >        1 file changed, 44 insertions(+)
> >
> >       diff --git a/README.md b/README.md
> >       index e316fc6..06a948d 100644
> >       --- a/README.md
> >       +++ b/README.md
> >       @@ -41,3 +41,47 @@ Maintenance
> >        Layer maintainers:
> >        * Jose Quaresma <jose.quaresma@foundries.io
> > <mailto:jose.quaresma@foundries.io> >
> >        * Peter Marko <peter.marko@siemens.com
> > <mailto:peter.marko@siemens.com> >
> >       +
> >       +Quality Assurance
> >       +-----------------
> >       +
> >       +QA tests are using original openembedded-core testsuites.
> >       +Current plan is to backport QA test changes to openembedded-core
> > scarthgap branch.
> >       +When that is no longer possible, changes will picked here.
> >       +
> >       +Automated tests to verify go toolchain functionality are being
> executed
> > with following configurations and commands:
> >       +
> >       +* OEQA runtime
> >       +
> >       +    ```
> >       +    IMAGE_INSTALL:append = " packagegroup-core-ssh-dropbear go-
> > helloworld packagegroup-go-sdk-target"
> >
> >
> >
> > Is the go-helloworld running automatically or does it need to be launched
> > manually?
>
> go.GoHelloworldTest.test_gohelloworld executes it in qemu and checks both
> exit code and printed message.
> See
> https://git.openembedded.org/openembedded-core/tree/meta/lib/oeqa/runtime/cases/go.py?h=scarthgap


Nice!


>
>
> Peter
>
> >
> > Jose
> >
> >
> >       +    IMAGE_CLASSES += "testimage"
> >       +    TEST_SUITES = "ping ssh go"
> >       +    QB_MEM = "-m 2048"
> >       +    ```
> >       +
> >       +    ```
> >       +    bitbake core-image-minimal && bitbake core-image-
> > minimal:do_testimage
> >       +    ```
> >       +
> >       +* OEQA SDK
> >       +
> >       +    ```
> >       +    IMAGE_CLASSES += "testimage"
> >       +    SDK_TOOLCHAIN_LANGS = "go"
> >       +    TESTSDK_SUITES = "go"
> >       +    ```
> >       +
> >       +    ```
> >       +    bitbake core-image-minimal:do_populate_sdk && bitbake
> core-image-
> > minimal:do_testsdk
> >       +    ```
> >       +
> >       +* OEQA selftest
> >       +
> >       +    ```
> >       +    SANITY_TESTED_DISTROS = ""
> >       +    ```
> >       +
> >       +    ```
> >       +    oe-selftest -r gotoolchain -j $(grep -c ^processor
> /proc/cpuinfo)
> >       +    ```
> >
> >
> >       -=-=-=-=-=-=-=-=-=-=-=-
> >       Links: You receive all messages sent to this group.
> >       View/Reply Online (#2533): https://lists.yoctoproject.org/g/yocto-
> > patches/message/2533
> >       Mute This Topic:
> https://lists.yoctoproject.org/mt/116273420/5052612
> >       Group Owner: yocto-patches+owner@lists.yoctoproject.org <mailto:
> yocto-
> > patches%2Bowner@lists.yoctoproject.org>
> >       Unsubscribe: https://lists.yoctoproject.org/g/yocto-
> > patches/leave/13170708/5052612/1504338242/xyzzy [quaresma.jose@gmail.com
> > <mailto:quaresma.jose@gmail.com> ]
> >       -=-=-=-=-=-=-=-=-=-=-=-
> >
> >
> >
> >
> >
> >
> > --
> >
> > Best regards,
> >
> > José Quaresma
>
diff mbox series

Patch

diff --git a/README.md b/README.md
index e316fc6..06a948d 100644
--- a/README.md
+++ b/README.md
@@ -41,3 +41,47 @@  Maintenance
 Layer maintainers:
 * Jose Quaresma <jose.quaresma@foundries.io>
 * Peter Marko <peter.marko@siemens.com>
+
+Quality Assurance
+-----------------
+
+QA tests are using original openembedded-core testsuites.
+Current plan is to backport QA test changes to openembedded-core scarthgap branch.
+When that is no longer possible, changes will picked here.
+
+Automated tests to verify go toolchain functionality are being executed with following configurations and commands:
+
+* OEQA runtime
+
+    ```
+    IMAGE_INSTALL:append = " packagegroup-core-ssh-dropbear go-helloworld packagegroup-go-sdk-target"
+    IMAGE_CLASSES += "testimage"
+    TEST_SUITES = "ping ssh go"
+    QB_MEM = "-m 2048"
+    ```
+
+    ```
+    bitbake core-image-minimal && bitbake core-image-minimal:do_testimage
+    ```
+
+* OEQA SDK
+
+    ```
+    IMAGE_CLASSES += "testimage"
+    SDK_TOOLCHAIN_LANGS = "go"
+    TESTSDK_SUITES = "go"
+    ```
+
+    ```
+    bitbake core-image-minimal:do_populate_sdk && bitbake core-image-minimal:do_testsdk
+    ```
+
+* OEQA selftest
+
+    ```
+    SANITY_TESTED_DISTROS = ""
+    ```
+
+    ```
+    oe-selftest -r gotoolchain -j $(grep -c ^processor /proc/cpuinfo)
+    ```