mbox series

[v3,0/4] insane: Add unimplemented-ptest checks

Message ID 20231010134931.3994720-1-yoann.congal@smile.fr
Headers show
Series insane: Add unimplemented-ptest checks | expand

Message

Yoann Congal Oct. 10, 2023, 1:49 p.m. UTC 
To increase ptest coverage we can check if the sources of a recipe looks like
it contains unittest and warn the user that a test may be implemented there.

This series provide the check infrastructure as a package QA check and some checks for :
python pytest, perl Test::, meson, cmake, autotools-based tests... as well as
the naive check of "Is there a test/ directory in the sources?" which work
surprisingly well.

Currently, this check find:
* 865 unimplemented ptest in meta-openembedded
* 315 unimplemented ptest in oe-core/meta-poky/meta-yocto-bsp

Full lists: https://gist.github.com/ycongal-smile/ff164a1393ac9a0bf1a25f5b91505a00

v2->v3:
* Fixed a typo in CMake handling that caused the detection to fail
* Removed the detection of native, cross, crosssdk and canadian. These caused
  oe-selftest to fail by accessing OVERRIDES too early and breaking checksums.
  Tests were already disabled on the .bbclass side by doing it this way, tests
  can be reenabled on a per-recipe basis.

v1->v2:
* Corrected: shortlog tag
* Fixed infinit loop on source package containing symlink loops (e.g. md5deep)
* Added test result

Jérémy Rosen (4):
  insane: Add unimplemented-ptest infrastructure
  insane: Detect python and perl based tests
  insane: Detect build-system test harnesses
  insane: Add a naive heuristic to detect test subdirectories

 meta/classes-global/insane.bbclass | 47 ++++++++++++++++++++++++++++++
 1 file changed, 47 insertions(+)