| Message ID | 20260113175758.1409859-1-tgamblin@baylibre.com |
|---|---|
| Headers | show |
| Series | python3: upgrade 3.13.11 -> 3.14.2 | expand |
here are few recipes in meta-openembedded which are failing with python 3.14, help in fixing this is appreciated https://autobuilder.yoctoproject.org/valkyrie/#/builders/81/builds/1260 On Tue, Jan 13, 2026 at 9:58 AM Trevor Gamblin via lists.openembedded.org <tgamblin=baylibre.com@lists.openembedded.org> wrote: > I know that there's a large backlog and bigger issues than taking an > upgrade > patch series right now, but I wanted to make sure I had tested this > properly and > submitted it with all of the necessary components before moving on. > > Compared to v3 > (https://lists.openembedded.org/g/openembedded-core/topic/117176199): > > - Added compression module changes to python3-compression split in a new > patch > > One final set of tests: > > ptests: > > |== Tests result: SUCCESS == > | > |28 tests skipped: > | test.test_asyncio.test_windows_events > | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace > | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full > | test.test_gdb.test_misc test.test_gdb.test_pretty_print > | test_android test_apple test_asdl_parser test_clinic test_devpoll > | test_free_threading test_generated_cases test_idle test_kqueue > | test_launcher test_msvcrt test_startfile test_tcl test_tkinter > | test_ttk test_ttk_textonly test_turtle test_winapi > | test_winconsoleio test_winreg test_wmi > | > |8 tests skipped (resource denied): > | test_curses test_peg_generator test_smtpnet test_socketserver > | test_urllib2net test_urllibnet test_winsound test_zipfile64 > | > |455 tests OK. > | > |Total duration: 3 min 43 sec > |Total tests: run=46,462 skipped=2,384 > |Total test files: run=483/491 skipped=28 resource_denied=8 > |Result: SUCCESS > |DURATION: 224 > |END: /usr/lib/python3/ptest > |2026-01-13T17:51 > |STOP: ptest-runner > |TOTAL: 1 FAIL: 0 > |root@qemux86-64:~# > > Reproducibility (gcc-doc failed, python3 did not): > > |2026-01-13 12:42:25,446 - oe-selftest - INFO - > ====================================================================== > |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAIL: > test_reproducible_builds > (reproducible.ReproducibleTests.test_reproducible_builds) > |2026-01-13 12:42:25,446 - oe-selftest - INFO - > ---------------------------------------------------------------------- > |2026-01-13 12:42:25,446 - oe-selftest - INFO - Traceback (most recent > call last): > | File > "/home/tgamblin/workspace/yocto/openembedded-core/meta/lib/oeqa/selftest/cases/reproducible.py", > line 406, in test_reproducible_builds > | self.fail('\n'.join(fails)) > | ~~~~~~~~~^^^^^^^^^^^^^^^^^^ > |AssertionError: The following deb packages are different and not in > exclusion list: > > |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb > |The following ipk packages are different and not in exclusion list: > > |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk > |The following rpm packages are different and not in exclusion list: > > |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm > | > |2026-01-13 12:42:25,446 - oe-selftest - INFO - > ---------------------------------------------------------------------- > |2026-01-13 12:42:25,446 - oe-selftest - INFO - Ran 1 test in 1549.611s > |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAILED > |2026-01-13 12:42:25,446 - oe-selftest - INFO - (failures=1) > |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS: > |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS - > reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1549.36s) > |2026-01-13 12:42:31,461 - oe-selftest - INFO - SUMMARY: > |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest () - Ran 1 > test in 1549.611s > |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest - FAIL - > Required tests failed (successes=0, skipped=0, failures=1, errors=0) > > buildall-qemu: > > |BUILDALL-QEMU LOG FOR python3 > |START TIME: 2026-01-13_11:25:54 > |HOSTNAME: megalith > |HOST OS: Fedora Linux 43 (Server Edition) > |HOST KERNEL: 6.17.12-300.fc43.x86_64 > |=============== > |BUILD RESULTS: > |[glibc] > |PASS: qemuarm > |PASS: qemuarm64 > |PASS: qemuarmv5 > |PASS: qemuloongarch64 > |PASS: qemumips > |PASS: qemumips64 > |PASS: qemuppc > |PASS: qemuppc64 > |PASS: qemuriscv32 > |PASS: qemuriscv64 > |PASS: qemux86-64 > |PASS: qemux86 > |[musl] > |PASS: qemuarm > |PASS: qemuarm64 > |PASS: qemuarmv5 > |FAIL: qemuloongarch64 > |PASS: qemumips > |PASS: qemumips64 > |PASS: qemuppc > |PASS: qemuppc64 > |PASS: qemuriscv32 > |PASS: qemuriscv64 > |PASS: qemux86-64 > |PASS: qemux86 > |=============== > |PASSED: 23 > |FAILED: 1 > > v3 details below. > > Compared to v2 > (https://lists.openembedded.org/g/openembedded-core/message/228232): > > - rebase on top of the 3.13.11 python3 recipe in master; > - add a patch to include the _ast_unparse module in the core split, fixing > some > import issues for annotationlib > > I've kept the original ptest, reproducibility, and buildall checks in the > respective patches, but here is another set of runs for completeness: > > ptests: > > |== Tests result: SUCCESS == > | > |28 tests skipped: > | test.test_asyncio.test_windows_events > | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace > | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full > | test.test_gdb.test_misc test.test_gdb.test_pretty_print > | test_android test_apple test_asdl_parser test_clinic test_devpoll > | test_free_threading test_generated_cases test_idle test_kqueue > | test_launcher test_msvcrt test_startfile test_tcl test_tkinter > | test_ttk test_ttk_textonly test_turtle test_winapi > | test_winconsoleio test_winreg test_wmi > | > |8 tests skipped (resource denied): > | test_curses test_peg_generator test_smtpnet test_socketserver > | test_urllib2net test_urllibnet test_winsound test_zipfile64 > | > |455 tests OK. > | > |Total duration: 3 min 44 sec > |Total tests: run=46,462 skipped=2,384 > |Total test files: run=483/491 skipped=28 resource_denied=8 > |Result: SUCCESS > |DURATION: 224 > |END: /usr/lib/python3/ptest > |2026-01-08T14:58 > |STOP: ptest-runner > |TOTAL: 1 FAIL: 0 > > Reproducibility OK (saw issue with gcc-doc, but not python3): > > > |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb > |The following ipk packages are different and not in exclusion list: > > |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk > |The following rpm packages are different and not in exclusion list: > > |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm > | > |2026-01-08 13:18:28,640 - oe-selftest - INFO - > ---------------------------------------------------------------------- > |2026-01-08 13:18:28,640 - oe-selftest - INFO - Ran 1 test in 1285.587s > |2026-01-08 13:18:28,640 - oe-selftest - INFO - FAILED > |2026-01-08 13:18:28,640 - oe-selftest - INFO - (failures=1) > |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS: > |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS - > reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1285.41s) > |2026-01-08 13:18:31,660 - oe-selftest - INFO - SUMMARY: > |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest () - Ran 1 > test in 1285.588s > |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest - FAIL - > Required tests failed (successes=0, skipped=0, failures=1, errors=0) > > buildall-qemu: > > |BUILDALL-QEMU LOG FOR python3 > |START TIME: 2026-01-08_13:27:10 > |HOSTNAME: megalith > |HOST OS: Fedora Linux 43 (Server Edition) > |HOST KERNEL: 6.17.12-300.fc43.x86_64 > |=============== > |BUILD RESULTS: > |[glibc] > |PASS: qemuarm > |PASS: qemuarm64 > |PASS: qemuarmv5 > |PASS: qemuloongarch64 > |PASS: qemumips > |PASS: qemumips64 > |PASS: qemuppc > |PASS: qemuppc64 > |PASS: qemuriscv32 > |PASS: qemuriscv64 > |PASS: qemux86-64 > |PASS: qemux86 > |[musl] > |PASS: qemuarm > |PASS: qemuarm64 > |PASS: qemuarmv5 > |FAIL: qemuloongarch64 > |PASS: qemumips > |PASS: qemumips64 > |PASS: qemuppc > |PASS: qemuppc64 > |PASS: qemuriscv32 > |PASS: qemuriscv64 > |PASS: qemux86-64 > |PASS: qemux86 > |=============== > |PASSED: 23 > |FAILED: 1 > > v2 details below. > > Compared to v1 > (https://lists.openembedded.org/g/openembedded-core/message/227955): > > - Drop python3-bcrypt upgrade, as someone else has submitted that; > - Drop rpm patch to manually override Python3_SITEARCH with a patch, as > that was > masking the real issue (see below); > - Add a new patch to fix python3targetconfig by exporting > _PYTHON_PROJECT_BASE, > which Python's sysconfig looks for (as of 3.14.0) when doing > cross-compilation. The absence of this was resulting in packages like rpm > finding paths for the native interpreter when making use of sysconfig, > when > they needed the host values. > > Note that I've dropped my own version of the python3-bcrypt upgrade, but I > tested this patch series on top of the other one that was submitted, as > otherwise the ptest images would break during build (version mismatch > errors > around PyO3, which is fixed with the bcrypt upgrade). > > v1 details below. > > This supersedes a previous series sent, which only did the 3.14.0 upgrade. > > Compared to the first series > (https://lists.openembedded.org/g/openembedded-core/message/227310), I've > done the following: > > - Added a commit for including the '_py_warnings' and 'annotationlib' > modules in > python3-core; > - Adds the python 3.14.2 upgrade; > - Removed commits for adding python3-misc to RDEPENDS for python3-pytest > and > python3-jsonpointer, as these are now solved by a new patch to add new > modules > to python3-core in the manifest. Doing it this way was fragile in the > sense > that there were many other recipes needing this same fix that testing > didn't > easily catch, and it doesn't make sense to add python3-misc to recipe > RDEPENDS > just because (for example) python3-logging (another package split) is > trying > to make use of warnings, but can't find the right module; > - Modified the rpm commit to apply a patch (submitted upstream) to fix > CMakeLists.txt, rather than a do_configure prepend; > - Fixed the Python 3.14.0 upgrade commit so that one of the patches we > carry to > skip tests doesn't include duplicate calls to the relevant skip > functions. > > I've kept the upgrades from 3.13.11 to 3.14.0 and 3.14.0 to 3.14.2 > separate to > reflect separate testing and let people review those changelogs > individually if > desired. > > Trevor Gamblin (7): > python3: upgrade 3.13.11 -> 3.14.0 > python3targetconfig: export _PYTHON_PROJECT_BASE > python_pep517: add --prefix to nativepython3 call > python3: upgrade 3.14.0 -> 3.14.2 > python3: add _py_warnings, annotationlib to core > python3: add _ast_unparse to core > python3: add new files to compression > > meta/classes-recipe/python3-dir.bbclass | 2 +- > .../python3targetconfig.bbclass | 1 + > meta/classes-recipe/python_pep517.bbclass | 2 +- > ...r-OpenSSL-3.4-and-add-it-to-multissl.patch | 1452 ----------------- > ...-use-prefix-value-from-build-configu.patch | 35 +- > ...sts-due-to-load-variability-on-YP-AB.patch | 31 +- > ...ctive_children-skip-problematic-test.patch | 17 +- > ...1-test_cmd-skip-bang-completion-test.patch | 31 + > ...-test_unix_console.test_cursor_back_.patch | 46 + > ...kip-test_sysconfig.test_sysconfigdat.patch | 32 + > .../python/python3/python3-manifest.json | 14 +- > .../{python3_3.13.11.bb => python3_3.14.2.bb} | 20 +- > 12 files changed, 195 insertions(+), 1488 deletions(-) > delete mode 100644 > meta/recipes-devtools/python/python3/0001-Generate-data-for-OpenSSL-3.4-and-add-it-to-multissl.patch > create mode 100644 > meta/recipes-devtools/python/python3/0001-test_cmd-skip-bang-completion-test.patch > create mode 100644 > meta/recipes-devtools/python/python3/0001-test_pyrepl-skip-test_unix_console.test_cursor_back_.patch > create mode 100644 > meta/recipes-devtools/python/python3/0001-test_sysconfig-skip-test_sysconfig.test_sysconfigdat.patch > rename meta/recipes-devtools/python/{python3_3.13.11.bb => > python3_3.14.2.bb} (95%) > > -- > 2.52.0 > > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#229280): > https://lists.openembedded.org/g/openembedded-core/message/229280 > Mute This Topic: https://lists.openembedded.org/mt/117247400/1997914 > Group Owner: openembedded-core+owner@lists.openembedded.org > Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [ > raj.khem@gmail.com] > -=-=-=-=-=-=-=-=-=-=-=- > >
On Thu, Jan 22, 2026 at 9:33 AM Khem Raj via lists.openembedded.org <raj.khem=gmail.com@lists.openembedded.org> wrote: > here are few recipes in meta-openembedded which are failing with python > 3.14, help in fixing this is appreciated > > https://autobuilder.yoctoproject.org/valkyrie/#/builders/81/builds/1260 > I have an upgrade for python3-orjson staged (including a fix for riscv64). I would like to add ptest and do some more testing on other architectures. Upstream seems resistant to embedded and cross-compilation, so I am trying to decide what to do with submitting. (My testing also was on top of the python3-maturin upgrade in oe-core). https://git.openembedded.org/meta-openembedded-contrib/log/?h=timo/python3-orjson-3.11.5 If we want to take this as is and address ptest and Upstream-Status later, I am fine with that. > On Tue, Jan 13, 2026 at 9:58 AM Trevor Gamblin via lists.openembedded.org > <tgamblin=baylibre.com@lists.openembedded.org> wrote: > >> I know that there's a large backlog and bigger issues than taking an >> upgrade >> patch series right now, but I wanted to make sure I had tested this >> properly and >> submitted it with all of the necessary components before moving on. >> >> Compared to v3 >> (https://lists.openembedded.org/g/openembedded-core/topic/117176199): >> >> - Added compression module changes to python3-compression split in a new >> patch >> >> One final set of tests: >> >> ptests: >> >> |== Tests result: SUCCESS == >> | >> |28 tests skipped: >> | test.test_asyncio.test_windows_events >> | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace >> | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full >> | test.test_gdb.test_misc test.test_gdb.test_pretty_print >> | test_android test_apple test_asdl_parser test_clinic test_devpoll >> | test_free_threading test_generated_cases test_idle test_kqueue >> | test_launcher test_msvcrt test_startfile test_tcl test_tkinter >> | test_ttk test_ttk_textonly test_turtle test_winapi >> | test_winconsoleio test_winreg test_wmi >> | >> |8 tests skipped (resource denied): >> | test_curses test_peg_generator test_smtpnet test_socketserver >> | test_urllib2net test_urllibnet test_winsound test_zipfile64 >> | >> |455 tests OK. >> | >> |Total duration: 3 min 43 sec >> |Total tests: run=46,462 skipped=2,384 >> |Total test files: run=483/491 skipped=28 resource_denied=8 >> |Result: SUCCESS >> |DURATION: 224 >> |END: /usr/lib/python3/ptest >> |2026-01-13T17:51 >> |STOP: ptest-runner >> |TOTAL: 1 FAIL: 0 >> |root@qemux86-64:~# >> >> Reproducibility (gcc-doc failed, python3 did not): >> >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - >> ====================================================================== >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAIL: >> test_reproducible_builds >> (reproducible.ReproducibleTests.test_reproducible_builds) >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - >> ---------------------------------------------------------------------- >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - Traceback (most recent >> call last): >> | File >> "/home/tgamblin/workspace/yocto/openembedded-core/meta/lib/oeqa/selftest/cases/reproducible.py", >> line 406, in test_reproducible_builds >> | self.fail('\n'.join(fails)) >> | ~~~~~~~~~^^^^^^^^^^^^^^^^^^ >> |AssertionError: The following deb packages are different and not in >> exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb >> |The following ipk packages are different and not in exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk >> |The following rpm packages are different and not in exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm >> | >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - >> ---------------------------------------------------------------------- >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - Ran 1 test in 1549.611s >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAILED >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - (failures=1) >> |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS: >> |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS - >> reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1549.36s) >> |2026-01-13 12:42:31,461 - oe-selftest - INFO - SUMMARY: >> |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest () - Ran 1 >> test in 1549.611s >> |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest - FAIL - >> Required tests failed (successes=0, skipped=0, failures=1, errors=0) >> >> buildall-qemu: >> >> |BUILDALL-QEMU LOG FOR python3 >> |START TIME: 2026-01-13_11:25:54 >> |HOSTNAME: megalith >> |HOST OS: Fedora Linux 43 (Server Edition) >> |HOST KERNEL: 6.17.12-300.fc43.x86_64 >> |=============== >> |BUILD RESULTS: >> |[glibc] >> |PASS: qemuarm >> |PASS: qemuarm64 >> |PASS: qemuarmv5 >> |PASS: qemuloongarch64 >> |PASS: qemumips >> |PASS: qemumips64 >> |PASS: qemuppc >> |PASS: qemuppc64 >> |PASS: qemuriscv32 >> |PASS: qemuriscv64 >> |PASS: qemux86-64 >> |PASS: qemux86 >> |[musl] >> |PASS: qemuarm >> |PASS: qemuarm64 >> |PASS: qemuarmv5 >> |FAIL: qemuloongarch64 >> |PASS: qemumips >> |PASS: qemumips64 >> |PASS: qemuppc >> |PASS: qemuppc64 >> |PASS: qemuriscv32 >> |PASS: qemuriscv64 >> |PASS: qemux86-64 >> |PASS: qemux86 >> |=============== >> |PASSED: 23 >> |FAILED: 1 >> >> v3 details below. >> >> Compared to v2 >> (https://lists.openembedded.org/g/openembedded-core/message/228232): >> >> - rebase on top of the 3.13.11 python3 recipe in master; >> - add a patch to include the _ast_unparse module in the core split, >> fixing some >> import issues for annotationlib >> >> I've kept the original ptest, reproducibility, and buildall checks in the >> respective patches, but here is another set of runs for completeness: >> >> ptests: >> >> |== Tests result: SUCCESS == >> | >> |28 tests skipped: >> | test.test_asyncio.test_windows_events >> | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace >> | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full >> | test.test_gdb.test_misc test.test_gdb.test_pretty_print >> | test_android test_apple test_asdl_parser test_clinic test_devpoll >> | test_free_threading test_generated_cases test_idle test_kqueue >> | test_launcher test_msvcrt test_startfile test_tcl test_tkinter >> | test_ttk test_ttk_textonly test_turtle test_winapi >> | test_winconsoleio test_winreg test_wmi >> | >> |8 tests skipped (resource denied): >> | test_curses test_peg_generator test_smtpnet test_socketserver >> | test_urllib2net test_urllibnet test_winsound test_zipfile64 >> | >> |455 tests OK. >> | >> |Total duration: 3 min 44 sec >> |Total tests: run=46,462 skipped=2,384 >> |Total test files: run=483/491 skipped=28 resource_denied=8 >> |Result: SUCCESS >> |DURATION: 224 >> |END: /usr/lib/python3/ptest >> |2026-01-08T14:58 >> |STOP: ptest-runner >> |TOTAL: 1 FAIL: 0 >> >> Reproducibility OK (saw issue with gcc-doc, but not python3): >> >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb >> |The following ipk packages are different and not in exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk >> |The following rpm packages are different and not in exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm >> | >> |2026-01-08 13:18:28,640 - oe-selftest - INFO - >> ---------------------------------------------------------------------- >> |2026-01-08 13:18:28,640 - oe-selftest - INFO - Ran 1 test in 1285.587s >> |2026-01-08 13:18:28,640 - oe-selftest - INFO - FAILED >> |2026-01-08 13:18:28,640 - oe-selftest - INFO - (failures=1) >> |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS: >> |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS - >> reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1285.41s) >> |2026-01-08 13:18:31,660 - oe-selftest - INFO - SUMMARY: >> |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest () - Ran 1 >> test in 1285.588s >> |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest - FAIL - >> Required tests failed (successes=0, skipped=0, failures=1, errors=0) >> >> buildall-qemu: >> >> |BUILDALL-QEMU LOG FOR python3 >> |START TIME: 2026-01-08_13:27:10 >> |HOSTNAME: megalith >> |HOST OS: Fedora Linux 43 (Server Edition) >> |HOST KERNEL: 6.17.12-300.fc43.x86_64 >> |=============== >> |BUILD RESULTS: >> |[glibc] >> |PASS: qemuarm >> |PASS: qemuarm64 >> |PASS: qemuarmv5 >> |PASS: qemuloongarch64 >> |PASS: qemumips >> |PASS: qemumips64 >> |PASS: qemuppc >> |PASS: qemuppc64 >> |PASS: qemuriscv32 >> |PASS: qemuriscv64 >> |PASS: qemux86-64 >> |PASS: qemux86 >> |[musl] >> |PASS: qemuarm >> |PASS: qemuarm64 >> |PASS: qemuarmv5 >> |FAIL: qemuloongarch64 >> |PASS: qemumips >> |PASS: qemumips64 >> |PASS: qemuppc >> |PASS: qemuppc64 >> |PASS: qemuriscv32 >> |PASS: qemuriscv64 >> |PASS: qemux86-64 >> |PASS: qemux86 >> |=============== >> |PASSED: 23 >> |FAILED: 1 >> >> v2 details below. >> >> Compared to v1 >> (https://lists.openembedded.org/g/openembedded-core/message/227955): >> >> - Drop python3-bcrypt upgrade, as someone else has submitted that; >> - Drop rpm patch to manually override Python3_SITEARCH with a patch, as >> that was >> masking the real issue (see below); >> - Add a new patch to fix python3targetconfig by exporting >> _PYTHON_PROJECT_BASE, >> which Python's sysconfig looks for (as of 3.14.0) when doing >> cross-compilation. The absence of this was resulting in packages like >> rpm >> finding paths for the native interpreter when making use of sysconfig, >> when >> they needed the host values. >> >> Note that I've dropped my own version of the python3-bcrypt upgrade, but I >> tested this patch series on top of the other one that was submitted, as >> otherwise the ptest images would break during build (version mismatch >> errors >> around PyO3, which is fixed with the bcrypt upgrade). >> >> v1 details below. >> >> This supersedes a previous series sent, which only did the 3.14.0 upgrade. >> >> Compared to the first series >> (https://lists.openembedded.org/g/openembedded-core/message/227310), I've >> done the following: >> >> - Added a commit for including the '_py_warnings' and 'annotationlib' >> modules in >> python3-core; >> - Adds the python 3.14.2 upgrade; >> - Removed commits for adding python3-misc to RDEPENDS for python3-pytest >> and >> python3-jsonpointer, as these are now solved by a new patch to add new >> modules >> to python3-core in the manifest. Doing it this way was fragile in the >> sense >> that there were many other recipes needing this same fix that testing >> didn't >> easily catch, and it doesn't make sense to add python3-misc to recipe >> RDEPENDS >> just because (for example) python3-logging (another package split) is >> trying >> to make use of warnings, but can't find the right module; >> - Modified the rpm commit to apply a patch (submitted upstream) to fix >> CMakeLists.txt, rather than a do_configure prepend; >> - Fixed the Python 3.14.0 upgrade commit so that one of the patches we >> carry to >> skip tests doesn't include duplicate calls to the relevant skip >> functions. >> >> I've kept the upgrades from 3.13.11 to 3.14.0 and 3.14.0 to 3.14.2 >> separate to >> reflect separate testing and let people review those changelogs >> individually if >> desired. >> >> Trevor Gamblin (7): >> python3: upgrade 3.13.11 -> 3.14.0 >> python3targetconfig: export _PYTHON_PROJECT_BASE >> python_pep517: add --prefix to nativepython3 call >> python3: upgrade 3.14.0 -> 3.14.2 >> python3: add _py_warnings, annotationlib to core >> python3: add _ast_unparse to core >> python3: add new files to compression >> >> meta/classes-recipe/python3-dir.bbclass | 2 +- >> .../python3targetconfig.bbclass | 1 + >> meta/classes-recipe/python_pep517.bbclass | 2 +- >> ...r-OpenSSL-3.4-and-add-it-to-multissl.patch | 1452 ----------------- >> ...-use-prefix-value-from-build-configu.patch | 35 +- >> ...sts-due-to-load-variability-on-YP-AB.patch | 31 +- >> ...ctive_children-skip-problematic-test.patch | 17 +- >> ...1-test_cmd-skip-bang-completion-test.patch | 31 + >> ...-test_unix_console.test_cursor_back_.patch | 46 + >> ...kip-test_sysconfig.test_sysconfigdat.patch | 32 + >> .../python/python3/python3-manifest.json | 14 +- >> .../{python3_3.13.11.bb => python3_3.14.2.bb} | 20 +- >> 12 files changed, 195 insertions(+), 1488 deletions(-) >> delete mode 100644 >> meta/recipes-devtools/python/python3/0001-Generate-data-for-OpenSSL-3.4-and-add-it-to-multissl.patch >> create mode 100644 >> meta/recipes-devtools/python/python3/0001-test_cmd-skip-bang-completion-test.patch >> create mode 100644 >> meta/recipes-devtools/python/python3/0001-test_pyrepl-skip-test_unix_console.test_cursor_back_.patch >> create mode 100644 >> meta/recipes-devtools/python/python3/0001-test_sysconfig-skip-test_sysconfig.test_sysconfigdat.patch >> rename meta/recipes-devtools/python/{python3_3.13.11.bb => >> python3_3.14.2.bb} (95%) >> >> -- >> 2.52.0 >> >> >> >> >> > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#229854): > https://lists.openembedded.org/g/openembedded-core/message/229854 > Mute This Topic: https://lists.openembedded.org/mt/117247400/924729 > Group Owner: openembedded-core+owner@lists.openembedded.org > Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [ > ticotimo@gmail.com] > -=-=-=-=-=-=-=-=-=-=-=- > >
I know that there's a large backlog and bigger issues than taking an upgrade patch series right now, but I wanted to make sure I had tested this properly and submitted it with all of the necessary components before moving on. Compared to v3 (https://lists.openembedded.org/g/openembedded-core/topic/117176199): - Added compression module changes to python3-compression split in a new patch One final set of tests: ptests: |== Tests result: SUCCESS == | |28 tests skipped: | test.test_asyncio.test_windows_events | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full | test.test_gdb.test_misc test.test_gdb.test_pretty_print | test_android test_apple test_asdl_parser test_clinic test_devpoll | test_free_threading test_generated_cases test_idle test_kqueue | test_launcher test_msvcrt test_startfile test_tcl test_tkinter | test_ttk test_ttk_textonly test_turtle test_winapi | test_winconsoleio test_winreg test_wmi | |8 tests skipped (resource denied): | test_curses test_peg_generator test_smtpnet test_socketserver | test_urllib2net test_urllibnet test_winsound test_zipfile64 | |455 tests OK. | |Total duration: 3 min 43 sec |Total tests: run=46,462 skipped=2,384 |Total test files: run=483/491 skipped=28 resource_denied=8 |Result: SUCCESS |DURATION: 224 |END: /usr/lib/python3/ptest |2026-01-13T17:51 |STOP: ptest-runner |TOTAL: 1 FAIL: 0 |root@qemux86-64:~# Reproducibility (gcc-doc failed, python3 did not): |2026-01-13 12:42:25,446 - oe-selftest - INFO - ====================================================================== |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAIL: test_reproducible_builds (reproducible.ReproducibleTests.test_reproducible_builds) |2026-01-13 12:42:25,446 - oe-selftest - INFO - ---------------------------------------------------------------------- |2026-01-13 12:42:25,446 - oe-selftest - INFO - Traceback (most recent call last): | File "/home/tgamblin/workspace/yocto/openembedded-core/meta/lib/oeqa/selftest/cases/reproducible.py", line 406, in test_reproducible_builds | self.fail('\n'.join(fails)) | ~~~~~~~~~^^^^^^^^^^^^^^^^^^ |AssertionError: The following deb packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb |The following ipk packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk |The following rpm packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm | |2026-01-13 12:42:25,446 - oe-selftest - INFO - ---------------------------------------------------------------------- |2026-01-13 12:42:25,446 - oe-selftest - INFO - Ran 1 test in 1549.611s |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAILED |2026-01-13 12:42:25,446 - oe-selftest - INFO - (failures=1) |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS: |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS - reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1549.36s) |2026-01-13 12:42:31,461 - oe-selftest - INFO - SUMMARY: |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest () - Ran 1 test in 1549.611s |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest - FAIL - Required tests failed (successes=0, skipped=0, failures=1, errors=0) buildall-qemu: |BUILDALL-QEMU LOG FOR python3 |START TIME: 2026-01-13_11:25:54 |HOSTNAME: megalith |HOST OS: Fedora Linux 43 (Server Edition) |HOST KERNEL: 6.17.12-300.fc43.x86_64 |=============== |BUILD RESULTS: |[glibc] |PASS: qemuarm |PASS: qemuarm64 |PASS: qemuarmv5 |PASS: qemuloongarch64 |PASS: qemumips |PASS: qemumips64 |PASS: qemuppc |PASS: qemuppc64 |PASS: qemuriscv32 |PASS: qemuriscv64 |PASS: qemux86-64 |PASS: qemux86 |[musl] |PASS: qemuarm |PASS: qemuarm64 |PASS: qemuarmv5 |FAIL: qemuloongarch64 |PASS: qemumips |PASS: qemumips64 |PASS: qemuppc |PASS: qemuppc64 |PASS: qemuriscv32 |PASS: qemuriscv64 |PASS: qemux86-64 |PASS: qemux86 |=============== |PASSED: 23 |FAILED: 1 v3 details below. Compared to v2 (https://lists.openembedded.org/g/openembedded-core/message/228232): - rebase on top of the 3.13.11 python3 recipe in master; - add a patch to include the _ast_unparse module in the core split, fixing some import issues for annotationlib I've kept the original ptest, reproducibility, and buildall checks in the respective patches, but here is another set of runs for completeness: ptests: |== Tests result: SUCCESS == | |28 tests skipped: | test.test_asyncio.test_windows_events | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full | test.test_gdb.test_misc test.test_gdb.test_pretty_print | test_android test_apple test_asdl_parser test_clinic test_devpoll | test_free_threading test_generated_cases test_idle test_kqueue | test_launcher test_msvcrt test_startfile test_tcl test_tkinter | test_ttk test_ttk_textonly test_turtle test_winapi | test_winconsoleio test_winreg test_wmi | |8 tests skipped (resource denied): | test_curses test_peg_generator test_smtpnet test_socketserver | test_urllib2net test_urllibnet test_winsound test_zipfile64 | |455 tests OK. | |Total duration: 3 min 44 sec |Total tests: run=46,462 skipped=2,384 |Total test files: run=483/491 skipped=28 resource_denied=8 |Result: SUCCESS |DURATION: 224 |END: /usr/lib/python3/ptest |2026-01-08T14:58 |STOP: ptest-runner |TOTAL: 1 FAIL: 0 Reproducibility OK (saw issue with gcc-doc, but not python3): |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb |The following ipk packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk |The following rpm packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm | |2026-01-08 13:18:28,640 - oe-selftest - INFO - ---------------------------------------------------------------------- |2026-01-08 13:18:28,640 - oe-selftest - INFO - Ran 1 test in 1285.587s |2026-01-08 13:18:28,640 - oe-selftest - INFO - FAILED |2026-01-08 13:18:28,640 - oe-selftest - INFO - (failures=1) |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS: |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS - reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1285.41s) |2026-01-08 13:18:31,660 - oe-selftest - INFO - SUMMARY: |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest () - Ran 1 test in 1285.588s |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest - FAIL - Required tests failed (successes=0, skipped=0, failures=1, errors=0) buildall-qemu: |BUILDALL-QEMU LOG FOR python3 |START TIME: 2026-01-08_13:27:10 |HOSTNAME: megalith |HOST OS: Fedora Linux 43 (Server Edition) |HOST KERNEL: 6.17.12-300.fc43.x86_64 |=============== |BUILD RESULTS: |[glibc] |PASS: qemuarm |PASS: qemuarm64 |PASS: qemuarmv5 |PASS: qemuloongarch64 |PASS: qemumips |PASS: qemumips64 |PASS: qemuppc |PASS: qemuppc64 |PASS: qemuriscv32 |PASS: qemuriscv64 |PASS: qemux86-64 |PASS: qemux86 |[musl] |PASS: qemuarm |PASS: qemuarm64 |PASS: qemuarmv5 |FAIL: qemuloongarch64 |PASS: qemumips |PASS: qemumips64 |PASS: qemuppc |PASS: qemuppc64 |PASS: qemuriscv32 |PASS: qemuriscv64 |PASS: qemux86-64 |PASS: qemux86 |=============== |PASSED: 23 |FAILED: 1 v2 details below. Compared to v1 (https://lists.openembedded.org/g/openembedded-core/message/227955): - Drop python3-bcrypt upgrade, as someone else has submitted that; - Drop rpm patch to manually override Python3_SITEARCH with a patch, as that was masking the real issue (see below); - Add a new patch to fix python3targetconfig by exporting _PYTHON_PROJECT_BASE, which Python's sysconfig looks for (as of 3.14.0) when doing cross-compilation. The absence of this was resulting in packages like rpm finding paths for the native interpreter when making use of sysconfig, when they needed the host values. Note that I've dropped my own version of the python3-bcrypt upgrade, but I tested this patch series on top of the other one that was submitted, as otherwise the ptest images would break during build (version mismatch errors around PyO3, which is fixed with the bcrypt upgrade). v1 details below. This supersedes a previous series sent, which only did the 3.14.0 upgrade. Compared to the first series (https://lists.openembedded.org/g/openembedded-core/message/227310), I've done the following: - Added a commit for including the '_py_warnings' and 'annotationlib' modules in python3-core; - Adds the python 3.14.2 upgrade; - Removed commits for adding python3-misc to RDEPENDS for python3-pytest and python3-jsonpointer, as these are now solved by a new patch to add new modules to python3-core in the manifest. Doing it this way was fragile in the sense that there were many other recipes needing this same fix that testing didn't easily catch, and it doesn't make sense to add python3-misc to recipe RDEPENDS just because (for example) python3-logging (another package split) is trying to make use of warnings, but can't find the right module; - Modified the rpm commit to apply a patch (submitted upstream) to fix CMakeLists.txt, rather than a do_configure prepend; - Fixed the Python 3.14.0 upgrade commit so that one of the patches we carry to skip tests doesn't include duplicate calls to the relevant skip functions. I've kept the upgrades from 3.13.11 to 3.14.0 and 3.14.0 to 3.14.2 separate to reflect separate testing and let people review those changelogs individually if desired. Trevor Gamblin (7): python3: upgrade 3.13.11 -> 3.14.0 python3targetconfig: export _PYTHON_PROJECT_BASE python_pep517: add --prefix to nativepython3 call python3: upgrade 3.14.0 -> 3.14.2 python3: add _py_warnings, annotationlib to core python3: add _ast_unparse to core python3: add new files to compression meta/classes-recipe/python3-dir.bbclass | 2 +- .../python3targetconfig.bbclass | 1 + meta/classes-recipe/python_pep517.bbclass | 2 +- ...r-OpenSSL-3.4-and-add-it-to-multissl.patch | 1452 ----------------- ...-use-prefix-value-from-build-configu.patch | 35 +- ...sts-due-to-load-variability-on-YP-AB.patch | 31 +- ...ctive_children-skip-problematic-test.patch | 17 +- ...1-test_cmd-skip-bang-completion-test.patch | 31 + ...-test_unix_console.test_cursor_back_.patch | 46 + ...kip-test_sysconfig.test_sysconfigdat.patch | 32 + .../python/python3/python3-manifest.json | 14 +- .../{python3_3.13.11.bb => python3_3.14.2.bb} | 20 +- 12 files changed, 195 insertions(+), 1488 deletions(-) delete mode 100644 meta/recipes-devtools/python/python3/0001-Generate-data-for-OpenSSL-3.4-and-add-it-to-multissl.patch create mode 100644 meta/recipes-devtools/python/python3/0001-test_cmd-skip-bang-completion-test.patch create mode 100644 meta/recipes-devtools/python/python3/0001-test_pyrepl-skip-test_unix_console.test_cursor_back_.patch create mode 100644 meta/recipes-devtools/python/python3/0001-test_sysconfig-skip-test_sysconfig.test_sysconfigdat.patch rename meta/recipes-devtools/python/{python3_3.13.11.bb => python3_3.14.2.bb} (95%)