diff mbox series

[19/24] python3-setuptools: upgrade 72.1.0 -> 72.2.0

Message ID 1724136703-20023-19-git-send-email-wangmy@fujitsu.com
State Accepted, archived
Commit 8fccef7a731f44e5d27653e06becb54cf770e5e5
Headers show
Series [01/24] binutils: upgrade 2.43 -> 2.43.1 | expand

Commit Message

Mingyu Wang (Fujitsu) Aug. 20, 2024, 6:51 a.m. UTC
From: Wang Mingyu <wangmy@fujitsu.com>

Changelog:
- Support for Pathlike objects in data files and extensions
- native support for C++ compilers
- removed unused get_msvcr()

Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
---
 ...ython3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-devtools/python/{python3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} (94%)

Comments

Martin Jansa Aug. 22, 2024, 4:30 p.m. UTC | #1
This seems to break python3-numpy build.

I guess it can be resolved by upgrading numpy as in:
https://lists.openembedded.org/g/openembedded-core/message/203231
which switches from setuptools3 to python_mesonpy

Comparing the failing command line it looks like CXX and some other
flags are included twice:

with: setuptools-72.2.0:

ccache \
aarch64-oe-linux-g++ \
-fstack-protector-all \
-O2 \
-D_FORTIFY_SOURCE=2 \
-Wformat \
-Wformat-security \
-Werror=format-security \
-Werror=return-type \
-funwind-tables \
--sysroot=WORKDIR/recipe-sysroot \
-O2 \
-g \
-fcanon-prefix-map \
-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
-pipe \
-fvisibility-inlines-hidden \
aarch64-oe-linux-g++ \
-fstack-protector-all \
-O2 \
-D_FORTIFY_SOURCE=2 \
-Wformat \
-Wformat-security \
-Werror=format-security \
-Werror=return-type \
-funwind-tables \
--sysroot=WORKDIR/recipe-sysroot \
-shared \
-Wl,-O1 \
-Wl,--hash-style=gnu \
-Wl,--as-needed \
-fcanon-prefix-map \
-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
-Wl,-z,relro,-z,now \
-O2 \
-g \
-fcanon-prefix-map \
-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
-pipe \
-fvisibility-inlines-hidden \
build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
\
build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_hashtable.o \
-LWORKDIR/recipe-sysroot/usr/lib \
-Lbuild/temp.linux-x86_64-cpython-312 \
-lnpymath \
-o \
build/lib.linux-x86_64-cpython-312/numpy/core/_multiarray_tests.cpython-312-aarch64-linux-gnu.so

--- setuptools-72.1.0   2024-08-22 18:17:36.941146726 +0200
+++ setuptools-72.2.0   2024-08-22 18:17:27.208147768 +0200
@@ -9,6 +9,28 @@
 -Werror=return-type \
 -funwind-tables \
 --sysroot=WORKDIR/recipe-sysroot \
+-O2 \
+-g \
+-fcanon-prefix-map \
+-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
+-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
+-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
+-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
+-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
+-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
+-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
+-pipe \
+-fvisibility-inlines-hidden \
+aarch64-oe-linux-g++ \
+-fstack-protector-all \
+-O2 \
+-D_FORTIFY_SOURCE=2 \
+-Wformat \
+-Wformat-security \
+-Werror=format-security \
+-Werror=return-type \
+-funwind-tables \
+--sysroot=WORKDIR/recipe-sysroot \
 -shared \
 -Wl,-O1 \
 -Wl,--hash-style=gnu \
@@ -33,6 +55,7 @@
 -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
 -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
 -pipe \
+-fvisibility-inlines-hidden \
 build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
\
 build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
 build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \

failing with:
WORKDIR/recipe-sysroot-native/usr/bin/aarch64-oe-linux/../../libexec/aarch64-oe-linux/gcc/aarch64-oe-linux/14.2.0/ld:
cannot find aarch64-oe-linux-g++: No such file or directory
collect2: error: ld returned 1 exit status

On Tue, Aug 20, 2024 at 8:52 AM wangmy via lists.openembedded.org
<wangmy=fujitsu.com@lists.openembedded.org> wrote:
>
> From: Wang Mingyu <wangmy@fujitsu.com>
>
> Changelog:
> - Support for Pathlike objects in data files and extensions
> - native support for C++ compilers
> - removed unused get_msvcr()
>
> Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
> ---
>  ...ython3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>  rename meta/recipes-devtools/python/{python3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} (94%)
>
> diff --git a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> similarity index 94%
> rename from meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> rename to meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> index 945d443aff..63ea999960 100644
> --- a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> +++ b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> @@ -11,7 +11,7 @@ SRC_URI:append:class-native = " file://0001-conditionally-do-not-fetch-code-by-e
>  SRC_URI += " \
>              file://0001-_distutils-sysconfig.py-make-it-possible-to-substite.patch"
>
> -SRC_URI[sha256sum] = "8d243eff56d095e5817f796ede6ae32941278f542e0f941867cc05ae52b162ec"
> +SRC_URI[sha256sum] = "80aacbf633704e9c8bfa1d99fa5dd4dc59573efcf9e4042c13d3bcef91ac2ef9"
>
>  DEPENDS += "python3"
>
> --
> 2.34.1
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#203537): https://lists.openembedded.org/g/openembedded-core/message/203537
> Mute This Topic: https://lists.openembedded.org/mt/107996505/3617156
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [martin.jansa@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
Martin Jansa Aug. 22, 2024, 6:26 p.m. UTC | #2
It seems to fail only when ccache is enabled, I'll send patch to add
CCACHE_DISABLE to numpy recipe to work around this issue for now.

On Thu, Aug 22, 2024 at 6:30 PM Martin Jansa via
lists.openembedded.org <martin.jansa=gmail.com@lists.openembedded.org>
wrote:
>
> This seems to break python3-numpy build.
>
> I guess it can be resolved by upgrading numpy as in:
> https://lists.openembedded.org/g/openembedded-core/message/203231
> which switches from setuptools3 to python_mesonpy
>
> Comparing the failing command line it looks like CXX and some other
> flags are included twice:
>
> with: setuptools-72.2.0:
>
> ccache \
> aarch64-oe-linux-g++ \
> -fstack-protector-all \
> -O2 \
> -D_FORTIFY_SOURCE=2 \
> -Wformat \
> -Wformat-security \
> -Werror=format-security \
> -Werror=return-type \
> -funwind-tables \
> --sysroot=WORKDIR/recipe-sysroot \
> -O2 \
> -g \
> -fcanon-prefix-map \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> -pipe \
> -fvisibility-inlines-hidden \
> aarch64-oe-linux-g++ \
> -fstack-protector-all \
> -O2 \
> -D_FORTIFY_SOURCE=2 \
> -Wformat \
> -Wformat-security \
> -Werror=format-security \
> -Werror=return-type \
> -funwind-tables \
> --sysroot=WORKDIR/recipe-sysroot \
> -shared \
> -Wl,-O1 \
> -Wl,--hash-style=gnu \
> -Wl,--as-needed \
> -fcanon-prefix-map \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> -Wl,-z,relro,-z,now \
> -O2 \
> -g \
> -fcanon-prefix-map \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> -pipe \
> -fvisibility-inlines-hidden \
> build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
> \
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_hashtable.o \
> -LWORKDIR/recipe-sysroot/usr/lib \
> -Lbuild/temp.linux-x86_64-cpython-312 \
> -lnpymath \
> -o \
> build/lib.linux-x86_64-cpython-312/numpy/core/_multiarray_tests.cpython-312-aarch64-linux-gnu.so
>
> --- setuptools-72.1.0   2024-08-22 18:17:36.941146726 +0200
> +++ setuptools-72.2.0   2024-08-22 18:17:27.208147768 +0200
> @@ -9,6 +9,28 @@
>  -Werror=return-type \
>  -funwind-tables \
>  --sysroot=WORKDIR/recipe-sysroot \
> +-O2 \
> +-g \
> +-fcanon-prefix-map \
> +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> +-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> +-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> +-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> +-pipe \
> +-fvisibility-inlines-hidden \
> +aarch64-oe-linux-g++ \
> +-fstack-protector-all \
> +-O2 \
> +-D_FORTIFY_SOURCE=2 \
> +-Wformat \
> +-Wformat-security \
> +-Werror=format-security \
> +-Werror=return-type \
> +-funwind-tables \
> +--sysroot=WORKDIR/recipe-sysroot \
>  -shared \
>  -Wl,-O1 \
>  -Wl,--hash-style=gnu \
> @@ -33,6 +55,7 @@
>  -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
>  -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
>  -pipe \
> +-fvisibility-inlines-hidden \
>  build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
> \
>  build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
>  build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
>
> failing with:
> WORKDIR/recipe-sysroot-native/usr/bin/aarch64-oe-linux/../../libexec/aarch64-oe-linux/gcc/aarch64-oe-linux/14.2.0/ld:
> cannot find aarch64-oe-linux-g++: No such file or directory
> collect2: error: ld returned 1 exit status
>
> On Tue, Aug 20, 2024 at 8:52 AM wangmy via lists.openembedded.org
> <wangmy=fujitsu.com@lists.openembedded.org> wrote:
> >
> > From: Wang Mingyu <wangmy@fujitsu.com>
> >
> > Changelog:
> > - Support for Pathlike objects in data files and extensions
> > - native support for C++ compilers
> > - removed unused get_msvcr()
> >
> > Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
> > ---
> >  ...ython3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> >  rename meta/recipes-devtools/python/{python3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} (94%)
> >
> > diff --git a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > similarity index 94%
> > rename from meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > rename to meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > index 945d443aff..63ea999960 100644
> > --- a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > +++ b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > @@ -11,7 +11,7 @@ SRC_URI:append:class-native = " file://0001-conditionally-do-not-fetch-code-by-e
> >  SRC_URI += " \
> >              file://0001-_distutils-sysconfig.py-make-it-possible-to-substite.patch"
> >
> > -SRC_URI[sha256sum] = "8d243eff56d095e5817f796ede6ae32941278f542e0f941867cc05ae52b162ec"
> > +SRC_URI[sha256sum] = "80aacbf633704e9c8bfa1d99fa5dd4dc59573efcf9e4042c13d3bcef91ac2ef9"
> >
> >  DEPENDS += "python3"
> >
> > --
> > 2.34.1
> >
> >
> >
> >
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#203658): https://lists.openembedded.org/g/openembedded-core/message/203658
> Mute This Topic: https://lists.openembedded.org/mt/107996505/3617156
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [martin.jansa@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
Trevor Gamblin Aug. 28, 2024, 8:04 p.m. UTC | #3
On 2024-08-22 2:26 p.m., Martin Jansa via lists.openembedded.org wrote:
> It seems to fail only when ccache is enabled, I'll send patch to add
> CCACHE_DISABLE to numpy recipe to work around this issue for now.

Even with that workaround, I see a more serious issue:

|DEBUG: Executing shell function do_compile
|/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py:60: 
RuntimeWarning: NumPy 1.26.4 may not yet support Python 3.12.
| warnings.warn(
|Running from numpy source directory.
|/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py:75: 
DeprecationWarning:
|
| `numpy.distutils` is deprecated since NumPy 1.23.0, as a result
|  of the deprecation of `distutils` itself. It will be removed for
|  Python >= 3.12. For older Python versions it will remain present.
|  It is recommended to use `setuptools < 60.0` for those Python versions.
|  For more details, see:
| https://numpy.org/devdocs/reference/distutils_status_migration.html
|
|
|  import numpy.distutils.command.sdist
|Traceback (most recent call last):
|  File 
"/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py", 
line 483, in <module>
|    from numpy.distutils.core import numpy_cmdclass as cmdclass
|  File 
"/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/core.py", 
line 24, in <module>
|    from numpy.distutils.command import config, config_compiler, \
|  File 
"/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/command/config.py", 
line 19, in <module>
|    from numpy.distutils.mingw32ccompiler import generate_manifest
|  File 
"/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/mingw32ccompiler.py", 
line 27, in <module>
|    from distutils.msvccompiler import get_build_version as 
get_build_msvc_version
|ModuleNotFoundError: No module named 'distutils.msvccompiler'
|ERROR: 'python3 setup.py bdist_wheel ' execution failed.

I think we'll need to wait for the numpy upgrade to go in.

>
> On Thu, Aug 22, 2024 at 6:30 PM Martin Jansa via
> lists.openembedded.org <martin.jansa=gmail.com@lists.openembedded.org>
> wrote:
>> This seems to break python3-numpy build.
>>
>> I guess it can be resolved by upgrading numpy as in:
>> https://lists.openembedded.org/g/openembedded-core/message/203231
>> which switches from setuptools3 to python_mesonpy
>>
>> Comparing the failing command line it looks like CXX and some other
>> flags are included twice:
>>
>> with: setuptools-72.2.0:
>>
>> ccache \
>> aarch64-oe-linux-g++ \
>> -fstack-protector-all \
>> -O2 \
>> -D_FORTIFY_SOURCE=2 \
>> -Wformat \
>> -Wformat-security \
>> -Werror=format-security \
>> -Werror=return-type \
>> -funwind-tables \
>> --sysroot=WORKDIR/recipe-sysroot \
>> -O2 \
>> -g \
>> -fcanon-prefix-map \
>> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
>> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
>> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
>> -pipe \
>> -fvisibility-inlines-hidden \
>> aarch64-oe-linux-g++ \
>> -fstack-protector-all \
>> -O2 \
>> -D_FORTIFY_SOURCE=2 \
>> -Wformat \
>> -Wformat-security \
>> -Werror=format-security \
>> -Werror=return-type \
>> -funwind-tables \
>> --sysroot=WORKDIR/recipe-sysroot \
>> -shared \
>> -Wl,-O1 \
>> -Wl,--hash-style=gnu \
>> -Wl,--as-needed \
>> -fcanon-prefix-map \
>> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
>> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
>> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
>> -Wl,-z,relro,-z,now \
>> -O2 \
>> -g \
>> -fcanon-prefix-map \
>> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
>> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
>> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
>> -pipe \
>> -fvisibility-inlines-hidden \
>> build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
>> \
>> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
>> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
>> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_hashtable.o \
>> -LWORKDIR/recipe-sysroot/usr/lib \
>> -Lbuild/temp.linux-x86_64-cpython-312 \
>> -lnpymath \
>> -o \
>> build/lib.linux-x86_64-cpython-312/numpy/core/_multiarray_tests.cpython-312-aarch64-linux-gnu.so
>>
>> --- setuptools-72.1.0   2024-08-22 18:17:36.941146726 +0200
>> +++ setuptools-72.2.0   2024-08-22 18:17:27.208147768 +0200
>> @@ -9,6 +9,28 @@
>>   -Werror=return-type \
>>   -funwind-tables \
>>   --sysroot=WORKDIR/recipe-sysroot \
>> +-O2 \
>> +-g \
>> +-fcanon-prefix-map \
>> +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
>> +-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
>> +-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
>> +-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
>> +-pipe \
>> +-fvisibility-inlines-hidden \
>> +aarch64-oe-linux-g++ \
>> +-fstack-protector-all \
>> +-O2 \
>> +-D_FORTIFY_SOURCE=2 \
>> +-Wformat \
>> +-Wformat-security \
>> +-Werror=format-security \
>> +-Werror=return-type \
>> +-funwind-tables \
>> +--sysroot=WORKDIR/recipe-sysroot \
>>   -shared \
>>   -Wl,-O1 \
>>   -Wl,--hash-style=gnu \
>> @@ -33,6 +55,7 @@
>>   -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
>>   -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
>>   -pipe \
>> +-fvisibility-inlines-hidden \
>>   build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
>> \
>>   build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
>>   build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
>>
>> failing with:
>> WORKDIR/recipe-sysroot-native/usr/bin/aarch64-oe-linux/../../libexec/aarch64-oe-linux/gcc/aarch64-oe-linux/14.2.0/ld:
>> cannot find aarch64-oe-linux-g++: No such file or directory
>> collect2: error: ld returned 1 exit status
>>
>> On Tue, Aug 20, 2024 at 8:52 AM wangmy via lists.openembedded.org
>> <wangmy=fujitsu.com@lists.openembedded.org> wrote:
>>> From: Wang Mingyu <wangmy@fujitsu.com>
>>>
>>> Changelog:
>>> - Support for Pathlike objects in data files and extensions
>>> - native support for C++ compilers
>>> - removed unused get_msvcr()
>>>
>>> Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
>>> ---
>>>   ...ython3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} | 2 +-
>>>   1 file changed, 1 insertion(+), 1 deletion(-)
>>>   rename meta/recipes-devtools/python/{python3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} (94%)
>>>
>>> diff --git a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
>>> similarity index 94%
>>> rename from meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
>>> rename to meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
>>> index 945d443aff..63ea999960 100644
>>> --- a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
>>> +++ b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
>>> @@ -11,7 +11,7 @@ SRC_URI:append:class-native = " file://0001-conditionally-do-not-fetch-code-by-e
>>>   SRC_URI += " \
>>>               file://0001-_distutils-sysconfig.py-make-it-possible-to-substite.patch"
>>>
>>> -SRC_URI[sha256sum] = "8d243eff56d095e5817f796ede6ae32941278f542e0f941867cc05ae52b162ec"
>>> +SRC_URI[sha256sum] = "80aacbf633704e9c8bfa1d99fa5dd4dc59573efcf9e4042c13d3bcef91ac2ef9"
>>>
>>>   DEPENDS += "python3"
>>>
>>> --
>>> 2.34.1
>>>
>>>
>>>
>>>
>>
>>
>>
>> -=-=-=-=-=-=-=-=-=-=-=-
>> Links: You receive all messages sent to this group.
>> View/Reply Online (#203661): https://lists.openembedded.org/g/openembedded-core/message/203661
>> Mute This Topic: https://lists.openembedded.org/mt/107996505/7611679
>> Group Owner: openembedded-core+owner@lists.openembedded.org
>> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [tgamblin@baylibre.com]
>> -=-=-=-=-=-=-=-=-=-=-=-
>>
Alexander Kanavin Aug. 28, 2024, 8:19 p.m. UTC | #4
On Wed, 28 Aug 2024 at 22:05, Trevor Gamblin via
lists.openembedded.org <tgamblin=baylibre.com@lists.openembedded.org>
wrote:
> Even with that workaround, I see a more serious issue:
>
> |DEBUG: Executing shell function do_compile
> |/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py:60:
> RuntimeWarning: NumPy 1.26.4 may not yet support Python 3.12.
> | warnings.warn(
> |Running from numpy source directory.
> |/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py:75:
> DeprecationWarning:
> |
> | `numpy.distutils` is deprecated since NumPy 1.23.0, as a result
> |  of the deprecation of `distutils` itself. It will be removed for
> |  Python >= 3.12. For older Python versions it will remain present.
> |  It is recommended to use `setuptools < 60.0` for those Python versions.
> |  For more details, see:
> | https://numpy.org/devdocs/reference/distutils_status_migration.html
> |
> |
> |  import numpy.distutils.command.sdist
> |Traceback (most recent call last):
> |  File
> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py",
> line 483, in <module>
> |    from numpy.distutils.core import numpy_cmdclass as cmdclass
> |  File
> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/core.py",
> line 24, in <module>
> |    from numpy.distutils.command import config, config_compiler, \
> |  File
> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/command/config.py",
> line 19, in <module>
> |    from numpy.distutils.mingw32ccompiler import generate_manifest
> |  File
> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/mingw32ccompiler.py",
> line 27, in <module>
> |    from distutils.msvccompiler import get_build_version as
> get_build_msvc_version
> |ModuleNotFoundError: No module named 'distutils.msvccompiler'
> |ERROR: 'python3 setup.py bdist_wheel ' execution failed.
>
> I think we'll need to wait for the numpy upgrade to go in.

I don't understand. This setuptools update did make it to master, and
numpy 1.26.4 builds fine with it on the autobuilder and in my local
builds.

Alex
Trevor Gamblin Aug. 28, 2024, 8:31 p.m. UTC | #5
On 2024-08-28 4:19 p.m., Alexander Kanavin wrote:
> On Wed, 28 Aug 2024 at 22:05, Trevor Gamblin via
> lists.openembedded.org <tgamblin=baylibre.com@lists.openembedded.org>
> wrote:
>> Even with that workaround, I see a more serious issue:
>>
>> |DEBUG: Executing shell function do_compile
>> |/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py:60:
>> RuntimeWarning: NumPy 1.26.4 may not yet support Python 3.12.
>> | warnings.warn(
>> |Running from numpy source directory.
>> |/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py:75:
>> DeprecationWarning:
>> |
>> | `numpy.distutils` is deprecated since NumPy 1.23.0, as a result
>> |  of the deprecation of `distutils` itself. It will be removed for
>> |  Python >= 3.12. For older Python versions it will remain present.
>> |  It is recommended to use `setuptools < 60.0` for those Python versions.
>> |  For more details, see:
>> | https://numpy.org/devdocs/reference/distutils_status_migration.html
>> |
>> |
>> |  import numpy.distutils.command.sdist
>> |Traceback (most recent call last):
>> |  File
>> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py",
>> line 483, in <module>
>> |    from numpy.distutils.core import numpy_cmdclass as cmdclass
>> |  File
>> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/core.py",
>> line 24, in <module>
>> |    from numpy.distutils.command import config, config_compiler, \
>> |  File
>> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/command/config.py",
>> line 19, in <module>
>> |    from numpy.distutils.mingw32ccompiler import generate_manifest
>> |  File
>> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/mingw32ccompiler.py",
>> line 27, in <module>
>> |    from distutils.msvccompiler import get_build_version as
>> get_build_msvc_version
>> |ModuleNotFoundError: No module named 'distutils.msvccompiler'
>> |ERROR: 'python3 setup.py bdist_wheel ' execution failed.
>>
>> I think we'll need to wait for the numpy upgrade to go in.
> I don't understand. This setuptools update did make it to master, and
> numpy 1.26.4 builds fine with it on the autobuilder and in my local
> builds.
Sorry, got my wires crossed. I'm trying setuptools 74.x, which I only 
mentioned testing in IRC...
>
> Alex
Alexander Kanavin Aug. 28, 2024, 8:34 p.m. UTC | #6
If numpy 2.x update was prevented by lack of recent piglit, that has
now landed in master.

Alex

On Wed, 28 Aug 2024 at 22:31, Trevor Gamblin <tgamblin@baylibre.com> wrote:
>
>
> On 2024-08-28 4:19 p.m., Alexander Kanavin wrote:
> > On Wed, 28 Aug 2024 at 22:05, Trevor Gamblin via
> > lists.openembedded.org <tgamblin=baylibre.com@lists.openembedded.org>
> > wrote:
> >> Even with that workaround, I see a more serious issue:
> >>
> >> |DEBUG: Executing shell function do_compile
> >> |/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py:60:
> >> RuntimeWarning: NumPy 1.26.4 may not yet support Python 3.12.
> >> | warnings.warn(
> >> |Running from numpy source directory.
> >> |/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py:75:
> >> DeprecationWarning:
> >> |
> >> | `numpy.distutils` is deprecated since NumPy 1.23.0, as a result
> >> |  of the deprecation of `distutils` itself. It will be removed for
> >> |  Python >= 3.12. For older Python versions it will remain present.
> >> |  It is recommended to use `setuptools < 60.0` for those Python versions.
> >> |  For more details, see:
> >> | https://numpy.org/devdocs/reference/distutils_status_migration.html
> >> |
> >> |
> >> |  import numpy.distutils.command.sdist
> >> |Traceback (most recent call last):
> >> |  File
> >> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/setup.py",
> >> line 483, in <module>
> >> |    from numpy.distutils.core import numpy_cmdclass as cmdclass
> >> |  File
> >> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/core.py",
> >> line 24, in <module>
> >> |    from numpy.distutils.command import config, config_compiler, \
> >> |  File
> >> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/command/config.py",
> >> line 19, in <module>
> >> |    from numpy.distutils.mingw32ccompiler import generate_manifest
> >> |  File
> >> "/home/tgamblin/workspace/yocto/poky/build/tmp/work/core2-64-poky-linux/python3-numpy/1.26.4/numpy-1.26.4/numpy/distutils/mingw32ccompiler.py",
> >> line 27, in <module>
> >> |    from distutils.msvccompiler import get_build_version as
> >> get_build_msvc_version
> >> |ModuleNotFoundError: No module named 'distutils.msvccompiler'
> >> |ERROR: 'python3 setup.py bdist_wheel ' execution failed.
> >>
> >> I think we'll need to wait for the numpy upgrade to go in.
> > I don't understand. This setuptools update did make it to master, and
> > numpy 1.26.4 builds fine with it on the autobuilder and in my local
> > builds.
> Sorry, got my wires crossed. I'm trying setuptools 74.x, which I only
> mentioned testing in IRC...
> >
> > Alex
Martin Jansa Sept. 3, 2024, 8:36 a.m. UTC | #7
Hello Wang,

did you have a look at this regression (with ccache) from the
setuptools upgrade?

Regards,

On Thu, Aug 22, 2024 at 6:30 PM Martin Jansa <martin.jansa@gmail.com> wrote:
>
> This seems to break python3-numpy build.
>
> I guess it can be resolved by upgrading numpy as in:
> https://lists.openembedded.org/g/openembedded-core/message/203231
> which switches from setuptools3 to python_mesonpy
>
> Comparing the failing command line it looks like CXX and some other
> flags are included twice:
>
> with: setuptools-72.2.0:
>
> ccache \
> aarch64-oe-linux-g++ \
> -fstack-protector-all \
> -O2 \
> -D_FORTIFY_SOURCE=2 \
> -Wformat \
> -Wformat-security \
> -Werror=format-security \
> -Werror=return-type \
> -funwind-tables \
> --sysroot=WORKDIR/recipe-sysroot \
> -O2 \
> -g \
> -fcanon-prefix-map \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> -pipe \
> -fvisibility-inlines-hidden \
> aarch64-oe-linux-g++ \
> -fstack-protector-all \
> -O2 \
> -D_FORTIFY_SOURCE=2 \
> -Wformat \
> -Wformat-security \
> -Werror=format-security \
> -Werror=return-type \
> -funwind-tables \
> --sysroot=WORKDIR/recipe-sysroot \
> -shared \
> -Wl,-O1 \
> -Wl,--hash-style=gnu \
> -Wl,--as-needed \
> -fcanon-prefix-map \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> -Wl,-z,relro,-z,now \
> -O2 \
> -g \
> -fcanon-prefix-map \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> -pipe \
> -fvisibility-inlines-hidden \
> build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
> \
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_hashtable.o \
> -LWORKDIR/recipe-sysroot/usr/lib \
> -Lbuild/temp.linux-x86_64-cpython-312 \
> -lnpymath \
> -o \
> build/lib.linux-x86_64-cpython-312/numpy/core/_multiarray_tests.cpython-312-aarch64-linux-gnu.so
>
> --- setuptools-72.1.0   2024-08-22 18:17:36.941146726 +0200
> +++ setuptools-72.2.0   2024-08-22 18:17:27.208147768 +0200
> @@ -9,6 +9,28 @@
>  -Werror=return-type \
>  -funwind-tables \
>  --sysroot=WORKDIR/recipe-sysroot \
> +-O2 \
> +-g \
> +-fcanon-prefix-map \
> +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> +-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> +-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> +-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> +-pipe \
> +-fvisibility-inlines-hidden \
> +aarch64-oe-linux-g++ \
> +-fstack-protector-all \
> +-O2 \
> +-D_FORTIFY_SOURCE=2 \
> +-Wformat \
> +-Wformat-security \
> +-Werror=format-security \
> +-Werror=return-type \
> +-funwind-tables \
> +--sysroot=WORKDIR/recipe-sysroot \
>  -shared \
>  -Wl,-O1 \
>  -Wl,--hash-style=gnu \
> @@ -33,6 +55,7 @@
>  -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
>  -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
>  -pipe \
> +-fvisibility-inlines-hidden \
>  build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
> \
>  build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
>  build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
>
> failing with:
> WORKDIR/recipe-sysroot-native/usr/bin/aarch64-oe-linux/../../libexec/aarch64-oe-linux/gcc/aarch64-oe-linux/14.2.0/ld:
> cannot find aarch64-oe-linux-g++: No such file or directory
> collect2: error: ld returned 1 exit status
>
> On Tue, Aug 20, 2024 at 8:52 AM wangmy via lists.openembedded.org
> <wangmy=fujitsu.com@lists.openembedded.org> wrote:
> >
> > From: Wang Mingyu <wangmy@fujitsu.com>
> >
> > Changelog:
> > - Support for Pathlike objects in data files and extensions
> > - native support for C++ compilers
> > - removed unused get_msvcr()
> >
> > Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
> > ---
> >  ...ython3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> >  rename meta/recipes-devtools/python/{python3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} (94%)
> >
> > diff --git a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > similarity index 94%
> > rename from meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > rename to meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > index 945d443aff..63ea999960 100644
> > --- a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > +++ b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > @@ -11,7 +11,7 @@ SRC_URI:append:class-native = " file://0001-conditionally-do-not-fetch-code-by-e
> >  SRC_URI += " \
> >              file://0001-_distutils-sysconfig.py-make-it-possible-to-substite.patch"
> >
> > -SRC_URI[sha256sum] = "8d243eff56d095e5817f796ede6ae32941278f542e0f941867cc05ae52b162ec"
> > +SRC_URI[sha256sum] = "80aacbf633704e9c8bfa1d99fa5dd4dc59573efcf9e4042c13d3bcef91ac2ef9"
> >
> >  DEPENDS += "python3"
> >
> > --
> > 2.34.1
> >
> >
> > -=-=-=-=-=-=-=-=-=-=-=-
> > Links: You receive all messages sent to this group.
> > View/Reply Online (#203537): https://lists.openembedded.org/g/openembedded-core/message/203537
> > Mute This Topic: https://lists.openembedded.org/mt/107996505/3617156
> > Group Owner: openembedded-core+owner@lists.openembedded.org
> > Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [martin.jansa@gmail.com]
> > -=-=-=-=-=-=-=-=-=-=-=-
> >
Khem Raj Sept. 3, 2024, 5 p.m. UTC | #8
Hi Martin

Can you try reverting this patch

https://github.com/pypa/setuptools/commit/2c937116cc0dcd9b26b6070e89a3dc5dcbedc2ae

and see if it helps ?

On Tue, Sep 3, 2024 at 1:36 AM Martin Jansa via lists.openembedded.org
<martin.jansa=gmail.com@lists.openembedded.org> wrote:
>
> Hello Wang,
>
> did you have a look at this regression (with ccache) from the
> setuptools upgrade?
>
> Regards,
>
> On Thu, Aug 22, 2024 at 6:30 PM Martin Jansa <martin.jansa@gmail.com> wrote:
> >
> > This seems to break python3-numpy build.
> >
> > I guess it can be resolved by upgrading numpy as in:
> > https://lists.openembedded.org/g/openembedded-core/message/203231
> > which switches from setuptools3 to python_mesonpy
> >
> > Comparing the failing command line it looks like CXX and some other
> > flags are included twice:
> >
> > with: setuptools-72.2.0:
> >
> > ccache \
> > aarch64-oe-linux-g++ \
> > -fstack-protector-all \
> > -O2 \
> > -D_FORTIFY_SOURCE=2 \
> > -Wformat \
> > -Wformat-security \
> > -Werror=format-security \
> > -Werror=return-type \
> > -funwind-tables \
> > --sysroot=WORKDIR/recipe-sysroot \
> > -O2 \
> > -g \
> > -fcanon-prefix-map \
> > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > -pipe \
> > -fvisibility-inlines-hidden \
> > aarch64-oe-linux-g++ \
> > -fstack-protector-all \
> > -O2 \
> > -D_FORTIFY_SOURCE=2 \
> > -Wformat \
> > -Wformat-security \
> > -Werror=format-security \
> > -Werror=return-type \
> > -funwind-tables \
> > --sysroot=WORKDIR/recipe-sysroot \
> > -shared \
> > -Wl,-O1 \
> > -Wl,--hash-style=gnu \
> > -Wl,--as-needed \
> > -fcanon-prefix-map \
> > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > -Wl,-z,relro,-z,now \
> > -O2 \
> > -g \
> > -fcanon-prefix-map \
> > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > -pipe \
> > -fvisibility-inlines-hidden \
> > build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
> > \
> > build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
> > build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
> > build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_hashtable.o \
> > -LWORKDIR/recipe-sysroot/usr/lib \
> > -Lbuild/temp.linux-x86_64-cpython-312 \
> > -lnpymath \
> > -o \
> > build/lib.linux-x86_64-cpython-312/numpy/core/_multiarray_tests.cpython-312-aarch64-linux-gnu.so
> >
> > --- setuptools-72.1.0   2024-08-22 18:17:36.941146726 +0200
> > +++ setuptools-72.2.0   2024-08-22 18:17:27.208147768 +0200
> > @@ -9,6 +9,28 @@
> >  -Werror=return-type \
> >  -funwind-tables \
> >  --sysroot=WORKDIR/recipe-sysroot \
> > +-O2 \
> > +-g \
> > +-fcanon-prefix-map \
> > +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > +-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > +-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > +-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > +-pipe \
> > +-fvisibility-inlines-hidden \
> > +aarch64-oe-linux-g++ \
> > +-fstack-protector-all \
> > +-O2 \
> > +-D_FORTIFY_SOURCE=2 \
> > +-Wformat \
> > +-Wformat-security \
> > +-Werror=format-security \
> > +-Werror=return-type \
> > +-funwind-tables \
> > +--sysroot=WORKDIR/recipe-sysroot \
> >  -shared \
> >  -Wl,-O1 \
> >  -Wl,--hash-style=gnu \
> > @@ -33,6 +55,7 @@
> >  -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> >  -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> >  -pipe \
> > +-fvisibility-inlines-hidden \
> >  build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
> > \
> >  build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
> >  build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
> >
> > failing with:
> > WORKDIR/recipe-sysroot-native/usr/bin/aarch64-oe-linux/../../libexec/aarch64-oe-linux/gcc/aarch64-oe-linux/14.2.0/ld:
> > cannot find aarch64-oe-linux-g++: No such file or directory
> > collect2: error: ld returned 1 exit status
> >
> > On Tue, Aug 20, 2024 at 8:52 AM wangmy via lists.openembedded.org
> > <wangmy=fujitsu.com@lists.openembedded.org> wrote:
> > >
> > > From: Wang Mingyu <wangmy@fujitsu.com>
> > >
> > > Changelog:
> > > - Support for Pathlike objects in data files and extensions
> > > - native support for C++ compilers
> > > - removed unused get_msvcr()
> > >
> > > Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
> > > ---
> > >  ...ython3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} | 2 +-
> > >  1 file changed, 1 insertion(+), 1 deletion(-)
> > >  rename meta/recipes-devtools/python/{python3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} (94%)
> > >
> > > diff --git a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > similarity index 94%
> > > rename from meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > > rename to meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > index 945d443aff..63ea999960 100644
> > > --- a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > > +++ b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > @@ -11,7 +11,7 @@ SRC_URI:append:class-native = " file://0001-conditionally-do-not-fetch-code-by-e
> > >  SRC_URI += " \
> > >              file://0001-_distutils-sysconfig.py-make-it-possible-to-substite.patch"
> > >
> > > -SRC_URI[sha256sum] = "8d243eff56d095e5817f796ede6ae32941278f542e0f941867cc05ae52b162ec"
> > > +SRC_URI[sha256sum] = "80aacbf633704e9c8bfa1d99fa5dd4dc59573efcf9e4042c13d3bcef91ac2ef9"
> > >
> > >  DEPENDS += "python3"
> > >
> > > --
> > > 2.34.1
> > >
> > >
> > >
> > >
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#204150): https://lists.openembedded.org/g/openembedded-core/message/204150
> Mute This Topic: https://lists.openembedded.org/mt/107996505/1997914
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [raj.khem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
Mingyu Wang (Fujitsu) Sept. 4, 2024, 1:01 a.m. UTC | #9
Sorry. Because I saw you send a patch to solve the problem before, so I didn't follow up anymore. 
I will now take a look at what issues have occurred.

  --
Best Regards
---------------------------------------------------
Wang Mingyu
FUJITSU NANJING SOFTWARE TECHNOLOGY CO., LTD. (FNST)
No.6 Wenzhu Road, Nanjing, 210012, China
TEL:+86+25-86630566--8568
COINS: 79988548
FAX: +86+25-83317685
MAIL: wangmy@fujitsu.com

> -----Original Message-----
> From: Martin Jansa <martin.jansa@gmail.com>
> Sent: Tuesday, September 3, 2024 4:37 PM
> To: Wang, Mingyu/王 鸣瑜 <wangmy@fujitsu.com>
> Cc: openembedded-core@lists.openembedded.org
> Subject: Re: [OE-core] [PATCH 19/24] python3-setuptools: upgrade 72.1.0 ->
> 72.2.0
> 
> Hello Wang,
> 
> did you have a look at this regression (with ccache) from the setuptools
> upgrade?
> 
> Regards,
> 
> On Thu, Aug 22, 2024 at 6:30 PM Martin Jansa <martin.jansa@gmail.com>
> wrote:
> >
> > This seems to break python3-numpy build.
> >
> > I guess it can be resolved by upgrading numpy as in:
> > https://lists.openembedded.org/g/openembedded-core/message/203231
> > which switches from setuptools3 to python_mesonpy
> >
> > Comparing the failing command line it looks like CXX and some other
> > flags are included twice:
> >
> > with: setuptools-72.2.0:
> >
> > ccache \
> > aarch64-oe-linux-g++ \
> > -fstack-protector-all \
> > -O2 \
> > -D_FORTIFY_SOURCE=2 \
> > -Wformat \
> > -Wformat-security \
> > -Werror=format-security \
> > -Werror=return-type \
> > -funwind-tables \
> > --sysroot=WORKDIR/recipe-sysroot \
> > -O2 \
> > -g \
> > -fcanon-prefix-map \
> >
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \ -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \ -pipe \
> > -fvisibility-inlines-hidden \
> > aarch64-oe-linux-g++ \
> > -fstack-protector-all \
> > -O2 \
> > -D_FORTIFY_SOURCE=2 \
> > -Wformat \
> > -Wformat-security \
> > -Werror=format-security \
> > -Werror=return-type \
> > -funwind-tables \
> > --sysroot=WORKDIR/recipe-sysroot \
> > -shared \
> > -Wl,-O1 \
> > -Wl,--hash-style=gnu \
> > -Wl,--as-needed \
> > -fcanon-prefix-map \
> >
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \ -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > -Wl,-z,relro,-z,now \
> > -O2 \
> > -g \
> > -fcanon-prefix-map \
> >
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \
> >
> -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/
> 1
> > .26.4 \ -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \ -pipe \
> > -fvisibility-inlines-hidden \
> > build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/
> > core/src/multiarray/_multiarray_tests.o
> > \
> >
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.
> > o \
> >
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse
> > .o \
> > build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_hashtabl
> > e.o \ -LWORKDIR/recipe-sysroot/usr/lib \
> > -Lbuild/temp.linux-x86_64-cpython-312 \ -lnpymath \ -o \
> > build/lib.linux-x86_64-cpython-312/numpy/core/_multiarray_tests.cpytho
> > n-312-aarch64-linux-gnu.so
> >
> > --- setuptools-72.1.0   2024-08-22 18:17:36.941146726 +0200
> > +++ setuptools-72.2.0   2024-08-22 18:17:27.208147768 +0200
> > @@ -9,6 +9,28 @@
> >  -Werror=return-type \
> >  -funwind-tables \
> >  --sysroot=WORKDIR/recipe-sysroot \
> > +-O2 \
> > +-g \
> > +-fcanon-prefix-map \
> >
> +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy
> /
> > +1.26.4 \
> >
> +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy
> /
> > +1.26.4 \
> >
> +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy
> /
> > +1.26.4 \
> >
> +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy
> /
> > +1.26.4 \ -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > +-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > +-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \ -pipe \
> > +-fvisibility-inlines-hidden \
> > +aarch64-oe-linux-g++ \
> > +-fstack-protector-all \
> > +-O2 \
> > +-D_FORTIFY_SOURCE=2 \
> > +-Wformat \
> > +-Wformat-security \
> > +-Werror=format-security \
> > +-Werror=return-type \
> > +-funwind-tables \
> > +--sysroot=WORKDIR/recipe-sysroot \
> >  -shared \
> >  -Wl,-O1 \
> >  -Wl,--hash-style=gnu \
> > @@ -33,6 +55,7 @@
> >  -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \  -pipe \
> > +-fvisibility-inlines-hidden \
> >
> > build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/
> > core/src/multiarray/_multiarray_tests.o
> > \
> >
> >
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.
> > o \
> >
> build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse
> > .o \
> >
> > failing with:
> >
> WORKDIR/recipe-sysroot-native/usr/bin/aarch64-oe-linux/../../libexec/aarch64-
> oe-linux/gcc/aarch64-oe-linux/14.2.0/ld:
> > cannot find aarch64-oe-linux-g++: No such file or directory
> > collect2: error: ld returned 1 exit status
> >
> > On Tue, Aug 20, 2024 at 8:52 AM wangmy via lists.openembedded.org
> > <wangmy=fujitsu.com@lists.openembedded.org> wrote:
> > >
> > > From: Wang Mingyu <wangmy@fujitsu.com>
> > >
> > > Changelog:
> > > - Support for Pathlike objects in data files and extensions
> > > - native support for C++ compilers
> > > - removed unused get_msvcr()
> > >
> > > Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
> > > ---
> > >  ...ython3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} | 2
> > > +-
> > >  1 file changed, 1 insertion(+), 1 deletion(-)  rename
> > > meta/recipes-devtools/python/{python3-setuptools_72.1.0.bb =>
> > > python3-setuptools_72.2.0.bb} (94%)
> > >
> > > diff --git
> > > a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > > b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > similarity index 94%
> > > rename from
> > > meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > > rename to meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > index 945d443aff..63ea999960 100644
> > > --- a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > > +++ b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > @@ -11,7 +11,7 @@ SRC_URI:append:class-native = "
> > > file://0001-conditionally-do-not-fetch-code-by-e
> > >  SRC_URI += " \
> > >
> file://0001-_distutils-sysconfig.py-make-it-possible-to-substite.patch"
> > >
> > > -SRC_URI[sha256sum] =
> "8d243eff56d095e5817f796ede6ae32941278f542e0f941867cc05ae52b162ec"
> > > +SRC_URI[sha256sum] =
> "80aacbf633704e9c8bfa1d99fa5dd4dc59573efcf9e4042c13d3bcef91ac2ef9"
> > >
> > >  DEPENDS += "python3"
> > >
> > > --
> > > 2.34.1
> > >
> > >
> > > -=-=-=-=-=-=-=-=-=-=-=-
> > > Links: You receive all messages sent to this group.
> > > View/Reply Online (#203537):
> > > https://lists.openembedded.org/g/openembedded-core/message/203537
> > > Mute This Topic: https://lists.openembedded.org/mt/107996505/3617156
> > > Group Owner: openembedded-core+owner@lists.openembedded.org
> > > Unsubscribe:
> > > https://lists.openembedded.org/g/openembedded-core/unsub
> > > [martin.jansa@gmail.com]
> > > -=-=-=-=-=-=-=-=-=-=-=-
> > >
Martin Jansa Sept. 5, 2024, 12:44 p.m. UTC | #10
Hi Khem,

it's surely related, but not a simple revert (as distutils commits are
merged into setuptools into different prefix and there were couple
commits on top), but with most of it reverted as in:
https://git.openembedded.org/openembedded-core-contrib/commit/?h=jansa/master-setuptools&id=cf310822e986802b0b97a7dcac2b9022d640efab
it no longer fails (tested with python3-icu with ccache enabled).

Regards,

On Tue, Sep 3, 2024 at 7:01 PM Khem Raj <raj.khem@gmail.com> wrote:
>
> Hi Martin
>
> Can you try reverting this patch
>
> https://github.com/pypa/setuptools/commit/2c937116cc0dcd9b26b6070e89a3dc5dcbedc2ae
>
> and see if it helps ?
>
> On Tue, Sep 3, 2024 at 1:36 AM Martin Jansa via lists.openembedded.org
> <martin.jansa=gmail.com@lists.openembedded.org> wrote:
> >
> > Hello Wang,
> >
> > did you have a look at this regression (with ccache) from the
> > setuptools upgrade?
> >
> > Regards,
> >
> > On Thu, Aug 22, 2024 at 6:30 PM Martin Jansa <martin.jansa@gmail.com> wrote:
> > >
> > > This seems to break python3-numpy build.
> > >
> > > I guess it can be resolved by upgrading numpy as in:
> > > https://lists.openembedded.org/g/openembedded-core/message/203231
> > > which switches from setuptools3 to python_mesonpy
> > >
> > > Comparing the failing command line it looks like CXX and some other
> > > flags are included twice:
> > >
> > > with: setuptools-72.2.0:
> > >
> > > ccache \
> > > aarch64-oe-linux-g++ \
> > > -fstack-protector-all \
> > > -O2 \
> > > -D_FORTIFY_SOURCE=2 \
> > > -Wformat \
> > > -Wformat-security \
> > > -Werror=format-security \
> > > -Werror=return-type \
> > > -funwind-tables \
> > > --sysroot=WORKDIR/recipe-sysroot \
> > > -O2 \
> > > -g \
> > > -fcanon-prefix-map \
> > > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > > -pipe \
> > > -fvisibility-inlines-hidden \
> > > aarch64-oe-linux-g++ \
> > > -fstack-protector-all \
> > > -O2 \
> > > -D_FORTIFY_SOURCE=2 \
> > > -Wformat \
> > > -Wformat-security \
> > > -Werror=format-security \
> > > -Werror=return-type \
> > > -funwind-tables \
> > > --sysroot=WORKDIR/recipe-sysroot \
> > > -shared \
> > > -Wl,-O1 \
> > > -Wl,--hash-style=gnu \
> > > -Wl,--as-needed \
> > > -fcanon-prefix-map \
> > > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > > -Wl,-z,relro,-z,now \
> > > -O2 \
> > > -g \
> > > -fcanon-prefix-map \
> > > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > -fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > > -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > > -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > > -pipe \
> > > -fvisibility-inlines-hidden \
> > > build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
> > > \
> > > build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
> > > build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
> > > build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_hashtable.o \
> > > -LWORKDIR/recipe-sysroot/usr/lib \
> > > -Lbuild/temp.linux-x86_64-cpython-312 \
> > > -lnpymath \
> > > -o \
> > > build/lib.linux-x86_64-cpython-312/numpy/core/_multiarray_tests.cpython-312-aarch64-linux-gnu.so
> > >
> > > --- setuptools-72.1.0   2024-08-22 18:17:36.941146726 +0200
> > > +++ setuptools-72.2.0   2024-08-22 18:17:27.208147768 +0200
> > > @@ -9,6 +9,28 @@
> > >  -Werror=return-type \
> > >  -funwind-tables \
> > >  --sysroot=WORKDIR/recipe-sysroot \
> > > +-O2 \
> > > +-g \
> > > +-fcanon-prefix-map \
> > > +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > +-fmacro-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > +-fdebug-prefix-map=WORKDIR/numpy-1.26.4=/usr/src/debug/python3-numpy/1.26.4 \
> > > +-fdebug-prefix-map=WORKDIR/recipe-sysroot= \
> > > +-fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > > +-fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > > +-pipe \
> > > +-fvisibility-inlines-hidden \
> > > +aarch64-oe-linux-g++ \
> > > +-fstack-protector-all \
> > > +-O2 \
> > > +-D_FORTIFY_SOURCE=2 \
> > > +-Wformat \
> > > +-Wformat-security \
> > > +-Werror=format-security \
> > > +-Werror=return-type \
> > > +-funwind-tables \
> > > +--sysroot=WORKDIR/recipe-sysroot \
> > >  -shared \
> > >  -Wl,-O1 \
> > >  -Wl,--hash-style=gnu \
> > > @@ -33,6 +55,7 @@
> > >  -fmacro-prefix-map=WORKDIR/recipe-sysroot= \
> > >  -fdebug-prefix-map=WORKDIR/recipe-sysroot-native= \
> > >  -pipe \
> > > +-fvisibility-inlines-hidden \
> > >  build/temp.linux-x86_64-cpython-312/build/src.linux-x86_64-3.12/numpy/core/src/multiarray/_multiarray_tests.o
> > > \
> > >  build/temp.linux-x86_64-cpython-312/numpy/core/src/common/mem_overlap.o \
> > >  build/temp.linux-x86_64-cpython-312/numpy/core/src/common/npy_argparse.o \
> > >
> > > failing with:
> > > WORKDIR/recipe-sysroot-native/usr/bin/aarch64-oe-linux/../../libexec/aarch64-oe-linux/gcc/aarch64-oe-linux/14.2.0/ld:
> > > cannot find aarch64-oe-linux-g++: No such file or directory
> > > collect2: error: ld returned 1 exit status
> > >
> > > On Tue, Aug 20, 2024 at 8:52 AM wangmy via lists.openembedded.org
> > > <wangmy=fujitsu.com@lists.openembedded.org> wrote:
> > > >
> > > > From: Wang Mingyu <wangmy@fujitsu.com>
> > > >
> > > > Changelog:
> > > > - Support for Pathlike objects in data files and extensions
> > > > - native support for C++ compilers
> > > > - removed unused get_msvcr()
> > > >
> > > > Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
> > > > ---
> > > >  ...ython3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} | 2 +-
> > > >  1 file changed, 1 insertion(+), 1 deletion(-)
> > > >  rename meta/recipes-devtools/python/{python3-setuptools_72.1.0.bb => python3-setuptools_72.2.0.bb} (94%)
> > > >
> > > > diff --git a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > > similarity index 94%
> > > > rename from meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > > > rename to meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > > index 945d443aff..63ea999960 100644
> > > > --- a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
> > > > +++ b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
> > > > @@ -11,7 +11,7 @@ SRC_URI:append:class-native = " file://0001-conditionally-do-not-fetch-code-by-e
> > > >  SRC_URI += " \
> > > >              file://0001-_distutils-sysconfig.py-make-it-possible-to-substite.patch"
> > > >
> > > > -SRC_URI[sha256sum] = "8d243eff56d095e5817f796ede6ae32941278f542e0f941867cc05ae52b162ec"
> > > > +SRC_URI[sha256sum] = "80aacbf633704e9c8bfa1d99fa5dd4dc59573efcf9e4042c13d3bcef91ac2ef9"
> > > >
> > > >  DEPENDS += "python3"
> > > >
> > > > --
> > > > 2.34.1
> > > >
> > > >
> > > >
> > > >
> >
> > -=-=-=-=-=-=-=-=-=-=-=-
> > Links: You receive all messages sent to this group.
> > View/Reply Online (#204150): https://lists.openembedded.org/g/openembedded-core/message/204150
> > Mute This Topic: https://lists.openembedded.org/mt/107996505/1997914
> > Group Owner: openembedded-core+owner@lists.openembedded.org
> > Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [raj.khem@gmail.com]
> > -=-=-=-=-=-=-=-=-=-=-=-
> >
diff mbox series

Patch

diff --git a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
similarity index 94%
rename from meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
rename to meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
index 945d443aff..63ea999960 100644
--- a/meta/recipes-devtools/python/python3-setuptools_72.1.0.bb
+++ b/meta/recipes-devtools/python/python3-setuptools_72.2.0.bb
@@ -11,7 +11,7 @@  SRC_URI:append:class-native = " file://0001-conditionally-do-not-fetch-code-by-e
 SRC_URI += " \
             file://0001-_distutils-sysconfig.py-make-it-possible-to-substite.patch"
 
-SRC_URI[sha256sum] = "8d243eff56d095e5817f796ede6ae32941278f542e0f941867cc05ae52b162ec"
+SRC_URI[sha256sum] = "80aacbf633704e9c8bfa1d99fa5dd4dc59573efcf9e4042c13d3bcef91ac2ef9"
 
 DEPENDS += "python3"