diff mbox series

[meta-python,v3,1/3] python3-frozenlist: support reproducibility

Message ID 20250926015937.2916794-1-hongxu.jia@windriver.com
State New
Headers show
Series [meta-python,v3,1/3] python3-frozenlist: support reproducibility | expand

Commit Message

Hongxu Jia Sept. 26, 2025, 1:59 a.m. UTC
In order to make the generated library be reproducible, build wheel
in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
option -fdebug-prefix-map could work as expected

Note: To support reproducibility, it also requires oe-core commit [1] to be merged

[1] https://git.openembedded.org/openembedded-core/commit/?id=61d98d12eca1c7bdf3b7387a820c83d3b8fad965

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
---
 .../files/0001-build-wheel-in-place.patch     | 31 +++++++++++++++++++
 .../python/python3-frozenlist_1.7.0.bb        |  3 ++
 2 files changed, 34 insertions(+)
 create mode 100644 meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch

Comments

Khem Raj Sept. 26, 2025, 3:07 a.m. UTC | #1
It would be better to have a per-recipe copy of the patch. I know it
is the same patch today but it may not be the same tomorrow since
these recipes are quite different.

On Thu, Sep 25, 2025 at 7:00 PM hongxu via lists.openembedded.org
<hongxu.jia=eng.windriver.com@lists.openembedded.org> wrote:
>
> In order to make the generated library be reproducible, build wheel
> in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
> option -fdebug-prefix-map could work as expected
>
> Note: To support reproducibility, it also requires oe-core commit [1] to be merged
>
> [1] https://git.openembedded.org/openembedded-core/commit/?id=61d98d12eca1c7bdf3b7387a820c83d3b8fad965
>
> Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
> ---
>  .../files/0001-build-wheel-in-place.patch     | 31 +++++++++++++++++++
>  .../python/python3-frozenlist_1.7.0.bb        |  3 ++
>  2 files changed, 34 insertions(+)
>  create mode 100644 meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
>
> diff --git a/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
> new file mode 100644
> index 0000000000..84f81da775
> --- /dev/null
> +++ b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
> @@ -0,0 +1,31 @@
> +From 606843ad079d9d0dac1172533d42b5a2327b99ed Mon Sep 17 00:00:00 2001
> +From: Hongxu Jia <hongxu.jia@windriver.com>
> +Date: Wed, 17 Sep 2025 15:41:09 +0800
> +Subject: [PATCH] build wheel in place
> +
> +In order to make the generated library be reproducible, build wheel
> +in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
> +option -fdebug-prefix-map could work as expected
> +
> +Upstream-Status: Pending
> +Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
> +---
> + packaging/pep517_backend/_backend.py | 2 +-
> + 1 file changed, 1 insertion(+), 1 deletion(-)
> +
> +diff --git a/packaging/pep517_backend/_backend.py b/packaging/pep517_backend/_backend.py
> +index 61cad34..d5d839e 100644
> +--- a/packaging/pep517_backend/_backend.py
> ++++ b/packaging/pep517_backend/_backend.py
> +@@ -316,7 +316,7 @@ def build_wheel(
> +     """
> +     with maybe_prebuild_c_extensions(
> +             line_trace_cython_when_unset=False,
> +-            build_inplace=False,
> ++            build_inplace=True,
> +             config_settings=config_settings,
> +     ):
> +         return _setuptools_build_wheel(
> +--
> +2.34.1
> +
> diff --git a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
> index 7d813a026c..d832494c82 100644
> --- a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
> +++ b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
> @@ -7,6 +7,9 @@ SRC_URI[sha256sum] = "2e310d81923c2437ea8670467121cc3e9b0f76d3043cc1d2331d56c7fb
>
>  inherit pypi python_setuptools_build_meta cython
>
> +SRC_URI += " \
> +    file://0001-build-wheel-in-place.patch \
> +"
>  DEPENDS += " \
>      python3-expandvars-native \
>  "
> --
> 2.34.1
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#119888): https://lists.openembedded.org/g/openembedded-devel/message/119888
> Mute This Topic: https://lists.openembedded.org/mt/115442281/1997914
> Group Owner: openembedded-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub [raj.khem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
Hongxu Jia Sept. 26, 2025, 8:12 a.m. UTC | #2
On 9/26/25 11:07, Khem Raj wrote:
> CAUTION: This email comes from a non Wind River email account!
> Do not click links or open attachments unless you recognize the sender and know the content is safe.
>
> It would be better to have a per-recipe copy of the patch. I know it
> is the same patch today but it may not be the same tomorrow since
> these recipes are quite different.

Sure, I will resend the whole series including

[oe] [meta-python][PATCH 1/3] python3-mlcommons-loadgen: support 
reproducibility

[oe] [meta-python][PATCH 2/3] python3-pandas: fix reproducibility issue

[oe] [meta-python][PATCH 3/3] meta-python/conf/layer.conf: update 
OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES

//Hongxu

>
> On Thu, Sep 25, 2025 at 7:00 PM hongxu via lists.openembedded.org
> <hongxu.jia=eng.windriver.com@lists.openembedded.org> wrote:
>> In order to make the generated library be reproducible, build wheel
>> in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
>> option -fdebug-prefix-map could work as expected
>>
>> Note: To support reproducibility, it also requires oe-core commit [1] to be merged
>>
>> [1] https://git.openembedded.org/openembedded-core/commit/?id=61d98d12eca1c7bdf3b7387a820c83d3b8fad965
>>
>> Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
>> ---
>>   .../files/0001-build-wheel-in-place.patch     | 31 +++++++++++++++++++
>>   .../python/python3-frozenlist_1.7.0.bb        |  3 ++
>>   2 files changed, 34 insertions(+)
>>   create mode 100644 meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
>>
>> diff --git a/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
>> new file mode 100644
>> index 0000000000..84f81da775
>> --- /dev/null
>> +++ b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
>> @@ -0,0 +1,31 @@
>> +From 606843ad079d9d0dac1172533d42b5a2327b99ed Mon Sep 17 00:00:00 2001
>> +From: Hongxu Jia <hongxu.jia@windriver.com>
>> +Date: Wed, 17 Sep 2025 15:41:09 +0800
>> +Subject: [PATCH] build wheel in place
>> +
>> +In order to make the generated library be reproducible, build wheel
>> +in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
>> +option -fdebug-prefix-map could work as expected
>> +
>> +Upstream-Status: Pending
>> +Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
>> +---
>> + packaging/pep517_backend/_backend.py | 2 +-
>> + 1 file changed, 1 insertion(+), 1 deletion(-)
>> +
>> +diff --git a/packaging/pep517_backend/_backend.py b/packaging/pep517_backend/_backend.py
>> +index 61cad34..d5d839e 100644
>> +--- a/packaging/pep517_backend/_backend.py
>> ++++ b/packaging/pep517_backend/_backend.py
>> +@@ -316,7 +316,7 @@ def build_wheel(
>> +     """
>> +     with maybe_prebuild_c_extensions(
>> +             line_trace_cython_when_unset=False,
>> +-            build_inplace=False,
>> ++            build_inplace=True,
>> +             config_settings=config_settings,
>> +     ):
>> +         return _setuptools_build_wheel(
>> +--
>> +2.34.1
>> +
>> diff --git a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
>> index 7d813a026c..d832494c82 100644
>> --- a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
>> +++ b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
>> @@ -7,6 +7,9 @@ SRC_URI[sha256sum] = "2e310d81923c2437ea8670467121cc3e9b0f76d3043cc1d2331d56c7fb
>>
>>   inherit pypi python_setuptools_build_meta cython
>>
>> +SRC_URI += " \
>> +    file://0001-build-wheel-in-place.patch \
>> +"
>>   DEPENDS += " \
>>       python3-expandvars-native \
>>   "
>> --
>> 2.34.1
>>
>>
>> -=-=-=-=-=-=-=-=-=-=-=-
>> Links: You receive all messages sent to this group.
>> View/Reply Online (#119888): https://lists.openembedded.org/g/openembedded-devel/message/119888
>> Mute This Topic: https://lists.openembedded.org/mt/115442281/1997914
>> Group Owner: openembedded-devel+owner@lists.openembedded.org
>> Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub [raj.khem@gmail.com]
>> -=-=-=-=-=-=-=-=-=-=-=-
>>
diff mbox series

Patch

diff --git a/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
new file mode 100644
index 0000000000..84f81da775
--- /dev/null
+++ b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
@@ -0,0 +1,31 @@ 
+From 606843ad079d9d0dac1172533d42b5a2327b99ed Mon Sep 17 00:00:00 2001
+From: Hongxu Jia <hongxu.jia@windriver.com>
+Date: Wed, 17 Sep 2025 15:41:09 +0800
+Subject: [PATCH] build wheel in place
+
+In order to make the generated library be reproducible, build wheel
+in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
+option -fdebug-prefix-map could work as expected
+
+Upstream-Status: Pending
+Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
+---
+ packaging/pep517_backend/_backend.py | 2 +-
+ 1 file changed, 1 insertion(+), 1 deletion(-)
+
+diff --git a/packaging/pep517_backend/_backend.py b/packaging/pep517_backend/_backend.py
+index 61cad34..d5d839e 100644
+--- a/packaging/pep517_backend/_backend.py
++++ b/packaging/pep517_backend/_backend.py
+@@ -316,7 +316,7 @@ def build_wheel(
+     """
+     with maybe_prebuild_c_extensions(
+             line_trace_cython_when_unset=False,
+-            build_inplace=False,
++            build_inplace=True,
+             config_settings=config_settings,
+     ):
+         return _setuptools_build_wheel(
+-- 
+2.34.1
+
diff --git a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
index 7d813a026c..d832494c82 100644
--- a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
+++ b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
@@ -7,6 +7,9 @@  SRC_URI[sha256sum] = "2e310d81923c2437ea8670467121cc3e9b0f76d3043cc1d2331d56c7fb
 
 inherit pypi python_setuptools_build_meta cython
 
+SRC_URI += " \
+    file://0001-build-wheel-in-place.patch \
+"
 DEPENDS += " \
     python3-expandvars-native \
 "