diff mbox series

autoconf: Raise line length limit for sed/awk

Message ID 20251127164443.2285753-1-raj.khem@gmail.com
State New
Headers show
Series autoconf: Raise line length limit for sed/awk | expand

Commit Message

Khem Raj Nov. 27, 2025, 4:44 p.m. UTC
Latest autoconf is splitting long cmd lines in config.status
it generates using sed/awk to have compatibility with
platform like HPUX,Solaris,AIX which is understandable given
autotools try to achieve wider portability, however, this does
mean that in OE builds we might get these newlines added in
places dividing commands including buildpaths in them and the
methods deployed to scrub them from output artifacts will fail
since the string is now on two lines resulting in build QA to
pass but the strings do sneak in affecting reproducibility
one such example is e2tools recipe in meta-filesystems and there
perhaps are more

Signed-off-by: Khem Raj <raj.khem@gmail.com>
---
 ...-command-limit-to-prevent-line-wrapp.patch | 41 +++++++++++++++++++
 .../autoconf/autoconf_2.72.bb                 |  3 +-
 2 files changed, 43 insertions(+), 1 deletion(-)
 create mode 100644 meta/recipes-devtools/autoconf/autoconf/0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch

Comments

Yoann Congal Nov. 27, 2025, 5:17 p.m. UTC | #1
Le jeu. 27 nov. 2025 à 17:44, Khem Raj via lists.openembedded.org <raj.khem=
gmail.com@lists.openembedded.org> a écrit :

> Latest autoconf is splitting long cmd lines in config.status
> it generates using sed/awk to have compatibility with
> platform like HPUX,Solaris,AIX which is understandable given
> autotools try to achieve wider portability, however, this does
> mean that in OE builds we might get these newlines added in
> places dividing commands including buildpaths in them and the
> methods deployed to scrub them from output artifacts will fail
> since the string is now on two lines resulting in build QA to
> pass but the strings do sneak in affecting reproducibility
> one such example is e2tools recipe in meta-filesystems and there
> perhaps are more
>
> Signed-off-by: Khem Raj <raj.khem@gmail.com>
>

For the impact on e2tools:
Tested-by: Yoann Congal <yoann.congal@smile.fr>
=> It does indeed make it reproducible by letting the sed replacing non
reproducible paths work.


> ---
>  ...-command-limit-to-prevent-line-wrapp.patch | 41 +++++++++++++++++++
>  .../autoconf/autoconf_2.72.bb                 |  3 +-
>  2 files changed, 43 insertions(+), 1 deletion(-)
>  create mode 100644
> meta/recipes-devtools/autoconf/autoconf/0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch
>
> diff --git
> a/meta/recipes-devtools/autoconf/autoconf/0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch
> b/meta/recipes-devtools/autoconf/autoconf/0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch
> new file mode 100644
> index 00000000000..41468ba316c
> --- /dev/null
> +++
> b/meta/recipes-devtools/autoconf/autoconf/0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch
> @@ -0,0 +1,41 @@
> +From 139f757a6244d3b1e07f7fddc6d07d9c17f45313 Mon Sep 17 00:00:00 2001
> +From: Khem Raj <raj.khem@gmail.com>
> +Date: Tue, 25 Nov 2025 21:03:38 -0800
> +Subject: [PATCH] Increase awk/sed command limit to prevent line wrapping
> +
> +Autoconf 2.70+ wraps long variable assignments in config.status
> +using backslash-newline continuations. This breaks when LDFLAGS
> +or other variables contain special characters.
> +
> +Increase _AC_SED_CMD_LIMIT from 99 and _AC_AWK_LITERAL_LIMIT
> +from 148 to 4000 to prevent wrapping.
> +
> +Upstream-Status: Inappropriate [OE-Specific]
> +
> +Signed-off-by: Khem Raj <raj.khem@gmail.com>
> +---
> + lib/autoconf/status.m4 | 4 ++--
> + 1 file changed, 2 insertions(+), 2 deletions(-)
> +
> +diff --git a/lib/autoconf/status.m4 b/lib/autoconf/status.m4
> +index 2bfaf32..be444b2 100644
> +--- a/lib/autoconf/status.m4
> ++++ b/lib/autoconf/status.m4
> +@@ -297,7 +297,7 @@ AC_DEFUN([AC_CONFIG_FILES], [_AC_CONFIG_FOOS([FILES],
> $@)])
> + # Some seds have small command number limits, like on Digital OSF/1 and
> HP-UX.
> + m4_define([_AC_SED_CMD_LIMIT],
> + dnl One cannot portably go further than 99 commands because of HP-UX.
> +-[99])
> ++[4000])
> +
> +
> + # _AC_AWK_LITERAL_LIMIT
> +@@ -307,7 +307,7 @@ dnl One cannot portably go further than 99 commands
> because of HP-UX.
> + #
> + # Some awk's have small limits, such as Solaris and AIX awk.
> + m4_define([_AC_AWK_LITERAL_LIMIT],
> +-[148])
> ++[4000])
> +
> +
> + # _AC_OUTPUT_FILES_PREPARE
> diff --git a/meta/recipes-devtools/autoconf/autoconf_2.72.bb
> b/meta/recipes-devtools/autoconf/autoconf_2.72.bb
> index b599f270c79..20197d6f793 100644
> --- a/meta/recipes-devtools/autoconf/autoconf_2.72.bb
> +++ b/meta/recipes-devtools/autoconf/autoconf_2.72.bb
> @@ -1,5 +1,5 @@
>  SUMMARY = "A GNU tool that produce shell scripts to automatically
> configure software"
> -DESCRIPTION = "Autoconf is an extensible package of M4 macros that
> produce shell scripts to automatically \
> +DESCRIPTION = "Autoconf is an extensible package of M4 macros that
> produce shell scripts to automatically \
>  configure software source code packages. Autoconf creates a configuration
> script for a package from a template \
>  file that lists the operating system features that the package can use,
> in the form of M4 macro calls."
>  LICENSE = "GPL-3.0-or-later"
> @@ -19,6 +19,7 @@ SRC_URI = " \
>             file://preferbash.patch \
>             file://autotest-automake-result-format.patch \
>             file://man-host-perl.patch \
> +
> file://0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch \
>  "
>  SRC_URI:append:class-native = " file://no-man.patch"
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#226850):
> https://lists.openembedded.org/g/openembedded-core/message/226850
> Mute This Topic: https://lists.openembedded.org/mt/116503258/4316185
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [
> yoann.congal@smile.fr]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>
diff mbox series

Patch

diff --git a/meta/recipes-devtools/autoconf/autoconf/0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch b/meta/recipes-devtools/autoconf/autoconf/0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch
new file mode 100644
index 00000000000..41468ba316c
--- /dev/null
+++ b/meta/recipes-devtools/autoconf/autoconf/0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch
@@ -0,0 +1,41 @@ 
+From 139f757a6244d3b1e07f7fddc6d07d9c17f45313 Mon Sep 17 00:00:00 2001
+From: Khem Raj <raj.khem@gmail.com>
+Date: Tue, 25 Nov 2025 21:03:38 -0800
+Subject: [PATCH] Increase awk/sed command limit to prevent line wrapping
+
+Autoconf 2.70+ wraps long variable assignments in config.status
+using backslash-newline continuations. This breaks when LDFLAGS
+or other variables contain special characters.
+
+Increase _AC_SED_CMD_LIMIT from 99 and _AC_AWK_LITERAL_LIMIT
+from 148 to 4000 to prevent wrapping.
+
+Upstream-Status: Inappropriate [OE-Specific]
+
+Signed-off-by: Khem Raj <raj.khem@gmail.com>
+---
+ lib/autoconf/status.m4 | 4 ++--
+ 1 file changed, 2 insertions(+), 2 deletions(-)
+
+diff --git a/lib/autoconf/status.m4 b/lib/autoconf/status.m4
+index 2bfaf32..be444b2 100644
+--- a/lib/autoconf/status.m4
++++ b/lib/autoconf/status.m4
+@@ -297,7 +297,7 @@ AC_DEFUN([AC_CONFIG_FILES], [_AC_CONFIG_FOOS([FILES], $@)])
+ # Some seds have small command number limits, like on Digital OSF/1 and HP-UX.
+ m4_define([_AC_SED_CMD_LIMIT],
+ dnl One cannot portably go further than 99 commands because of HP-UX.
+-[99])
++[4000])
+ 
+ 
+ # _AC_AWK_LITERAL_LIMIT
+@@ -307,7 +307,7 @@ dnl One cannot portably go further than 99 commands because of HP-UX.
+ #
+ # Some awk's have small limits, such as Solaris and AIX awk.
+ m4_define([_AC_AWK_LITERAL_LIMIT],
+-[148])
++[4000])
+ 
+ 
+ # _AC_OUTPUT_FILES_PREPARE
diff --git a/meta/recipes-devtools/autoconf/autoconf_2.72.bb b/meta/recipes-devtools/autoconf/autoconf_2.72.bb
index b599f270c79..20197d6f793 100644
--- a/meta/recipes-devtools/autoconf/autoconf_2.72.bb
+++ b/meta/recipes-devtools/autoconf/autoconf_2.72.bb
@@ -1,5 +1,5 @@ 
 SUMMARY = "A GNU tool that produce shell scripts to automatically configure software"
-DESCRIPTION = "Autoconf is an extensible package of M4 macros that produce shell scripts to automatically \ 
+DESCRIPTION = "Autoconf is an extensible package of M4 macros that produce shell scripts to automatically \
 configure software source code packages. Autoconf creates a configuration script for a package from a template \
 file that lists the operating system features that the package can use, in the form of M4 macro calls."
 LICENSE = "GPL-3.0-or-later"
@@ -19,6 +19,7 @@  SRC_URI = " \
            file://preferbash.patch \
            file://autotest-automake-result-format.patch \
            file://man-host-perl.patch \
+		   file://0001-Increase-awk-sed-command-limit-to-prevent-line-wrapp.patch \
 "
 SRC_URI:append:class-native = " file://no-man.patch"