mbox series

[meta-arago,master,0/3] ARMv7 support across ML frameworks

Message ID 20260325145050.1053445-1-p-deshmukh@ti.com
Headers show
Series ARMv7 support across ML frameworks | expand

Message

Pratham Deshmukh March 25, 2026, 2:50 p.m. UTC 
This patch series provides ARMv7 compatibility across the GP AI stacks
in meta-arago by addressing architecture-specific build issues.

Changes include:
 - tensorflow-lite: Add ARMv7 support with fp16 optimizations for v2.20.0,
   including XNNPACK delegate fixes and EMBEDDING_LOOKUP kernel enhancements
 - onnx: Fix 32-bit ARM build failure caused by LONG_BIT mismatch
 - arm-compute-library: Exclude AARCH64-specific KleiDiAI kernels from
   ARMv7 builds to prevent compilation errors
 - onnxruntime: NA
 - nnstreamer: NA

Benchmarking results on am335x-evm:

 - TFLite
   - XNNPACK ON 
     - https://gist.github.com/PrathamTI/2cce31defc047515d3bb205b86ec954d
   - XNNPACK OFF
     - https://gist.github.com/PrathamTI/734ea8c0aa8b4fb57125cc5a7e032c00
 
 - arm-compute-library
   - https://gist.github.com/PrathamTI/fd78e2e8b259e88e33c4efb926aafbad
 
 - nnstreamer 
   - https://gist.github.com/PrathamTI/46529497cf4b3852619f5f3bf84908a7

 - onnxruntime 
   - https://gist.github.com/PrathamTI/1e7150592d8e1fc6b167548ea62f0904

Pratham Deshmukh (3):
  tensorflow-lite: Add armv7 support with fp16 optimizations for v2.20.0
  onnx: fix 32-bit ARM build failure due to LONG_BIT mismatch
  arm-compute-library: Add patch to exclude AARCH64-specific KleiDiAI
    kernels from armv7 builds

 ...RCH64-specific-KleiDiAI-kernels-from.patch |  37 ++
 .../arm-compute-library_52.7.0.bb             |   1 +
 .../recipes-framework/onnx/onnx_1.18.0.bb     |   2 +-
 ...delegate-target-operations-for-armv7.patch |  38 ++
 ...pe-infrastructure-to-TensorFlow-Lite.patch | 552 ++++++++++++++++++
 ...6-support-to-EMBEDDING_LOOKUP-kernel.patch | 447 ++++++++++++++
 .../tensorflow-lite/tensorflow-lite_2.20.0.bb |   3 +
 7 files changed, 1079 insertions(+), 1 deletion(-)
 create mode 100644 meta-arago-extras/recipes-devtools/arm-compute-library/arm-compute-library/0009-cmake-Exclude-AARCH64-specific-KleiDiAI-kernels-from.patch
 create mode 100644 meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0004-Disable-xnnpack-delegate-target-operations-for-armv7.patch
 create mode 100644 meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0005-Add-fp16-data-type-infrastructure-to-TensorFlow-Lite.patch
 create mode 100644 meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0006-Add-float16-support-to-EMBEDDING_LOOKUP-kernel.patch

Comments

PRC Automation March 25, 2026, 2:55 p.m. UTC | #1 
meta-arago / na / 20260325145050.1053445-1-p-deshmukh

PRC Results: FAIL

=========================================================
  check-yocto-patches: FAIL
=========================================================
Patches
----------------------------------------
FAIL - [meta-arago][master][PATCH  3/3] arm-compute-library: Add patch to exclude AARCH64-specific KleiDiAI kernels from armv7 builds
    ERROR: Commit message too long (> 80 chars): arm-compute-library: Add patch to exclude AARCH64-specific KleiDiAI kernels from armv7 builds. (COMMIT-MESSAGE-1)
        patch:68
            Subject: [meta-arago][master][PATCH  3/3] arm-compute-library: Add patch to exclude AARCH64-specific KleiDiAI kernels from armv7 builds
    
    For details on the above errors/warnings visit: https://lists.yoctoproject.org/g/meta-ti/wiki/40887