mbox series

[meta-arago,master,v2,0/3] ARMv7 support across ML frameworks

Message ID 20260326072653.1025506-1-p-deshmukh@ti.com
Headers show
Series ARMv7 support across ML frameworks | expand

Message

Pratham Deshmukh March 26, 2026, 7:26 a.m. UTC 
This patch series provides ARMv7 compatibility across the GP AI stacks
in meta-arago by addressing architecture-specific build issues.

Changes include:
 - tensorflow-lite: Add ARMv7 support with fp16 optimizations for v2.20.0,
   including XNNPACK delegate fixes and EMBEDDING_LOOKUP kernel enhancements
 - onnx: Fix 32-bit ARM build failure caused by LONG_BIT mismatch
 - arm-compute-library: Exclude AARCH64-specific KleiDiAI kernels from
   ARMv7 builds to prevent compilation errors
 - onnxruntime: NA
 - nnstreamer: NA

Benchmarking results on am335x-evm:

 - TFLite
   - XNNPACK ON 
     - https://gist.github.com/PrathamTI/2cce31defc047515d3bb205b86ec954d
   - XNNPACK OFF
     - https://gist.github.com/PrathamTI/734ea8c0aa8b4fb57125cc5a7e032c00
 
 - arm-compute-library
   - https://gist.github.com/PrathamTI/fd78e2e8b259e88e33c4efb926aafbad
 
 - nnstreamer 
   - https://gist.github.com/PrathamTI/46529497cf4b3852619f5f3bf84908a7

 - onnxruntime 
   - https://gist.github.com/PrathamTI/1e7150592d8e1fc6b167548ea62f0904

Link to v1:
 - https://patchwork.yoctoproject.org/project/arago/list/?series=44947

Pratham Deshmukh (3):
  tensorflow-lite: Add armv7 support with fp16 optimizations for v2.20.0
  onnx: fix 32-bit ARM build failure due to LONG_BIT mismatch
  arm-compute-library: Exclude AARCH64 KleiDiAI kernels from armv7

 ...RCH64-specific-KleiDiAI-kernels-from.patch |  37 ++
 .../arm-compute-library_52.7.0.bb             |   1 +
 .../recipes-framework/onnx/onnx_1.18.0.bb     |   2 +-
 ...delegate-target-operations-for-armv7.patch |  38 ++
 ...pe-infrastructure-to-TensorFlow-Lite.patch | 552 ++++++++++++++++++
 ...6-support-to-EMBEDDING_LOOKUP-kernel.patch | 447 ++++++++++++++
 .../tensorflow-lite/tensorflow-lite_2.20.0.bb |   3 +
 7 files changed, 1079 insertions(+), 1 deletion(-)
 create mode 100644 meta-arago-extras/recipes-devtools/arm-compute-library/arm-compute-library/0009-cmake-Exclude-AARCH64-specific-KleiDiAI-kernels-from.patch
 create mode 100644 meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0004-Disable-xnnpack-delegate-target-operations-for-armv7.patch
 create mode 100644 meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0005-Add-fp16-data-type-infrastructure-to-TensorFlow-Lite.patch
 create mode 100644 meta-arago-extras/recipes-framework/tensorflow-lite/tensorflow-lite/0006-Add-float16-support-to-EMBEDDING_LOOKUP-kernel.patch

Comments

PRC Automation March 26, 2026, 7:54 a.m. UTC | #1 
meta-arago / na / 20260326072653.1025506-1-p-deshmukh

PRC Results: PASS

=========================================================
  check-yocto-patches: PASS
=========================================================
Patches
----------------------------------------
WARN - [meta-arago][master][PATCH v2 1/3] tensorflow-lite: Add armv7 support with fp16 optimizations for v2.20.0
    WARN: Revised patch missing a comment. (REVISION-1)
        patch
    
    For details on the above errors/warnings visit: https://lists.yoctoproject.org/g/meta-ti/wiki/40887
WARN - [meta-arago][master][PATCH v2 2/3] onnx: fix 32-bit ARM build failure due to LONG_BIT mismatch
    WARN: Revised patch missing a comment. (REVISION-1)
        patch
    
    For details on the above errors/warnings visit: https://lists.yoctoproject.org/g/meta-ti/wiki/40887
WARN - [meta-arago][master][PATCH v2 3/3] arm-compute-library: Exclude AARCH64 KleiDiAI kernels from armv7
    WARN: Revised patch missing a comment. (REVISION-1)
        patch
    
    For details on the above errors/warnings visit: https://lists.yoctoproject.org/g/meta-ti/wiki/40887



=========================================================
  apply-yocto-patch: PASS
=========================================================
master
=====================
Summary:
- Patch Series: [meta-arago][master][PATCH v2 0/3] ARMv7 support across ML frameworks
- Submitter: From: Pratham Deshmukh <p-deshmukh@ti.com>
- Date: Date: Thu, 26 Mar 2026 12:56:50 +0530
- Num Patches: 3
- Mailing List (public inbox) Commit SHA: 8d31555c25ff15d4a587f03bddcff9e784018bc5

Applied to:
- Repository: lcpd-prc-meta-arago
- Base Branch: master-wip
- Commit Author: Ryan Eatmon <reatmon@ti.com>
- Commit Subject: arago-prefs: Remove old settings
- Commit SHA: 6a3e3ddaca8ccea3590b072ad7fd1f2cae50df35

Patches
----------------------------------------
All patches applied



=========================================================
  check-yocto-repo: PASS
=========================================================
master
=====================
PASS



=========================================================
  yocto-check-layers: PASS
=========================================================
master - PASS
=====================
All checks passed