mbox series

[layerindex-web,0/4] Fixes for errors and warnings in layer updates

Message ID 20261019213510.4384-1-tim.orling@konsulko.com
Headers show
Series Fixes for errors and warnings in layer updates | expand

Message

Tim Orling Oct. 19, 2026, 9:35 p.m. UTC 
These fix problems found while running full updates on a test
instance loaded with a copy of the layers.openembedded.org database.

1: Files in layers within a layer were indexed as part of the outer
   layer on incremental updates (e.g. meta-voltumna's vendored
   openembedded-core and meta-openembedded). Affected layer branches need
   a full rescan (update.py -r) to drop those records.
2: A layer first seen on a new branch copied its subdirectory from the
   oldest branch, so meta-tq failed on wrynose.
3: The core layer was in BBPATH twice, giving a "Duplicate inclusion"
   warning for maintainers.inc for every layer. The matching BitBake fix
   for include_all has been sent to bitbake-devel.
4: Long recipe values (LICENSE, inherits, BBCLASSEXTEND, ...) were being
   truncated. This adds a migration on layerindex_recipe, which took
   under a minute for 365,000 recipes on the test instance.

Tim Orling (4):
  update_layer.py: skip layers within a layer on incremental updates
  update: copy a new layer branch's subdirectory from the newest branch
  recipeparse: don't add the core layer to BBPATH twice
  layerindex/models.py: store long recipe values without truncating

 .../migrations/0055_recipe_text_fields.py     | 58 +++++++++++++++++++
 layerindex/models.py                          | 27 ++++++---
 layerindex/recipeparse.py                     |  9 +--
 layerindex/update.py                          |  2 +-
 layerindex/update_layer.py                    | 41 ++++---------
 layerindex/utils.py                           | 22 +++++++
 tests/test_latest_layerbranch.py              | 52 +++++++++++++++++
 tests/test_recipe_fields.py                   | 53 +++++++++++++++++
 tests/test_utils.py                           | 45 ++++++++++++++
 9 files changed, 264 insertions(+), 45 deletions(-)
 create mode 100644 layerindex/migrations/0055_recipe_text_fields.py
 create mode 100644 tests/test_latest_layerbranch.py
 create mode 100644 tests/test_recipe_fields.py


base-commit: ede7510fae1ea6225cac56a020e5e9ae0033b467