mbox series

[bitbake-devel,v2,0/8] Implement parallel Query API

Message ID 20240218225953.2997239-1-JPEWhacker@gmail.com
Headers show
Series Implement parallel Query API | expand

Message

Joshua Watt Feb. 18, 2024, 10:59 p.m. UTC 
Implements API to allows querying if a hash exists in the server, and to
do so using multiple connections to the server in parallel. This will be
used to query if an sstate object exists before actually looking for it
in the sstate cache, which is important for e.g. on a CDN where negative
lookups are expensive

V2: Added some patches that were missed in the first series, and also
rebased Tobias patch on top of my changes, as it was easier than
rebasing the other way around.

Joshua Watt (7):
  hashserv: Add Unihash Garbage Collection
  hashserv: sqlalchemy: Use _execute() helper
  hashserv: Add unihash-exists API
  asyncrpc: Add Client Pool object
  hashserv: Add Client Pool
  siggen: Add parallel query API
  siggen: Add parallel unihash exist API

Tobias Hagelborn (1):
  bitbake: hashserv: Postgres adaptations for ignoring duplicate inserts

 bitbake/bin/bitbake-hashclient      |  48 +++
 bitbake/lib/bb/asyncrpc/__init__.py |   2 +-
 bitbake/lib/bb/asyncrpc/client.py   |  77 +++++
 bitbake/lib/bb/siggen.py            | 153 +++++++--
 bitbake/lib/hashserv/client.py      | 155 ++++++++-
 bitbake/lib/hashserv/server.py      | 164 +++++----
 bitbake/lib/hashserv/sqlalchemy.py  | 515 ++++++++++++++++++----------
 bitbake/lib/hashserv/sqlite.py      | 221 ++++++++++--
 bitbake/lib/hashserv/tests.py       | 320 +++++++++++++++++
 9 files changed, 1336 insertions(+), 319 deletions(-)