LocalAI/core/gallery
Ettore Di Giacinto fc5b9ebfcc
feat(loader): enhance single active backend to support LRU eviction (#7535)
* feat(loader): refactor single active backend support to LRU

This changeset introduces LRU management of loaded backends. Users can
set now a maximum number of models to be loaded concurrently, and, when
setting LocalAI in single active backend mode we set LRU to 1 for
backward compatibility.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: add tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-12-12 12:28:38 +01:00
..
importers chore(importers/llama.cpp): add models to 'llama-cpp' subfolder (#7450) 2025-12-07 21:44:57 +01:00
backend_types.go feat(ui): allow to order search results (#7507) 2025-12-11 00:11:33 +01:00
backends.go feat(importer): unify importing code with CLI (#7299) 2025-11-19 20:52:11 +01:00
backends_test.go feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
gallery.go feat(ui): allow to order search results (#7507) 2025-12-11 00:11:33 +01:00
gallery_suite_test.go feat: Add backend gallery (#5607) 2025-06-15 14:56:52 +02:00
gallery_test.go feat(ui): allow to order search results (#7507) 2025-12-11 00:11:33 +01:00
metadata_type.go feat: Add backend gallery (#5607) 2025-06-15 14:56:52 +02:00
models.go fix: do not delete files if used by other configured models (#7235) 2025-11-20 14:55:51 +01:00
models_test.go fix: do not delete files if used by other configured models (#7235) 2025-11-20 14:55:51 +01:00
models_types.go feat(ui): allow to order search results (#7507) 2025-12-11 00:11:33 +01:00
request_test.go feat: Add backend gallery (#5607) 2025-06-15 14:56:52 +02:00