LocalAI/tests
Ettore Di Giacinto fc5b9ebfcc
feat(loader): enhance single active backend to support LRU eviction (#7535)
* feat(loader): refactor single active backend support to LRU

This changeset introduces LRU management of loaded backends. Users can
set now a maximum number of models to be loaded concurrently, and, when
setting LocalAI in single active backend mode we set LRU to 1 for
backward compatibility.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: add tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-12-12 12:28:38 +01:00
..
e2e ci: add GPU tests (#1095) 2023-10-19 13:50:40 +02:00
e2e-aio fix(reranker): tests and top_n check fix #7212 (#7284) 2025-11-16 17:53:23 +01:00
e2e-fixtures ci: add GPU tests (#1095) 2023-10-19 13:50:40 +02:00
fixtures feat: Add backend gallery (#5607) 2025-06-15 14:56:52 +02:00
integration feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
models_fixtures feat(transformers): merge sentencetransformers backend (#4624) 2025-01-18 18:30:30 +01:00