LocalAI/docs/content
Ettore Di Giacinto fc5b9ebfcc
feat(loader): enhance single active backend to support LRU eviction (#7535)
* feat(loader): refactor single active backend support to LRU

This changeset introduces LRU management of loaded backends. Users can
set now a maximum number of models to be loaded concurrently, and, when
setting LocalAI in single active backend mode we set LRU to 1 for
backward compatibility.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: add tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-12-12 12:28:38 +01:00
..
advanced feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
features feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
getting-started chore(docs): add documentation about import (#7315) 2025-11-20 23:07:36 +01:00
installation chore: switch from /usr/share to /var/lib for data storage (#7361) 2025-11-27 09:18:28 +01:00
reference feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
_index.md chore(docs): center video 2025-12-08 16:59:11 +01:00
faq.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
integrations.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
overview.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
whats-new.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00