LocalAI/core/backend
Ettore Di Giacinto 59108fbe32
feat: add distributed mode (#9124)
* feat: add distributed mode (experimental)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix data races, mutexes, transactions

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix events and tool stream in agent chat

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* use ginkgo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(cron): compute correctly time boundaries avoiding re-triggering

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* enhancements, refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* do not flood of healthy checks

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* do not list obvious backends as text backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* tests fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Drop redundant healthcheck

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* enhancements, refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2026-03-30 00:47:27 +02:00
..
backend_suite_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
detection.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
embeddings.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
image.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
llm.go feat: add distributed mode (#9124) 2026-03-30 00:47:27 +02:00
llm_test.go feat(backends): add system backend, refactor (#6059) 2025-08-14 19:38:26 +02:00
options.go feat: add distributed mode (#9124) 2026-03-30 00:47:27 +02:00
rerank.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
soundgeneration.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
stores.go feat: refactor build process, drop embedded backends (#5875) 2025-07-22 16:31:04 +02:00
token_metrics.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
tokenize.go feat: add distributed mode (#9124) 2026-03-30 00:47:27 +02:00
transcript.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
tts.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
vad.go feat: add distributed mode (#9124) 2026-03-30 00:47:27 +02:00
video.go feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00