LocalAI/backend/python/mlx-vlm
Ettore Di Giacinto 59108fbe32
feat: add distributed mode (#9124)
* feat: add distributed mode (experimental)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix data races, mutexes, transactions

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix events and tool stream in agent chat

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* use ginkgo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(cron): compute correctly time boundaries avoiding re-triggering

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* enhancements, refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* do not flood of healthy checks

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* do not list obvious backends as text backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* tests fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Drop redundant healthcheck

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* enhancements, refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2026-03-30 00:47:27 +02:00
..
backend.py feat: add distributed mode (#9124) 2026-03-30 00:47:27 +02:00
install.sh Add mlx-vlm (#6119) 2025-08-23 23:05:30 +02:00
Makefile Add mlx-vlm (#6119) 2025-08-23 23:05:30 +02:00
requirements-cpu.txt feat(mlx): Add support for CUDA12, CUDA13, L4T, SBSA and CPU (#8380) 2026-02-03 23:53:34 +01:00
requirements-cublas12.txt feat(mlx): Add support for CUDA12, CUDA13, L4T, SBSA and CPU (#8380) 2026-02-03 23:53:34 +01:00
requirements-cublas13.txt feat(mlx): Add support for CUDA12, CUDA13, L4T, SBSA and CPU (#8380) 2026-02-03 23:53:34 +01:00
requirements-l4t12.txt feat(mlx): Add support for CUDA12, CUDA13, L4T, SBSA and CPU (#8380) 2026-02-03 23:53:34 +01:00
requirements-l4t13.txt feat(mlx): Add support for CUDA12, CUDA13, L4T, SBSA and CPU (#8380) 2026-02-03 23:53:34 +01:00
requirements-mps.txt Add mlx-vlm (#6119) 2025-08-23 23:05:30 +02:00
requirements.txt Add mlx-vlm (#6119) 2025-08-23 23:05:30 +02:00
run.sh Add mlx-vlm (#6119) 2025-08-23 23:05:30 +02:00
test.py Add mlx-vlm (#6119) 2025-08-23 23:05:30 +02:00
test.sh Add mlx-vlm (#6119) 2025-08-23 23:05:30 +02:00