Ettore Di Giacinto a026277ab9 feat(mlx-distributed): add new MLX-distributed backend (#8801) ... * feat(mlx-distributed): add new MLX-distributed backend Add new MLX distributed backend with support for both TCP and RDMA for model sharding. This implementation ties in the discovery implementation already in place, and re-uses the same P2P mechanism for the TCP MLX-distributed inferencing. The Auto-parallel implementation is inspired by Exo's ones (who have been added to acknowledgement for the great work!) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * expose a CLI to facilitate backend starting Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat: make manual rank0 configurable via model configs Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Add missing features from mlx backend Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Apply suggestion from @mudler Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>		2026-03-09 17:29:32 +01:00
..
context	chore: allow to set local-ai log format, default to custom one (#7679)	2025-12-21 21:21:59 +01:00
worker	feat(mlx-distributed): add new MLX-distributed backend (#8801)	2026-03-09 17:29:32 +01:00
backends.go	chore(refactor): move logging to common package based on slog (#7668)	2025-12-21 19:33:13 +01:00
cli.go	feat: Add shell completion support for bash, zsh, and fish (#8851)	2026-03-08 09:32:39 +01:00
completion.go	feat: Add shell completion support for bash, zsh, and fish (#8851)	2026-03-08 09:32:39 +01:00
completion_test.go	feat: Add shell completion support for bash, zsh, and fish (#8851)	2026-03-08 09:32:39 +01:00
explorer.go	chore(refactor): move logging to common package based on slog (#7668)	2025-12-21 19:33:13 +01:00
federated.go	chore: update cogito and simplify MCP logics (#6413)	2025-10-09 12:36:45 +02:00
models.go	fix(cli): import via CLI needs system state (#7746)	2025-12-27 11:10:28 +01:00
run.go	feat(mlx-distributed): add new MLX-distributed backend (#8801)	2026-03-09 17:29:32 +01:00
soundgeneration.go	fix: Remove debug print statement from soundgeneration.go (C2) (#8843)	2026-03-08 08:49:29 +01:00
transcript.go	fix: rename json_verbose to verbose_json (#8627)	2026-02-23 17:57:06 +00:00
tts.go	chore(refactor): move logging to common package based on slog (#7668)	2025-12-21 19:33:13 +01:00
util.go	chore(refactor): move logging to common package based on slog (#7668)	2025-12-21 19:33:13 +01:00