LocalAI/core
Ettore Di Giacinto 1d830ce7dd
feat(mlx): add mlx backend (#6049)
* chore: allow to install with pip

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* WIP

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make the backend to build and actually work

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* List models from system only

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add script to build darwin python backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Run protogen in libbackend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Detect if mps is available across python backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* CI: try to build backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Debug CI

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Index mlx-vlm

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Remove mlx-vlm

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Drop CI test

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-08-22 08:42:29 +02:00
..
application feat(p2p): automatically sync installed models between instances (#6108) 2025-08-19 19:37:46 +02:00
backend feat(backends): add system backend, refactor (#6059) 2025-08-14 19:38:26 +02:00
cli feat(p2p): automatically sync installed models between instances (#6108) 2025-08-19 19:37:46 +02:00
clients feat(store): add Golang client (#1977) 2024-04-16 15:54:14 +02:00
config feat(webui): add import/edit model page (#6050) 2025-08-14 23:48:09 +02:00
dependencies_manager fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
explorer feat(p2p): automatically sync installed models between instances (#6108) 2025-08-19 19:37:46 +02:00
gallery feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
http feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
p2p feat(p2p): automatically sync installed models between instances (#6108) 2025-08-19 19:37:46 +02:00
schema feat(p2p): automatically sync installed models between instances (#6108) 2025-08-19 19:37:46 +02:00
services feat(ui): General improvements (#6072) 2025-08-16 07:44:50 +02:00
startup feat(backends): add system backend, refactor (#6059) 2025-08-14 19:38:26 +02:00
templates feat(backends): add system backend, refactor (#6059) 2025-08-14 19:38:26 +02:00