LocalAI/backend/python
Ettore Di Giacinto 1d830ce7dd
feat(mlx): add mlx backend (#6049)
* chore: allow to install with pip

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* WIP

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make the backend to build and actually work

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* List models from system only

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add script to build darwin python backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Run protogen in libbackend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Detect if mps is available across python backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* CI: try to build backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Debug CI

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Index mlx-vlm

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Remove mlx-vlm

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Drop CI test

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-08-22 08:42:29 +02:00
..
bark feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
chatterbox feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
common feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
coqui feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
diffusers feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
exllama2 feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
faster-whisper feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
kitten-tts feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
kokoro feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
mlx feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
rerankers feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
rfdetr feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
transformers feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
vllm feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>