LocalAI/backend/python
Ettore Di Giacinto 1ba66d00f5
feat: bundle python inside backends (#6123)
* feat(backends): bundle python

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* test ci

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* vllm on self-hosted

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add clang

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Try to fix it for Mac

* Relocate links only when is portable

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make sure to call macosPortableEnv

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Use self-hosted for vllm

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* CI

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-08-23 22:36:39 +02:00
..
bark feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
chatterbox feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
common feat: bundle python inside backends (#6123) 2025-08-23 22:36:39 +02:00
coqui feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
diffusers feat: bundle python inside backends (#6123) 2025-08-23 22:36:39 +02:00
exllama2 feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
faster-whisper feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
kitten-tts feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
kokoro feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
mlx feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
rerankers feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
rfdetr feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
transformers feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
vllm feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>