mirror of
https://github.com/mudler/LocalAI
synced 2026-05-24 09:28:23 +00:00
* Bump vLLM version to 0.3.2 * Add vLLM model loading options * Remove transformers-exllama * Fix install exllama |
||
|---|---|---|
| .. | ||
| backend_pb2.py | ||
| backend_pb2_grpc.py | ||
| Makefile | ||
| README.md | ||
| run.sh | ||
| test.sh | ||
| test_transformers.py | ||
| transformers_server.py | ||
Creating a separate environment for the transformers project
make transformers-musicgen