mirror of
https://github.com/mudler/LocalAI
synced 2026-04-29 09:17:16 +00:00
* Bump vLLM version to 0.3.2 * Add vLLM model loading options * Remove transformers-exllama * Fix install exllama |
||
|---|---|---|
| .. | ||
| backend_pb2.py | ||
| backend_pb2_grpc.py | ||
| Makefile | ||
| README.md | ||
| run.sh | ||
| sentencetransformers.py | ||
| test.sh | ||
| test_sentencetransformers.py | ||
Creating a separate environment for the sentencetransformers project
make sentencetransformers