mirror of
https://github.com/mudler/LocalAI
synced 2026-04-21 21:37:21 +00:00
* Bump oneapi-basekit, optimum and openvino * Changed PERFORMANCE HINT to CUMULATIVE_THROUGHPUT Minor latency change for first token but about 10-15% speedup on token generation. |
||
|---|---|---|
| .. | ||
| Makefile | ||
| README.md | ||
| run.sh | ||
| test.sh | ||
| test_transformers_server.py | ||
| transformers_server.py | ||
Creating a separate environment for the transformers project
make transformers