mirror of
https://github.com/mudler/LocalAI
synced 2026-04-21 13:27:21 +00:00
* Bump oneapi-basekit, optimum and openvino * Changed PERFORMANCE HINT to CUMULATIVE_THROUGHPUT Minor latency change for first token but about 10-15% speedup on token generation. |
||
|---|---|---|
| .. | ||
| cpp | ||
| go | ||
| python | ||
| backend.proto | ||