mirror of
https://github.com/mudler/LocalAI
synced 2026-05-06 14:58:36 +00:00
32c0ab3a7f
* fix: properly terminate kv_overrides array with empty key The llama model loading function expects KV overrides to be terminated with an empty key (key[0] == 0). Previously, the kv_overrides vector was not being properly terminated, causing an assertion failure. This commit ensures that after parsing all KV override strings, we add a final terminating entry with an empty key to satisfy the C-style array termination requirement. This fixes the assertion error and allows the model to load correctly with custom KV overrides. Fixes #6643 - Also included a reference to the usage of the `overrides` option in the advanced-usage section. Signed-off-by: blob42 <contact@blob42.xyz> * doc: document the `overrides` option --------- Signed-off-by: blob42 <contact@blob42.xyz> |
||
|---|---|---|
| .. | ||
| patches | ||
| CMakeLists.txt | ||
| grpc-server.cpp | ||
| Makefile | ||
| package.sh | ||
| prepare.sh | ||
| run.sh | ||