mirror of
https://github.com/mudler/LocalAI
synced 2026-05-24 09:28:23 +00:00
32c0ab3a7f
* fix: properly terminate kv_overrides array with empty key The llama model loading function expects KV overrides to be terminated with an empty key (key[0] == 0). Previously, the kv_overrides vector was not being properly terminated, causing an assertion failure. This commit ensures that after parsing all KV override strings, we add a final terminating entry with an empty key to satisfy the C-style array termination requirement. This fixes the assertion error and allows the model to load correctly with custom KV overrides. Fixes #6643 - Also included a reference to the usage of the `overrides` option in the advanced-usage section. Signed-off-by: blob42 <contact@blob42.xyz> * doc: document the `overrides` option --------- Signed-off-by: blob42 <contact@blob42.xyz> |
||
|---|---|---|
| .. | ||
| advanced | ||
| features | ||
| getting-started | ||
| reference | ||
| faq.md | ||
| integrations.md | ||
| overview.md | ||
| whats-new.md | ||