Elgato_dark/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI synced 2026-05-24 09:28:23 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 9
LocalAI/backend/cpp/buun-llama-cpp
History
Ettore Di Giacinto d6bf3a4969 fix(buun-llama-cpp): drop logit_bias_eog arg from params_from_json_cmpl 
Previous substitution kept the call as 5 args, but buun predates the
upstream refactor that also *added* the logit_bias_eog parameter to
params_from_json_cmpl — buun's signature is still the 4-arg form
  (const llama_vocab*, const common_params&, int, const json&)
and it still derives logit_bias_eog internally from the common_params.

Replace the substitution with a line-delete. Guard matches both the
original call (ctx_server.get_meta().logit_bias_eog) and the previously
substituted form (params_base.sampling.logit_bias_eog) so the script
stays safe across re-runs and whatever state the tree was left in.

Assisted-by: Claude:Opus-4.7 [Read] [Edit] [Bash]
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2026-04-24 12:52:53 +00:00
..
apply-patches.sh feat(backend): add buun-llama-cpp fork (DFlash + TCQ KV-cache) 2026-04-24 12:52:53 +00:00
Makefile feat(backend): add buun-llama-cpp fork (DFlash + TCQ KV-cache) 2026-04-24 12:52:53 +00:00
package.sh feat(backend): add buun-llama-cpp fork (DFlash + TCQ KV-cache) 2026-04-24 12:52:53 +00:00
patch-grpc-server.sh fix(buun-llama-cpp): drop logit_bias_eog arg from params_from_json_cmpl 2026-04-24 12:52:53 +00:00
run.sh feat(backend): add buun-llama-cpp fork (DFlash + TCQ KV-cache) 2026-04-24 12:52:53 +00:00