mirror of
https://github.com/mudler/LocalAI
synced 2026-05-24 09:28:23 +00:00
5195062e12
The realtime endpoint was not passing the noAction "answer" function to the
model in the prompt template, causing the model to always call user-provided
tools even when a direct response was appropriate.
Root cause:
- User tools were added to the funcs list
- TemplateMessages() was called to generate the prompt
- noAction function was only added AFTER templating
- This meant the prompt didn't include the "answer" function, even though
the grammar did
Fix:
- Move noAction function creation before TemplateMessages() call so it's
included in both the prompt and grammar
- Add proper tool_choice parameter handling to support "auto", "required",
"none", and specific function selection
- Match behavior of the standard chat endpoint
💘 Generated with Crush
Assisted-by: Claude Sonnet 4.5 via Crush <crush@charm.land>
Signed-off-by: Richard Palethorpe <io@richiejp.com>
|
||
|---|---|---|
| .. | ||
| types | ||
| chat.go | ||
| completion.go | ||
| constants.go | ||
| edit.go | ||
| embeddings.go | ||
| image.go | ||
| inference.go | ||
| inpainting.go | ||
| inpainting_test.go | ||
| list.go | ||
| realtime.go | ||
| realtime_model.go | ||
| transcription.go | ||