LocalAI/pkg/model
Ettore Di Giacinto 34e054f607
fix(reasoning): support models with reasoning without starting thinking tag (#8132)
* chore: extract reasoning to its own package

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* make sure we detect thinking tokens from template

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Allow to override via config, add tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2026-01-20 21:07:59 +01:00
..
filters.go fix: make sure to close on errors (#7521) 2025-12-11 14:03:20 +01:00
initializers.go feat: disable force eviction (#7725) 2025-12-25 14:26:18 +01:00
loader.go feat: disable force eviction (#7725) 2025-12-25 14:26:18 +01:00
loader_options.go feat: refactor build process, drop embedded backends (#5875) 2025-07-22 16:31:04 +02:00
loader_test.go feat: disable force eviction (#7725) 2025-12-25 14:26:18 +01:00
model.go chore(refactor): track grpcProcess in the model structure (#3663) 2024-09-26 12:44:55 +02:00
model_suite_test.go tests: add template tests (#2063) 2024-04-18 10:57:24 +02:00
process.go fix(model): do not assume success when deleting a model process (#7963) 2026-01-10 23:33:44 +01:00
watchdog.go fix(reasoning): support models with reasoning without starting thinking tag (#8132) 2026-01-20 21:07:59 +01:00
watchdog_options.go feat: disable force eviction (#7725) 2025-12-25 14:26:18 +01:00
watchdog_options_test.go chore: fixup tests with defaults from constants 2025-12-16 21:26:55 +00:00
watchdog_test.go feat: disable force eviction (#7725) 2025-12-25 14:26:18 +01:00