Ettore Di Giacinto 02cc8cbcaa feat(llama.cpp): consolidate options and respect tokenizer template when enabled (#7120) ... * feat(llama.cpp): expose env vars as options for consistency This allows to configure everything in the YAML file of the model rather than have global configurations Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(llama.cpp): respect usetokenizertemplate and use llama.cpp templating system to process messages Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * WIP Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Detect template exists if use tokenizer template is enabled Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Better recognization of chat Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Fixes to support tool calls while using templates from tokenizer Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Fixups Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Drop template guessing, fix passing tools to tokenizer Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Extract grammar and other options from chat template, add schema struct Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * WIP Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * WIP Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Automatically set use_jinja Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Cleanups, identify by default gguf models for chat Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Update docs Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>		2025-11-07 21:23:50 +01:00
..
grammars	fix: handle multi-type arrays in JSON schema to prevent panic (#6495)	2025-10-17 11:07:37 +02:00
function_structure.go	feat(grammar): add llama3.1 schema (#3015)	2024-07-26 20:11:29 +02:00
functions.go	feat(llama.cpp): consolidate options and respect tokenizer template when enabled (#7120)	2025-11-07 21:23:50 +01:00
functions_suite_test.go	feat(grammar): add llama3.1 schema (#3015)	2024-07-26 20:11:29 +02:00
functions_test.go	feat(functions): parse broken JSON when we parse the raw results, use dynamic rules for grammar keys (#2912)	2024-07-18 17:52:22 +02:00
json_mode.go	refactor: break down json grammar parser in different files (#3004)	2024-07-25 08:41:00 +02:00
parse.go	feat(llama.cpp): consolidate options and respect tokenizer template when enabled (#7120)	2025-11-07 21:23:50 +01:00
parse_test.go	feat(functions): parse broken JSON when we parse the raw results, use dynamic rules for grammar keys (#2912)	2024-07-18 17:52:22 +02:00