LocalAI/core/services
Ettore Di Giacinto d9c1db2b87
feat: add (experimental) fine-tuning support with TRL (#9088)
* feat: add fine-tuning endpoint

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(experimental): add fine-tuning endpoint and TRL support

This changeset defines new GRPC signatues for Fine tuning backends, and
add TRL backend as initial fine-tuning engine. This implementation also
supports exporting to GGUF and automatically importing it to LocalAI
after fine-tuning.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* commit TRL backend, stop by killing process

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* move fine-tune to generic features

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* add evals, reorder menu

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fix tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2026-03-21 02:08:02 +01:00
..
agent_jobs.go feat: add users and authentication support (#9061) 2026-03-19 21:40:51 +01:00
agent_jobs_test.go feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
agent_pool.go feat: add (experimental) fine-tuning support with TRL (#9088) 2026-03-21 02:08:02 +01:00
agent_pool_sse.go feat: add agentic management (#8820) 2026-03-07 00:03:08 +01:00
backend_monitor.go chore(refactor): move logging to common package based on slog (#7668) 2025-12-21 19:33:13 +01:00
backends.go chore(refactor): move logging to common package based on slog (#7668) 2025-12-21 19:33:13 +01:00
backends_test.go fix(gallery): Use YAML v3 to avoid merging maps with incompatible keys (#8580) 2026-02-16 14:10:19 +01:00
finetune.go feat: add (experimental) fine-tuning support with TRL (#9088) 2026-03-21 02:08:02 +01:00
gallery.go feat(ui): allow to cancel ops (#7264) 2025-11-13 18:41:47 +01:00
list_models.go feat(backends): add system backend, refactor (#6059) 2025-08-14 19:38:26 +02:00
metrics.go chore(refactor): move logging to common package based on slog (#7668) 2025-12-21 19:33:13 +01:00
models.go fix(gallery): Use YAML v3 to avoid merging maps with incompatible keys (#8580) 2026-02-16 14:10:19 +01:00
operation.go feat(ui): add mask to install custom backends (#7559) 2025-12-13 19:11:32 +01:00
services_suite_test.go feat: agent jobs panel (#7390) 2025-11-28 23:05:39 +01:00
user_services.go feat: add users and authentication support (#9061) 2026-03-19 21:40:51 +01:00
user_storage.go feat: add users and authentication support (#9061) 2026-03-19 21:40:51 +01:00