LocalAI/core
Ettore Di Giacinto d9c1db2b87
feat: add (experimental) fine-tuning support with TRL (#9088)
* feat: add fine-tuning endpoint

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(experimental): add fine-tuning endpoint and TRL support

This changeset defines new GRPC signatues for Fine tuning backends, and
add TRL backend as initial fine-tuning engine. This implementation also
supports exporting to GGUF and automatically importing it to LocalAI
after fine-tuning.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* commit TRL backend, stop by killing process

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* move fine-tune to generic features

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* add evals, reorder menu

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fix tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2026-03-21 02:08:02 +01:00
..
application fix: Add tracing settings loading from runtime_settings.json (#9081) 2026-03-20 00:58:52 +01:00
backend feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00
cli feat: add (experimental) fine-tuning support with TRL (#9088) 2026-03-21 02:08:02 +01:00
clients feat(store): add Golang client (#1977) 2024-04-16 15:54:14 +02:00
config feat: add (experimental) fine-tuning support with TRL (#9088) 2026-03-21 02:08:02 +01:00
dependencies_manager feat(ui): move to React for frontend (#8772) 2026-03-05 21:47:12 +01:00
explorer feat(mlx-distributed): add new MLX-distributed backend (#8801) 2026-03-09 17:29:32 +01:00
gallery feat: add (experimental) fine-tuning support with TRL (#9088) 2026-03-21 02:08:02 +01:00
http feat: add (experimental) fine-tuning support with TRL (#9088) 2026-03-21 02:08:02 +01:00
p2p feat(mlx-distributed): add new MLX-distributed backend (#8801) 2026-03-09 17:29:32 +01:00
schema feat: add (experimental) fine-tuning support with TRL (#9088) 2026-03-21 02:08:02 +01:00
services feat: add (experimental) fine-tuning support with TRL (#9088) 2026-03-21 02:08:02 +01:00
startup feat(api): Add transcribe response format request parameter & adjust STT backends (#8318) 2026-02-01 17:33:17 +01:00
templates chore(refactor): move logging to common package based on slog (#7668) 2025-12-21 19:33:13 +01:00
trace feat(ui): Per model backend logs and various fixes (#9028) 2026-03-18 08:31:26 +01:00