LocalAI/docs/content/features
Ettore Di Giacinto 8862e3ce60
feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186)
* always enable parallel requests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: move tests to ginkgo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(smart router): order by available vram

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2026-03-31 08:28:56 +02:00
..
_index.en.md feat: add distributed mode (#9124) 2026-03-30 00:47:27 +02:00
agents.md feat(ui): add canvas mode, support history in agent chat (#8927) 2026-03-09 23:42:47 +01:00
audio-to-text.md fix: rename json_verbose to verbose_json (#8627) 2026-02-23 17:57:06 +00:00
authentication.md feat: add users and authentication support (#9061) 2026-03-19 21:40:51 +01:00
backend-monitor.md feat: Add documentation for undocumented API endpoints (#8852) 2026-03-08 17:59:33 +01:00
backends.md feat(voxtral): add voxtral backend (#8451) 2026-02-09 09:12:05 +01:00
constrained_grammars.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
distributed-mode.md feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186) 2026-03-31 08:28:56 +02:00
distributed_inferencing.md feat: add distributed mode (#9124) 2026-03-30 00:47:27 +02:00
embeddings.md docs: Add troubleshooting guide for embedding models (fixes #9064) (#9065) 2026-03-19 19:41:12 +01:00
fine-tuning.md fix(docs): Use notice instead of alert (#9134) 2026-03-25 13:55:48 +01:00
gpt-vision.md chore: drop AIO images (#9004) 2026-03-14 17:49:36 +01:00
GPU-acceleration.md chore: drop AIO images (#9004) 2026-03-14 17:49:36 +01:00
image-generation.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
mcp.md feat(ui): MCP Apps, mcp streaming and client-side support (#8947) 2026-03-11 07:30:49 +01:00
mlx-distributed.md feat(mlx-distributed): add new MLX-distributed backend (#8801) 2026-03-09 17:29:32 +01:00
model-gallery.md feat(ui): add model size estimation (#8684) 2026-02-28 23:03:47 +01:00
object-detection.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
openai-functions.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
openai-realtime.md feat(realtime): WebRTC support (#8790) 2026-03-13 21:37:15 +01:00
p2p.md feat: Add documentation for undocumented API endpoints (#8852) 2026-03-08 17:59:33 +01:00
quantization.md fix(docs): Use notice instead of alert (#9134) 2026-03-25 13:55:48 +01:00
reranker.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
runtime-settings.md feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186) 2026-03-31 08:28:56 +02:00
sound-generation.md feat: Add documentation for undocumented API endpoints (#8852) 2026-03-08 17:59:33 +01:00
stores.md feat: docs revamp (#7313) 2025-11-19 22:21:20 +01:00
text-generation.md feat: pass-by metadata to predict options (#8795) 2026-03-05 22:50:10 +01:00
text-to-audio.md feat(qwen-tts): Support using multiple voices (#8757) 2026-03-04 09:47:21 +01:00
video-generation.md feat: Add documentation for undocumented API endpoints (#8852) 2026-03-08 17:59:33 +01:00
voice-activity-detection.md feat: Add documentation for undocumented API endpoints (#8852) 2026-03-08 17:59:33 +01:00