LocalAI/core/http/endpoints
Ettore Di Giacinto 50f9c9a058
feat(watchdog): add Memory resource reclaimer (#7583)
* feat(watchdog): add GPU reclaimer

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Handle vram calculation for unified memory devices

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Support RAM eviction, set watchdog interval from runtime settings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-12-16 09:15:18 +01:00
..
elevenlabs feat: migrate to echo and enable cancellation of non-streaming requests (#7270) 2025-11-14 22:57:53 +01:00
explorer feat: migrate to echo and enable cancellation of non-streaming requests (#7270) 2025-11-14 22:57:53 +01:00
jina fix(reranker): tests and top_n check fix #7212 (#7284) 2025-11-16 17:53:23 +01:00
localai feat(watchdog): add Memory resource reclaimer (#7583) 2025-12-16 09:15:18 +01:00
mcp fix(mcp): register sessions (#6429) 2025-10-10 18:03:07 +02:00
openai feat(inpainting): add inpainting endpoint, wire ImageGenerationFunc and return generated image URL (#7328) 2025-11-24 21:13:54 +01:00