LocalAI/core/cli
Ettore Di Giacinto 50f9c9a058
feat(watchdog): add Memory resource reclaimer (#7583)
* feat(watchdog): add GPU reclaimer

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Handle vram calculation for unified memory devices

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Support RAM eviction, set watchdog interval from runtime settings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-12-16 09:15:18 +01:00
..
context feat: refactor build process, drop embedded backends (#5875) 2025-07-22 16:31:04 +02:00
worker feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
backends.go feat(ui): add mask to install custom backends (#7559) 2025-12-13 19:11:32 +01:00
cli.go chore(cli): add backends CLI to manipulate and install backends (#5787) 2025-07-03 19:31:27 +02:00
explorer.go feat: migrate to echo and enable cancellation of non-streaming requests (#7270) 2025-11-14 22:57:53 +01:00
federated.go chore: update cogito and simplify MCP logics (#6413) 2025-10-09 12:36:45 +02:00
models.go feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
run.go feat(watchdog): add Memory resource reclaimer (#7583) 2025-12-16 09:15:18 +01:00
soundgeneration.go feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
transcript.go feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
tts.go feat(loader): enhance single active backend to support LRU eviction (#7535) 2025-12-12 12:28:38 +01:00
util.go feat(backends): add system backend, refactor (#6059) 2025-08-14 19:38:26 +02:00