LocalAI/core/http
Ettore Di Giacinto 50f9c9a058
feat(watchdog): add Memory resource reclaimer (#7583)
* feat(watchdog): add GPU reclaimer

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Handle vram calculation for unified memory devices

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Support RAM eviction, set watchdog interval from runtime settings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-12-16 09:15:18 +01:00
..
endpoints feat(watchdog): add Memory resource reclaimer (#7583) 2025-12-16 09:15:18 +01:00
middleware fix: do not require auth for readyz/healthz endpoints (#7403) 2025-12-01 10:35:28 +01:00
routes feat(watchdog): add Memory resource reclaimer (#7583) 2025-12-16 09:15:18 +01:00
static fix(chat-ui): model selection toggle and new chat (#7574) 2025-12-14 22:29:11 +01:00
views feat(watchdog): add Memory resource reclaimer (#7583) 2025-12-16 09:15:18 +01:00
app.go fix(paths): remove trailing slash from requests (#7451) 2025-12-07 21:45:09 +01:00
app_test.go chore(ci): do not overload the apple tests 2025-12-04 14:15:15 +01:00
explorer.go feat: migrate to echo and enable cancellation of non-streaming requests (#7270) 2025-11-14 22:57:53 +01:00
http_suite_test.go fix(llama-cpp): correctly calculate embeddings (#6259) 2025-09-13 23:11:54 +02:00
openai_mapping_test.go feat(api): OpenAI video create enpoint integration (#6777) 2025-10-27 10:06:57 +01:00
openai_videos_test.go feat: migrate to echo and enable cancellation of non-streaming requests (#7270) 2025-11-14 22:57:53 +01:00
render.go feat: migrate to echo and enable cancellation of non-streaming requests (#7270) 2025-11-14 22:57:53 +01:00