mirror of
https://github.com/mudler/LocalAI
synced 2026-05-24 09:28:23 +00:00
3280b9a287
Some checks failed
Security Scan / tests (push) Has been cancelled
The multi-replica refactor (PR #9583) changed the worker's process key from `modelID` to `modelID#replicaIndex`, but the BackendLogStore kept the bare-modelID lookup. Result: every distributed deployment lost backend logs in the Nodes UI — single-replica too, since even the default capacity of 1 produces a `#0` suffix. Two changes wired together: * pkg/model: BackendLogStore.GetLines/Subscribe now treat a modelID without `#` as a model prefix and merge across all `modelID#N` replica buffers (timestamp-sorted for GetLines; fan-in for Subscribe). Calls with a full `modelID#N` key resolve exactly. ListModels strips replica suffixes and deduplicates so the listing surfaces one entry per loaded model. * react-ui: per-replica log streams as the default. Loaded Models table disambiguates each row with a `rep N` pill (only when the node hosts >1 replica of a model). Each row's "View logs" link routes to the per-replica process key so operators see only that replica's output. The logs page renders the replica context as a chip in the title and surfaces a segmented control — `Replica 0 / 1 / … / All merged` — when the model has multiple replicas; the merged segment uses the bare-modelID URL (delegating to the store's prefix aggregation) for the side-by-side comparison case. Single-replica deployments see no extra UI. Tests added first (TDD): the regression set in backend_log_store_test.go reproduces the bug at the exact failure point — GetLines/ListModels/Subscribe assertions all fail against the broken code, all pass against the fix. TestSubscribe_PerReplicaFilter pins the exact-key path so a future change can't silently break it. Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Assisted-by: claude-code:opus-4-7 [Edit] [Skill:critique] [Skill:audit] [Skill:polish] [Skill:distill] |
||
|---|---|---|
| .. | ||
| backend_log_store.go | ||
| backend_log_store_test.go | ||
| connection_errors.go | ||
| connection_evicting_client.go | ||
| filters.go | ||
| initializers.go | ||
| loader.go | ||
| loader_options.go | ||
| loader_test.go | ||
| model.go | ||
| model_suite_test.go | ||
| process.go | ||
| store.go | ||
| store_test.go | ||
| watchdog.go | ||
| watchdog_options.go | ||
| watchdog_options_test.go | ||
| watchdog_test.go | ||