mirror of
https://github.com/mudler/LocalAI
synced 2026-05-24 09:28:23 +00:00
3948b580d2
PR #9583 changed the supervisor's process map key from `modelID` to `modelID#replicaIndex`, but the NATS lifecycle handlers kept passing the bare modelID: * `backend.stop` (subscribeLifecycleEvents): `s.stopBackend(req.Backend)` → `s.processes["Qwen3.6-..."]` missed (actual key is "...#0") → silent no-op. Admin "Unload model" clicks released VRAM via model.unload but left the gRPC process alive on its old port. Subsequent chats hit installBackend, found the leftover process, reused its address — and the UI reported "no models loaded" while the model kept responding. * `backend.delete` (subscribeLifecycleEvents): same map miss in `isRunning(req.Backend)` and `s.stopBackend(req.Backend)` — admin "Delete backend" deleted the binary while the process was still serving traffic. Add `resolveProcessKeys(id)`: exact match if `id` is a full processKey (stopAllBackends iterates the map and passes its own keys); prefix-match if `id` is bare (NATS handlers); empty if `id` contains `#` but doesn't match (no spurious fallback when the caller was explicit). stopBackend and isRunning now call it; stopBackend gets a new stopBackendExact helper for per-key cleanup. TDD: regression test fails without the fix (resolveProcessKeys doesn't exist; map lookup by bare name returns nothing). Tests pass post-fix. Reproduced live: registry row count was 0 for the model the user "Unloaded", chat still served by the leftover worker process. SmartRouter behavior is correct in itself — it falls through to scheduleAndLoad when no row exists; the bug was that the leftover process corrupted the install path. Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Assisted-by: claude-code:opus-4-7 [Edit] [Bash] |
||
|---|---|---|
| .. | ||
| context | ||
| worker | ||
| workerregistry | ||
| agent.go | ||
| agent_test.go | ||
| agent_worker.go | ||
| backends.go | ||
| cli.go | ||
| cli_suite_test.go | ||
| completion.go | ||
| completion_test.go | ||
| deprecations.go | ||
| explorer.go | ||
| federated.go | ||
| models.go | ||
| run.go | ||
| soundgeneration.go | ||
| transcript.go | ||
| tts.go | ||
| util.go | ||
| worker.go | ||
| worker_addr_test.go | ||
| worker_replica_test.go | ||