Ettore Di Giacinto d0f2bf3181 fix(shutdown): do not shutdown immediately busy backends (#3543) ... * fix(shutdown): do not shutdown immediately busy backends Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(refactor): avoid duplicate functions Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix: multiplicative backoff for shutdown (#3547) * multiplicative backoff for shutdown Rather than always retry every two seconds, back off the shutdown attempt rate? Signed-off-by: Dave <dave@gray101.com> * Update loader.go Signed-off-by: Dave <dave@gray101.com> * add clamp of 2 minutes Signed-off-by: Dave Lee <dave@gray101.com> --------- Signed-off-by: Dave <dave@gray101.com> Signed-off-by: Dave Lee <dave@gray101.com> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Signed-off-by: Dave <dave@gray101.com> Signed-off-by: Dave Lee <dave@gray101.com> Co-authored-by: Dave <dave@gray101.com>		2024-09-17 04:50:57 +00:00
..
initializers.go	feat: add endpoint to list system informations (#3449)	2024-09-05 20:44:30 +02:00
loader.go	fix(shutdown): do not shutdown immediately busy backends (#3543)	2024-09-17 04:50:57 +00:00
loader_test.go	chore(model-loader): increase test coverage of model loader (#3433)	2024-08-30 15:20:39 +02:00
model.go	chore(model-loader): increase test coverage of model loader (#3433)	2024-08-30 15:20:39 +02:00
model_suite_test.go	tests: add template tests (#2063)	2024-04-18 10:57:24 +02:00
options.go	chore: fix go.mod module (#2635)	2024-06-23 08:24:36 +00:00
process.go	fix(shutdown): do not shutdown immediately busy backends (#3543)	2024-09-17 04:50:57 +00:00
template.go	fix(model-loading): keep track of open GRPC Clients (#3377)	2024-08-25 14:36:09 +02:00
template_test.go	fix(model-loading): keep track of open GRPC Clients (#3377)	2024-08-25 14:36:09 +02:00
watchdog.go	fix(model-loading): keep track of open GRPC Clients (#3377)	2024-08-25 14:36:09 +02:00