LocalAI/core/backend
Richard Palethorpe bf6426aef2
feat: Realtime API support reboot (#5392)
* feat(realtime): Initial Realtime API implementation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: go mod tidy

Signed-off-by: Richard Palethorpe <io@richiejp.com>

* feat: Implement transcription only mode for realtime API

Reduce the scope of the real time API for the initial realease and make
transcription only mode functional.

Signed-off-by: Richard Palethorpe <io@richiejp.com>

* chore(build): Build backends on a separate layer to speed up core only changes

Signed-off-by: Richard Palethorpe <io@richiejp.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Richard Palethorpe <io@richiejp.com>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
2025-05-25 22:25:05 +02:00
..
backend_suite_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
embeddings.go feat(loader): enhance single active backend by treating as singleton (#5107) 2025-04-01 20:58:11 +02:00
image.go feat(loader): enhance single active backend by treating as singleton (#5107) 2025-04-01 20:58:11 +02:00
llm.go feat: Realtime API support reboot (#5392) 2025-05-25 22:25:05 +02:00
llm_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
options.go feat(llama.cpp): add reranking (#5396) 2025-05-22 21:49:30 +02:00
rerank.go feat(loader): enhance single active backend by treating as singleton (#5107) 2025-04-01 20:58:11 +02:00
soundgeneration.go feat(video-gen): add endpoint for video generation (#5247) 2025-04-26 18:05:01 +02:00
stores.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
token_metrics.go feat(loader): enhance single active backend by treating as singleton (#5107) 2025-04-01 20:58:11 +02:00
tokenize.go feat(loader): enhance single active backend by treating as singleton (#5107) 2025-04-01 20:58:11 +02:00
transcript.go feat(loader): enhance single active backend by treating as singleton (#5107) 2025-04-01 20:58:11 +02:00
tts.go feat(video-gen): add endpoint for video generation (#5247) 2025-04-26 18:05:01 +02:00
vad.go feat(loader): enhance single active backend by treating as singleton (#5107) 2025-04-01 20:58:11 +02:00
video.go feat(video-gen): add endpoint for video generation (#5247) 2025-04-26 18:05:01 +02:00