LocalAI/backend/python/kokoro
Ettore Di Giacinto 59108fbe32
feat: add distributed mode (#9124)
* feat: add distributed mode (experimental)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix data races, mutexes, transactions

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix events and tool stream in agent chat

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* use ginkgo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(cron): compute correctly time boundaries avoiding re-triggering

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* enhancements, refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* do not flood of healthy checks

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* do not list obvious backends as text backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* tests fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactoring and consolidation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Drop redundant healthcheck

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* enhancements, refactorings

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2026-03-30 00:47:27 +02:00
..
backend.py feat: add distributed mode (#9124) 2026-03-30 00:47:27 +02:00
install.sh fix(l4t-12): use pip to install python deps (#7967) 2026-01-11 00:21:32 +01:00
Makefile feat(mlx): add mlx backend (#6049) 2025-08-22 08:42:29 +02:00
README.md feat(kokoro): complete kokoro integration (#5978) 2025-08-06 15:23:29 +02:00
requirements-cpu.txt feat(kokoro): complete kokoro integration (#5978) 2025-08-06 15:23:29 +02:00
requirements-cublas12.txt feat(kokoro): complete kokoro integration (#5978) 2025-08-06 15:23:29 +02:00
requirements-cublas13.txt feat: add cuda13 images (#7404) 2025-12-02 14:24:35 +01:00
requirements-hipblas.txt chore: Update to Ubuntu24.04 (cont #7423) (#7769) 2026-01-06 15:26:42 +01:00
requirements-intel.txt feat(qwen-tts): add Qwen-tts backend (#8163) 2026-01-23 15:18:41 +01:00
requirements-l4t12.txt feat: add cuda13 images (#7404) 2025-12-02 14:24:35 +01:00
requirements-mps.txt feat(metal): try to extend support to remaining backends (#8374) 2026-02-03 21:57:50 +01:00
requirements.txt feat(kokoro): complete kokoro integration (#5978) 2025-08-06 15:23:29 +02:00
run.sh feat: Add backend gallery (#5607) 2025-06-15 14:56:52 +02:00
test.py feat(kokoro): complete kokoro integration (#5978) 2025-08-06 15:23:29 +02:00
test.sh feat: Add backend gallery (#5607) 2025-06-15 14:56:52 +02:00

Kokoro TTS Backend for LocalAI

This is a gRPC server backend for LocalAI that uses the Kokoro TTS pipeline.

Creating a separate environment for kokoro project

make kokoro

Testing the gRPC server

make test

Features

  • Lightweight TTS model with 82 million parameters
  • Apache-licensed weights
  • Fast and cost-efficient
  • Multi-language support
  • Multiple voice options