Ettore Di Giacinto c89271b2e4 feat(llama.cpp): add distributed llama.cpp inferencing (#2324) ... * feat(llama.cpp): support distributed llama.cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat: let tweak how chat messages are merged together Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactor Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Makefile: register to ALL_GRPC_BACKENDS Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactoring, allow disable auto-detection of backends Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * minor fixups Signed-off-by: mudler <mudler@localai.io> * feat: add cmd to start rpc-server from llama.cpp Signed-off-by: mudler <mudler@localai.io> * ci: add ccache Signed-off-by: mudler <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Signed-off-by: mudler <mudler@localai.io>		2024-05-15 01:17:02 +02:00
..
assets	feat(llama.cpp): add distributed llama.cpp inferencing (#2324)	2024-05-15 01:17:02 +02:00
downloader	fix: reduce chmod permissions for created files and directories (#2137)	2024-04-26 00:47:06 +02:00
functions	feat(functions): allow to set JSON matcher (#2319)	2024-05-14 09:39:20 +02:00
gallery	feat(ui): prompt for chat, support vision, enhancements (#2259)	2024-05-08 00:42:34 +02:00
grpc	refactor(application): introduce application global state (#2072)	2024-04-29 17:42:37 +00:00
langchain	feat(llama.cpp): do not specify backends to autoload and add llama.cpp variants (#2232)	2024-05-04 17:56:12 +02:00
model	feat(llama.cpp): add distributed llama.cpp inferencing (#2324)	2024-05-15 01:17:02 +02:00
stablediffusion	feat: support upscaled image generation with esrgan (#509)	2023-06-05 17:21:38 +02:00
startup	feat: Galleries UI (#2104)	2024-04-23 09:22:58 +02:00
store	feat(stores): Vector store backend (#1795)	2024-03-22 21:14:04 +01:00
templates	fix: reduce chmod permissions for created files and directories (#2137)	2024-04-26 00:47:06 +02:00
tinydream	feat: add tiny dream stable diffusion support (#1283)	2023-12-24 19:27:24 +00:00
utils	refactor(application): introduce application global state (#2072)	2024-04-29 17:42:37 +00:00
xsync	feat(ui): prompt for chat, support vision, enhancements (#2259)	2024-05-08 00:42:34 +02:00
xsysinfo	feat(startup): show CPU/GPU information with --debug (#2241)	2024-05-05 09:10:23 +02:00