mintyleaf 96f8ec0402 feat: add machine tag and inference timings (#4577) ... * Add machine tag option, add extraUsage option, grpc-server -> proto -> endpoint extraUsage data is broken for now Signed-off-by: mintyleaf <mintyleafdev@gmail.com> * remove redurant timing fields, fix not working timings output Signed-off-by: mintyleaf <mintyleafdev@gmail.com> * use middleware for Machine-Tag only if tag is specified Signed-off-by: mintyleaf <mintyleafdev@gmail.com> --------- Signed-off-by: mintyleaf <mintyleafdev@gmail.com>		2025-01-17 17:05:58 +01:00
..
patches	chore(llava): update clip.patch (#4453)	2024-12-23 19:11:31 +01:00
CMakeLists.txt	deps(llama.cpp): update, support Gemma models (#1734)	2024-02-21 17:23:38 +01:00
grpc-server.cpp	feat: add machine tag and inference timings (#4577)	2025-01-17 17:05:58 +01:00
json.hpp	🔥 add LaVA support and GPT vision API, Multiple requests for llama.cpp, return JSON types (#1254)	2023-11-11 13:14:59 +01:00
Makefile	fix(llama.cpp): embed metal file into result binary for darwin (#4279)	2024-11-28 04:17:00 +00:00
prepare.sh	chore(deps): update llama.cpp (#3497)	2024-09-12 20:55:27 +02:00
utils.hpp	chore(deps): update llama.cpp (#3497)	2024-09-12 20:55:27 +02:00