fakezeta 8210ffcb6c feat: Token Stream support for Transformer, fix: missing package for OpenVINO (#1908) ... * Streaming working * Small fix for regression on CUDA and XPU * use pip version of optimum[openvino] * Update backend/python/transformers/transformers_server.py Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> * Token streaming support fix optimum[openvino] package in install.sh * Token Streaming support --------- Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>		2024-03-27 17:50:35 +01:00
..
cpp	test/fix: OSX Test Repair (#1843)	2024-03-18 19:19:43 +01:00
go	feat(stores): Vector store backend (#1795)	2024-03-22 21:14:04 +01:00
python	feat: Token Stream support for Transformer, fix: missing package for OpenVINO (#1908)	2024-03-27 17:50:35 +01:00
backend.proto	feat(stores): Vector store backend (#1795)	2024-03-22 21:14:04 +01:00
backend_grpc.pb.go	transformers: correctly load automodels (#1643)	2024-01-26 00:13:21 +01:00