2 commits

Author	SHA1	Message	Date
ok2sh	20d637e7b7	fix: ExLlama Backend Context Size & Rope Scaling (#1311) ... * fix: context_size not propagated to exllama backend * fix: exllama rope scaling	2023-11-21 19:26:39 +01:00
Ettore Di Giacinto	ad0e30bca5	refactor: move backends into the backends directory (#1279) ... * refactor: move backends into the backends directory Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * refactor: move main close to implementation for every backend Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-11-13 22:40:16 +01:00

Renamed from extra/grpc/exllama/exllama.py (Browse further)