LocalAI/gallery/phi-2-chat.yaml

---
name: "phi-2-chatml"

config_file: |
  backend: "llama-cpp"
  mmap: true
  template:
    chat_message: |
      <|im_start|>{{ .RoleName }}
      {{.Content}}<|im_end|>
    chat: |
      {{.Input}}
      <|im_start|>assistant
    completion: |
      {{.Input}}
  context_size: 4096
  f16: true
  stopwords:
  - <|im_end|>
fix: yamlint warnings and errors (#2131) fix yamlint warnings and errors Signed-off-by: Dave Lee <dave@gray101.com> 2024-04-25 17:25:56 +00:00			`---`
feat(gallery): add llama3, hermes, phi-3, and others (#2110) Also adds embeddings and llava models Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2024-04-23 17:35:45 +00:00			`name: "phi-2-chatml"`

			`config_file: \|`
feat: refactor build process, drop embedded backends (#5875) * feat: split remaining backends and drop embedded backends - Drop silero-vad, huggingface, and stores backend from embedded binaries - Refactor Makefile and Dockerfile to avoid building grpc backends - Drop golang code that was used to embed backends - Simplify building by using goreleaser Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(gallery): be specific with llama-cpp backend templates Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(docs): update Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(ci): minor fixes Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore: drop all ffmpeg references Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix: run protogen-go Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Always enable p2p mode Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Update gorelease file Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(stores): do not always load Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Fix linting issues Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Simplify Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Mac OS fixup Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2025-07-22 14:31:04 +00:00			`backend: "llama-cpp"`
feat(gallery): add llama3, hermes, phi-3, and others (#2110) Also adds embeddings and llava models Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2024-04-23 17:35:45 +00:00			`mmap: true`
			`template:`
			`chat_message: \|`
			`<\|im_start\|>{{ .RoleName }}`
			`{{.Content}}<\|im_end\|>`
			`chat: \|`
			`{{.Input}}`
			`<\|im_start\|>assistant`
			`completion: \|`
			`{{.Input}}`
			`context_size: 4096`
			`f16: true`
			`stopwords:`
			`- <\|im_end\|>`