LocalAI/gallery/moondream.yaml

---
name: "moondream2"


config_file: |
    backend: "llama-cpp"
    context_size: 2046
    roles:
      user: "\nQuestion: "
      system: "\nSystem: "
      assistant: "\nAnswer: "
    stopwords:
    - "Question:"
    - "<|endoftext|>"
    f16: true
    template:
      completion: |
        Complete the following sentence: {{.Input}}
      chat: "{{.Input}}\nAnswer:\n"
models(gallery): add moondream2 (#2237) * models(gallery): add moondream2 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * models(gallery): fix typo for TTS models Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * models(gallery): add base config for moondream2 and icon Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * linter fixes Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2024-05-04 16:29:04 +00:00			`---`
			`name: "moondream2"`


			`config_file: \|`
feat: refactor build process, drop embedded backends (#5875) * feat: split remaining backends and drop embedded backends - Drop silero-vad, huggingface, and stores backend from embedded binaries - Refactor Makefile and Dockerfile to avoid building grpc backends - Drop golang code that was used to embed backends - Simplify building by using goreleaser Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(gallery): be specific with llama-cpp backend templates Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(docs): update Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(ci): minor fixes Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore: drop all ffmpeg references Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix: run protogen-go Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Always enable p2p mode Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Update gorelease file Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(stores): do not always load Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Fix linting issues Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Simplify Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Mac OS fixup Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2025-07-22 14:31:04 +00:00			`backend: "llama-cpp"`
models(gallery): add moondream2 (#2237) * models(gallery): add moondream2 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * models(gallery): fix typo for TTS models Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * models(gallery): add base config for moondream2 and icon Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * linter fixes Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2024-05-04 16:29:04 +00:00			`context_size: 2046`
			`roles:`
			`user: "\nQuestion: "`
			`system: "\nSystem: "`
			`assistant: "\nAnswer: "`
			`stopwords:`
models(gallery): moondream2 fixups Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> 2024-05-05 08:49:04 +00:00			`- "Question:"`
			`- "<\|endoftext\|>"`
models(gallery): add moondream2 (#2237) * models(gallery): add moondream2 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * models(gallery): fix typo for TTS models Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * models(gallery): add base config for moondream2 and icon Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * linter fixes Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> 2024-05-04 16:29:04 +00:00			`f16: true`
			`template:`
			`completion: \|`
			`Complete the following sentence: {{.Input}}`
models(gallery): moondream2 fixups Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> 2024-05-05 08:49:04 +00:00			`chat: "{{.Input}}\nAnswer:\n"`