Richard Palethorpe 5d0b549049 feat(gallery): verify backend OCI images with keyless cosign (#9823) ... * feat(gallery): verify backend OCI images with keyless cosign Close a trust gap where a registry compromise or MITM could silently replace a backend image: the gallery YAML tells LocalAI which image to pull, but until now nothing verified the bytes came from our CI. Consumer (pkg/oci/cosignverify): - New package using sigstore-go to verify keyless-cosign signatures. - OCI 1.1 referrers API + new bundle format (no legacy :tag.sig). - Policy fields: Issuer / IssuerRegex / Identity / IdentityRegex / NotBefore. NotBefore is the revocation lever — keyless Fulcio certs are ephemeral so revocation is policy-side; advancing not_before in the gallery YAML invalidates every signature predating the cutoff. - TUF trusted root cached process-wide so N backends from one gallery do 1 fetch, not N. Plumbing: - pkg/downloader: ImageVerifier interface + WithImageVerifier option threaded through DownloadFileWithContext. Verification runs between oci.GetImage and oci.ExtractOCIImage, with digest pinning via pinnedImageRef to close the TOCTOU window. Skips the verifier's HEAD when the ref is already digest-pinned. - core/config: Gallery.Verification YAML block. - core/gallery: backendDownloadOptions builds the verifier from the policy; applied on initial URI, mirrors, and tag fallbacks. - core/gallery/upgrade: the upgrade path now routes through the same options builder. A regression Ginkgo spec pins this contract — without it, UpgradeBackend silently bypassed verification. - core/cli: --require-backend-integrity (LOCALAI_REQUIRE_BACKEND_INTEGRITY) escalates missing policy / empty SHA256 from warn to hard-fail. Producer (.github/workflows/backend_merge.yml): - id-token: write at job scope (PR-fork-safe via existing event gate). - sigstore/cosign-installer@v3 pinned to v2.4.1. - After each docker buildx imagetools create, resolve the manifest list digest and run cosign sign --recursive --new-bundle-format --registry-referrers-mode=oci-1-1 against repo@digest. --recursive signs the index and every per-arch entry, matching how the consumer resolves a tag to a platform-specific manifest before verifying. Rollout: backend/index.yaml has no `verification:` block yet, so this PR is backward-compatible — installs proceed with a warning until the gallery is populated. Strict mode is opt-in. Assisted-by: claude-code:claude-opus-4-7 [Bash] [Edit] [Read] [Write] [WebSearch] [WebFetch] Signed-off-by: Richard Palethorpe <io@richiejp.com> * refactor(gallery): plumb RequireBackendIntegrity through config instead of env The previous implementation re-exported the --require-backend-integrity CLI flag into LOCALAI_REQUIRE_BACKEND_INTEGRITY via os.Setenv, then re-read it in core/gallery via os.Getenv. This leaked process state into the gallery package and made the flag impossible to override per-call or test without touching the env. Add RequireBackendIntegrity to ApplicationConfig (with a matching WithRequireBackendIntegrity AppOption) and thread the bool through every install/upgrade path: InstallBackend, InstallBackendFromGallery, UpgradeBackend, InstallModelFromGallery, InstallExternalBackend, ApplyGalleryFromString/File, startup.InstallModels. Worker subcommands gain the same env-bound flag on WorkerFlags so distributed-worker installs honor it consistently with the worker daemon path. Add a forbidigo lint rule against os.Getenv / os.LookupEnv / os.Environ to keep the env-leak pattern from creeping back. Existing offenders (p2p, config loaders, etc.) are baseline-grandfathered by the existing new-from-merge-base: origin/master setting; targeted path exclusions cover the legitimate cases — kong CLI entry points, backend subprocesses, system capability probes, gRPC AUTH_TOKEN inheritance, test gating env vars. Assisted-by: claude-code:claude-opus-4-7 Signed-off-by: Richard Palethorpe <io@richiejp.com> --------- Signed-off-by: Richard Palethorpe <io@richiejp.com>		2026-05-18 08:02:20 +02:00
..
actions	ci: phase 1-3 of GHA free tier migration (path filter, multi-arch split prep, /mnt disk relief) (#9726)	2026-05-08 23:43:41 +02:00
ci	fix: roll out bluemonday Sanitize more widely (#3794)	2024-10-12 09:45:47 +02:00
gallery-agent	fix(ci): switch gallery-agent to sigs.k8s.io/yaml (#9397)	2026-04-17 10:10:42 +02:00
ISSUE_TEMPLATE	docs/examples: enhancements (#1572)	2024-01-18 19:41:08 +01:00
scripts	ci: close GC race + cascade-skip + darwin grpc gaps from v4.2.1 (#9781)	2026-05-12 17:22:09 +02:00
workflows	feat(gallery): verify backend OCI images with keyless cosign (#9823)	2026-05-18 08:02:20 +02:00
backend-matrix.yml	feat(realtime): Add Liquid Audio s2s model and assistant mode on talk page (#9801)	2026-05-13 21:57:27 +02:00
bump_deps.sh	feat: do not bundle llama-cpp anymore (#5790)	2025-07-18 13:24:12 +02:00
bump_docs.sh	fix: github bump_docs.sh regex to drop emoji and other text (#2180)	2024-04-29 03:55:29 +00:00
bump_vllm_wheel.sh	feat(vllm): expose AsyncEngineArgs via generic engine_args YAML map (#9563)	2026-04-29 00:49:28 +02:00
check_and_update.py	fix(ci): fixup checksum scanning pipeline (#3631)	2024-09-23 10:56:10 +02:00
checksum_checker.sh	fix(ci): fixup correct path for check_and_update.py (#2777)	2024-07-11 23:05:43 +02:00
dependabot.yml	feat: Add backend gallery (#5607)	2025-06-15 14:56:52 +02:00
FUNDING.yml	Create FUNDING.yml (#725)	2023-07-09 13:39:00 +02:00
labeler.yml	chore(ci): update labels	2025-02-13 09:58:19 +01:00
PULL_REQUEST_TEMPLATE.md	feat(vllm): Allow to set quantization (#1094)	2023-09-22 15:52:38 +02:00
release.yml	feat(p2p): Federation and AI swarms (#2723)	2024-07-08 22:04:06 +02:00
stale.yml	feat: add PR template and stale configuration (#316)	2023-05-20 09:10:20 +02:00