Richard Palethorpe 5d0b549049 feat(gallery): verify backend OCI images with keyless cosign (#9823) ... * feat(gallery): verify backend OCI images with keyless cosign Close a trust gap where a registry compromise or MITM could silently replace a backend image: the gallery YAML tells LocalAI which image to pull, but until now nothing verified the bytes came from our CI. Consumer (pkg/oci/cosignverify): - New package using sigstore-go to verify keyless-cosign signatures. - OCI 1.1 referrers API + new bundle format (no legacy :tag.sig). - Policy fields: Issuer / IssuerRegex / Identity / IdentityRegex / NotBefore. NotBefore is the revocation lever — keyless Fulcio certs are ephemeral so revocation is policy-side; advancing not_before in the gallery YAML invalidates every signature predating the cutoff. - TUF trusted root cached process-wide so N backends from one gallery do 1 fetch, not N. Plumbing: - pkg/downloader: ImageVerifier interface + WithImageVerifier option threaded through DownloadFileWithContext. Verification runs between oci.GetImage and oci.ExtractOCIImage, with digest pinning via pinnedImageRef to close the TOCTOU window. Skips the verifier's HEAD when the ref is already digest-pinned. - core/config: Gallery.Verification YAML block. - core/gallery: backendDownloadOptions builds the verifier from the policy; applied on initial URI, mirrors, and tag fallbacks. - core/gallery/upgrade: the upgrade path now routes through the same options builder. A regression Ginkgo spec pins this contract — without it, UpgradeBackend silently bypassed verification. - core/cli: --require-backend-integrity (LOCALAI_REQUIRE_BACKEND_INTEGRITY) escalates missing policy / empty SHA256 from warn to hard-fail. Producer (.github/workflows/backend_merge.yml): - id-token: write at job scope (PR-fork-safe via existing event gate). - sigstore/cosign-installer@v3 pinned to v2.4.1. - After each docker buildx imagetools create, resolve the manifest list digest and run cosign sign --recursive --new-bundle-format --registry-referrers-mode=oci-1-1 against repo@digest. --recursive signs the index and every per-arch entry, matching how the consumer resolves a tag to a platform-specific manifest before verifying. Rollout: backend/index.yaml has no `verification:` block yet, so this PR is backward-compatible — installs proceed with a warning until the gallery is populated. Strict mode is opt-in. Assisted-by: claude-code:claude-opus-4-7 [Bash] [Edit] [Read] [Write] [WebSearch] [WebFetch] Signed-off-by: Richard Palethorpe <io@richiejp.com> * refactor(gallery): plumb RequireBackendIntegrity through config instead of env The previous implementation re-exported the --require-backend-integrity CLI flag into LOCALAI_REQUIRE_BACKEND_INTEGRITY via os.Setenv, then re-read it in core/gallery via os.Getenv. This leaked process state into the gallery package and made the flag impossible to override per-call or test without touching the env. Add RequireBackendIntegrity to ApplicationConfig (with a matching WithRequireBackendIntegrity AppOption) and thread the bool through every install/upgrade path: InstallBackend, InstallBackendFromGallery, UpgradeBackend, InstallModelFromGallery, InstallExternalBackend, ApplyGalleryFromString/File, startup.InstallModels. Worker subcommands gain the same env-bound flag on WorkerFlags so distributed-worker installs honor it consistently with the worker daemon path. Add a forbidigo lint rule against os.Getenv / os.LookupEnv / os.Environ to keep the env-leak pattern from creeping back. Existing offenders (p2p, config loaders, etc.) are baseline-grandfathered by the existing new-from-merge-base: origin/master setting; targeted path exclusions cover the legitimate cases — kong CLI entry points, backend subprocesses, system capability probes, gRPC AUTH_TOKEN inheritance, test gating env vars. Assisted-by: claude-code:claude-opus-4-7 Signed-off-by: Richard Palethorpe <io@richiejp.com> --------- Signed-off-by: Richard Palethorpe <io@richiejp.com>		2026-05-18 08:02:20 +02:00
..
disabled	chore(ci): disable CI actions	2026-03-02 14:48:00 +01:00
backend.yml	ci: close GC race + cascade-skip + darwin grpc gaps from v4.2.1 (#9781)	2026-05-12 17:22:09 +02:00
backend_build.yml	ci: close GC race + cascade-skip + darwin grpc gaps from v4.2.1 (#9781)	2026-05-12 17:22:09 +02:00
backend_build_darwin.yml	ci: close GC race + cascade-skip + darwin grpc gaps from v4.2.1 (#9781)	2026-05-12 17:22:09 +02:00
backend_merge.yml	feat(gallery): verify backend OCI images with keyless cosign (#9823)	2026-05-18 08:02:20 +02:00
backend_pr.yml	ci: close GC race + cascade-skip + darwin grpc gaps from v4.2.1 (#9781)	2026-05-12 17:22:09 +02:00
base-images.yml	ci(base-images): also trigger rebuild on .docker/install-base-deps.sh changes	2026-05-09 22:30:46 +00:00
build-test.yaml	feat(ci): allow routing apt traffic through an alternate Ubuntu mirror (#9650)	2026-05-03 23:50:13 +02:00
bump-inference-defaults.yml	chore(deps): bump peter-evans/create-pull-request from 7 to 8 (#9114)	2026-03-24 08:50:50 +01:00
bump_deps.yaml	ci(bump-deps): register ds4 + move version pin into the Makefile (#9761)	2026-05-11 22:46:02 +02:00
bump_docs.yaml	fix(api)!: Stop model prior to deletion (#8422)	2026-02-06 09:22:10 +01:00
checksum_checker.yaml	feat(ci): allow routing apt traffic through an alternate Ubuntu mirror (#9650)	2026-05-03 23:50:13 +02:00
deploy-explorer.yaml	fix(api)!: Stop model prior to deletion (#8422)	2026-02-06 09:22:10 +01:00
gallery-agent.yaml	Change cron schedule to run every 12 hours	2026-04-25 18:38:28 +02:00
generate_intel_image.yaml	ci(concurrency): make cancel-in-progress event-aware, group by sha on push	2026-05-09 08:30:55 +00:00
gh-pages.yml	chore(deps): bump actions/upload-pages-artifact from 4 to 5 (#9337)	2026-04-13 21:53:47 +02:00
image-pr.yml	ci(concurrency): make cancel-in-progress event-aware, group by sha on push	2026-05-09 08:30:55 +00:00
image.yml	ci(image): publish missing :latest-* and :v<X>-* singleton image tags (#9812)	2026-05-14 00:28:48 +02:00
image_build.yml	ci(image): publish missing :latest-* and :v<X>-* singleton image tags (#9812)	2026-05-14 00:28:48 +02:00
image_merge.yml	ci(image): publish missing :latest-* and :v<X>-* singleton image tags (#9812)	2026-05-14 00:28:48 +02:00
lint.yml	ci(concurrency): make cancel-in-progress event-aware, group by sha on push	2026-05-09 08:30:55 +00:00
notify-releases.yaml	fix(api)!: Stop model prior to deletion (#8422)	2026-02-06 09:22:10 +01:00
release.yaml	feat(ci): allow routing apt traffic through an alternate Ubuntu mirror (#9650)	2026-05-03 23:50:13 +02:00
secscan.yaml	Revert "chore(deps): bump securego/gosec from 2.22.9 to 2.22.11" (#7789)	2025-12-30 09:58:13 +01:00
stalebot.yml	chore(deps): bump actions/stale from 10.1.1 to 10.2.0 (#8633)	2026-02-23 23:27:20 +01:00
test-extra.yml	feat(realtime): Add Liquid Audio s2s model and assistant mode on talk page (#9801)	2026-05-13 21:57:27 +02:00
test.yml	ci: drop paths-ignore from test.yml and tests-e2e.yml	2026-05-09 09:23:51 +00:00
tests-aio.yml	ci(concurrency): make cancel-in-progress event-aware, group by sha on push	2026-05-09 08:30:55 +00:00
tests-e2e.yml	ci: drop paths-ignore from test.yml and tests-e2e.yml	2026-05-09 09:23:51 +00:00
tests-ui-e2e.yml	ci(concurrency): make cancel-in-progress event-aware, group by sha on push	2026-05-09 08:30:55 +00:00
update_swagger.yaml	feat(ci): allow routing apt traffic through an alternate Ubuntu mirror (#9650)	2026-05-03 23:50:13 +02:00
yaml-check.yml	chore(backend gallery): add description for remaining backends (#5679)	2025-06-17 22:21:44 +02:00