Open device management
Find a file
Scott Gress 26e4395926
Allow GitOps to clear global settings more easily using overwrite option (#29215)
for #28118 

# Checklist for submitter

- [X] Manual QA for all new/changed functionality

## Details

This PR adds an `overwrite` option to the "modify app config" API which,
if set, causes the code to replace certain keys in the existing config
with keys from the incoming config, without attempting any merge. This
is then used by GitOps to allow it to easily clear settings that were
otherwise being merged together or ignored entirely due to the PATCH
semantics expected for the `fleetctl apply` use case.

The new setting is utilized in this first pass for the following
settings:

* `sso_settings`
* `smtp_settings`
* `features`
* `mdm.end_user_authentication`

It could be expanded to several more keys that we currently handle
piecemeal in the GitOps code by attempting to send empty values to the
server (with varying success).

Targeting `mdm.end_user_authentication` vs. all of `mdm` is based on
[this bug](https://github.com/fleetdm/fleet/issues/26175) being opened.
The concern with doing all of `mdm` would be that anyone who had e.g.
VPP set up in their app and hadn't set it up in GitOps would have it
wiped out. If we're comfortable with that risk I can update that here
and update the warning accordingly.

### More detail 

**The way this code works _without_ Overwrite mode on**

1. We unmarshall the incoming JSON from GitOps into a fresh AppConfig
struct `newAppConfig`. Anything keys not present in the incoming JSON
will result in default values being set in `newAppConfig`
2. We unmarshall the incoming JSON from GitOps into the current
`appConfig`. This uses an internal merge algorithm where keys not
present in the JSON will generally leave the matching keys in
`appConfig` untouched. We've been dealing with this by having GitOps
find missing keys and explicitly set them to non-nil empty states. When
arrays are encountered, they are _merged_, not replaced, which is
problematic for the `features.additional_queries` use case and probably
others.
3. We piecemeal replace certain data in `appConfig` with data from
`newAppConfig`, and save it to the db.

**The way this works _with_ Overwrite mode on**

Between steps 1 and 2 above, we _copy_ certain keys from `newAppConfig`
to `appConfig`. If the incoming JSON didn't have a key, the effect will
be that `appConfig` now has default values for that key. For nested
arrays like `features.additionalQueries`, the value in `appConfig` will
be precisely what the user put in GitOps.

## Testing

I tested adding/removing these settings with GitOps manually via
`fleetctl gitops`. On the main branch I could reproduce the issue where
omitting out these keys in my YAML did not lead to the settings being
reset on my instance. With the Features settings, the issue was more
granular, with inconsistent behavior when trying to remove individual
nested settings. On this branch, the settings are cleared as expected at
all levels of granularity.

I also added some new automated tests to verify the expected behavior
for these keys. All existing tests pass.

If accepted this PR would supercede
https://github.com/fleetdm/fleet/pull/29180 which approaches the issue
from the GitOps side for sso, smtp and mdm. Adapting that approach for
`features` would require custom logic to declare nested properties as
"cleared".
2025-05-19 11:18:28 -05:00
.github Update changelog for fleetd 1.42.0 release (#29186) 2025-05-19 08:22:30 -03:00
.storybook Fleet Design: Add software icons into storybook (#27238) 2025-03-19 09:22:12 -04:00
.vscode Update policies page empty state (#25726) 2025-01-29 11:12:28 -06:00
articles Organize contributor docs and establish ADR process and template (#29101) 2025-05-17 15:03:52 -05:00
assets Fleet UI: Add Self-service categories key and filtering (#28506) 2025-05-02 12:11:48 -04:00
changes Allow GitOps to clear global settings more easily using overwrite option (#29215) 2025-05-19 11:18:28 -05:00
charts Prepare Fleet v4.67.3 (#28883) 2025-05-06 15:29:34 -05:00
cmd Allow GitOps to clear global settings more easily using overwrite option (#29215) 2025-05-19 11:18:28 -05:00
docs Organize contributor docs and establish ADR process and template (#29101) 2025-05-17 15:03:52 -05:00
ee Update linux_wipe.sh (#29146) 2025-05-19 10:25:23 -05:00
frontend Fix activity feed padding (#29234) 2025-05-17 15:07:05 -05:00
git-hooks Auto-generate and check Android schema.sql (#26720) 2025-02-28 16:30:40 -06:00
handbook Organize contributor docs and establish ADR process and template (#29101) 2025-05-17 15:03:52 -05:00
infrastructure Enabling AWS Backups for dogfood instances (#28915) 2025-05-07 12:19:24 -04:00
it-and-security Uninstall fleetd scripts: "fleetd" (#29196) 2025-05-15 18:48:14 -04:00
orbit Update changelog for fleetd 1.42.0 release (#29186) 2025-05-19 08:22:30 -03:00
pkg Properly decode MSI product names from Windows-1252 (#29245) 2025-05-19 10:39:57 -05:00
proposals Remove proposals (unused) (#26646) 2025-02-27 10:37:07 -06:00
schema Update osquery schema to 5.17.0 (#29100) 2025-05-13 11:45:27 -07:00
security Iterate status.md for reporting vulnerability updates (#29062) 2025-05-15 21:15:37 -03:00
server Allow GitOps to clear global settings more easily using overwrite option (#29215) 2025-05-19 11:18:28 -05:00
terraform Remove terraform modules from the Fleet repo to reduce confusion (#26201) 2025-02-10 18:42:39 -06:00
test/upgrade Simplify DB test/upgrade tool (#27141) 2025-03-14 17:07:41 -03:00
tools Improve .pkg metadata extraction for names and bundle IDs, let custom package metadata extraction tool check an entire directory at a time (#29249) 2025-05-19 10:32:36 -05:00
website Organize contributor docs and establish ADR process and template (#29101) 2025-05-17 15:03:52 -05:00
.dockerignore Added support to read jwt and mysql password from a file (#141) 2021-01-04 07:58:43 -08:00
.eslintrc.js update storybook to 8.4.7 (#25451) 2025-01-20 16:17:33 +00:00
.gitattributes Windows friendly changes after walking through getting started guide (#1441) 2021-07-21 20:49:44 -04:00
.gitignore Ignore .swp files (#23755) 2024-11-13 09:08:47 -08:00
.gitpod.yml Add gitpod yml (#2915) 2021-11-19 10:03:56 -03:00
.golangci.yml Moved fleetctl to fleetctl package. (#28932) 2025-05-07 15:53:35 -05:00
.goreleaser-snapshot.yml Use goreleaser v2 in CI (#23748) 2024-12-03 16:15:31 -06:00
.goreleaser.yml Fix tagging of fleetdm/fleet and fleetdm/fleetctl when releasing (#28251) 2025-04-16 15:48:47 -03:00
.npmignore Move fleetdm.com into main Fleet repo (#83) 2020-12-02 14:48:03 -06:00
.pre-commit-config.yaml bump golangci-lint to 1.55.2 (#18604) 2024-04-30 08:59:14 -06:00
.prettierignore Fix verify fleetd-base files > verify-fleetd-base-msi powershell script (#25064) 2025-01-02 10:24:25 -08:00
.prettierrc.json add prettier and have it format all fleet application code (#625) 2021-04-12 14:32:25 +01:00
.yarnrc New yarn configuration: Sets installing a dependency to a specific semantic versioning instead of latest stable (#17938) 2024-03-29 10:39:20 -04:00
babel.config.json Fleet Frontend: Create integration tests QuerySidePanel.tests.tsx (#12179) 2023-06-07 12:01:59 -04:00
CHANGELOG.md Prepare Fleet v4.67.3 (#28883) 2025-05-06 15:29:34 -05:00
CODE_OF_CONDUCT.md Remove @fleetdm.com emails from fleetdm/fleet repo (#882) 2021-05-27 17:19:14 -04:00
codecov.yml Added migration test. 2024-09-09 15:28:15 -05:00
CODEOWNERS Organize contributor docs and establish ADR process and template (#29101) 2025-05-17 15:03:52 -05:00
docker-compose-redis-cluster.yml Move Redis cluster docker yml to separate file (#11162) 2023-04-12 15:14:28 -04:00
docker-compose.yml Optimize software_titles query to use indexes (#25722) 2025-01-23 15:48:21 -03:00
Dockerfile-desktop-linux Fix detected CVEs and docker scout exit code to fail the Github Action (#28836) 2025-05-06 13:35:27 -03:00
go.mod Fix detected CVEs and docker scout exit code to fail the Github Action (#28836) 2025-05-06 13:35:27 -03:00
go.sum Fleetd: Update the Registry DisplayVersion when fleetd auto-updates (#28183) 2025-04-17 11:04:02 -07:00
LICENSE Update LICENSE (#10) 2020-11-04 19:57:51 -06:00
Makefile Iterate status.md for reporting vulnerability updates (#29062) 2025-05-15 21:15:37 -03:00
manifest.yml.cloudgov.example cloud.gov deployment (#7611) 2022-09-07 13:30:06 -05:00
osv-scanner.toml Waive 3 Go code scanning vulnerability alerts. (#18007) 2024-04-03 16:04:01 -05:00
package.json Update SQL parser to handle more modern syntax (#28211) 2025-04-16 10:10:52 -05:00
postcss.config.js Upgrade Bourbon to 5.1.0 and fix deprecation warnings (#1973) 2019-01-03 12:46:55 -08:00
README.md Update README.md (#27751) 2025-04-02 10:23:40 -05:00
render.yaml Use Render Redis service (#23056) 2025-01-02 10:07:54 -06:00
SECURITY.md Add scanning to released images and process to track vulnerabilities (#28087) 2025-04-16 11:50:10 -03:00
tsconfig.json Fleet UI: Fix policy software automation fail to report as failing (#26044) 2025-02-28 08:45:33 -05:00
webpack.config.js Update SQL parser to handle more modern syntax (#28211) 2025-04-16 10:10:52 -05:00
yarn.lock Update SQL parser to handle more modern syntax (#28211) 2025-04-16 10:10:52 -05:00

Fleet logo, landscape, dark text, transparent background

News   ·   Report a bug   ·   Handbook   ·   Why open source?   ·   Art

Open-source platform for IT and security teams with thousands of computers. Designed for APIs, GitOps, webhooks, YAML, and humans.

A glass city in the clouds

What's it for?

Organizations like Fastly and Gusto use Fleet for vulnerability reporting, detection engineering, device management (MDM), device health monitoring, posture-based access control, managing unused software licenses, and more.

Explore data

To see what kind of data you can use Fleet to gather, check out the table reference documentation.

Out-of-the-box policies

Fleet includes out-of-the box support for all CIS benchmarks for macOS and Windows, as well as many simpler queries.

Take as much or as little as you need for your organization.

Supported platforms

Here are the platforms Fleet currently supports:

  • Linux (all distros)
  • macOS
  • Windows
  • Chromebooks
  • Amazon Web Services (AWS)
  • Google Cloud (GCP)
  • Azure (Microsoft cloud)
  • Data centers
  • Containers (kube, etc)
  • Linux-based IoT devices

Lighter than air

Fleet is lightweight and modular. You can use it for security without using it for MDM, and vice versa. You can turn off features you are not using.

Openness

Fleet is dedicated to flexibility, accessibility, and clarity. We think everyone can contribute and that tools should be as easy as possible for everyone to understand.

Good neighbors

Fleet has no ambition to replace all of your other tools. (Though it might replace some, if you want it to.) Ready-to-use, enterprise-friendly integrations exist for Snowflake, Splunk, GitHub Actions, Vanta, Elastic Jira, Zendesk, and more.

Fleet plays well with Munki, Chef, Puppet, and Ansible, as well as with security tools like Crowdstrike and SentinelOne. For example, you can use the free version of Fleet to quickly report on what hosts are actually running your EDR agent.

Free as in free

The free version of Fleet will always be free. Fleet is independently backed and actively maintained with the help of many amazing contributors.

Longevity

The company behind Fleet is founded (and majority-owned) by true believers in open source. The company's business model is influenced by GitLab (NYSE: GTLB), with great investors, happy customers, and the capacity to become profitable at any time.

In keeping with Fleet's value of openness, Fleet Device Management's company handbook is public and open source. You can read about the history of Fleet and osquery and our commitment to improving the product.

Is it any good?

Fleet is used in production by IT and security teams with thousands of laptops and servers. Many deployments support tens of thousands of hosts, and a few large organizations manage deployments as large as 400,000+ hosts.

Chat

Please join us in MacAdmins Slack or in osquery Slack.

The Fleet community is full of kind and helpful people. Whether or not you are a paying customer, if you need help, just ask.

Contributing   Run Tests   Go Report Card   CII Best Practices   Twitter Follow  

The landscape of cybersecurity and IT is too complex. Let's open it up.

Contributions are welcome, whether you answer questions on Slack / GitHub / StackOverflow / LinkedIn / Twitter, improve the documentation or website, write a tutorial, give a talk at a conference or local meetup, give an interview on a podcast, troubleshoot reported issues, or submit a patch. The Fleet code of conduct is on GitHub.

What's next?

To see what Fleet can do, head over to fleetdm.com and try it out for yourself, grab time with one of the maintainers to discuss, or visit the docs and roll it out to your organization.

Production deployment

Fleet is simple enough to spin up for yourself. Or you can have us host it for you. Premium features are available either way.

Documentation

Complete documentation for Fleet can be found at https://fleetdm.com/docs.

License

The free version of Fleet is available under the MIT license. The commercial license is also designed to allow contributions to paid features for users whose employment agreements allow them to contribute to open source projects. (See LICENSE.md for details.)

Fleet is built on osquery, nanoMDM, Nudge, and swiftDialog.