Commit graph

994 commits

Author SHA1 Message Date
Jorge Falcon
5a0b4221a1
Loadtest osquery perf Github action extra_flags fix (#34075) 2025-10-09 18:03:29 -04:00
Lucas Manuel Rodriguez
215fb90d35
Remove unclear item from pull_request_template (#34029)
Context:
https://fleetdm.slack.com/archives/C019WG4GH0A/p1759191019453799
2025-10-09 17:38:41 -03:00
Jorge Falcon
22f950e708
Loadtest Github Actions Fixes (#34038)
* Fixes typos in loadtest-infra.yml
  * Input refrences: `input.` -> `inputs.` 
  * `fleet_database_instance_size`: `defualt` -> `default`
  * `fleet_redis_instance_size`: `defualt` -> `default`
* Fixes typos in loadtest-osquery-perf.yml
  * Input refrences: `input.` -> `inputs.`
2025-10-09 10:39:55 -04:00
Jorge Falcon
e952ef06c0
Loadtesting IAC updates (#32629)
# Github Actions (New)
- New workflow to deploy/destroy loadtest infrastructure with one-click
(Needs to be tested)
- Common inputs drive configuration and deployment of loadtest
infrastructure
    - tag
    - fleet_task_count
    - fleet_task_memory
    - fleet_task_cpu
    - fleet_database_instance_size
    - fleet_database_instance_count
    - fleet_redis_instance_size
    - fleet_redis_instance_count
    - terraform_workspace
    - terraform_action
- New workflow to deploy/destroy osquery-perf to loadtest infrastructure
with one-click (Needs to be tested)
- Common inputs drive configuration and deployment of osquery-perf
resources
    - tag
    - git_branch
    - loadtest_containers
    - extra_flags
    - terraform_workspace
    - terraform_action
- New workflow to deploy shared loadtest resources with one-click (Needs
to be tested)

# Loadtest Infrastructure (New)
- New directory (`infrastructure/loadtesting/terraform/infra`) for
one-click deployment
- Loadtest environment updated to use [fleet-terraform
modules](https://github.com/fleetdm/fleet-terraform)
- [Deployment documentation
updated](0c254bca40/infrastructure/loadtesting/terraform/infra/README.md)
to reflect new steps

# Osquery-perf deployment (New)
- New directory (`infrastructure/loadtesting/terraform/osquery-perf`)
for the deployment of osquery-perf
- osquery-perf updated to use [fleet-terraform
modules](https://github.com/fleetdm/fleet-terraform)
- [Deployment documentation
updated](0c254bca40/infrastructure/loadtesting/terraform/osquery_perf)
to reflect new steps
2025-10-08 15:31:37 -04:00
Victor Lyuboslavsky
91c15314b7
Updated product group parser to include tech leads and Security & compliance group. (#33849)
<!-- Add the related story/sub-task/bug number, like Resolves #123, or
remove if NA -->
**Related issue:** Resolves #33848

Verified by running the GitHub Action:

```
***"timestamp":"2025-10-05T21:10:43.408Z","level":"info","message":"Parsing product groups from /home/runner/work/fleet/fleet/handbook/company/product-groups.md"***
***"timestamp":"2025-10-05T21:10:43.409Z","level":"info","message":"Found 1 tech lead(s) in mdm group: JordanMontgomery"***
***"timestamp":"2025-10-05T21:10:43.409Z","level":"info","message":"Found 3 developer(s) in mdm group: gillespi314, ghernandez345, MagnusHJensen"***
***"timestamp":"2025-10-05T21:10:43.409Z","level":"info","message":"Found 1 tech lead(s) in orchestration group: lucasmrod"***
***"timestamp":"2025-10-05T21:10:43.410Z","level":"info","message":"Found 4 developer(s) in orchestration group: sgress454, juan-fdz-hawa, iansltx, ksykulev"***
***"timestamp":"2025-10-05T21:10:43.410Z","level":"info","message":"Found 1 tech lead(s) in software group: cdcme"***
***"timestamp":"2025-10-05T21:10:43.410Z","level":"info","message":"Found 4 developer(s) in software group: rachelelysia, jahzielv, jkatz01, mna"***
***"timestamp":"2025-10-05T21:10:43.410Z","level":"info","message":"Found 1 tech lead(s) in security-compliance group: getvictor"***
***"timestamp":"2025-10-05T21:10:43.410Z","level":"info","message":"Found 3 developer(s) in security-compliance group: dantecatalfamo, jacobshandling, mostlikelee"***
```

# Checklist for submitter

This is not a product change. Only an update to gathering engineering
metrics.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- New Features
  - Adds support for the Security & compliance group.
- Extracts and reports Tech Lead memberships, including inclusion in
overall engineering stats.
- Bug Fixes
- More reliable username parsing (handles hyphens, numbers, multi-line
cells).
- Stricter validation halts on missing sections or rows to prevent
partial/inaccurate results, with clearer error messages.
- Tests
- Expanded coverage for new groups, tech leads, error paths, and
edge-case username formats.
- Chores
  - Updated dependencies for stability and maintenance.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-10-06 13:44:18 -05:00
Victor Lyuboslavsky
0aba71bf05
Updated docker vulnerabilities slack webhooks. (#33814)
Moving Slack webhooks since g-security-compliance will be responsible
for docker image vulnerabilities.
2025-10-06 10:25:38 -05:00
Luke Heath
8dc81ecae9
Remove GitOps migrate, add migration shell script (#33680)
For #33671

---------

Co-authored-by: George Karr <georgekarrv@gmail.com>
2025-10-06 10:22:59 -05:00
Marko Lisica
02c75f516e
[Update story template] Add name for the type filter in the activity feed (#33856)
- We're adding an option to filter the activity feed on the dashboard,
and we introduced a dropdown to filter by activity type. We want to use
more human friendly names.

e.g. `edited_macos_min_version` -> "OS updates: edited macOS"

---------

Co-authored-by: Noah Talerman <47070608+noahtalerman@users.noreply.github.com>
2025-10-06 09:42:05 -04:00
Lucas Manuel Rodriguez
322438e4cb
Fix docker publish failures (#33690)
Fixing https://github.com/fleetdm/fleet/actions/runs/18150944735.

- It seems that when not using the RC versions it cannot determine the
version of the github.com/fleetdm/fleet/v4 package , so it assumes it's
using `v4.0.0` thus causing alerts around our recent SAML vulnerability
(already fixed). So I'm changing it to only run on RC cuts, not every
day.
- Also adding a skip rule for a new CVE that we are not affected by.
2025-10-02 13:12:13 -03:00
Lucas Manuel Rodriguez
93bea23859
Add CVE scanning for fleetdm/wix and split out workflows (#33687)
Attempting to fix
https://github.com/fleetdm/fleet/actions/runs/18120473187/job/51564073671#step:11:38

Changes:
- The docker images are too big so they started to cause issues in
Github runners. Thus I'm splitting the one workflow into three separate
workflows, one for each image.
- While we are at it: start tracking vulnerabilities in fleetdm/wix and
fleetdm/bomutils.

New runs:
-
https://github.com/fleetdm/fleet/actions/runs/18161326970/job/51692559418
-
https://github.com/fleetdm/fleet/actions/runs/18161326953/job/51692559257
-
https://github.com/fleetdm/fleet/actions/runs/18161326952/job/51692559172
2025-10-01 19:37:22 -03:00
Allen Houchins
a5f1739a7e
Update dogfood-policy-updater-latest-macos.sh (#33615)
- Updated to v2 of the sofafeed
- Updated logic to detect last two major OS versions
2025-09-29 21:27:47 -05:00
Ian Littman
fa3da7569e
Match Fleet-maintained app update PR assignees to current software team members (#33549) 2025-09-29 09:49:08 -05:00
Noah Talerman
3d73adfc5c
User story template: Add "Usage statistics" checkbox (#33289)
Consider adding usage statistics as part of every user story. PRs
(wireframes) should be made to the JSON object in the usage statistics
guide:
https://fleetdm.com/guides/fleet-usage-statistics#what-is-included-in-usage-statistics-in-fleet



Why did this come up now? We're having to spend a lot of time to figure
out which customers to notify re breaking changes to the certificate
authorities (CAs) YAML:
https://docs.google.com/document/d/1w8_q4HyehCIoG1xDc-vD91xkBVajwbYbX_mwQWUtu9A/edit?tab=t.0
2025-09-23 18:49:46 -04:00
Lucas Manuel Rodriguez
bc14761854
Add workflow to publish go modules (#33335)
For #6994.
2025-09-23 12:03:37 -03:00
Victor Lyuboslavsky
e872f9a984
Update golangci-lint to v2.4.0 (#33251)
<!-- Add the related story/sub-task/bug number, like Resolves #123, or
remove if NA -->
**Related issue:** Resolves #33250

Waived most new failures. Planning to come back and fix some of them in
subsequent PRs.
2025-09-22 13:17:11 -05:00
Luke Heath
23a0f8148b
Update GitHub Actions workflow with permissions (#33220) 2025-09-19 11:19:04 -05:00
Scott Gress
e37aa6cf29
Updates for getting private key from AWS secrets manager (#32789)
for #31321 

# Details

Small updates from [community
PR](https://github.com/fleetdm/fleet/pull/31134):

* Updated config vars to match
[docs](https://github.com/fleetdm/fleet/blob/docs-v4.75.0/docs/Configuration/fleet-server-configuration.md#server_private_key_region)
* Added support for specifying region in config (already documented)
* Removed parsing of ARN for region
* Made retry backoff intervals a bit longer

# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [X] Changes file added for user-visible changes in `changes/`,
`orbit/changes/` or `ee/fleetd-chrome/changes`.
(already added in the community PR
[here](https://github.com/fleetdm/fleet/blob/sgress454/updates-for-private-key-in-aws-sm/changes/private-key-secrets-manager#L0-L1)

## Testing

- [X] Added/updated automated tests
- [X] QA'd all new/changed functionality manually



<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- New Features
- Added support for specifying the AWS region for server private key
retrieval from AWS Secrets Manager via server.private_key_region.

- Chores
  - Renamed configuration keys:
    - server.private_key_secret_arn → server.private_key_arn
- server.private_key_secret_sts_assume_role_arn →
server.private_key_sts_assume_role_arn
- server.private_key_secret_sts_external_id →
server.private_key_sts_external_id
  - Update your configuration to use the new keys.
- Adjusted retry backoff for Secrets Manager retrieval to improve
resilience.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-09-19 10:57:02 -05:00
Victor Lyuboslavsky
3ad3f12c17
Update PR template to link to related story/bug (#33128) 2025-09-19 07:54:38 -05:00
Lucas Manuel Rodriguez
134c74a94b
Add initial Arch Linux support (#33096)
For #32859.

We can ignore the "Dependency review" failure in
[CVE-2023-32698](https://github.com/advisories/GHSA-w7jw-q4fg-qc4c)
because we already have the rules to ignore it (we are not vulnerable).
I'm not updating nfpm to latest because it would require further changes
on all deb/rpm generation (source code breaking changes on the golang
interfaces).

---

<img width="448" height="151" alt="screenshot-2025-09-11_08-38-20"
src="https://github.com/user-attachments/assets/4c00b960-568a-48d9-8098-308c8ab8916f"
/>
<img width="391" height="73" alt="screenshot-2025-09-11_08-37-40"
src="https://github.com/user-attachments/assets/dec6ea22-31f8-4930-b067-0b04b4ec2b5f"
/>

<img width="759" height="428" alt="Image"
src="https://github.com/user-attachments/assets/0a76d070-4709-4a35-8e6e-caf869473d28"
/>
<img width="1178" height="634" alt="Image"
src="https://github.com/user-attachments/assets/98e6fa2a-ba07-4a55-81aa-ad747f1c57b9"
/>
<img width="1388" height="830" alt="Image"
src="https://github.com/user-attachments/assets/19d36bad-d01d-4130-b271-38bea2534833"
/>
<img width="933" height="930" alt="Image"
src="https://github.com/user-attachments/assets/1d6a369b-65d7-46a4-98a6-e6f0b29be2c8"
/>
<img width="2241" height="693" alt="Image"
src="https://github.com/user-attachments/assets/d8f98e97-f027-4c1c-ae5d-c4fa3b592a20"
/>

- [X] Changes file added for user-visible changes in `changes/`,
`orbit/changes/` or `ee/fleetd-chrome/changes`.
See [Changes
files](https://github.com/fleetdm/fleet/blob/main/docs/Contributing/guides/committing-changes.md#changes-files)
for more information.

## Testing

- [x] Added/updated automated tests
- [X] QA'd all new/changed functionality manually
2025-09-18 18:55:31 -03:00
Sharon Katz
83fb73a5a8
Add a checkbox for premium dev (#33043) 2025-09-17 09:33:58 -05:00
Allen Houchins
072bba770e
Update dogfood-policy-updater-latest-macos.sh (#33037)
- Updated formatting of auto-generated pull requests
2025-09-16 11:09:19 -05:00
Allen Houchins
2e3aa58c42
Update dogfood-policy-updater-latest-macos.sh (#33034)
- Fixed script logic to not look for latest by using n-1 (ex: macOS 26 to macOS 26-1 or 25) but rather sorting results in descending order.
2025-09-16 09:08:01 -05:00
Allen Houchins
2586ebe39e
Update dogfood-policy-updater-latest-macos.sh (#33023)
- Updated script to account for macOS n-1.
2025-09-16 08:51:17 -05:00
Allen Houchins
fccdd8c152
Clean up "Compliance exclusions" references (#32969)
- https://github.com/fleetdm/fleet/issues/32633
2025-09-15 13:38:20 -05:00
Allen Houchins
fcdef439ab
Create testing-and-qa.yml (#32954)
- https://github.com/fleetdm/fleet/issues/32633
2025-09-14 20:37:59 -05:00
Luke Heath
e9d8d92704
Add trailing slash to S3_URI (#32958) 2025-09-13 14:10:09 -05:00
Jonathan Katz
bff25fe13d
Add jkatz01 and remove mostlikelee to fma updates (#32939) 2025-09-12 16:56:57 -04:00
Luke Heath
a3e0e9d4a9
Remove updates workflow (#32908) 2025-09-12 09:12:19 -05:00
Ian Littman
197c14f722
Add smoke test item, QA considerations for testing Fleet Desktop with Fleet Free (#32805) 2025-09-10 13:53:51 -05:00
Anthony Maxwell
0c62ef105f
Bugfix: YAML Migration Tool Build Job Binary and Hash File Name (#32735)
# Overview

[For non-Windows binaries you end up with a literal `false` in the
artifact
name](https://github.com/fleetdm/fleet/actions/runs/17557881094/job/49866625368#step:9:20).

---------

Signed-off-by: Illbjorn <am@hades.so>
2025-09-08 14:23:33 -04:00
Anthony Maxwell
288ea58bce
Feat: GitOps YAML Migration Tool (#32237)
# Overview

This pull request resolves #31165, implementing command-line tooling to
migrate GitOps YAML files following the [changes introduced in the
upcoming 4.74
release](https://github.com/fleetdm/fleet/pull/32237/files#diff-8769f6e90e8bdf15faad8f390fdf3ffb6fd2238b7d6087d83518c21464109119R7).

Aligning with the recommended steps in the `README`; [this is an example
of the first step](https://github.com/Illbjorn/fleet/pull/3/files)
(`gitops-migrate format`) and [this is an example of the second
step](https://github.com/Illbjorn/fleet/pull/4/files) (`gitops-migrate
migrate`).

---------

Signed-off-by: Illbjorn <am@hades.so>
Co-authored-by: Ian Littman <iansltx@gmail.com>
2025-09-08 12:42:25 -04:00
Jordan Montgomery
596fb70399
Update Makefile swift dialog versions and add github workflow (#32511)
For #31675
For #32099 

Adds a Github workflow to generate our packaged build of Swift
Dialog(following existing Nudge packager), updates the version to 2.5.6
and modifies the Migration dialog to render properly with the new Swift
Dialog version(it previously rendered it just didn't format as expected
due to changes in the markdown formatter)

Makefile changes are necessary not only because of the version bump but
because the latest package includes xattrs for some strange reason.
Extracting it verbatim on a system(at least with our Go implementation)
creates files that cause Gatekeeper to stop execution of swift dialog.

# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [x] Changes file added for user-visible changes in `changes/`,
`orbit/changes/` or `ee/fleetd-chrome/changes`.
See [Changes
files](https://github.com/fleetdm/fleet/blob/main/docs/Contributing/guides/committing-changes.md#changes-files)
for more information.

- [x] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)
- [x] If paths of existing endpoints are modified without backwards
compatibility, checked the frontend/CLI for any necessary changes

## Testing

- [x] QA'd all new/changed functionality manually

## fleetd/orbit/Fleet Desktop

- [x] Verified compatibility with the latest released version of Fleet
(see [Must
rule](https://github.com/fleetdm/fleet/blob/main/docs/Contributing/workflows/fleetd-development-and-release-strategy.md))
- [x] If the change applies to only one platform, confirmed that
`runtime.GOOS` is used as needed to isolate changes
- [x] Verified that fleetd runs on macOS, Linux and Windows
- [x] Verified auto-update works from the released version of component
to the new version (see [tools/tuf/test](../tools/tuf/test/README.md))
2025-09-05 10:49:21 -04:00
Lucas Manuel Rodriguez
ea42ef3cee
Add slack notification to TUF signature job when it fails (#32452)
We got the following warning today:

<img width="1311" height="200" alt="Screenshot 2025-08-29 at 9 51 52 AM"
src="https://github.com/user-attachments/assets/a62ab52d-fe89-4b96-9082-f1a91d6e8b08"
/>

The process for updating the signature which happens every Tuesday
failed, and nobody realized it failed because we missed adding a Slack
notification to it.
2025-09-03 16:17:53 -03:00
Luke Heath
7bfd47276a
Pin action versions used in script diff workflow (#32416)
Resolves security scanner alert.
2025-08-28 14:38:45 -05:00
Victor Lyuboslavsky
1d9131a602
Improve integration workflow robustness with health checks and detailed enrollment logging. (#32348)
Fixes #32347

# Checklist for submitter

## Testing

- [x] QA'd all new/changed functionality manually


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- New Features
- Added health checks and elapsed-time logging during server startup and
host enrollment in the integration workflow.
- Bug Fixes
- Reduced flakiness by adding bounded login retries and server readiness
verification before proceeding.
- Tests
- Periodic diagnostics for host enrollment status to aid visibility
during runs.
- Chores
- Increased server startup timeout from 10 to 15 minutes in the
integration workflow.
  - Minor workflow formatting cleanups for consistency.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-08-27 14:52:48 -05:00
Tim Lee
1cf71a251d
Fix FMA update PR name filter (#32338) 2025-08-27 13:45:04 -05:00
Tim Lee
8920c76cc7
Enable assignees for automated FMA PR creation (#32327) 2025-08-26 15:33:24 -05:00
Juan Fernandez
583c95c7b9
Added missing permissions required for code-sign-windows (#32281)
For #32007.

Added missing attestation permission requirements.
2025-08-25 17:08:36 -04:00
Carlo
8bc8d01f0a
Merge Android datastore into main Fleet datastore (#32233)
Resolves #31218
2025-08-25 11:41:28 -04:00
Lucas Manuel Rodriguez
6474fb39d1
Remove pull_request from check-vulnerabilities-in-released-docker-images.yml (#32234)
It triggered on a UI change, which doesn't make sense.

https://github.com/fleetdm/fleet/actions/runs/17164572704/job/48701807667?pr=32232

This should run in a schedule and manually only, not on pull requests.
2025-08-22 17:11:11 -03:00
Ian Littman
015a84046a
Split paths list in script diff GHA workflow to make the filter actually work (#32188) 2025-08-21 17:23:37 -06:00
Ian Littman
6c5d8bc2e9
Fix path filter for script diff action (#32186) 2025-08-21 17:04:37 -06:00
Tim Lee
f331effbc7
Use PAT to trigger FMA PRs (#32146) 2025-08-21 15:47:07 -06:00
Dhruv Trivedi
f03d5770ee
feat: add CI workflow to automatically check and report script changes in maintained apps (#32006) 2025-08-20 13:09:24 -06:00
Jorge Falcon
fc94901cac
Dogfood & Dogfood Free - Terraform deprecation fixes (#32101)
Added support to allow terraform plan (dry-run) without apply for
dogfood deployment action

Updated infrastructure/dogfood/terraform/aws-tf-module/docker/main.tf
- Allow hashicorp/aws `>= 5.68.0` instead of `~> 5.0`

Updated infrastructure/dogfood/terraform/aws-tf-module/main.tf
- Updated occurences of `data.aws_region.current.id` ->
`data.aws_region.current.region`
- Updated occurences of `data.aws_region.current.name` ->
`data.aws_region.current.region`
- Allow hashicorp/aws `>= 5.68.0` instead of `~> 5.0`
- `tf-mod-root-v1.15.2` -> `tf-mod-root-v1.17.0`
- `tf-mod-addon-migrations-v2.0.1` -> `tf-mod-addon-migrations-v2.1.0`
- `tf-mod-addon-osquery-carve-v1.1.0` ->
`tf-mod-addon-osquery-carve-v1.1.1`
- `tf-mod-addon-logging-alb-v1.3.0` -> `tf-mod-addon-logging-alb-v1.4.0`
- `tf-mod-addon-ses-v1.3.0` -> `tf-mod-addon-ses-v1.4.0`
- `tf-mod-addon-external-vuln-scans-v2.2.1` ->
`tf-mod-addon-external-vuln-scans-v2.3.0`

Updated infrastructure/dogfood/terraform/aws-tf-module/free.tf
- Updated occurences of `data.aws_region.current.id` ->
`data.aws_region.current.region`
- Updated occurences of `data.aws_region.current.name` ->
`data.aws_region.current.region`
- `tf-mod-byo-vpc-v1.13.0` -> `tf-mod-byo-vpc-v1.18.3`
- `tf-mod-addon-ses-v1.3.0` -> `tf-mod-addon-ses-v1.4.0`
- `tf-mod-addon-migrations-v2.0.1` -> `tf-mod-addon-migrations-v2.1.0`

Updated infrastructure/dogfood/terraform/aws-tf-module/free-ecs-hosts.tf
- Updated occurences of `data.aws_region.current.name` ->
`data.aws_region.current.region`
2025-08-19 22:48:19 -04:00
Juan Fernandez
19a5298f5b
Added missing permissions (#32021)
For #32007. Added missing permissions for attestation.
2025-08-19 14:04:17 -04:00
Victor Lyuboslavsky
4e50de7193
For Go tests, always upload a success/fail status indicator so that aggregate-result works correctly. (#32065)
Fixes #31994
2025-08-18 17:23:45 -05:00
Allen Houchins
02b80eeeca
Adding configuration for Nudge testing (#31928)
In preparation for Nudge testing:
- created a label
- install policy
- install script
- pkg for assets
- configuration profile
2025-08-14 20:00:39 -05:00
Juan Fernandez
656869acf2
SLSA attestation updates (#31833)
For #26382

- Attested the signed Windows Orbit binary instead of the unsigned one.
- For both Fleet desktop and Osquery for macOS and Windows artifacts,
attested the binaries inside archives.
2025-08-14 14:52:16 -04:00
Lucas Manuel Rodriguez
1382365f8c
Release osqueryd 5.19.0 (#31912) 2025-08-14 14:47:22 -03:00