fleet/server/service
Roberto Dip a4725518ac
filter out Google Chrome profiles without an associated email before ingesting (#5440)
To add support for #400, we're using the macadmins/osquery-extension to gather Google Chrome profiles from hosts.

Under the hood, the extension looks and parses a json file in which Chrome stores a bunch of data. Given that emails are not required to create Chrome profiles, some of the profiles stored in this file and returned by the query we're using contain empty emails.

The idea after this change is to prevent empty emails from being ingested in the first place instead of filtering them after the fact. I have also included a migration to clean the rows with empty email columns.

Fixes #4780
2022-05-02 09:55:40 -03:00
..
async Add sentry (#3669) 2022-01-20 16:41:02 -03:00
externalsvc Queue jobs for Jira integration when enabled and new vulnerabilities are found. (#4975) 2022-04-11 16:42:16 -04:00
middleware Add support for downloading a list of hosts in CSV format (#4596) 2022-03-15 15:14:42 -04:00
mock Add distributed discovery query support for detail queries, add orbit… (#4597) 2022-03-15 16:51:00 -03:00
osquery_utils filter out Google Chrome profiles without an associated email before ingesting (#5440) 2022-05-02 09:55:40 -03:00
redis_policy_set Migrate team-related endpoints to new pattern (#3740) 2022-01-19 10:52:14 -05:00
testdata add endpoint to serve the kolide certificate back to the user (#1025) 2017-01-20 14:32:10 -05:00
activities.go Refactor ListActivities to new endpoint pattern (#3115) 2021-11-29 08:12:22 -05:00
activities_test.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
appconfig.go hide jira api token from the config API (#5196) 2022-04-18 17:55:51 -03:00
appconfig_test.go hide jira api token from the config API (#5196) 2022-04-18 17:55:51 -03:00
campaigns.go fleetctl query improve error message (#5141) 2022-04-20 11:35:46 -06:00
campaigns_test.go fleetctl query improve error message (#5141) 2022-04-20 11:35:46 -06:00
carves.go Add new endpoints to retrieve device information by orbit identifier (#4531) 2022-03-09 16:13:56 -05:00
carves_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
client.go Print version warning when using fleetctl (#4139) 2022-02-14 09:43:34 -07:00
client_appconfig.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_carves.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_debug.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
client_errors.go Error early if email already exists (#4363) 2022-02-28 09:34:44 -03:00
client_hosts.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_labels.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_live_query.go Unversion the /setup endpoint, version the websocket endpoint (#5104) 2022-04-20 15:57:26 -04:00
client_live_query_test.go Unversion the /setup endpoint, version the websocket endpoint (#5104) 2022-04-20 15:57:26 -04:00
client_packs.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_policies.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_queries.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_sessions.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_setup.go fleetctl preview to use v1 setup path, to support previous versions of fleet (#5331) 2022-04-25 10:02:21 -03:00
client_software.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_targets.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_teams.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
client_users.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
debug_handler.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
debug_handler_test.go Add fleetctl debug migrations command to get missing migrations (#2967) 2021-11-22 14:06:12 -03:00
devices.go Refactor authz skip for device auth, add org_logo_url for frontend (#4619) 2022-03-16 10:15:25 -04:00
endpoint_campaigns.go Unversion the /setup endpoint, version the websocket endpoint (#5104) 2022-04-20 15:57:26 -04:00
endpoint_middleware.go Refactor authz skip for device auth, add org_logo_url for frontend (#4619) 2022-03-16 10:15:25 -04:00
endpoint_middleware_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
endpoint_setup.go Add read replica testing helpers and fix non-sso login bug (#4908) 2022-04-04 16:52:05 -07:00
endpoint_utils.go Unversion the /setup endpoint, version the websocket endpoint (#5104) 2022-04-20 15:57:26 -04:00
endpoint_utils_test.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
frontend.go Add v4 suffix in go.mod (#1224) 2021-06-25 21:46:51 -07:00
global_policies.go Allow updating the policy platform (part 1 of the ticket) (#4311) 2022-02-22 13:42:03 -05:00
global_policies_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
global_schedule.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
global_schedule_test.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
handler.go Unversion the /setup endpoint, version the websocket endpoint (#5104) 2022-04-20 15:57:26 -04:00
handler_test.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
hosts.go Update os version aggregated stats for all teams (#5083) 2022-04-18 16:19:58 -05:00
hosts_test.go Remove unused Datastore.SaveHost and unused Modified fields (#5245) 2022-04-26 18:33:29 -03:00
http_auth.go Remove unused request-id in context (#3632) 2022-01-13 14:12:56 -08:00
http_auth_test.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
http_publicip.go Add public ip to hosts & derive geolocation when rendering host (#4652) 2022-03-21 12:29:52 -04:00
integration_core_test.go Collect last_opened_at for macOS software, and return it in host details payload (#5376) 2022-04-26 14:16:59 -04:00
integration_ds_only_test.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
integration_enterprise_test.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
integration_live_queries_test.go fleetctl query improve error message (#5141) 2022-04-20 11:35:46 -06:00
integration_logger_test.go Introduce API version 2022-04, deprecate use of /global in paths (#4731) 2022-04-05 11:35:53 -04:00
integration_sso_test.go Fix SSO paths to always use /v1/ instead of /latest/ (#5246) 2022-04-20 12:46:45 -04:00
invites.go Fix update invite email conflict (#4751) 2022-03-28 09:38:57 -06:00
invites_test.go Fix update invite email conflict (#4751) 2022-03-28 09:38:57 -06:00
jitter.go Migrate special-case endpoints to new pattern (#4511) 2022-03-08 11:27:38 -05:00
jitter_test.go Migrate special-case endpoints to new pattern (#4511) 2022-03-08 11:27:38 -05:00
labels.go Migrate labels endpoints to new pattern (#3354) 2021-12-21 09:53:15 -05:00
labels_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
live_queries.go Shorten "simple" query API period to 25s (#3775) 2022-01-19 17:48:57 -08:00
mem_failing_policies_set_test.go Fix failing policy sets for redis cluster mode (#3725) 2022-01-17 15:16:54 -05:00
metrics.go Issue 1362 fleetctl user roles (#1397) 2021-07-16 15:28:13 -03:00
metrics_appconfig.go Refactor app config (POC, for now) (#1685) 2021-08-20 12:27:41 -03:00
metrics_change_email.go Update go-kit to 0.4.0 (#1411) 2017-03-15 08:55:30 -07:00
metrics_invites.go Add v4 suffix in go.mod (#1224) 2021-06-25 21:46:51 -07:00
metrics_labels.go Add v4 suffix in go.mod (#1224) 2021-06-25 21:46:51 -07:00
metrics_sessions.go Add read replica testing helpers and fix non-sso login bug (#4908) 2022-04-04 16:52:05 -07:00
metrics_users.go Add v4 suffix in go.mod (#1224) 2021-06-25 21:46:51 -07:00
osquery.go Add team failing policies webhook (#4633) 2022-03-21 13:16:47 -06:00
osquery_test.go Remove unused Datastore.SaveHost and unused Modified fields (#5245) 2022-04-26 18:33:29 -03:00
packs.go Return 400 when trying to create packs, queries and policies with empty names (#3761) 2022-01-19 16:07:58 -03:00
packs_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
queries.go apply queries spec endpoint missing authorization check (#4068) 2022-02-08 09:47:48 -07:00
queries_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
scheduled_queries.go Improved Datastore usage of osquery hosts requests (#3601) 2022-01-17 22:52:09 -03:00
scheduled_queries_test.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
service.go Add public ip to hosts & derive geolocation when rendering host (#4652) 2022-03-21 12:29:52 -04:00
service_appconfig.go Return the new recent_vulnerability_max_age config in the REST API config payload (#5107) 2022-04-13 12:05:57 -04:00
service_appconfig_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
service_campaign_test.go Remove unused Datastore.SaveHost and unused Modified fields (#5245) 2022-04-26 18:33:29 -03:00
service_campaigns.go Add read replica testing helpers and fix non-sso login bug (#4908) 2022-04-04 16:52:05 -07:00
service_errors.go Error early if email already exists (#4363) 2022-02-28 09:34:44 -03:00
service_users.go Migrate special-case endpoints to new pattern (#4511) 2022-03-08 11:27:38 -05:00
sessions.go Fix SSO paths to always use /v1/ instead of /latest/ (#5246) 2022-04-20 12:46:45 -04:00
sessions_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
software.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
software_test.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
status.go Migrate the last batch of authenticatedUser endpoints to the new pattern (#4210) 2022-02-15 15:22:19 -05:00
targets.go Add team failing policies webhook (#4633) 2022-03-21 13:16:47 -06:00
targets_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
team_policies.go Allow updating the policy platform (part 1 of the ticket) (#4311) 2022-02-22 13:42:03 -05:00
team_policies_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
team_schedule.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
team_schedule_test.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
teams.go feat(api): add endpoint to get team by id (#4018) 2022-02-04 14:33:22 -03:00
teams_test.go Add missing error checking to test config setup (#4401) 2022-03-11 12:51:12 -03:00
testing_client.go Fix race condition in tests when using global var loginRateLimit (#5197) 2022-04-19 10:35:53 -03:00
testing_utils.go Fix race condition in tests when using global var loginRateLimit (#5197) 2022-04-19 10:35:53 -03:00
translator.go Migrate special-case endpoints to new pattern (#4511) 2022-03-08 11:27:38 -05:00
transport.go Add support for downloading a list of hosts in CSV format (#4596) 2022-03-15 15:14:42 -04:00
transport_error.go Add support for downloading a list of hosts in CSV format (#4596) 2022-03-15 15:14:42 -04:00
transport_error_test.go Create errors with ctxerr, add the call to store them in redis (#2786) 2021-11-15 09:11:38 -05:00
transport_setup.go Update go-kit to 0.4.0 (#1411) 2017-03-15 08:55:30 -07:00
transport_test.go Add v4 suffix in go.mod (#1224) 2021-06-25 21:46:51 -07:00
user_roles.go Migrate special-case endpoints to new pattern (#4511) 2022-03-08 11:27:38 -05:00
users.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
users_test.go Merge pull request from GHSA-pr2g-j78h-84cr 2022-04-18 10:27:30 -07:00
validation_setup.go Use new error handling approach in other packages (#2954) 2021-11-22 09:13:26 -05:00