fleet/server/datastore/mysql
Roberto Dip a4725518ac
filter out Google Chrome profiles without an associated email before ingesting (#5440)
To add support for #400, we're using the macadmins/osquery-extension to gather Google Chrome profiles from hosts.

Under the hood, the extension looks and parses a json file in which Chrome stores a bunch of data. Given that emails are not required to create Chrome profiles, some of the profiles stored in this file and returned by the query we're using contain empty emails.

The idea after this change is to prevent empty emails from being ingested in the first place instead of filtering them after the fact. I have also included a migration to clean the rows with empty email columns.

Fixes #4780
2022-05-02 09:55:40 -03:00
..
migrations filter out Google Chrome profiles without an associated email before ingesting (#5440) 2022-05-02 09:55:40 -03:00
activities.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
activities_test.go Improve performance of the Go test suite (#2060) 2021-09-20 14:09:38 -04:00
aggregated_stats.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
aggregated_stats_test.go Replace uses of ansi quotes (") in SQL statements (#4726) 2022-04-11 11:47:50 -07:00
app_configs.go Migrate special-case endpoints to new pattern (#4511) 2022-03-08 11:27:38 -05:00
app_configs_test.go Add enable scheduled query stats to fleet config (#4066) 2022-02-09 08:20:29 -03:00
campaigns.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
campaigns_test.go Improve performance of the Go test suite (#2060) 2021-09-20 14:09:38 -04:00
carves.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
carves_test.go Improve performance of the Go test suite (#2060) 2021-09-20 14:09:38 -04:00
config.go Add osquery.min_software_last_opened_at_diff configuration option (#5394) 2022-04-27 09:47:09 -04:00
delete.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
delete_test.go Further optimize host select with policies (#3013) 2021-11-18 14:36:35 -03:00
email_changes.go Create errors with ctxerr, add the call to store them in redis (#2786) 2021-11-15 09:11:38 -05:00
email_changes_test.go Improve performance of the Go test suite (#2060) 2021-09-20 14:09:38 -04:00
errors.go Improved Datastore usage of osquery hosts requests (#3601) 2022-01-17 22:52:09 -03:00
fulltext.go Using '@' in target search causes 422 error response (#5148) 2022-04-19 09:28:49 -04:00
fulltext_test.go Using '@' in target search causes 422 error response (#5148) 2022-04-19 09:28:49 -04:00
hosts.go Remove unused Datastore.SaveHost and unused Modified fields (#5245) 2022-04-26 18:33:29 -03:00
hosts_test.go Remove unused Datastore.SaveHost and unused Modified fields (#5245) 2022-04-26 18:33:29 -03:00
invites.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
invites_test.go Create errors with ctxerr, add the call to store them in redis (#2786) 2021-11-15 09:11:38 -05:00
jobs.go Queue jobs for Jira integration when enabled and new vulnerabilities are found. (#4975) 2022-04-11 16:42:16 -04:00
labels.go Allow updating the policy platform (part 1 of the ticket) (#4311) 2022-02-22 13:42:03 -05:00
labels_test.go Remove unused Datastore.SaveHost and unused Modified fields (#5245) 2022-04-26 18:33:29 -03:00
locks.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
locks_test.go Add team targets to pack spec (#4272) 2022-02-21 09:18:58 -07:00
migrations_test.go Do not exit on serve/prepare if there are unknown migrations (#3262) 2021-12-08 19:50:00 -03:00
mysql.go Add osquery.min_software_last_opened_at_diff configuration option (#5394) 2022-04-27 09:47:09 -04:00
mysql_test.go fix mysql tests by with a regexp assertion of possible error messages (#5444) 2022-04-29 09:31:58 -03:00
packs.go Add team targets to pack spec (#4272) 2022-02-21 09:18:58 -07:00
packs_test.go Add team targets to pack spec (#4272) 2022-02-21 09:18:58 -07:00
password_reset.go Migrate special-case endpoints to new pattern (#4511) 2022-03-08 11:27:38 -05:00
password_reset_test.go Improve performance of the Go test suite (#2060) 2021-09-20 14:09:38 -04:00
policies.go Fix typos and amend PR template (#5227) 2022-04-19 18:09:55 -03:00
policies_test.go Implement cron cleanup job of policy membership when policy platform is updated (#4331) 2022-02-23 16:10:37 -05:00
queries.go Replace uses of ansi quotes (") in SQL statements (#4726) 2022-04-11 11:47:50 -07:00
queries_test.go Add author_email to payload of queries (Get/List) (#2798) 2021-11-08 09:06:56 -05:00
scheduled_queries.go Replace uses of ansi quotes (") in SQL statements (#4726) 2022-04-11 11:47:50 -07:00
scheduled_queries_test.go Improved Datastore usage of osquery hosts requests (#3601) 2022-01-17 22:52:09 -03:00
schema.sql filter out Google Chrome profiles without an associated email before ingesting (#5440) 2022-05-02 09:55:40 -03:00
sessions.go Add read replica testing helpers and fix non-sso login bug (#4908) 2022-04-04 16:52:05 -07:00
sessions_test.go Add read replica testing helpers and fix non-sso login bug (#4908) 2022-04-04 16:52:05 -07:00
software.go Add osquery.min_software_last_opened_at_diff configuration option (#5394) 2022-04-27 09:47:09 -04:00
software_test.go Add osquery.min_software_last_opened_at_diff configuration option (#5394) 2022-04-27 09:47:09 -04:00
statistics.go Allow updating the policy platform (part 1 of the ticket) (#4311) 2022-02-22 13:42:03 -05:00
statistics_test.go Fix usage stats to send missing numLabels field (#3606) 2022-01-13 11:11:13 -06:00
targets.go Issue 3173 debug status processlist (#4009) 2022-02-03 14:56:22 -03:00
targets_test.go Remove unused Datastore.SaveHost and unused Modified fields (#5245) 2022-04-26 18:33:29 -03:00
teams.go Add team failing policies webhook (#4633) 2022-03-21 13:16:47 -06:00
teams_test.go Add team failing policies webhook (#4633) 2022-03-21 13:16:47 -06:00
testing_utils.go Support listing software hosts count filtered by team (#4388) 2022-02-28 13:55:14 -05:00
unicode_test.go Further optimize host select with policies (#3013) 2021-11-18 14:36:35 -03:00
users.go Allow updating the policy platform (part 1 of the ticket) (#4311) 2022-02-22 13:42:03 -05:00
users_test.go Add AvailableTeams to loginResponse and getUserResponse (#3585) 2022-01-13 13:57:44 -06:00