Commit graph

289 commits

Author SHA1 Message Date
Matej Bačo
3932b8bdc1 Merge branch '1.7.x' into feat-sites 2025-02-19 12:54:05 +01:00
Chirag Aggarwal
235a357ca3 chore: initialized queueForWebhooks in worker init 2025-02-18 11:37:36 +00:00
Damodar Lohani
f2fc45da02 fix format 2025-02-11 09:46:00 +00:00
Damodar Lohani
940f4d12af Remove usage and usage dump in favor of stats-usage and stats-usage-dump 2025-02-11 07:52:37 +00:00
Chirag Aggarwal
375f643214 refactor: triggering realtime events with queueForRealtime 2025-02-11 03:29:32 +00:00
Matej Bačo
7ac83d7a9f Merge branch '1.6.x' into feat-sites 2025-02-06 14:23:50 +01:00
Damodar Lohani
cf66bee925 Merge remote-tracking branch 'origin/1.6.x' into feat-logs-db 2025-02-05 09:49:11 +00:00
Fabian Gruber
a16f26d378 feat: add AMQP queues 2025-02-05 10:29:33 +01:00
Matej Bačo
f9430d4d20 Merge branch '1.6.x' into fix-site-tests 2025-02-03 10:05:30 +01:00
Damodar Lohani
71c265d4e8 fix wrong comment 2025-01-30 07:12:15 +00:00
Damodar Lohani
d31a358392 Temp: everything to be removed 2025-01-30 07:07:10 +00:00
Damodar Lohani
cb31e7954e refactor rename 2025-01-30 04:53:53 +00:00
Damodar Lohani
0da3f870f9 refactor: rename 2025-01-30 04:43:16 +00:00
Damodar Lohani
187ea93f81 Get logs db resource 2025-01-27 02:26:06 +00:00
Jake Barnby
1cd7c397de
Revert "Fix dead connections" 2025-01-13 19:24:58 +13:00
Christy Jacob
cde1d6e83e
Merge pull request #9190 from appwrite/fix-dead-connections
Fix dead connections
# Conflicts:
#	composer.lock
2025-01-13 18:03:40 +13:00
Jake Barnby
b88d9c51fb
Revert "Fix dead connections" 2025-01-10 20:19:34 +13:00
Jake Barnby
71b892132b
Mark connections as unhealthy on lost connection error from DB 2025-01-08 18:39:06 +13:00
Jake Barnby
2c04ace022
Add connection for project 2025-01-08 18:38:24 +13:00
Christy Jacob
25953732ab fix: deletes worker abuse retention type 2024-12-23 01:30:20 +05:30
Christy Jacob
50601bd454 chore: use redis adapter for abuse 2024-12-20 20:14:50 +05:30
Christy Jacob
b97dea7996
Revert "chore: initial commit" 2024-12-19 20:27:54 +05:30
Christy Jacob
d0f04126f3 chore: add missing resources to workers 2024-12-18 19:59:49 +05:30
Christy Jacob
75b42e134a chore: replace occurrences of dbForConsole to dbForPlatform 2024-12-12 14:30:26 +04:00
Fabian Gruber
f0b6c729c9 feat: add more tags to sentry 2024-11-26 16:13:55 +01:00
Fabian Gruber
98984a8085 refactor: use single adapter 2024-11-26 13:54:52 +01:00
Christy Jacob
f490d4edaf
Merge pull request #8797 from appwrite/feat-migration
Feat migration
# Conflicts:
#	composer.lock
2024-11-21 14:08:20 +13:00
Matej Bačo
c8cf645414 Merge branch '1.6.x' into feat-sites 2024-11-20 12:07:13 +01:00
Khushboo Verma
2ad0428727 Merge 1.6.x into feat-sites 2024-11-13 13:18:21 +05:30
Bradley Schofield
54db5655a1 Run Linter 2024-11-13 13:42:49 +09:00
Bradley Schofield
91cc0e627a Address Comments 2024-11-13 10:29:43 +09:00
Fabian Gruber
4313162b5e fix(blocks): check if resource is blocked inside functions worker 2024-10-25 13:25:54 +02:00
Khushboo Verma
4240089d41 Add create deployment endpoint 2024-10-22 19:45:49 +02:00
Jake Barnby
8bc37026cd
Revert "Feat adding coroutines" 2024-10-08 20:54:40 +13:00
Binyamin Yawitz
16835f96bf
chore: merge 2024-10-07 11:02:18 -04:00
fogelito
a408cd3b57 set setResource project 2024-10-02 14:36:09 +03:00
fogelito
c3b186b3f9 set setResource project 2024-10-02 14:32:56 +03:00
fogelito
e1a772fd3e Merge branch '1.6.x' of https://github.com/appwrite/appwrite into migrations-backups 2024-10-01 21:45:10 +03:00
Binyamin Yawitz
d14edf4207
reverting: to set coroutines as head 2024-10-01 10:30:47 -04:00
fogelito
54f55f65f4 deletes-worker-set-project 2024-10-01 17:17:36 +03:00
Damodar Lohani
d4b480b014
catch error pushing error logs everywhere 2024-09-26 16:36:51 +05:45
Jake Barnby
e74a5cbf6e
Remove detailed trace from error logs 2024-07-09 15:15:03 +12:00
Damodar Lohani
00a633759e
Merge pull request #7936 from appwrite/feat-upgrade-platform-with-module
Use latest Platform and add Core module
2024-06-09 06:40:13 +05:45
Damodar Lohani
f44ed18b05 remove worker index 2024-06-06 08:45:15 +00:00
Jake Barnby
9e487b8ccf
Revert "Merge pull request #8237 from appwrite/revert-8193-feat-remove-random-shared-tables"
This reverts commit 930ae6ded0, reversing
changes made to 1f6417b156.
2024-06-06 20:11:19 +12:00
Christy Jacob
ff6efc2855
Revert "Feat remove random shared tables" 2024-06-06 00:11:56 +05:30
Jake Barnby
f459a5c458
Merge remote-tracking branch 'origin/refactor-usage-sn' into feat-remove-random-shared-tables
# Conflicts:
#	docker-compose.yml
2024-06-04 17:43:14 +12:00
Christy Jacob
cd5f6f58a2 Merge branch 'main' of https://github.com/appwrite/appwrite into sync-with-main 2024-05-24 12:43:56 +00:00
Jake Barnby
e19b465ce2
Move shared tables db to env var from const 2024-05-24 20:10:47 +12:00
shimon
355e2dc266 updating composer 2024-05-22 16:45:30 +03:00
shimon
7c71e44250 Merge branch 'refactor-usage-sn' of github.com:appwrite/appwrite into feat-get-env-sn 2024-05-22 16:39:42 +03:00
shimon
6639714a1b updating composer 2024-05-22 16:37:45 +03:00
shimon
6e79d33ca2 Merge branch 'main' of github.com:appwrite/appwrite into feat-worker-get-arg
 Conflicts:
	composer.lock
2024-05-22 16:01:40 +03:00
Binyamin Yawitz
ab0d6f7c19
refactor(messaging worker): Refactoring local device to worker only 2024-05-21 15:48:53 -04:00
fogelito
795b595052 Remove throw 2024-05-21 10:18:13 +03:00
Christy Jacob
10722aa736 chore: cleanup obsolete tasks and workers 2024-05-16 07:11:00 +00:00
Jake Barnby
912e3b01dc
Add clarifying comments 2024-05-07 14:07:04 +12:00
Jake Barnby
5e62007c8f
Fix dbForProject resources 2024-05-06 21:19:19 +12:00
Jake Barnby
52c52fa519
Add scheme to DSN on fail 2024-05-06 18:13:41 +12:00
shimon
27e460671b Merge branch 'main' of github.com:appwrite/appwrite into feat-worker-get-arg 2024-05-06 08:59:03 +03:00
Jake Barnby
db94070162
Use DSN for project database 2024-05-06 17:33:36 +12:00
Jake Barnby
c4deb0ba93
Allow shared tables namespace override 2024-05-03 21:30:38 +12:00
Jake Barnby
b2e956a14d
Merge remote-tracking branch 'origin/refactor-usage-sn' into feat-isolation-modes
# Conflicts:
#	.gitignore
#	app/cli.php
#	app/controllers/api/account.php
#	app/controllers/api/databases.php
#	app/controllers/api/projects.php
#	app/controllers/general.php
#	app/controllers/shared/api.php
#	app/init.php
#	app/realtime.php
#	app/worker.php
#	composer.json
#	composer.lock
#	src/Appwrite/Platform/Tasks/DeleteOrphanedProjects.php
#	src/Appwrite/Platform/Tasks/GetMigrationStats.php
#	src/Appwrite/Platform/Workers/Databases.php
#	src/Appwrite/Platform/Workers/Deletes.php
#	src/Appwrite/Platform/Workers/Hamster.php
#	tests/e2e/General/HTTPTest.php
#	tests/e2e/Services/Databases/DatabasesCustomServerTest.php
#	tests/e2e/Services/Projects/ProjectsConsoleClientTest.php
2024-04-30 19:40:47 +12:00
shimon
8588bb4555 getEnv on worker.php 2024-04-25 19:31:30 +03:00
Matej Bačo
1234770dc8 CI/CD fixes 2024-04-02 18:48:12 +02:00
Matej Bačo
d091b37a15 Merge branch 'refactor-usage-sn' into refactor-usage-sn-1.5.x 2024-04-02 18:42:17 +02:00
Eldad Fux
8ed1da4ea8 Updated getEnv to use system lib 2024-04-01 13:02:47 +02:00
Jake Barnby
664df69a5f
Fix method refs 2024-03-07 17:49:59 +01:00
Jake Barnby
8a73203635
Revert debugs 2024-03-07 14:52:13 +01:00
Jake Barnby
2bed17de35
Debug 2024-03-06 21:50:31 +01:00
Jake Barnby
3312ed1c5d
Debug 2024-03-06 21:14:55 +01:00
Torsten Dittmann
0a1d572c72 chore: run formatter 2024-03-06 18:34:21 +01:00
Jake Barnby
1b7ce8fc61
Debug 2024-03-06 10:59:05 +01:00
Torsten Dittmann
a53e630536 Merge branch 'main' of https://github.com/appwrite/appwrite into sync-main-1.5.x-2 2024-03-05 10:31:51 +01:00
Jake Barnby
74a3d6531f
Merge remote-tracking branch 'origin/refactor-usage-sn' into feat-isolation-modes
# Conflicts:
#	composer.json
#	composer.lock
#	src/Appwrite/Platform/Tasks/CalcTierStats.php
#	tests/e2e/Services/Projects/ProjectsConsoleClientTest.php
2024-03-04 19:50:10 +01:00
Jake Barnby
942847cf3a
Merge remote-tracking branch 'origin/main' into 1.5.x
# Conflicts:
#	app/config/collections.php
#	app/config/errors.php
#	app/config/specs/open-api3-latest-client.json
#	app/config/specs/open-api3-latest-console.json
#	app/config/specs/open-api3-latest-server.json
#	app/config/specs/swagger2-latest-client.json
#	app/config/specs/swagger2-latest-console.json
#	app/config/specs/swagger2-latest-server.json
#	app/controllers/api/account.php
#	app/controllers/api/teams.php
#	app/controllers/api/users.php
#	app/controllers/shared/api.php
#	app/init.php
#	app/worker.php
#	composer.json
#	composer.lock
#	docker-compose.yml
#	src/Appwrite/Extend/Exception.php
#	src/Appwrite/Platform/Services/Tasks.php
#	src/Appwrite/Platform/Tasks/Maintenance.php
#	src/Appwrite/Platform/Workers/Certificates.php
#	src/Appwrite/Platform/Workers/Deletes.php
#	src/Appwrite/Platform/Workers/Messaging.php
#	src/Appwrite/Platform/Workers/Usage.php
#	src/Appwrite/Platform/Workers/UsageHook.php
#	src/Appwrite/Specification/Format/OpenAPI3.php
#	src/Appwrite/Specification/Format/Swagger2.php
#	tests/e2e/Services/Account/AccountConsoleClientTest.php
2024-02-22 01:29:28 +13:00
Jake Barnby
379c79dae9
Consistent naming for device resources 2024-02-21 03:10:51 +13:00
Jake Barnby
2667d1fb07
Inject always local file device 2024-02-21 02:50:44 +13:00
Jake Barnby
439e7b1ccf
Merge remote-tracking branch 'origin/feat-remove-callback-resources' into feat-email-attachments
# Conflicts:
#	app/worker.php
#	src/Appwrite/Platform/Workers/Messaging.php
2024-02-21 02:00:46 +13:00
Jake Barnby
2f711c84ed
Remove callback resources from workers 2024-02-21 00:40:55 +13:00
shimon
22e7c58d7d Merge branch 'refactor-usage-sn' of github.com:appwrite/appwrite into remove-cloud-scripts 2024-02-19 17:38:13 +02:00
Jake Barnby
022c4678ec
Allow attaching files from storage to emails 2024-02-20 00:08:57 +13:00
shimon
ed4319314a Addressed comments 2024-02-15 17:15:10 +02:00
shimon
2a5f21e982 Addressed comments 2024-02-15 17:12:37 +02:00
shimon
8c44627da1 Merge branch 'main' of github.com:appwrite/appwrite into remove-cloud-scripts
 Conflicts:
	Dockerfile
	src/Appwrite/Platform/Services/Workers.php
2024-02-13 10:29:17 +02:00
Steven Nguyen
4ace8ed027
Replace catching \Exception with \Throwable
\Exception doesn't work as a catch-all because not everything extends
\Exception. For example, there was a problem where the messaging worker
didn't catch an exception here:

} catch (\Exception $e) {
    $deliveryErrors[] = 'Failed sending to targets ' . $batchIndex + 1 . '-' . \count($batch) . ' with error: ' . $e->getMessage();
} finally {

As such, $deliveryErrors stayed as an empty array. In this case, the
$adapter->send() threw a TypeError which extends Error which implements
Throwable. Updating the catch to catch \Throwable ensures the error is
caught and $deliveryErrors gets updated.
2024-02-08 01:17:54 +00:00
shimon
be829e2db4 Merge branch 'refactor-usage-sn' of github.com:appwrite/appwrite into remove-cloud-scripts
 Conflicts:
	Dockerfile
	docker-compose.yml
	src/Appwrite/Platform/Services/Tasks.php
	src/Appwrite/Platform/Services/Workers.php
	src/Appwrite/Platform/Tasks/CalcTierStats.php
	src/Appwrite/Platform/Workers/Hamster.php
2024-01-30 20:47:35 +02:00
shimon
7a2ee683e3 refactor usage poc 2024-01-28 11:28:59 +02:00
Torsten Dittmann
62e459c581 fix: workers 2024-01-24 12:29:36 +01:00
Torsten Dittmann
9f5a0312cf Merge branch 'main' of https://github.com/appwrite/appwrite into 1.5.x 2024-01-24 11:24:59 +01:00
Matej Bačo
2be504ed8a fix pool is empty webhook worker 2024-01-18 09:13:11 +00:00
shimon
6ad63b6f7b addressing comments 2024-01-17 10:44:16 +02:00
Matej Bačo
ed28bb9295 Merge remote-tracking branch 'origin/1.5.x' into feat-improve-logging 2024-01-11 10:22:50 +00:00
Matej Bačo
92c4c52a81 QA changes 2024-01-02 13:02:11 +00:00
Matej Bačo
0ba768125d Merge remote-tracking branch 'origin/1.5.x' into feat-improve-logging 2024-01-02 11:08:47 +00:00
shimon
99f1543f1b Merge branch 'main' of github.com:appwrite/appwrite into refactor-usage-sn
 Conflicts:
	.gitmodules
	Dockerfile
	app/console
	app/init.php
	composer.lock
	src/Appwrite/Platform/Services/Workers.php
	src/Appwrite/Platform/Tasks/Hamster.php
2024-01-02 11:49:23 +02:00
Jake Barnby
23b39fee02
FIx FCM tests 2023-12-17 12:41:20 +13:00
Jake Barnby
5135262b79
Merge remote-tracking branch 'origin/1.4.x' into 1.5.x
# Conflicts:
#	app/config/errors.php
#	composer.lock
2023-12-15 02:41:46 +13:00
Damodar Lohani
5c3bd741b4 fix resources 2023-12-12 11:26:14 +00:00
Damodar Lohani
d8fe96e300 set project resource 2023-12-12 11:08:14 +00:00
Damodar Lohani
104b8bb366 provide retention time as queue server resource 2023-12-12 08:07:24 +00:00
Jake Barnby
018b7c38bd
Merge remote-tracking branch 'origin/1.4.x' into feat-isolation-modes
# Conflicts:
#	src/Appwrite/Platform/Tasks/Hamster.php
2023-12-08 13:34:28 +01:00
Jake Barnby
7e12da5a2a
Use hard-coded DB name instead of project attribute 2023-11-30 16:32:15 +13:00
Jake Barnby
e109f1e008
Add metadata in worker dbs 2023-11-30 16:06:49 +13:00
Bradley Schofield
dea3e74b6a Implement Job based hamster 2023-11-28 10:19:55 +00:00
Jake Barnby
2e89113e6a
Self review 2023-11-28 00:52:46 +13:00
Jake Barnby
68548ebd47
Fix worker tenant set/reset 2023-11-28 00:27:16 +13:00
Matej Bačo
9fb6525063 Add new tags from worker, fix queue name 2023-11-22 14:50:57 +01:00
Jake Barnby
35163ff52a
Check project shareTables status when configuring databases 2023-11-23 01:13:24 +13:00
Prateek Banga
3ade88897c Merge branch 'main' of https://github.com/appwrite/appwrite into chore-sync-main-1.5.x 2023-11-10 12:49:05 +05:30
shimon
f64d0ab8a8 Merge branch '1.4.x' of github.com:appwrite/appwrite into refactor-usage-sn
 Conflicts:
	.gitmodules
	CHANGES.md
	Dockerfile
	composer.lock
	src/Appwrite/Migration/Migration.php
2023-11-05 17:03:13 +02:00
Jake Barnby
995c404f35
Update db 2023-10-26 21:24:30 +13:00
Torsten Dittmann
404ad8653d fix: worker permissions reset 2023-10-25 19:23:55 +02:00
shimon
14ac780180 workers start hook 2023-10-25 12:10:30 +03:00
shimon
9fad9dca88 usage sync 2023-10-25 10:39:59 +03:00
prateek banga
af40c63357 review changes 2023-10-20 17:02:13 +05:30
prateek banga
161bbfb822 Merge branch '1.4.x' of https://github.com/appwrite/appwrite into sync-1.4.x-to-1.5.x 2023-10-20 14:55:17 +05:30
shimon
593e5ab316 some fixes 2023-10-17 22:08:01 +03:00
shimon
3d5930c104 some fixes 2023-10-17 16:55:08 +03:00
shimon
55dfb0b034 Merge remote-tracking branch 'origin/refactor-workers-sn' into refactor-workers-sn 2023-10-17 06:44:53 +03:00
shimon
9a6d88a819 addressing some comments 2023-10-17 06:44:36 +03:00
Shimon Newman
e565557eb2
Update app/worker.php
Co-authored-by: Christy Jacob <christyjacob4@gmail.com>
2023-10-16 20:13:39 +03:00
shimon
0e2c1c1f2d small fixes 2023-10-16 16:20:41 +03:00
shimon
0c776e0a44 comparing $workersCount via worker.php vs init php 2023-10-16 11:04:44 +03:00
shimon
94178f8eaf rollback to Usage 2023-10-15 20:41:09 +03:00
shimon
66c57c9a4f Merge remote-tracking branch 'origin/refactor-workers' into refactor-workers 2023-10-12 16:34:31 +03:00
shimon
4088941f70 sync with main 2023-10-12 16:34:13 +03:00
Jake Barnby
dc580c3d0d
Change name 2023-10-12 20:15:16 +13:00
Jake Barnby
e2a8369712
Add docblock for env vars 2023-10-12 19:11:08 +13:00
Jake Barnby
effdeb4bc2
Fix env vars 2023-10-12 19:10:45 +13:00
Jake Barnby
1ac3372239
Set queue name per worker 2023-10-12 17:55:30 +13:00
Jake Barnby
096a529618
Revert "Merge branch 'feat-db-per-process' of github.com:appwrite/appwrite into feat-db-per-process"
This reverts commit 6f42305484, reversing
changes made to 69abd222e8.
2023-10-12 15:30:01 +13:00
Jake Barnby
6f42305484
Merge branch 'feat-db-per-process' of github.com:appwrite/appwrite into feat-db-per-process
# Conflicts:
#	bin/worker-databases
#	src/Appwrite/Event/Database.php
#	src/Appwrite/Platform/Workers/Databases.php
2023-10-12 15:28:52 +13:00
shimon
2cd4514086 sync with main 2023-10-11 16:03:15 +03:00
shimon
002fc19d60 tests fix 2023-10-10 21:02:24 +03:00
shimon
b02d51c794 migrations worker 2023-10-01 20:39:26 +03:00
shimon
a10246a9bd build && audit && usage workers 2023-09-28 13:45:15 +03:00
shimon
c4bd6e008e Merge branch 'master' of github.com:appwrite/appwrite into refactor-workers
 Conflicts:
	.env
	app/cli.php
	app/config/collections.php
	app/console
	app/controllers/api/account.php
	app/controllers/api/databases.php
	app/controllers/api/functions.php
	app/controllers/api/projects.php
	app/controllers/api/storage.php
	app/controllers/api/teams.php
	app/controllers/api/users.php
	app/controllers/general.php
	app/controllers/shared/api.php
	app/init.php
	app/worker.php
	app/workers/audits.php
	app/workers/builds.php
	app/workers/certificates.php
	app/workers/databases.php
	app/workers/deletes.php
	app/workers/functions.php
	app/workers/mails.php
	bin/worker-usage
	composer.json
	composer.lock
	docker-compose.yml
	src/Appwrite/Event/Delete.php
	src/Appwrite/Event/Mail.php
	src/Appwrite/Platform/Tasks/Maintenance.php
2023-09-27 18:51:17 +03:00
Jake Barnby
0a5b0fa06b
Fix functions worker crash 2023-08-23 15:08:26 -04:00
Steven Nguyen
a13b7606a2
Fix console db namespace 2023-08-21 15:53:30 -07:00
shimon
8147f3ee7d rolling back usage flow 2023-08-20 15:29:43 +03:00
shimon
d1d1392bb3 small adjustments 2023-07-12 11:12:56 +03:00
Damodar Lohani
c41dd6f67b fix logger optional 2023-07-12 07:17:40 +00:00
Damodar Lohani
d5a7e8cfed add missing resource 2023-07-11 04:39:59 +00:00
shimon
5366d90ff2 users addition 2023-07-10 11:07:54 +03:00
shimon
89f0146c45 users addition 2023-07-10 11:03:59 +03:00
Damodar Lohani
f59d3563f4 Merge remote-tracking branch 'origin/feat-db-pools-master' into feat-db-pools-db-pools-master-sync 2023-07-10 03:06:48 +00:00
shimon
57bc7d0584 functions/builds/deletes worker 2023-06-11 17:08:48 +03:00
shimon
fd4f86b1c1 functions/builds/deletes worker 2023-06-11 13:29:04 +03:00
shimon
62c619434e functions/builds/deletes worker 2023-06-05 19:13:00 +03:00