131 commits

Author	SHA1	Message	Date
Haojun Liao	8cde39eebd	fix(stream): fix dead lock when shutdown all tasks.	2023-10-24 19:11:24 +08:00
Haojun Liao	4d5d078fbe	fix(stream): fix bugs caused by refactor.	2023-10-19 18:00:54 +08:00
Haojun Liao	d5059826a8	fix(stream): fix bugs caused by refactor.	2023-10-19 17:59:04 +08:00
Haojun Liao	402aefd95d	refactor(stream): do some internal refactor.	2023-10-19 15:09:47 +08:00
Haojun Liao	f4caeca24a	refactor(stream): add state machine to manage the state of stream tasks.	2023-10-19 10:34:20 +08:00
Haojun Liao	54ec679b58	refactor(stream): do some internal refactor.	2023-10-18 15:34:53 +08:00
Haojun Liao	2904cfd4d5	Merge branch 'main' into refact/streamsm	2023-10-18 10:29:09 +08:00
Haojun Liao	64ed7e49a2	enh(stream): sm for stream tasks.	2023-10-17 13:47:55 +08:00
Haojun Liao	7b7ce10475	refactor(stream): do some internal refactor.	2023-10-17 11:23:04 +08:00
Haojun Liao	fdb6ec1fa3	enh(stream): add parameter to limit the stream sink task.	2023-10-16 22:52:39 +08:00
Haojun Liao	eb4449999f	other: merge 3.0	2023-10-12 10:33:48 +08:00
yihaoDeng	b36163a197	add session iter	2023-10-10 15:12:21 +08:00
yihaoDeng	825341d90a	add sess iter	2023-10-10 14:35:02 +08:00
Haojun Liao	7ce3d2c200	fix(stream): quit from loop when input queue is full.	2023-10-07 14:54:11 +08:00
Haojun Liao	c20dd002fb	enh(stream): add more info for sink task.	2023-10-07 01:14:00 +08:00
Haojun Liao	41ef1a45c1	enh(stream): optimize the scan wal perf	2023-10-04 22:06:46 +08:00
Haojun Liao	5718158fc0	refactor: do some internal refactor.	2023-10-01 22:27:29 +08:00
Haojun Liao	11641e1115	refactor: do some internal refactor.	2023-09-27 14:18:01 +08:00
Haojun Liao	e13efd5b04	refactor: optimize the fill-history task launch policy, and do some other internal refactor.	2023-09-27 14:00:48 +08:00
Haojun Liao	aec15ae39f	enh(stream): add quota limitation for sink task.	2023-09-26 23:29:54 +08:00
Haojun Liao	a74b462ffb	fix(stream): add new timer for each task.	2023-09-24 02:25:53 +08:00
Haojun Liao	4ea737571d	refactor: do some internal refactor.	2023-09-24 01:26:51 +08:00
Haojun Liao	898aea5cfb	refactor(stream): refactor send msg.	2023-09-22 14:52:18 +08:00
Haojun Liao	17586af0ce	refactor: do refactor the sink task.	2023-09-21 13:32:57 +08:00
Haojun Liao	6633fb971b	fix(stream): update logs.	2023-09-20 18:18:31 +08:00
Haojun Liao	4846194bbb	refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node.	2023-09-16 21:37:30 +08:00
Haojun Liao	2bfd6e3355	refactor: do some internal refactor.	2023-09-15 09:25:22 +08:00
Haojun Liao	b240e91c91	enh(stream): add token bucket to limit the rate of sink operation.	2023-09-07 09:58:48 +08:00
Haojun Liao	3fc3dafca6	refactor: do some internal refactor.	2023-08-31 13:46:48 +08:00
Haojun Liao	e53b5d4392	refactor: do some internal refactor.	2023-08-31 11:01:53 +08:00
yihaoDeng	8ed2836a2b	refactor code	2023-08-29 09:52:03 +08:00
yihaoDeng	a2901411b0	refactor code	2023-08-28 18:52:10 +08:00
yihaoDeng	0959758bd5	fix transfer error	2023-08-23 21:43:10 +08:00
Haojun Liao	b0c5fa8290	fix(stream): reset the task status.	2023-08-23 14:10:41 +08:00
Haojun Liao	c26d625152	Merge branch '3.0' into enh/triggerCheckPoint2	2023-08-18 15:51:07 +08:00
Haojun Liao	edbad45772	other: add logs.	2023-08-18 13:45:08 +08:00
Haojun Liao	bb4f8515bd	fix(stream): pause when outputQ is blocked.	2023-08-17 11:53:17 +08:00
Haojun Liao	ea6574b3c7	other: merge 3.0	2023-08-17 00:07:55 +08:00
Haojun Liao	0d38f389ab	refactor: do some internal refactor.	2023-08-13 16:25:35 +08:00
Haojun Liao	03c26a9d6d	refactor	2023-08-12 19:16:20 +08:00
Haojun Liao	30c2a9c619	refactor: do some internal refactor.	2023-08-12 18:27:51 +08:00
Haojun Liao	8a11a0418f	other: merge 3.0	2023-08-07 09:19:26 +08:00
Haojun Liao	d45596bb33	fix(stream): kill task when pause the stream execution.	2023-07-31 18:07:37 +08:00
Haojun Liao	8dfef8768a	other: merge 3.0	2023-07-29 22:54:16 +08:00
Haojun Liao	1e34f84f78	other: merge 3.0	2023-07-24 15:23:03 +08:00
Haojun Liao	f4864b8713	fix(stream): fix memory leak.	2023-07-22 01:02:58 +08:00
Haojun Liao	16d7707b90	fix(stream): align the scan real time data for stream task.	2023-07-21 19:33:43 +08:00
yihaoDeng	aad669e33c	add checkpoint	2023-07-14 14:46:13 +00:00
Haojun Liao	2b85ea62aa	refactor: do some internal refactor.	2023-07-14 17:48:47 +08:00
Haojun Liao	eb7e6152ae	refactor(stream): do some internal refactor.	2023-07-14 17:21:20 +08:00