106 commits

Author	SHA1	Message	Date
Haojun Liao	4846194bbb	refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node.	2023-09-16 21:37:30 +08:00
Haojun Liao	2bfd6e3355	refactor: do some internal refactor.	2023-09-15 09:25:22 +08:00
Haojun Liao	b240e91c91	enh(stream): add token bucket to limit the rate of sink operation.	2023-09-07 09:58:48 +08:00
Haojun Liao	3fc3dafca6	refactor: do some internal refactor.	2023-08-31 13:46:48 +08:00
Haojun Liao	e53b5d4392	refactor: do some internal refactor.	2023-08-31 11:01:53 +08:00
yihaoDeng	8ed2836a2b	refactor code	2023-08-29 09:52:03 +08:00
yihaoDeng	a2901411b0	refactor code	2023-08-28 18:52:10 +08:00
yihaoDeng	0959758bd5	fix transfer error	2023-08-23 21:43:10 +08:00
Haojun Liao	b0c5fa8290	fix(stream): reset the task status.	2023-08-23 14:10:41 +08:00
Haojun Liao	c26d625152	Merge branch '3.0' into enh/triggerCheckPoint2	2023-08-18 15:51:07 +08:00
Haojun Liao	edbad45772	other: add logs.	2023-08-18 13:45:08 +08:00
Haojun Liao	bb4f8515bd	fix(stream): pause when outputQ is blocked.	2023-08-17 11:53:17 +08:00
Haojun Liao	ea6574b3c7	other: merge 3.0	2023-08-17 00:07:55 +08:00
Haojun Liao	0d38f389ab	refactor: do some internal refactor.	2023-08-13 16:25:35 +08:00
Haojun Liao	03c26a9d6d	refactor	2023-08-12 19:16:20 +08:00
Haojun Liao	30c2a9c619	refactor: do some internal refactor.	2023-08-12 18:27:51 +08:00
Haojun Liao	8a11a0418f	other: merge 3.0	2023-08-07 09:19:26 +08:00
Haojun Liao	d45596bb33	fix(stream): kill task when pause the stream execution.	2023-07-31 18:07:37 +08:00
Haojun Liao	8dfef8768a	other: merge 3.0	2023-07-29 22:54:16 +08:00
Haojun Liao	1e34f84f78	other: merge 3.0	2023-07-24 15:23:03 +08:00
Haojun Liao	f4864b8713	fix(stream): fix memory leak.	2023-07-22 01:02:58 +08:00
Haojun Liao	16d7707b90	fix(stream): align the scan real time data for stream task.	2023-07-21 19:33:43 +08:00
yihaoDeng	aad669e33c	add checkpoint	2023-07-14 14:46:13 +00:00
Haojun Liao	2b85ea62aa	refactor: do some internal refactor.	2023-07-14 17:48:47 +08:00
Haojun Liao	eb7e6152ae	refactor(stream): do some internal refactor.	2023-07-14 17:21:20 +08:00
Haojun Liao	08a4fb06ae	fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.	2023-07-13 09:17:20 +08:00
Haojun Liao	d392bb60ba	refactor(stream): set the initial version from the checkpoint.	2023-07-12 11:38:13 +08:00
Haojun Liao	a049e310f6	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-12 10:16:26 +08:00
Haojun Liao	6f2fc4fab3	fix(stream): commit task meta after do vnode-wide checkpoint.	2023-07-12 10:16:14 +08:00
yihaoDeng	e547ed3699	rm expire checkpoint	2023-07-11 16:30:14 +08:00
Haojun Liao	87bedef2cd	fix(stream): fix error in checkpointing.	2023-07-10 19:20:05 +08:00
Haojun Liao	a5c19427e7	fix(stream): send correct rsp to mnode.	2023-07-08 09:39:44 +08:00
Haojun Liao	47877898d0	enh(stream): generate the checkpoint framework.	2023-07-07 16:07:52 +08:00
Haojun Liao	d7101f7109	enh(stream): support dispatch checkpoint msg.	2023-07-06 18:26:22 +08:00
Haojun Liao	5a9461a69a	other: merge 3.0	2023-07-06 11:52:21 +08:00
Haojun Liao	f4a3567935	other: merge 3.0	2023-07-06 11:24:30 +08:00
Haojun Liao	03dbcbf055	refactor: do some internal refactor.	2023-07-05 15:55:55 +08:00
yihaoDeng	7d30a6e27a	vnode snapshot read	2023-06-30 11:48:46 +00:00
yihaoDeng	5ccfae87d9	add checkpoint	2023-06-19 20:49:04 +08:00
yihaoDeng	548e439aa2	add checkpoint	2023-06-19 20:48:49 +08:00
yihaoDeng	0ef8afbdaa	support fill history	2023-06-16 09:32:38 +08:00
yihaoDeng	9f9171719a	support fill history	2023-06-15 21:29:52 +08:00
Yihao Deng	7ded6fc7a2	Merge branch '3.0' into enh/triggerCheckPoint2	2023-06-14 16:30:38 +08:00
Haojun Liao	11f0c3b336	refactor: do some internal refactor.	2023-06-14 10:46:46 +08:00
Haojun Liao	53246ed6bb	other: merge other branch.	2023-06-09 09:41:10 +08:00
yihaoDeng	d5c0ca3163	opt batch write	2023-06-08 13:36:52 +00:00
yihaoDeng	9828ca9d7f	add trigger checkpoint	2023-06-08 09:28:34 +00:00
Haojun Liao	cb26dd9fa2	refactor(stream): do some internal refactor.	2023-06-08 10:17:21 +08:00
Haojun Liao	06cf3588da	refactor: do some internal refactor.	2023-06-07 15:03:04 +08:00
Haojun Liao	6a3c935b4a	fix(stream): fix error in fill history scan.	2023-06-07 09:15:55 +08:00