127 commits

Author	SHA1	Message	Date
Haojun Liao	60fac80345	fix(stream): add some logs.	2024-06-17 19:34:09 +08:00
Haojun Liao	b25e6d3250	fix(stream): always return 0 for enqueuing retrieve block.	2024-06-14 14:43:27 +08:00
Haojun Liao	0f8c0fa8cb	fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.	2024-06-13 14:56:20 +08:00
Haojun Liao	d06e1549f1	fix(stream): add fill-history task id in msg.	2024-06-12 15:27:19 +08:00
Haojun Liao	9406be9aa6	fix(stream): remove invalid reset.	2024-06-11 18:58:16 +08:00
Haojun Liao	a41a04dc37	fix(stream): remove the related history task correctly.	2024-06-11 18:35:59 +08:00
Haojun Liao	cbf8b363fc	fix(stream): update checkpoint info by using trans.	2024-06-10 00:46:01 +08:00
Haojun Liao	3b3ed1c30c	fix(stream): add monitor for checkpoint-ready msg recv status.	2024-06-03 16:45:37 +08:00
Haojun Liao	2a8270f9c8	fix(stream): track the checkpoint-ready msg on the upstream tasks.	2024-06-01 18:26:45 +08:00
Haojun Liao	76b43dc072	fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request.	2024-05-31 14:32:55 +08:00
Haojun Liao	b4956392d9	fix(stream): return in_progress code if not send retrieve rsp to downstream.	2024-05-30 15:54:08 +08:00
Haojun Liao	d1d868f239	refactor: do some internal refactor and set the pActiveInfo for rsma.	2024-05-29 00:08:29 +08:00
Haojun Liao	8d54d45054	fix(stream): fix error found by CI.	2024-05-28 17:30:14 +08:00
Haojun Liao	cc318d7e2d	enh(stream): sink task does not initialize the backend.	2024-05-28 11:34:04 +08:00
Haojun Liao	be107b204c	enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes.	2024-05-28 09:54:22 +08:00
Haojun Liao	abd90c733a	fix(stream): remove backend files only after the in-memory task is dropped.	2024-05-15 14:24:35 +08:00
Haojun Liao	610aa80e65	fix(stream): init backend for fill-history task.	2024-05-15 00:08:38 +08:00
Haojun Liao	6898eba6ed	fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks.	2024-05-14 14:34:31 +08:00
Haojun Liao	3dfffe9113	fix(stream): async load and start stream tasks.	2024-05-13 15:31:26 +08:00
Haojun Liao	7f93ec2c53	fix(stream): update the checkpoint info for followers, and some internal refactor.	2024-05-11 09:37:02 +08:00
Haojun Liao	cdeb4462fb	refactor: do some internal refactor.	2024-05-07 23:43:21 +08:00
Haojun Liao	0e0f98eb8d	refactor: do some internal refactor.	2024-05-07 10:50:44 +08:00
Haojun Liao	18c66a5491	refactor: do some internal refactor.	2024-05-06 18:17:38 +08:00
Haojun Liao	7ad7ef7cfc	refactor: do some internal refactor.	2024-05-06 17:03:41 +08:00
Haojun Liao	cdc7b03ac6	fix(stream): fix syntax error.	2024-04-30 22:44:32 +08:00
Haojun Liao	629502e12e	refactor: do some internal refactor.	2024-04-30 17:00:51 +08:00
Haojun Liao	bf5d523116	fix(stream): disable the exec of complete check status in timer thread.	2024-04-28 17:57:34 +08:00
Haojun Liao	77961ea791	fix(stream): handle disorder node Update trans Id.	2024-04-26 09:45:42 +08:00
Haojun Liao	eef5e6e409	fix(stream): fix syntax error.	2024-04-25 18:30:33 +08:00
Haojun Liao	3b932599ab	fix(stream): fix syntax error.	2024-04-25 17:47:03 +08:00
Haojun Liao	cd8baa7ba0	fix(stream): add log for update task epset, set correct update flag if epset updated.	2024-04-25 16:39:11 +08:00
Haojun Liao	0c7373509e	fix(stream): add task update trans conflict level.	2024-04-23 18:07:00 +08:00
Haojun Liao	1adf59e7d8	fix(stream): do check when task is paused, and do some internal refactor.	2024-04-23 13:53:23 +08:00
Haojun Liao	315b86cf66	fix(stream): save the epset if task epset updated.	2024-04-22 23:52:45 +08:00
Haojun Liao	a8fac441be	fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.	2024-04-22 14:02:31 +08:00
Haojun Liao	ea527b19b8	fix(stream): set correct start version if no checkpoint exist.	2024-04-19 19:12:23 +08:00
Haojun Liao	815d12fd77	fix(stream): set check downstream completed for sink task.	2024-04-18 18:36:02 +08:00
Haojun Liao	4802cd1ddf	Merge branch '3.0' into fix/3_liaohj	2024-04-18 17:53:30 +08:00
Haojun Liao	ac84a5f82b	refactor: do some internal refactor.	2024-04-17 21:57:09 +08:00
Haojun Liao	289ec6cf66	fix(stream): reset checkpoint info after receiving task-reset info.	2024-04-17 17:57:12 +08:00
Yihao Deng	354f33fa88	drop stream data	2024-04-17 05:38:45 +00:00
Yihao Deng	74b7bf6bbc	drop stream data	2024-04-17 05:37:35 +00:00
Haojun Liao	15c18af221	fix(stream): fix init error.	2024-04-13 18:27:38 +08:00
Haojun Liao	d799212fb2	refactor: do some internal refactor.	2024-04-12 10:02:18 +08:00
Haojun Liao	f23a8a37bc	refactor: do some internal refactor.	2024-04-10 16:43:02 +08:00
Haojun Liao	24559725da	fix(stream): add lock for when set checkpoint dispatch msg.	2024-04-02 18:45:30 +08:00
54liuyao	3835e0c156	open operator after resume stream	2024-03-12 16:35:55 +08:00
Haojun Liao	4d10f28a00	Merge pull request #24999 from taosdata/fix/nullcheck ... fix(stream): remove related fill-history if task in stop status.	2024-03-05 09:15:21 +08:00
Haojun Liao	2ac803bf3c	fix(stream): clear and set task status.	2024-03-04 22:16:41 +08:00
Haojun Liao	80fd3e0445	fix(stream): remove related fill-history if task in stop status.	2024-03-04 19:31:47 +08:00