Commit graph

310 commits

Author SHA1 Message Date
Simon Guan
b74b038f4f Merge branch '3.0' into merge/mainto3.0 2025-03-04 11:32:29 +08:00
Simon Guan
6826edf5e0 Merge branch 'main' into merge/mainto3.0 2025-03-03 14:01:43 +08:00
Haojun Liao
a71f414d97 refactor(stream): stop all tasks before drop vnodes. 2025-03-02 02:06:14 +08:00
Haojun Liao
3e55f8edfe fix(stream): follower nodes not restart tasks. 2025-02-28 13:54:26 +08:00
Simon Guan
b91dd10846 enh: add log level to each log entry 2025-02-27 09:55:11 +08:00
Haojun Liao
f1c4d2734f fix(stream): follower nodes not restart tasks. 2025-02-23 10:43:56 +08:00
Shengliang Guan
2bee60a41a Merge branch 'main' into merge/mainto3.0 2025-02-20 18:12:02 +08:00
Haojun Liao
6766e6db53 refactor(stream): add checkpoint queue to handle chkpt. 2025-02-20 16:13:33 +08:00
54liuyao
870fe1c071 fix(tsma):drop invalid state for tsma 2025-02-20 11:52:04 +08:00
Jinqing Kuang
fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
54liuyao
f6500b3551 ci(test):delete invalid code&& add ci 2024-12-26 11:16:02 +08:00
54liuyao
f452ca47fe delete window state when drop table 2024-11-08 09:42:56 +08:00
54liuyao
ba31bf2c52 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-11-06 09:42:50 +08:00
Haojun Liao
9bae0adba6 fix(stream): start scheduler task after set the refId. 2024-10-29 19:14:37 +08:00
Haojun Liao
4802f59dfe fix(stream): use the refId in stream meta list, in order to avoid access already freed stream tasks. 2024-10-27 15:49:40 +08:00
54liuyao
a62b5a3efd fix issue 2024-10-17 14:55:07 +08:00
54liuyao
3e49f40c74 stream twa 2024-10-16 12:16:59 +08:00
54liuyao
df8cfa65c2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-27 11:37:37 +08:00
Hongze Cheng
0e1ef424fa remove more void 2024-09-26 11:27:01 +08:00
Hongze Cheng
53caf9f018 ehn: remove void 2024-09-26 10:43:16 +08:00
Haojun Liao
e1d8e98b11 feat(stream): support the force_window_close trigger. 2024-09-19 16:23:51 +08:00
54liuyao
9d8e8892b4 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-08-30 16:04:09 +08:00
Hongze Cheng
f4916211ca enh: clear more asserts 2024-08-26 16:56:48 +08:00
54liuyao
bdaf0d419e stream interp force window close 2024-08-06 16:14:15 +08:00
54liuyao
063b492f72 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-07-30 15:13:15 +08:00
Hongze Cheng
cc10d70e5e enh: refactor return code 2024-07-29 13:54:50 +08:00
54liuyao
b5f432bd50 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-07-26 16:44:18 +08:00
Hongze Cheng
69fa2a187a enh: refactor return code 2024-07-24 13:58:17 +08:00
Yihao Deng
b3ce1c8411 Merge remote-tracking branch 'origin/3.0' into enh/refactErrCodeRsync 2024-07-20 09:19:45 +00:00
Yihao Deng
e20a972b7f refactor rsync 2024-07-18 08:45:58 +00:00
Haojun Liao
30186f466b refactor: check return value for each function. 2024-07-17 16:47:56 +08:00
Haojun Liao
552e59f42b refactor: check return value for each function. 2024-07-17 15:40:00 +08:00
54liuyao
6c84d926ab Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-07-12 11:04:44 +08:00
54liuyao
1c9011e820 stream time slice 2024-07-12 11:03:45 +08:00
Haojun Liao
647f9f47ef refactor: do some internal refactor. 2024-07-08 10:32:23 +08:00
Haojun Liao
8e6bb176c2 fix(stream): use trans to set the consensus-checkpoint id 2024-07-05 16:17:20 +08:00
Haojun Liao
653f7a1a43 fix(stream): refactor the checkpoint consensus policy. 2024-07-04 13:55:50 +08:00
Haojun Liao
025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao
48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Hongze Cheng
b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao
1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Haojun Liao
2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Haojun Liao
c4a2756907 fix(stream): not revise the stream id for fill-history task. 2024-06-17 23:13:54 +08:00
Haojun Liao
42e0dff589 fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already. 2024-06-14 17:03:04 +08:00
Haojun Liao
cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao
ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Haojun Liao
d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
Haojun Liao
6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao
3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
Haojun Liao
7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Haojun Liao
732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao
ea527b19b8 fix(stream): set correct start version if no checkpoint exist. 2024-04-19 19:12:23 +08:00
Haojun Liao
665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
Haojun Liao
d799212fb2 refactor: do some internal refactor. 2024-04-12 10:02:18 +08:00
Haojun Liao
f23a8a37bc refactor: do some internal refactor. 2024-04-10 16:43:02 +08:00
Haojun Liao
aee0460daf enh(stream):rsp the checkpoint ready msg. 2024-02-27 11:15:09 +08:00
Haojun Liao
dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
Haojun Liao
b361eb4a7c fix(stream): add hb rsp handle function for vnode and snode. 2024-02-21 15:16:07 +08:00
Haojun Liao
46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023
stream count window
2024-02-20 08:50:25 +08:00
Haojun Liao
a3b04c3c58 fix(stream): set the processVer for streamTask when initializing the task object. 2024-02-19 14:50:09 +08:00
54liuyao
ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
54liuyao
d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
Haojun Liao
ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao
5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
54liuyao
3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
Haojun Liao
80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
Haojun Liao
f6c0649108 fix(stream): fix syntax error. 2024-01-11 09:53:19 +08:00
Haojun Liao
bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
wangmm0220
df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Haojun Liao
29219ba9f4 fix(stream): add task number check. 2024-01-07 01:32:50 +08:00
Haojun Liao
0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
Haojun Liao
6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao
0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao
b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
yihaoDeng
913fda4a36 fix snode crash 2023-12-21 18:52:25 +08:00
Haojun Liao
92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
Haojun Liao
fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
Haojun Liao
ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao
ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
yihaoDeng
87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
54liuyao
271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
54liuyao
ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
yihaoDeng
08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
wangmm0220
70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng
6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
wangmm0220
15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
wangmm0220
6dc91d12d5 fix:add msg type 2023-11-22 20:23:58 +08:00
wangmm0220
cfab06239b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-22 19:37:44 +08:00
wangmm0220
9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao
9a4222e189
Merge pull request #23767 from taosdata/fix/TD-27414
fix:test case for windows
2023-11-22 11:02:08 +08:00
yihaoDeng
0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
wangmm0220
b3ca673fe9 fix:test case for windows 2023-11-21 14:35:41 +08:00
wangmm0220
3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00
yihaoDeng
20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
wangmm0220
a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
wangmm0220
a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
wangmm0220
45782f278b fix:send update msg to vnodes if snode restart 2023-11-15 18:13:35 +08:00
wangmm0220
8a9ded764d fix:add finish history msg to snode 2023-11-15 11:50:14 +08:00
wangmm0220
6a44bd54ac fix:load task in snode 2023-11-13 09:12:15 +08:00
wangmm0220
8a05bad899 fix:snode error 2023-11-10 14:14:22 +08:00