Commit graph

2864 commits

Author SHA1 Message Date
Haojun Liao
43dc95869f fix(stream):set the initialized value. 2024-07-17 19:41:06 +08:00
54liuyao
113cb57326 adj stream operator result 2024-07-17 19:35:35 +08:00
Haojun Liao
0b6a49ac7d fix(stream): fix error and do some internal refactor. 2024-07-17 19:17:53 +08:00
Haojun Liao
9bdc65ceb1 fix(stream):fix syntax error. 2024-07-17 18:57:29 +08:00
Haojun Liao
b35d107bf9 refactor: check return value for each function. 2024-07-17 18:55:04 +08:00
Haojun Liao
2b00d6549d refactor: check return value for each function. 2024-07-17 17:57:08 +08:00
factosea
aee48971de fix: taoshash put 2024-07-17 17:52:29 +08:00
Haojun Liao
0100bb51b9 other: merge 3.0 2024-07-17 17:36:49 +08:00
Haojun Liao
2aa4d6028b refactor: check return value for each function. 2024-07-17 16:56:36 +08:00
Haojun Liao
30186f466b refactor: check return value for each function. 2024-07-17 16:47:56 +08:00
Haojun Liao
552e59f42b refactor: check return value for each function. 2024-07-17 15:40:00 +08:00
Hongze Cheng
35606a5658 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-3 2024-07-17 13:07:07 +08:00
Haojun Liao
53ed030967 Merge branch '3.0' into fix/3_liaohj 2024-07-17 11:25:19 +08:00
Haojun Liao
395b437fec Merge branch '3.0' into fix/create_tb 2024-07-17 10:24:20 +08:00
Haojun Liao
5057749790 fix(stream): fix race condition for dispatch msg. 2024-07-17 10:22:49 +08:00
Haojun Liao
9aadc5e4ac fix(stream): fix race condition for dispatch msg. 2024-07-17 10:18:58 +08:00
Haojun Liao
665fbd6f22
Merge pull request #26551 from taosdata/fix/TD-30967
feat: adj result of function
2024-07-17 09:09:23 +08:00
Hongze Cheng
64363627fe enh: refact tqueue code 2024-07-16 17:30:32 +08:00
Haojun Liao
691c1dfa7d fix(stream): check dst stable schema before generating auto create table. 2024-07-16 14:45:09 +08:00
54liuyao
29381075c5 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30967 2024-07-16 08:54:12 +08:00
Haojun Liao
25f5c9dc5e other: merge 3.0 2024-07-15 19:41:54 +08:00
Haojun Liao
51e9723d66 refactor: do some refactor. 2024-07-15 19:37:52 +08:00
Haojun Liao
a46b7b3a41 fix(stream): adjust the time to free task backend. 2024-07-15 19:19:58 +08:00
54liuyao
b5ccc3db92 adj stream function result 2024-07-15 18:19:05 +08:00
54liuyao
3cdb957f22 adj function of stream operator result 2024-07-15 15:32:11 +08:00
dapan1121
4951ed9fa7
Merge pull request #26552 from taosdata/fix/TD-30966.0
fix: validate function return value
2024-07-15 14:59:47 +08:00
Haojun Liao
a886351298 fix(stream): update checkpoint into different dir. 2024-07-15 14:52:28 +08:00
54liuyao
4efd774ce8 adj stream function return 2024-07-15 14:32:31 +08:00
Haojun Liao
c4cde6f268 fix(stream): mark the timer launched by which checkpoint procedure. 2024-07-15 14:23:33 +08:00
54liuyao
33f873b8ec Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-07-15 13:42:45 +08:00
54liuyao
9b067d075f adj stream function return 2024-07-15 13:38:34 +08:00
54liuyao
3b914248a5 adj bloomfilter 2024-07-12 15:52:54 +08:00
54liuyao
5b982354e1 adj bloomfilter 2024-07-12 15:30:03 +08:00
dapan1121
e527f2fd0b fix: validate function return value 2024-07-12 15:22:39 +08:00
Haojun Liao
f424460a0c other: merge 3.0 2024-07-12 15:17:06 +08:00
Haojun Liao
8b269ca955 refactor: do some internal refactor. 2024-07-12 15:12:43 +08:00
Haojun Liao
58b44de576
Merge pull request #26526 from taosdata/fix/3_liaohj
fix(stream):commit the update of table meta.
2024-07-12 15:11:51 +08:00
Haojun Liao
93c06be262 fix(stream): free checkpoint trigger block in case of redundant trigger block recved. 2024-07-11 17:03:21 +08:00
Haojun Liao
15573efbbc fix(stream):commit the update of table meta. 2024-07-11 14:57:40 +08:00
Haojun Liao
e273173d20
Merge pull request #26499 from taosdata/fix/3_liaohj
fix(stream): fix race-condition during expand stream tasks.
2024-07-11 00:06:57 +08:00
Haojun Liao
60fa674be8 fix(stream): fix race-condition during expand stream tasks. 2024-07-10 17:46:33 +08:00
54liuyao
dcb8673063 set key for session window state 2024-07-10 09:01:39 +08:00
Hongze Cheng
0fcc57b52a
Merge pull request #26439 from taosdata/enh/TD-30442
Enh/TD-30442
2024-07-09 18:04:34 +08:00
Yihao Deng
41f8553d53 refactor code 2024-07-09 08:35:04 +00:00
Yihao Deng
ee09e26f47 refactor code 2024-07-09 08:24:30 +00:00
Haojun Liao
773f70a907 fix(stream): fix syntax error. 2024-07-09 15:55:56 +08:00
Haojun Liao
c71413c2aa fix(stream): discard the repeat send consensus-checkpointId msg. 2024-07-09 14:52:15 +08:00
Haojun Liao
acde36a25b Merge branch '3.0' into fix/3_liaohj 2024-07-09 14:43:35 +08:00
Haojun Liao
bdced636b3 fix(stream): free task state when stopping stream tasks. 2024-07-08 18:20:35 +08:00
Haojun Liao
de7e25f259 fix(stream): fix race condition in handling the hbMsg rsp. 2024-07-08 16:57:13 +08:00
Haojun Liao
7cfdf0c14d fix(stream): not check the total number of sub tasks with different status. 2024-07-08 15:43:29 +08:00
Yihao Deng
982fed581d fix invalid read 2024-07-08 07:34:06 +00:00
Haojun Liao
6e15c16cf7 fix(stream): check the set consensus-checkpointId ts. 2024-07-08 14:33:28 +08:00
Haojun Liao
ce4153b6fc fix(stream): use hb to send the consens-checkpointid req. 2024-07-08 09:05:33 +08:00
Yihao Deng
8cbe534f93 fix invalid read 2024-07-07 06:04:59 +00:00
Haojun Liao
8e6bb176c2 fix(stream): use trans to set the consensus-checkpoint id 2024-07-05 16:17:20 +08:00
Yihao Deng
3202776f0a Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-05 07:31:57 +00:00
Yihao Deng
4ac897be44 refactor backend 2024-07-05 06:51:13 +00:00
Yihao Deng
52a8082622 refactor backend 2024-07-05 03:40:19 +00:00
Yihao Deng
f9679feaa7 fix compile error 2024-07-05 02:42:22 +00:00
Yihao Deng
f8c7908611 fix compile error 2024-07-05 02:29:55 +00:00
Haojun Liao
db4a00c74e fix(stream): not restart for reset task status. 2024-07-05 08:55:40 +08:00
Yihao Deng
94a480292f Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-05 00:48:41 +00:00
Yihao Deng
0cdfae3a2c refactor backend 2024-07-04 12:13:17 +00:00
Haojun Liao
799f61c2db other: fix coverity issue. 2024-07-04 19:20:07 +08:00
Yihao Deng
92ab689c46 refactor backend 2024-07-04 10:26:58 +00:00
Yihao Deng
8428a5be37 refactor backend 2024-07-04 10:25:37 +00:00
Haojun Liao
998421e5ad fix(stream): update some logs. 2024-07-04 17:49:59 +08:00
Haojun Liao
e6defda0d0 fix(stream): check for checkpoint interrpution in sendReady monitor. 2024-07-04 17:48:58 +08:00
Haojun Liao
c35c634977 fix(stream): add flag to disable the concurrently started consensus-checkpointId procedure. 2024-07-04 17:08:32 +08:00
Yihao Deng
7171b6dd6d fix comment 2024-07-04 08:34:42 +00:00
Yihao Deng
5b1dddf4d5 fix comment 2024-07-04 08:14:50 +00:00
Yihao Deng
eb1a5e3cc6 fix comment 2024-07-04 08:05:51 +00:00
Haojun Liao
47b0a0464e fix(stream): send checkpoint-source-rsp to mnode before reset task status. 2024-07-04 15:21:16 +08:00
Yihao Deng
ea01f1eb85 fix comment 2024-07-04 06:38:14 +00:00
Yihao Deng
0bd51f2133 fix comment 2024-07-04 06:36:36 +00:00
Haojun Liao
653f7a1a43 fix(stream): refactor the checkpoint consensus policy. 2024-07-04 13:55:50 +08:00
Yihao Deng
95469124f8 fix stream restart crash 2024-07-03 06:47:52 +00:00
Yihao Deng
471580ec5e Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-02 08:26:10 +00:00
Yihao Deng
ca1562a990 add self check 2024-07-02 08:23:56 +00:00
Haojun Liao
4e56b6f9eb fix(stream): fix error in pause/resume procedure. 2024-07-02 13:33:31 +08:00
Haojun Liao
2c86e3940f fix(stream): fix memory leak. 2024-07-01 17:43:10 +08:00
Haojun Liao
c166c8de70 fix(stream): fix memory leak. 2024-07-01 16:53:43 +08:00
Haojun Liao
6d64d0e081 fix(stream): fix memory leak. 2024-07-01 15:34:04 +08:00
Haojun Liao
3ae8916384 fix(stream): add more check for checkpoint info update for leader. 2024-07-01 14:59:55 +08:00
Haojun Liao
f09be802ea other: merge 3.0 2024-07-01 13:32:30 +08:00
Haojun Liao
5c002e4bbe fix(stream):set the srcTaskId for checkpoint-trigger block 2024-07-01 08:55:38 +08:00
Haojun Liao
398a1b08ac fix(stream): set the correct rsp msg start position. 2024-07-01 08:55:04 +08:00
Yihao Deng
7290920c6f add self check 2024-06-29 04:35:54 +00:00
Yihao Deng
f023e7780c add self check 2024-06-29 04:33:14 +00:00
Haojun Liao
1f8991ec91 fix(stream): set the correct rsp msg position. 2024-06-29 00:40:57 +08:00
Haojun Liao
e74b8473f1 fix(stream): clear the active checkpoint info after report to mnode. 2024-06-28 23:40:05 +08:00
Haojun Liao
5585a141d5 fix(stream): set the failed id before clear the checkpoint info. 2024-06-28 23:16:03 +08:00
Haojun Liao
1ffec769b8 fix(stream): clear the msgId if send success, and handle the race condition problem. 2024-06-28 17:03:14 +08:00
Haojun Liao
79be59d20c fix(stream): reset the status before re-send data. 2024-06-28 16:27:31 +08:00
Haojun Liao
67f483430e fix(stream): reset the status before re-send data. 2024-06-28 16:25:59 +08:00
Yihao Deng
bf656ec80f fix merge conflict 2024-06-28 08:23:09 +00:00
Yihao Deng
2e59284388 add self check 2024-06-28 08:14:34 +00:00
Yihao Deng
2ae54486b5 add self check 2024-06-28 07:01:45 +00:00
Yihao Deng
8fe57c1669 add self check 2024-06-28 03:08:02 +00:00
Yihao Deng
51e4abe256 add self check 2024-06-28 02:58:30 +00:00
Haojun Liao
025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao
48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Yihao Deng
de77ce6480 add self check 2024-06-27 09:51:49 +00:00
Hongze Cheng
5e235b50fa
Merge pull request #26295 from taosdata/fix/TD-30720
fix(streamMeta): commit tdb after load tasks
2024-06-27 14:04:02 +08:00
Yihao Deng
1004ac6924 add self check 2024-06-27 05:28:17 +00:00
Yihao Deng
7c328f0cfa add self check 2024-06-27 05:28:06 +00:00
Yihao Deng
f2fc09cd02 add self check 2024-06-27 01:48:59 +00:00
Yihao Deng
0a35d7ef6b add self check 2024-06-27 01:33:25 +00:00
Haojun Liao
a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
Minglei Jin
3014c66965 fix(streamMeta): commit tdb after load tasks 2024-06-26 11:21:31 +08:00
Hongze Cheng
b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao
b6948dcc4e refactor: do some internal refactor. 2024-06-26 10:19:45 +08:00
Haojun Liao
1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Yihao Deng
ac351c5b58 add self check info 2024-06-26 01:26:39 +00:00
Yihao Deng
061648071e add self check info 2024-06-25 12:35:25 +00:00
Yihao Deng
49ba8132c0 add self check info 2024-06-25 12:04:10 +00:00
54liuyao
25b150af10 fix(stream):fill result immediately after delete data 2024-06-25 17:24:59 +08:00
Haojun Liao
c2ad0a6ec5
Revert "fix(stream):fill result immediately after delete data" 2024-06-25 16:53:32 +08:00
Haojun Liao
156e3ce109
Merge pull request #26267 from taosdata/fix/TD-30585
fix(stream):fill result immediately after delete data
2024-06-25 16:46:52 +08:00
Yihao Deng
33aef6ddc5 add self check info 2024-06-25 07:12:09 +00:00
Haojun Liao
195469f1dd fix(stream): disable the checkpoint-info-update for tasks in non-checkpoint status 2024-06-25 12:57:50 +08:00
Yihao Deng
7cab27110a add self check info 2024-06-24 12:26:10 +00:00
54liuyao
a4211efacf calc end key 2024-06-24 19:19:15 +08:00
Haojun Liao
6b0b65527f fix(stream): do update the checkpoint info if not in checkpoint status. 2024-06-24 19:18:31 +08:00
Haojun Liao
bd8c7d8c93 fix(stream): pause not stop the start procedure of stream tasks. 2024-06-24 13:25:48 +08:00
54liuyao
2d7d144ca2 fix(stream):fill dresultimmediately after delete data 2024-06-24 10:56:26 +08:00
Haojun Liao
393369fcd8 fix(stream):clear checkpoint-ready msg. 2024-06-23 00:40:12 +08:00
Haojun Liao
21e1763ff4 fix(stream): set correct flag for checkpoint. 2024-06-22 11:16:20 +08:00
Haojun Liao
095510ba41 fix(stream): fix deadlock 2024-06-21 23:43:25 +08:00
Haojun Liao
94f3c6ec2d fix(stream): fix deadlock 2024-06-21 23:40:03 +08:00
Haojun Liao
82febd30a0 fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:48:34 +08:00
Haojun Liao
5a9500055d fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:44:54 +08:00
Haojun Liao
5966b4f83f fix(stream): fix error in assert. 2024-06-21 17:17:39 +08:00
Haojun Liao
4c4bb0a2e4 other: merge 3.0. 2024-06-21 16:11:50 +08:00
Haojun Liao
53f9af06ff fix(stream): fix invalid write. 2024-06-21 15:44:38 +08:00
Haojun Liao
119001e30b fix(stream): update the retrieve checkpoint-trigger msg. 2024-06-21 15:11:48 +08:00
Haojun Liao
e7105edaa4 fix(stream): disable pause if task is un-init. 2024-06-21 14:14:44 +08:00
Haojun Liao
aea4254d40 fix(stream): async start task. 2024-06-21 10:37:06 +08:00
Haojun Liao
f8578b4a69 fix(stream): fix syntax error. 2024-06-21 09:34:18 +08:00
Haojun Liao
ebf2df965c
Update streamBackendRocksdb.c 2024-06-21 09:28:42 +08:00
Haojun Liao
2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Haojun Liao
8fd9baf6f5 fix(stream):synchronized upload checkpoint data to snode. 2024-06-21 09:11:16 +08:00
Haojun Liao
bf16c596a6 fix(stream): fix syntax error. 2024-06-21 08:46:09 +08:00
Haojun Liao
096ba251ec Merge branch '3.0' into fix/3_liaohj 2024-06-20 23:12:18 +08:00
Haojun Liao
2ecc725b1a fix(stream): not clear check downstream info. 2024-06-20 21:31:23 +08:00
Haojun Liao
151fc212b8
Merge pull request #26218 from taosdata/fix/3_liaohj
fix(stream): clear the local backend default directory
2024-06-20 18:26:28 +08:00
Haojun Liao
e1cb4e021f fix(stream): clear the local backend default directory, when no checkpoint generated yet. 2024-06-20 16:24:02 +08:00
54liuyao
0471afb840 adj sream tbname cache 2024-06-20 13:25:36 +08:00
54liuyao
1b317ae578 adj sream tbname cache 2024-06-20 11:06:09 +08:00