Commit graph

2864 commits

Author SHA1 Message Date
Yihao Deng
51e4abe256 add self check 2024-06-28 02:58:30 +00:00
Haojun Liao
025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao
48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Yihao Deng
de77ce6480 add self check 2024-06-27 09:51:49 +00:00
Hongze Cheng
5e235b50fa
Merge pull request #26295 from taosdata/fix/TD-30720
fix(streamMeta): commit tdb after load tasks
2024-06-27 14:04:02 +08:00
Yihao Deng
1004ac6924 add self check 2024-06-27 05:28:17 +00:00
Yihao Deng
7c328f0cfa add self check 2024-06-27 05:28:06 +00:00
Yihao Deng
f2fc09cd02 add self check 2024-06-27 01:48:59 +00:00
Yihao Deng
0a35d7ef6b add self check 2024-06-27 01:33:25 +00:00
Haojun Liao
a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
Minglei Jin
3014c66965 fix(streamMeta): commit tdb after load tasks 2024-06-26 11:21:31 +08:00
Hongze Cheng
b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao
b6948dcc4e refactor: do some internal refactor. 2024-06-26 10:19:45 +08:00
Haojun Liao
1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Yihao Deng
ac351c5b58 add self check info 2024-06-26 01:26:39 +00:00
Yihao Deng
061648071e add self check info 2024-06-25 12:35:25 +00:00
Yihao Deng
49ba8132c0 add self check info 2024-06-25 12:04:10 +00:00
54liuyao
25b150af10 fix(stream):fill result immediately after delete data 2024-06-25 17:24:59 +08:00
Haojun Liao
c2ad0a6ec5
Revert "fix(stream):fill result immediately after delete data" 2024-06-25 16:53:32 +08:00
Haojun Liao
156e3ce109
Merge pull request #26267 from taosdata/fix/TD-30585
fix(stream):fill result immediately after delete data
2024-06-25 16:46:52 +08:00
Yihao Deng
33aef6ddc5 add self check info 2024-06-25 07:12:09 +00:00
Haojun Liao
195469f1dd fix(stream): disable the checkpoint-info-update for tasks in non-checkpoint status 2024-06-25 12:57:50 +08:00
Yihao Deng
7cab27110a add self check info 2024-06-24 12:26:10 +00:00
54liuyao
a4211efacf calc end key 2024-06-24 19:19:15 +08:00
Haojun Liao
6b0b65527f fix(stream): do update the checkpoint info if not in checkpoint status. 2024-06-24 19:18:31 +08:00
Haojun Liao
bd8c7d8c93 fix(stream): pause not stop the start procedure of stream tasks. 2024-06-24 13:25:48 +08:00
54liuyao
2d7d144ca2 fix(stream):fill dresultimmediately after delete data 2024-06-24 10:56:26 +08:00
Haojun Liao
393369fcd8 fix(stream):clear checkpoint-ready msg. 2024-06-23 00:40:12 +08:00
Haojun Liao
21e1763ff4 fix(stream): set correct flag for checkpoint. 2024-06-22 11:16:20 +08:00
Haojun Liao
095510ba41 fix(stream): fix deadlock 2024-06-21 23:43:25 +08:00
Haojun Liao
94f3c6ec2d fix(stream): fix deadlock 2024-06-21 23:40:03 +08:00
Haojun Liao
82febd30a0 fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:48:34 +08:00
Haojun Liao
5a9500055d fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:44:54 +08:00
Haojun Liao
5966b4f83f fix(stream): fix error in assert. 2024-06-21 17:17:39 +08:00
Haojun Liao
4c4bb0a2e4 other: merge 3.0. 2024-06-21 16:11:50 +08:00
Haojun Liao
53f9af06ff fix(stream): fix invalid write. 2024-06-21 15:44:38 +08:00
Haojun Liao
119001e30b fix(stream): update the retrieve checkpoint-trigger msg. 2024-06-21 15:11:48 +08:00
Haojun Liao
e7105edaa4 fix(stream): disable pause if task is un-init. 2024-06-21 14:14:44 +08:00
Haojun Liao
aea4254d40 fix(stream): async start task. 2024-06-21 10:37:06 +08:00
Haojun Liao
f8578b4a69 fix(stream): fix syntax error. 2024-06-21 09:34:18 +08:00
Haojun Liao
ebf2df965c
Update streamBackendRocksdb.c 2024-06-21 09:28:42 +08:00
Haojun Liao
2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Haojun Liao
8fd9baf6f5 fix(stream):synchronized upload checkpoint data to snode. 2024-06-21 09:11:16 +08:00
Haojun Liao
bf16c596a6 fix(stream): fix syntax error. 2024-06-21 08:46:09 +08:00
Haojun Liao
096ba251ec Merge branch '3.0' into fix/3_liaohj 2024-06-20 23:12:18 +08:00
Haojun Liao
2ecc725b1a fix(stream): not clear check downstream info. 2024-06-20 21:31:23 +08:00
Haojun Liao
151fc212b8
Merge pull request #26218 from taosdata/fix/3_liaohj
fix(stream): clear the local backend default directory
2024-06-20 18:26:28 +08:00
Haojun Liao
e1cb4e021f fix(stream): clear the local backend default directory, when no checkpoint generated yet. 2024-06-20 16:24:02 +08:00
54liuyao
0471afb840 adj sream tbname cache 2024-06-20 13:25:36 +08:00
54liuyao
1b317ae578 adj sream tbname cache 2024-06-20 11:06:09 +08:00
54liuyao
6a3bbccda9 adj par tbname cache 2024-06-20 10:23:44 +08:00
54liuyao
ecfb5e5f4c adj par name catch 2024-06-20 09:28:04 +08:00
Haojun Liao
da63a40796
Merge pull request #26188 from taosdata/fix/3_liaohj
fix(stream): fix a typo.
2024-06-19 14:58:21 +08:00
Haojun Liao
2534ce5071 fix(stream): fix a typo. 2024-06-19 10:29:01 +08:00
54liuyao
3ba7bc8ec5 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-06-18 08:41:10 +08:00
Haojun Liao
c3ae66c95c
Merge pull request #26169 from taosdata/fix/3_liaohj
fix(stream): not revise the stream id for fill-history task.
2024-06-18 08:38:29 +08:00
Haojun Liao
bca3cf4e9e fix(stream): fix error in unit test. 2024-06-17 23:51:25 +08:00
Haojun Liao
c4a2756907 fix(stream): not revise the stream id for fill-history task. 2024-06-17 23:13:54 +08:00
Haojun Liao
f57ff96408 fix(stream): do some refactor. 2024-06-17 19:56:18 +08:00
Haojun Liao
60fac80345 fix(stream): add some logs. 2024-06-17 19:34:09 +08:00
54liuyao
00c64ed0e3 adj create count window state 2024-06-17 19:33:01 +08:00
Haojun Liao
0f4ffdf49a fix(stream): add some info. 2024-06-17 18:57:31 +08:00
Haojun Liao
bdbcdf3465 refactor: add two assert. 2024-06-17 16:58:58 +08:00
Haojun Liao
848b1e19b5 fix(stream): fix some typo. 2024-06-17 14:39:46 +08:00
Haojun Liao
b89b2158f1
Merge pull request #26135 from taosdata/fix/TD-30578
check cursor for count window
2024-06-17 11:25:19 +08:00
54liuyao
4474788e36 adj log 2024-06-17 11:24:30 +08:00
54liuyao
2298b4eae8 adj log 2024-06-17 11:19:10 +08:00
Haojun Liao
b44d87475d fix(test): fix syntax error. 2024-06-14 17:54:44 +08:00
Haojun Liao
42e0dff589 fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already. 2024-06-14 17:03:04 +08:00
Haojun Liao
4490f40c96 fix(stream): do some internal refactor. 2024-06-14 14:43:57 +08:00
Haojun Liao
9af6076b4f fix(stream): add the dispatch entry. 2024-06-14 14:42:22 +08:00
Haojun Liao
325ad5beb8 fix(stream):set correct node id 2024-06-13 18:25:34 +08:00
54liuyao
367b3b153f check cursor for count window 2024-06-13 15:35:26 +08:00
Haojun Liao
0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
Haojun Liao
9c42c90209
Merge pull request #26118 from taosdata/fix/3_liaohj
fix(stream): add fill-history task id in msg.
2024-06-12 18:03:43 +08:00
Haojun Liao
d06e1549f1 fix(stream): add fill-history task id in msg. 2024-06-12 15:27:19 +08:00
Haojun Liao
623a73f57b
Merge pull request #26089 from taosdata/fix/3_liaohj
fix(stream): init the node list and task list when starting mnode.
2024-06-12 11:34:10 +08:00
Haojun Liao
a41a04dc37 fix(stream): remove the related history task correctly. 2024-06-11 18:35:59 +08:00
Haojun Liao
00eb621825 fix(stream): do scan checkpoint-report in write queue. 2024-06-11 14:09:50 +08:00
Haojun Liao
20bade24c3
Merge branch '3.0' into fix/3_liaohj 2024-06-10 01:34:55 +08:00
Haojun Liao
cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao
895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
Haojun Liao
cbd9f86a34
Merge pull request #26065 from taosdata/fix/3_liaohj
fix(stream): always load the data for fill-history scan.
2024-06-07 14:01:50 +08:00
Haojun Liao
c4447d6873 fix(stream): flush executor state for those with only one task for a stream. 2024-06-07 12:44:38 +08:00
Haojun Liao
1e47cb7eba other: update the test case. 2024-06-07 11:15:23 +08:00
Haojun Liao
385e1a8b0d refactor: do some internal refactor. 2024-06-06 23:55:54 +08:00
Haojun Liao
88e77d6bc6 fix(stream): remove expired stream in buf. 2024-06-06 23:54:48 +08:00
Haojun Liao
420cbc36e5 other: fix syntax error. 2024-06-06 17:40:17 +08:00
Haojun Liao
52e090634e fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks. 2024-06-06 17:21:23 +08:00
Haojun Liao
29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao
c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-06-05 13:38:51 +08:00
Haojun Liao
bf9a5135fb fix(stream): disable timer for checkpoint-ready msg in rsma. 2024-06-05 00:13:57 +08:00
Haojun Liao
4fc21cc8b0 refactor: do some internal refactor. 2024-06-04 10:08:18 +08:00
Haojun Liao
407f79cfa6 fix(stream): fix dead-lock. 2024-06-03 19:14:45 +08:00
Haojun Liao
3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
54liuyao
ca7e1344e1 adj stream count state buff 2024-06-03 15:22:12 +08:00
Haojun Liao
31317c4895 fix(stream): set the checkpoint ready info for only one task in stream. 2024-06-01 23:20:43 +08:00
Haojun Liao
2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
Haojun Liao
76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao
ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Haojun Liao
0946f25e5f fix(stream): fix syntax error. 2024-05-29 22:36:22 +08:00
Haojun Liao
becc4cb368 enh(stream): limit the concurrent started checkpoint tasks. 2024-05-29 19:29:26 +08:00
Haojun Liao
46ca55ac74 fix(stream): avoid deadlock. 2024-05-29 15:20:35 +08:00
Haojun Liao
27ac6ca16e fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-29 14:12:14 +08:00
Haojun Liao
09efbad117 fix(stream): drop related fill history task. 2024-05-29 11:16:26 +08:00
Haojun Liao
a9abe78eab other: comment invalid sleep for test purpose 2024-05-29 09:16:37 +08:00
Haojun Liao
225dfb1a93 enh(stream): check checkpoint-trigger msg every 100ms. 2024-05-29 00:30:42 +08:00
Haojun Liao
d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
Haojun Liao
8d54d45054 fix(stream): fix error found by CI. 2024-05-28 17:30:14 +08:00
Haojun Liao
cc318d7e2d enh(stream): sink task does not initialize the backend. 2024-05-28 11:34:04 +08:00
Haojun Liao
bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
Haojun Liao
be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Haojun Liao
03a5230bd7
Merge pull request #25923 from taosdata/fix/TD-30028
fix(stream): fix memory leak if write failed.
2024-05-25 00:40:14 +08:00
Haojun Liao
01fb950cbc refactor: add some logs. 2024-05-24 11:44:17 +08:00
Haojun Liao
89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00
Haojun Liao
28032dfd39 fix(stream): fix memory leak if write failed. 2024-05-24 11:39:02 +08:00
Haojun Liao
499ca6c23b
Merge pull request #25910 from taosdata/fix/TD-30028
fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec.
2024-05-24 10:25:17 +08:00
Haojun Liao
8c0a74e7b2 fix(stream):adjust the idle time. 2024-05-24 09:19:09 +08:00
Yihao Deng
a021b62c04 fix backen crash 2024-05-23 12:02:01 +00:00
Haojun Liao
eb1f09f47f refactor: do some internal refactor. 2024-05-23 17:25:22 +08:00
Haojun Liao
0c61fb20d6 fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec. 2024-05-23 17:22:29 +08:00
Haojun Liao
cc7d5d7a91 Merge branch '3.0' into fix/TD-30028 2024-05-23 16:16:59 +08:00
Haojun Liao
cb6e03d985
Merge pull request #25896 from taosdata/fix/TD-30208
check delete mark
2024-05-23 15:48:01 +08:00
Haojun Liao
69567799eb fix(stream): initialization tasks before start all tasks. 2024-05-23 15:45:59 +08:00
Haojun Liao
61b08259ba fix(stream): initialization fill-history tasks before start all other stream tasks. 2024-05-23 15:38:16 +08:00
54liuyao
0b9e3c9115 check delete mark 2024-05-23 10:05:24 +08:00
Haojun Liao
f146ae4198 fix(stream): 2024-05-22 19:46:24 +08:00
Haojun Liao
96e1487787 refactor: do some internal refactor. 2024-05-22 16:57:09 +08:00
Haojun Liao
142bc9046d fix(stream): fix memory leak. 2024-05-22 15:13:00 +08:00
Haojun Liao
be39044b66 fix(stream): add more info 2024-05-22 11:04:54 +08:00
wangmm0220
f21eeae56c fix:[TD-30180]error in judging if groupId already added to the end of table name 2024-05-21 16:57:00 +08:00
Haojun Liao
3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
Hongze Cheng
9527b66db1
Merge pull request #25841 from taosdata/feat/ly_opt_checkpointYh
Feat/ly_opt_checkpointYh
2024-05-20 10:10:28 +08:00
Haojun Liao
130f7a292d fix(stream): reset the error code when trying to restore checkpoint. 2024-05-19 22:36:09 +08:00
Haojun Liao
f74fad7e60 fix(query): fix error in refactor. 2024-05-19 17:17:40 +08:00
Haojun Liao
0fe2686b63 fix(query): fix bugs caused by refactor. 2024-05-19 14:55:51 +08:00
Haojun Liao
7a90e68667 fix(query): fix bugs caused by refactor. 2024-05-19 13:55:46 +08:00
Haojun Liao
82c10fd709 fix(query): fix bugs caused by refactor. 2024-05-19 13:40:09 +08:00
Haojun Liao
1e5098f676 fix(query): fix bugs caused by refactor. 2024-05-19 13:32:30 +08:00
Yihao Deng
bb47a8df33 opt checkpoint 2024-05-17 15:30:04 +08:00
Yihao Deng
b0377a2e3a opt checkpoint 2024-05-17 14:21:04 +08:00
wade zhang
b299ff0449
Merge pull request #25798 from taosdata/fix/backendInvalidFree
Fix/backendInvalidFree
2024-05-17 13:46:18 +08:00
Yihao Deng
a7b434075b opt checkpoint 2024-05-16 20:16:59 +08:00
Yihao Deng
2359e0e61b opt checkpoint 2024-05-16 18:07:57 +08:00
Yihao Deng
ef5d9316bb Merge branch 'enh/refactoBackendCp' into feat/ly_opt_checkpoint 2024-05-16 16:30:27 +08:00
54liuyao
7b50663240 optimize stream operator checkpoint 2024-05-16 16:24:58 +08:00
Yihao Deng
f33bf898b4 fix invalid free 2024-05-15 16:56:02 +08:00
Yihao Deng
01e9ae6299 fix invalid free 2024-05-15 16:53:42 +08:00
Haojun Liao
2b44211928 fix(test): update test case and fix a typo. 2024-05-15 14:52:59 +08:00
Haojun Liao
abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
Yihao Deng
b1c50e23b6 refactor checkpoint 2024-05-15 11:38:43 +08:00
Haojun Liao
042ed3caff fix(stream): fix invalid unlock. 2024-05-15 10:08:56 +08:00
Haojun Liao
610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao
4eacf86843 fix(tsdb): fix deadlock when stopping reader. 2024-05-14 19:20:19 +08:00
Haojun Liao
241f8b3d2e fix(tsdb): fix deadlock when stopping reader. 2024-05-14 18:05:13 +08:00
Haojun Liao
1ccf743215 fix(stream): fix syntax error. 2024-05-14 16:19:21 +08:00
Haojun Liao
4fa8cfbffe fix(stream): fix syntax error. 2024-05-14 15:42:37 +08:00
Haojun Liao
6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao
fb248b2682 fix(stream): not save the stream task for rsma. 2024-05-13 17:26:39 +08:00
Haojun Liao
3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
Haojun Liao
d214dd5cdd fix(stream): fix error in downloading remote backup checkpoint data. 2024-05-11 16:19:11 +08:00
Haojun Liao
f8d8061260 refactor: do some internal refactor. 2024-05-11 11:08:51 +08:00
Haojun Liao
d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
Haojun Liao
370c255128 refactor: do some internal refactor. 2024-05-11 10:27:55 +08:00
Haojun Liao
11ed1f54b3 refactor: do some internal refactor. 2024-05-11 10:09:23 +08:00
Haojun Liao
7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Haojun Liao
845fcfa247
Merge pull request #25700 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-09 15:14:46 +08:00
Haojun Liao
6721ec3cd8 refactor: do some internal refactor. 2024-05-09 14:06:25 +08:00
Haojun Liao
2ee8f7da32
Merge pull request #25695 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-09 13:36:56 +08:00
Haojun Liao
db848f7e6b refactor: do some internal refactor. 2024-05-09 10:15:34 +08:00
Haojun Liao
6693efaa85 refactor: do some internal refactor. 2024-05-09 10:11:37 +08:00
Haojun Liao
a450deb60b
Merge pull request #25679 from taosdata/fix/3_liaohj
fix(query): set correct row length for rowid sort.
2024-05-09 10:10:27 +08:00
Haojun Liao
4f59754a63 refactor: do some internal refactor. 2024-05-08 16:22:02 +08:00
Haojun Liao
a1a198630a
Merge pull request #25666 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 15:33:53 +08:00
Haojun Liao
bc04093d11 refactor: do some internal refactor. 2024-05-08 13:54:25 +08:00
Haojun Liao
9ce8f6953d refactor: do some internal refactor. 2024-05-08 13:52:20 +08:00
Haojun Liao
b26656fd1c
Merge pull request #25661 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 13:03:13 +08:00
Haojun Liao
c43fbf6fee refactor: do some internal refactor. 2024-05-08 11:21:24 +08:00
Haojun Liao
cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao
55a630911d
Merge pull request #25653 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-07 23:12:30 +08:00
Haojun Liao
b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
54liuyao
a5213e4cf9 adj delete mark 2024-05-07 15:01:45 +08:00
Haojun Liao
0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Haojun Liao
bbd423f666 refactor: do some internal refactor. 2024-05-07 09:46:12 +08:00
Haojun Liao
3b43b8f8c7
Merge pull request #25646 from taosdata/fix/3_liaohj
fix(stream): set global close flag in the streamMeta.
2024-05-06 22:19:23 +08:00
Haojun Liao
18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao
c982f6ac80 refactor: do some internal refactor. 2024-05-06 17:08:11 +08:00
Haojun Liao
7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao
46e9fe6f97 fix(stream): set global close flag in the streamMeta. 2024-05-06 17:03:09 +08:00
Haojun Liao
d879c7c967 fix(stream): set global close flag in the streamMeta. 2024-05-06 16:40:49 +08:00
Yihao Deng
8061688e79 fix rocskdb init failed 2024-05-06 03:22:28 +00:00
Haojun Liao
05a204dd6c refactor: do some internal refactor. 2024-04-30 19:30:56 +08:00
Haojun Liao
732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao
94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao
ed610d293f fix(stream): close task if it's in checkdown stream procedure. 2024-04-30 17:09:37 +08:00
Haojun Liao
629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao
f2bc93b78d
Merge pull request #25598 from taosdata/fix/3_liaohj
refactor(stream): opt stream sink perf.
2024-04-30 16:59:22 +08:00
Haojun Liao
973ca3be80 refactor: do some internal refactor. 2024-04-30 09:51:40 +08:00
Haojun Liao
cd6261c8d4 refactor: do some internal refactor. 2024-04-30 09:49:11 +08:00
Yihao Deng
3fd6770c81 avoid invalid read 2024-04-29 05:52:54 +00:00
Yihao Deng
b54198ba4a avoid invalid read 2024-04-29 03:18:38 +00:00
Yihao Deng
97aadd3aa7 avoid invalid read 2024-04-29 03:17:33 +00:00
Yihao Deng
2beb46c9df Merge branch '3.0' into fix/TD-29844 2024-04-29 01:27:20 +00:00
Haojun Liao
6c93fe5593 fix(stream): fix dead lock. 2024-04-28 18:35:00 +08:00
Haojun Liao
b990632e8d fix(stream): fix dead lock. 2024-04-28 18:29:18 +08:00
Haojun Liao
bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Yihao Deng
9e19c52924 Remove unnecessary memory free in uploadCheckpointData function 2024-04-28 06:50:54 +00:00
Yihao Deng
fac8530580 fix invalid read 2024-04-28 06:50:33 +00:00
Yihao Deng
af567ea2cb fix invalid read 2024-04-28 06:47:31 +00:00
Haojun Liao
57ee97814f fix(stream): fix failed to launch timer bug. 2024-04-28 14:29:18 +08:00
Haojun Liao
3c5ca17737 Merge branch '3.0' into fix/3_liaohj 2024-04-28 13:57:16 +08:00
Haojun Liao
6ea4823f1e fix(stream): update the timeout measurement. 2024-04-28 11:14:10 +08:00
Haojun Liao
b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
Haojun Liao
8adaeb59a3 refactor: do some internal refactor. 2024-04-28 09:50:21 +08:00
Haojun Liao
384efdc185
Merge pull request #25531 from taosdata/fix/3_liaohj
fix(stream):add ref for task in check rsp monitor timer.
2024-04-28 09:22:00 +08:00
Haojun Liao
a33e7b2eb3 refactor: do some internal refactor. 2024-04-26 22:22:54 +08:00
Haojun Liao
2d1e9ba631 fix(stream):add ref for task in check rsp monitor timer. 2024-04-26 19:11:57 +08:00
Haojun Liao
324072fed8
Merge pull request #25525 from taosdata/fix/3_liaohj
fix(stream): update stream task meta info.
2024-04-26 18:15:09 +08:00
Haojun Liao
b1b3246066 fix(stream): update the checkpoint executed transId range. 2024-04-26 17:03:01 +08:00
Haojun Liao
5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Haojun Liao
8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Haojun Liao
3961903fea refactor: do some internal refactor. 2024-04-26 14:00:03 +08:00
Haojun Liao
88af030966 refactor: do some internal refactor. 2024-04-26 13:53:41 +08:00
Haojun Liao
19b0de6582 fix(stream): add task node into update list if it is timeout for more than 100sec. 2024-04-26 13:49:40 +08:00
Hongze Cheng
e678d2508f
Merge pull request #25462 from taosdata/enh/supportTmqInterface
Enh/support tmq interface
2024-04-26 13:05:33 +08:00
Haojun Liao
c565e31638
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
2024-04-26 12:44:00 +08:00
Haojun Liao
e5069669cb refactor: do some internal refactor. 2024-04-26 11:16:40 +08:00
Haojun Liao
a0e68c2bfb refactor: do some internal refactor. 2024-04-26 11:14:53 +08:00
Haojun Liao
ae4e2bf671 fix(stream): suppress some warnings by ide. 2024-04-26 10:00:54 +08:00
Haojun Liao
fae53efed9 fix(stream): add some logs for retry for notready/timeout downstream tasks. and do some internal refactor. 2024-04-26 09:58:20 +08:00
Haojun Liao
77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
Haojun Liao
5df720910e
Merge pull request #25497 from taosdata/fix/TD-29672
save stream tbname
2024-04-26 09:14:24 +08:00
Haojun Liao
b3d2ccec83
Merge pull request #25483 from taosdata/fix/3_liaohj
fix(query): add ts in cache_scan_operator if pk exists and only retri…
2024-04-25 22:32:26 +08:00
54liuyao
0551c1189d save stream tbname 2024-04-25 18:46:13 +08:00
54liuyao
220a31d02f save stream tbname 2024-04-25 17:48:32 +08:00
54liuyao
dbe3b25618 save stream tbname 2024-04-25 17:37:59 +08:00
Haojun Liao
addd2d2a84 fix(stream): fix syntax error. 2024-04-25 17:06:15 +08:00
Haojun Liao
cd8baa7ba0 fix(stream): add log for update task epset, set correct update flag if epset updated. 2024-04-25 16:39:11 +08:00
Yihao Deng
d06cf49182 Fix memory leak in copyDataAt function 2024-04-25 07:44:31 +00:00
Haojun Liao
d1ecfe5cf3 refactor: do some internal refactor. 2024-04-25 14:24:20 +08:00
Haojun Liao
b698b8be96 fix(stream): pass the address of tmr_h id 2024-04-25 09:57:08 +08:00
54liuyao
2a72ceadd1 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-24 18:57:22 +08:00
54liuyao
85cd290aa5 opt bloom filter 2024-04-24 18:40:39 +08:00
54liuyao
3300bf04c1 opt bloom filter 2024-04-24 17:27:24 +08:00
Haojun Liao
a37667968f refactor: do some internal refactor. 2024-04-23 19:49:14 +08:00
Haojun Liao
82cde46614 fix(stream): fix memory leak. 2024-04-23 19:48:50 +08:00
Haojun Liao
10c792efa2 fix(stream):add related fill-history task to be done, when check-rsp moniting quit. 2024-04-23 16:55:47 +08:00
Haojun Liao
1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
Haojun Liao
34048937a4 fix(stream): check req id to remove expired check rsp . 2024-04-23 10:03:01 +08:00
Haojun Liao
315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00