Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
67094 commits 554 branches 514 tags 1.7 GiB
Commit graph

2864 commits

Author SHA1 Message Date
Benguang Zhao
c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Haojun Liao
f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
Haojun Liao
54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
yihaoDeng
c6ba2ca205 fix transfer crash 2023-10-18 14:49:12 +08:00
yihaoDeng
d6840ae07f fix transfer crash 2023-10-18 14:22:52 +08:00
yihaoDeng
1b755dd4e7 fix transfer crash 2023-10-18 14:22:33 +08:00
yihaoDeng
e49b9b2276 fix transfer crash 2023-10-18 11:34:11 +08:00
Haojun Liao
2904cfd4d5 Merge branch 'main' into refact/streamsm 2023-10-18 10:29:09 +08:00
Haojun Liao
5115a1ac88
Merge pull request #23304 from taosdata/fix/TD-26771 
double free
 2023-10-18 10:09:17 +08:00
yihaoDeng
d67fdb5e46 fix transfer crash 2023-10-17 21:08:31 +08:00
yihaoDeng
2004c1a346 fix transfer crash 2023-10-17 18:19:52 +08:00
Haojun Liao
64ed7e49a2 enh(stream): sm for stream tasks. 2023-10-17 13:47:55 +08:00
yihaoDeng
77542cc461 fix stream snap deadlock 2023-10-17 11:23:39 +08:00
Haojun Liao
7b7ce10475 refactor(stream): do some internal refactor. 2023-10-17 11:23:04 +08:00
Haojun Liao
14035c763c refactor: do some internal refactor. 2023-10-17 09:57:13 +08:00
Haojun Liao
fdb6ec1fa3 enh(stream): add parameter to limit the stream sink task. 2023-10-16 22:52:39 +08:00
liuyao
990d36654d release buff 2023-10-16 19:49:45 +08:00
Haojun Liao
a1aa2c9e0c fix(stream):add more check for test cases. 2023-10-16 18:47:01 +08:00
Haojun Liao
67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao
f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
Haojun Liao
6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
liuyao
7269dedb39 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-10-13 11:35:01 +08:00
liuyao
429125be93 session state recover 2023-10-13 11:32:35 +08:00
Haojun Liao
33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao
84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
yihaoDeng
d6ff282006 refactor backend 2023-10-12 20:42:36 +08:00
yihaoDeng
8c1a9f7c58 refactor backend 2023-10-12 20:28:40 +08:00
yihaoDeng
0ba7e2278a refactor backend 2023-10-12 20:21:11 +08:00
yihaoDeng
a56d831a14 refactor backend 2023-10-12 20:16:41 +08:00
yihaoDeng
861d26e356 refactor backend 2023-10-12 15:24:50 +08:00
yihaoDeng
f704d4b82e refactor backend 2023-10-12 11:45:18 +08:00
yihaoDeng
bfd205b3f7 refactor backend 2023-10-12 11:31:39 +08:00
Haojun Liao
eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
yihaoDeng
4c94fbb44f refactor backend 2023-10-11 20:26:19 +08:00
yihaoDeng
f264ffdcd6 refactor backend 2023-10-11 20:12:07 +08:00
yihaoDeng
83b52a4c1d refactor backend 2023-10-11 20:02:40 +08:00
yihaoDeng
031506aef8 refactor backend 2023-10-11 19:46:35 +08:00
yihaoDeng
4f47162512 refactor backend 2023-10-11 16:36:43 +08:00
yihaoDeng
722d72659b refactor backend 2023-10-11 16:10:16 +08:00
yihaoDeng
0baef335d7 refactor backend 2023-10-11 16:03:04 +08:00
yihaoDeng
4cff121a38 refactor backend 2023-10-11 14:46:41 +08:00
liuyao
e9fc079d26 opt bloom filter 2023-10-11 10:14:11 +08:00
Haojun Liao
1d4f0c8599
Merge pull request #23201 from taosdata/enh/TD-26646 
Enh/td 26646
 2023-10-10 22:59:37 +08:00
yihaoDeng
28421cd35e refactor backend 2023-10-10 20:51:41 +08:00
Haojun Liao
05dfadd8f8 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 15:52:48 +08:00
Haojun Liao
5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
yihaoDeng
b36163a197 add session iter 2023-10-10 15:12:21 +08:00
yihaoDeng
825341d90a add sess iter 2023-10-10 14:35:02 +08:00
Haojun Liao
adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan
9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN 
fix: add case for lost data after  split vgroup (main)
 2023-10-10 00:54:34 -05:00
Alex Duan
e566027cef
Merge pull request #23019 from taosdata/case/TD-26408-3.0 
fix: add case for lost data after split 3.0
 2023-10-10 00:53:56 -05:00
yihaoDeng
6adf7532a8 add sess iter 2023-10-10 11:35:18 +08:00
yihaoDeng
7ac4ef5beb add sess iter 2023-10-10 10:41:46 +08:00
yihaoDeng
0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
Haojun Liao
a25d94ab6f fix(stream): retry when error occurs during timer. 2023-10-09 20:10:28 +08:00
Haojun Liao
7d39164133 fix(stream): disable retrieving results during checkpoint procedure 2023-10-09 20:10:27 +08:00
Haojun Liao
af4618f958 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 20:10:27 +08:00
Haojun Liao
847baa8b71 fix(stream): fix the pause failure bug. 2023-10-09 20:10:27 +08:00
Haojun Liao
21fb502690 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 20:10:26 +08:00
Haojun Liao
64bde93f85 fix(stream): not idle for sink task when no tokens are available. 2023-10-09 20:10:25 +08:00
Haojun Liao
9a7167aaba fix(stream): sleep for 10ms 2023-10-09 20:10:24 +08:00
Haojun Liao
9af8ce21ed fix(stream): wait for a while when no available token. 2023-10-09 20:10:23 +08:00
Haojun Liao
4780474877 fix(stream): continue 2023-10-09 20:10:23 +08:00
Haojun Liao
da833ccb30 refactor: inc the dump batch. 2023-10-09 20:10:23 +08:00
Haojun Liao
2936ac9b89 fix(stream): add missing refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao
af2c0c95e9 refactor: do some internal refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao
940d6a3cb4 fix(stream): check items in queue and qall, stead of only the queue items. 2023-10-09 20:10:21 +08:00
Haojun Liao
e95aea84ae fix(stream): fix syntax error. 2023-10-09 20:10:21 +08:00
Haojun Liao
59e284c332 fix(stream): quit from loop when input queue is full. 2023-10-09 20:10:21 +08:00
Haojun Liao
9d5a3b8d78 other: merge stream fix. 2023-10-09 20:10:13 +08:00
Haojun Liao
c5997bee5b fix(stream): update the current processing version. 2023-10-09 20:09:23 +08:00
Haojun Liao
28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao
b3b9e89d30 fix(stream): fix the invalid check. 2023-10-09 20:09:22 +08:00
Haojun Liao
cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao
d2160efa05 refactor: wait for 100ms before scan wal again. 2023-10-09 20:09:21 +08:00
Haojun Liao
932d93ab35 refactor: wait for more time for future data 2023-10-09 20:09:21 +08:00
Haojun Liao
7682c033ad fix(stream): add null check. 2023-10-09 20:09:21 +08:00
Haojun Liao
0ab5d4b342 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
c295ec322a refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
d5abb21335 fix(stream): fix invalid check. 2023-10-09 20:09:20 +08:00
Haojun Liao
583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
83f84d92bc refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-10-09 20:09:10 +08:00
Haojun Liao
bb4ba54f28 fix(stream): enable new time range for stream task. 2023-10-09 20:09:09 +08:00
Haojun Liao
c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao
db897fb03a fix(stream): opt perf. 2023-10-09 20:09:09 +08:00
Haojun Liao
0a2b70fd7f fix(stream): fix syntax error. 2023-10-09 20:09:06 +08:00
Haojun Liao
8477271240 fix(stream): fix dead lock. 2023-10-09 20:09:00 +08:00
Haojun Liao
12eabb0c2c log(stream): update logs. 2023-10-09 20:09:00 +08:00
Haojun Liao
b716f0d1fd fix(stream): fix dead lock. 2023-10-09 20:08:57 +08:00
Haojun Liao
60a720efbb log: update logs. 2023-10-09 20:08:53 +08:00
Haojun Liao
d10b07d23d refactor: do some internal refactor. 2023-10-09 20:08:53 +08:00
Haojun Liao
6d2dbd549b fix(stream): avoid repeatly free obj. 2023-10-09 20:08:53 +08:00
Haojun Liao
6b5770aab7 log(stream): update the log. 2023-10-09 20:08:52 +08:00
Haojun Liao
dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao
38164435f9 refactor: do some internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao
f2848de12a fix(stream): reduce the counter when remove stream tasks. 2023-10-09 20:08:52 +08:00
Haojun Liao
ecb3b44026 fix(stream): limit sink quota. 2023-10-09 20:08:52 +08:00
Haojun Liao
2c0e54f4f7 fix(stream): update the retry interval. 2023-10-09 20:08:13 +08:00
Haojun Liao
7f8da725bc enh(stream): add quota limitation for sink task. 2023-10-09 20:08:13 +08:00
Haojun Liao
a248f3d088 refactor: do some internal refactor. 2023-10-09 20:08:12 +08:00
Haojun Liao
0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao
3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00
Haojun Liao
feb09c8361 fix(stream): fix error in pause scan-history data. 2023-10-09 20:08:11 +08:00
Haojun Liao
6a98b11bef fix(stream): fix invalid read and memory leak. 2023-10-09 20:08:11 +08:00
Haojun Liao
65f66f0986 fix(stream): transfer state when all downstream rsp already. 2023-10-09 20:08:11 +08:00
Haojun Liao
a32b56f381 fix(stream): fix memory leak. 2023-10-09 20:08:10 +08:00
Haojun Liao
4af7812f0b fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-10-09 20:08:10 +08:00
Haojun Liao
4fe1382cd9 fix(stream): adjust nodeUpdate check interval. 2023-10-09 20:08:09 +08:00
Haojun Liao
f4f55fcbce fix(stream): record the tasks started info, and do some internal refactor. 2023-10-09 20:08:09 +08:00
Haojun Liao
68b003c804 fix(stream): fix race condition. 2023-10-09 20:08:09 +08:00
Haojun Liao
fc96ec6bae fix(stream): do not wait for the checkpoint finish before stop tasks. 2023-10-09 20:08:09 +08:00
Haojun Liao
7167c3c5de fix(stream): add new timer for each task. 2023-10-09 20:08:08 +08:00
Haojun Liao
7336228c16 refactor: do some internal refactor. 2023-10-09 20:08:08 +08:00
Haojun Liao
477f57aa0e refactor: do some internal refactor. 2023-10-09 20:08:08 +08:00
Haojun Liao
52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao
3baddbe67a fix(stream): update the checkpoint record start time. 2023-10-09 20:08:07 +08:00
Haojun Liao
a6ffb845c8 fix(stream): fix invalid checkpoint start time. 2023-10-09 20:08:07 +08:00
Haojun Liao
c05a8de3e8 fix(stream): rsp when checkpoint source failed. 2023-10-09 20:08:06 +08:00
Haojun Liao
b4bc4fac98 fix(stream): disable auto rsp for checkpoint source. 2023-10-09 20:08:06 +08:00
Haojun Liao
e671e87234 fix(stream): fix invalid assert. 2023-10-09 20:08:06 +08:00
Haojun Liao
d1a6b8bd22 refactor: do some internal refactor. 2023-10-09 20:08:06 +08:00
Haojun Liao
46b17aa9f1 fix(stream): fix race condition. 2023-10-09 20:08:06 +08:00
Haojun Liao
e49409a11e fix(stream): add some logs. 2023-10-09 20:08:05 +08:00
Haojun Liao
5eee76df65 fix(stream): add msg identifier check. 2023-10-09 20:08:05 +08:00
Haojun Liao
192c47a7c2 fix(stream): add some logs. 2023-10-09 20:08:05 +08:00
Haojun Liao
693254f602 fix(stream): remove invalid free. 2023-10-09 20:08:04 +08:00
Haojun Liao
f3bd5c411d fix(stream): remove the blocking flag after successfully retry sending msg. 2023-10-09 20:08:04 +08:00
Haojun Liao
ed9e035095 fix(stream): clear the failure vnode id list before send msg. 2023-10-09 20:08:04 +08:00
Haojun Liao
3726aa723e fix(stream): fix invalid read. 2023-10-09 20:08:04 +08:00
Haojun Liao
e0d19af000 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-10-09 20:08:03 +08:00
Haojun Liao
2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao
27e00b1f19 fix(stream): add some logs, and remove invalid assert. 2023-10-09 20:08:02 +08:00
Haojun Liao
12687eb287 fix(stream): add check info detailed information. 2023-10-09 20:08:02 +08:00
Haojun Liao
ab7c18f604 refactor: do some internal refactor. 2023-10-09 20:08:01 +08:00
Haojun Liao
e5535fa1f5 fix(stream): handle dispatch checkpoint-trigger failure. 2023-10-09 20:08:01 +08:00
Haojun Liao
65cc4040f3 fix(stream): update logs. 2023-10-09 20:08:00 +08:00
Haojun Liao
6d3a134077 fix(stream): ignore the dispatch failure, and set the correct rsp counter. 2023-10-09 20:07:54 +08:00
Haojun Liao
7f4d9b6e41 fix(stream): wait for the task checkpoint before stop. 2023-10-09 20:07:53 +08:00
Haojun Liao
ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao
e4ac835554 fix(stream): disable token bucket. 2023-10-09 20:07:53 +08:00
Haojun Liao
a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao
1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao
d752fb1ed6 fix(stream): exec task in task queuee threads. 2023-10-09 20:06:11 +08:00
Haojun Liao
1ebafe4a1f fix(stream): add more check. 2023-10-09 20:06:11 +08:00
Haojun Liao
c403a15f36 fix(stream): check the status before exec stream task when handling the dispatch requests. 2023-10-09 20:06:11 +08:00
Haojun Liao
d76e3ac718 fix(stream): add task status check. 2023-10-09 20:06:10 +08:00
Haojun Liao
e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao
ce85945583 fix(stream): set correct size for results generated by scan history stream tasks. 2023-10-09 20:06:05 +08:00
Haojun Liao
053643be19 fix(stream): add timestamp. 2023-10-09 20:06:05 +08:00
Haojun Liao
b38f9e0288 fix(stream): update logs. 2023-10-09 20:06:05 +08:00
Haojun Liao
5c0b8ea804 enh(stream): log the checkpoint time. 2023-10-09 20:06:04 +08:00
Haojun Liao
b95ad74c7f fix(stream): not handle the check msg for follower tasks. 2023-10-09 20:06:04 +08:00
Haojun Liao
e6fb9ee46c fix(stream): reset task counter. 2023-10-09 20:06:04 +08:00
Haojun Liao
c3a3cf21fb fix(stream): add some logs. 2023-10-09 20:05:39 +08:00
Haojun Liao
08b37dfc13 fix(stream): fix memory leak. 2023-10-09 20:05:38 +08:00
Haojun Liao
734f648891 fix(stream): set the output normal for stream dispatch when encountering the transfer state. 2023-10-09 20:05:38 +08:00
Haojun Liao
636eccc160 fix(stream): add null check 2023-10-09 20:05:37 +08:00
Haojun Liao
57bf1cadc4 fix(stream): fix error in decode stream task. 2023-10-09 20:05:37 +08:00
Haojun Liao
9d6199adf7 fix(stream): fix invalid read. 2023-10-09 20:05:37 +08:00
Haojun Liao
0459a4628c fix(stream): fix stream task id error. 2023-10-09 20:05:36 +08:00
Haojun Liao
7ccc273206 other: merge stream fix in main. 2023-10-09 20:05:29 +08:00
Haojun Liao
98ef566eb4 fix(stream): remove fill-history sink task. 2023-10-09 20:04:17 +08:00
Haojun Liao
e84eeee6b8 refactor: do some internal refactor. 2023-10-09 20:04:17 +08:00
Haojun Liao
fe7864b976 fix(stream): fix error in drop task. 2023-10-09 20:04:17 +08:00
Haojun Liao
c33e521aa1 fix(stream): update some logs. 2023-10-09 20:04:17 +08:00
Haojun Liao
39e0c57323 fix(stream): set the correct guard flag. 2023-10-09 20:04:16 +08:00
Haojun Liao
3d1f29ff21 fix(stream): fix memory leak. 2023-10-09 20:04:16 +08:00
yihaoDeng
c6e9134cea add sess iter 2023-10-09 20:02:23 +08:00
Haojun Liao
6fa54789cb fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-10-09 19:59:31 +08:00
Haojun Liao
1256eafddb other: merge stream fix. 2023-10-09 19:59:24 +08:00
Haojun Liao
283118bf68 fix(stream):fix missing unlock. 2023-10-09 19:56:17 +08:00
Haojun Liao
aaa12ed4f8 refactor: do some internal refactor about the sched status set 2023-10-09 19:56:17 +08:00
Haojun Liao
01d104706e refactor(stream): remove unnecessary streamschedTask function to improve the performance. 2023-10-09 19:56:17 +08:00
Haojun Liao
a678e722ce fix(stream): limit the token bucket capacity 2023-10-09 19:56:17 +08:00
Haojun Liao
b0ef091430 fix(stream): retry when error occurs during timer. 2023-10-09 16:40:05 +08:00
Haojun Liao
be0a2e4573 fix(stream): disable retrieving results during checkpoint procedure 2023-10-09 16:33:28 +08:00
yihaoDeng
2aa88dfe9b fix mem leak 2023-10-09 15:53:42 +08:00
Haojun Liao
8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Haojun Liao
d87db2f829 fix(stream): fix the pause failure bug. 2023-10-09 14:48:11 +08:00
yihaoDeng
28b546a4ad fix mem leak 2023-10-09 14:25:57 +08:00
yihaoDeng
be42143362 Merge branch '3.0' into case/TD-26408-3.0 2023-10-09 14:24:31 +08:00
yihaoDeng
3f9784f475 fix mem leak 2023-10-09 14:07:22 +08:00
yihaoDeng
0b92a6b1ea fix mem leak 2023-10-09 11:16:16 +08:00
Haojun Liao
74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao
ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao
4b8cd3bccd fix(stream): not idle for sink task when no tokens are available. 2023-10-09 10:07:19 +08:00
yihaoDeng
f49a2cbeb0 refact task backend 2023-10-08 18:14:17 +08:00
liuyao
1cbb8ef444 init bloomfilter array 2023-10-08 14:43:44 +08:00
yihaoDeng
b5994b31e2 fix mem leak 2023-10-08 13:33:02 +08:00
yihaoDeng
e3f18495e0 fix mem leak 2023-10-08 11:22:26 +08:00
yihaoDeng
2fa91341a7 refact task backend 2023-10-08 10:35:49 +08:00
Haojun Liao
23fb26798f fix(stream): sleep for 10ms 2023-10-07 19:47:49 +08:00
Haojun Liao
e4e4c5a36e fix(stream): wait for a while when no available token. 2023-10-07 19:41:49 +08:00
Haojun Liao
45bb3f50d7 fix(stream): continue 2023-10-07 19:25:40 +08:00
liuyao
95ffe6fa23 stream recover 2023-10-07 19:24:21 +08:00
Haojun Liao
62cdcbc7e3 refactor: inc the dump batch. 2023-10-07 19:20:48 +08:00
Haojun Liao
4d6f143146 fix(stream): add missing refactor. 2023-10-07 19:18:26 +08:00
Haojun Liao
ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
Haojun Liao
0e8a8aabc1 fix(stream): check items in queue and qall, stead of only the queue items. 2023-10-07 19:16:25 +08:00
liuyao
1e323c0408 fix issue 2023-10-07 19:11:46 +08:00
yihaoDeng
98099ebbae fix mem leak 2023-10-07 18:41:27 +08:00
liuyao
19bbf10579 fix issue 2023-10-07 17:59:53 +08:00
yihaoDeng
97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
liuyao
1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
yihaoDeng
bdc4afec83 refact task backend 2023-10-07 17:17:30 +08:00
yihaoDeng
e41da13d5b refact task backend 2023-10-07 17:07:26 +08:00
yihaoDeng
3ebc7eef5f refact task backend 2023-10-07 17:03:12 +08:00
yihaoDeng
c146327da8 refact task backend 2023-10-07 16:48:36 +08:00
Haojun Liao
d11c0a113c fix(stream): fix syntax error. 2023-10-07 14:56:09 +08:00
Haojun Liao
7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
yihaoDeng
66315fe405 refact task backend 2023-10-07 13:53:44 +08:00
yihaoDeng
82e0242889 refact task backend 2023-10-07 13:43:52 +08:00
yihaoDeng
fa70221238 refact task backend 2023-10-07 12:17:55 +08:00
liuyao
460ee86fdf fix issue 2023-10-07 11:55:40 +08:00
liuyao
59d47e1e1f fix issuse 2023-10-07 10:34:35 +08:00
Haojun Liao
115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
Haojun Liao
011627d50a fix(stream): update the current processing version. 2023-10-07 09:07:44 +08:00
Haojun Liao
c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
Haojun Liao
98659ad323 fix(stream): fix the invalid check. 2023-10-05 00:09:47 +08:00
Haojun Liao
41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao
45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao
132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao
38aff641ee fix(stream): add null check. 2023-10-03 02:39:57 +08:00
Haojun Liao
58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao
a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao
5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
Haojun Liao
5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
yihaoDeng
b8e265e502 add cvt state 2023-09-30 09:05:28 +00:00
Haojun Liao
31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
yihaoDeng
eac16b9d1b add cvt state 2023-09-28 11:59:53 +00:00
yihaoDeng
4f66dc538f add cvt state 2023-09-28 11:52:18 +00:00
Haojun Liao
f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
yihaoDeng
c5bb37a5cb refact task backend 2023-09-28 17:30:49 +08:00
yihaoDeng
bb265887e6 refact task backend 2023-09-28 17:07:19 +08:00
yihaoDeng
54e3ac2c1e refact task backend 2023-09-28 15:46:12 +08:00
Haojun Liao
80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
Haojun Liao
22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao
f525778aef fix(stream): fix syntax error. 2023-09-28 00:53:36 +08:00
Haojun Liao
8c998673ad fix(stream): fix dead lock. 2023-09-27 17:15:49 +08:00
Haojun Liao
2dade996bb log(stream): update logs. 2023-09-27 15:37:12 +08:00
Haojun Liao
8f2d217834 log: update logs. 2023-09-27 14:48:53 +08:00
yihaoDeng
d4f87378fd avoid first tag index conflict 2023-09-27 14:44:09 +08:00
Haojun Liao
11641e1115 refactor: do some internal refactor. 2023-09-27 14:18:01 +08:00
Haojun Liao
34d547bfff fix(stream): avoid repeatly free obj. 2023-09-27 14:05:14 +08:00
Haojun Liao
ae020fcd2d log(stream): update the log. 2023-09-27 14:03:57 +08:00
Haojun Liao
e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
Haojun Liao
a7e6933ce7 refactor: do some internal refactor. 2023-09-27 09:46:15 +08:00
Haojun Liao
37bf387453 fix(stream): reduce the counter when remove stream tasks. 2023-09-27 09:36:20 +08:00
Haojun Liao
9ab9de0ad3 fix(stream): limit sink quota. 2023-09-27 00:30:38 +08:00
Haojun Liao
27dcbcb96f fix(stream): update the retry interval. 2023-09-26 23:42:02 +08:00
Haojun Liao
aec15ae39f enh(stream): add quota limitation for sink task. 2023-09-26 23:29:54 +08:00
liuyao
c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
Haojun Liao
890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao
f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
liuyao
82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
Haojun Liao
d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Haojun Liao
6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao
5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00
yihaoDeng
ed172a939c rename cfg default name 2023-09-25 18:09:35 +08:00
Haojun Liao
c9576d7a85 fix(stream): transfer state when all downstream rsp already. 2023-09-25 17:31:38 +08:00
Haojun Liao
c615c513e8 fix(stream): fix memory leak. 2023-09-25 16:01:17 +08:00
Haojun Liao
fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
Haojun Liao
1af95969b2 fix(stream): adjust nodeUpdate check interval. 2023-09-25 10:40:30 +08:00
Haojun Liao
eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao
c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
Haojun Liao
da82a5f19e fix(stream): do not wait for the checkpoint finish before stop tasks. 2023-09-24 22:03:07 +08:00
Haojun Liao
a74b462ffb fix(stream): add new timer for each task. 2023-09-24 02:25:53 +08:00
Haojun Liao
b7dcd94c64 refactor: do some internal refactor. 2023-09-24 01:56:52 +08:00
Haojun Liao
3a75c21e66 refactor: do some internal refactor. 2023-09-24 01:55:59 +08:00
Haojun Liao
4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
Haojun Liao
7f265e181d fix(stream): update the checkpoint record start time. 2023-09-23 18:05:14 +08:00
Haojun Liao
6ef68fdf06 fix(stream): fix invalid checkpoint start time. 2023-09-23 17:57:09 +08:00
Haojun Liao
acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
Haojun Liao
7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao
5155519559 fix(stream): fix invalid assert. 2023-09-22 23:06:48 +08:00
Haojun Liao
cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
yihaoDeng
8890f5c950 add cvt state 2023-09-22 12:51:29 +00:00
Haojun Liao
fcbd747afc fix(stream): fix race condition. 2023-09-22 19:35:12 +08:00
liuyao
5cc1ae1266 fix issue 2023-09-22 19:25:19 +08:00
Haojun Liao
1ca05fb3af fix(stream): add some logs. 2023-09-22 18:56:31 +08:00
Haojun Liao
5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
Haojun Liao
bb1a2322ca fix(stream): add some logs. 2023-09-22 17:27:10 +08:00
yihaoDeng
11da631bb5 add cvt state 2023-09-22 09:08:42 +00:00
Haojun Liao
07ec6f38b8 fix(stream): remove invalid free. 2023-09-22 16:53:22 +08:00
Haojun Liao
5a695f632c fix(stream): remove the blocking flag after successfully retry sending msg. 2023-09-22 16:44:55 +08:00
yihaoDeng
970b1cb840 add cvt state 2023-09-22 08:38:41 +00:00
yihaoDeng
173604ee1a add cvt state 2023-09-22 08:32:14 +00:00
yihaoDeng
19e52c364e add cvt state 2023-09-22 08:26:03 +00:00
Haojun Liao
6c357104a5 fix(stream): clear the failure vnode id list before send msg. 2023-09-22 16:19:25 +08:00
Haojun Liao
0f5f21ba09 fix(stream): fix invalid read. 2023-09-22 16:05:12 +08:00
Haojun Liao
619a9f6d08 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-09-22 15:57:55 +08:00
liuyao
4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
liuyao
410a177637 fix issue 2023-09-22 15:00:26 +08:00
Haojun Liao
898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Haojun Liao
87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao
f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
wangmm0220
5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
liuyao
4979fc5283 fix issue 2023-09-22 09:40:08 +08:00
wangmm0220
803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao
b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao
b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao
50d5fb6641 fix(stream): update logs. 2023-09-21 19:14:34 +08:00
yihaoDeng
470849982e add cvt func 2023-09-21 09:41:30 +00:00
Haojun Liao
4925b67d4a fix(stream): ignore the dispatch failure, and set the correct rsp counter. 2023-09-21 17:22:09 +08:00
Haojun Liao
2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao
17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
yihaoDeng
77ef632233 refactor code 2023-09-21 01:36:12 +00:00
Haojun Liao
9f9b712332 fix(stream): disable token bucket. 2023-09-21 01:19:58 +08:00
yihaoDeng
ee8c09667e refactor backend 2023-09-20 12:53:58 +00:00
Haojun Liao
92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
Haojun Liao
6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
liuyao
b4be5fe895 fix mem leak 2023-09-20 17:35:11 +08:00
Haojun Liao
619b377dd9 fix(stream): exec task in task queuee threads. 2023-09-20 17:30:41 +08:00
Haojun Liao
49165f8c3c fix(stream): add more check. 2023-09-20 16:49:55 +08:00
Haojun Liao
8329ec79f2 fix(stream): check the status before exec stream task when handling the dispatch requests. 2023-09-20 16:32:27 +08:00
Haojun Liao
2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
liuyao
1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
Haojun Liao
b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
Haojun Liao
1decaaee1e fix(stream): set correct size for results generated by scan history stream tasks. 2023-09-19 16:49:04 +08:00
Haojun Liao
309630eb11 fix(stream): add timestamp. 2023-09-19 14:22:05 +08:00
Haojun Liao
38b3a7c1bd fix(stream): update logs. 2023-09-19 11:05:49 +08:00
Haojun Liao
b7efedf4aa enh(stream): log the checkpoint time. 2023-09-19 09:53:33 +08:00
Haojun Liao
e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
Haojun Liao
9a9fffa577 fix(stream): reset task counter. 2023-09-19 00:52:35 +08:00
Haojun Liao
377fdfacf6 fix(stream): add some logs. 2023-09-18 23:51:08 +08:00
Haojun Liao
2c9d54af37 fix(stream): fix memory leak. 2023-09-18 19:58:46 +08:00
Haojun Liao
c7b8d572f6 fix(stream): set the output normal for stream dispatch when encountering the transfer state. 2023-09-18 18:25:22 +08:00
Haojun Liao
c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
Haojun Liao
8aa9960760
Merge pull request #22944 from taosdata/fix/liaohj 
refactor: do some internal refactor, and fix some bugs.
 2023-09-17 21:25:33 +08:00
Haojun Liao
3dfdda3283 fix(stream): fix error in decode stream task. 2023-09-17 18:07:26 +08:00
Haojun Liao
301258784a fix(stream): fix invalid read. 2023-09-17 13:59:06 +08:00
Haojun Liao
01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao
4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
Haojun Liao
caa7542cea
Merge pull request #22913 from taosdata/fix/liaohj 
fix(stream): fix error in drop task.
 2023-09-16 21:36:38 +08:00
Haojun Liao
91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
yihaoDeng
e958e18726 fix race crash and add log 2023-09-15 15:02:05 +08:00
yihaoDeng
6820fb0c5d fix race crash and add log 2023-09-15 14:59:44 +08:00
Haojun Liao
2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
Haojun Liao
117de7ab7d fix(stream): fix error in drop task. 2023-09-15 00:51:13 +08:00
Haojun Liao
500fcad36c
Merge pull request #22892 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-09-15 00:46:46 +08:00
Haojun Liao
73c2782d78 fix(stream): update some logs. 2023-09-14 23:17:23 +08:00
Haojun Liao
303e8caf0c fix(stream): set the correct guard flag. 2023-09-14 22:44:16 +08:00
Haojun Liao
27f626769e fix(stream): fix memory leak. 2023-09-14 19:33:05 +08:00
Haojun Liao
f2c3e0a6e8 fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-09-14 17:22:31 +08:00
Haojun Liao
fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
Haojun Liao
d9f6cf3966 fix(stream):fix missing unlock. 2023-09-13 14:11:41 +08:00
Haojun Liao
7305c8dbe1 refactor: do some internal refactor about the sched status set 2023-09-13 14:00:34 +08:00
Haojun Liao
ca2fea3e1b refactor(stream): remove unnecessary streamschedTask function to improve the performance. 2023-09-13 11:02:38 +08:00
Haojun Liao
0943c1c5b1 fix(stream): limit the token bucket capacity 2023-09-13 09:19:59 +08:00
Haojun Liao
99477babca
Merge pull request #22872 from taosdata/fix/coverityScanDyh 
fix coverity scan problem
 2023-09-13 09:18:27 +08:00
Haojun Liao
09a15bf340 refactor: do some internal refactor. 2023-09-12 22:07:52 +08:00
Haojun Liao
60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao
f6a097d96f refactor: do some internal refactor. 2023-09-12 21:58:22 +08:00
Haojun Liao
4325a0a433
Merge pull request #22866 from taosdata/fix/3_liaohj 
refactor: do  some internal refactor.
 2023-09-12 21:56:44 +08:00
yihaoDeng
8fc33dd74d fix coverity scan problem 2023-09-12 18:52:16 +08:00
Haojun Liao
13c20facd0 fix(stream): fix syntax error. 2023-09-12 18:37:30 +08:00
Haojun Liao
66676b977e fix(stream): set correct number items in outputQ 2023-09-12 18:16:07 +08:00
Haojun Liao
e457d94ac6 refactor: do some internal refactor. 2023-09-12 18:09:02 +08:00
Haojun Liao
4d33387e80
Merge pull request #22814 from taosdata/fix/fixTransferCrash2 
fix merge error
 2023-09-12 16:10:07 +08:00
Haojun Liao
78a5680cf4 fix(stream): add some logs. 2023-09-12 15:59:09 +08:00
yihaoDeng
3e48f3639c fix transfer crash 2023-09-12 14:46:32 +08:00
yihaoDeng
6ce85f5cae fix transfer crash 2023-09-12 10:44:56 +08:00
Haojun Liao
f602aa965f fix(stream): fix coverity scan issues. 2023-09-12 09:16:18 +08:00
Haojun Liao
45880f70d4 fix(stream): fix display error in logs. 2023-09-11 13:57:33 +08:00
Haojun Liao
3b79ab3266 fix(stream): reset the init ts. 2023-09-11 13:50:55 +08:00
Haojun Liao
50ef500f51 refactor(stream): do sink module refactor. 2023-09-11 10:09:31 +08:00
Haojun Liao
a9321248a9 fix(stream): set the correct flag when there is one token existed. 2023-09-10 18:34:03 +08:00
Haojun Liao
4ffb4a5b1f refactor: disable some logs. 2023-09-10 11:02:32 +08:00
Haojun Liao
85a5c45098 fix(stream): limit the already processed data. 2023-09-10 00:01:25 +08:00
Haojun Liao
6f5c855a4b fix(stream): fix msg lost bug. 2023-09-09 15:08:36 +08:00
Haojun Liao
47fd144447 other: add some logs. 2023-09-09 11:19:51 +08:00
Haojun Liao
e4918e85eb fix(stream): limit the sink rate 2023-09-09 00:22:22 +08:00
Haojun Liao
bf79c2c993 fix(stream): limit the sink rate 2023-09-09 00:11:13 +08:00
Haojun Liao
35b97cbd19 fix(stream): set correct token in bucket. 2023-09-08 23:50:41 +08:00
Haojun Liao
328377c25f refactor: add some logs. 2023-09-08 23:04:39 +08:00
Haojun Liao
b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
Haojun Liao
dc821057e5 fix(stream): update the log. 2023-09-07 10:33:38 +08:00
Haojun Liao
e407d7dc6b fix(stream): update log. 2023-09-07 10:09:05 +08:00
Haojun Liao
956047a441 fix(stream): count down the token in bucket. 2023-09-07 10:02:13 +08:00
Haojun Liao
b240e91c91 enh(stream): add token bucket to limit the rate of sink operation. 2023-09-07 09:58:48 +08:00
liuyao
d7caed1c44 opt stream state 2023-09-06 16:34:25 +08:00
Haojun Liao
8783ebcb02 enh(stream): add some logs and record the submit package performance. 2023-09-06 14:34:36 +08:00
Haojun Liao
c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
Haojun Liao
0441c7a870 Merge branch 'fix/3_liaohj' of github.com:taosdata/tdengine into fix/3_liaohj 2023-09-05 10:40:48 +08:00
Haojun Liao
5b3cb8ec42 fix(stream): fix memory leak. 2023-09-05 09:27:16 +08:00
Haojun Liao
4f85a2620a fix(stream): remove invalid free. 2023-09-05 09:27:16 +08:00
Haojun Liao
77eed06bcd
Merge branch '3.0' into fix/3_liaohj 2023-09-04 18:51:07 +08:00
Haojun Liao
5869750782 fix(stream): release stream task with max_delay option. 2023-09-04 18:33:33 +08:00
Haojun Liao
325a177170 fix(stream): disable the fill-history task when restart stream tasks. 2023-09-04 17:18:04 +08:00
Haojun Liao
aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao
375d0abea5 fix(stream): merge main. 2023-09-04 13:12:53 +08:00
Haojun Liao
21dab8ceab other: merge 3.0 2023-09-04 13:08:19 +08:00
Haojun Liao
d8518de5e0 fix(stream):fix error in timerActive. 2023-09-01 20:20:39 +08:00
Minglei Jin
5159bf3e2a fix(stream): fix epset errors 2023-09-01 15:33:23 +08:00
dapan1121
cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
Haojun Liao
bce46f1be8 fix(stream): transfer state should wait for the checkpoint generating completed. 2023-09-01 09:50:45 +08:00
Haojun Liao
9612704fa6 fix(stream): add assert 2023-08-31 21:43:44 +08:00
Haojun Liao
95da66e3e8 fix(stream): fix error. 2023-08-31 20:50:12 +08:00
Haojun Liao
bef0d4bff3 fix(stream): add assert. 2023-08-31 20:01:59 +08:00
Haojun Liao
e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069 
fix invalid insert
 2023-08-31 18:29:25 +08:00
yihaoDeng
1833be028f fix invalid insert 2023-08-31 15:28:31 +08:00
Haojun Liao
e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao
69f95f9324 other: merge 3.0 2023-08-31 13:56:34 +08:00
Haojun Liao
2285b834b0 refactor: do some internal refactor. 2023-08-31 13:53:12 +08:00
Haojun Liao
3fc3dafca6 refactor: do some internal refactor. 2023-08-31 13:46:48 +08:00
Haojun Liao
3ed78ddadd
Merge pull request #22662 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-08-31 13:46:14 +08:00
Haojun Liao
8645f763b5
Merge pull request #22661 from taosdata/enh/reserve 
stream change ver
 2023-08-31 13:35:23 +08:00
Haojun Liao
ecff0acb73 fix(stream): fix a syntax error. 2023-08-31 11:48:25 +08:00
yihaoDeng
83a5e2be4c stream change ver 2023-08-31 11:42:12 +08:00
Haojun Liao
e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
yihaoDeng
05ca71d5de stream change ver 2023-08-31 09:28:43 +08:00
Haojun Liao
65eaa9b15f fix(stream): add task release. 2023-08-30 19:06:12 +08:00
Haojun Liao
d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
yihaoDeng
57608e7fff fix merge error 2023-08-30 17:12:37 +08:00
Haojun Liao
997d247aa6 fix(stream): remove invalid memset. 2023-08-30 16:58:22 +08:00
Haojun Liao
d26e5373b9 fix(stream): fix syntax error. 2023-08-30 16:02:46 +08:00
Haojun Liao
c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao
24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
liuyao
fc3468fe39 add log 2023-08-30 15:58:51 +08:00
liuyao
0a72e576bd op stream pause 
pause data dispatch

opt stream pause
 2023-08-30 14:53:49 +08:00
Haojun Liao
646b339bde fix(stream): not enable the pause before receive all finish rsp 2023-08-30 14:28:45 +08:00
dapan1121
f6321d0c4f Merge remote-tracking branch 'origin/main' into fix/m23.1 2023-08-30 11:03:33 +08:00
Haojun Liao
3a7a220d43 fix(stream): fix error found by ci. 2023-08-30 10:14:01 +08:00
Haojun Liao
204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
Haojun Liao
c3e9590740 fix(stream): fix error. 2023-08-29 15:11:01 +08:00
yihaoDeng
8ed2836a2b refactor code 2023-08-29 09:52:03 +08:00
yihaoDeng
a2901411b0 refactor code 2023-08-28 18:52:10 +08:00
yihaoDeng
1687f68156 refactor code 2023-08-28 16:13:27 +08:00
Haojun Liao
391103bc5a fix(stream): do dome internal refactor. 2023-08-28 15:54:01 +08:00
dapan1121
b00aa1a992
Merge pull request #22458 from taosdata/fix/TD-25719 
fix: fix non-root users cannot create log files even if they have write
 2023-08-28 13:28:59 +08:00
Haojun Liao
b75ae217f6 fix(stream): notify close for snode. 2023-08-28 09:53:08 +08:00
Haojun Liao
88a59eee37 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-27 00:18:53 +08:00
Haojun Liao
46529d383c fix(stream): build checkpoint for sink tasks. 2023-08-27 00:18:41 +08:00
yihaoDeng
998dac0ffb fix mem leak 2023-08-26 21:54:36 +08:00
yihaoDeng
7d237d4310 fix UAF 2023-08-26 17:37:09 +08:00
yihaoDeng
bed5765013 fix UAF 2023-08-26 16:15:26 +08:00
yihaoDeng
0348ef6e22 fix UAF 2023-08-26 16:13:17 +08:00
Haojun Liao
b7c36bbfe4 fix(stream): fix the status error. 2023-08-26 00:49:23 +08:00
yihaoDeng
22b8d90fbc fix invalid read 2023-08-25 18:34:11 +08:00
Haojun Liao
ef3e2737f4 fix(stream): fix syntax error. 2023-08-25 17:39:31 +08:00
yihaoDeng
a02b35ed86 fix compile error 2023-08-25 09:02:56 +00:00
Haojun Liao
60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
Haojun Liao
35193020dd fix(stream): add logs. 2023-08-25 10:18:06 +08:00
Haojun Liao
ce1a3a379c fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived. 2023-08-25 10:12:12 +08:00
Ganlin Zhao
af130cc92f Revert "add seperate function for createLogs" 
This reverts commit 13d2d72bb6.
 2023-08-25 09:55:50 +08:00
Haojun Liao
f7ea875af1 fix(stream): add some logs. 2023-08-24 23:27:48 +08:00
Haojun Liao
f7dada53b9
Merge pull request #22559 from taosdata/fix/liaohj 
other: merge main.
 2023-08-24 19:01:18 +08:00
Haojun Liao
218e2cc5f3 fix(stream): invoke the timer when not sending hb. 2023-08-24 18:27:09 +08:00
Haojun Liao
82e356a9b5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/vnode/src/tq/tq.c
 2023-08-24 18:04:44 +08:00
Haojun Liao
70396aa5a5 fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure. 2023-08-24 17:54:50 +08:00
yihaoDeng
8883d66227 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-24 17:20:12 +08:00
yihaoDeng
090515c684 refactor code 2023-08-24 17:20:04 +08:00
Ganlin Zhao
13d2d72bb6 add seperate function for createLogs 2023-08-24 14:56:14 +08:00
Haojun Liao
a750eb9699 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-24 11:43:32 +08:00
Haojun Liao
957c7f872b fix(stream): update the agg task status check, when transferring state. 2023-08-24 11:43:18 +08:00
liuyao
1e108c4178 mem leak 2023-08-24 11:34:43 +08:00
liuyao
7ebce2814f mem leak 2023-08-24 11:19:59 +08:00
yihaoDeng
3afea998ac refactor log 2023-08-24 10:15:15 +08:00
Ganlin Zhao
962a0cd403 fix 2023-08-23 23:34:02 +08:00
yihaoDeng
0959758bd5 fix transfer error 2023-08-23 21:43:10 +08:00
Haojun Liao
8e07703dd2 fix(stream): reset the timerActive value. 2023-08-23 18:26:07 +08:00
Haojun Liao
809d3087ff Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
 2023-08-23 17:53:50 +08:00
Haojun Liao
230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
yihaoDeng
1ffc13d391 fix mem leak 2023-08-23 17:02:12 +08:00
Haojun Liao
f8a3cdb987 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-23 14:10:56 +08:00
Haojun Liao
b0c5fa8290 fix(stream): reset the task status. 2023-08-23 14:10:41 +08:00
yihaoDeng
ab407c58b6 add log 2023-08-23 10:54:50 +08:00
yihaoDeng
12b10dfc76 fix mem leak 2023-08-23 09:08:37 +08:00
yihaoDeng
5fe7563a13 fix mem leak 2023-08-22 21:13:02 +08:00
yihaoDeng
ba5c3648db fix mem leak 2023-08-22 21:12:54 +08:00
Haojun Liao
57ef43ba18 fix(stream): set sink task status to enable the checkpoint. 2023-08-22 18:16:46 +08:00
yihaoDeng
ab9490101f Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 18:04:04 +08:00
Haojun Liao
af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao
e6b49b45d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 13:37:50 +08:00
Haojun Liao
cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
yihaoDeng
2c1ca6d325 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 10:51:39 +08:00
yihaoDeng
d106b5a87e Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-22 10:48:30 +08:00
yihaoDeng
a0fd56c84f fix invalid cmp 2023-08-22 10:48:15 +08:00
Haojun Liao
64556c9f1d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 10:47:02 +08:00
Haojun Liao
def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
yihaoDeng
0304ad88ff fix invalid cmp 2023-08-22 09:49:04 +08:00
yihaoDeng
fdd62e53d8 fix invalid cmp 2023-08-22 09:11:56 +08:00
yihaoDeng
2268114c4a fix invalid cmp 2023-08-22 09:10:48 +08:00
yihaoDeng
55f1d464ab fix invalid cmp 2023-08-22 09:06:42 +08:00
yihaoDeng
3e944d228b refactor checkpoint 2023-08-21 21:48:06 +08:00
Haojun Liao
082882b71e fix(stream): reset the upstream stage info. 2023-08-21 19:29:03 +08:00
Haojun Liao
8b27f98ee4 refactor: do some internal refactor. 2023-08-21 19:08:27 +08:00
yihaoDeng
387b4d365e refactor checkpoint 2023-08-21 19:07:15 +08:00
yihaoDeng
bf3c401a68 refactor checkpoint 2023-08-21 12:52:00 +08:00
Haojun Liao
99024e9d78 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-21 11:49:08 +08:00
Haojun Liao
29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
yihaoDeng
9ef69dd455 refactor checkpoint 2023-08-21 10:27:47 +08:00
yihaoDeng
1c5346b13c refactor checkpoint 2023-08-19 16:10:03 +08:00
yihaoDeng
52788aca1c fix checkpoint error 2023-08-19 12:25:22 +08:00
yihaoDeng
fbdea723b0 fix checkpoint error 2023-08-19 11:58:12 +08:00
Haojun Liao
718bb4a881 fix(stream): fix the invalid free. 2023-08-18 22:40:04 +08:00
yihaoDeng
8e4411c144 fix checkpoint error 2023-08-18 21:42:35 +08:00
Haojun Liao
4b10393c81 fix(stream): fix memory leak and do some internal refactor. 2023-08-18 18:02:08 +08:00
yihaoDeng
3a3385bb84 fix mem leak 2023-08-18 17:01:57 +08:00
yihaoDeng
0537323bac fix get error 2023-08-18 16:54:33 +08:00
Haojun Liao
c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
liuyao
9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao
87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
Haojun Liao
10872240ae
Merge pull request #22476 from taosdata/fix/3_liaohj 
fix(stream): pause when outputQ is blocked.
 2023-08-18 15:12:54 +08:00
Haojun Liao
3ec28ca5e1 Merge branch 'enh/triggerCheckPoint2' of github.com:taosdata/tdengine into enh/triggerCheckPoint2 2023-08-18 15:11:19 +08:00
Haojun Liao
edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
yihaoDeng
ac10f0f9b4 add trace log 2023-08-18 12:06:41 +08:00
Haojun Liao
a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao
2a9668da67 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
 2023-08-18 10:30:30 +08:00
Haojun Liao
87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
yihaoDeng
002d5979c1 add trace log 2023-08-17 21:13:03 +08:00
yihaoDeng
ebd4cac36b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-17 18:58:18 +08:00
yihaoDeng
46574c385f fix mem leak 2023-08-17 18:52:33 +08:00
Haojun Liao
a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
Haojun Liao
9e9d83d4a1 refactor: do some internal refactor 2023-08-17 11:57:04 +08:00
Haojun Liao
bb4f8515bd fix(stream): pause when outputQ is blocked. 2023-08-17 11:53:17 +08:00
Haojun Liao
58c0a3d8ef fix(stream): fix syntax error. 2023-08-17 09:13:37 +08:00
Haojun Liao
eb76b6f175 fix(stream): fix syntax error. 2023-08-17 09:11:32 +08:00
liuyao
5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
Haojun Liao
6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
 2023-08-17 00:08:44 +08:00
Haojun Liao
ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
yihaoDeng
114df7c349 fix transfer error 2023-08-16 11:37:15 +00:00
Haojun Liao
59d5858b95 fix(stream): fix a typo 2023-08-16 19:22:45 +08:00
Haojun Liao
9a76ae72d6 fix(stream): add the back pressure for sink node. 2023-08-16 19:11:43 +08:00
Haojun Liao
ec84d7fd81 fix(stream): add the back pressure for sink node. 2023-08-16 19:00:35 +08:00
yihaoDeng
ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
Haojun Liao
d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
yihaoDeng
993ae84398 close backend 2023-08-16 07:17:15 +00:00
yihaoDeng
7815e44655 fix invalid free 2023-08-16 09:48:11 +08:00
Haojun Liao
ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao
7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
yihaoDeng
7fd918962f fix invalid free 2023-08-16 00:53:10 +00:00
Haojun Liao
9551fcf7bb fix(tsdb): check the 2023-08-15 20:57:12 +08:00
Haojun Liao
13640f5f53 other 2023-08-15 20:46:06 +08:00
Haojun Liao
6d7b6fbb74 other: add some logs. 2023-08-15 20:01:53 +08:00
liuyao
19dfcf3a59 refactor stream scan log 2023-08-15 16:29:48 +08:00
Haojun Liao
39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Haojun Liao
71c3c710e6 fix(stream): continue process when met with trans-state msg. 2023-08-15 14:23:20 +08:00
Haojun Liao
0acb00c516 fix(stream): add log. 2023-08-15 11:48:56 +08:00
Haojun Liao
c9f3e0b0e1 fix(stream): fix an syntax error. 2023-08-15 09:34:19 +08:00
Haojun Liao
fe5e48b87d fix(stream): remove redundant include. 2023-08-15 09:26:35 +08:00
Haojun Liao
b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao
a334547726 fix(stream): fix an syntax error. 2023-08-14 19:28:36 +08:00
Haojun Liao
1a08ffc79f fix(stream): check error. 2023-08-14 19:27:09 +08:00
Haojun Liao
5d3232d275 fix(stream): fix an syntax error. 2023-08-14 18:14:32 +08:00
Haojun Liao
2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
Haojun Liao
a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Haojun Liao
91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Haojun Liao
e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
Haojun Liao
2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
Haojun Liao
98f40325e9 fix(stream): fix memory leak. 2023-08-13 20:02:15 +08:00
Haojun Liao
a81cc9aebf fix(stream): fix the error when no agg tasks exist. 2023-08-13 17:31:09 +08:00
Haojun Liao
0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao
0e189f70a1 refactor 2023-08-12 19:44:44 +08:00
Haojun Liao
03c26a9d6d refactor 2023-08-12 19:16:20 +08:00
Haojun Liao
afe9b848a5 fix(tsdb): check the 2023-08-12 18:54:39 +08:00
Haojun Liao
09da6c6840 refactor: do some internal refactor. 2023-08-12 18:51:20 +08:00
Haojun Liao
75e6fb0f16 refactor: do some internal refactor. 2023-08-12 18:47:01 +08:00
Haojun Liao
075b5e9481 refactor: do some internal refactor. 2023-08-12 18:41:54 +08:00
Haojun Liao
a0534ee715 refactor: do some internal refactor. 2023-08-12 18:40:09 +08:00
Haojun Liao
8f9de93cf0 refactor: do some internal refactor. 2023-08-12 18:37:36 +08:00
Haojun Liao
30c2a9c619 refactor: do some internal refactor. 2023-08-12 18:27:51 +08:00
Haojun Liao
0d0e30b764 fix(stream): fix the error. 2023-08-12 17:20:10 +08:00
Haojun Liao
ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
Haojun Liao
a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
Haojun Liao
f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
Haojun Liao
87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng
6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao
e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
Haojun Liao
4afe603c6e fix(stream): fix error. 2023-08-11 14:17:09 +08:00
yihaoDeng
99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao
1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao
6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng
ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
yihaoDeng
32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
Haojun Liao
8890fa5781 fix(stream): execute the stream task directly, instead of executing it in a asynchronized way. 2023-08-10 15:13:49 +08:00
yihaoDeng
b2fb94d7f8 Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer 2023-08-10 14:57:25 +08:00
yihaoDeng
ea00f676fc Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer 2023-08-10 14:57:12 +08:00
yihaoDeng
100d2240c3 support reopen stream state 2023-08-10 06:35:25 +00:00
Haojun Liao
a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
Haojun Liao
f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao
b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-10 11:43:02 +08:00
yihaoDeng
ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao
c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao
4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao
0cf8144952 fix(stream): fix the invalid key used by remove data in stream meta hash table. 2023-08-09 22:28:23 +08:00
yihaoDeng
a20b299f9b support reopen stream state 2023-08-09 13:06:10 +00:00
yihaoDeng
19ac9054d0 support reopen stream state 2023-08-09 12:47:49 +00:00
Haojun Liao
d34b9af054 enh(stream): create update stream trans. 2023-08-09 19:38:13 +08:00
yihaoDeng
1db15da4e1 support reopen stream state 2023-08-09 09:50:49 +00:00
yihaoDeng
6fdcd82a33 support reopen stream state 2023-08-09 09:19:03 +00:00
yihaoDeng
f3cf907d5a support reopen stream state 2023-08-09 09:07:13 +00:00
yihaoDeng
a336a7b1a4 support reopen stream state 2023-08-09 09:06:22 +00:00
yihaoDeng
a619b8f5be rm duplicate para 2023-08-09 08:58:49 +00:00
Haojun Liao
1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao
4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
yihaoDeng
92b247aae8 support reopen stream state 2023-08-09 07:36:00 +00:00
yihaoDeng
bbcfa9ab03 support reopen stream state 2023-08-09 06:10:40 +00:00
Haojun Liao
3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
Haojun Liao
f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
yihaoDeng
c43a6b272c support reopen stream state 2023-08-09 02:09:50 +00:00
yihaoDeng
ac11537fc8 support reopen stream state 2023-08-08 07:21:47 +00:00
Haojun Liao
17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Haojun Liao
a0dcec5890 enh(stream): add function handler for hb message. 2023-08-08 11:23:19 +08:00
Haojun Liao
db8ce3de3b other: merge main. 2023-08-08 10:17:51 +08:00
Haojun Liao
327e13c3f7 fix(stream): fix the syntax error. 2023-08-08 10:07:28 +08:00
Haojun Liao
d6d63ec54c fix(stream): add more check. 2023-08-08 09:54:49 +08:00
Haojun Liao
e89d3c18d6 fix(stream): remove invalid check. 2023-08-08 09:54:46 +08:00
Haojun Liao
ac00e1d520 fix(stream): fetch all data before paused and dump to sink node. 2023-08-08 09:54:43 +08:00
Haojun Liao
0e3fd5277d fix(stream): dump results to sink node before paused. 2023-08-08 09:54:39 +08:00
Haojun Liao
1e680d4df1 fix(stream): ignore the sink task transfer state. 2023-08-08 09:52:19 +08:00
Haojun Liao
3bcc7ed83e fix(stream): transfer the state for agg tasks. 2023-08-08 09:52:04 +08:00
Haojun Liao
d43cb3fcdf fix(stream): kill task when pause the stream execution. 2023-08-08 09:51:21 +08:00
Haojun Liao
ca2183acfd refactor: do some internal refactor. 2023-08-08 09:50:40 +08:00
Haojun Liao
82ab81810b refactor: do some internal refactor. 2023-08-08 09:40:21 +08:00
Haojun Liao
51e0b903b0 refactor: do some internal refactor. 2023-08-08 09:36:42 +08:00
Haojun Liao
af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
Haojun Liao
f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao
ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj 
other: merge main and fix bugs in stop stream tasks.
 2023-08-07 22:57:13 +08:00
Haojun Liao
85756e4404
Merge pull request #22353 from taosdata/fix/liaohj 
fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.
 2023-08-07 22:57:08 +08:00
yihaoDeng
6b73fc9c06 support reopen stream state 2023-08-07 13:56:53 +00:00
yihaoDeng
80e78e054d support reopen stream state 2023-08-07 11:39:32 +00:00
Haojun Liao
2da67392c6 fix(stream): commit the update to make sure the new state of tasks will be persistent to disk. 2023-08-07 19:30:23 +08:00
yihaoDeng
6a69c56b32 support reopen stream state 2023-08-07 10:55:42 +00:00
yihaoDeng
6c8c575549 support reopen stream state 2023-08-07 10:48:04 +00:00
Haojun Liao
aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
yihaoDeng
b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng
eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao
225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
yihaoDeng
7ef4df8752 support reopen stream state 2023-08-07 07:20:05 +00:00
Haojun Liao
7924d7e0af
Merge pull request #22337 from taosdata/fix/fixInvalidFree 
fix invalid free
 2023-08-07 11:45:29 +08:00
Haojun Liao
a8006d3d0d
Merge pull request #22278 from taosdata/fix/fixStateMemleak 
fix state mem leak
 2023-08-07 11:45:16 +08:00
yihaoDeng
4ca39d0f3c support reopen stream state 2023-08-07 01:45:16 +00:00
Haojun Liao
8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
yihaoDeng
7396799d90 fix invalid free 2023-08-04 19:06:16 +08:00
yihaoDeng
36e841b6d0 fix invalid free 2023-08-04 18:59:17 +08:00
Hui Li
f19826fa9d
Merge pull request #22313 from taosdata/fix/addStreamVer 
add stream verion
 2023-08-04 17:36:21 +08:00
yihaoDeng
a4da6e9a88 fix mem leak 2023-08-04 15:59:34 +08:00
yihaoDeng
81908be32f add stream ver 2023-08-04 14:02:03 +08:00
yihaoDeng
6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
liuyao
9cb481dd6e use stream task 2023-08-04 11:01:36 +08:00
yihaoDeng
f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
liuyao
3464979489 set dummy delete data request 2023-08-03 09:03:48 +08:00
yihaoDeng
918eca4d22 fix state mem leak 2023-08-02 03:31:11 +00:00
yihaoDeng
6cdf94fec0 fix state mem leak 2023-08-02 03:29:13 +00:00
yihaoDeng
d9fd95777a fix state mem leak 2023-08-02 03:21:39 +00:00
yihaoDeng
83468a7710 fix state mem leak 2023-08-02 03:18:59 +00:00
Haojun Liao
13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
liuyao
71b000f08c reload state window state 2023-08-01 18:22:40 +08:00
Haojun Liao
ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Haojun Liao
164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
yihaoDeng
111481cef9 fix state mem leak 2023-08-01 08:09:10 +00:00
Haojun Liao
6365d5000b
Merge pull request #22271 from taosdata/fix/3_liaohj 
fix(stream): dump results to sink node before paused.
 2023-08-01 15:50:17 +08:00
Haojun Liao
f1e0e64918 fix(stream): add more check. 2023-08-01 14:31:41 +08:00
Haojun Liao
75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Haojun Liao
e11cda17c0 fix(stream): remove invalid check. 2023-08-01 10:30:24 +08:00
Haojun Liao
f6ae9cf9bb fix(stream): fetch all data before paused and dump to sink node. 2023-08-01 10:16:14 +08:00
Haojun Liao
b83860372c fix(stream): dump results to sink node before paused. 2023-08-01 00:50:30 +08:00
Haojun Liao
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457 
check update data
 2023-07-31 22:56:05 +08:00
Haojun Liao
8c1c17e31e fix(stream): ignore the sink task transfer state. 2023-07-31 19:23:53 +08:00
Haojun Liao
d72580dad7 fix(stream): transfer the state for agg tasks. 2023-07-31 19:12:23 +08:00
Haojun Liao
d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
liuyao
32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
Haojun Liao
9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao
e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
Haojun Liao
cc5ff44604 enh(stream): handle the stream hb. 2023-07-30 19:25:00 +08:00
Haojun Liao
8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao
0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
Haojun Liao
f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
Haojun Liao
92d1dbd9ad fix(stream): set the time window filter before generating create table result. 2023-07-29 01:23:06 +08:00
Haojun Liao
6c9fa4d7c8 fix(stream): check for pause when handling the fill history data. 2023-07-28 19:58:52 +08:00
Haojun Liao
936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao
d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
Haojun Liao
9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao
74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao
2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj 
other: merge main.
 2023-07-28 13:06:17 +08:00
Haojun Liao
ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj 
fix(stream): scan wal in step2
 2023-07-28 00:42:15 +08:00
Haojun Liao
22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
liuyao
5d21f50340 adjust history task trigger mode 2023-07-27 17:45:28 +08:00
Haojun Liao
6319cb8dd4 fix: fix syntax error. 2023-07-27 17:16:45 +08:00
Haojun Liao
b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao
3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao
6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
Haojun Liao
40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Haojun Liao
e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
yihaoDeng
287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
liuyao
c368db30c3 stream fill operator mem leak 2023-07-26 17:38:37 +08:00
Haojun Liao
cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Haojun Liao
728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
Haojun Liao
12986ff594 fix(stream): fix memory leaks. 2023-07-26 09:25:30 +08:00
yihaoDeng
22c85fcbad fix stream state transfer 2023-07-25 13:07:49 +00:00
yihaoDeng
0c2e86f416 fix stream state transfer 2023-07-25 10:17:30 +00:00
Haojun Liao
1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
Haojun Liao
063673726a fix(stream): fix syntax error 2023-07-25 18:08:22 +08:00
Haojun Liao
2cc4e0a727 fix(stream): fix syntax error 2023-07-25 17:56:40 +08:00
Haojun Liao
0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Haojun Liao
d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
Haojun Liao
f3f1fade43 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-25 09:25:32 +08:00
Haojun Liao
c116b69941 fix(stream): fix memory leak. 2023-07-25 09:25:18 +08:00
Haojun Liao
a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
yihaoDeng
fe262d308e del wal 2023-07-24 11:10:15 +00:00
Haojun Liao
1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Haojun Liao
9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
yihaoDeng
6a27e81964 fix stream state transfer 2023-07-24 02:05:14 +00:00
Haojun Liao
1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao
0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao
e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao
4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao
9679cc4527 fix(stream): fix race condition. 2023-07-22 10:19:51 +08:00
Haojun Liao
f4864b8713 fix(stream): fix memory leak. 2023-07-22 01:02:58 +08:00
Haojun Liao
bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao
1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao
16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
Haojun Liao
39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
Haojun Liao
bd8b811b9d refactor: do some internal refactor. 2023-07-21 09:14:25 +08:00
Haojun Liao
0d1c4f9ee2 fix(stream): fix syntax error 2023-07-21 09:13:06 +08:00
Haojun Liao
db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng
82df77eba8 fix stream state transfer 2023-07-20 11:52:31 +00:00
yihaoDeng
fc2d6744e2 fix stream state transfer 2023-07-20 10:52:34 +00:00
yihaoDeng
519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Haojun Liao
c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao
45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao
87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao
aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng
6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
yihaoDeng
733db123ad refactor code 2023-07-19 13:24:59 +00:00
Haojun Liao
97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
liuyao
8481725517 remove redundant results 2023-07-19 14:58:28 +08:00
Haojun Liao
a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao
2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao
fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
Haojun Liao
9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
Haojun Liao
5b29a5ec97 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 18:30:10 +08:00
Haojun Liao
902f9d1f94 fix(stream): set not-ready initial value. 2023-07-18 18:29:35 +08:00
yihaoDeng
039befa3d6 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-18 10:15:20 +00:00
yihaoDeng
790101ced2 fix mem leak 2023-07-18 10:14:04 +00:00
Haojun Liao
d2c875e774 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 15:19:09 +08:00
Haojun Liao
901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
yihaoDeng
95b8754dab Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-18 04:03:56 +00:00
yihaoDeng
40d59990d8 fix mem leak 2023-07-18 04:01:20 +00:00
Haojun Liao
92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
Haojun Liao
2f24f776fb fix(stream): fix error in generating checkpoint for state_window. 2023-07-18 09:04:28 +08:00
yihaoDeng
40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
Haojun Liao
14b9d920ba fix(stream): fix memory leak. 2023-07-17 16:02:41 +08:00
Haojun Liao
08f43b9d00 fix(stream): fix checkpoint block not fetched bug. 2023-07-17 15:31:54 +08:00
yihaoDeng
394cc771e5 add checkpoint 2023-07-17 06:47:23 +00:00
yihaoDeng
f0f2215f49 add checkpoint 2023-07-17 06:21:45 +00:00
yihaoDeng
3168096e40 add checkpoint 2023-07-17 06:06:21 +00:00
yihaoDeng
e0bb3c8f94 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-17 05:26:57 +00:00
yihaoDeng
f7732ddd18 recoverSnapshot 2023-07-17 05:26:30 +00:00
Haojun Liao
4dd93494d1 fix(stream): fix syntax error 2023-07-17 13:23:06 +08:00
Haojun Liao
d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
yihaoDeng
5adf580764 add checkpoint 2023-07-17 03:44:06 +00:00
Haojun Liao
8c8b1a6d79 fix(stream): handle block before checkpoint msg in the inputQ. 2023-07-17 10:47:05 +08:00
yihaoDeng
dea2e73d2e add checkpoint 2023-07-17 02:22:21 +00:00
Haojun Liao
a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao
c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng
b4de0892e6 add checkpoint 2023-07-15 09:35:33 +00:00
yihaoDeng
7b4185dc56 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-15 04:27:39 +00:00
yihaoDeng
e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
yihaoDeng
aad669e33c add checkpoint 2023-07-14 14:46:13 +00:00
Haojun Liao
725db16af9 fix(stream): set save checkpoint ver. 2023-07-14 19:47:19 +08:00
Haojun Liao
035b199497 refactor(stream): do some internal refactor. 2023-07-14 18:46:38 +08:00
Haojun Liao
6798e31bb5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 18:35:53 +08:00
Haojun Liao
8c79157822 fix(stream): close the inputQ if checkpoint msg received. 2023-07-14 18:35:41 +08:00
yihaoDeng
3020e27114 fix mem leak 2023-07-14 10:20:37 +00:00
yihaoDeng
ed931c1100 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-14 10:11:20 +00:00
yihaoDeng
3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
Haojun Liao
2b85ea62aa refactor: do some internal refactor. 2023-07-14 17:48:47 +08:00
Haojun Liao
b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao
eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
yihaoDeng
be050e12ea fix recover error 2023-07-14 15:46:00 +08:00
yihaoDeng
d0ccbd48d2 fix coverity scan problem 2023-07-14 14:54:20 +08:00
yihaoDeng
49b21b3ccb fix coverity scan problem 2023-07-14 14:53:11 +08:00
yihaoDeng
2279706357 fix coverity scan problem 2023-07-14 14:49:02 +08:00
yihaoDeng
15f5fd19eb fix recover error 2023-07-14 14:47:06 +08:00
yihaoDeng
e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
liuyao
c3375dd744 mem leak 2023-07-13 19:24:11 +08:00
Haojun Liao
e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj 
other: merge main
 2023-07-13 17:55:28 +08:00
Haojun Liao
2fd72500e2 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-13 16:32:37 +08:00
Haojun Liao
813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
liuyao
ec2134f758 op ci 2023-07-13 16:24:38 +08:00
yihaoDeng
9e128b92f8 fix recover error 2023-07-13 16:17:18 +08:00
yihaoDeng
1307776786 fix recover error 2023-07-13 16:09:34 +08:00
yihaoDeng
9434b4eaac fix recover error 2023-07-13 16:07:58 +08:00
yihaoDeng
18f9882834 fix recover error 2023-07-13 16:06:23 +08:00
Haojun Liao
66d577d134 fix(stream): abort exec when task is dropped. 2023-07-13 15:04:39 +08:00
yihaoDeng
b7403cd171 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-13 10:38:34 +08:00
yihaoDeng
0e1a91d134 fix compile error 2023-07-13 10:38:21 +08:00
Haojun Liao
af7f78ada2 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-13 10:17:10 +08:00
Haojun Liao
2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
yihaoDeng
f3f3893872 fix compile error 2023-07-13 10:05:29 +08:00
yihaoDeng
2ec67bcc08 rm expire checkpoint 2023-07-13 10:00:16 +08:00
Haojun Liao
773ae39d33 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamCheckpoint.c
 2023-07-13 09:17:51 +08:00
Haojun Liao
08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
yihaoDeng
82468f162a Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-12 16:43:56 +08:00
yihaoDeng
e1de4984a6 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-12 16:39:19 +08:00
yihaoDeng
bb72f07a94 rm expire checkpoint 2023-07-12 16:38:46 +08:00
Haojun Liao
3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao
d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
liuyao
7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
Haojun Liao
9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
Haojun Liao
a049e310f6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 10:16:26 +08:00
Haojun Liao
6f2fc4fab3 fix(stream): commit task meta after do vnode-wide checkpoint. 2023-07-12 10:16:14 +08:00
Haojun Liao
fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
liuyao
6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
yihaoDeng
503d7540f7 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-11 16:31:07 +08:00
yihaoDeng
e547ed3699 rm expire checkpoint 2023-07-11 16:30:14 +08:00
Haojun Liao
da6a4de021 fix(stream): disable invalid set normal task status. 2023-07-11 15:12:34 +08:00
Haojun Liao
09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
Haojun Liao
571cccd737 refactor: do some internal refactor. 2023-07-11 11:41:37 +08:00
Haojun Liao
62a763ead3 fix(stream): fix invalid assert. 2023-07-11 11:22:48 +08:00
Haojun Liao
a803eaee3e fix(stream): fix concurrent bug in save task meta. 2023-07-11 10:01:43 +08:00
Haojun Liao
a571663a5d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamExec.c
 2023-07-11 09:53:41 +08:00
Haojun Liao
cbda61c7f9 fix(stream): fix error in checkpointing. 2023-07-11 09:53:08 +08:00
yihaoDeng
c056e34534 fix compile error 2023-07-11 09:39:58 +08:00
Haojun Liao
3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao
a6cd702676 fix(stream): supress the warning 2023-07-11 08:54:11 +08:00
Haojun Liao
8a6a876f67 fix(stream): fix error in generating checkpoint. 2023-07-10 22:53:15 +08:00
Haojun Liao
87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao
ab5b2fe0a8 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-10 18:21:02 +08:00
Haojun Liao
385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
yihaoDeng
e263d5f55f add checkpoint 2023-07-10 17:33:48 +08:00
Haojun Liao
d6e7e6e174 fix(stream): fix typo. 2023-07-10 14:57:28 +08:00
Haojun Liao
16ee72ab06 fix(stream): free msg after send checkpoint rsp. 2023-07-10 13:57:51 +08:00
Haojun Liao
f6515e2a2c fix(stream): fix error in checkpointing. 2023-07-10 11:43:37 +08:00
Haojun Liao
5940bbfb33 fix(stream): set correct datablock. 2023-07-10 10:42:38 +08:00
Haojun Liao
9ad5e05751 fix(stream): fix error in checking status. 2023-07-10 10:24:04 +08:00
Haojun Liao
e8eba3175a fix(stream): fix error in checking status. 2023-07-10 10:23:05 +08:00
Haojun Liao
dd15ca6103 fix(stream): add missing status check. 2023-07-10 10:06:21 +08:00
Haojun Liao
ed1181a1d1 fix(stream): fix invalid read bug. 2023-07-10 09:55:29 +08:00
Haojun Liao
4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao
a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao
ab4e2ebc3a fix(stream): fix bug that causes the endless loop. 2023-07-07 21:45:22 +08:00
Haojun Liao
9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
Haojun Liao
b03ca31a7f fix(stream): fix error in generating checkpoint. 2023-07-07 17:21:46 +08:00
Haojun Liao
8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
Haojun Liao
47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
Haojun Liao
4f814db5d5 fix(stream): fix error during transferring executor state, while a task is not in normal status. 2023-07-06 18:34:01 +08:00
Haojun Liao
61f3585714 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-06 18:26:44 +08:00
Haojun Liao
d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
yihaoDeng
8e9ef2a384 fix mem leak 2023-07-06 09:01:34 +00:00
liuyao
0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
Haojun Liao
5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
yihaoDeng
483f9ab896 add other 2023-07-06 03:39:28 +00:00
Haojun Liao
f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
Haojun Liao
7a417a33b0
Merge pull request #21960 from taosdata/fix/3_liaohj 
fix(stream): fix error for extract msg from inputQ
 2023-07-05 17:47:18 +08:00
Haojun Liao
1855a16981 other: merge 3.0 2023-07-05 16:12:32 +08:00
Haojun Liao
03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao
ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao
77530e1956 refactor: record the downstream input Queue blocking time. 2023-07-04 10:58:11 +08:00
yihaoDeng
e7b37486bb vnode snapshot read 2023-07-04 00:46:39 +00:00
Haojun Liao
393b36d83d Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-07-03 17:53:18 +08:00
Haojun Liao
2dbccc1573 refactor: do some internal refactor. 2023-07-03 17:52:17 +08:00
Haojun Liao
42e1cd741a
Merge pull request #21935 from taosdata/fix/3_liaohj 
fix(stream): fix message lost bug during pause stream.
 2023-07-03 17:37:56 +08:00
Haojun Liao
9e62b9d0d2 fix(stream): fix error in extract data from inputQ. 2023-07-03 15:33:08 +08:00
Haojun Liao
200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao
20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj 
fix: fix coverity issue.
 2023-07-03 15:15:21 +08:00
Haojun Liao
ceb06635fe fix(stream): fix error in pause stream. 2023-07-03 15:12:35 +08:00
Haojun Liao
f84bfc96fb fix(stream): fix error in pause in stream. 2023-07-03 14:30:11 +08:00
Haojun Liao
5d4efe1198 fix(stream): fix error in pause. 2023-07-03 11:46:05 +08:00
Haojun Liao
317a7c83c7 fix(stream): fix message lost bug during pause stream. 2023-07-03 10:55:45 +08:00
yihaoDeng
247d3ac7ee vnode snapshot read 2023-06-30 12:05:05 +00:00
yihaoDeng
7d30a6e27a vnode snapshot read 2023-06-30 11:48:46 +00:00
yihaoDeng
9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Haojun Liao
622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
dapan1121
3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
yihaoDeng
bb520b56e7 add checkpoint 2023-06-28 09:58:07 +00:00
yihaoDeng
6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
Haojun Liao
78739e4bdb fix(stream): fix syntax error. 2023-06-28 14:21:11 +08:00
Haojun Liao
57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
Haojun Liao
3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Haojun Liao
a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
Yihao Deng
4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
Haojun Liao
32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao
3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
liuyao
71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao
b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
yihaoDeng
2c1fc501ff add checkpoint 2023-06-26 12:28:42 +00:00
Haojun Liao
437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
dapan1121
4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Haojun Liao
daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
liuyao
6b8549dea5 set table name 2023-06-26 14:14:46 +08:00
yihaoDeng
9b451bc56a add checkpoint 2023-06-25 20:14:07 +08:00
yihaoDeng
52f588955b add checkpoint 2023-06-25 20:05:42 +08:00
yihaoDeng
04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao
402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
yihaoDeng
74a4a89d70 add checkpoint 2023-06-25 17:59:36 +08:00
liuyao
e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
yihaoDeng
832aed5e98 add checkpoint 2023-06-25 17:10:59 +08:00
yihaoDeng
0330f3b2db add checkpoint 2023-06-25 17:03:01 +08:00
yihaoDeng
e36de5edf7 add checkpoint 2023-06-25 14:35:20 +08:00
Haojun Liao
0322fdc1fc fix(stream): fix memory leak. 2023-06-24 23:43:43 +08:00
Haojun Liao
ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
yihaoDeng
c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
yihaoDeng
2f656f3854 add checkpoint 2023-06-21 18:04:10 +08:00
yihaoDeng
ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
yihaoDeng
e5c62cfa06 add static lib 2023-06-21 12:10:42 +08:00
liuyao
d23c80b12f free mem 2023-06-21 10:24:34 +08:00
yihaoDeng
daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
yihaoDeng
d9e24566c0 add checkpoint 2023-06-20 18:32:56 +08:00
liuyao
aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
yihaoDeng
b6d4e98e68 fix restart crash 2023-06-20 13:47:46 +08:00
yihaoDeng
f1fcc1d2f1 add checkpoint 2023-06-20 11:44:51 +08:00
liuyao
870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
yihaoDeng
5ccfae87d9 add checkpoint 2023-06-19 20:49:04 +08:00
yihaoDeng
548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
liuyao
41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
yihaoDeng
0eeaab9cd3 Merge branch 'refact/fillhistory1' into refact/fillhistory 2023-06-19 13:53:37 +08:00
yihaoDeng
fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
yihaoDeng
b6fe5d917b refactor checkpoint 2023-06-17 14:05:49 +08:00
Haojun Liao
64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
yihaoDeng
1e05f5c693 support fill history 2023-06-16 10:00:16 +08:00
yihaoDeng
f4b9d630c0 support fill history 2023-06-16 09:36:44 +08:00
yihaoDeng
0ef8afbdaa support fill history 2023-06-16 09:32:38 +08:00
yihaoDeng
8cb8c05428 support fill history 2023-06-15 21:55:46 +08:00
yihaoDeng
9f9171719a support fill history 2023-06-15 21:29:52 +08:00
Haojun Liao
74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
liuyao
693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao
1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao
13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Haojun Liao
53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Yihao Deng
7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
yihaoDeng
52ca94ea6d trigger checkpoint 2023-06-14 16:20:14 +08:00
liuyao
9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Haojun Liao
7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
yihaoDeng
ee3017ed3a add static lib 2023-06-14 12:14:49 +08:00
Haojun Liao
11f0c3b336 refactor: do some internal refactor. 2023-06-14 10:46:46 +08:00
Haojun Liao
5282492663 refactor: do some internal refactor. 2023-06-14 10:35:03 +08:00
Haojun Liao
b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao
97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
Haojun Liao
fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
yihaoDeng
83dde6a212 add trigger checkpoint 2023-06-12 14:33:08 +00:00
Haojun Liao
78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
yihaoDeng
ae7d5c79e5 fix invald read/write 2023-06-12 02:24:49 +00:00
yihaoDeng
a2030dc378 add trigger checkpoint 2023-06-09 12:12:51 +00:00
yihaoDeng
a0c2897124 add trigger checkpoint 2023-06-09 10:46:03 +00:00
yihaoDeng
d38e3835c0 opt batch write 2023-06-09 08:12:39 +00:00
yihaoDeng
06b65ce5c1 opt batch write 2023-06-09 07:49:43 +00:00
Haojun Liao
69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao
53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
yihaoDeng
a67ef8ce91 opt batch write 2023-06-09 01:27:08 +00:00
yihaoDeng
d5c0ca3163 opt batch write 2023-06-08 13:36:52 +00:00
Haojun Liao
0fd11aaefe other: add some logs. 2023-06-08 19:14:36 +08:00
Haojun Liao
c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Haojun Liao
6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
yihaoDeng
9828ca9d7f add trigger checkpoint 2023-06-08 09:28:34 +00:00
Haojun Liao
6c13491428 refactor: do some internal refactor. 2023-06-08 16:55:41 +08:00
Haojun Liao
2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
yihaoDeng
8b91617145 Merge branch 'enh/dv3' into enh/triggerCheckpoint 2023-06-08 07:20:41 +00:00
Haojun Liao
30eba472c3
Merge pull request #21602 from taosdata/fix/TD-24600-dv3 
fix/td-24600-dv3
 2023-06-08 13:42:02 +08:00
yihaoDeng
9b749b8faa change link op t 2023-06-08 02:43:44 +00:00
Haojun Liao
cb26dd9fa2 refactor(stream): do some internal refactor. 2023-06-08 10:17:21 +08:00
yihaoDeng
79b628101c add trigger checkpoint 2023-06-07 14:32:22 +00:00
Haojun Liao
9abe47ff93
Merge pull request #21638 from taosdata/enh/changeLinkOpt 
change link opt
 2023-06-07 19:07:06 +08:00
Haojun Liao
06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
yihaoDeng
4fa1cc6dd3 change link opt 2023-06-07 05:26:07 +00:00
Haojun Liao
7bf07b78b2 fix(client): remove dependency 2023-06-07 11:36:01 +08:00
liuyao
1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
Haojun Liao
6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
yihaoDeng
66f483e51a fix invalid free 2023-06-06 02:32:06 +00:00
yihaoDeng
c6242fee01 fix invalid free 2023-06-05 10:54:02 +00:00
yihaoDeng
cb024ca069 fix invalid free 2023-06-05 10:52:07 +00:00
Haojun Liao
0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
yihaoDeng
63c4929089 fix invalid free 2023-06-05 08:42:00 +00:00
Haojun Liao
e8549ce511 refactor: do some internal refactor. 2023-06-05 16:19:37 +08:00
Haojun Liao
fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
yihaoDeng
c77f7f65d2 fix invalid free 2023-06-05 07:32:28 +00:00
yihaoDeng
3108ecf84b fix invalid free 2023-06-05 06:38:17 +00:00
yihaoDeng
74d5f02969 fix invalid free 2023-06-05 04:56:07 +00:00
Haojun Liao
077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Haojun Liao
044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao
cb7bb954b5
Merge pull request #21577 from taosdata/fix/TD-24515 
reset unclosed window info
 2023-06-03 11:21:06 +08:00
yihaoDeng
9e0392ff59 fix mem leak 2023-06-03 09:17:05 +08:00
yihaoDeng
7244ab1f6b fix mem leak 2023-06-03 08:28:21 +08:00
yihaoDeng
81fe174aa2 fix mem leak 2023-06-03 08:19:59 +08:00
yihaoDeng
5063c175f4 fix mem problem 2023-06-02 23:47:14 +08:00
yihaoDeng
3ec700e0f7 fix mem problem 2023-06-02 22:25:38 +08:00
yihaoDeng
e48e485b6c update default buffer 2023-06-02 11:56:24 +00:00
yihaoDeng
6ee68331b3 update DEFAULT_BUFF 2023-06-02 11:54:36 +00:00
Haojun Liao
cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
liuyao
17f2c3f882 reset wind info 2023-06-02 18:27:22 +08:00
yihaoDeng
449051cda6 avoid mem leak 2023-06-02 10:05:32 +00:00
wangmm0220
56f7a137ee fix:conflict 2023-06-02 15:47:53 +08:00
wangmm0220
b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
Haojun Liao
6a9c03309e
Merge pull request #21553 from taosdata/enh/changeRocksParam 
change log level
 2023-06-02 14:23:50 +08:00
Haojun Liao
cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao
f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
yihaoDeng
63d9a5dcf3 avoid mem leak 2023-06-02 04:08:08 +00:00
Haojun Liao
27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
yihaoDeng
becc5c51a4 fix compatibility 2023-06-02 02:35:15 +00:00
yihaoDeng
420ae73728 Avoid creating the same ID task multiple times 2023-06-02 00:35:45 +00:00
yihaoDeng
1571ea844a Avoid creating the same ID task multiple times 2023-06-01 11:25:55 +00:00
yihaoDeng
0315e89591 Avoid creating the same ID task multiple times 2023-06-01 11:13:01 +00:00
yihaoDeng
64edab6302 refactor code 2023-06-01 07:51:52 +00:00
Haojun Liao
91de00597d refactor: do some internal refactor. 2023-05-31 22:12:14 +08:00
Haojun Liao
46f731e4d9
Merge pull request #21551 from taosdata/fix/resume_mem 
fix(query): check the version range when dump partial rows. #TD-24504
 2023-05-31 21:51:07 +08:00
Haojun Liao
ccc86f9916 refactor: do some internal refactor. 2023-05-31 19:36:34 +08:00
Haojun Liao
87deb36f8a refactor: do some internal refactor. 2023-05-31 19:36:02 +08:00
yihaoDeng
04f3784696 change log level 2023-05-31 11:05:03 +00:00
Haojun Liao
a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
Haojun Liao
65b81a803f refactor: do some internal refactor and add some logs. 2023-05-31 18:05:53 +08:00
Haojun Liao
8c240cede9
Merge pull request #21545 from taosdata/enh/changeRocksParam 
Enh/change rocks param
 2023-05-31 13:51:32 +08:00
Haojun Liao
dd9f810f81
Merge pull request #21530 from taosdata/fix/TD-24365 
fix sliding window issue
 2023-05-31 13:51:14 +08:00
yihaoDeng
3b0a6d7f0b change db param 2023-05-31 03:15:25 +00:00
yihaoDeng
67becbd4d1 change db param 2023-05-31 01:10:36 +00:00
Haojun Liao
fc20ca8423 fix(stream): set the correct rps flag as the dispatch rsp. 2023-05-30 18:42:23 +08:00
Haojun Liao
d9cc9f2157 fix(stream): remove invalid free. 2023-05-30 18:03:21 +08:00
Haojun Liao
937f67f07b fix(stream): fix invalid free. 2023-05-30 18:02:42 +08:00
Haojun Liao
e96ed81ec0 fix(stream): add input queue capacity check. 2023-05-30 17:29:01 +08:00
Haojun Liao
eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
Haojun Liao
d9c364d663 Merge branch '3.0' into refact/fillhistory 2023-05-30 15:51:12 +08:00
Haojun Liao
de7231e59e fix(stream): fix memory leak in handling dispatch msg when output buffer is full. 2023-05-30 15:35:59 +08:00
liuyao
7d699ae579 fix sliding window issue 2023-05-30 15:16:11 +08:00
Haojun Liao
2977a4d07f refactor: do some internal refactor. 2023-05-30 09:41:19 +08:00
Haojun Liao
20a0054c4a
Merge pull request #21472 from taosdata/enh/addCompileError 
change parameter
 2023-05-30 09:36:36 +08:00
yihaoDeng
e00f79367d merge 3.0 2023-05-29 18:57:21 +08:00
Haojun Liao
3628888ecc refactor: do some internal refactor. 2023-05-29 18:02:45 +08:00
Haojun Liao
cd2d225c93 refactor: do some internal refactor. 2023-05-29 17:50:39 +08:00
yihaoDeng
1782ecd57e Merge branch 'fix/shared_link_rocksdb' into enh/addCompileError 2023-05-29 08:20:11 +00:00
Haojun Liao
f2887278e2 refactor: do some internal refactor. 2023-05-29 15:44:45 +08:00
yihaoDeng
26cbcf996c Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 07:31:14 +00:00
yihaoDeng
342ce14c7d Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:37:47 +00:00
yihaoDeng
58cc631c22 Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:29:56 +00:00
yihaoDeng
0be1858b4b Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-29 01:50:43 +00:00
yihaoDeng
de739ce086 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-29 01:11:13 +00:00
yihaoDeng
2f5fe2dec6 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 14:01:05 +00:00
yihaoDeng
4b931d3007 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 13:59:16 +00:00
yihaoDeng
a71bffd719 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 13:03:35 +00:00
yihaoDeng
57a4e56a61 change parameter 2023-05-26 20:30:03 +08:00
yihaoDeng
34d21bc03f change parameter 2023-05-26 20:11:33 +08:00
liuyao
5ebe75599e fix pause issue 2023-05-26 14:58:39 +08:00
Haojun Liao
1e845acabe fix(tmq): allow seek before get assignment 2023-05-26 11:34:12 +08:00
yihaoDeng
52c384c7c9 change parameter 2023-05-26 09:06:19 +08:00
Haojun Liao
cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory 
refactor: remove the module dependency.  TD-24279
 2023-05-26 09:01:45 +08:00
Haojun Liao
30de31e374 fix(test): fix unit test link error. 2023-05-25 18:17:09 +08:00
yihaoDeng
cd44bd9f3f change parameter 2023-05-25 18:16:33 +08:00
yihaoDeng
9cb4a114e2 change parameter 2023-05-25 16:20:00 +08:00
yihaoDeng
2f90fda13d change parameter 2023-05-25 16:15:10 +08:00
Haojun Liao
0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao
01f6f74fb9 fix: update the cmake file. 2023-05-24 22:27:45 +08:00
Hongze Cheng
4d526ed0cd change more 2023-05-24 18:59:09 +08:00
Haojun Liao
fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Haojun Liao
a566180770 fix: fix syntax error. 2023-05-24 15:16:50 +08:00
Haojun Liao
1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
Haojun Liao
e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
Haojun Liao
f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Haojun Liao
9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory 
Refact/fillhistory
 2023-05-21 01:12:00 +08:00
Haojun Liao
dcb91082f9 fix(stream): fix error. 2023-05-20 23:37:40 +08:00
Haojun Liao
cb75e5a863 fix(stream): fix memory leak. 2023-05-20 22:07:04 +08:00
Haojun Liao
899e4d3350 refactor: do some internal refactor. 2023-05-20 18:13:58 +08:00
Haojun Liao
de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
Haojun Liao
3cef1e7c42 fix(stream): add some logs. 2023-05-20 15:45:07 +08:00
Haojun Liao
aa7ea60bca fix(stream): update the free strategy. 2023-05-20 15:43:48 +08:00
Haojun Liao
84146e6aaa other: merge main. 2023-05-20 15:16:51 +08:00
Haojun Liao
6932c59510 other: merge main. 2023-05-20 15:09:30 +08:00
Haojun Liao
10692fde5e other: merge main. 2023-05-20 14:53:28 +08:00
Haojun Liao
afc384bead fix:remove invalid assert. 2023-05-20 14:44:34 +08:00
Haojun Liao
484788a60f fix:add null ptr check. 2023-05-20 14:29:51 +08:00
Haojun Liao
4974ac78f7 fix: fix invalid ref. 2023-05-20 13:42:09 +08:00
Haojun Liao
336102b8c5 refactor: do some internal refactor. 2023-05-20 13:34:49 +08:00
Haojun Liao
5cbad1da3e refactor: do some internal refactor. 2023-05-20 12:20:04 +08:00
Haojun Liao
6ded3284da refactor: do some internal refactor. 2023-05-20 11:37:17 +08:00
Haojun Liao
8ab065d01e other: update some logs. 2023-05-19 23:53:23 +08:00
Haojun Liao
56e5a483dd other: update log. 2023-05-19 20:00:32 +08:00
Haojun Liao
a9b7b8a5fd other: add some logs. 2023-05-19 19:26:15 +08:00
Haojun Liao
e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
Haojun Liao
90687bae1c refactor: do some internal refactor. 2023-05-19 15:30:50 +08:00
liuyao
e1291bd8b4 opt stream ci test 2023-05-19 13:28:58 +08:00
Haojun Liao
d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
Haojun Liao
c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao
dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate 
state merge into 3.0
 2023-05-18 17:25:44 +08:00
Haojun Liao
84a81716b3
Merge branch '3.0' into feature/3_liaohj 2023-05-18 17:00:56 +08:00
Haojun Liao
8a328b6636 fix(stream): fix error in stream read. 2023-05-18 16:59:18 +08:00
liuyao
da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
yihaoDeng
9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Haojun Liao
48dd3753aa
Merge pull request #21353 from taosdata/feature/3_liaohj 
merge main, and do some internal refactor.
 2023-05-17 22:34:34 +08:00
Haojun Liao
92feb89a09 refactor: do some internal refactor. 2023-05-17 18:08:04 +08:00
Haojun Liao
ffee5ebc61 Merge branch '3.0' into feature/3_liaohj 2023-05-17 17:47:44 +08:00
Haojun Liao
041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
liuyao
695de9d3ac fix stream queue mem leak 2023-05-17 15:19:14 +08:00
Haojun Liao
f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Haojun Liao
e35d145734 fix(stream): fix memory leak. 2023-05-16 13:59:13 +08:00
liuyao
3c81137ffe pause source task 2023-05-16 13:43:46 +08:00
Haojun Liao
e1700d00dc fix(stream): avoid memory leak. 2023-05-16 09:26:19 +08:00
liuyao
502efb3d01 op stream selectivity buff 2023-05-15 16:26:24 +08:00
yihaoDeng
a001e3c424 refactor code 2023-05-15 07:22:29 +00:00
Haojun Liao
4c64260a7a refactor: do internal refactor. 2023-05-15 14:15:10 +08:00
yihaoDeng
4015f544db refactor code 2023-05-15 05:45:17 +00:00
yihaoDeng
42562d388f refactor code 2023-05-15 05:29:56 +00:00
liuyao
a6570a4327 Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate 2023-05-15 11:19:55 +08:00
liuyao
9258dcd740 fix:mem leak 2023-05-15 11:19:17 +08:00
Haojun Liao
3b6e052c6b enh(stream): avoid clone submit block. 2023-05-15 10:11:08 +08:00
yihaoDeng
9c0d2c87c6 Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-15 01:52:42 +00:00
Haojun Liao
3d00f6ce54 refactor: do some internal refactor. 2023-05-14 22:08:17 +08:00
yihaoDeng
41ebd07472 factor code 2023-05-13 23:59:57 +00:00
Haojun Liao
8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao
236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao
23f5f7f6da Merge remote-tracking branch 'origin/enh/rocksdbSstate' into enh/rocksdbSstate 2023-05-12 19:55:37 +08:00
Haojun Liao
b78fc86550 fix(stream): remove some logs. 2023-05-12 19:55:22 +08:00
yihaoDeng
cfc6bd9f9f factor code 2023-05-12 02:10:40 +00:00
yihaoDeng
eb3ab4fcea factor code 2023-05-11 13:34:17 +00:00
yihaoDeng
6cf1adf1b1 factor code 2023-05-11 13:01:45 +00:00
liuyao
8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
yihaoDeng
4e8f5f5d32 factor code 2023-05-11 09:58:53 +00:00
yihaoDeng
afaee9c386 factor code 2023-05-11 09:51:01 +00:00
yihaoDeng
4715aacd41 factor code 2023-05-11 09:44:40 +00:00
yihaoDeng
59ff6bd301 factor code 2023-05-11 09:32:44 +00:00
yihaoDeng
04c7c99a67 factor code 2023-05-11 09:17:05 +00:00
yihaoDeng
0710fc39af factor code 2023-05-11 09:04:14 +00:00
Haojun Liao
8277d608f4 other: update logs. 2023-05-11 16:53:19 +08:00
yihaoDeng
e6474caddf factor code 2023-05-11 08:51:41 +00:00
Haojun Liao
b2d141fe40 fix(stream): limit the batch size. 2023-05-11 15:07:07 +08:00
yihaoDeng
f652f71d68 factor code 2023-05-11 06:37:57 +00:00
Haojun Liao
2b736ffd60 fix(stream): avoid duplicated task id in task id list. 2023-05-11 11:47:57 +08:00
Haojun Liao
b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
yihaoDeng
d473fcf6b0 refactor code 2023-05-11 01:19:54 +00:00
yihaoDeng
c7602a4c1a refactor code 2023-05-11 01:19:40 +00:00
Haojun Liao
dbd79cc80c refactor: do some internal refactor. 2023-05-10 22:22:01 +08:00
yihaoDeng
b4bd6a4f1c refactor code 2023-05-10 10:49:10 +00:00
Yihao Deng
c6e5879f44
Merge branch 'main' into enh/rocksdbSstate 2023-05-10 10:04:28 +08:00
liuyao
62ccd4bf16 avoid delete data 2023-05-10 09:11:04 +08:00
yihaoDeng
8356533eb1 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-09 12:13:16 +00:00
liuyao
8224d49702 fix:after restarting taosd, stream does not work. 2023-05-09 17:24:11 +08:00
yihaoDeng
55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
yihaoDeng
b5fdaa327d avoid deadlock 2023-05-09 07:00:29 +00:00
Yihao Deng
cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
Haojun Liao
31ac1e3eaa fix(stream): revise the input queue capacity. 2023-05-08 00:00:55 +08:00
Haojun Liao
d026e7ef16 refactor: update some logs. 2023-05-07 22:55:49 +08:00
yihaoDeng
163a862f5f fix mem leak 2023-05-06 13:57:33 +00:00
yihaoDeng
08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Haojun Liao
c141abfbb8 fix(stream): set correct msg size; 2023-05-06 20:03:07 +08:00
Haojun Liao
13f3ca4226 fix(stream): add input queue size limitation. 2023-05-06 18:47:29 +08:00
yihaoDeng
8be29dc98e failed to open rocksdb cf 2023-05-06 10:35:23 +00:00
Haojun Liao
aca5760ceb fix(query): fix syntax error. 2023-05-06 13:17:31 +08:00
Haojun Liao
da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
Haojun Liao
1fa4327f6c Merge branch 'main' into fix/liaohj_main 2023-05-06 10:15:23 +08:00
liuyao
76bf0aea56 opt stream input queue 2023-05-06 10:14:27 +08:00
Haojun Liao
3afc5bdfcf refactor: add some logs. 2023-05-06 10:09:51 +08:00
Haojun Liao
29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao
5d4a3116d5
Merge pull request #21139 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-05-06 09:49:26 +08:00
yihaoDeng
d7e86aca05 fix case failure 2023-05-05 15:14:16 +00:00
Haojun Liao
8958aabe4b fix(stream): opt task scan performance. 2023-05-05 19:33:30 +08:00
yihaoDeng
f7a7743af7 fix case failure 2023-05-05 08:32:33 +00:00
Haojun Liao
8b12d4d3da fix(stream): secure the delete task operation. TD-1198 2023-05-05 15:02:03 +08:00
yihaoDeng
a1b9dcf595 fix mem leak 2023-05-05 02:20:11 +00:00
liuyao
74ab689719 opt batch num 2023-05-05 08:59:07 +08:00
yihaoDeng
f20b28bc9f fix mem leak 2023-05-04 14:29:56 +00:00
yihaoDeng
6b0bda6708 fix mem leak 2023-05-04 13:38:19 +00:00
yihaoDeng
c2de8c91dd fix mem leak 2023-05-04 11:52:29 +00:00
yihaoDeng
f9c49f4938 add compile opt on windows 2023-05-04 10:22:13 +00:00
Haojun Liao
2b7a816b86 fix(tmq): fix syntax error. 2023-05-04 16:59:26 +08:00
Haojun Liao
23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
yihaoDeng
c27d01a510 Merge branch 'enh/addTtlToStream' into enh/rocksdbSstateMerge 2023-05-04 08:22:31 +00:00
Haojun Liao
09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
liuyao
d8a1f15d10 fix resum bug 2023-05-04 09:28:06 +08:00
Haojun Liao
3b814f2478 fix(stream): do some internal refactor. 2023-05-01 23:21:29 +08:00
Haojun Liao
a1263b8b04 fix(query):fix syntax error. 2023-05-01 19:40:26 +08:00
Haojun Liao
3c61932ecc refactor: do some internal refactor. 2023-05-01 19:28:54 +08:00
Haojun Liao
6c86847b12 refactor: do some internal refactor. 2023-05-01 14:58:59 +08:00
Haojun Liao
777ed1761f refactor: update logs. 2023-04-29 18:24:46 +08:00
Haojun Liao
bbb8aaa0dc refactor: add some logs. 2023-04-29 02:37:10 +08:00
Haojun Liao
b69137df44 refactor(log): add some logs. 2023-04-29 00:00:25 +08:00
Haojun Liao
c647ded0da fix(stream): add some logs. 2023-04-28 19:47:49 +08:00
yihaoDeng
dda1c8803c Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-04-28 09:17:22 +00:00
yihaoDeng
afc6023a8a merge rocksdb inst 2023-04-28 06:32:33 +00:00
Haojun Liao
b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao
f9a64cbcd6 other: add some logs. 2023-04-28 12:58:03 +08:00
yihaoDeng
c4f36d32ae merge rocksdb inst 2023-04-28 01:31:37 +00:00
yihaoDeng
984a69671e merge rocksdb inst 2023-04-27 14:46:33 +00:00
yihaoDeng
36a4413bf1 merge rocksdb inst 2023-04-27 14:38:33 +00:00
jiajingbin
ebf9a13fe7 inc batch num 2023-04-27 18:15:17 +08:00
Haojun Liao
6780833cd2 Merge remote-tracking branch 'origin/enh/rocksdbSstate' into enh/rocksdbSstate 2023-04-27 15:08:17 +08:00
Haojun Liao
b7040ed15e enh(stream): support resume from the latest data, and do some internal refactor. 2023-04-27 15:07:54 +08:00
liuyao
8b5251004f inc queue cap 2023-04-27 14:04:46 +08:00
liuyao
dbdc31539c inc queue cap 2023-04-27 10:46:08 +08:00
liuyao
4c4a4775de opt stream 2023-04-26 19:13:58 +08:00
liuyao
863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
liuyao
2533b5c5c2 op stream 2023-04-26 17:00:33 +08:00
yihaoDeng
10582fb5e0 opt write opt 2023-04-25 09:49:28 +00:00
yihaoDeng
84cae91f9f rocksdb_iter_value 2023-04-25 09:39:57 +00:00
yihaoDeng
c64a7d3e5f add ttl to stream state key 2023-04-25 08:54:03 +00:00
yihaoDeng
05df0f6ed7 add ttl to stream state key 2023-04-25 02:36:44 +00:00
yihaoDeng
81bd7661bd add ttl to stream state key 2023-04-24 14:20:01 +00:00
yihaoDeng
f15b806e15 opt write opt 2023-04-24 09:08:48 +00:00
yihaoDeng
e1535124d1 opt write opt 2023-04-24 09:08:07 +00:00
yihaoDeng
23803c04ed opt write opt 2023-04-24 08:49:56 +00:00
yihaoDeng
2d5218246d add ttl to stream state key 2023-04-24 08:18:02 +00:00
yihaoDeng
3abdbec813 add ttl to stream state key 2023-04-24 08:17:57 +00:00
liuyao
eca7b68fa0 ignore update 2023-04-24 15:01:56 +08:00
Haojun Liao
48c36a8c35 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 14:44:13 +08:00
yihaoDeng
ae3730c318 add ttl to stream state key 2023-04-23 13:29:18 +00:00
Haojun Liao
623ea6df5f fix(stream): add task status check. 2023-04-23 17:42:56 +08:00
yihaoDeng
917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
yihaoDeng
54f3bc2543 change write opt 2023-04-21 10:06:37 +00:00
liuyao
426a794e7e add ini 2023-04-21 17:47:00 +08:00
yihaoDeng
c71bbb0109 change write opt 2023-04-21 06:24:46 +00:00
yihaoDeng
98d6ff5a5d change write opt 2023-04-21 05:55:10 +00:00
yihaoDeng
57c4544bf0 change write opt 2023-04-21 05:54:52 +00:00
Haojun Liao
b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Haojun Liao
6c641cff39 fix(stream): fix error in start stream tasks. 2023-04-21 09:37:16 +08:00
Haojun Liao
5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
Haojun Liao
dc733352db enh(stream): set the max input queue size to be 3000. 2023-04-20 17:38:10 +08:00
Haojun Liao
8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Haojun Liao
b60b1796f7 fix(stream): add lock during check wal to create new stream task. 2023-04-20 15:53:41 +08:00
yihaoDeng
3272d14e33 change write opt 2023-04-20 04:05:35 +00:00
yihaoDeng
aa613285e7 change write opt 2023-04-20 00:21:16 +00:00
yihaoDeng
9d6e8b3fa7 change write opt 2023-04-20 00:18:57 +00:00
yihaoDeng
b640a0330d change write opt 2023-04-19 23:55:09 +00:00
yihaoDeng
6ff0b09e5e change write opt 2023-04-19 23:46:08 +00:00
yihaoDeng
22afdaa6a4 change write opt 2023-04-19 14:15:17 +00:00
yihaoDeng
10e44c63e1 change write opt 2023-04-19 13:12:53 +00:00
yihaoDeng
5efa5f6b9f change write opt 2023-04-19 13:01:13 +00:00
54liuyao
5b7ccc42ca inc sleep time 2023-04-19 13:38:30 +08:00
liuyao
ae117bd7c3 fill state 2023-04-19 09:15:12 +08:00
Haojun Liao
9f16802451 fix(stream): set the initial value. 2023-04-18 16:42:40 +08:00
Haojun Liao
76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj 
fix(stream): set the correct initial checkpoint versions.
 2023-04-18 11:26:48 +08:00
liuyao
5460eaf29a memory leak 2023-04-18 09:50:13 +08:00
yihaoDeng
47bf2374db fix compile error 2023-04-17 15:19:33 +00:00
yihaoDeng
fc6d9afa19 fix compile error 2023-04-17 15:01:47 +00:00
yihaoDeng
6f6fd3e147 fix compile error 2023-04-17 15:01:41 +00:00
Haojun Liao
930b267a75 fix(stream): set the correct start offset for stream task. 2023-04-17 22:59:00 +08:00
liuyao
27d14f742d fix:stream memory leak 2023-04-17 17:27:02 +08:00
liuyao
afc8e5cea7 fix asan bug 2023-04-17 11:48:08 +08:00
Haojun Liao
ac137b4b33 refactor: do some internal refactor. 2023-04-17 09:46:58 +08:00
Haojun Liao
10b3fd9426 other: merge main. 2023-04-17 09:19:48 +08:00
Haojun Liao
dc78233f86 Merge branch 'enh/rocksRevert' of github.com:taosdata/tdengine into enh/rocksRevert 2023-04-15 09:36:15 +08:00
Haojun Liao
04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao
a3b02a80c0 fix(stream): update the version when open stream tasks. 2023-04-15 00:10:08 +08:00
Haojun Liao
3aa6897738 refactor: increase the buffer size 2023-04-14 22:56:11 +08:00
Haojun Liao
e05d61456a fix(stream): disable the status check. 2023-04-14 22:45:22 +08:00
yihaoDeng
964db517dc Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 14:06:13 +00:00
yihaoDeng
80f348de1d fix recover 2023-04-14 14:05:59 +00:00
Haojun Liao
d420734971 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 18:03:19 +08:00
Haojun Liao
d0c706ac7c ehn(stream): increase the capacity of input queue to be 2000 items. 2023-04-14 18:02:41 +08:00
Haojun Liao
ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
Haojun Liao
e0cb8aa534 fix(stream): don't the initial task status and do some internal refactor. 2023-04-14 17:43:37 +08:00
yihaoDeng
efa7b48c1b Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 09:40:25 +00:00
yihaoDeng
4c70cfdfad startGroupTableMe 2023-04-14 09:36:08 +00:00
liuyao
b8ac811f20 fix bug 2023-04-14 17:35:17 +08:00
Haojun Liao
eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao
5850a3ab01 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 10:37:17 +08:00
Haojun Liao
b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
yihaoDeng
1b25523153 Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 02:11:07 +00:00
yihaoDeng
c0ebdb92d3 startGroupTableMe 2023-04-14 02:10:33 +00:00
Haojun Liao
f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao
4d83118ff7 fix(stream): fix memory leak. 2023-04-13 23:49:14 +08:00
Haojun Liao
70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
yihaoDeng
36eef2fdef refactor code 2023-04-13 09:57:04 +00:00