Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
67094 commits 554 branches 514 tags 1.7 GiB
Commit graph

2864 commits

Author SHA1 Message Date
yihaoDeng
98099ebbae fix mem leak 2023-10-07 18:41:27 +08:00
liuyao
19bbf10579 fix issue 2023-10-07 17:59:53 +08:00
yihaoDeng
97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
liuyao
1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
yihaoDeng
bdc4afec83 refact task backend 2023-10-07 17:17:30 +08:00
yihaoDeng
e41da13d5b refact task backend 2023-10-07 17:07:26 +08:00
yihaoDeng
3ebc7eef5f refact task backend 2023-10-07 17:03:12 +08:00
yihaoDeng
c146327da8 refact task backend 2023-10-07 16:48:36 +08:00
Haojun Liao
d11c0a113c fix(stream): fix syntax error. 2023-10-07 14:56:09 +08:00
Haojun Liao
7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
yihaoDeng
66315fe405 refact task backend 2023-10-07 13:53:44 +08:00
yihaoDeng
82e0242889 refact task backend 2023-10-07 13:43:52 +08:00
yihaoDeng
fa70221238 refact task backend 2023-10-07 12:17:55 +08:00
liuyao
460ee86fdf fix issue 2023-10-07 11:55:40 +08:00
liuyao
59d47e1e1f fix issuse 2023-10-07 10:34:35 +08:00
Haojun Liao
115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
Haojun Liao
011627d50a fix(stream): update the current processing version. 2023-10-07 09:07:44 +08:00
Haojun Liao
c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
Haojun Liao
98659ad323 fix(stream): fix the invalid check. 2023-10-05 00:09:47 +08:00
Haojun Liao
41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao
45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao
132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao
38aff641ee fix(stream): add null check. 2023-10-03 02:39:57 +08:00
Haojun Liao
58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao
a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao
5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
Haojun Liao
5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
yihaoDeng
b8e265e502 add cvt state 2023-09-30 09:05:28 +00:00
Haojun Liao
31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
yihaoDeng
eac16b9d1b add cvt state 2023-09-28 11:59:53 +00:00
yihaoDeng
4f66dc538f add cvt state 2023-09-28 11:52:18 +00:00
Haojun Liao
f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
yihaoDeng
c5bb37a5cb refact task backend 2023-09-28 17:30:49 +08:00
yihaoDeng
bb265887e6 refact task backend 2023-09-28 17:07:19 +08:00
yihaoDeng
54e3ac2c1e refact task backend 2023-09-28 15:46:12 +08:00
Haojun Liao
80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
Haojun Liao
22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao
f525778aef fix(stream): fix syntax error. 2023-09-28 00:53:36 +08:00
Haojun Liao
8c998673ad fix(stream): fix dead lock. 2023-09-27 17:15:49 +08:00
Haojun Liao
2dade996bb log(stream): update logs. 2023-09-27 15:37:12 +08:00
Haojun Liao
8f2d217834 log: update logs. 2023-09-27 14:48:53 +08:00
yihaoDeng
d4f87378fd avoid first tag index conflict 2023-09-27 14:44:09 +08:00
Haojun Liao
11641e1115 refactor: do some internal refactor. 2023-09-27 14:18:01 +08:00
Haojun Liao
34d547bfff fix(stream): avoid repeatly free obj. 2023-09-27 14:05:14 +08:00
Haojun Liao
ae020fcd2d log(stream): update the log. 2023-09-27 14:03:57 +08:00
Haojun Liao
e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
Haojun Liao
a7e6933ce7 refactor: do some internal refactor. 2023-09-27 09:46:15 +08:00
Haojun Liao
37bf387453 fix(stream): reduce the counter when remove stream tasks. 2023-09-27 09:36:20 +08:00
Haojun Liao
9ab9de0ad3 fix(stream): limit sink quota. 2023-09-27 00:30:38 +08:00
Haojun Liao
27dcbcb96f fix(stream): update the retry interval. 2023-09-26 23:42:02 +08:00
Haojun Liao
aec15ae39f enh(stream): add quota limitation for sink task. 2023-09-26 23:29:54 +08:00
liuyao
c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
Haojun Liao
890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao
f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
liuyao
82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
Haojun Liao
d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Haojun Liao
6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao
5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00
yihaoDeng
ed172a939c rename cfg default name 2023-09-25 18:09:35 +08:00
Haojun Liao
c9576d7a85 fix(stream): transfer state when all downstream rsp already. 2023-09-25 17:31:38 +08:00
Haojun Liao
c615c513e8 fix(stream): fix memory leak. 2023-09-25 16:01:17 +08:00
Haojun Liao
fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
Haojun Liao
1af95969b2 fix(stream): adjust nodeUpdate check interval. 2023-09-25 10:40:30 +08:00
Haojun Liao
eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao
c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
Haojun Liao
da82a5f19e fix(stream): do not wait for the checkpoint finish before stop tasks. 2023-09-24 22:03:07 +08:00
Haojun Liao
a74b462ffb fix(stream): add new timer for each task. 2023-09-24 02:25:53 +08:00
Haojun Liao
b7dcd94c64 refactor: do some internal refactor. 2023-09-24 01:56:52 +08:00
Haojun Liao
3a75c21e66 refactor: do some internal refactor. 2023-09-24 01:55:59 +08:00
Haojun Liao
4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
Haojun Liao
7f265e181d fix(stream): update the checkpoint record start time. 2023-09-23 18:05:14 +08:00
Haojun Liao
6ef68fdf06 fix(stream): fix invalid checkpoint start time. 2023-09-23 17:57:09 +08:00
Haojun Liao
acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
Haojun Liao
7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao
5155519559 fix(stream): fix invalid assert. 2023-09-22 23:06:48 +08:00
Haojun Liao
cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
yihaoDeng
8890f5c950 add cvt state 2023-09-22 12:51:29 +00:00
Haojun Liao
fcbd747afc fix(stream): fix race condition. 2023-09-22 19:35:12 +08:00
liuyao
5cc1ae1266 fix issue 2023-09-22 19:25:19 +08:00
Haojun Liao
1ca05fb3af fix(stream): add some logs. 2023-09-22 18:56:31 +08:00
Haojun Liao
5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
Haojun Liao
bb1a2322ca fix(stream): add some logs. 2023-09-22 17:27:10 +08:00
yihaoDeng
11da631bb5 add cvt state 2023-09-22 09:08:42 +00:00
Haojun Liao
07ec6f38b8 fix(stream): remove invalid free. 2023-09-22 16:53:22 +08:00
Haojun Liao
5a695f632c fix(stream): remove the blocking flag after successfully retry sending msg. 2023-09-22 16:44:55 +08:00
yihaoDeng
970b1cb840 add cvt state 2023-09-22 08:38:41 +00:00
yihaoDeng
173604ee1a add cvt state 2023-09-22 08:32:14 +00:00
yihaoDeng
19e52c364e add cvt state 2023-09-22 08:26:03 +00:00
Haojun Liao
6c357104a5 fix(stream): clear the failure vnode id list before send msg. 2023-09-22 16:19:25 +08:00
Haojun Liao
0f5f21ba09 fix(stream): fix invalid read. 2023-09-22 16:05:12 +08:00
Haojun Liao
619a9f6d08 fix(stream): refactor re-try dispatch msg for stream tasks. 2023-09-22 15:57:55 +08:00
liuyao
4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
liuyao
410a177637 fix issue 2023-09-22 15:00:26 +08:00
Haojun Liao
898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Haojun Liao
87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao
f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
wangmm0220
5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
liuyao
4979fc5283 fix issue 2023-09-22 09:40:08 +08:00
wangmm0220
803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao
b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao
b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao
50d5fb6641 fix(stream): update logs. 2023-09-21 19:14:34 +08:00
yihaoDeng
470849982e add cvt func 2023-09-21 09:41:30 +00:00
Haojun Liao
4925b67d4a fix(stream): ignore the dispatch failure, and set the correct rsp counter. 2023-09-21 17:22:09 +08:00
Haojun Liao
2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao
17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
yihaoDeng
77ef632233 refactor code 2023-09-21 01:36:12 +00:00
Haojun Liao
9f9b712332 fix(stream): disable token bucket. 2023-09-21 01:19:58 +08:00
yihaoDeng
ee8c09667e refactor backend 2023-09-20 12:53:58 +00:00
Haojun Liao
92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
Haojun Liao
6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
liuyao
b4be5fe895 fix mem leak 2023-09-20 17:35:11 +08:00
Haojun Liao
619b377dd9 fix(stream): exec task in task queuee threads. 2023-09-20 17:30:41 +08:00
Haojun Liao
49165f8c3c fix(stream): add more check. 2023-09-20 16:49:55 +08:00
Haojun Liao
8329ec79f2 fix(stream): check the status before exec stream task when handling the dispatch requests. 2023-09-20 16:32:27 +08:00
Haojun Liao
2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
liuyao
1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
Haojun Liao
b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
Haojun Liao
1decaaee1e fix(stream): set correct size for results generated by scan history stream tasks. 2023-09-19 16:49:04 +08:00
Haojun Liao
309630eb11 fix(stream): add timestamp. 2023-09-19 14:22:05 +08:00
Haojun Liao
38b3a7c1bd fix(stream): update logs. 2023-09-19 11:05:49 +08:00
Haojun Liao
b7efedf4aa enh(stream): log the checkpoint time. 2023-09-19 09:53:33 +08:00
Haojun Liao
e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
Haojun Liao
9a9fffa577 fix(stream): reset task counter. 2023-09-19 00:52:35 +08:00
Haojun Liao
377fdfacf6 fix(stream): add some logs. 2023-09-18 23:51:08 +08:00
Haojun Liao
2c9d54af37 fix(stream): fix memory leak. 2023-09-18 19:58:46 +08:00
Haojun Liao
c7b8d572f6 fix(stream): set the output normal for stream dispatch when encountering the transfer state. 2023-09-18 18:25:22 +08:00
Haojun Liao
c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
Haojun Liao
8aa9960760
Merge pull request #22944 from taosdata/fix/liaohj 
refactor: do some internal refactor, and fix some bugs.
 2023-09-17 21:25:33 +08:00
Haojun Liao
3dfdda3283 fix(stream): fix error in decode stream task. 2023-09-17 18:07:26 +08:00
Haojun Liao
301258784a fix(stream): fix invalid read. 2023-09-17 13:59:06 +08:00
Haojun Liao
01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao
4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
Haojun Liao
caa7542cea
Merge pull request #22913 from taosdata/fix/liaohj 
fix(stream): fix error in drop task.
 2023-09-16 21:36:38 +08:00
Haojun Liao
91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
yihaoDeng
e958e18726 fix race crash and add log 2023-09-15 15:02:05 +08:00
yihaoDeng
6820fb0c5d fix race crash and add log 2023-09-15 14:59:44 +08:00
Haojun Liao
2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
Haojun Liao
117de7ab7d fix(stream): fix error in drop task. 2023-09-15 00:51:13 +08:00
Haojun Liao
500fcad36c
Merge pull request #22892 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-09-15 00:46:46 +08:00
Haojun Liao
73c2782d78 fix(stream): update some logs. 2023-09-14 23:17:23 +08:00
Haojun Liao
303e8caf0c fix(stream): set the correct guard flag. 2023-09-14 22:44:16 +08:00
Haojun Liao
27f626769e fix(stream): fix memory leak. 2023-09-14 19:33:05 +08:00
Haojun Liao
f2c3e0a6e8 fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-09-14 17:22:31 +08:00
Haojun Liao
fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
Haojun Liao
d9f6cf3966 fix(stream):fix missing unlock. 2023-09-13 14:11:41 +08:00
Haojun Liao
7305c8dbe1 refactor: do some internal refactor about the sched status set 2023-09-13 14:00:34 +08:00
Haojun Liao
ca2fea3e1b refactor(stream): remove unnecessary streamschedTask function to improve the performance. 2023-09-13 11:02:38 +08:00
Haojun Liao
0943c1c5b1 fix(stream): limit the token bucket capacity 2023-09-13 09:19:59 +08:00
Haojun Liao
99477babca
Merge pull request #22872 from taosdata/fix/coverityScanDyh 
fix coverity scan problem
 2023-09-13 09:18:27 +08:00
Haojun Liao
09a15bf340 refactor: do some internal refactor. 2023-09-12 22:07:52 +08:00
Haojun Liao
60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao
f6a097d96f refactor: do some internal refactor. 2023-09-12 21:58:22 +08:00
Haojun Liao
4325a0a433
Merge pull request #22866 from taosdata/fix/3_liaohj 
refactor: do  some internal refactor.
 2023-09-12 21:56:44 +08:00
yihaoDeng
8fc33dd74d fix coverity scan problem 2023-09-12 18:52:16 +08:00
Haojun Liao
13c20facd0 fix(stream): fix syntax error. 2023-09-12 18:37:30 +08:00
Haojun Liao
66676b977e fix(stream): set correct number items in outputQ 2023-09-12 18:16:07 +08:00
Haojun Liao
e457d94ac6 refactor: do some internal refactor. 2023-09-12 18:09:02 +08:00
Haojun Liao
4d33387e80
Merge pull request #22814 from taosdata/fix/fixTransferCrash2 
fix merge error
 2023-09-12 16:10:07 +08:00
Haojun Liao
78a5680cf4 fix(stream): add some logs. 2023-09-12 15:59:09 +08:00
yihaoDeng
3e48f3639c fix transfer crash 2023-09-12 14:46:32 +08:00
yihaoDeng
6ce85f5cae fix transfer crash 2023-09-12 10:44:56 +08:00
Haojun Liao
f602aa965f fix(stream): fix coverity scan issues. 2023-09-12 09:16:18 +08:00
Haojun Liao
45880f70d4 fix(stream): fix display error in logs. 2023-09-11 13:57:33 +08:00
Haojun Liao
3b79ab3266 fix(stream): reset the init ts. 2023-09-11 13:50:55 +08:00
Haojun Liao
50ef500f51 refactor(stream): do sink module refactor. 2023-09-11 10:09:31 +08:00
Haojun Liao
a9321248a9 fix(stream): set the correct flag when there is one token existed. 2023-09-10 18:34:03 +08:00
Haojun Liao
4ffb4a5b1f refactor: disable some logs. 2023-09-10 11:02:32 +08:00
Haojun Liao
85a5c45098 fix(stream): limit the already processed data. 2023-09-10 00:01:25 +08:00
Haojun Liao
6f5c855a4b fix(stream): fix msg lost bug. 2023-09-09 15:08:36 +08:00
Haojun Liao
47fd144447 other: add some logs. 2023-09-09 11:19:51 +08:00
Haojun Liao
e4918e85eb fix(stream): limit the sink rate 2023-09-09 00:22:22 +08:00
Haojun Liao
bf79c2c993 fix(stream): limit the sink rate 2023-09-09 00:11:13 +08:00
Haojun Liao
35b97cbd19 fix(stream): set correct token in bucket. 2023-09-08 23:50:41 +08:00
Haojun Liao
328377c25f refactor: add some logs. 2023-09-08 23:04:39 +08:00
Haojun Liao
b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
Haojun Liao
dc821057e5 fix(stream): update the log. 2023-09-07 10:33:38 +08:00
Haojun Liao
e407d7dc6b fix(stream): update log. 2023-09-07 10:09:05 +08:00
Haojun Liao
956047a441 fix(stream): count down the token in bucket. 2023-09-07 10:02:13 +08:00
Haojun Liao
b240e91c91 enh(stream): add token bucket to limit the rate of sink operation. 2023-09-07 09:58:48 +08:00
liuyao
d7caed1c44 opt stream state 2023-09-06 16:34:25 +08:00
Haojun Liao
8783ebcb02 enh(stream): add some logs and record the submit package performance. 2023-09-06 14:34:36 +08:00
Haojun Liao
c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
Haojun Liao
0441c7a870 Merge branch 'fix/3_liaohj' of github.com:taosdata/tdengine into fix/3_liaohj 2023-09-05 10:40:48 +08:00
Haojun Liao
5b3cb8ec42 fix(stream): fix memory leak. 2023-09-05 09:27:16 +08:00
Haojun Liao
4f85a2620a fix(stream): remove invalid free. 2023-09-05 09:27:16 +08:00
Haojun Liao
77eed06bcd
Merge branch '3.0' into fix/3_liaohj 2023-09-04 18:51:07 +08:00
Haojun Liao
5869750782 fix(stream): release stream task with max_delay option. 2023-09-04 18:33:33 +08:00
Haojun Liao
325a177170 fix(stream): disable the fill-history task when restart stream tasks. 2023-09-04 17:18:04 +08:00
Haojun Liao
aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao
375d0abea5 fix(stream): merge main. 2023-09-04 13:12:53 +08:00
Haojun Liao
21dab8ceab other: merge 3.0 2023-09-04 13:08:19 +08:00
Haojun Liao
d8518de5e0 fix(stream):fix error in timerActive. 2023-09-01 20:20:39 +08:00
Minglei Jin
5159bf3e2a fix(stream): fix epset errors 2023-09-01 15:33:23 +08:00
dapan1121
cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
Haojun Liao
bce46f1be8 fix(stream): transfer state should wait for the checkpoint generating completed. 2023-09-01 09:50:45 +08:00
Haojun Liao
9612704fa6 fix(stream): add assert 2023-08-31 21:43:44 +08:00
Haojun Liao
95da66e3e8 fix(stream): fix error. 2023-08-31 20:50:12 +08:00
Haojun Liao
bef0d4bff3 fix(stream): add assert. 2023-08-31 20:01:59 +08:00
Haojun Liao
e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069 
fix invalid insert
 2023-08-31 18:29:25 +08:00
yihaoDeng
1833be028f fix invalid insert 2023-08-31 15:28:31 +08:00
Haojun Liao
e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao
69f95f9324 other: merge 3.0 2023-08-31 13:56:34 +08:00
Haojun Liao
2285b834b0 refactor: do some internal refactor. 2023-08-31 13:53:12 +08:00
Haojun Liao
3fc3dafca6 refactor: do some internal refactor. 2023-08-31 13:46:48 +08:00
Haojun Liao
3ed78ddadd
Merge pull request #22662 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-08-31 13:46:14 +08:00
Haojun Liao
8645f763b5
Merge pull request #22661 from taosdata/enh/reserve 
stream change ver
 2023-08-31 13:35:23 +08:00
Haojun Liao
ecff0acb73 fix(stream): fix a syntax error. 2023-08-31 11:48:25 +08:00
yihaoDeng
83a5e2be4c stream change ver 2023-08-31 11:42:12 +08:00
Haojun Liao
e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
yihaoDeng
05ca71d5de stream change ver 2023-08-31 09:28:43 +08:00
Haojun Liao
65eaa9b15f fix(stream): add task release. 2023-08-30 19:06:12 +08:00
Haojun Liao
d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
yihaoDeng
57608e7fff fix merge error 2023-08-30 17:12:37 +08:00
Haojun Liao
997d247aa6 fix(stream): remove invalid memset. 2023-08-30 16:58:22 +08:00
Haojun Liao
d26e5373b9 fix(stream): fix syntax error. 2023-08-30 16:02:46 +08:00
Haojun Liao
c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao
24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
liuyao
fc3468fe39 add log 2023-08-30 15:58:51 +08:00
liuyao
0a72e576bd op stream pause 
pause data dispatch

opt stream pause
 2023-08-30 14:53:49 +08:00
Haojun Liao
646b339bde fix(stream): not enable the pause before receive all finish rsp 2023-08-30 14:28:45 +08:00
dapan1121
f6321d0c4f Merge remote-tracking branch 'origin/main' into fix/m23.1 2023-08-30 11:03:33 +08:00
Haojun Liao
3a7a220d43 fix(stream): fix error found by ci. 2023-08-30 10:14:01 +08:00
Haojun Liao
204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
Haojun Liao
c3e9590740 fix(stream): fix error. 2023-08-29 15:11:01 +08:00
yihaoDeng
8ed2836a2b refactor code 2023-08-29 09:52:03 +08:00
yihaoDeng
a2901411b0 refactor code 2023-08-28 18:52:10 +08:00
yihaoDeng
1687f68156 refactor code 2023-08-28 16:13:27 +08:00
Haojun Liao
391103bc5a fix(stream): do dome internal refactor. 2023-08-28 15:54:01 +08:00
dapan1121
b00aa1a992
Merge pull request #22458 from taosdata/fix/TD-25719 
fix: fix non-root users cannot create log files even if they have write
 2023-08-28 13:28:59 +08:00
Haojun Liao
b75ae217f6 fix(stream): notify close for snode. 2023-08-28 09:53:08 +08:00
Haojun Liao
88a59eee37 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-27 00:18:53 +08:00
Haojun Liao
46529d383c fix(stream): build checkpoint for sink tasks. 2023-08-27 00:18:41 +08:00
yihaoDeng
998dac0ffb fix mem leak 2023-08-26 21:54:36 +08:00
yihaoDeng
7d237d4310 fix UAF 2023-08-26 17:37:09 +08:00
yihaoDeng
bed5765013 fix UAF 2023-08-26 16:15:26 +08:00
yihaoDeng
0348ef6e22 fix UAF 2023-08-26 16:13:17 +08:00
Haojun Liao
b7c36bbfe4 fix(stream): fix the status error. 2023-08-26 00:49:23 +08:00
yihaoDeng
22b8d90fbc fix invalid read 2023-08-25 18:34:11 +08:00
Haojun Liao
ef3e2737f4 fix(stream): fix syntax error. 2023-08-25 17:39:31 +08:00
yihaoDeng
a02b35ed86 fix compile error 2023-08-25 09:02:56 +00:00
Haojun Liao
60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
Haojun Liao
35193020dd fix(stream): add logs. 2023-08-25 10:18:06 +08:00
Haojun Liao
ce1a3a379c fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived. 2023-08-25 10:12:12 +08:00
Ganlin Zhao
af130cc92f Revert "add seperate function for createLogs" 
This reverts commit 13d2d72bb6.
 2023-08-25 09:55:50 +08:00
Haojun Liao
f7ea875af1 fix(stream): add some logs. 2023-08-24 23:27:48 +08:00
Haojun Liao
f7dada53b9
Merge pull request #22559 from taosdata/fix/liaohj 
other: merge main.
 2023-08-24 19:01:18 +08:00
Haojun Liao
218e2cc5f3 fix(stream): invoke the timer when not sending hb. 2023-08-24 18:27:09 +08:00
Haojun Liao
82e356a9b5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/vnode/src/tq/tq.c
 2023-08-24 18:04:44 +08:00
Haojun Liao
70396aa5a5 fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure. 2023-08-24 17:54:50 +08:00
yihaoDeng
8883d66227 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-24 17:20:12 +08:00
yihaoDeng
090515c684 refactor code 2023-08-24 17:20:04 +08:00
Ganlin Zhao
13d2d72bb6 add seperate function for createLogs 2023-08-24 14:56:14 +08:00
Haojun Liao
a750eb9699 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-24 11:43:32 +08:00
Haojun Liao
957c7f872b fix(stream): update the agg task status check, when transferring state. 2023-08-24 11:43:18 +08:00
liuyao
1e108c4178 mem leak 2023-08-24 11:34:43 +08:00
liuyao
7ebce2814f mem leak 2023-08-24 11:19:59 +08:00
yihaoDeng
3afea998ac refactor log 2023-08-24 10:15:15 +08:00
Ganlin Zhao
962a0cd403 fix 2023-08-23 23:34:02 +08:00
yihaoDeng
0959758bd5 fix transfer error 2023-08-23 21:43:10 +08:00
Haojun Liao
8e07703dd2 fix(stream): reset the timerActive value. 2023-08-23 18:26:07 +08:00
Haojun Liao
809d3087ff Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
 2023-08-23 17:53:50 +08:00
Haojun Liao
230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
yihaoDeng
1ffc13d391 fix mem leak 2023-08-23 17:02:12 +08:00
Haojun Liao
f8a3cdb987 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-23 14:10:56 +08:00
Haojun Liao
b0c5fa8290 fix(stream): reset the task status. 2023-08-23 14:10:41 +08:00
yihaoDeng
ab407c58b6 add log 2023-08-23 10:54:50 +08:00
yihaoDeng
12b10dfc76 fix mem leak 2023-08-23 09:08:37 +08:00
yihaoDeng
5fe7563a13 fix mem leak 2023-08-22 21:13:02 +08:00
yihaoDeng
ba5c3648db fix mem leak 2023-08-22 21:12:54 +08:00
Haojun Liao
57ef43ba18 fix(stream): set sink task status to enable the checkpoint. 2023-08-22 18:16:46 +08:00
yihaoDeng
ab9490101f Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 18:04:04 +08:00
Haojun Liao
af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao
e6b49b45d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 13:37:50 +08:00
Haojun Liao
cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
yihaoDeng
2c1ca6d325 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 10:51:39 +08:00
yihaoDeng
d106b5a87e Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-22 10:48:30 +08:00
yihaoDeng
a0fd56c84f fix invalid cmp 2023-08-22 10:48:15 +08:00
Haojun Liao
64556c9f1d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 10:47:02 +08:00
Haojun Liao
def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
yihaoDeng
0304ad88ff fix invalid cmp 2023-08-22 09:49:04 +08:00
yihaoDeng
fdd62e53d8 fix invalid cmp 2023-08-22 09:11:56 +08:00
yihaoDeng
2268114c4a fix invalid cmp 2023-08-22 09:10:48 +08:00
yihaoDeng
55f1d464ab fix invalid cmp 2023-08-22 09:06:42 +08:00
yihaoDeng
3e944d228b refactor checkpoint 2023-08-21 21:48:06 +08:00
Haojun Liao
082882b71e fix(stream): reset the upstream stage info. 2023-08-21 19:29:03 +08:00
Haojun Liao
8b27f98ee4 refactor: do some internal refactor. 2023-08-21 19:08:27 +08:00
yihaoDeng
387b4d365e refactor checkpoint 2023-08-21 19:07:15 +08:00
yihaoDeng
bf3c401a68 refactor checkpoint 2023-08-21 12:52:00 +08:00
Haojun Liao
99024e9d78 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-21 11:49:08 +08:00
Haojun Liao
29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
yihaoDeng
9ef69dd455 refactor checkpoint 2023-08-21 10:27:47 +08:00
yihaoDeng
1c5346b13c refactor checkpoint 2023-08-19 16:10:03 +08:00
yihaoDeng
52788aca1c fix checkpoint error 2023-08-19 12:25:22 +08:00
yihaoDeng
fbdea723b0 fix checkpoint error 2023-08-19 11:58:12 +08:00
Haojun Liao
718bb4a881 fix(stream): fix the invalid free. 2023-08-18 22:40:04 +08:00
yihaoDeng
8e4411c144 fix checkpoint error 2023-08-18 21:42:35 +08:00
Haojun Liao
4b10393c81 fix(stream): fix memory leak and do some internal refactor. 2023-08-18 18:02:08 +08:00
yihaoDeng
3a3385bb84 fix mem leak 2023-08-18 17:01:57 +08:00
yihaoDeng
0537323bac fix get error 2023-08-18 16:54:33 +08:00
Haojun Liao
c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
liuyao
9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao
87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
Haojun Liao
10872240ae
Merge pull request #22476 from taosdata/fix/3_liaohj 
fix(stream): pause when outputQ is blocked.
 2023-08-18 15:12:54 +08:00
Haojun Liao
3ec28ca5e1 Merge branch 'enh/triggerCheckPoint2' of github.com:taosdata/tdengine into enh/triggerCheckPoint2 2023-08-18 15:11:19 +08:00
Haojun Liao
edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
yihaoDeng
ac10f0f9b4 add trace log 2023-08-18 12:06:41 +08:00
Haojun Liao
a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao
2a9668da67 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
 2023-08-18 10:30:30 +08:00
Haojun Liao
87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
yihaoDeng
002d5979c1 add trace log 2023-08-17 21:13:03 +08:00
yihaoDeng
ebd4cac36b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-17 18:58:18 +08:00
yihaoDeng
46574c385f fix mem leak 2023-08-17 18:52:33 +08:00
Haojun Liao
a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
Haojun Liao
9e9d83d4a1 refactor: do some internal refactor 2023-08-17 11:57:04 +08:00
Haojun Liao
bb4f8515bd fix(stream): pause when outputQ is blocked. 2023-08-17 11:53:17 +08:00
Haojun Liao
58c0a3d8ef fix(stream): fix syntax error. 2023-08-17 09:13:37 +08:00
Haojun Liao
eb76b6f175 fix(stream): fix syntax error. 2023-08-17 09:11:32 +08:00
liuyao
5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
Haojun Liao
6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
 2023-08-17 00:08:44 +08:00
Haojun Liao
ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
yihaoDeng
114df7c349 fix transfer error 2023-08-16 11:37:15 +00:00
Haojun Liao
59d5858b95 fix(stream): fix a typo 2023-08-16 19:22:45 +08:00
Haojun Liao
9a76ae72d6 fix(stream): add the back pressure for sink node. 2023-08-16 19:11:43 +08:00
Haojun Liao
ec84d7fd81 fix(stream): add the back pressure for sink node. 2023-08-16 19:00:35 +08:00
yihaoDeng
ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
Haojun Liao
d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
yihaoDeng
993ae84398 close backend 2023-08-16 07:17:15 +00:00
yihaoDeng
7815e44655 fix invalid free 2023-08-16 09:48:11 +08:00
Haojun Liao
ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao
7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
yihaoDeng
7fd918962f fix invalid free 2023-08-16 00:53:10 +00:00
Haojun Liao
9551fcf7bb fix(tsdb): check the 2023-08-15 20:57:12 +08:00
Haojun Liao
13640f5f53 other 2023-08-15 20:46:06 +08:00
Haojun Liao
6d7b6fbb74 other: add some logs. 2023-08-15 20:01:53 +08:00
liuyao
19dfcf3a59 refactor stream scan log 2023-08-15 16:29:48 +08:00
Haojun Liao
39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Haojun Liao
71c3c710e6 fix(stream): continue process when met with trans-state msg. 2023-08-15 14:23:20 +08:00
Haojun Liao
0acb00c516 fix(stream): add log. 2023-08-15 11:48:56 +08:00
Haojun Liao
c9f3e0b0e1 fix(stream): fix an syntax error. 2023-08-15 09:34:19 +08:00
Haojun Liao
fe5e48b87d fix(stream): remove redundant include. 2023-08-15 09:26:35 +08:00
Haojun Liao
b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao
a334547726 fix(stream): fix an syntax error. 2023-08-14 19:28:36 +08:00
Haojun Liao
1a08ffc79f fix(stream): check error. 2023-08-14 19:27:09 +08:00
Haojun Liao
5d3232d275 fix(stream): fix an syntax error. 2023-08-14 18:14:32 +08:00
Haojun Liao
2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
Haojun Liao
a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Haojun Liao
91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Haojun Liao
e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
Haojun Liao
2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
Haojun Liao
98f40325e9 fix(stream): fix memory leak. 2023-08-13 20:02:15 +08:00
Haojun Liao
a81cc9aebf fix(stream): fix the error when no agg tasks exist. 2023-08-13 17:31:09 +08:00
Haojun Liao
0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao
0e189f70a1 refactor 2023-08-12 19:44:44 +08:00
Haojun Liao
03c26a9d6d refactor 2023-08-12 19:16:20 +08:00
Haojun Liao
afe9b848a5 fix(tsdb): check the 2023-08-12 18:54:39 +08:00
Haojun Liao
09da6c6840 refactor: do some internal refactor. 2023-08-12 18:51:20 +08:00
Haojun Liao
75e6fb0f16 refactor: do some internal refactor. 2023-08-12 18:47:01 +08:00
Haojun Liao
075b5e9481 refactor: do some internal refactor. 2023-08-12 18:41:54 +08:00
Haojun Liao
a0534ee715 refactor: do some internal refactor. 2023-08-12 18:40:09 +08:00
Haojun Liao
8f9de93cf0 refactor: do some internal refactor. 2023-08-12 18:37:36 +08:00
Haojun Liao
30c2a9c619 refactor: do some internal refactor. 2023-08-12 18:27:51 +08:00
Haojun Liao
0d0e30b764 fix(stream): fix the error. 2023-08-12 17:20:10 +08:00
Haojun Liao
ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
Haojun Liao
a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
Haojun Liao
f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
Haojun Liao
87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng
6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao
e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
Haojun Liao
4afe603c6e fix(stream): fix error. 2023-08-11 14:17:09 +08:00
yihaoDeng
99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao
1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao
6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng
ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
yihaoDeng
32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
Haojun Liao
8890fa5781 fix(stream): execute the stream task directly, instead of executing it in a asynchronized way. 2023-08-10 15:13:49 +08:00
yihaoDeng
b2fb94d7f8 Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer 2023-08-10 14:57:25 +08:00
yihaoDeng
ea00f676fc Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer 2023-08-10 14:57:12 +08:00
yihaoDeng
100d2240c3 support reopen stream state 2023-08-10 06:35:25 +00:00
Haojun Liao
a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
Haojun Liao
f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao
b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-10 11:43:02 +08:00
yihaoDeng
ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao
c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao
4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao
0cf8144952 fix(stream): fix the invalid key used by remove data in stream meta hash table. 2023-08-09 22:28:23 +08:00
yihaoDeng
a20b299f9b support reopen stream state 2023-08-09 13:06:10 +00:00
yihaoDeng
19ac9054d0 support reopen stream state 2023-08-09 12:47:49 +00:00
Haojun Liao
d34b9af054 enh(stream): create update stream trans. 2023-08-09 19:38:13 +08:00
yihaoDeng
1db15da4e1 support reopen stream state 2023-08-09 09:50:49 +00:00
yihaoDeng
6fdcd82a33 support reopen stream state 2023-08-09 09:19:03 +00:00
yihaoDeng
f3cf907d5a support reopen stream state 2023-08-09 09:07:13 +00:00
yihaoDeng
a336a7b1a4 support reopen stream state 2023-08-09 09:06:22 +00:00
yihaoDeng
a619b8f5be rm duplicate para 2023-08-09 08:58:49 +00:00
Haojun Liao
1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao
4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
yihaoDeng
92b247aae8 support reopen stream state 2023-08-09 07:36:00 +00:00
yihaoDeng
bbcfa9ab03 support reopen stream state 2023-08-09 06:10:40 +00:00
Haojun Liao
3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
Haojun Liao
f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
yihaoDeng
c43a6b272c support reopen stream state 2023-08-09 02:09:50 +00:00
yihaoDeng
ac11537fc8 support reopen stream state 2023-08-08 07:21:47 +00:00
Haojun Liao
17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Haojun Liao
a0dcec5890 enh(stream): add function handler for hb message. 2023-08-08 11:23:19 +08:00
Haojun Liao
db8ce3de3b other: merge main. 2023-08-08 10:17:51 +08:00
Haojun Liao
327e13c3f7 fix(stream): fix the syntax error. 2023-08-08 10:07:28 +08:00
Haojun Liao
d6d63ec54c fix(stream): add more check. 2023-08-08 09:54:49 +08:00
Haojun Liao
e89d3c18d6 fix(stream): remove invalid check. 2023-08-08 09:54:46 +08:00
Haojun Liao
ac00e1d520 fix(stream): fetch all data before paused and dump to sink node. 2023-08-08 09:54:43 +08:00
Haojun Liao
0e3fd5277d fix(stream): dump results to sink node before paused. 2023-08-08 09:54:39 +08:00
Haojun Liao
1e680d4df1 fix(stream): ignore the sink task transfer state. 2023-08-08 09:52:19 +08:00
Haojun Liao
3bcc7ed83e fix(stream): transfer the state for agg tasks. 2023-08-08 09:52:04 +08:00
Haojun Liao
d43cb3fcdf fix(stream): kill task when pause the stream execution. 2023-08-08 09:51:21 +08:00
Haojun Liao
ca2183acfd refactor: do some internal refactor. 2023-08-08 09:50:40 +08:00
Haojun Liao
82ab81810b refactor: do some internal refactor. 2023-08-08 09:40:21 +08:00
Haojun Liao
51e0b903b0 refactor: do some internal refactor. 2023-08-08 09:36:42 +08:00
Haojun Liao
af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
Haojun Liao
f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao
ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj 
other: merge main and fix bugs in stop stream tasks.
 2023-08-07 22:57:13 +08:00
Haojun Liao
85756e4404
Merge pull request #22353 from taosdata/fix/liaohj 
fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.
 2023-08-07 22:57:08 +08:00
yihaoDeng
6b73fc9c06 support reopen stream state 2023-08-07 13:56:53 +00:00
yihaoDeng
80e78e054d support reopen stream state 2023-08-07 11:39:32 +00:00
Haojun Liao
2da67392c6 fix(stream): commit the update to make sure the new state of tasks will be persistent to disk. 2023-08-07 19:30:23 +08:00
yihaoDeng
6a69c56b32 support reopen stream state 2023-08-07 10:55:42 +00:00
yihaoDeng
6c8c575549 support reopen stream state 2023-08-07 10:48:04 +00:00
Haojun Liao
aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
yihaoDeng
b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng
eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao
225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
yihaoDeng
7ef4df8752 support reopen stream state 2023-08-07 07:20:05 +00:00
Haojun Liao
7924d7e0af
Merge pull request #22337 from taosdata/fix/fixInvalidFree 
fix invalid free
 2023-08-07 11:45:29 +08:00
Haojun Liao
a8006d3d0d
Merge pull request #22278 from taosdata/fix/fixStateMemleak 
fix state mem leak
 2023-08-07 11:45:16 +08:00
yihaoDeng
4ca39d0f3c support reopen stream state 2023-08-07 01:45:16 +00:00
Haojun Liao
8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
yihaoDeng
7396799d90 fix invalid free 2023-08-04 19:06:16 +08:00
yihaoDeng
36e841b6d0 fix invalid free 2023-08-04 18:59:17 +08:00
Hui Li
f19826fa9d
Merge pull request #22313 from taosdata/fix/addStreamVer 
add stream verion
 2023-08-04 17:36:21 +08:00
yihaoDeng
a4da6e9a88 fix mem leak 2023-08-04 15:59:34 +08:00
yihaoDeng
81908be32f add stream ver 2023-08-04 14:02:03 +08:00
yihaoDeng
6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
liuyao
9cb481dd6e use stream task 2023-08-04 11:01:36 +08:00
yihaoDeng
f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
liuyao
3464979489 set dummy delete data request 2023-08-03 09:03:48 +08:00
yihaoDeng
918eca4d22 fix state mem leak 2023-08-02 03:31:11 +00:00
yihaoDeng
6cdf94fec0 fix state mem leak 2023-08-02 03:29:13 +00:00
yihaoDeng
d9fd95777a fix state mem leak 2023-08-02 03:21:39 +00:00
yihaoDeng
83468a7710 fix state mem leak 2023-08-02 03:18:59 +00:00
Haojun Liao
13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
liuyao
71b000f08c reload state window state 2023-08-01 18:22:40 +08:00
Haojun Liao
ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Haojun Liao
164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
yihaoDeng
111481cef9 fix state mem leak 2023-08-01 08:09:10 +00:00
Haojun Liao
6365d5000b
Merge pull request #22271 from taosdata/fix/3_liaohj 
fix(stream): dump results to sink node before paused.
 2023-08-01 15:50:17 +08:00
Haojun Liao
f1e0e64918 fix(stream): add more check. 2023-08-01 14:31:41 +08:00
Haojun Liao
75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Haojun Liao
e11cda17c0 fix(stream): remove invalid check. 2023-08-01 10:30:24 +08:00
Haojun Liao
f6ae9cf9bb fix(stream): fetch all data before paused and dump to sink node. 2023-08-01 10:16:14 +08:00
Haojun Liao
b83860372c fix(stream): dump results to sink node before paused. 2023-08-01 00:50:30 +08:00
Haojun Liao
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457 
check update data
 2023-07-31 22:56:05 +08:00
Haojun Liao
8c1c17e31e fix(stream): ignore the sink task transfer state. 2023-07-31 19:23:53 +08:00
Haojun Liao
d72580dad7 fix(stream): transfer the state for agg tasks. 2023-07-31 19:12:23 +08:00
Haojun Liao
d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
liuyao
32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
Haojun Liao
9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao
e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
Haojun Liao
cc5ff44604 enh(stream): handle the stream hb. 2023-07-30 19:25:00 +08:00
Haojun Liao
8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao
0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
Haojun Liao
f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
Haojun Liao
92d1dbd9ad fix(stream): set the time window filter before generating create table result. 2023-07-29 01:23:06 +08:00
Haojun Liao
6c9fa4d7c8 fix(stream): check for pause when handling the fill history data. 2023-07-28 19:58:52 +08:00
Haojun Liao
936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao
d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
Haojun Liao
9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao
74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao
2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj 
other: merge main.
 2023-07-28 13:06:17 +08:00
Haojun Liao
ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj 
fix(stream): scan wal in step2
 2023-07-28 00:42:15 +08:00
Haojun Liao
22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
liuyao
5d21f50340 adjust history task trigger mode 2023-07-27 17:45:28 +08:00
Haojun Liao
6319cb8dd4 fix: fix syntax error. 2023-07-27 17:16:45 +08:00
Haojun Liao
b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao
3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao
6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
Haojun Liao
40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Haojun Liao
e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
yihaoDeng
287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
liuyao
c368db30c3 stream fill operator mem leak 2023-07-26 17:38:37 +08:00
Haojun Liao
cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Haojun Liao
728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
Haojun Liao
12986ff594 fix(stream): fix memory leaks. 2023-07-26 09:25:30 +08:00
yihaoDeng
22c85fcbad fix stream state transfer 2023-07-25 13:07:49 +00:00
yihaoDeng
0c2e86f416 fix stream state transfer 2023-07-25 10:17:30 +00:00
Haojun Liao
1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
Haojun Liao
063673726a fix(stream): fix syntax error 2023-07-25 18:08:22 +08:00
Haojun Liao
2cc4e0a727 fix(stream): fix syntax error 2023-07-25 17:56:40 +08:00
Haojun Liao
0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Haojun Liao
d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
Haojun Liao
f3f1fade43 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-25 09:25:32 +08:00
Haojun Liao
c116b69941 fix(stream): fix memory leak. 2023-07-25 09:25:18 +08:00
Haojun Liao
a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
yihaoDeng
fe262d308e del wal 2023-07-24 11:10:15 +00:00
Haojun Liao
1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Haojun Liao
9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
yihaoDeng
6a27e81964 fix stream state transfer 2023-07-24 02:05:14 +00:00
Haojun Liao
1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao
0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao
e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao
4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao
9679cc4527 fix(stream): fix race condition. 2023-07-22 10:19:51 +08:00
Haojun Liao
f4864b8713 fix(stream): fix memory leak. 2023-07-22 01:02:58 +08:00
Haojun Liao
bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao
1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao
16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
Haojun Liao
39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
Haojun Liao
bd8b811b9d refactor: do some internal refactor. 2023-07-21 09:14:25 +08:00
Haojun Liao
0d1c4f9ee2 fix(stream): fix syntax error 2023-07-21 09:13:06 +08:00
Haojun Liao
db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng
82df77eba8 fix stream state transfer 2023-07-20 11:52:31 +00:00
yihaoDeng
fc2d6744e2 fix stream state transfer 2023-07-20 10:52:34 +00:00
yihaoDeng
519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Haojun Liao
c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao
45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao
87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao
aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng
6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
yihaoDeng
733db123ad refactor code 2023-07-19 13:24:59 +00:00
Haojun Liao
97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
liuyao
8481725517 remove redundant results 2023-07-19 14:58:28 +08:00
Haojun Liao
a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao
2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao
fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
Haojun Liao
9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
Haojun Liao
5b29a5ec97 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 18:30:10 +08:00
Haojun Liao
902f9d1f94 fix(stream): set not-ready initial value. 2023-07-18 18:29:35 +08:00
yihaoDeng
039befa3d6 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-18 10:15:20 +00:00
yihaoDeng
790101ced2 fix mem leak 2023-07-18 10:14:04 +00:00
Haojun Liao
d2c875e774 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 15:19:09 +08:00
Haojun Liao
901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
yihaoDeng
95b8754dab Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-18 04:03:56 +00:00
yihaoDeng
40d59990d8 fix mem leak 2023-07-18 04:01:20 +00:00
Haojun Liao
92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
Haojun Liao
2f24f776fb fix(stream): fix error in generating checkpoint for state_window. 2023-07-18 09:04:28 +08:00
yihaoDeng
40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
Haojun Liao
14b9d920ba fix(stream): fix memory leak. 2023-07-17 16:02:41 +08:00
Haojun Liao
08f43b9d00 fix(stream): fix checkpoint block not fetched bug. 2023-07-17 15:31:54 +08:00
yihaoDeng
394cc771e5 add checkpoint 2023-07-17 06:47:23 +00:00
yihaoDeng
f0f2215f49 add checkpoint 2023-07-17 06:21:45 +00:00
yihaoDeng
3168096e40 add checkpoint 2023-07-17 06:06:21 +00:00
yihaoDeng
e0bb3c8f94 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-17 05:26:57 +00:00
yihaoDeng
f7732ddd18 recoverSnapshot 2023-07-17 05:26:30 +00:00
Haojun Liao
4dd93494d1 fix(stream): fix syntax error 2023-07-17 13:23:06 +08:00
Haojun Liao
d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
yihaoDeng
5adf580764 add checkpoint 2023-07-17 03:44:06 +00:00
Haojun Liao
8c8b1a6d79 fix(stream): handle block before checkpoint msg in the inputQ. 2023-07-17 10:47:05 +08:00
yihaoDeng
dea2e73d2e add checkpoint 2023-07-17 02:22:21 +00:00
Haojun Liao
a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao
c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng
b4de0892e6 add checkpoint 2023-07-15 09:35:33 +00:00
yihaoDeng
7b4185dc56 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-15 04:27:39 +00:00
yihaoDeng
e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
yihaoDeng
aad669e33c add checkpoint 2023-07-14 14:46:13 +00:00
Haojun Liao
725db16af9 fix(stream): set save checkpoint ver. 2023-07-14 19:47:19 +08:00
Haojun Liao
035b199497 refactor(stream): do some internal refactor. 2023-07-14 18:46:38 +08:00
Haojun Liao
6798e31bb5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 18:35:53 +08:00
Haojun Liao
8c79157822 fix(stream): close the inputQ if checkpoint msg received. 2023-07-14 18:35:41 +08:00
yihaoDeng
3020e27114 fix mem leak 2023-07-14 10:20:37 +00:00
yihaoDeng
ed931c1100 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-14 10:11:20 +00:00
yihaoDeng
3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
Haojun Liao
2b85ea62aa refactor: do some internal refactor. 2023-07-14 17:48:47 +08:00
Haojun Liao
b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao
eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
yihaoDeng
be050e12ea fix recover error 2023-07-14 15:46:00 +08:00
yihaoDeng
d0ccbd48d2 fix coverity scan problem 2023-07-14 14:54:20 +08:00
yihaoDeng
49b21b3ccb fix coverity scan problem 2023-07-14 14:53:11 +08:00
yihaoDeng
2279706357 fix coverity scan problem 2023-07-14 14:49:02 +08:00
yihaoDeng
15f5fd19eb fix recover error 2023-07-14 14:47:06 +08:00
yihaoDeng
e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
liuyao
c3375dd744 mem leak 2023-07-13 19:24:11 +08:00
Haojun Liao
e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj 
other: merge main
 2023-07-13 17:55:28 +08:00
Haojun Liao
2fd72500e2 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-13 16:32:37 +08:00
Haojun Liao
813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
liuyao
ec2134f758 op ci 2023-07-13 16:24:38 +08:00
yihaoDeng
9e128b92f8 fix recover error 2023-07-13 16:17:18 +08:00
yihaoDeng
1307776786 fix recover error 2023-07-13 16:09:34 +08:00
yihaoDeng
9434b4eaac fix recover error 2023-07-13 16:07:58 +08:00
yihaoDeng
18f9882834 fix recover error 2023-07-13 16:06:23 +08:00
Haojun Liao
66d577d134 fix(stream): abort exec when task is dropped. 2023-07-13 15:04:39 +08:00
yihaoDeng
b7403cd171 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-13 10:38:34 +08:00
yihaoDeng
0e1a91d134 fix compile error 2023-07-13 10:38:21 +08:00
Haojun Liao
af7f78ada2 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-13 10:17:10 +08:00
Haojun Liao
2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
yihaoDeng
f3f3893872 fix compile error 2023-07-13 10:05:29 +08:00
yihaoDeng
2ec67bcc08 rm expire checkpoint 2023-07-13 10:00:16 +08:00
Haojun Liao
773ae39d33 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamCheckpoint.c
 2023-07-13 09:17:51 +08:00
Haojun Liao
08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
yihaoDeng
82468f162a Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-12 16:43:56 +08:00
yihaoDeng
e1de4984a6 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-12 16:39:19 +08:00
yihaoDeng
bb72f07a94 rm expire checkpoint 2023-07-12 16:38:46 +08:00
Haojun Liao
3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao
d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
liuyao
7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
Haojun Liao
9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
Haojun Liao
a049e310f6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 10:16:26 +08:00
Haojun Liao
6f2fc4fab3 fix(stream): commit task meta after do vnode-wide checkpoint. 2023-07-12 10:16:14 +08:00
Haojun Liao
fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
liuyao
6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
yihaoDeng
503d7540f7 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-11 16:31:07 +08:00
yihaoDeng
e547ed3699 rm expire checkpoint 2023-07-11 16:30:14 +08:00
Haojun Liao
da6a4de021 fix(stream): disable invalid set normal task status. 2023-07-11 15:12:34 +08:00
Haojun Liao
09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
Haojun Liao
571cccd737 refactor: do some internal refactor. 2023-07-11 11:41:37 +08:00
Haojun Liao
62a763ead3 fix(stream): fix invalid assert. 2023-07-11 11:22:48 +08:00
Haojun Liao
a803eaee3e fix(stream): fix concurrent bug in save task meta. 2023-07-11 10:01:43 +08:00
Haojun Liao
a571663a5d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamExec.c
 2023-07-11 09:53:41 +08:00
Haojun Liao
cbda61c7f9 fix(stream): fix error in checkpointing. 2023-07-11 09:53:08 +08:00
yihaoDeng
c056e34534 fix compile error 2023-07-11 09:39:58 +08:00
Haojun Liao
3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao
a6cd702676 fix(stream): supress the warning 2023-07-11 08:54:11 +08:00
Haojun Liao
8a6a876f67 fix(stream): fix error in generating checkpoint. 2023-07-10 22:53:15 +08:00
Haojun Liao
87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao
ab5b2fe0a8 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-10 18:21:02 +08:00
Haojun Liao
385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
yihaoDeng
e263d5f55f add checkpoint 2023-07-10 17:33:48 +08:00
Haojun Liao
d6e7e6e174 fix(stream): fix typo. 2023-07-10 14:57:28 +08:00
Haojun Liao
16ee72ab06 fix(stream): free msg after send checkpoint rsp. 2023-07-10 13:57:51 +08:00
Haojun Liao
f6515e2a2c fix(stream): fix error in checkpointing. 2023-07-10 11:43:37 +08:00
Haojun Liao
5940bbfb33 fix(stream): set correct datablock. 2023-07-10 10:42:38 +08:00
Haojun Liao
9ad5e05751 fix(stream): fix error in checking status. 2023-07-10 10:24:04 +08:00
Haojun Liao
e8eba3175a fix(stream): fix error in checking status. 2023-07-10 10:23:05 +08:00
Haojun Liao
dd15ca6103 fix(stream): add missing status check. 2023-07-10 10:06:21 +08:00
Haojun Liao
ed1181a1d1 fix(stream): fix invalid read bug. 2023-07-10 09:55:29 +08:00
Haojun Liao
4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao
a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao
ab4e2ebc3a fix(stream): fix bug that causes the endless loop. 2023-07-07 21:45:22 +08:00
Haojun Liao
9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
Haojun Liao
b03ca31a7f fix(stream): fix error in generating checkpoint. 2023-07-07 17:21:46 +08:00
Haojun Liao
8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
Haojun Liao
47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
Haojun Liao
4f814db5d5 fix(stream): fix error during transferring executor state, while a task is not in normal status. 2023-07-06 18:34:01 +08:00
Haojun Liao
61f3585714 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-06 18:26:44 +08:00
Haojun Liao
d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
yihaoDeng
8e9ef2a384 fix mem leak 2023-07-06 09:01:34 +00:00
liuyao
0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
Haojun Liao
5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
yihaoDeng
483f9ab896 add other 2023-07-06 03:39:28 +00:00
Haojun Liao
f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
Haojun Liao
7a417a33b0
Merge pull request #21960 from taosdata/fix/3_liaohj 
fix(stream): fix error for extract msg from inputQ
 2023-07-05 17:47:18 +08:00
Haojun Liao
1855a16981 other: merge 3.0 2023-07-05 16:12:32 +08:00
Haojun Liao
03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao
ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao
77530e1956 refactor: record the downstream input Queue blocking time. 2023-07-04 10:58:11 +08:00
yihaoDeng
e7b37486bb vnode snapshot read 2023-07-04 00:46:39 +00:00
Haojun Liao
393b36d83d Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-07-03 17:53:18 +08:00
Haojun Liao
2dbccc1573 refactor: do some internal refactor. 2023-07-03 17:52:17 +08:00
Haojun Liao
42e1cd741a
Merge pull request #21935 from taosdata/fix/3_liaohj 
fix(stream): fix message lost bug during pause stream.
 2023-07-03 17:37:56 +08:00
Haojun Liao
9e62b9d0d2 fix(stream): fix error in extract data from inputQ. 2023-07-03 15:33:08 +08:00
Haojun Liao
200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao
20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj 
fix: fix coverity issue.
 2023-07-03 15:15:21 +08:00
Haojun Liao
ceb06635fe fix(stream): fix error in pause stream. 2023-07-03 15:12:35 +08:00
Haojun Liao
f84bfc96fb fix(stream): fix error in pause in stream. 2023-07-03 14:30:11 +08:00
Haojun Liao
5d4efe1198 fix(stream): fix error in pause. 2023-07-03 11:46:05 +08:00
Haojun Liao
317a7c83c7 fix(stream): fix message lost bug during pause stream. 2023-07-03 10:55:45 +08:00
yihaoDeng
247d3ac7ee vnode snapshot read 2023-06-30 12:05:05 +00:00
yihaoDeng
7d30a6e27a vnode snapshot read 2023-06-30 11:48:46 +00:00
yihaoDeng
9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Haojun Liao
622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
dapan1121
3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
yihaoDeng
bb520b56e7 add checkpoint 2023-06-28 09:58:07 +00:00
yihaoDeng
6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
Haojun Liao
78739e4bdb fix(stream): fix syntax error. 2023-06-28 14:21:11 +08:00
Haojun Liao
57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
Haojun Liao
3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Haojun Liao
a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
Yihao Deng
4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
Haojun Liao
32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao
3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
liuyao
71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao
b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
yihaoDeng
2c1fc501ff add checkpoint 2023-06-26 12:28:42 +00:00
Haojun Liao
437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
dapan1121
4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Haojun Liao
daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
liuyao
6b8549dea5 set table name 2023-06-26 14:14:46 +08:00
yihaoDeng
9b451bc56a add checkpoint 2023-06-25 20:14:07 +08:00
yihaoDeng
52f588955b add checkpoint 2023-06-25 20:05:42 +08:00
yihaoDeng
04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao
402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
yihaoDeng
74a4a89d70 add checkpoint 2023-06-25 17:59:36 +08:00
liuyao
e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
yihaoDeng
832aed5e98 add checkpoint 2023-06-25 17:10:59 +08:00
yihaoDeng
0330f3b2db add checkpoint 2023-06-25 17:03:01 +08:00
yihaoDeng
e36de5edf7 add checkpoint 2023-06-25 14:35:20 +08:00
Haojun Liao
0322fdc1fc fix(stream): fix memory leak. 2023-06-24 23:43:43 +08:00
Haojun Liao
ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
yihaoDeng
c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
yihaoDeng
2f656f3854 add checkpoint 2023-06-21 18:04:10 +08:00
yihaoDeng
ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
yihaoDeng
e5c62cfa06 add static lib 2023-06-21 12:10:42 +08:00
liuyao
d23c80b12f free mem 2023-06-21 10:24:34 +08:00
yihaoDeng
daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
yihaoDeng
d9e24566c0 add checkpoint 2023-06-20 18:32:56 +08:00
liuyao
aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
yihaoDeng
b6d4e98e68 fix restart crash 2023-06-20 13:47:46 +08:00
yihaoDeng
f1fcc1d2f1 add checkpoint 2023-06-20 11:44:51 +08:00
liuyao
870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
yihaoDeng
5ccfae87d9 add checkpoint 2023-06-19 20:49:04 +08:00
yihaoDeng
548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
liuyao
41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
yihaoDeng
0eeaab9cd3 Merge branch 'refact/fillhistory1' into refact/fillhistory 2023-06-19 13:53:37 +08:00
yihaoDeng
fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
yihaoDeng
b6fe5d917b refactor checkpoint 2023-06-17 14:05:49 +08:00
Haojun Liao
64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
yihaoDeng
1e05f5c693 support fill history 2023-06-16 10:00:16 +08:00
yihaoDeng
f4b9d630c0 support fill history 2023-06-16 09:36:44 +08:00
yihaoDeng
0ef8afbdaa support fill history 2023-06-16 09:32:38 +08:00
yihaoDeng
8cb8c05428 support fill history 2023-06-15 21:55:46 +08:00
yihaoDeng
9f9171719a support fill history 2023-06-15 21:29:52 +08:00
Haojun Liao
74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
liuyao
693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao
1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao
13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Haojun Liao
53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Yihao Deng
7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
yihaoDeng
52ca94ea6d trigger checkpoint 2023-06-14 16:20:14 +08:00
liuyao
9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Haojun Liao
7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
yihaoDeng
ee3017ed3a add static lib 2023-06-14 12:14:49 +08:00
Haojun Liao
11f0c3b336 refactor: do some internal refactor. 2023-06-14 10:46:46 +08:00
Haojun Liao
5282492663 refactor: do some internal refactor. 2023-06-14 10:35:03 +08:00
Haojun Liao
b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao
97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
Haojun Liao
fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
yihaoDeng
83dde6a212 add trigger checkpoint 2023-06-12 14:33:08 +00:00
Haojun Liao
78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
yihaoDeng
ae7d5c79e5 fix invald read/write 2023-06-12 02:24:49 +00:00
yihaoDeng
a2030dc378 add trigger checkpoint 2023-06-09 12:12:51 +00:00
yihaoDeng
a0c2897124 add trigger checkpoint 2023-06-09 10:46:03 +00:00
yihaoDeng
d38e3835c0 opt batch write 2023-06-09 08:12:39 +00:00
yihaoDeng
06b65ce5c1 opt batch write 2023-06-09 07:49:43 +00:00
Haojun Liao
69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao
53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
yihaoDeng
a67ef8ce91 opt batch write 2023-06-09 01:27:08 +00:00
yihaoDeng
d5c0ca3163 opt batch write 2023-06-08 13:36:52 +00:00
Haojun Liao
0fd11aaefe other: add some logs. 2023-06-08 19:14:36 +08:00
Haojun Liao
c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Haojun Liao
6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
yihaoDeng
9828ca9d7f add trigger checkpoint 2023-06-08 09:28:34 +00:00
Haojun Liao
6c13491428 refactor: do some internal refactor. 2023-06-08 16:55:41 +08:00
Haojun Liao
2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
yihaoDeng
8b91617145 Merge branch 'enh/dv3' into enh/triggerCheckpoint 2023-06-08 07:20:41 +00:00
Haojun Liao
30eba472c3
Merge pull request #21602 from taosdata/fix/TD-24600-dv3 
fix/td-24600-dv3
 2023-06-08 13:42:02 +08:00
yihaoDeng
9b749b8faa change link op t 2023-06-08 02:43:44 +00:00
Haojun Liao
cb26dd9fa2 refactor(stream): do some internal refactor. 2023-06-08 10:17:21 +08:00
yihaoDeng
79b628101c add trigger checkpoint 2023-06-07 14:32:22 +00:00
Haojun Liao
9abe47ff93
Merge pull request #21638 from taosdata/enh/changeLinkOpt 
change link opt
 2023-06-07 19:07:06 +08:00
Haojun Liao
06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
yihaoDeng
4fa1cc6dd3 change link opt 2023-06-07 05:26:07 +00:00
Haojun Liao
7bf07b78b2 fix(client): remove dependency 2023-06-07 11:36:01 +08:00
liuyao
1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
Haojun Liao
6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
yihaoDeng
66f483e51a fix invalid free 2023-06-06 02:32:06 +00:00
yihaoDeng
c6242fee01 fix invalid free 2023-06-05 10:54:02 +00:00
yihaoDeng
cb024ca069 fix invalid free 2023-06-05 10:52:07 +00:00
Haojun Liao
0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
yihaoDeng
63c4929089 fix invalid free 2023-06-05 08:42:00 +00:00
Haojun Liao
e8549ce511 refactor: do some internal refactor. 2023-06-05 16:19:37 +08:00
Haojun Liao
fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
yihaoDeng
c77f7f65d2 fix invalid free 2023-06-05 07:32:28 +00:00
yihaoDeng
3108ecf84b fix invalid free 2023-06-05 06:38:17 +00:00
yihaoDeng
74d5f02969 fix invalid free 2023-06-05 04:56:07 +00:00
Haojun Liao
077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Haojun Liao
044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao
cb7bb954b5
Merge pull request #21577 from taosdata/fix/TD-24515 
reset unclosed window info
 2023-06-03 11:21:06 +08:00
yihaoDeng
9e0392ff59 fix mem leak 2023-06-03 09:17:05 +08:00
yihaoDeng
7244ab1f6b fix mem leak 2023-06-03 08:28:21 +08:00
yihaoDeng
81fe174aa2 fix mem leak 2023-06-03 08:19:59 +08:00
yihaoDeng
5063c175f4 fix mem problem 2023-06-02 23:47:14 +08:00
yihaoDeng
3ec700e0f7 fix mem problem 2023-06-02 22:25:38 +08:00
yihaoDeng
e48e485b6c update default buffer 2023-06-02 11:56:24 +00:00
yihaoDeng
6ee68331b3 update DEFAULT_BUFF 2023-06-02 11:54:36 +00:00
Haojun Liao
cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
liuyao
17f2c3f882 reset wind info 2023-06-02 18:27:22 +08:00
yihaoDeng
449051cda6 avoid mem leak 2023-06-02 10:05:32 +00:00
wangmm0220
56f7a137ee fix:conflict 2023-06-02 15:47:53 +08:00
wangmm0220
b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
Haojun Liao
6a9c03309e
Merge pull request #21553 from taosdata/enh/changeRocksParam 
change log level
 2023-06-02 14:23:50 +08:00
Haojun Liao
cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao
f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
yihaoDeng
63d9a5dcf3 avoid mem leak 2023-06-02 04:08:08 +00:00
Haojun Liao
27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
yihaoDeng
becc5c51a4 fix compatibility 2023-06-02 02:35:15 +00:00
yihaoDeng
420ae73728 Avoid creating the same ID task multiple times 2023-06-02 00:35:45 +00:00
yihaoDeng
1571ea844a Avoid creating the same ID task multiple times 2023-06-01 11:25:55 +00:00
yihaoDeng
0315e89591 Avoid creating the same ID task multiple times 2023-06-01 11:13:01 +00:00
yihaoDeng
64edab6302 refactor code 2023-06-01 07:51:52 +00:00
Haojun Liao
91de00597d refactor: do some internal refactor. 2023-05-31 22:12:14 +08:00
Haojun Liao
46f731e4d9
Merge pull request #21551 from taosdata/fix/resume_mem 
fix(query): check the version range when dump partial rows. #TD-24504
 2023-05-31 21:51:07 +08:00
Haojun Liao
ccc86f9916 refactor: do some internal refactor. 2023-05-31 19:36:34 +08:00
Haojun Liao
87deb36f8a refactor: do some internal refactor. 2023-05-31 19:36:02 +08:00
yihaoDeng
04f3784696 change log level 2023-05-31 11:05:03 +00:00
Haojun Liao
a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
Haojun Liao
65b81a803f refactor: do some internal refactor and add some logs. 2023-05-31 18:05:53 +08:00
Haojun Liao
8c240cede9
Merge pull request #21545 from taosdata/enh/changeRocksParam 
Enh/change rocks param
 2023-05-31 13:51:32 +08:00
Haojun Liao
dd9f810f81
Merge pull request #21530 from taosdata/fix/TD-24365 
fix sliding window issue
 2023-05-31 13:51:14 +08:00
yihaoDeng
3b0a6d7f0b change db param 2023-05-31 03:15:25 +00:00
yihaoDeng
67becbd4d1 change db param 2023-05-31 01:10:36 +00:00
Haojun Liao
fc20ca8423 fix(stream): set the correct rps flag as the dispatch rsp. 2023-05-30 18:42:23 +08:00
Haojun Liao
d9cc9f2157 fix(stream): remove invalid free. 2023-05-30 18:03:21 +08:00
Haojun Liao
937f67f07b fix(stream): fix invalid free. 2023-05-30 18:02:42 +08:00
Haojun Liao
e96ed81ec0 fix(stream): add input queue capacity check. 2023-05-30 17:29:01 +08:00
Haojun Liao
eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
Haojun Liao
d9c364d663 Merge branch '3.0' into refact/fillhistory 2023-05-30 15:51:12 +08:00
Haojun Liao
de7231e59e fix(stream): fix memory leak in handling dispatch msg when output buffer is full. 2023-05-30 15:35:59 +08:00
liuyao
7d699ae579 fix sliding window issue 2023-05-30 15:16:11 +08:00
Haojun Liao
2977a4d07f refactor: do some internal refactor. 2023-05-30 09:41:19 +08:00
Haojun Liao
20a0054c4a
Merge pull request #21472 from taosdata/enh/addCompileError 
change parameter
 2023-05-30 09:36:36 +08:00
yihaoDeng
e00f79367d merge 3.0 2023-05-29 18:57:21 +08:00
Haojun Liao
3628888ecc refactor: do some internal refactor. 2023-05-29 18:02:45 +08:00
Haojun Liao
cd2d225c93 refactor: do some internal refactor. 2023-05-29 17:50:39 +08:00
yihaoDeng
1782ecd57e Merge branch 'fix/shared_link_rocksdb' into enh/addCompileError 2023-05-29 08:20:11 +00:00
Haojun Liao
f2887278e2 refactor: do some internal refactor. 2023-05-29 15:44:45 +08:00
yihaoDeng
26cbcf996c Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 07:31:14 +00:00
yihaoDeng
342ce14c7d Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:37:47 +00:00
yihaoDeng
58cc631c22 Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:29:56 +00:00
yihaoDeng
0be1858b4b Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-29 01:50:43 +00:00
yihaoDeng
de739ce086 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-29 01:11:13 +00:00
yihaoDeng
2f5fe2dec6 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 14:01:05 +00:00
yihaoDeng
4b931d3007 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 13:59:16 +00:00
yihaoDeng
a71bffd719 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 13:03:35 +00:00
yihaoDeng
57a4e56a61 change parameter 2023-05-26 20:30:03 +08:00
yihaoDeng
34d21bc03f change parameter 2023-05-26 20:11:33 +08:00
liuyao
5ebe75599e fix pause issue 2023-05-26 14:58:39 +08:00
Haojun Liao
1e845acabe fix(tmq): allow seek before get assignment 2023-05-26 11:34:12 +08:00
yihaoDeng
52c384c7c9 change parameter 2023-05-26 09:06:19 +08:00
Haojun Liao
cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory 
refactor: remove the module dependency.  TD-24279
 2023-05-26 09:01:45 +08:00
Haojun Liao
30de31e374 fix(test): fix unit test link error. 2023-05-25 18:17:09 +08:00
yihaoDeng
cd44bd9f3f change parameter 2023-05-25 18:16:33 +08:00
yihaoDeng
9cb4a114e2 change parameter 2023-05-25 16:20:00 +08:00
yihaoDeng
2f90fda13d change parameter 2023-05-25 16:15:10 +08:00
Haojun Liao
0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao
01f6f74fb9 fix: update the cmake file. 2023-05-24 22:27:45 +08:00
Hongze Cheng
4d526ed0cd change more 2023-05-24 18:59:09 +08:00
Haojun Liao
fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Haojun Liao
a566180770 fix: fix syntax error. 2023-05-24 15:16:50 +08:00
Haojun Liao
1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
Haojun Liao
e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
Haojun Liao
f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Haojun Liao
9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory 
Refact/fillhistory
 2023-05-21 01:12:00 +08:00
Haojun Liao
dcb91082f9 fix(stream): fix error. 2023-05-20 23:37:40 +08:00
Haojun Liao
cb75e5a863 fix(stream): fix memory leak. 2023-05-20 22:07:04 +08:00
Haojun Liao
899e4d3350 refactor: do some internal refactor. 2023-05-20 18:13:58 +08:00
Haojun Liao
de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
Haojun Liao
3cef1e7c42 fix(stream): add some logs. 2023-05-20 15:45:07 +08:00
Haojun Liao
aa7ea60bca fix(stream): update the free strategy. 2023-05-20 15:43:48 +08:00
Haojun Liao
84146e6aaa other: merge main. 2023-05-20 15:16:51 +08:00
Haojun Liao
6932c59510 other: merge main. 2023-05-20 15:09:30 +08:00
Haojun Liao
10692fde5e other: merge main. 2023-05-20 14:53:28 +08:00
Haojun Liao
afc384bead fix:remove invalid assert. 2023-05-20 14:44:34 +08:00
Haojun Liao
484788a60f fix:add null ptr check. 2023-05-20 14:29:51 +08:00
Haojun Liao
4974ac78f7 fix: fix invalid ref. 2023-05-20 13:42:09 +08:00
Haojun Liao
336102b8c5 refactor: do some internal refactor. 2023-05-20 13:34:49 +08:00
Haojun Liao
5cbad1da3e refactor: do some internal refactor. 2023-05-20 12:20:04 +08:00
Haojun Liao
6ded3284da refactor: do some internal refactor. 2023-05-20 11:37:17 +08:00
Haojun Liao
8ab065d01e other: update some logs. 2023-05-19 23:53:23 +08:00
Haojun Liao
56e5a483dd other: update log. 2023-05-19 20:00:32 +08:00
Haojun Liao
a9b7b8a5fd other: add some logs. 2023-05-19 19:26:15 +08:00
Haojun Liao
e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
Haojun Liao
90687bae1c refactor: do some internal refactor. 2023-05-19 15:30:50 +08:00
liuyao
e1291bd8b4 opt stream ci test 2023-05-19 13:28:58 +08:00
Haojun Liao
d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
Haojun Liao
c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao
dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate 
state merge into 3.0
 2023-05-18 17:25:44 +08:00
Haojun Liao
84a81716b3
Merge branch '3.0' into feature/3_liaohj 2023-05-18 17:00:56 +08:00
Haojun Liao
8a328b6636 fix(stream): fix error in stream read. 2023-05-18 16:59:18 +08:00
liuyao
da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
yihaoDeng
9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Haojun Liao
48dd3753aa
Merge pull request #21353 from taosdata/feature/3_liaohj 
merge main, and do some internal refactor.
 2023-05-17 22:34:34 +08:00
Haojun Liao
92feb89a09 refactor: do some internal refactor. 2023-05-17 18:08:04 +08:00
Haojun Liao
ffee5ebc61 Merge branch '3.0' into feature/3_liaohj 2023-05-17 17:47:44 +08:00
Haojun Liao
041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
liuyao
695de9d3ac fix stream queue mem leak 2023-05-17 15:19:14 +08:00
Haojun Liao
f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Haojun Liao
e35d145734 fix(stream): fix memory leak. 2023-05-16 13:59:13 +08:00
liuyao
3c81137ffe pause source task 2023-05-16 13:43:46 +08:00
Haojun Liao
e1700d00dc fix(stream): avoid memory leak. 2023-05-16 09:26:19 +08:00
liuyao
502efb3d01 op stream selectivity buff 2023-05-15 16:26:24 +08:00
yihaoDeng
a001e3c424 refactor code 2023-05-15 07:22:29 +00:00
Haojun Liao
4c64260a7a refactor: do internal refactor. 2023-05-15 14:15:10 +08:00
yihaoDeng
4015f544db refactor code 2023-05-15 05:45:17 +00:00
yihaoDeng
42562d388f refactor code 2023-05-15 05:29:56 +00:00
liuyao
a6570a4327 Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate 2023-05-15 11:19:55 +08:00
liuyao
9258dcd740 fix:mem leak 2023-05-15 11:19:17 +08:00
Haojun Liao
3b6e052c6b enh(stream): avoid clone submit block. 2023-05-15 10:11:08 +08:00
yihaoDeng
9c0d2c87c6 Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-15 01:52:42 +00:00
Haojun Liao
3d00f6ce54 refactor: do some internal refactor. 2023-05-14 22:08:17 +08:00
yihaoDeng
41ebd07472 factor code 2023-05-13 23:59:57 +00:00
Haojun Liao
8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao
236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao
23f5f7f6da Merge remote-tracking branch 'origin/enh/rocksdbSstate' into enh/rocksdbSstate 2023-05-12 19:55:37 +08:00
Haojun Liao
b78fc86550 fix(stream): remove some logs. 2023-05-12 19:55:22 +08:00
yihaoDeng
cfc6bd9f9f factor code 2023-05-12 02:10:40 +00:00
yihaoDeng
eb3ab4fcea factor code 2023-05-11 13:34:17 +00:00
yihaoDeng
6cf1adf1b1 factor code 2023-05-11 13:01:45 +00:00
liuyao
8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
yihaoDeng
4e8f5f5d32 factor code 2023-05-11 09:58:53 +00:00
yihaoDeng
afaee9c386 factor code 2023-05-11 09:51:01 +00:00
yihaoDeng
4715aacd41 factor code 2023-05-11 09:44:40 +00:00
yihaoDeng
59ff6bd301 factor code 2023-05-11 09:32:44 +00:00
yihaoDeng
04c7c99a67 factor code 2023-05-11 09:17:05 +00:00
yihaoDeng
0710fc39af factor code 2023-05-11 09:04:14 +00:00
Haojun Liao
8277d608f4 other: update logs. 2023-05-11 16:53:19 +08:00
yihaoDeng
e6474caddf factor code 2023-05-11 08:51:41 +00:00
Haojun Liao
b2d141fe40 fix(stream): limit the batch size. 2023-05-11 15:07:07 +08:00
yihaoDeng
f652f71d68 factor code 2023-05-11 06:37:57 +00:00
Haojun Liao
2b736ffd60 fix(stream): avoid duplicated task id in task id list. 2023-05-11 11:47:57 +08:00
Haojun Liao
b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
yihaoDeng
d473fcf6b0 refactor code 2023-05-11 01:19:54 +00:00
yihaoDeng
c7602a4c1a refactor code 2023-05-11 01:19:40 +00:00
Haojun Liao
dbd79cc80c refactor: do some internal refactor. 2023-05-10 22:22:01 +08:00
yihaoDeng
b4bd6a4f1c refactor code 2023-05-10 10:49:10 +00:00
Yihao Deng
c6e5879f44
Merge branch 'main' into enh/rocksdbSstate 2023-05-10 10:04:28 +08:00
liuyao
62ccd4bf16 avoid delete data 2023-05-10 09:11:04 +08:00
yihaoDeng
8356533eb1 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-09 12:13:16 +00:00
liuyao
8224d49702 fix:after restarting taosd, stream does not work. 2023-05-09 17:24:11 +08:00
yihaoDeng
55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
yihaoDeng
b5fdaa327d avoid deadlock 2023-05-09 07:00:29 +00:00
Yihao Deng
cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
Haojun Liao
31ac1e3eaa fix(stream): revise the input queue capacity. 2023-05-08 00:00:55 +08:00
Haojun Liao
d026e7ef16 refactor: update some logs. 2023-05-07 22:55:49 +08:00
yihaoDeng
163a862f5f fix mem leak 2023-05-06 13:57:33 +00:00
yihaoDeng
08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
Haojun Liao
c141abfbb8 fix(stream): set correct msg size; 2023-05-06 20:03:07 +08:00
Haojun Liao
13f3ca4226 fix(stream): add input queue size limitation. 2023-05-06 18:47:29 +08:00
yihaoDeng
8be29dc98e failed to open rocksdb cf 2023-05-06 10:35:23 +00:00
Haojun Liao
aca5760ceb fix(query): fix syntax error. 2023-05-06 13:17:31 +08:00
Haojun Liao
da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
Haojun Liao
1fa4327f6c Merge branch 'main' into fix/liaohj_main 2023-05-06 10:15:23 +08:00
liuyao
76bf0aea56 opt stream input queue 2023-05-06 10:14:27 +08:00
Haojun Liao
3afc5bdfcf refactor: add some logs. 2023-05-06 10:09:51 +08:00
Haojun Liao
29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao
5d4a3116d5
Merge pull request #21139 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-05-06 09:49:26 +08:00
yihaoDeng
d7e86aca05 fix case failure 2023-05-05 15:14:16 +00:00
Haojun Liao
8958aabe4b fix(stream): opt task scan performance. 2023-05-05 19:33:30 +08:00
yihaoDeng
f7a7743af7 fix case failure 2023-05-05 08:32:33 +00:00
Haojun Liao
8b12d4d3da fix(stream): secure the delete task operation. TD-1198 2023-05-05 15:02:03 +08:00
yihaoDeng
a1b9dcf595 fix mem leak 2023-05-05 02:20:11 +00:00
liuyao
74ab689719 opt batch num 2023-05-05 08:59:07 +08:00
yihaoDeng
f20b28bc9f fix mem leak 2023-05-04 14:29:56 +00:00
yihaoDeng
6b0bda6708 fix mem leak 2023-05-04 13:38:19 +00:00
yihaoDeng
c2de8c91dd fix mem leak 2023-05-04 11:52:29 +00:00
yihaoDeng
f9c49f4938 add compile opt on windows 2023-05-04 10:22:13 +00:00
Haojun Liao
2b7a816b86 fix(tmq): fix syntax error. 2023-05-04 16:59:26 +08:00
Haojun Liao
23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
yihaoDeng
c27d01a510 Merge branch 'enh/addTtlToStream' into enh/rocksdbSstateMerge 2023-05-04 08:22:31 +00:00
Haojun Liao
09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
liuyao
d8a1f15d10 fix resum bug 2023-05-04 09:28:06 +08:00
Haojun Liao
3b814f2478 fix(stream): do some internal refactor. 2023-05-01 23:21:29 +08:00
Haojun Liao
a1263b8b04 fix(query):fix syntax error. 2023-05-01 19:40:26 +08:00
Haojun Liao
3c61932ecc refactor: do some internal refactor. 2023-05-01 19:28:54 +08:00
Haojun Liao
6c86847b12 refactor: do some internal refactor. 2023-05-01 14:58:59 +08:00
Haojun Liao
777ed1761f refactor: update logs. 2023-04-29 18:24:46 +08:00
Haojun Liao
bbb8aaa0dc refactor: add some logs. 2023-04-29 02:37:10 +08:00
Haojun Liao
b69137df44 refactor(log): add some logs. 2023-04-29 00:00:25 +08:00
Haojun Liao
c647ded0da fix(stream): add some logs. 2023-04-28 19:47:49 +08:00
yihaoDeng
dda1c8803c Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-04-28 09:17:22 +00:00
yihaoDeng
afc6023a8a merge rocksdb inst 2023-04-28 06:32:33 +00:00
Haojun Liao
b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao
f9a64cbcd6 other: add some logs. 2023-04-28 12:58:03 +08:00
yihaoDeng
c4f36d32ae merge rocksdb inst 2023-04-28 01:31:37 +00:00
yihaoDeng
984a69671e merge rocksdb inst 2023-04-27 14:46:33 +00:00
yihaoDeng
36a4413bf1 merge rocksdb inst 2023-04-27 14:38:33 +00:00
jiajingbin
ebf9a13fe7 inc batch num 2023-04-27 18:15:17 +08:00
Haojun Liao
6780833cd2 Merge remote-tracking branch 'origin/enh/rocksdbSstate' into enh/rocksdbSstate 2023-04-27 15:08:17 +08:00
Haojun Liao
b7040ed15e enh(stream): support resume from the latest data, and do some internal refactor. 2023-04-27 15:07:54 +08:00
liuyao
8b5251004f inc queue cap 2023-04-27 14:04:46 +08:00
liuyao
dbdc31539c inc queue cap 2023-04-27 10:46:08 +08:00
liuyao
4c4a4775de opt stream 2023-04-26 19:13:58 +08:00
liuyao
863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
liuyao
2533b5c5c2 op stream 2023-04-26 17:00:33 +08:00
yihaoDeng
10582fb5e0 opt write opt 2023-04-25 09:49:28 +00:00
yihaoDeng
84cae91f9f rocksdb_iter_value 2023-04-25 09:39:57 +00:00
yihaoDeng
c64a7d3e5f add ttl to stream state key 2023-04-25 08:54:03 +00:00
yihaoDeng
05df0f6ed7 add ttl to stream state key 2023-04-25 02:36:44 +00:00
yihaoDeng
81bd7661bd add ttl to stream state key 2023-04-24 14:20:01 +00:00
yihaoDeng
f15b806e15 opt write opt 2023-04-24 09:08:48 +00:00
yihaoDeng
e1535124d1 opt write opt 2023-04-24 09:08:07 +00:00
yihaoDeng
23803c04ed opt write opt 2023-04-24 08:49:56 +00:00
yihaoDeng
2d5218246d add ttl to stream state key 2023-04-24 08:18:02 +00:00
yihaoDeng
3abdbec813 add ttl to stream state key 2023-04-24 08:17:57 +00:00
liuyao
eca7b68fa0 ignore update 2023-04-24 15:01:56 +08:00
Haojun Liao
48c36a8c35 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 14:44:13 +08:00
yihaoDeng
ae3730c318 add ttl to stream state key 2023-04-23 13:29:18 +00:00
Haojun Liao
623ea6df5f fix(stream): add task status check. 2023-04-23 17:42:56 +08:00
yihaoDeng
917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
yihaoDeng
54f3bc2543 change write opt 2023-04-21 10:06:37 +00:00
liuyao
426a794e7e add ini 2023-04-21 17:47:00 +08:00
yihaoDeng
c71bbb0109 change write opt 2023-04-21 06:24:46 +00:00
yihaoDeng
98d6ff5a5d change write opt 2023-04-21 05:55:10 +00:00
yihaoDeng
57c4544bf0 change write opt 2023-04-21 05:54:52 +00:00
Haojun Liao
b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Haojun Liao
6c641cff39 fix(stream): fix error in start stream tasks. 2023-04-21 09:37:16 +08:00
Haojun Liao
5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
Haojun Liao
dc733352db enh(stream): set the max input queue size to be 3000. 2023-04-20 17:38:10 +08:00
Haojun Liao
8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Haojun Liao
b60b1796f7 fix(stream): add lock during check wal to create new stream task. 2023-04-20 15:53:41 +08:00
yihaoDeng
3272d14e33 change write opt 2023-04-20 04:05:35 +00:00
yihaoDeng
aa613285e7 change write opt 2023-04-20 00:21:16 +00:00
yihaoDeng
9d6e8b3fa7 change write opt 2023-04-20 00:18:57 +00:00
yihaoDeng
b640a0330d change write opt 2023-04-19 23:55:09 +00:00
yihaoDeng
6ff0b09e5e change write opt 2023-04-19 23:46:08 +00:00
yihaoDeng
22afdaa6a4 change write opt 2023-04-19 14:15:17 +00:00
yihaoDeng
10e44c63e1 change write opt 2023-04-19 13:12:53 +00:00
yihaoDeng
5efa5f6b9f change write opt 2023-04-19 13:01:13 +00:00
54liuyao
5b7ccc42ca inc sleep time 2023-04-19 13:38:30 +08:00
liuyao
ae117bd7c3 fill state 2023-04-19 09:15:12 +08:00
Haojun Liao
9f16802451 fix(stream): set the initial value. 2023-04-18 16:42:40 +08:00
Haojun Liao
76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj 
fix(stream): set the correct initial checkpoint versions.
 2023-04-18 11:26:48 +08:00
liuyao
5460eaf29a memory leak 2023-04-18 09:50:13 +08:00
yihaoDeng
47bf2374db fix compile error 2023-04-17 15:19:33 +00:00
yihaoDeng
fc6d9afa19 fix compile error 2023-04-17 15:01:47 +00:00
yihaoDeng
6f6fd3e147 fix compile error 2023-04-17 15:01:41 +00:00
Haojun Liao
930b267a75 fix(stream): set the correct start offset for stream task. 2023-04-17 22:59:00 +08:00
liuyao
27d14f742d fix:stream memory leak 2023-04-17 17:27:02 +08:00
liuyao
afc8e5cea7 fix asan bug 2023-04-17 11:48:08 +08:00
Haojun Liao
ac137b4b33 refactor: do some internal refactor. 2023-04-17 09:46:58 +08:00
Haojun Liao
10b3fd9426 other: merge main. 2023-04-17 09:19:48 +08:00
Haojun Liao
dc78233f86 Merge branch 'enh/rocksRevert' of github.com:taosdata/tdengine into enh/rocksRevert 2023-04-15 09:36:15 +08:00
Haojun Liao
04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao
a3b02a80c0 fix(stream): update the version when open stream tasks. 2023-04-15 00:10:08 +08:00
Haojun Liao
3aa6897738 refactor: increase the buffer size 2023-04-14 22:56:11 +08:00
Haojun Liao
e05d61456a fix(stream): disable the status check. 2023-04-14 22:45:22 +08:00
yihaoDeng
964db517dc Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 14:06:13 +00:00
yihaoDeng
80f348de1d fix recover 2023-04-14 14:05:59 +00:00
Haojun Liao
d420734971 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 18:03:19 +08:00
Haojun Liao
d0c706ac7c ehn(stream): increase the capacity of input queue to be 2000 items. 2023-04-14 18:02:41 +08:00
Haojun Liao
ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
Haojun Liao
e0cb8aa534 fix(stream): don't the initial task status and do some internal refactor. 2023-04-14 17:43:37 +08:00
yihaoDeng
efa7b48c1b Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 09:40:25 +00:00
yihaoDeng
4c70cfdfad startGroupTableMe 2023-04-14 09:36:08 +00:00
liuyao
b8ac811f20 fix bug 2023-04-14 17:35:17 +08:00
Haojun Liao
eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao
5850a3ab01 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 10:37:17 +08:00
Haojun Liao
b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
yihaoDeng
1b25523153 Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-14 02:11:07 +00:00
yihaoDeng
c0ebdb92d3 startGroupTableMe 2023-04-14 02:10:33 +00:00
Haojun Liao
f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao
4d83118ff7 fix(stream): fix memory leak. 2023-04-13 23:49:14 +08:00
Haojun Liao
70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
yihaoDeng
36eef2fdef refactor code 2023-04-13 09:57:04 +00:00
liuyao
34bf638f19 fix bug 2023-04-13 16:21:57 +08:00
liuyao
9be89ce00a delete expired check point 2023-04-12 17:33:58 +08:00
yihaoDeng
4625dd98f0 fix write crash 2023-04-12 07:39:54 +00:00
yihaoDeng
d0246a80cf Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-12 05:50:22 +00:00
yihaoDeng
7e4eefcde1 fix write crash 2023-04-12 05:50:01 +00:00
liuyao
819154e1fc use delete_mark to drop check point 2023-04-12 13:47:54 +08:00
yihaoDeng
ed4aaade8c add backend 2023-04-12 03:03:51 +00:00
yihaoDeng
7db12bb317 fix invalid free 2023-04-11 14:21:16 +00:00
yihaoDeng
a8ffb82370 fix invalid free 2023-04-11 14:13:35 +00:00
yihaoDeng
29d80b1c76 fix invalid free 2023-04-11 14:04:39 +00:00
yihaoDeng
a3836b2363 fix invalid free 2023-04-11 12:52:03 +00:00
yihaoDeng
743ed82daa fix invalid free 2023-04-11 11:55:47 +00:00
Haojun Liao
5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
yihaoDeng
b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
yihaoDeng
ff8cb09f63 refactor backend 2023-04-11 10:47:15 +00:00
Xiaoyu Wang
4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Haojun Liao
18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
liuyao
95d81604c7 feat:encode&&decode stream scan op 2023-04-11 14:34:31 +08:00
Haojun Liao
15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00
liuyao
74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao
a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
Haojun Liao
7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
yihaoDeng
eab6f84b9b Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-10 04:52:15 +00:00
yihaoDeng
1416da1967 opt write snapshot 2023-04-10 04:51:00 +00:00
Haojun Liao
f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
liuyao
fe9ca49d3f feat:optimize get patitionby name 2023-04-07 18:47:57 +08:00
liuyao
955f8f9f07 feat:optimize get patitionby name 2023-04-07 18:45:09 +08:00
yihaoDeng
1e3569367a opt write snapshot 2023-04-07 07:38:02 +00:00
yihaoDeng
c082536242 opt write snapshot 2023-04-07 07:26:15 +00:00
liuyao
1f63859e21 feat:add buff swap 2023-04-07 12:50:59 +08:00
liuyao
ad16487180 feat:add checkpoint 2023-04-06 18:26:47 +08:00
liuyao
0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
54liuyao
1892b806b5 feat:add stream state buff 2023-04-04 17:09:35 +08:00
54liuyao
429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00
Haojun Liao
bd4c33d1c2 fix(tmq):fix the invalid read. 2023-04-04 15:57:50 +08:00
yihaoDeng
628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Xiaoyu Wang
e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Haojun Liao
d48be5c0ce refactor: do some internal refactor. 2023-04-03 18:23:35 +08:00
Haojun Liao
a3ac8b647c refactor: do some internal refactor. 2023-04-03 18:20:35 +08:00
Haojun Liao
482c319bee refactor: do some internal refactor. 2023-04-03 18:07:28 +08:00
Haojun Liao
3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
yihaoDeng
6ee0180217 fix invalid read/write error 2023-04-03 03:32:01 +00:00
yihaoDeng
7f4d0a17e6 add backend 2023-03-30 06:09:40 +00:00
yihaoDeng
c3a8ecd9c2 reset version 2023-03-30 03:56:01 +00:00
yihaoDeng
009d5099b4 reset version 2023-03-30 01:53:26 +00:00
yihaoDeng
8387f04476 reset version 2023-03-30 01:53:13 +00:00
yihaoDeng
03f80fbe36 add backend 2023-03-29 07:28:34 +00:00
yihaoDeng
50b094ab5d add backend 2023-03-29 07:26:11 +00:00
yihaoDeng
2ca072344e add backend 2023-03-29 06:56:14 +00:00
yihaoDeng
e3002f1872 add backend 2023-03-29 06:17:38 +00:00
yihaoDeng
1cf96cdbf1 add backend 2023-03-29 04:18:16 +00:00
yihaoDeng
e6e9828d5a add backend 2023-03-29 03:26:59 +00:00
yihaoDeng
ae54e994ca add backend 2023-03-29 01:27:39 +00:00
yihaoDeng
1e597503bc add backend 2023-03-28 15:16:06 +00:00
yihaoDeng
0e4445b3b5 add backend 2023-03-28 15:09:58 +00:00
yihaoDeng
0d11430be1 tqadd backend 2023-03-28 14:31:11 +00:00
yihaoDeng
86fe216921 add backend 2023-03-28 11:23:24 +00:00
yihaoDeng
ca5f813c5e add backend 2023-03-28 09:27:42 +00:00
yihaoDeng
1c21d67570 add backend 2023-03-28 06:24:16 +00:00
yihaoDeng
47cb4339f0 add backend 2023-03-28 02:27:20 +00:00
yihaoDeng
e1046015ae add backend 2023-03-28 02:25:11 +00:00
yihaoDeng
47bd13a7b1 add backend 2023-03-27 13:25:06 +00:00
yihaoDeng
5a8c46b733 add backend 2023-03-27 08:34:12 +00:00
yihaoDeng
011c791b89 add backend 2023-03-27 08:25:40 +00:00
54liuyao
cf2d169f75 feat:coverity scan 2023-03-27 16:17:49 +08:00
yihaoDeng
f0df728a0e add backend 2023-03-27 08:08:43 +00:00
yihaoDeng
a3a0d9c81f add backend 2023-03-27 07:42:11 +00:00
yihaoDeng
0690604a49 add backend 2023-03-27 02:20:49 +00:00
yihaoDeng
2cc2e5d522 add backend 2023-03-27 01:39:00 +00:00
yihaoDeng
874b6916aa add backend 2023-03-26 12:06:06 +00:00
yihaoDeng
ffd272597c add backend 2023-03-26 06:32:10 +00:00
yihaoDeng
78f22d71b9 add backend 2023-03-26 05:54:07 +00:00
yihaoDeng
fe5fe72e63 add backend 2023-03-26 05:50:18 +00:00
yihaoDeng
c3d7f888e9 add backend 2023-03-26 05:46:48 +00:00
yihaoDeng
b9531fc9a7 add backend 2023-03-25 06:46:19 +00:00
yihaoDeng
8e409f81ae add backend 2023-03-25 06:43:17 +00:00
yihaoDeng
b17f99de47 add backend 2023-03-23 12:49:33 +00:00
yihaoDeng
981466a0c7 failed to read from 2023-03-22 14:35:24 +00:00
yihaoDeng
40535b5ede add backend 2023-03-22 13:34:19 +00:00
yihaoDeng
b701198dbb add backend 2023-03-22 13:19:56 +00:00
dapan1121
5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
yihaoDeng
43e16c865a add backend 2023-03-22 01:16:49 +00:00
yihaoDeng
7e33e70a66 add backend 2023-03-21 14:00:51 +00:00
yihaoDeng
764a81298f add backend 2023-03-21 13:21:36 +00:00
yihaoDeng
914d391845 fix tag filter 2023-03-21 12:28:16 +00:00
yihaoDeng
2d37aeabdc add backend 2023-03-20 15:33:18 +00:00
yihaoDeng
05a205d3b8 add backend 2023-03-20 02:00:31 +00:00
yihaoDeng
e04de7f6df add backend 2023-03-18 07:37:54 +00:00
yihaoDeng
8039702c14 add backend 2023-03-18 07:36:55 +00:00
54liuyao
2185464836 fix:scan of fill history ended prematurely 2023-03-18 13:38:33 +08:00
yihaoDeng
e2646734ad enh: add queue limit 2023-03-15 12:01:16 +00:00
yihaoDeng
ef092c1cce enh: add queue limit 2023-03-15 11:54:36 +00:00
Shengliang Guan
08601f4b83
Merge pull request #20451 from taosdata/fix/TD-23134 
fix: fix coverity scan
 2023-03-15 14:10:18 +08:00
54liuyao
25732f7c3c fix:source task needs to wait & stream state window does not handle null 2023-03-15 13:15:17 +08:00
54liuyao
96db1192ae fix: fix coverity scan 2023-03-15 09:03:05 +08:00
54liuyao
0cd871010f fix:fix fill history bug 2023-03-07 13:34:26 +08:00
yihaoDeng
1cb6e49c79 change default config 2023-03-02 13:04:49 +08:00
Xiaoyu Wang
5856a39827
Merge pull request #20123 from taosdata/fix/3.0_merge_main 
merge main
 2023-02-25 10:01:26 +08:00
Haojun Liao
22aa03307c fix(query): fix syntax errors on centos. 2023-02-24 11:38:54 +08:00
Xiaoyu Wang
1ab144609e merge main 2023-02-23 14:58:22 +08:00
54liuyao
1d58f85a54 feat:coverity scan 2023-02-22 10:10:04 +08:00
Xiaoyu Wang
c597de099f merge main 2023-02-20 13:41:27 +08:00
Haojun Liao
751c1cb5d2 refactor:do some internal refactor. 2023-02-20 10:12:27 +08:00
54liuyao
2270fed9f7 fix:add limit for stream batch 2023-02-18 11:57:24 +08:00
Liu Jicong
2a4708d82a fix: save fill history state 2023-02-16 17:01:09 +08:00
Haojun Liao
c9ce01c878 Merge branch 'main' into feature/3_liaohj 2023-02-13 17:09:27 +08:00
Liu Jicong
7a4c8f30db reset default cfg 2023-02-13 10:54:13 +08:00
Liu Jicong
0cd6bd3d86 Merge branch 'main' into enh/stream_buffer_param 2023-02-13 09:48:02 +08:00
Liu Jicong
1114fef337 add cfg 2023-02-13 09:47:30 +08:00
Haojun Liao
a7fdc4bae3 other: merge 3.0 2023-02-10 19:20:24 +08:00
Liu Jicong
c8acfc4d54 fix: stream meta 2023-02-10 10:48:26 +08:00
Xiaoyu Wang
b2e60da1cf merge main 2023-02-10 10:34:55 +08:00
Xiaoyu Wang
09925437e3 merge main 2023-02-08 09:51:52 +08:00
Minglei Jin
f4a60a4364 fix(stream/state): switch tdb rollback on to restore from journals 2023-02-07 15:11:22 +08:00
Xiaoyu Wang
5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Haojun Liao
ab8c977417 other: merge main. 2023-02-02 14:00:36 +08:00
Minglei Jin
df30b51a75 fix(stream): use tdb page replacement with stream state 2023-02-01 17:59:39 +08:00
Liu Jicong
98906bb272 remove assert 2023-01-29 15:24:31 +08:00
Xiaoyu Wang
24157e78d6 merge main 2023-01-28 17:52:58 +08:00
Liu Jicong
51866dadbe Merge branch 'fix/task_db' into enh/stream_buffer_param 2023-01-28 11:24:46 +08:00
Liu Jicong
089bc74055 Merge branch 'main' into enh/stream_buffer_param 2023-01-28 11:24:25 +08:00
Liu Jicong
0c6f6d3a42 fix: task db 2023-01-28 10:59:09 +08:00
54liuyao
e03deeaed8 feat:add stream delete mark 2023-01-17 16:21:51 +08:00
Haojun Liao
07cf336fa0 refactor: add an array list api. 2023-01-17 09:43:33 +08:00
Minglei Jin
a2e35ce13b streamState/tdb: use NULL for tdbBegin's heap source 2023-01-12 11:26:13 +08:00
54liuyao
d5ade95b31 feat(stream):user define tag 2023-01-10 10:13:56 +08:00
Shengliang Guan
398161eb5f Merge branch 'main' into merge/mainto3.0_0108 2023-01-09 10:00:53 +08:00
Liu Jicong
65e7dbda0c enh: enlarge state buffer size 2023-01-06 17:37:45 +08:00
Xiaoyu Wang
fdde287ca9 merge main 2023-01-04 11:43:20 +08:00
Benguang Zhao
4031dc1af4 Merge branch main into FIX/TD-21043-main 2023-01-02 16:41:46 +08:00
Benguang Zhao
3edde0eadf fix: tdbAbort on metaClose or streamMetaClose instead of tdbTxnClose 2023-01-01 21:07:32 +08:00
Shengliang Guan
3a11c62243
Merge pull request #19290 from taosdata/feature/stream_main 
fix: reset stream status when load from disk
 2022-12-30 19:44:09 +08:00
Liu Jicong
095c6d39ca reset param 2022-12-30 17:30:02 +08:00
Liu Jicong
4601e67e67 fix: reset stream status when load from disk 2022-12-30 16:59:48 +08:00
Shengliang Guan
85eba36190
Merge pull request #19257 from taosdata/refactor/stream_dispatch_main 
refactor: stream dispatch
 2022-12-30 10:18:29 +08:00
Shengliang Guan
fad687161b
Merge pull request #19255 from taosdata/enh/stream_drop_when_scan 
enh: optimize drop when scan exec
 2022-12-29 17:17:59 +08:00
Shengliang Guan
25e9d94f5b
Merge pull request #19244 from taosdata/feature/stream_main 
enh: put func state into tdb
 2022-12-29 17:17:29 +08:00
Liu Jicong
bfb92457fa refactor: stream dispatch 2022-12-29 16:24:30 +08:00
Liu Jicong
66b9fa01f7 enh: optimize drop when scan exec 2022-12-29 15:51:12 +08:00
Liu Jicong
7721353b6b enh: put func state into tdb 2022-12-29 12:39:07 +08:00
Benguang Zhao
d307413c36 Merge branch 'main' into FIX/TD-21043-main 2022-12-29 10:03:17 +08:00
Shengliang Guan
2bbf2f3ab1 Merge branch '3.0' into merge/mainto3.0_1229 2022-12-29 09:36:52 +08:00
Shengliang Guan
d09011def8
Merge pull request #19190 from taosdata/feature/stream_main 
fix memory leak
 2022-12-28 17:46:30 +08:00
Shengliang Guan
78c14a2c88 Merge remote-tracking branch 'origin/3.0' into merge/mainto3.0_1228 2022-12-28 14:59:02 +08:00
Benguang Zhao
6fc47beb71 enh: streamMetaCommit in sync with vnodeCommit 2022-12-28 14:34:23 +08:00
Shengliang Guan
d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req 
Refact/submit req
 2022-12-28 10:29:00 +08:00
Liu Jicong
bbab03274a fix memory leak 2022-12-27 18:02:43 +08:00
Liu Jicong
dcb71e4af1 refactor: stream dispatch 2022-12-27 15:17:43 +08:00
Liu Jicong
39eb62d80d enh: set scan limit 2022-12-27 14:52:41 +08:00
Liu Jicong
5826e40aa7 enh: drop stream eagerly 2022-12-27 11:20:35 +08:00
54liuyao
70ffbabcbf fix:remove assert 2022-12-26 10:15:14 +08:00
Xiaoyu Wang
0c269c317b merge 3.0 2022-12-23 17:50:05 +08:00
Liu Jicong
b1bd24d15a enh: scan exec set limit 2022-12-23 16:35:40 +08:00
Liu Jicong
69d410591f refactor: add debug log 2022-12-22 17:14:17 +08:00
Liu Jicong
2a7de0cd46 refactor: remove assert 2022-12-21 13:54:14 +08:00
Haojun Liao
48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00
Shengliang Guan
50b66df39f fix: control rpc qitem memory 2022-12-10 14:02:57 +08:00
Liu Jicong
ecbc09663f enh: tolerate exec error 2022-12-09 09:35:53 +08:00
Liu Jicong
74a253eac4 refactor 2022-12-08 13:34:42 +08:00
Shengliang Guan
6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan
d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Shengliang Guan
f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Liu Jicong
b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Shengliang Guan
c45001744f
Merge pull request #18674 from taosdata/feat/async_commit 
feat: async commit
 2022-12-04 22:31:04 +08:00
Alex Duan
213b97b79a feat(api): taos_affected_rows64 add and modfiy tmsg.h 2022-12-02 23:20:19 +08:00
Minglei Jin
6cb65f336d Merge branch 'v3.0' into feat/async_commit 2022-12-02 14:49:58 +08:00
Shengliang Guan
a366696478
Merge pull request #18596 from taosdata/feature/stream 
refactor(stream): distributed checkpoint
 2022-12-02 07:51:10 +08:00
Liu Jicong
3424b184d3 refactor(stream): distributed checkpoint 2022-12-02 03:48:45 +08:00
Hongze Cheng
3fc30c991e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-01 18:59:21 +08:00
Haojun Liao
124fb5fc50 refactor: do some internal refactor. 2022-11-30 17:52:12 +08:00
Hongze Cheng
df7c07a541 Merge branch 'fix/tdb-async-commit' of https://github.com/taosdata/TDengine into feat/async_commit 2022-11-30 16:48:09 +08:00
Liu Jicong
548684e5ac fix(stream): delete multiple row 2022-11-29 23:39:58 +08:00
Minglei Jin
2c771153ef fix(streamState): use new txn related api 2022-11-28 16:27:20 +08:00
Minglei Jin
506554b5d2 Merge branch 'v3.0' into fix/tdb-async-commit 2022-11-28 16:20:48 +08:00
Haojun Liao
6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Liu Jicong
48894c8bdb enh(stream): new api for stream queue 2022-11-25 18:03:40 +08:00
Minglei Jin
ada76477fc fix: free stream state cursor 2022-11-21 11:54:25 +08:00
54liuyao
3e29f19782 fix:stream state abnormal failure 2022-11-20 10:32:25 +08:00
Liu Jicong
9a603e5663 enh(stream): put user defined tb name into stream state 2022-11-18 17:21:50 +08:00
Minglei Jin
78335f83d2 tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state 2022-11-17 20:02:13 +08:00
Liu Jicong
5161eca70f fix(stream): stop scan when no output 2022-11-17 10:30:05 +08:00
Liu Jicong
015c00aaca fix(stream): timer refer stream task 2022-11-16 11:16:32 +08:00
Liu Jicong
a9bf05bc01 refactor: stream meta ref count 2022-11-15 19:11:42 +08:00
Liu Jicong
aa9e935854 enh(stream): set path max length to 1024 2022-11-14 14:46:50 +08:00
54liuyao
7ea790021f fix:avoid duplicate results 2022-11-11 16:18:54 +08:00
Liu Jicong
64f22d560c refactor(stream): drop stream task 2022-11-10 16:36:49 +08:00
Haojun Liao
015f1a1df8 other: merge 3.0 2022-11-09 19:17:45 +08:00
Haojun Liao
b48752686e refactor: do some internal refactor. 2022-11-09 13:45:46 +08:00
54liuyao
f66eded1e1 fix(stream): state window, error result after deleting data 2022-11-08 14:40:44 +08:00
Shengliang Guan
7a5be43d14
Merge pull request #17954 from taosdata/feature/stream 
fix(stream): delete tb should be checked in write thread
 2022-11-08 13:50:15 +08:00
Liu Jicong
bc469f7f7b fix(stream): delete tb should be checked in write thread 2022-11-08 11:30:29 +08:00
Minglei Jin
1a4cf6964b fix: add post commit to tq & stream 2022-11-07 20:34:23 +08:00
Liu Jicong
2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Liu Jicong
5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Liu Jicong
2e640c38a2 refactor: stream and tmq message 2022-10-31 18:37:28 +08:00
54liuyao
7d8a282258 fix(stream):tqBuildDeleteReq error 2022-10-28 11:19:26 +08:00
Liu Jicong
8d8fd2b2bc refactor(stream): recover and fill history 2022-10-26 10:20:33 +08:00
Liu Jicong
52b4b510a8 merge 3.0 2022-10-26 09:18:29 +08:00
Liu Jicong
75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
54liuyao
5cee271cbc fix(stream): stream state invalid cur 2022-10-24 13:28:13 +08:00
Liu Jicong
f49d91ac1a fix(stream): decode bloom filter 2022-10-21 17:22:31 +08:00
Liu Jicong
5571ebee0f
Merge pull request #17542 from taosdata/feature/stream 
enh(stream): internal optimize
 2022-10-21 14:31:42 +08:00
54liuyao
d9beaeb3a3 fix(stream):session window max_delay crash 2022-10-21 11:49:45 +08:00
Liu Jicong
26d4af6968 fix: memory leak 2022-10-21 11:42:30 +08:00
Liu Jicong
e0b5b9263e refactor: remove unused code 2022-10-21 10:42:24 +08:00
Liu Jicong
035e6b13c8 enh(stream): internal optimize 2022-10-21 10:29:05 +08:00
54liuyao
86a858e04d fix(stream): coverity scan 2022-10-20 11:41:20 +08:00
54liuyao
368f5134c5 feat(stream):optimize state window disc buff 2022-10-20 09:04:51 +08:00
Hongze Cheng
eb7de2e571
Merge pull request #17443 from taosdata/fix/commit_txn 
fix: commit txn
 2022-10-19 13:15:15 +08:00
54liuyao
7f16081e29 feat(stream): stream task and meta 2022-10-19 10:49:42 +08:00
Hongze Cheng
efa9f19d18 make it compile 2022-10-19 09:12:37 +08:00
Hongze Cheng
71a2db6cf2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-19 09:10:36 +08:00
Minglei Jin
82132cdfdd meta: new metaFinishCommit api & rollback parameter with metaOpen 2022-10-18 18:34:39 +08:00
54liuyao
8efd7e8763 feat(stream):replace disk buff 2022-10-18 18:13:47 +08:00
Liu Jicong
bf2d8540d3
Merge pull request #17355 from taosdata/feature/stream 
fix(stream): memory leak
 2022-10-14 17:24:24 +08:00
Liu Jicong
a57a305035 fix(stream): memory leak 2022-10-14 14:43:22 +08:00
54liuyao
d5a410b90e fix(stream):Defects Tracking, delete log 2022-10-14 14:29:25 +08:00
Hongze Cheng
5b6e928d65 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 14:25:51 +08:00
Hongze Cheng
63d9b85631 more code format 2022-10-13 13:59:18 +08:00
Liu Jicong
d507678b35 refactor(stream): set state buffer size 2022-10-13 11:18:02 +08:00
Liu Jicong
db6b0503a1 refactor(stream): change state table name 2022-10-12 14:34:04 +08:00
Liu Jicong
eafe8666f7 merge 3.0 2022-10-09 17:00:18 +08:00
Liu Jicong
2f9aeeb5fc feat(stream): support define table name 2022-10-09 16:54:27 +08:00
54liuyao
9c170ecfa8 fix(stream): filter error occurred when data was modified 2022-10-09 14:52:39 +08:00
54liuyao
f569355d06 fix(stream):memory leak 2022-10-08 11:04:36 +08:00
Zhiqiang Wang
d05b134a48
os: Mac package (#17201) 
* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package
 2022-10-08 10:12:17 +08:00
54liuyao
46c99915bc feat(stream): distribute interval disc buff 2022-09-30 10:01:51 +08:00
Cary Xu
9e49eb03e4 fix: coverity scan for sma 2022-09-28 18:54:39 +08:00
54liuyao
747297bd28 feat(stream): stream fill 2022-09-27 18:11:44 +08:00
Liu Jicong
72fba5a8ce fix(stream): check delete uid 2022-09-21 11:54:44 +08:00
54liuyao
97ca09689c Merge branch 'feature/stream' into feature/TD-18820 2022-09-19 19:31:41 +08:00
Liu Jicong
86c0fb56e0 enhance stream backend for sma 2022-09-19 17:27:25 +08:00
54liuyao
955838d1f6 feat(stream): optimize disc buff 2022-09-19 17:13:13 +08:00
Liu Jicong
4c6a8bbc95 feat(stream): stream state support tuple 2022-09-14 16:50:42 +08:00
Liu Jicong
b8a7c8b2aa feat(stream): support hash suffix and prefix 2022-09-13 15:21:26 +08:00
54liuyao
1f5d9a38e7 feat(stream):change single interval disc buff and interval delete 2022-09-07 14:48:14 +08:00
Liu Jicong
d653da7971 feat(stream): support delete data 2022-09-02 15:46:41 +08:00
54liuyao
83e62c3849 feat(stream):stream partition by column 2022-09-01 15:05:24 +08:00
Minglei Jin
04e5c75bba fix: cleanup memory with streamLoadTasks 2022-08-26 14:51:30 +08:00
Liu Jicong
24261cc90b refactor(stream): refine stream backend interface 2022-08-24 15:53:29 +08:00
Liu Jicong
d7b804e02e fix stream load task 2022-08-24 10:42:34 +08:00
Liu Jicong
c296dd0a63 fix compile 2022-08-24 01:48:00 +08:00
Liu Jicong
2d628491b2 feat(stream): support tdb state backend 2022-08-23 19:30:04 +08:00
Liu Jicong
2b092f6551 fix(query): memory leak 2022-08-18 18:39:21 +08:00
Liu Jicong
963287798d refactor(mnode): drop stream task 2022-08-17 23:18:39 +08:00
Liu Jicong
853e6e2988 refactor(mnode): drop stream task 2022-08-17 19:19:58 +08:00
Liu Jicong
357b21cfeb refactor(tmq): use tdb to store check info 2022-08-17 13:58:56 +08:00
Liu Jicong
2ced6c280c enh(stream): reduce table scan 2022-08-16 12:11:56 +08:00
54liuyao
44123ec8f0 feat(stream):optimzie stream interval 2022-08-11 10:20:42 +08:00
Liu Jicong
51aa9413d7
Merge pull request #15937 from taosdata/feature/stream 
enh(tmq): speed up consumer recover
 2022-08-10 17:19:36 +08:00
Haojun Liao
6250c1b157
Merge pull request #15851 from taosdata/feature/3.0_query_optimize 
ehn(query): optimize the query performance.
 2022-08-10 16:51:46 +08:00
Liu Jicong
e5e82f0cf2 merge 3.0 2022-08-10 16:31:23 +08:00
Liu Jicong
18f6fb6123 enh(tmq): speed up consumer recover 2022-08-10 16:04:03 +08:00
Liu Jicong
a62950b441
Merge pull request #15920 from taosdata/feature/stream 
enh(stream): recover process
 2022-08-09 23:35:03 +08:00
Liu Jicong
fc225a580d enh(stream): recover process 2022-08-09 21:37:21 +08:00
54liuyao
41e2538ade scalable bloom filter encode & decode 2022-08-09 16:54:59 +08:00
Liu Jicong
d9a4ea305d fix(stream): memory error 2022-08-09 14:11:41 +08:00
Haojun Liao
b9c6e0cdf9 refactor: stream invoke previous APIs. 2022-08-09 13:55:51 +08:00
Haojun Liao
a2a1da06dd other:merge 3.0 2022-08-09 13:45:44 +08:00
Xiaoyu Wang
07ef00e89f merge 3.0 2022-08-09 11:36:08 +08:00
Liu Jicong
ad032a0a90 enh(stream): stream recover 2022-08-09 10:36:27 +08:00
Liu Jicong
e30b74ad5a fix(stream): memory leak 2022-08-08 18:53:49 +08:00
Liu Jicong
c411b9aebb fix(stream): memory leak 2022-08-08 18:09:36 +08:00
Haojun Liao
4d8842c21f other:merge 3.0 2022-08-08 16:37:37 +08:00
Liu Jicong
bb0ce39511 refactor(stream): add stream meta 2022-08-08 15:05:54 +08:00
Liu Jicong
43026ac31d refactor(stream) 2022-08-08 11:29:50 +08:00
54liuyao
214d3609b2 fix(stream):set num of stream session child 2022-08-06 15:14:11 +08:00
Liu Jicong
7c9d57bd89 refactor(stream): unify sink and dispatch 2022-08-05 20:16:47 +08:00
Haojun Liao
0e4748771a enh(query): support combine multi datablock to pass to upstream operators 2022-08-05 14:10:45 +08:00
Liu Jicong
6f8683de7e enh(tmq): retry consumer close 2022-08-04 20:37:02 +08:00
Liu Jicong
031414001d fix schedule 2022-08-04 17:46:13 +08:00
Liu Jicong
e64e41679e fix schedule 2022-08-04 17:00:45 +08:00
Liu Jicong
d6cc88ed4b refactor(stream): exec scheduler 2022-08-04 16:19:53 +08:00
Liu Jicong
e345023dfd enh(stream): keep thread from blocking 2022-08-03 15:31:10 +08:00
Liu Jicong
c089d3ba08 merge 3.0 2022-08-02 22:53:49 +08:00
Liu Jicong
d43eec5d16 enh(stream): directly dispatch 2022-08-02 22:23:33 +08:00
Shengliang Guan
56f2e49764 refactor: adjust logs 2022-08-02 17:12:07 +08:00
54liuyao
b3d104349f feat(stream):optimize stream update scan 2022-08-01 17:09:46 +08:00
Liu Jicong
6c250e75cd fix(stream): forbid histogram in stream 2022-07-29 21:28:18 +08:00
Liu Jicong
a9d11b58ad enh(stream): recover 2022-07-28 16:19:50 +08:00
Liu Jicong
904ec81bf9 fix(stream): concurrency dispatch 2022-07-27 21:02:21 +08:00
Liu Jicong
ba0c1b3689 refactor(stream) 2022-07-27 20:11:03 +08:00
Liu Jicong
5e1bbe0e7e refactor(sma): remove option 2022-07-27 16:55:23 +08:00
Liu Jicong
00acf4520c refactor(stream): remove option 2022-07-27 16:49:03 +08:00
Liu Jicong
57f9d8b0b0 fix(stream): dispatch 2022-07-27 11:44:01 +08:00
Liu Jicong
3fa5791889 fix(stream): dispatch 2022-07-27 10:52:25 +08:00
jiajingbin
8833a8bdfb fix: fix bug for TD-17801 2022-07-25 21:39:12 +08:00
54liuyao
b28553395f feat(stream): adjust stream scan 2022-07-22 20:13:37 +08:00
Liu Jicong
b1f3428c05 refactor(stream): do not merge output 2022-07-22 10:43:49 +08:00
Liu Jicong
81d8d2b937 feat(stream): add version in stream block 2022-07-21 17:27:44 +08:00
54liuyao
f5a326dbf4 feat(stream): optimize update data check 2022-07-21 15:16:57 +08:00
Liu Jicong
edaec52bca refactor: add debug flag 2022-07-19 19:59:07 +08:00
Liu Jicong
414673db57
Merge branch '3.0' into feature/stream 2022-07-19 19:46:36 +08:00
Liu Jicong
24bc71568e refactor(stream): batch optimization for submit msg 2022-07-19 18:29:12 +08:00
jiacy-jcy
5200a48107 fix: update 2022-07-19 16:54:19 +08:00
Liu Jicong
bc1af6deaf refactor(stream): batch optimization for submit msg 2022-07-19 15:52:08 +08:00
54liuyao
8e41fc912b feat(stream): add num of children 2022-07-19 14:17:53 +08:00
Liu Jicong
b6f55fa09e refactor(stream): batch optimization for submit msg 2022-07-18 21:32:40 +08:00
Liu Jicong
053786e6b4 fix(stream): data exec 2022-07-18 15:50:36 +08:00
Liu Jicong
500553d581 refactor: add debug log 2022-07-18 11:41:56 +08:00
Liu Jicong
280ed4f65d feat(stream): pipelined exec for recovering 2022-07-15 21:29:53 +08:00
Liu Jicong
9394e3380f feat(stream): recover from failure 2022-07-15 17:58:53 +08:00
Liu Jicong
d75e9b8f6a merge from 3.0 2022-07-14 15:35:00 +08:00
Liu Jicong
9ea0ad57ec refactor(stream): destroy stream task 2022-07-14 15:32:21 +08:00
Haojun Liao
b23e08db85
Merge pull request #14893 from taosdata/feature/3_liaohj 
fix(query): set correct fill output column index and fix some memory leaks
 2022-07-14 14:25:24 +08:00
Haojun Liao
75aca0b031 fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor, 2022-07-14 13:53:23 +08:00
54liuyao
13519f8fd9 feat(stream): interval offset 2022-07-14 11:24:24 +08:00
Liu Jicong
a717042acf refactor(stream): simple batch 2022-07-13 17:24:36 +08:00
Liu Jicong
eb49ec97ae Merge branch 'fix/dnode' into feature/stream 2022-07-13 16:38:32 +08:00
Liu Jicong
8a6e4b877a refactor(stream): simple batch 2022-07-13 16:37:33 +08:00
Shengliang Guan
c2aebfa322 enh: add stream queue to vnode 2022-07-13 16:26:22 +08:00
Liu Jicong
8e3f5135a6 fix(tsdb): close fd 2022-07-12 17:28:14 +08:00
Liu Jicong
d637ffe22c refactor(tmq): prepare only needed 2022-07-12 14:10:22 +08:00
Liu Jicong
9fd5ec9020 fix(wal): rollback 2022-07-11 13:38:50 +08:00
Liu Jicong
8c5dbde918 refactor(stream): stream reader created in scanner 2022-07-06 14:20:07 +08:00
Liu Jicong
52d09b4173 refactor(wal) 2022-07-01 14:39:21 +08:00
Liu Jicong
0f0fe6276a merge from 3.0 2022-06-29 21:33:10 +08:00
Liu Jicong
c2955a807b feat(tmq): offset support snapshot 2022-06-29 21:04:51 +08:00
Liu Jicong
58803fafcf fix(query): check datablock should check output flag 2022-06-28 16:05:00 +08:00
Liu Jicong
383e7a495b fix(query): enable output check 2022-06-28 13:45:50 +08:00
54liuyao
10e90ce973 feat(stream): auto pull data 2022-06-25 16:44:14 +08:00
Liu Jicong
90121ae439 fix(tmq): check stb existence when subscribing stb 2022-06-25 15:26:29 +08:00
Liu Jicong
81ed902d7f fix(stream): stream rsp to retrieve msg if data is empty 2022-06-25 14:03:06 +08:00
Liu Jicong
5040cb9541 enh(query): window included in serialized retrieve table rsp 2022-06-25 10:43:19 +08:00
Liu Jicong
0964b07229 fix(stream): support none type in submit msg 2022-06-24 21:44:53 +08:00
Liu Jicong
f53521cb8c test(stream): partition by tbname 2022-06-24 16:50:11 +08:00
Liu Jicong
f2f5d68f3b fix(stream): memory leak 2022-06-23 22:05:00 +08:00
Liu Jicong
bd64bebb63
Merge branch '3.0' into feature/3_liaohj 2022-06-23 16:00:17 +08:00
Liu Jicong
4ed47a0296 feat(tmq): scan tsdb as snapshot 2022-06-23 13:35:24 +08:00
Haojun Liao
2d31d3cb43 other: merge 3.0 2022-06-23 10:37:07 +08:00
Liu Jicong
14a488c92c feat(stream): stream support multiple type input 2022-06-22 21:21:39 +08:00
Haojun Liao
ed8002f903 fix(query): fix syntax error. 2022-06-22 20:34:24 +08:00
Haojun Liao
bf0caa2038 Merge branch '3.0' into feature/3_liaohj 2022-06-22 20:32:02 +08:00
Liu Jicong
fb596625d3 feat(stream): support retrieve 2022-06-22 19:12:31 +08:00
Haojun Liao
5c1e7f3114 Merge branch '3.0' into feature/3_liaohj 2022-06-22 17:23:57 +08:00
Haojun Liao
14ddf539e0 refactor(query): do some internal refactor. 2022-06-22 17:21:04 +08:00
Liu Jicong
3f6ce2da73 feat(tmq): support topic with meta 2022-06-21 15:18:09 +08:00
Liu Jicong
c409760f75 feat(stream): drop stream 2022-06-21 11:32:36 +08:00
Liu Jicong
450675f672 feat(stream): support snode 2022-06-20 20:18:34 +08:00
Liu Jicong
53ef66961a feat(stream): support snode 2022-06-20 14:29:18 +08:00
Liu Jicong
342a1ae42d fix(stream): build ctb name 2022-06-17 21:00:10 +08:00
Liu Jicong
8eb08fa0d4 feat(stream): trigger mode add max delay 2022-06-15 16:11:20 +08:00
Liu Jicong
0ef33c05bc enh(tmq): avoid uninitialized memory 2022-06-11 21:36:15 +08:00
Liu Jicong
767b768e51 fix(stream): fix shuffle vg id not initialized 2022-06-11 15:20:59 +08:00
Liu Jicong
73b8f02ac7 fix(stream): set child id 2022-06-10 12:00:38 +08:00
Liu Jicong
0e1328ae7f fix(stream): set child id 2022-06-10 10:24:56 +08:00
Liu Jicong
9e4b3adc7c fix(stream): msg dispatch 2022-06-09 11:45:06 +08:00
Liu Jicong
83f5e5eedc fix(stream): fix no executor stream task 2022-06-09 09:56:45 +08:00
Liu Jicong
cbbf5f5d4d refactor(stream) 2022-06-07 21:35:49 +08:00
Liu Jicong
46bea47b62 enh(stream): direct sink if not dispatch 2022-06-07 19:58:06 +08:00
Liu Jicong
94d7cbe622 feat(stream): snode process stream msg 2022-06-07 16:24:50 +08:00
Liu Jicong
65900c32c3 enh(stream): use same name rule with schemaless 2022-06-07 15:40:11 +08:00
Liu Jicong
1a84d07188 fix(stream): msg deserialize 2022-06-07 11:36:40 +08:00
Liu Jicong
858868d76a refactor(stream): distributed execution 2022-06-07 10:54:18 +08:00
Liu Jicong
1b26da1bae refactor(stream): distributed execution 2022-06-06 22:18:50 +08:00
Liu Jicong
2677a3c8d9 refactor(stream) 2022-06-06 20:15:36 +08:00
Liu Jicong
e1a5000e50 refactor(tmq): tq sink and push 2022-06-01 17:26:15 +08:00
54liuyao
870f24a0c9 feat(stream):adjust bloom filter 2022-05-31 17:15:43 +08:00
54liuyao
901ff9bf18 feat(sma):files factor 2022-05-31 16:14:56 +08:00
Cary Xu
f2b4cca23d fix: init buffer to avoid invalid write 2022-05-29 01:10:32 +08:00
Liu Jicong
c47827527a
Merge pull request #13167 from taosdata/feature/tq 
fix(tmq): update tq for auto create table
 2022-05-28 20:01:15 +08:00
Liu Jicong
1aa97bc117 fix(tmq): update tq for auto create table 2022-05-28 19:48:17 +08:00
54liuyao
aa20cfedcd feat(stream): watermark and trigger 2022-05-28 18:19:36 +08:00
Haojun Liao
d87bb5f3fa refactor(query): set the block groupId for stream block. 2022-05-27 10:03:45 +08:00
Liu Jicong
d5d8581bcf refactor(stream): remove out-of-date msg 2022-05-26 21:45:59 +08:00
Liu Jicong
d3a2e98d60 fix(stream): double free 2022-05-26 20:52:27 +08:00
Liu Jicong
a0f3138888 fix(stream): tb name error 2022-05-26 11:16:35 +08:00
Liu Jicong
86c9446a84 fix(stream): handle null data 2022-05-25 19:37:52 +08:00
Liu Jicong
79e97271ca fix(stream): memory error 2022-05-25 18:43:25 +08:00
54liuyao
0778bf8857 stream session operator 2022-05-25 09:05:03 +08:00
Liu Jicong
a393dee9d2 refactor(stream) 2022-05-23 16:51:12 +08:00
54liuyao
42fcb433dc fix(stream):adjust bloom filter 2022-05-23 11:30:22 +08:00
Liu Jicong
fc9c22b89c fix(stream): array init error 2022-05-21 17:35:14 +08:00
Liu Jicong
7391a756f6 refactor(stream) 2022-05-20 18:53:21 +08:00
Liu Jicong
71984b4268 refactor(stream): exec 2022-05-20 05:43:36 +08:00
Shengliang Guan
0623514ed1 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-05-17 16:12:53 +08:00
Shengliang Guan
36fe62fbd2 refactor: make more object global 2022-05-16 23:23:49 +08:00
Liu Jicong
b3fea32a7e refactor(stream) 2022-05-16 22:43:04 +08:00
Shengliang Guan
81e89ec7b6 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-05-16 20:13:02 +08:00
Shengliang Guan
fc94b71c80 refactor: adjust SRpcMsg 2022-05-16 15:17:11 +08:00
Liu Jicong
f77f910264 refactor(stream) 2022-05-16 02:11:47 +08:00
Liu Jicong
a6015d2f39 refactor(stream) 2022-05-15 08:14:23 +08:00
54liuyao
4b564b2ebd add stream ci 2022-05-13 15:37:31 +08:00
54liuyao
42f27e99d0 steam reprocess window 2022-05-12 22:15:13 +08:00
Liu Jicong
d17b478e96 feat(stream): auto create ctb 2022-05-08 02:37:23 +08:00
Liu Jicong
db3cbbf22d fix(query): column match 2022-05-08 00:21:17 +08:00
Liu Jicong
3ed1ab6acb enh(stream): auto create ctb 2022-05-07 23:19:05 +08:00
Hongze Cheng
a06bf6e5ca
Merge pull request #12206 from taosdata/feature/vnode_refact1 
refact: vnode
 2022-05-07 19:05:25 +08:00
54liuyao
599ea89a53 stream scan 2022-05-07 18:10:45 +08:00
Hongze Cheng
323ce214b6 refact encode APIs 2022-05-07 10:03:06 +00:00
Liu Jicong
a5706ea7e5 feat(stream): insert data 2022-05-05 18:57:09 +08:00
Liu Jicong
de939d589f fix: memory error 2022-04-29 20:11:58 +08:00
liuyao
a9c159db7a
Merge pull request #12012 from taosdata/feature/TD-15111 
add unit test
 2022-04-28 16:54:00 +08:00
Liu Jicong
ca61066b32
Merge pull request #12006 from taosdata/feature/tq 
enh(tmq): add rebalance global lock
 2022-04-28 16:27:51 +08:00
54liuyao
564f2f188f add unit test 2022-04-28 16:13:34 +08:00
Liu Jicong
131a1c13c5 fix show 2022-04-28 15:53:12 +08:00
root
fde3f3f68f stream update 2022-04-28 13:32:11 +08:00
afwerar
2662a3b69d [TD-13254]<fix>: make 3.0 grant. 2022-04-10 19:08:16 +08:00
Liu Jicong
e163197573 merge from 3.0 2022-03-31 15:55:34 +08:00
Liu Jicong
3e5da8bedb fix 2022-03-31 15:52:54 +08:00