Commit graph

503 commits

Author SHA1 Message Date
54liuyao
99f4484328 adj stream operator result 2024-07-18 11:26:50 +08:00
54liuyao
4e6b898c9a adj stream operator result 2024-07-18 10:37:14 +08:00
54liuyao
113cb57326 adj stream operator result 2024-07-17 19:35:35 +08:00
Haojun Liao
665fbd6f22
Merge pull request #26551 from taosdata/fix/TD-30967
feat: adj result of function
2024-07-17 09:09:23 +08:00
Haojun Liao
94f596c4ce refactor: remove the invalid return value. 2024-07-16 18:52:01 +08:00
54liuyao
29381075c5 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30967 2024-07-16 08:54:12 +08:00
54liuyao
3cdb957f22 adj function of stream operator result 2024-07-15 15:32:11 +08:00
54liuyao
9b067d075f adj stream function return 2024-07-15 13:38:34 +08:00
dapan1121
4c2c9a71d5 fix: table info issue 2024-07-15 10:05:57 +08:00
54liuyao
5b982354e1 adj bloomfilter 2024-07-12 15:30:03 +08:00
54liuyao
1c9011e820 stream time slice 2024-07-12 11:03:45 +08:00
dapan1121
55ba9054ea enh: add stat info 2024-07-02 19:25:33 +08:00
dapan1121
b3eb938527 enh: add query memory pool 2024-07-01 17:22:43 +08:00
wangjiaming0909
11a98ffab2 QueryAutoQWorker 2024-07-01 11:08:39 +08:00
54liuyao
ecfb5e5f4c adj par name catch 2024-06-20 09:28:04 +08:00
Haojun Liao
2534ce5071 fix(stream): fix a typo. 2024-06-19 10:29:01 +08:00
Haojun Liao
985d619569 fix(stream): fix syntax error. 2024-06-17 23:14:33 +08:00
Haojun Liao
895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
Haojun Liao
6d7e1eb576 fix(query): check for the server ep and client ep to set the compress flag. 2024-06-04 15:07:02 +08:00
Haojun Liao
927e2237de Merge branch '3.0' into fix/3_liaohj 2024-06-03 15:56:02 +08:00
54liuyao
441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
Haojun Liao
3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
Haojun Liao
92b247e5b4 refactor: move compress data in query threads. 2024-05-16 15:55:48 +08:00
Haojun Liao
6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
t_max
f030af3aab fix: build fails on macOS and Windows 2024-05-11 14:59:05 +08:00
Shungang Li
7ae4415890 fix: refactor lastcache ser/des for compatibility 2024-05-09 19:04:11 +08:00
54liuyao
2a72ceadd1 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-24 18:57:22 +08:00
54liuyao
85cd290aa5 opt bloom filter 2024-04-24 18:40:39 +08:00
54liuyao
3300bf04c1 opt bloom filter 2024-04-24 17:27:24 +08:00
Haojun Liao
ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
yihaoDeng
4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00
wangmm0220
f609a45dd2 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-11 16:21:14 +08:00
54liuyao
1d42e927c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-04-11 15:35:42 +08:00
54liuyao
e161556f51 set ts column index for function 2024-04-10 15:35:25 +08:00
wangmm0220
fe7a42b118 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-01 09:11:39 +08:00
factosea
9ddc0b51cb merge 2024-03-29 10:37:59 +08:00
Haojun Liao
f61596706d fix(tsdb): add attributes for cache scan optr. 2024-03-26 17:34:30 +08:00
wangmm0220
912cb09839 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-03-22 18:22:13 +08:00
wangmm0220
f1853ced26 feat:[TS-4243] add logic for primark key in tmq 2024-03-22 17:48:59 +08:00
kailixu
fb2667d92d fix: sys table scan and meta query 2024-03-22 10:33:46 +08:00
Haojun Liao
74d7a0bd3e
Merge pull request #25112 from taosdata/fix/3_liaohj
fix(meta): fix repeatly reader lock for tsdb meta.
2024-03-16 23:57:55 +08:00
Haojun Liao
93c808326b fix(meta): fix repeatly reader lock for tsdb meta. 2024-03-16 22:03:46 +08:00
yihaoDeng
fe10867547 Merge branch '3.0' into feature/compressData 2024-03-14 03:19:39 +00:00
wangmm0220
80f55abc61 fix:[TS-4540]seperate block if insert in one sql when subscribe query 2024-03-07 14:16:10 +08:00
yihaoDeng
63d3671f42 add new msg 2024-03-06 12:06:26 +00:00
Haojun Liao
46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023
stream count window
2024-02-20 08:50:25 +08:00
Haojun Liao
e62dd2ff5c refactor: do some internal refactor. 2024-02-19 10:31:25 +08:00
54liuyao
05eaa90c11 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-19 08:59:15 +08:00
wangmm0220
871ebfa7ba Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-06 14:02:46 +08:00
wangmm0220
5796f411e4 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-05 17:08:05 +08:00
wangmm0220
a656d75ca7 opti:consume data excluded from some source 2024-02-05 17:07:50 +08:00
54liuyao
b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
54liuyao
ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao
3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
54liuyao
d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
Haojun Liao
ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao
3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
fullhonest
cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao
af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Haojun Liao
1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash
Fix/snode backend crash
2023-12-16 13:13:28 +08:00
yihaoDeng
7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
shenglian zhou
cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao
4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao
7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
shenglian zhou
a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
yihaoDeng
87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
slzhou
e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
shenglian zhou
bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
slzhou
4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
54liuyao
ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
slzhou
4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
shenglian zhou
df4f7d6956 Revert "Revert "enhance: duration notification""
This reverts commit 3331e25aaf.
2023-11-28 10:31:18 +08:00
shenglian zhou
3331e25aaf Revert "enhance: duration notification"
This reverts commit 9dd306e1ef.
2023-11-28 08:29:05 +08:00
shenglian zhou
9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
Haojun Liao
b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao
2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898
stream event window
2023-11-15 14:18:07 +08:00
Haojun Liao
e46a13c788
Merge pull request #23669 from taosdata/enh/stream_delay
opt max delay
2023-11-14 09:31:17 +08:00
liuyao
6d2d5823dc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 09:24:05 +08:00
liuyao
340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
kailixu
b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu
6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
Haojun Liao
d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao
53b2158c54 refactor: do some internal refactor. 2023-11-03 13:51:17 +08:00
liuyao
d0e4a5d0f7 opt max delay 2023-10-25 20:29:25 +08:00
liuyao
f51c985914 stream event window 2023-10-25 17:50:16 +08:00
wangmm0220
473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
wangmm0220
b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220
3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
liuyao
ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
kailixu
8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
liuyao
1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
Haojun Liao
24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
dapan1121
1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
dapan1121
cb70861986 fix: memory leak issue 2023-08-22 18:40:42 +08:00
yihaoDeng
6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
liuyao
87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121
efc5589aa2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-18 14:11:26 +08:00
shenglian zhou
4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
Haojun Liao
ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
dapan1121
143c657571 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-16 14:50:31 +08:00
dapan1121
6ce28e8886 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-14 10:49:56 +08:00
dapan1121
c9656d3f77 fix: fix memory issues 2023-08-11 17:39:41 +08:00
slzhou
42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
shenglian zhou
b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
Haojun Liao
f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao
3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
dapan1121
0546bdceb2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-07 11:23:15 +08:00
Haojun Liao
8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
Haojun Liao
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
check update data
2023-07-31 22:56:05 +08:00
liuyao
32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
Haojun Liao
9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao
8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
dapan1121
b7126b9cc6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-28 18:01:11 +08:00
Haojun Liao
3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
dapan1121
6a0061ccfb fix: invalid task status update issue 2023-07-26 13:54:58 +08:00
wangmm0220
bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
Haojun Liao
2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
Haojun Liao
3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao
d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
liuyao
7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
liuyao
6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
liuyao
0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
dapan1121
b371b7e6be fix: compile issue and merge join crash issue 2023-07-06 10:52:28 +08:00
dapan1121
0718859c0a enh: support passing params between nodes 2023-07-05 19:24:06 +08:00
Haojun Liao
9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
wangmm0220
58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
liuyao
2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Haojun Liao
a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
liuyao
e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
Haojun Liao
6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Shungang Li
b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
liuyao
41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
liuyao
693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao
7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Haojun Liao
53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Haojun Liao
c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Haojun Liao
6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Haojun Liao
fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Minglei Jin
d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
Haojun Liao
d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
Haojun Liao
5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
wangmm0220
d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
wangmm0220
41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220
07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
wangmm0220
78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
wangmm0220
a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao
8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
Haojun Liao
953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Haojun Liao
e24ce2111f fix: set function ptr. 2023-05-26 00:00:07 +08:00
Haojun Liao
c3be7b14be fix: set correct function ptr. 2023-05-25 17:51:03 +08:00
Haojun Liao
0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao
4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
Haojun Liao
a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao
ab907e3344 fix(query): fix syntax error. 2023-05-24 21:53:40 +08:00
wangmm0220
8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Haojun Liao
fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Haojun Liao
a566180770 fix: fix syntax error. 2023-05-24 15:16:50 +08:00
Haojun Liao
1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
Haojun Liao
66477a28ca refactor: do some internal refactor. 2023-05-23 19:10:50 +08:00
Haojun Liao
85afbf0d35 refactor: do some internal refactor. 2023-05-23 18:58:54 +08:00
Haojun Liao
a63473b1cc refacotor: do some internal refactor. 2023-05-23 18:54:32 +08:00
Haojun Liao
c66c0c4dfd refactor: do some internal refactor. 2023-05-23 18:42:52 +08:00
Haojun Liao
e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
Hui Li
3f824e2045
Merge pull request #21355 from taosdata/mark/tmq
fix:error in pHandle lock
2023-05-22 08:57:45 +08:00
wangmm0220
04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
wangmm0220
ff2b545b27 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 17:16:47 +08:00
Haojun Liao
1e020a46c9 other: merge main. 2023-05-19 09:07:35 +08:00
Haojun Liao
5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
wangmm0220
ee32620808 fix:[TS-3347]set ver to first version if version stored is smaller than first version in wal when subscribe db 2023-05-06 16:22:30 +08:00
Haojun Liao
09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Haojun Liao
03b1de017a refactor: remove assert. 2023-04-28 14:12:17 +08:00
Haojun Liao
eb7f510ccb fix(query): return correct suid to delete sink. 2023-04-17 10:59:24 +08:00
Haojun Liao
eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao
f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Xiaoyu Wang
4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
liuyao
74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao
a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
Haojun Liao
f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
Xiaoyu Wang
e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
wangmm0220
d651ba02ae fix:lose consume data because of exec close if consume while insert data 2023-04-03 19:54:52 +08:00
wangmm0220
97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
Haojun Liao
56c98d7768 refactor: do some internal refactor. 2023-03-29 19:35:04 +08:00
wangmm0220
d0c55ef572 fix:conflicts 2023-03-28 18:12:13 +08:00
Haojun Liao
c158087d66 fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers. 2023-03-28 09:53:49 +08:00
dapan1121
5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
wangmm0220
f7b7320f5f fix:set offset if read wal none 2023-03-20 16:57:45 +08:00
wangmm0220
506c192bff fix:error in TD-23218 & remove useless logic 2023-03-20 16:26:15 +08:00
wangmm0220
f80078030c fix:error in TD-23218 & remove useless logic 2023-03-20 15:40:01 +08:00
Haojun Liao
7e712a14b6 fix(tmq): adjust log. 2023-03-19 19:06:28 +08:00
Haojun Liao
ae5155edcf fix(tmq): do some internal refactor. 2023-03-19 10:49:30 +08:00
wangmm0220
7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
54liuyao
0cd871010f fix:fix fill history bug 2023-03-07 13:34:26 +08:00
Haojun Liao
0d9d2ea293 fix(query): do some internal refactor, and fix the bug when calender time duration exists in sliding and offset. 2023-02-17 18:31:32 +08:00
Shengliang Guan
3016f35e9f Merge branch '3.0' into merge/mainto3.0_0105 2023-01-05 16:08:23 +08:00
Liu Jicong
e30c00875c enh: close tsdb reader 2023-01-04 15:14:00 +08:00
dapan1121
1477ce97a7 fix: drop task while task executing issue 2023-01-03 18:07:18 +08:00
Shengliang Guan
d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong
39eb62d80d enh: set scan limit 2022-12-27 14:52:41 +08:00
Liu Jicong
b1bd24d15a enh: scan exec set limit 2022-12-23 16:35:40 +08:00
Liu Jicong
74a253eac4 refactor 2022-12-08 13:34:42 +08:00