Commit graph

18026 commits

Author SHA1 Message Date
wangmm0220
e7c84442dc fix(stream): add get tsdb/wal interface for vtable 2025-06-03 14:09:25 +08:00
dapan1121
e110f7fffe Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw9 2025-06-03 09:49:02 +08:00
dapan1121
52af23f309 fix: lastTaskId value 2025-06-03 09:48:03 +08:00
wangmm0220
db29960716 fix(stream): add get last/first ts interface for vtable 2025-05-30 18:54:18 +08:00
dapan1121
78bd13a68a enh: add stream health check 2025-05-30 18:15:49 +08:00
dapan1121
994eaa06d9 fix: crash issue 2025-05-30 16:54:19 +08:00
Jinqing Kuang
f8ddbe2500 feat(stream): add stream mgmt request 2025-05-30 11:42:54 +08:00
dapan1121
c27ad1ab64 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw9 2025-05-30 09:02:01 +08:00
dapan1121
b3b8db8307 enh: enhance stream mgmt 2025-05-30 08:56:34 +08:00
dongming chen
4aff5c9b06
fix/fix-ci-build (#31248) 2025-05-29 17:37:12 +08:00
dongming chen
4b0ec00b75
enh: [TS-6089] trans-parallel (#30265) 2025-05-29 16:49:43 +08:00
dongming chen
7126f40688
feat: [TD-29445] add error handling for offline vnode state (#31232) 2025-05-29 16:44:08 +08:00
WANG MINGMING
3006ee87ed
fix: avoid using : in consumer group (#31225) 2025-05-29 16:29:07 +08:00
dapan1121
fca4816606 fix: add virtual table process 2025-05-29 11:43:17 +08:00
facetosea
734e09a22f fix: table uid hash cache 2025-05-29 11:30:28 +08:00
wangmm0220
3a38149af6 fix(stream): add get OTableInfo interface 2025-05-28 19:41:10 +08:00
dapan1121
621edcdd02 fix: add status 2025-05-28 18:37:21 +08:00
wangmm0220
e6dfbf6295 fix(stream): add interface of get vtable info 2025-05-28 18:34:19 +08:00
dapan1121
829921cc21 fix: start/stop stream 2025-05-28 17:27:53 +08:00
dapan1121
be4cbde30a fix:drop stream issue 2025-05-28 17:27:53 +08:00
dapan1121
ca895c39aa fix: start/stop stream 2025-05-28 17:17:54 +08:00
Hongze Cheng
98e23733ba
fix: add duplicate tolerance (#31217) 2025-05-28 16:54:48 +08:00
dapan1121
c61a61db21 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw8 2025-05-28 16:28:22 +08:00
dapan1121
ecfe8791f8 fix:drop stream issue 2025-05-28 16:28:04 +08:00
dapan1121
d79e5e7ddd Merge remote-tracking branch 'origin/feat/TS-6100-3.0.pw8' into feat/TS-6100-3.0 2025-05-28 15:37:17 +08:00
dapan1121
dc9be241ec fix: trigReader issue 2025-05-28 15:36:30 +08:00
wangmm0220
1661db33b3 fix(stream): processTag coredump in walCaclRequest 2025-05-28 14:45:48 +08:00
Jing Sima
fa5b70d670 feat: [TS-6100] Parse create stream sql: Sql gen refacotr. 2025-05-28 13:52:56 +08:00
dapan1121
6992932a95 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw8 2025-05-28 11:36:31 +08:00
dapan1121
43d31dd8cc fix: deployId issue 2025-05-28 11:35:54 +08:00
Jinqing Kuang
5f3d1df1fa Merge branch '3.0' into feat/TS-6100-3.0 2025-05-27 19:31:36 +08:00
dapan1121
01d2677fca Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw8 2025-05-27 19:12:25 +08:00
dapan1121
f7c1fddf9a fix: add watch processing 2025-05-27 19:08:07 +08:00
Hongze Cheng
430da1f872
enh: add memory usage monitor for vnode (#31212) 2025-05-27 16:40:03 +08:00
Jing Sima
e2147145e0 feat: [TS-6100] Parse create stream sql: Support vtable. 2025-05-27 09:39:59 +08:00
wangmm0220
9772e9846c fix(stream): error if %%n with varchar tag 2025-05-26 19:56:41 +08:00
wangmm0220
3aa8c175f5 feat(stream): reset agg operator & reset tsdb reader in fetch request 2025-05-26 14:52:02 +08:00
Simon Guan
309f4ffa5c Merge branch 'main' into merge/mainto3.0 2025-05-26 13:46:33 +08:00
Jinqing Kuang
cd5ef52a9d fix(stream): remove unused files 2025-05-26 09:38:40 +08:00
dapan1121
c8b36ee449 fix: add watch process 2025-05-24 18:15:32 +08:00
Jing Sima
c812498a91 feat: [TS-6100] Parse create stream sql: Support recalculate stream and refactor of drop/start/stop stream. 2025-05-24 17:57:24 +08:00
Jinqing Kuang
18566df281 Merge branch '3.0' into kjq-merge 2025-05-24 14:56:21 +08:00
dapan1121
270e383229 enh: add mnode error handling 2025-05-23 18:14:34 +08:00
Haojun Liao
11665b6efe fix(stream): control the global parameters. 2025-05-23 14:36:20 +08:00
Haojun Liao
8b2eb18323 fix(stream): update the stream info for update. 2025-05-23 11:01:28 +08:00
Haojun Liao
02d70186d2 refactor(stream): add parameters to config the stream queue size. 2025-05-22 19:56:49 +08:00
Haojun Liao
f5db6532dc refactor(stream): add parameters to config the write queue size. 2025-05-22 19:54:54 +08:00
Haojun Liao
4743cc3683 refactor(stream): check for write queue size for sink tasks. 2025-05-22 17:55:47 +08:00
wangmm0220
2d717c3a4f feat(stream): set tag value in trigger cols 2025-05-22 15:38:32 +08:00
Haojun Liao
8bb4979e53 refactor: remove some comments. 2025-05-22 09:55:56 +08:00
Haojun Liao
231d8b416e fix(stream): fix memory leak. 2025-05-22 09:55:18 +08:00
Haojun Liao
a05b023c3e fix(stream): fix memory leak. 2025-05-21 19:13:23 +08:00
Haojun Liao
e04f81385a fix(stream): collect involved tasks firstly. 2025-05-21 18:41:47 +08:00
dapan1121
35553ac4e4 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-21 10:51:21 +08:00
dapan1121
df2039e779 enh: add restart phase 2025-05-21 10:49:48 +08:00
wangjiaming0909
a3ca501368 new-stream: runner remove comments 2025-05-21 00:50:15 +00:00
wangjiaming0909
0ffe9e55f3 stream runner force output impl 2025-05-20 03:13:22 +00:00
dapan1121
3228a993a3 fix: debug log 2025-05-20 09:09:09 +08:00
dapan1121
0a01e7f4f1 fix: add create stream log 2025-05-20 08:15:23 +08:00
dapan1121
e4cd39affc fix: add stream object debug log 2025-05-19 17:46:59 +08:00
Jing Sima
cd3e0bf4c8 feat: [TS-6100] Parse create stream sql: Fix external window wrong plan. 2025-05-19 16:37:48 +08:00
dapan1121
f848d8806b fix: compile issues 2025-05-19 11:15:15 +08:00
facetosea
80d75a6316 fix: stream test case 2025-05-19 09:55:44 +08:00
dapan1121
097a9ba275 fix: drop snode task list issue 2025-05-19 09:54:46 +08:00
dapan1121
067f201f64 fix: snode task list redeploy issue 2025-05-17 18:26:28 +08:00
dapan1121
5069aa8845 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-17 16:37:12 +08:00
dapan1121
85767a9cbf enh: enhance drop snode 2025-05-17 16:36:35 +08:00
wangmm0220
b13967b8f3 feat(stream): move SStorageAPI from stream directory to vnode 2025-05-17 16:00:50 +08:00
Simon Guan
556e426880 Merge branch 'main' into merge/mainto3.0 2025-05-17 12:55:32 +08:00
wangmm0220
96ab95e33b feat(stream): add group values 2025-05-17 11:41:46 +08:00
dapan1121
9a2cf31ee6 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-17 10:56:13 +08:00
dapan1121
66ab04dc49 enh: add stream and snode assignment 2025-05-17 10:55:32 +08:00
factosea
edcec9f02b fix: create table has exist 2025-05-17 10:47:56 +08:00
Jinqing Kuang
aca888c6b7 fix(stream): pull group col value in stream trigger task 2025-05-16 17:12:01 +08:00
wangmm0220
3f08f95dde feat(stream): fix col id error 2025-05-16 17:03:55 +08:00
wangmm0220
2891e73399 feat(stream): fix compile error 2025-05-16 16:13:44 +08:00
wangmm0220
a5007823b8 feat(stream): add ctime for getting wal meta 2025-05-16 16:14:42 +08:00
dapan1121
d98210a7ee Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-16 14:20:45 +08:00
dapan1121
929d923994 enh: add drop snode processing 2025-05-16 14:19:36 +08:00
wangmm0220
39015385f9 feat(stream): add some logs 2025-05-16 09:23:52 +08:00
wangmm0220
88414a1b09 feat(stream): use TimeRangeExpr to filter data in tsdb reader 2025-05-15 19:07:42 +08:00
WANG MINGMING
40216c6143
opti(tmq): save tmq offset in vnode commit time & change log level (#30993) 2025-05-15 18:15:01 +08:00
Yihao Deng
c61c087e98
feat: Refresh user IP white list when drop-dnode finished (#31089) 2025-05-15 16:03:41 +08:00
dapan1121
7119dc9792 fix: trigger table type issue 2025-05-15 15:07:03 +08:00
wangmm0220
0297c7be2c feat(stream): add ts slotid/blockId in external window 2025-05-15 14:22:46 +08:00
dapan1121
0793da0526 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-15 11:48:09 +08:00
dapan1121
63df994be5 enh: add alter snode 2025-05-15 11:46:39 +08:00
dapan1121
5bc2e4e0be fix: trigger reader task flag 2025-05-15 10:15:57 +08:00
wangmm0220
9ffe95755b feat(stream): add interface of getting cols value of groupid 2025-05-15 10:03:57 +08:00
dapan1121
f535662356 fix: add debug log 2025-05-15 08:47:59 +08:00
wangjiaming0909
3db03588bd impl runner external window operator 2025-05-14 09:55:32 +00:00
wangjiaming0909
ef7d67efe0 new-stream: runner notification 2025-05-14 09:55:07 +00:00
facetosea
0a7ac81aeb fix: table schema version start from 1 2025-05-14 17:41:51 +08:00
wangmm0220
a1955fb3af feat(stream): add ast for calc in stream reader 2025-05-14 17:39:02 +08:00
dapan1121
a10f70bb83 enh: add snode create processing 2025-05-14 11:39:54 +08:00
facetosea
11760abea2 fix: subtable schema check when table has exist 2025-05-14 11:12:14 +08:00
Haojun Liao
d02b17be0e
fix(stream): extends the node update check interval. (#31048) 2025-05-14 10:15:17 +08:00
dapan1121
1d0d0ca10d fix: calc multiple reader issue 2025-05-14 09:53:15 +08:00
dapan1121
6b95962fe2 fix: crash issue 2025-05-14 09:34:21 +08:00
wangmm0220
9032653fad feat(stream): add filter if with external window 2025-05-13 17:57:15 +08:00
Jing Sima
84579d0e74 feat: [TS-6100] Parse create stream sql: Fix wrong subplan num. 2025-05-13 15:57:36 +08:00
dapan1121
08effac8ff Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-13 14:37:50 +08:00
dapan1121
8ed0f7214e enh: add create snode processing 2025-05-13 14:37:07 +08:00
Jing Sima
0c490df458 feat: [TS-6100] Parse create stream sql: Fix partition by tbname error. 2025-05-13 14:13:20 +08:00
wangmm0220
5e7aed840e feat(stream): add filter if with external window 2025-05-13 10:53:39 +08:00
Jing Sima
d7690a611a feat: [TS-6100] Fix mac cmake error. 2025-05-12 18:59:53 +08:00
facetosea
b5916c88d5 fix: print log 2025-05-12 17:36:09 +08:00
dapan1121
a4869f5263 fix: compile issues 2025-05-12 17:14:35 +08:00
dapan1121
009e8aa41e Merge remote-tracking branch 'origin/3.0' into feat/TS-6100-3.0 2025-05-12 16:24:22 +08:00
dapan1121
fd405c6920 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw6 2025-05-12 15:20:46 +08:00
dapan1121
73d13075b1 enh: add snode failover 2025-05-12 15:19:22 +08:00
wangmm0220
b07d8d2dd0 feat(stream): add interface vnodeProcessStreamGroupColValueReq 2025-05-12 14:33:20 +08:00
Jinqing Kuang
965d33e1ef fix(stream): fix ts slot id in calc data 2025-05-12 14:20:36 +08:00
Simon Guan
75e2b3917f Merge branch 'main' into merge/mainto3.0 2025-05-12 11:33:33 +08:00
Hongze Cheng
0dfb4596fb
enh: add another recover mode (#30985) 2025-05-12 11:28:07 +08:00
Haojun Liao
e439569455
test(stream): update the test cases. (#31044) 2025-05-12 11:25:07 +08:00
facetosea
b0e0d0e565 fix: data insert, table version changed 2025-05-12 10:22:28 +08:00
Simon Guan
3cfdb304e8 Merge branch 'main' into merge/mainto3.0 2025-05-12 09:01:48 +08:00
wangmm0220
df42d12b06 feat(stream): return calc cols and trigger cols from stream reader 2025-05-10 21:22:11 +08:00
wangjiaming0909
6d6c63a221 new-stream: handle read from cache rsp 2025-05-10 20:30:35 +08:00
facetosea
b62c7976c1 fix: get data from cache 2025-05-10 19:26:27 +08:00
dapan1121
08db53099c enh: add snode redeploy 2025-05-10 18:36:23 +08:00
wangmm0220
f1155c54ad feat(stream): return calc cols and trigger cols from stream reader 2025-05-10 18:34:01 +08:00
Jinqing Kuang
4d4544109e fix(stream): fix history calc of stream trigger task 2025-05-10 18:17:17 +08:00
dapan1121
bdcbe1a717 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw5 2025-05-10 17:18:40 +08:00
dapan1121
ca2241f6ad fix: add snode task redeploy 2025-05-10 17:16:39 +08:00
wangjiaming0909
9bd7381978 stream-runner: runner impl 2025-05-10 15:42:05 +08:00
wangjiaming0909
e9d248f9e7 new-stream: runner notification 2025-05-10 15:42:05 +08:00
wangjiaming0909
b9f4426fde new-stream: runner handle read from cache 2025-05-10 15:42:05 +08:00
Zhixiao Bao
338072e262
enh: add more feat for stb keep. (#31019) 2025-05-10 15:17:22 +08:00
Jing Sima
84016904ff
fix: [TS-6445] Fix virtual tables not detecting schema changes. (#30999)
Ensure virtual tables invalidate cached schema metadata and reload it when a schema change (e.g., ALTER VTABLE) is detected. This prevents stale schema references and query errors after structural updates.
2025-05-10 10:34:54 +08:00
wangmm0220
aea901d2c8 fix(stream): add trigger cols 2025-05-09 18:37:54 +08:00
dongming chen
7840f361dd
enh: update database fetch functions to include status in JSON output (#31005) 2025-05-09 15:58:31 +08:00
Jinqing Kuang
27d7d71057 fix(stream): fix response type of stream reader task 2025-05-09 14:41:45 +08:00
factosea
9ab3fcd062 fix: datainsert 2025-05-09 14:34:45 +08:00
factosea
29db253166 fix: safe check 2025-05-09 13:26:31 +08:00
wangmm0220
441d3d3648 fix(stream): change code from no data to success if wal read out 2025-05-09 12:19:18 +08:00
dapan1121
7e792ee76e Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw5 2025-05-09 11:35:10 +08:00
factosea
64a2fdd7c2 fix: crash, safe check 2025-05-09 11:32:20 +08:00
dapan1121
ee09c9643c Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw5 2025-05-09 11:32:10 +08:00
Simon Guan
f31428d422 Merge branch 'main' into merge/mainto3.0 2025-05-09 09:19:07 +08:00
dongming chen
28fda620c7
feat: add tsRoutineReportInterval and integrate into syncNodeTimerRou… (#30956) 2025-05-09 09:16:49 +08:00
wangmm0220
332d21630c feat(stream): reset task if fetchMsg.reset is true for calc 2025-05-08 19:53:40 +08:00
wangmm0220
9dfcb4d63b feat(stream): add logic of fetch rsp for calc 2025-05-08 17:39:12 +08:00
wangjiaming0909
5372df5e22 new-stream: runner impl 2025-05-08 17:36:20 +08:00
wangmm0220
bc1c0f272d feat(stream): add logic of fetch rsp for calc 2025-05-08 17:27:09 +08:00
dapan1121
cc7dd3bebc fix: add stb version and top plan 2025-05-08 15:13:59 +08:00
dapan1121
e76cd4ff5c fix: add calcCacheScan plan for reader 2025-05-08 15:13:59 +08:00
wangjiaming0909
9fd5f6364c new-stream: runner impl 2025-05-08 14:58:41 +08:00
wangmm0220
1bb860519f feat(stream): add logic of fetch rsp for calc 2025-05-08 13:52:45 +08:00
wangmm0220
6f8076092e feat(stream): add logic of fetch rsp for calc 2025-05-08 11:43:45 +08:00
wangmm0220
58959b5526 feat(stream): add logic of fetch rsp for calc 2025-05-08 11:24:37 +08:00
wangmm0220
e28e48cbf9 feat(stream): add logic of fetch rsp for calc 2025-05-08 10:30:51 +08:00
factosea
f3027e938e feat: stream data insert 2025-05-08 09:48:53 +08:00
wangmm0220
f4455b3419 feat(stream): add logic of vnodeProcessStreamWalCalcDataReq 2025-05-07 20:17:14 +08:00
dapan1121
77a024f96f fix: add cache fetch 2025-05-07 19:16:56 +08:00
dapan1121
7aded97b75 fix: add more fetch types 2025-05-07 18:30:05 +08:00
wangjiaming0909
e95c5a9d85 new-stream: runner impl 2025-05-07 18:14:17 +08:00
dapan1121
404d0da770 fix: plan source addr update issue 2025-05-07 13:43:30 +08:00
factosea
de961ee864 fix: log 2025-05-07 11:47:02 +08:00
pengrongkun94@qq.com
820a0101ae feat:add auto create table 2025-05-07 11:06:12 +08:00
pengrongkun94@qq.com
d0eb0c5962 fix:invalid but no error output 2025-05-07 11:05:52 +08:00
taos-support
be3987e6e9 feat: [TS-6100] Process SCMCreateStreamReq : Add unit test and fix bugs. 2025-05-07 09:55:12 +08:00
dapan1121
9e707f65da enh: add task undeploy processing 2025-05-07 09:48:09 +08:00
dapan1121
0411d10241 fix: add timer api 2025-05-06 19:15:51 +08:00
dapan1121
d6eb7151bf fix: debug log issue 2025-05-06 18:51:40 +08:00
dapan1121
7af00e7330 fix: plan clone issue 2025-05-06 18:51:40 +08:00
Jinqing Kuang
1c71c8ce40 fix(stream): fix wal meta datablock of stream reader task 2025-05-06 18:46:14 +08:00
yihaoDeng
e83c59fed9 feat(strea): add reader logic for calc 2025-05-06 18:10:40 +08:00
yihaoDeng
209fa90b34 feat(strea): add reader logic for calc 2025-05-06 18:05:47 +08:00
dapan1121
a96949a2c2 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw4 2025-05-06 16:12:07 +08:00
dapan1121
aeb53e88ae fix: runner snode addr issue 2025-05-06 16:10:44 +08:00
Kaili Xu
a65dd404ee
enh: number of dnodes with vgroups not exceed 2 when dnode limit is 2 and dualRepliaHA is specified (#30959) 2025-05-06 16:00:59 +08:00
Haojun Liao
704686ece6
fix(stream): fix the double release stream object in mnode. (#30942) 2025-05-06 15:56:24 +08:00
Jinqing Kuang
87da875fdf fix(stream): fix calc request send of stream trigger task 2025-05-06 15:22:05 +08:00
dapan1121
07c3f4c34a Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw4 2025-05-06 10:28:09 +08:00
dapan1121
88599ad4e7 enh: add drop stream processing 2025-05-06 10:27:12 +08:00
wangmm0220
bd8188c533 fix(stream): add error code if no data in block 2025-05-06 09:43:20 +08:00
Jinqing Kuang
437a6fc4fd fix(stream): fix message process of stream trigger task 2025-05-06 09:20:37 +08:00
dapan1121
2dd6d3eb28 enh: add drop stream processing 2025-04-30 18:39:59 +08:00
wangmm0220
8d9a2b1c56 feat(stream): add logic for stream reader 2025-04-30 18:08:08 +08:00
wangmm0220
2236273044 feat(stream): add logic for stream reader 2025-04-30 17:39:14 +08:00
wangmm0220
10d955528a feat(stream): add logic for stream reader 2025-04-30 13:37:48 +08:00
wangmm0220
ae43f9023d feat(stream): remove useless code 2025-04-30 09:14:19 +08:00
wangmm0220
145a535e12 feat(stream): remove useless code 2025-04-30 09:12:20 +08:00
wangmm0220
7dc6557b46 fix(stream): message error 2025-04-29 21:10:12 +08:00
dapan1121
2dadaf6f52 fix: add stream addr 2025-04-29 19:22:55 +08:00
wangmm0220
19a878cc79 feat(stream): add thread worker for stream reader 2025-04-29 18:51:21 +08:00
Pan Wei
ba423a0f79
Merge pull request #30938 from taosdata/fix/taosdCmdArgs
fix: taosd cmd args
2025-04-29 17:40:10 +08:00
dapan1121
c7c0d9e8b0 fix: stream vgroup map issue 2025-04-29 17:03:52 +08:00
wangmm0220
0b861a2c7c feat(stream): add thread worker for stream reader 2025-04-29 16:28:33 +08:00
WANG MINGMING
be7fffcde4
Merge branch 'feat/TS-6100-marks-new' into feat/TS-6100-3.0 2025-04-29 15:05:38 +07:00
wangmm0220
37a315fcc7 feat(stream): add thread worker for stream reader 2025-04-29 16:02:05 +08:00
dapan1121
2d499c9572 fix: stream queue issue 2025-04-29 15:32:56 +08:00
wangjiaming0909
1ccc6c69a8 new-stream: runner impl 2025-04-29 15:31:17 +08:00
Jing Sima
6ae805bb7a feat: [TS-6100] Process SCMCreateStreamReq ver-4
support placeHolderBitmap and interval offset in stream trigger.
remove useless code.
2025-04-29 15:19:30 +08:00
Kaili Xu
f1e480ef53
enh: support revoke sign in show grants logs (#30929) 2025-04-29 14:46:27 +08:00
Simon Guan
97d66f958c Merge remote-tracking branch 'origin/main' into merge/mainto3.0 2025-04-29 14:33:35 +08:00
dapan1121
7f5cd8a70d fix: add stream id 2025-04-29 13:59:53 +08:00
dapan1121
b07fafa27f fix: stream hb rsp length issue 2025-04-29 11:02:56 +08:00
factosea
d67081c55f fix: taosd cmd args 2025-04-29 10:36:23 +08:00
Jinqing Kuang
162d083951 fix(stream): fix compile issues 2025-04-29 09:23:09 +08:00
Jinqing Kuang
2a796e17ef feat(stream): implement stream trigger realtime calc 2025-04-29 09:23:05 +08:00
dapan1121
706d297232 fix: msg encode issues 2025-04-29 08:38:03 +08:00
dapan1121
ef1e51e9b9 enh: add stream obj name 2025-04-29 08:38:03 +08:00
dapan1121
87c8b3f8b7 fix: add stream phase 2025-04-29 08:38:03 +08:00
dapan1121
0c7504944f fix: add hb processing 2025-04-29 08:38:03 +08:00
wangmm0220
5d13d3a4ce feat(stream): add logic of stream reader 2025-04-28 19:26:02 +08:00
wangmm0220
c632dcf0c1 feat(stream): add logic of stream reader 2025-04-28 19:21:47 +08:00
wangmm0220
7158d4c76f Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-marks-new 2025-04-28 14:37:28 +08:00
wangmm0220
a78b09577a feat(stream): add thread worker for stream reader 2025-04-28 14:37:05 +08:00
Jing Sima
22ebaece7c feat: [TS-6100] Process SCMCreateStreamReq 2025-04-28 11:28:33 +08:00
Simon Guan
16f90d4de1 Merge branch 'main' into merge/mainto3.0 2025-04-27 19:16:46 +08:00
dapan1121
992042cd00 fix: compile issues 2025-04-27 18:36:08 +08:00
Kaili Xu
b88ec2f1a8
fix: timeseries statis for virtual table (#30911) 2025-04-27 18:03:20 +08:00
dapan1121
3793eb2835 enh:add hb msg serilization 2025-04-27 17:53:12 +08:00
wangmm0220
2a1a6d0d95 feat(stream): add thread worker for stream reader 2025-04-27 09:11:50 +08:00
Jing Sima
e81a59b2e7 feat: [TS-6100] Fix compile error. 2025-04-27 09:08:26 +08:00
wangmm0220
11b625c63e feat(stream): add thread worker for stream reader 2025-04-25 18:47:25 +08:00
wangmm0220
eee6456cc4 feat(stream): add thread worker for stream reader 2025-04-25 18:18:17 +08:00
Pan Wei
00e0c4ef25
Merge pull request #30876 from taosdata/fix/TS-6321
fix(tmq): add log
2025-04-25 17:13:56 +08:00
dapan1121
cc025dbd59 enh: add task plan update 2025-04-25 14:59:41 +08:00
Hongze Cheng
de110f95ef
fix: invalid parameter input (#30873) 2025-04-24 20:02:52 +08:00
wangmm0220
5ce115cc23 feat(stream): fix compile error 2025-04-24 18:02:12 +08:00
wangmm0220
ffffefb802 fix(tmq): add log 2025-04-24 11:45:37 +08:00
WANG MINGMING
ddd32e23d9
fix(tmq): init tmq handle error if snapshotVer is out of range (#30859) 2025-04-24 09:50:51 +08:00
dapan1121
330cf9982d fix: compile issues 2025-04-24 09:11:54 +08:00
dapan1121
b8991295e1 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw1 2025-04-22 17:49:01 +08:00
dapan1121
ae0e1ded7d enh: add hb processing 2025-04-22 17:46:17 +08:00
Jing Sima
c1cb4029a1 feat: [TS-6100] Build create request for create stream. 2025-04-21 17:47:15 +08:00
dapan1121
21e5aae05c enh: add stream hb processing 2025-04-19 18:58:51 +08:00
WANG MINGMING
88eec0cddd
fix: (TS-6376)jump virtual table if snapshot is true in tmq (#30835) 2025-04-19 17:39:36 +08:00
WANG MINGMING
c85b195421
Merge branch 'feat/TS-6100-marks' into feat/TS-6100-3.0 2025-04-19 16:18:09 +07:00
wangmm0220
80f368ba51 feat(stream): add stream reader logic 2025-04-19 17:10:43 +08:00
Simon Guan
e8dd9daf11 Merge branch 'main' into merge/mainto3.0 2025-04-19 14:33:11 +08:00
freemine
6267763e85
Freemine.cmake.3.0 (#30663)
* chore(ci): with cmake verbose, temporarily

* chore(cmake): prefer Threads::Threads

* fix(cmake): debug building gtest on ubuntu 20.04 for the moment

* fix(cmake): try adding Threads::Threads

* fix(cmake): debug building gtest on ubuntu 20.04 for the moment

* fix(cmake): revert taosd-ci-build.yml

* fix(cmake): debug building on ubuntu 20.04 for the moment

* fix(cmake): debug building on ubuntu 20.04 for the moment

* fix(cmake): debug building on ubuntu 20.04 for the moment, adding dl right after DEP_ext_libuv

* fix(cmake): debug building on ubuntu 20.04 for the moment, try full run

* fix(cmake): fix building on ubuntu 20.04

* fix(cmake): dl is only valid in non-windows platform

* fix(cmake): dl order

* refactor(cmake): adjust option/cache variables for external dependencies

* refactor(cmake): mv patch files from contrib/ to cmake/

* refactor(cmake): typo

* refactor(cmake): adding cache on ci

* refactor(cmake):
1. ext_lzma2 is only used by Linux
2. fix bug in taosd-ci-build.yml

* enh: adding functionalities of build.sh

* fix(ci): `cmake -B` shall maintain consistency

* refactor(cmake): LOCAL_REPO/LOCAL_URL as cache variable

* refactor(cmake): taosadapter to be built in main build directory rather than .externals

* refactor(cmake): adding rpath for taosadapter, linux now

* refactor(cmake): adding rpath for taosadapter, macos now

* chore(cmake): remove some comments

* debug(ci): bypass TD_EXTERNALS_USE_ONLY

* debug(ci): bypass .externals caching for the moment

* fix(cmake): temporarily use taosadapter/main branch because this branch(freemine.cmake.3.0) has not include taos_fetch_fields_e from upstream

* refactor(cmake): clean GIT_TAG/GIT_SHALLOW pairs

* enh(ci): use build.sh rather than hard-coded in taosd-ci-build.yml, linux for now

* debug(ci): undefined __isoc23_strtoull

* debug(ci): benchmarkTest

* debug(ci): what if use_only = off

* debug(ci): remove .externals to make a refresh build

* debug(ci): back to cache, and ls files of gtest

* debug(ci): remove find coz {} not escaped

* debug(ci): cache key seems missing "matrix.os"

* refactor(ci): fixed cache key and reopen macos/windows

* chore(ci): literally -j4

* chore(ci): Trigger GitHub Actions re-run

* chore(ci): Trigger GitHub Actions re-run

* fix(ci): typo

* chore(ci): JOBS calculated by build.sh itself

* refactor(ci): enable WEBSOCKET in build.sh by default

* refactor(ci): enable WEBSOCKET in build.sh by default, macOS

* chore(cmake): remove obsoletes

* refactor(ci): stop service before running taosd

* chore(ci): `./build.sh install` just install TDengine, you will have to start taosd by `./build.sh start`

* refactor(cmake): adding source code found on http://emfisis.physics.uiowa.edu/Software/C/libargp/

* refactor(cmake): moving jansson/snappy/avro to .externals, and porting BUILD_TEST/WEBSOCKET on Windows

* refactor(cmake): porting linux

* refactor(cmake): porting macos
1. check argp.h
2. re-enable building taosdump

* refactor(cmake): porting linux
1. adjust CMAKE_C/CXX_FLAGS

* refactor(cmake): porting windows, adjust CMAKE_C/CXX_FLAGS

* refactor(cmake): use cmake_parse_arguments in macro INIT_EXT

* refactor(cmake): format ci cache directives

* refactor(cmake): adding comments for ci externals-cache directives

* refactor(cmake): adding check_env.cmake to checking libraries installed on the system

* refactor(cmake): porting linux, make homebrew-installed-libs available

* refactor(cmake): remove BYPRODUCTS from INIT_EXT macro

* refactor(cmake): INC_DIR is oneValueArg

* refactor(cmake): taosdump depends on ext_xz(LZMA)

* refactor(cmake): add copy_pthreadVC3 target on windows

* refactor(cmake): mv taosd-ci-build.yml to tdengine-build.yml

* chore(ci): try to fix yml syntax error

* refactor(cmake): use brew --prefix to get HomeBrew's install path

* refactor(cmake): typo

* debug(ci): build and cache externals first

* debug(ci): adding -Wno-stringop-overread for the moment

* debug(ci): make Threads::Threads public from os target

* debug(ci): make os public

* debug(ci): re-enable start and test

* debug(ci): let it go even if taosBenchmark failed

* debug(ci): copy logic from TDengine/main

* debug(ci): try ./build.sh start/test

* debug(ci): revert to original simple test logic in ci, taosBenchark/taos

* chore(cmake): code-convention and ci-logic

* debug(ci): show versions

* debug(ci): forcefully use specific GIT_TAG by commit-id for taos-connector-rust.git and taosadapter.git

* refactor(cmake): remove empty lines

* debug(ci): typo

* debug(ci): set supportVnodes to 256 before starting taosd

* debug(ci): fix: sudo and pipe

* debug(ci): cat /etc/taos/taos.cfg to check if supportVnodes effective

* debug(ci): cat forceReadConfig to taos.cfg

* debug(ci): adding taos -s "show dnodes"

* debug(ci): print more info

* debug(ci):
1. git log .... in an independant step
2. sleep 3 deliberately

* build: release ver-3.3.6.0

* chore(ci): comment and remove unnecessary code

* refactor(ci): cleanup tools/CMakeLists.txt
1. remove unnecessary or uneffective codes
2. better approach to pass compile flags to go

* chore(cmake): remove unnecessary code

* merge(cmake): porting linux

* merge(cmake): porting macOS

* merge(cmake): porting windows

* merge(cmake): pitfall fix: use literal format string instead

* merge(cmake): ver-3.3.6.0 for both taosadatper and taosws

* merge(cmake): adjust ci for debug purposes

* merge(cmake): add dependenices to make sure native built

* merge(main): link os

* merge(main): revert to main

* chore(cmake): remove freemine'd comments

* chore(cmake): make github ci to run with empty change

* refactor(cmake): remove unnecessaries

* refactor(cmake): remove unnecessaries

* chore(cmake):
1. remove taosudf in build.sh::do_purge
2. packaging taosBenchmark

* chore(cmake):
1. typo corrections
2. add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to bypass compatibility check imposed by latest cmake since 4.0

* chore(cmake): show cmake version

* chore(cmake): add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to bypass compatibility check imposed by latest cmake since 4.0

* chore(cmake): typo

* chore(cmake): remove unnecessaries

* cmake: debug enterprise compilation

* refactor: preparatory work before merging the freemin PR

* refactor(cmake): revert to d91205594a

* refactor(cmake): optimize by adjusting cache key

* chore(cmake): make github ci to run with empty change

* refactor(cmake): move libs3 and azure to external.cmake

* refactor(cmake): porting macOS

* refactor(cmake): move cos to external.cmake

* refactor(cmake): bypass s3/azure/cos on windows for the moment

* refactor(cmake): try find_package(Threads)

* refactor(cmake): add dl/pthread in libs3

* refactor(cmake): enable s3/azure for the moment, hard-coded

* refactor(cmake): adjust BUILD_WITH_ANALYSIS option

* refactor(cmake):
1. enum AVROTYPE => enum enAVROTYPE
2. remove INSTALL(CODE ...) from tools/taos-tools/CMakeLists.txt

* refactor(cmake): portint macOS and typo

* refactor(cmake): ticking external cache key to force refresh external building

* refactor(cmake): remove obsoletes

* refactor(cmake): remove obsoletes

* refactor(cmake): remove obsoletes, contrib/deps-download related

* refactor(cmake): adding build.bat, and use build.bat in .github/workflows/tdengine-build.yml

* refactor(cmake):
1. call .\build.bat
2. remove POST_BUILD which is not valid in this signature of add_custom_command

* refactor(ci): use 'NMake Makefiles JOM'

* refactor(ci): typo

* refactor(ci): debug

* refactor(ci): debug

* refactor(ci): debug

* refactor(ci): use call on windows

* refactor(cmake): move utils/TSZ to contrib/TSZ

* chore(cmake): make github ci to run with empty change

* refactor(cmake): mv cmake.* -> *.cmake and related in CMakeLists.txt

* refactor(cmake): debugging integrating community

* refactor(cmake): debugging integrating community

* chore(cmake): make github ci to run with empty change

* refactor(cmake): revert geos.git back to 3.12.0

* refactor(cmake): revert doc/** to main branch

* refactor(cmake): revert tests/** to main branch, except tests/taosc_test/CMakeLists.txt

* refactor(cmake): revert test/cases/** to main branch

* refactor(cmake): revert test/docs/** to main branch

* refactor(cmake): revert tools/taos-tools/deps/{avro,jansson,libargp,snappy,zlib-1.2.13} to main branch, which need to be removed later

* refactor(ci): revert .github/workflows/{deploy-case-docs.yml,tdengine-doc-build.yml} to main branch

* refactor(cmake): revert tcommon.h and related to main branch

* refactor(cmake): revert test/* stuffs back to main branch

* refactor(cmake): revert libuv.git back to v1.49.2

* refactor(cmake): revert .h/.c and related to main branch

* refactor(cmake): typo format string

* refactor(cmake): typo correction, incorrect use of macro `assert`

* refactor(cmake): adding /wd4028 to bypass thttp.c under enterprise build for the moment

* refactor(cmake):
1. adding some rules to .gitignore for the last resort to save
2. adding source files manually to source/libs/parser/CMakeLists.txt to exclude potential sql.c generated by old build system

* refactor(cmake): add -Wno-unused-result for the moment

* refactor(cmake): adjust target dependencies

* refactor(cmake): tweaking building of mxml

* refactor(cmake): adjust externals CMAKE_ARGS to save compilation time

* refactor(cmake): temporarily use tomchon-patch-3

* refactor(cmake): temporarily adding dumpbin directives

* refactor(cmake): adding NODEFAULTLIB temporarily for debugging purpose

* refactor(cmake): adding NODEFAULTLIB:libcpmt temporarily for debugging purpose

* refactor(cmake): adding NODEFAULTLIB:cpmt temporarily for debugging purpose

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* refactor(ci): use freemine.debug branch for the moment

* refactor(ci): revert back to use run-tests-on-windows.yml of tomchon-patch-3 branch

* chore(cmake): make github ci to run with empty change

* refactor(cmake): remove temporary debug directives

* refactor(cmake): move cmake_policy(..CMP0135..) to the root of this project

* refactor(cmake): Remove temporary debugging conditional and restore original logic

* chore(cmake): adding -B in army tests

* chore(cmake): make github ci to run with empty change

* chore(cmake): revert: adding -B in army tests

* refactor(cmake):
1. use ver-3.3.6.3 of taosadapter
2. pitfall fix: do not link with taosws for taos shell

* refactor(cmake): revert taosadapter to ver-3.3.6.0

* chore(cmake): adding logging message in more detail

* chore(cmake): adding logging message in more detail

* chore(ci): debugging by using ls -l

* chore(ci): typo

* chore(ci): typo

* refactor(cmake): revert to remove debug code, and taosadapter to ver-3.3.6.3

* refactor(cmake): remove DEP_ext_taosws

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): typo correction: utils/test/c/sml_test.c

* debug(cmake): test cases debug

* chore(cmake): make github ci to run with empty change

* chore(ci): using tomchon-patch-3 branch for run-tests-on-linux for the moment

* chore(cmake): make github ci to run with empty change

* debug(test): revert utils/test/c/sml_test.c back to tdengine/main branch

* debug(test): adding VERBOSE=1 and gcc --version

* debug(test): revert tests/parallel_test/cases.task back to tdengine/main branch

* debug: add log in run_case.sh

* fix: test log

* fix: docker run privileged

* tes: add debug test in  cases.task

* refactor(cmake): remove ref to \contrib\<dep-name> and ~/.cos-local-{1,2} from CMakeLists.txt(s)

* refactor(cmake): make taosudf link with libtaos.so

* chore(cmake): fix compiler warning as error problem

* refactor(cmake): revert 7d7f03832d

* chore(cmake): only udf.sim and udfpy.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug only udf.sim for the moment

* debug(ci): debug only udf.sim for the moment, using tee

* debug(ci): debug only udf.sim for the moment, revert using tee

* debug(ci): debug only udf.sim for the moment, adding TAOS_LIB again

* debug(cmake): adding -rdynamic for the moment

* debug(cmake): re-adding udfpy.sim

* debug(cmake): do NOT run with Sanitizer for udfpy.sim for the moment

* chore(cmake): revert cases.task, and remove ubuntu-20.04 from tdengine-build.yml

* refactor(cmake): using ENABLE_EXPORTS to export symbols in taosudf

* chore(cmake): make github ci to run with empty change

* chore(cmake): remove stuffs for debug purpose and revert

---------

Co-authored-by: support-platform <it@taosdata.com>
Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: haoranchen <haoran920c@163.com>
2025-04-19 14:03:29 +08:00
WANG MINGMING
ca724865b9
fix(stream): parName is null (#30592) 2025-04-19 10:26:32 +08:00
dapan1121
279595240e enh: add deploy processing 2025-04-18 19:28:43 +08:00
Zhixiao Bao
1ae6b32541
fix: S3 data not being uploaded as expected. 2025-04-18 18:16:39 +08:00
wangmm0220
919628568d feat(stream): add stream reader logic 2025-04-17 19:50:37 +08:00
Zhixiao Bao
e25da1cd35
fix: taosd fails to start after modifying the timezone configuration parameter. 2025-04-17 19:19:05 +08:00
dapan1121
7c714f7d5f Merge remote-tracking branch 'origin/feat/TS-6100-3.0.pw1' into feat/TS-6100-3.0 2025-04-17 10:48:44 +08:00
dapan1121
38bdafd329 enh: add deploy processing 2025-04-17 10:45:06 +08:00
Simon Guan
888fed8699 Merge branch 'main' into merge/mainto3.0 2025-04-16 19:34:20 +08:00
wangjiaming0909
163dd33a0a new-stream: impl stream runner 2025-04-16 18:16:55 +08:00
wangjiaming0909
22b1eebb3a new-stream: define vnode build runner task 2025-04-16 18:16:55 +08:00
wangjiaming0909
ceaf69184c new-stream: create new-stream threads 2025-04-16 18:16:09 +08:00
Zhixiao Bao
6748fe8235
enh: reduce the amount of logs printed when the apply queue is full. (#30796) 2025-04-16 15:59:03 +08:00
Hongze Cheng
7e17430796
fix: make duplicate version acceptable (#30794) 2025-04-16 15:52:59 +08:00
dongming chen
c38f9eda0c
fix: TS-6336-get-epset (#30770) 2025-04-15 16:44:58 +08:00
Jing Sima
82b068ef8a
feat: [TS-6333] Fix decimal attempting free on address which was not malloc()-ed. (#30764) 2025-04-15 10:58:28 +08:00
dapan1121
b5b9ba0faa enh: add mnode processing 2025-04-14 13:20:57 +08:00
dongming chen
d9b7511b0e
fix: [TS-6245]add-protection-when-drop-db (#30567) 2025-04-12 09:47:11 +08:00
dongming chen
f04b57dc9e
fix: [TS-6245]-add-trans-timeout (#30740) 2025-04-12 09:46:59 +08:00
WANG Xu
259075e8c6
Merge pull request #30670 from taosdata/enh/platform-error-info
fix: update support link in error message for unsupported platform initialization
2025-04-12 09:29:02 +08:00
danielclow
48598af3cc
add slash before period
add / before . so users can copy the url directly
2025-04-11 15:54:00 +08:00
Haojun Liao
a90b41e4ce
fix: tables with a composite primary key of type varchar may have incorrect counts of projected results when sorted. 2025-04-11 15:44:34 +08:00
Simon Guan
7437dd026e Merge branch '3.0' into merge/mainto3.0 2025-04-11 13:47:45 +08:00
xinsheng Ren
7376e8401f
fix: when there are offline dnodes, "show dnode * variables" does not return any output. (#30667) 2025-04-11 11:21:55 +08:00
dongming chen
b2fec10beb
fix[TS-6166]: when the transaction to create a database fails, repeatedly sending messages can cause high CPU usage.(#30724) 2025-04-10 20:41:38 +08:00
dapan1121
45d0af0a63 enh: add create stream 2025-04-10 19:41:37 +08:00
freemine
9897d85f86
enh(test): adding TD_ALWAYS_ASSERT macro for test cases to use (#30739) 2025-04-10 16:52:55 +08:00
dapan1121
675790a63c fix: remove codes 2025-04-10 09:09:30 +08:00
Zhixiao Bao
34a41bf54c
fix: crash while upgrade taosd to 3362. (#30712) 2025-04-09 18:53:47 +08:00
dongming chen
8710e539a0
fix: [TD-34436] double-release (#30668) 2025-04-09 14:50:20 +08:00
dongming chen
712cb6652b
fix: TS-6276-grant-format (#30701) 2025-04-09 14:40:24 +08:00
dongming chen
c5c86af7b5
fix/TS-6226-send-check-when-not-sync (#30588) 2025-04-09 11:18:53 +08:00
Hongze Cheng
f4e210c452
fix: meta abort clear cache (#30672) 2025-04-08 18:21:57 +08:00
Hongze Cheng
0609bf14e6
fix: add tag data type check when create child table (#30694) 2025-04-08 17:42:06 +08:00
chenhaoran
363b8e5d83 fix: update support link in error message for unsupported platform initialization 2025-04-07 17:10:17 +08:00
Zhixiao Bao
c64bea8b7f
fix(compact): unmatched parameter list. (#30660) 2025-04-07 17:05:58 +08:00
chenhaoran
37c9800482 fix: update support link in error message for unsupported platform initialization 2025-04-07 16:26:36 +08:00
Simon Guan
de5f5866a8
fix[TS-6276]: when the authorization statement exceeds a certain length, it cannot be displayed in full (#30657) 2025-04-07 09:21:13 +08:00
Bomin Zhang
a031d3ddd4
fix[TD-34340]: enable page recyling and ensure TDB cell size is at least the size of a free cell (#30606) 2025-04-03 13:28:09 +08:00
Simon Guan
28c9473513
refactor: adjust qid for connector log (#30577) 2025-04-01 16:34:33 +08:00
dongming chen
915a6e5609
fix: [TD-34250] wrong-createdb (#30555) 2025-04-01 10:02:05 +08:00
Zhixiao Bao
c6216a02ab
fix(s3): wrong condition where alter db ops s3_compact. (#30568) 2025-04-01 09:19:12 +08:00
Haojun Liao
1d6507b7ae
fix(stream): delete backup data in remote rsync server. (#30557) 2025-03-31 10:38:24 +08:00
WANG MINGMING
1c4507ab75
fix(stream): row size error (#30330) 2025-03-28 18:10:57 +08:00
Jing Sima
f84f04398d
fix: [TS-4897] Support query stables cross databases and fix potential deadlock. (#30507) 2025-03-28 10:07:08 +08:00
Simon Guan
9a89db55ca
enh: allow ordinary users to execute the “show anodes” command. (#30464) 2025-03-25 20:17:16 +08:00
dongming chen
13475700c5
enh: [TD-34190] remove-wrong-log (#30408) 2025-03-25 12:37:20 +08:00
Haojun Liao
af06bea439
fix(stream): add start/stop message. (#30400) 2025-03-24 19:38:00 +08:00
Haojun Liao
cfcdfdd2e7
fix(stream): update the update node info. (#30364) 2025-03-24 10:18:06 +08:00
Haojun Liao
82ffeb82a9
fix(gpt): fix the bug for algo name case sensitive (#30362) 2025-03-23 13:20:24 +08:00
Simon Guan
24d4f37f83 Merge branch '3.0' into merge/mainto3.0 2025-03-22 23:41:39 +08:00
Simon Guan
c00f876638 Merge branch 'main' into merge/mainto3.0 2025-03-22 23:41:35 +08:00
Hongze Cheng
9723fd9182
fix: send uninitialized memory (#30328) 2025-03-22 23:23:14 +08:00
Zhixiao Bao
ec7177cb7d
fix: correct numberFileset counting cause S3 retention happened while compact. (#30282) 2025-03-21 14:50:41 +08:00
Alex Duan
c133489917
new-libtaos-with-ws (#29971)
* enh: rename libtaos.so to libtaosinternal.so

* enh: let python system-test work

* enh: shell for libinternal.so

* enh: refact script

* enh: wrapper for libtaosinternal

* enh: rename some files

* enh: let shell support internal driver

* enh: minor changes

* enh: minor changes

* add intenal.h

* enh: remove unused codes

* enh: minor changs

* feat: mac os issues

* enh: let python test use internal connection

* enh: let nettest work

* enh: let taosc -C work

* enh: test shell in mac os

* enh: minor changes

* enh: let libtaosinternal.so work in linux

* enh: update install script

* enh: for ci

* enh: for windows compile

* enh: minor changes

* enh: compile in windows

* enh: minor changes

* enh: taosinternal work in windows

* enh: add taos_internal_static

* enh: rollback os_for_wrapper

* fix: conflicts

* fix: conflicts

* fix: compile errors

* fix: conflicts

* enh: rename taosinternal to taosnative

* enh: rename taosinternal to taosnative

* fix: compile error

* enh: remove taosnative.h

* fix: compile errors

* enh: set default shell options

* fix: compile errors

* fix: compile errors

* debug: switch taosws branch to feat/new-libtaos-with-ws

* enh: taosBenchmark remove WEBSOCKET finished

* fix: CMakeLists.txt remove WEBSOCKET

* fix: compile errors

* fix: taosBenchmark delete restful code

* .gitignore remove taos-tools folder

* fix: remove taosdump WEBSOCKET MACRO

* fix: build error for taosdump

* fix: build project passed

* fix: support -Z for connect mode

* fix: build error

* fix: build error fixed

* fix: add -Z options

* fix: native and websocket with string

* fix: -Z option core

* fix: build unit test

* fix: build error

* fix: add colon for array

* fix: unit test can not include fun

* fix: CTest pointer null is nullptr

* fix: include pub.h

* fix: taosdump add -Z --driver options

* fix: taosdump support -Z with pub.h pub.c

* fix: toolsGetTimeDay move to pub.c

* fix: restore pub.c only simple fun

* fix: add error tips

* fix: tmfree remove from taosdump

* fix: remove double declare taos variant

* fix: taos support -Z option

* enh: configDir set with main fun

* fix: add g_arguments.configDir

* fix: show tips add cfgdir

* fix: g_argument is pointer

* fix: configDir is global var

* fix: declare g_configDir in benchMain.c

* fix: taos version not show on websocket

* stmt2 websocket prepare with supertable

* stmt2 websocket prepare build

* fix: stmt and stmt2 prepare add db name

* fix: remove -R --restful test case

* fix: taosBenchmark adjust priority cmd > json > evn

* fix: add connect mode test case connMode.py

* fix: clear evn and add host port check

* fix: army/test.py modify start taosAdapter is default

* change: system-test/test.py default start taosAdapter

* fix: add taosAdapter variant to system-test/test.py

* fix: -y must put behind other options

* fix: remove rest sml and add -N normal case

* fix: add -c work cfg test case

* del: queryMain.py remove rest query

* fix: remove groups have a blank append bug

* fix: caseBase.py add db in sql query

* fix: query_json.py remove rest test

* fix: taosBenchmark uniform dsn describe

* fix: add pub.h pub.c to tools public

* fix: case remove restful interface

* fix: build error

* fix: taosDriverCleanup no arg call

* fix: taosdump add test conn mode case taosdumpCommandline.py

* fix: modify insertFullType.json db name

* fix: taosdump connMode test case taosDumpCommandline.py passed

* enh: priority cmd > env > json

* fix: taosCli remove is_native variant

* fix: password is not pointer

* fix: comment -o test case

* fix: solve fun return code check

* fix: windows unresolved strcasecmp

* fix: remove coverHostToServAddr

* fix: forbid check ODR violation

* ci: trigger pr run

* fix: build error not del >>>>>3.0

* fix: support json dbinfo->vgroups have blank space

* fix: solve conflict with merge

* fix: with TrimCaseCmp fun to compare vgroups

* fix: del vgroups support blank code

* feat: wrapper add taos_fetch_fields_e

* fix: move jni from libtaosnative.so to libtaos.so

* fix: move clientTmqConnector.c for jni

* fix: fix assert check with del comment code

* fix: taosBenchmark add prepare stmt debug log

* fix: stmt2 already have debug log on preapare

* fix:  (double)LLONG_MAX force covert

* fix: stmt insert normal table with websocket

* fix: normal table with stmt too many ?

* fix: taosdump stmt_prepare with child tbname

* fix: build error add int code

* feat: stmtPrepare with child table to do

* taos -a options move to native test case

* fix:unit test benchmarkTest passed

* fix: query_json-with-sqlfile.py case no check results

* fix: queryMain.py case lost, put in tasks again

---------

Co-authored-by: Shengliang Guan <slguan@taosdata.com>
2025-03-20 22:54:29 +08:00
Simon Guan
eff763dc91
fix(stream): fix stream processing for virtual tables 2025-03-20 22:31:29 +08:00
liuyao
f7beaeebfe
ci: adjust test && fix issue
ci: adjust test && fix issue
2025-03-20 17:54:20 +08:00
Simon Guan
9b7434d0ab
merge: from main to 3.0 branch (#30296)
* chore(ci): statistics ci report

* chore(ci): statistics ci report never fail

* chore(ci): statistics ci report sort by size desc

* Update .github/workflows/taosd-ci-build.yml

* docs: upgrade the node.js connector version (#30264)

* feat: change the max value of minFreeDiskSize to 2TB (#30250)

* feat: change the max value of minFreeDiskSize to 2TB

* fix: CI test case change

* enh: remove useless comment

* docs(query): enhance time window clause descriptions in the documentation

* docs: fix image position in DST document (#30266)

* fix node.js example error (#30287)

* test: node example case

* fix: node.js example error

* fix: restore test case validation

* fix(stream): fix race condition in send msg. (#30277)

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>

* add c stmt2 example to doc (#30286)

* add: stmt2 insert example

* fix: free all heap

* format code

* add c stmt2 example

* update en doc desc

* mod makefile

---------

Co-authored-by: pengrongkun94@qq.com <pengrongkun94@qq.com>

---------

Co-authored-by: freemine <freemine@yeah.net>
Co-authored-by: WANG Xu <feici02@outlook.com>
Co-authored-by: kevin men <men_shi_bin@163.com>
Co-authored-by: Hongze Cheng <hzcheng@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: Linhe Huo <linhehuo@gmail.com>
Co-authored-by: Haojun Liao <hjxilinx@users.noreply.github.com>
Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
Co-authored-by: She Yanjie <57549981+sheyanjie-qq@users.noreply.github.com>
Co-authored-by: pengrongkun94@qq.com <pengrongkun94@qq.com>
2025-03-20 16:54:39 +08:00
Zhixiao Bao
0b8bff92c6
enh: add keep option while show stable. (#30294) 2025-03-20 15:30:22 +08:00
Haojun Liao
cd10173454
fix(gpt): fix error in gpt (#30275)
* fix(stream): support packaging enterprise edition.

* feat(gpt): support lstm and do some internal refactor, add sample autoencoder model.

* feat(gpt): support lstm and do some internal refactor, add sample autoencoder model.

* test(gpt): disable model case.

* test(gpt): disable model case.

* doc: fix title error in doc.

* doc: add mlp doc.

* fix(gpt): add gpt

* fix(gpt): update the test cases.

* fix(gpt): update the test cases.

* test(gpt): disable gpt test in github action.

* fix(gpt): check the grant, check the rsp code.

* fix(gpt): limit the forecast rows.

* fix(gpt): use default gpt service

* fix(gpt): update error code.
2025-03-20 15:18:58 +08:00
Simon Guan
2c27c10fa8 Merge branch 'main' into merge/mainto3.0 2025-03-20 14:05:45 +08:00
dapan1121
f0f517db71 fix: vnode vsubtables meta fetch issue 2025-03-20 09:52:03 +08:00
Jinqing Kuang
c82398e175 fix(stream): fix stream processing for virtual tables
- Fixed status check in virtual table stream processing
- Fixed multi-way merge logic for super virtual tables
- Fixed generation of target subtable names during merge
2025-03-20 01:15:54 +08:00
Haojun Liao
db57fc4ba8
fix(stream): fix race condition in send msg. (#30277)
Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-19 23:15:15 +08:00
Simon Guan
0a96294056
fix: adjust raft logs (#30258) 2025-03-19 21:44:39 +08:00
Simon Guan
d02196a231
refactor: adjust some logs (#30245)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* docs: update keywords

* fix: compile errors in windows

* docs: minor changes

* docs: minor changes

* refactor: minor changes

* docs: fminro changes

* docs: format

* refactr: remove uncessory logs

* docs: format doc
2025-03-18 17:55:36 +08:00
Simon Guan
ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID (#30195)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* fix: compile errors in windows

* refactor: minor changes
2025-03-18 16:21:44 +08:00
WANG MINGMING
3bc6635de3
feat[TS-6115]: support deletion of topics with active consumers. (#30232)
* feat[TS-6115]: drop topic & consumer group in force

* feat[TS-6115]: drop topic & consumer group in force

* feat[TS-6115]: drop topic & consumer group in force
2025-03-18 14:11:00 +08:00
Simon Guan
7edd97a321 fix: compile errors 2025-03-17 22:57:06 +08:00
Simon Guan
87fbdd24ad fix: compile errors 2025-03-17 22:54:12 +08:00
Simon Guan
cf8d7cd0ac Merge branch 'main' into merge/mainto3.0 2025-03-17 21:42:42 +08:00
Yihao Deng
2151c5cae0
update telemInterval (#29703) 2025-03-17 17:42:24 +08:00
dongming chen
03fe3e5430
fix: [TD-34000] remove lock when send heartbeat reply main (#30123)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix: TD-34000-remove-lock-when-send-heartbeat-reply

* fix: TD-34000-remove-lock-when-send-heartbeat-reply

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 17:13:54 +08:00
Haojun Liao
dfe32225de chore: merge main. 2025-03-17 14:51:11 +08:00
Haojun Liao
ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
Yihao Deng
0806cca09e
fix(query): fix ins_usage error on multi storage (#30134)
* fix calc disk usage error

* fix calc disk usage error

* fix calc disk usage error

* fix calc disk usage error

* fix calc disk usage error

* add test case

* add test case

* add test case

* add test case

* add test case

* add test case

* refactor code

* refactor code

* refactor code

* refactor code

* refactor code

* refactor code
2025-03-14 18:11:39 +08:00
wangjiaming
f50fcb85b8
feat(decimal): support decimal data type (#30060)
* decimal: create table

* decimal: add test case decimal.py

* decimal: add decimal.c

* support input decimal

* decimal test

* refactor svalue

* fix test cases

* add decimal unit test

* add decimal test cmake

* support insert and query decimal type

* define wide integer, support decimal128

* support decimal128 divide

* set decimal type expr res types

* scalar decimal

* convert to decimal

* fix decimal64/128 from str and to str

* fix decimal from str and decimal to str

* decimal simple conversion

* unit test for decimal

* decimal conversion and unit tests

* decimal + - * /

* decimal scalar ops and comparision

* start to refactor GET_TYPED_DATA

* support decimal max func, cast func

* refactor GET_TYPED_DATA interface

* decimal scalar comparision

* start to implement sum for decimal

* support sum and avg for decimal type

* decimal tests

* add decimal test

* decimal add test cases

* decimal use int256/int128

* decimal testing

* fix decimal table meta and add tests for decimal col streams

* fix create stream and create tsma

* test insert decimal values

* decimal from str

* test decimal input

* test parse decimal from string

* add taos_fetch_field_e api

* decimal insert tests

* test decimal operators

* decimal operator test

* feat:support decimal in raw block

* decimal operator tests

* decimal test

* feat:support decimal in raw block

* feat:support decimal in raw block

* feat:add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* decimal test operators

* decimal operator test

* test decimal operators

* test decimal compare operators

* decimal unary operator test

* decimal col with decimal col oper test

* test decimal col filtering

* fix decimal float operator test

* decimal test where filtering

* fix decimal filtering

* fix decimal order by

* fix decimal op test

* test decimal agg funcs

* test decimal functions

* remove assert

* fix ci build for ret check

* fix decimal windows build

* fix ci ret check

* skip decimal ret check

* skip decimal ret check

* fix decimal tests

* fix decimal ci test

* decimal test

* fix(tmq): heap user after free

* fix(tmq): double free

* fix(tmq): double free

* fix decimal tests

* fix(decimal): decimal test ci build

* fix(decimal): windows build

* fix(decimal): decimal test build

* fix(decimal): fix decimal build and tests

* fix(decimal): fix decimal tests

* fix(decimal): fix taos_fetch_fields_e api

* fix(decimal): fix decimal taos_fetch_fields_e api

* fix(decimal): rebase 3.0

* fix(decimal): fix decimal functions

* fix(decimal): fix decimal test case memory leak

* fix(decimal): fix decimal tests

* fix(decimal): fix decimal test case

* fix(decimal): fix decimal tests

* feat(decimal): fix unit tests

* feat(decimal): fix deicmal unit test

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 18:08:07 +08:00
Zhixiao Bao
af7e34e189
feat(keep): support keep on super table level. (#30097)
* Feat: support use keep while create super table.

* Test(keep): add test for create super table with keep option.

* Feat(keep): Add tmsg for create keep.

* Feat(keep): support alter table option keep.

* Fix(keep): Add baisc test for alter table option.

* Fix(keep): memory leek.

* Feat(keep): add keep to metaEntry&metaCache and fix earliestTs with stn keep.

* Test(keep): add some cases for select with stb keep.

* Fix: fix ci core while alter stb.

* Feat(keep): delete expired data in super table level.

* Feat: remove get stb keep while query.

* Fix : build error.

* Revert "Fix : build error."

This reverts commit 0ed66e4e84.

* Revert "Feat(keep): delete expired data in super table level."

This reverts commit 36330f6b4c.

* Fix : build errors.

* Feat : support restart taosd.

* Fix : alter table comment problems.

* Test : add tests for super table keep.

* Fix: change sdb stb reserve size.

* Test: add more tests.

* Feat: Disable normal tables and sub tables from setting the keep parameter

* Fix: add more checks to avoid unknown address.

* Docs: Add docs for stable keep.

* Fix: some review changes.

* Fix: review errors.
2025-03-14 16:10:13 +08:00
WANG MINGMING
3d053e2c9b
feat(stream): optimize client logic of creating stream if with history (#30059)
* feat:[TS-5617]use last_row cache mode if creating stream in fill_history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* fix: heap use after free

* feat: add log

* fix: ci case error

* fix: compile error in windows

* fix: ci case error

* fix: heap user after free

* fix: memory leak

* fix: ci case error

* fix: ci case error

* fix: ci case error

---------

Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 13:55:52 +08:00
Kaili Xu
13f9bddf3d
feat: support customized taos/taosd (#29736)
* feat: support TDAcoreOS

* chore: cmake options for TD_ACORE

* chore: disable lemon for TD_ACORE

* chore: add lzma2 and msvcregex

* chore: cmake for lzma2

* chore: adapt for TD_ACORE

* chore: adapt strcasecmp for TD_ACORE

* chore: adapt for geos/threadName

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE termio

* chore: refact transComm.h for TD_ACORE

* chore: refact transportInt.h for TD_ACORE

* chore: refact trans.c for TD_ACORE

* chore: refact trpc.h for TD_ACORE

* chore: refact transCli.c/transComm.c/transSvr.c for TD_ACORE

* chore: refact uv.h for TD_ACORE

* chore: refact geosWrapper.h for TD_ACORE

* chore: refact token/builtins/udf for TD_ACORE

* chore: refact rocks for TD_ACORE

* chore: refact tsdbCache.c for TD_ACORE, use LRU cache for last/last_row, not use rocksdb

* chore: refact FAIL to _ERR to solve conflicts for TD_ACORE

* chore: restore lemon.c/lempar.c

* chore: support build lemon for TD_ACORE

* chore: refact trpc and siginfo_t for TD_ACORE

* chore: refact timezone for TD_ACORE

* chore: refact lz4 for TD_ACORE

* chore: refact TD_ACORE to make compile pass

* chore: code optimization for TD_ASTRA

* feat: support run taos with taosd integrated

* feat: support invoke taos shell

* feat: support invoke taos shell

* feat: support invoke taos shell

* chore: code optimization

* chore: fix undefined reference problem os TD_ASTRA

* chore: resolve compile problem for TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix getpid

* chore: fix typo

* chore: set stack size and ajust min pack size for TD_ASTRA

* chore: fix pthread create parameters

* chore: chmod adapt for TD_ASTRA

* chore: fix trans compile problem

* chore: adapt chmod for TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: conditional compile option

* chore: adapt for TD_ASTRA

* chore: adjust taosPId and msvcregex for TD_ASTRA

* chore: log dir separator for wal build name

* chore: fix type of pointer parameter

* chore: fix compile problem of tsdbGetS3Size

* enh: get last ver from wal log for TD_ASTRA

* enh: refact wal meta ver

* enh: refact wal meta ver

* fix: typo of taosUcs4Compare

* enh: process return value of CI

* chore: more code for TD_ASTRA adaption

* chore: return value of taosCloseFile in walMeta.c

* chore: fix compile problem

* chore: fix compile problem of TD_ASTRA

* fix: update macro for tq and stream task

* chore: code optimization for TD_ASTRA

* chore: restore create log and init cfg interface

* chore: restore strncasecmp and strcasecmp

* fix: adjust the field position of SDataBlockInfo

* fix: pragma pack min size

* fix: pragma pack min size

* chore: more code for TD_ASTRA adaption

* fix: type of parameters

* chore: adapt strncasecmp and strcasecmp for TD_ASTRA

* chore: restore interface of init log

* enh: pack push optimization

* fix: taos init cfg

* add astra support

* fix: fetch the value of suid

* chore: switch of  build with udf

* add temp code

* chore: more code for TD_ASTRA adaption

* chore: add macro ERRNO to replace errno

* chore: bytes align for TD_ASTRA

* fix: remove obsolete codes

* enh: support USE_UDF macro

* fix compile error

* fix: resolve redefinition problem

* fix: compile problem of log.cpp

* fix: compile problem of osTimezone

* fix: resolve compile problem of udf

* fix: pragma definition on windows

* fix: ucs4 and stpncpy for TD_ASTRA

* fix: memory align problem for TD_ASTRA

* enh: solve memory leak for TD_ASTRA_RPC

* fix: compile problem of taosSetInt64Aligned

* fix: restore mndSubscribe.c

* fix: scalar for udf

* chore: code adaption for TD_ASTRA

* chore: code optimization for TD_ASTRA

* fix: typo of add definition

* fix: typo of macro in tudf.h

* chore: remove void to make CI pass

* enh: move macro from cmake.platform to cmake.options

* enh: byte align for hash node and error code

* chore: restore the size for lru cache

* enh: restore some code about pack push

* chore: restore the pack push in tmsg.h

* fix: add macro of pack pop for windows

---------

Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 13:32:13 +08:00
kailixu
4791f4e9da chore: remove void to make CI pass 2025-03-12 17:16:20 +08:00
Hongze Cheng
4c6098e290 feat: revert taosd -r option 2025-03-12 11:25:17 +08:00
Hongze Cheng
28201e635e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-03-12 09:55:19 +08:00
Haojun Liao
90aa27ee23 fix(stream): handle TDMT_STREAM_CHKPT_EXEC in stream queue. 2025-03-11 13:57:31 +08:00
Haojun Liao
d24bc139a5 chore: merge 3.0 2025-03-10 18:31:56 +08:00
Simon Guan
4a73af6e18
Merge pull request #30088 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2025-03-10 14:39:59 +08:00
Simon Guan
dde312787c
Merge pull request #30054 from taosdata/fix/TD-32218-3
fix(tdb): restrict tdb allocation from buffer pool
2025-03-10 13:50:36 +08:00
Simon Guan
abaf48ae15 Merge branch '3.0' into merge/mainto3.0 2025-03-10 11:07:48 +08:00
Simon Guan
1170955b95 Merge branch 'main' into merge/mainto3.0 2025-03-10 11:05:52 +08:00
Haojun Liao
2eeb13591c
Merge branch 'main' into fix/checkpoint 2025-03-10 10:15:23 +08:00
Simon Guan
f60219e2f0
Merge pull request #30035 from taosdata/enh/TD-33960-improve-sync-log
enh: [TD-33960] improve-sync-log
2025-03-10 10:03:16 +08:00
Hongze Cheng
eb5ff7317d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-03-07 16:47:48 +08:00
Hongze Cheng
0c48a3ab25 fix: open meta invalid state handle 2025-03-07 16:47:04 +08:00
Simon Guan
8fa8fc2a0c
Merge pull request #29934 from taosdata/enh/TS-5650/showLike
enh: show variables like
2025-03-07 16:37:19 +08:00
Minglei Jin
a94d6aef03 fix(tdb): restrict tdb allocation from buffer pool 2025-03-07 14:29:29 +08:00
xinsheng Ren
4edddd6038
Merge branch '3.0' into enh/TS-5650/showLike 2025-03-07 10:29:35 +08:00
Simon Guan
609ff730c4 refactor: jemalloc options 2025-03-07 10:03:43 +08:00
Simon Guan
6250adb3b1 refactor: rename udfd to taosudf 2025-03-06 22:20:52 +08:00
Haojun Liao
95e75196e2 chore: merge main. 2025-03-06 18:45:21 +08:00
Simon Guan
c00d772492
Merge pull request #29649 from taosdata/feat/TS-5927-long-password
feat:[TS-5927]long-password
2025-03-06 17:25:48 +08:00
Simon Guan
c642f5e6e0
Merge pull request #30033 from taosdata/fix/TS-6078-main
fix(query): change error log to warning when failed to acquire tsdb reader
2025-03-06 17:19:03 +08:00
Simon Guan
2c3099b840
Merge pull request #30010 from taosdata/fix/checkfh
fix(stream): not remove local checkpoint dir, log the checkpoint size.
2025-03-06 17:13:55 +08:00
dmchen
952053598c enh: TD-33960-improve-sync-log 2025-03-06 14:47:44 +08:00
Jinqing Kuang
7a7aacd6cc fix(query): change error log to warning when failed to acquire tsdb reader
Jira: https://jira.taosdata.com:18080/browse/TS-6066
2025-03-06 14:23:00 +08:00
Simon Guan
9023f2f505
Merge pull request #30022 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2025-03-05 19:44:38 +08:00
Simon Guan
f9681cce1d
Merge pull request #30000 from taosdata/enh/3.0/TD33165
enh(insert): use cache to improve auto create table performance.
2025-03-05 18:52:22 +08:00
Simon Guan
6fa7a7bb99
Merge pull request #29996 from taosdata/fix/droptask
feat(stream): add timeout parameter.
2025-03-05 18:49:23 +08:00
Simon Guan
34120a38c5 Merge branch '3.0' into merge/mainto3.0 2025-03-05 18:12:55 +08:00
Simon Guan
292b0cb317 Merge branch 'main' into merge/mainto3.0 2025-03-05 18:10:31 +08:00
Haojun Liao
24882459e3 chore: merge main 2025-03-05 13:40:44 +08:00
dongming chen
e5fb75797a
Merge branch '3.0' into feat/TS-5927-long-password 2025-03-05 12:15:12 +08:00
yihaoDeng
d1ded07b43 fix(index): fix return error 2025-03-05 11:07:59 +08:00
yihaoDeng
a4b738b3c6 enh(index): opt error code 2025-03-05 11:04:39 +08:00
Simon Guan
6656460320
Merge pull request #29988 from taosdata/fix/chkptq
fix(stream):check the maximum allowed forecast rows, add one test case
2025-03-05 09:29:01 +08:00
Haojun Liao
eb0553b737 refactor: do some internal refactor. 2025-03-04 18:45:29 +08:00
Haojun Liao
936f0af929 fix(analytics): check return value. 2025-03-04 17:04:07 +08:00
Haojun Liao
2eea385485 fix(analytics): check return value. 2025-03-04 15:29:54 +08:00
Zhixiao Bao
45d05761ae
Merge branch '3.0' into enh/3.0/TD33165 2025-03-04 14:46:51 +08:00
Haojun Liao
c186d31c7d fix(analytics): check return value. 2025-03-04 14:30:48 +08:00
Simon Guan
1a9f75e663 Merge branch '3.0' into fix/internal 2025-03-04 13:47:03 +08:00
Simon Guan
b74b038f4f Merge branch '3.0' into merge/mainto3.0 2025-03-04 11:32:29 +08:00
Simon Guan
16ada1f0d3 Merge branch 'main' into merge/mainto3.0 2025-03-04 11:24:13 +08:00
xiao-77
e2b18a7182 End(insert):Use cache to improve auto create table performance. 2025-03-04 10:04:58 +08:00
Haojun Liao
19f09d679d feat(stream): add timeout parameter. 2025-03-03 23:05:14 +08:00
Simon Guan
65d5fd0578
Merge pull request #29975 from taosdata/enh/stopall
refactor(stream): stop all tasks before drop vnodes.
2025-03-03 20:01:56 +08:00
Haojun Liao
f563a35b3f fix(stream):check the maximum allowed forecast rows, add one test case, and do some internal refactor. 2025-03-03 17:27:05 +08:00
Haojun Liao
f59d25f1a5 fix(stream): fix syntax error. 2025-03-03 16:27:54 +08:00
Haojun Liao
ac667164ed refactor: do some internal refactor. 2025-03-03 16:20:58 +08:00
Haojun Liao
dfd1beaead chore: merge main 2025-03-03 14:29:10 +08:00
Simon Guan
7326e3d8bc Merge branch '3.0' into merge/mainto3.0 2025-03-03 14:01:51 +08:00
Simon Guan
6826edf5e0 Merge branch 'main' into merge/mainto3.0 2025-03-03 14:01:43 +08:00
Simon Guan
f88c249fa4
Merge pull request #29946 from taosdata/fix/remove-sync-heartbeat-lock
fix: remove sync heartbeat lock
2025-03-03 13:52:16 +08:00
Simon Guan
eee9976a44
Merge pull request #29958 from taosdata/fix/TD-33872-improve-status-sync-heartbeat
fix: [td-33872] improve status sync heartbeat
2025-03-03 13:51:44 +08:00
Simon Guan
d7207861bb Merge remote-tracking branch 'origin/3.0' into fix/internal 2025-03-03 10:43:07 +08:00
factosea
6da2e6f547 fix: test case 2025-03-02 22:48:21 +08:00
factosea
e91014f807 feat: show variables like 2025-03-02 22:48:05 +08:00
Haojun Liao
06ba3027b1 fix(stream): check return value. 2025-03-02 12:06:19 +08:00
Haojun Liao
a71f414d97 refactor(stream): stop all tasks before drop vnodes. 2025-03-02 02:06:14 +08:00
Haojun Liao
d2d7279f0d fix(stream): fix memory leak if error occurs. 2025-03-01 19:22:26 +08:00
Haojun Liao
c9f9540530 fix(stream): fix memory leak. 2025-03-01 15:34:09 +08:00
Haojun Liao
f8cc9648f6 fix(stream): fix memory leak. 2025-03-01 15:33:31 +08:00
dmchen
b0f62f4f91 fix:statusseq 2025-03-01 12:51:09 +08:00
dmchen
3fb2476b81 fix:statusseq 2025-03-01 12:50:28 +08:00
dmchen
65773866ca fix:remove-send-status-lock 2025-03-01 01:02:30 +08:00
dmchen
ccd4b19c5f fix:remove-send-status-lock 2025-03-01 00:53:04 +08:00
dmchen
092e8e4488 fix:remove-send-status-lock 2025-03-01 00:52:11 +08:00
dmchen
6d2925b832 fix/remove-get-queue-size-when-print-heartbeat-log 2025-03-01 00:22:42 +08:00
dmchen
3359483836 fix:decouple get mload 2025-03-01 00:22:40 +08:00
dmchen
774c512148 fix:add-status-timestamp 2025-03-01 00:22:37 +08:00
dmchen
48787ba1aa fix/move-status-to-new-queue 2025-03-01 00:22:35 +08:00
Haojun Liao
c726420081 Merge branch 'main' into fix/droptask 2025-02-28 19:42:35 +08:00
Haojun Liao
8c3035cf24 fix(stream): avoid lock in timer to avoid sync operation blocks. 2025-02-28 17:47:43 +08:00
Haojun Liao
e1c4451f81 fix(stream): avoid lock in timer to avoid sync operation blocks. 2025-02-28 17:46:54 +08:00
Simon Guan
43ca6d5f9e refactor: adjust some logs 2025-02-28 16:49:46 +08:00
Haojun Liao
5f6ecab854 fix(stream): check the return values. 2025-02-28 15:05:00 +08:00
dmchen
45cdd871db fix/remove-get-queue-size-when-print-heartbeat-log 2025-02-28 14:15:20 +08:00
Haojun Liao
6e1206bbc1 fix(stream): add some logs. 2025-02-28 13:55:37 +08:00
Haojun Liao
951b469b10 fix(stream): add some logs. 2025-02-28 13:55:24 +08:00
Haojun Liao
14ef25101d fix(stream): adjust log. 2025-02-28 13:55:09 +08:00
Haojun Liao
3e55f8edfe fix(stream): follower nodes not restart tasks. 2025-02-28 13:54:26 +08:00
Haojun Liao
ed03b3a22c fix(stream): try starting task even the inputQ is full. 2025-02-28 13:48:05 +08:00
Simon Guan
24fae6adbb
Merge pull request #29900 from taosdata/fix/checkfh
refactor(stream): scan wal is driven by time, instead of insert events.
2025-02-28 13:42:43 +08:00
Hongze Cheng
0174d7404d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-28 13:26:53 +08:00
dmchen
aa7cb880bb fix/remove-get-queue-size-when-print-heartbeat-log 2025-02-28 11:53:18 +08:00
dmchen
1237e762c1 fix/remove-get-queue-size-when-print-heartbeat-log 2025-02-28 11:52:27 +08:00
Simon Guan
aa1bf309ea
Merge pull request #29959 from taosdata/fix/droptask
refactor(stream): create task epset update trans out of lock
2025-02-28 11:00:58 +08:00
Simon Guan
ed2d3b258d Merge branch '3.0' into merge/mainto3.0 2025-02-28 09:11:14 +08:00
Simon Guan
f5429637fa Merge branch 'main' into merge/mainto3.0 2025-02-28 09:11:10 +08:00
dmchen
2d4697d32f fix:decouple get mload 2025-02-27 19:17:54 +08:00
dmchen
4dd0622594 fix:decouple get mload 2025-02-27 19:07:33 +08:00
dmchen
f6a472ae68 fix:decouple get mload 2025-02-27 19:05:06 +08:00
Hongze Cheng
0d2ca243b1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-27 17:18:33 +08:00
dmchen
d435bbae1d fix:add-status-timestamp 2025-02-27 15:54:07 +08:00
dmchen
55f58d743f fix/move-status-to-new-queue 2025-02-27 15:54:06 +08:00
Simon Guan
5d777f9bcf
Merge pull request #29654 from taosdata/feat/TS-5805-force-assign-leader
Feat/ts 5805 force assign leader
2025-02-27 15:42:27 +08:00
dmchen
7eeb800213 fix:add-status-timestamp 2025-02-27 15:29:52 +08:00
dmchen
1f6c4df422 fix/move-status-to-new-queue 2025-02-27 15:26:06 +08:00
dmchen
93992f3d6e fix:add-status-timestamp 2025-02-27 15:22:33 +08:00
Haojun Liao
45dfa0f12e refactor(stream): create task epset update trans out of lock, to avoid blocking mnode-read thread. 2025-02-27 15:18:01 +08:00
Hongze Cheng
e2b48e4397 enh: add more code 2025-02-27 15:06:49 +08:00
Haojun Liao
7b56df0adc refactor(stream): create task epset update trans out of lock, to avoid blocking mnode-read thread. 2025-02-27 14:51:26 +08:00
Hongze Cheng
b3ae5df8ac enh: more code 2025-02-27 14:06:30 +08:00
dmchen
5635b285cd feat/TS-5805-force-assign-leader-fix-check 2025-02-27 03:17:21 +00:00
dmchen
031f176aa1 fix/move-status-to-new-queue 2025-02-27 11:02:18 +08:00
Simon Guan
7f10288df1 Merge branch '3.0' into fix/internal 2025-02-27 10:04:34 +08:00
Simon Guan
76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
Simon Guan
b91dd10846 enh: add log level to each log entry 2025-02-27 09:55:11 +08:00
wangmm0220
ef13df2e3d feat:[TD-33798]modify metadata logic for tmq 2025-02-27 09:55:11 +08:00
wangmm0220
a823efb3c4 feat:[TD-33798]modify metadata logic for tmq 2025-02-27 09:55:11 +08:00
wangmm0220
ebc8a2e433 fix:[TD-337958]send batch metadata & remove data if subscribe only meta 2025-02-27 09:55:11 +08:00
Haojun Liao
899d2cef20 fix(stream): not discard stream msg 2025-02-27 00:39:30 +08:00
Haojun Liao
786ee101cd other: merge main. 2025-02-27 00:18:25 +08:00
Haojun Liao
bf1f162aa0 fix(stream): drop task in synch model in write thread. 2025-02-27 00:15:36 +08:00
Haojun Liao
012ee53d35 fix(stream): drop task in synch model in write thread. 2025-02-27 00:15:31 +08:00
Haojun Liao
45b0e47a19 refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution. 2025-02-27 00:15:03 +08:00
Haojun Liao
7319f544c2 refactor(stream): drop task in async ways 2025-02-27 00:14:34 +08:00
Haojun Liao
c14ba08d7c refactor(stream): drop task in async ways 2025-02-27 00:12:11 +08:00
Hongze Cheng
df96529e0d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-26 15:09:54 +08:00
Simon Guan
ac056f153f
Merge pull request #29871 from taosdata/fix/TS-6028-check-column-name
fix:[TS-6028]check-column-name
2025-02-26 14:00:45 +08:00
dongming chen
0ce087f2b3
Merge branch '3.0' into feat/TS-5805-force-assign-leader 2025-02-26 13:57:36 +08:00
dmchen
ebd2e657c6 fix/TS-6028-check-column-name-fix-review 2025-02-26 01:30:33 +00:00
dmchen
26f3adcf6a fix/TS-6028-check-column-name-fix-review 2025-02-25 10:27:32 +00:00
Hongze Cheng
b26166b48d support meta_only option 2025-02-25 17:57:25 +08:00
Hongze Cheng
d48547ed64 more code 2025-02-25 16:48:43 +08:00
Shengliang Guan
e429264432
Merge pull request #29884 from taosdata/enh/killtrans
enh(stream): auto kill checkpoint trans that last long time
2025-02-25 11:29:49 +08:00
Hongze Cheng
f85ddb6633 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-25 09:47:38 +08:00
Shengliang Guan
8a324a45d5
Merge pull request #29885 from taosdata/feat/TD-33798
feat:[TD-33798]send batch metadata & remove data if subscribe only meta
2025-02-24 19:32:26 +08:00
Hongze Cheng
9a95abd26d more code 2025-02-24 16:32:09 +08:00
wangmm0220
e87541efaa feat:[TD-33798]modify metadata logic for tmq 2025-02-24 16:18:27 +08:00
Shengliang Guan
8fccf318ab
Merge pull request #29902 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2025-02-24 15:47:21 +08:00
Hongze Cheng
b01ed3bb80 more code 2025-02-24 15:32:46 +08:00
Hongze Cheng
b048c597dc more code 2025-02-24 14:41:56 +08:00
Shengliang Guan
3a1d06f4d7
Merge pull request #29354 from taosdata/enh/TS-5255/colsFunc2
enh: ts5255/cols func2
2025-02-24 14:19:37 +08:00
Haojun Liao
91271f3fa4 refactor: do some internal refactor. 2025-02-24 13:53:28 +08:00
Haojun Liao
4d21d5e055 fix(stream): fix memory leak. 2025-02-24 13:50:38 +08:00
Haojun Liao
c7d9a1cd73 fix(stream): fix memory leak. 2025-02-24 13:48:21 +08:00
Hongze Cheng
f8a0dc8fe0 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-24 09:49:31 +08:00
Haojun Liao
97071f1d29 other: add some logs. 2025-02-24 09:42:15 +08:00
Haojun Liao
514a63ab37 fix(stream): fix the error in check scan interval 2025-02-24 00:40:16 +08:00
Haojun Liao
00edb8e612 fix(stream): adjust init tmr position. 2025-02-23 16:27:18 +08:00
Haojun Liao
787590b6c9 fix(stream): adjust init tmr position. 2025-02-23 16:25:17 +08:00
Haojun Liao
b4de2d16b6 fix(stream): add some logs. 2025-02-23 16:18:49 +08:00
Haojun Liao
f4c3fdedbd fix(stream): add some logs. 2025-02-23 16:18:19 +08:00
Haojun Liao
4ff74ab2ea fix(stream): adjust log. 2025-02-23 15:37:59 +08:00
Haojun Liao
8c0ead7c61 refactor: add some comments. 2025-02-23 11:03:49 +08:00
Haojun Liao
2fdb31a41a fix(stream): adjust scan timer 2025-02-23 10:49:13 +08:00
Haojun Liao
f1c4d2734f fix(stream): follower nodes not restart tasks. 2025-02-23 10:43:56 +08:00
Haojun Liao
e378b5cb8a fix(stream): adjust scan timer 2025-02-23 03:42:44 +08:00
Haojun Liao
9018970135 refactor: do some internal refactor. 2025-02-23 01:39:00 +08:00
Haojun Liao
034c907ee1 refactor: do some internal refactor. 2025-02-23 01:38:05 +08:00
Shengliang Guan
3a739beaa5 Merge branch 'main' into merge/mainto3.0 2025-02-22 20:07:40 +08:00
Haojun Liao
a8d50f28a6 fix(stream): disable error injection. 2025-02-22 14:19:44 +08:00
Haojun Liao
56f1c80018 fix(stream): disable error injection. 2025-02-22 14:18:44 +08:00
Haojun Liao
4d62c60aaf fix(stream): fix syntax error. 2025-02-22 14:17:19 +08:00
Haojun Liao
6c92474afd fix(stream): fix syntax error. 2025-02-22 14:16:46 +08:00
Haojun Liao
a9b5d0fbf0 fix(stream): update function return value. 2025-02-22 14:13:42 +08:00
Haojun Liao
9bd8b532ad fix(stream): update function return value. 2025-02-22 14:12:38 +08:00
Haojun Liao
0ec8e1e202 refactor(stream): remove comments. 2025-02-22 12:38:19 +08:00
Haojun Liao
0f89421b62 refactor(stream): scan wal is driven by time, instead of insert events. 2025-02-22 12:38:03 +08:00
Haojun Liao
b5fdb44193 refactor(stream): remove comments. 2025-02-22 12:35:37 +08:00
Haojun Liao
09b6642e45 refactor(stream): scan wal is driven by time, instead of insert events. 2025-02-22 12:33:32 +08:00
Haojun Liao
ea549364d4 fix(stream): free array and check the return values. 2025-02-21 16:38:26 +08:00
Hongze Cheng
93e17112e1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-21 15:22:22 +08:00
dmchen
6a81665ffa fix/TS-6028-check-column-name-add-case 2025-02-21 14:51:40 +08:00
wangmm0220
e594c2bbd5 feat:[TD-33798]modify metadata logic for tmq 2025-02-21 11:49:17 +08:00
Haojun Liao
2228a9fc33
Merge branch 'main' into fix/checkfh 2025-02-21 11:11:36 +08:00
dmchen
cdb11dd497 fix/TS-6028-column-name-fix-cases 2025-02-21 10:10:44 +08:00
Haojun Liao
ecc667c22b
Revert "refactor(stream): drop task in async ways" 2025-02-21 01:10:18 +08:00
wangmm0220
7b5edade95 fix:[TD-337958]send batch metadata & remove data if subscribe only meta 2025-02-20 19:50:37 +08:00
Haojun Liao
9d5735703b Merge branch 'fix/checkfh' into fix/checkpoint 2025-02-20 18:28:46 +08:00
Haojun Liao
bea8fe42db fix(stream): check status before scan history. 2025-02-20 18:28:19 +08:00
Haojun Liao
66697ee188 fix(stream): check status before scan history. 2025-02-20 18:22:45 +08:00
Shengliang Guan
2bee60a41a Merge branch 'main' into merge/mainto3.0 2025-02-20 18:12:02 +08:00
Hongze Cheng
b980bb35bc more code 2025-02-20 18:08:20 +08:00
dmchen
078c7bdc31 fix/TS-6028-check-column-name 2025-02-20 17:33:48 +08:00
Haojun Liao
22c05fde79 Merge branch 'enh/killtrans' into fix/checkpoint 2025-02-20 17:28:13 +08:00
Haojun Liao
6d5984421f refactor(stream): update the long trans threshold. 2025-02-20 17:27:41 +08:00
Haojun Liao
85c164c855 other: merge main. 2025-02-20 17:25:48 +08:00
Haojun Liao
0a672f1b96 refactor(stream): update logs. 2025-02-20 16:55:10 +08:00
Haojun Liao
6766e6db53 refactor(stream): add checkpoint queue to handle chkpt. 2025-02-20 16:13:33 +08:00
Haojun Liao
55f03f2187 fix(stream): try starting task even the inputQ is full. 2025-02-20 16:07:05 +08:00
Haojun Liao
99d6086c5a enh(stream): kill too long checkpoint trans. 2025-02-20 15:07:24 +08:00
Shengliang Guan
42bafc0d47
Merge pull request #29848 from taosdata/fix/ly_stream
fix(tsma):drop invalid state for tsma
2025-02-20 15:04:03 +08:00
Shengliang Guan
0a9f5086f0
Merge pull request #29775 from taosdata/fix/analysis
refactor(stream): drop task in async ways
2025-02-20 13:38:53 +08:00
54liuyao
870fe1c071 fix(tsma):drop invalid state for tsma 2025-02-20 11:52:04 +08:00
Shengliang Guan
86ea533b36 Merge branch '3.0' into merge/mainto3.03 2025-02-20 11:38:43 +08:00
Shengliang Guan
d0eb99809f Merge branch 'main' into merge/mainto3.03 2025-02-20 11:38:41 +08:00
Shengliang Guan
f16ae7abe1
Merge pull request #29809 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2025-02-20 10:27:20 +08:00
Haojun Liao
3048654484 refactor(stream): kill too long checkpoint trans. 2025-02-20 10:01:30 +08:00
Shengliang Guan
4e064b5aec
Merge pull request #29823 from taosdata/feat/TS-5928
fix:[TS-5928]add consumer parameters
2025-02-19 19:22:26 +08:00
Shengliang Guan
f2f8cb1648 Merge branch '3.0' into merge/mainto3.03 2025-02-19 17:00:41 +08:00
Shengliang Guan
d13f9448eb
Merge pull request #29730 from taosdata/feat/3.0/TS-5584
Feat(sync):Add restore progress to the "show vnodes" command, and add…
2025-02-19 16:30:27 +08:00
wangmm0220
fc3995a10c fix:[TS-5776]add test case 2025-02-19 11:12:13 +08:00
Haojun Liao
7d617a7cde
fix(stream): fix the invalid start task condition
1. Get the basic checkpointId, and wait for 10 s, it's allowed to go.  2. All tasks have the same checkpointId, go immedidately.
2025-02-19 00:39:01 +08:00
Shengliang Guan
6735e5e948
Merge pull request #29822 from taosdata/kjq/enh-code-clarity
enh(stream): add options to control message and frame size
2025-02-18 18:59:28 +08:00
Shengliang Guan
8bee0e7030
Merge pull request #29666 from taosdata/feat/TS-5776
fix:[TS-5776]add raw type from consumer
2025-02-18 17:53:52 +08:00
wangmm0220
bdfa67e4a9 fix:[TS-5928]add consumer parameters 2025-02-18 17:32:00 +08:00
Jinqing Kuang
a48095d467 enh(streams): add options to control message and frame size
Add options to allow users to specify message and frame size limits for
event notifications.
2025-02-18 17:20:38 +08:00
Shengliang Guan
b43aaa5f8a Merge branch '3.0' into merge/mainto3.02 2025-02-18 16:48:55 +08:00
Zhixiao Bao
05112546fd
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-18 16:07:47 +08:00
wangmm0220
f824a75f4d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-5776 2025-02-18 15:28:10 +08:00
wangmm0220
07e4265dde fix:[TS-5776]error in create table time 2025-02-18 15:21:51 +08:00
Shengliang Guan
92eb6038e2
Merge pull request #29762 from taosdata/feat/TS-5469-3.0
feat(stream)[TS-5469]: add more stream event notifications
2025-02-18 15:14:58 +08:00
wangmm0220
9dcac195cb fix:[TS-5776]error in ci 2025-02-18 11:20:42 +08:00
Shengliang Guan
63fc5dea34 Merge branch '3.0' into merge/mainto3.0 2025-02-18 10:29:16 +08:00
xiao-77
d071f40328 Fix review errors. 2025-02-18 09:31:15 +08:00
wangmm0220
6f2ccfc3b2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-5776 2025-02-17 17:41:25 +08:00
wangmm0220
bf5dc63a30 fix:[TS-5776]add test case 2025-02-17 17:40:54 +08:00
Linhe Huo
a0090b5cdf
Merge pull request #29763 from taosdata/enh/TD-33678-3.0
enh: unified oem --version output 3.0
2025-02-17 10:41:33 +08:00
Linhe Huo
f21ffcb510
Merge pull request #29764 from taosdata/enh/TD-33678-MAIN
fix: oem taosdump taosBenchmark --version support -main
2025-02-17 10:41:06 +08:00
Shengliang Guan
6dedab4bba
Merge pull request #29784 from taosdata/fix/TS-6017-3.0m
fix: timeseries statistics and test case
2025-02-17 10:25:44 +08:00
wangmm0220
3da00b7c74 fix:[TS-5776]add raw type from consumer 2025-02-17 10:13:49 +08:00
Haojun Liao
c4cd6dd62d fix(stream): drop task in synch model in write thread. 2025-02-17 10:06:09 +08:00
Shengliang Guan
596e381e0e
Merge pull request #29779 from taosdata/fix/metanull
fix(stream): access value after null ptr check.
2025-02-17 09:36:09 +08:00
Jinqing Kuang
fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
wangmm0220
47a6836c27 fix:[TS-5776]add raw type from consumer 2025-02-16 00:15:01 +08:00
Haojun Liao
465e5eabd7 fix(stream): drop task in synch model in write thread. 2025-02-15 23:20:05 +08:00
Haojun Liao
0a101fc3c1 fix(stream): add missing release 2025-02-15 00:05:24 +08:00
Haojun Liao
57a2471cc6 fix(stream): add missing release 2025-02-15 00:03:33 +08:00
Haojun Liao
8848ae61a4 fix(stream): add missing release 2025-02-15 00:00:45 +08:00
Haojun Liao
25cdfa5ee9 refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution. 2025-02-14 18:34:20 +08:00
Alex Duan
c99e59fa94 fix:merge main branch 2025-02-14 18:16:05 +08:00
kailixu
5fa20d8cb3 Merge branch 'main' into fix/TS-6017-3.0m 2025-02-14 17:02:47 +08:00
wangmm0220
39f77e45fc fix:[TS-5776]add raw type from consumer 2025-02-14 16:54:53 +08:00
kailixu
6885b942b1 fix: timeseries statistics and test case 2025-02-14 16:53:32 +08:00
wangmm0220
f16f21897e fix:[TS-5776]add raw type from consumer 2025-02-14 16:12:00 +08:00
Shengliang Guan
6f001ece03
Merge pull request #29778 from taosdata/fix/internal
fix: compilation failures after enabling the JEMALLOC_ENABLED option
2025-02-14 15:42:24 +08:00
Haojun Liao
73ec4af4a7 Merge branch 'main' into fix/analysis 2025-02-14 15:37:11 +08:00
wangmm0220
d67de02a31 fix:[TS-5776]add raw type from consumer 2025-02-14 15:09:32 +08:00
Shengliang Guan
d6bd52ece7
Merge pull request #29750 from taosdata/enh/streamqueue
refactor(stream): add more operation handled in ctrl queue, and limit the stream input q size
2025-02-14 15:02:23 +08:00
Shengliang Guan
8da407e67d fix: compilation failures after enabling the JEMALLOC_ENABLED option 2025-02-14 14:21:20 +08:00
dmchen
cc3b883a43 feat/TS-5927-long-password-compatable 2025-02-14 06:04:22 +00:00
Haojun Liao
03041d0f61 other: merge main 2025-02-14 10:18:19 +08:00
dmchen
8f2370f3fa feat/TS-5927-long-password-fix-case 2025-02-14 01:12:09 +00:00
Haojun Liao
43d45e9f9a refactor(stream): drop task in async ways 2025-02-13 23:43:07 +08:00
Haojun Liao
fd96b096ea refactor(stream): drop task in async ways 2025-02-13 23:41:06 +08:00
kailixu
e3aaab405d fix: timeseries statistics and test case 2025-02-13 18:55:28 +08:00
dmchen
55e12e520b feat/TS-5927-long-password-encrypt-pass 2025-02-13 07:45:42 +00:00
Alex Duan
d3e1e53569 fix: adjust oem name only with cus_name.h define 2025-02-13 14:12:34 +08:00
kailixu
61a606a410 fix: timeseries calculation when create table 2025-02-13 14:03:54 +08:00
wangmm0220
daea0ec61a fix:[TS-5776]add raw type from consumer 2025-02-13 13:54:54 +08:00
Alex Duan
22ca66b25c fix: restore cur_name.h 2025-02-13 13:16:39 +08:00
Alex Duan
400254820c fix: remove cur_name.h content to tdef.h and del cur_name.h 2025-02-13 13:00:46 +08:00
Zhixiao Bao
e71c03a90f
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-13 10:17:58 +08:00
dongming chen
2fd8792c7a
Merge branch '3.0' into feat/TS-5927-long-password 2025-02-12 15:26:41 +08:00
xiao-77
359399f1cd feat rename some names. 2025-02-12 14:49:59 +08:00
dmchen
b422e2b2f2 feat/TS-5805-force-assign-leader-msg-type 2025-02-12 06:29:24 +00:00
dongming chen
0350f46ba4
Merge pull request #29756 from taosdata/3.0
3.0
2025-02-12 14:00:02 +08:00
Shengliang Guan
67b678f9f0
Merge pull request #29746 from taosdata/merge/mainto3.02
merge: from main to 3.0 branch
2025-02-12 13:57:36 +08:00
Shengliang Guan
54c8a2be0a
Merge pull request #29310 from taosdata/fix/TS-5805-check-arb
fix/TS-5805-check-arb
2025-02-12 13:46:06 +08:00
dmchen
d128c3927d fix/TS-5805-check-arb-fix-comment 2025-02-12 02:04:13 +00:00
xiao-77
bdcec392b4 Merge remote-tracking branch 'origin/3.0' into feat/3.0/TS-5584 2025-02-12 09:56:23 +08:00
xiao-77
a1a3f83283 Add unapplied to show vnodes. 2025-02-12 09:55:36 +08:00
wangmm0220
878bac1556 fix:[TS-5776]avoid memcpy fo DataRspObj 2025-02-11 18:04:53 +08:00
xiao-77
b62d8d37b1 Feat(sync):Use remaining time to replace progress. 2025-02-11 15:51:05 +08:00
Shengliang Guan
cd52401303 Merge branch 'main' into merge/mainto3.02 2025-02-11 15:15:35 +08:00
Haojun Liao
81b718ec69 refactor(stream): handle retrieve chkpt trigger in ctrl queue. 2025-02-11 13:07:06 +08:00
dmchen
635b4a5cb1 fix/TS-5805-check-arb-trans-compatable 2025-02-11 02:56:12 +00:00
Haojun Liao
267f7d3b08 refactor(stream): limit the maximum number of consensus checkpoint trans. 2025-02-11 10:31:11 +08:00
Haojun Liao
d08a81cc98 fix(stream): fix bug in limiting concurrent checkpoints 2025-02-10 19:24:37 +08:00
Haojun Liao
6c7a8e9774 refactor(stream): allow ready stream to start checkpoint procedure. 2025-02-10 19:24:36 +08:00
Haojun Liao
9ad6fd170b fix(stream): update the process queue. 2025-02-10 19:24:36 +08:00
Shengliang Guan
dae17cd1b0
Merge pull request #29718 from taosdata/enh/streamqueue
refactor(stream): notify close stream in main thread
2025-02-10 18:44:27 +08:00
Hongze Cheng
3d081041ba fix: invalid pointer 2025-02-10 18:38:27 +08:00
xiao-77
fbe65197d6 Feat(sync):Add restore progress to the "show vnodes" command, and add the applied index to the "show vgroups" command. 2025-02-10 15:58:25 +08:00
Hongze Cheng
d537b2f8b6 adjust api code 2025-02-10 15:56:23 +08:00
dmchen
b1dc31a2bd fix/TS-5805-check-arb-add-column 2025-02-10 06:57:50 +00:00
Hongze Cheng
b2bfbebfb1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5794-3.0 2025-02-10 14:29:13 +08:00
dmchen
946a0c1bb5 fix/TS-5805-check-arb-remve-useless-code 2025-02-10 02:58:42 +00:00
Shengliang Guan
f5c0d5ffaa
Merge pull request #29704 from taosdata/fix/main/TS-5974
Fix(cfg):fix some configs' errors and remove some configs from global config list.
2025-02-10 10:13:54 +08:00
dongming chen
240a8b5d5b
Merge pull request #29723 from taosdata/3.0
3.0
2025-02-10 09:56:12 +08:00
Haojun Liao
694b6385d5 refactor(stream): adjust reset and mark failed Id. 2025-02-09 21:40:33 +08:00
Haojun Liao
ec954bf408 refactor(stream): record the dropped stream. 2025-02-09 21:13:10 +08:00
Haojun Liao
cb7e2cb1e0 refactor(stream): record the elapsed time for close stream tasks. 2025-02-09 01:42:25 +08:00
Haojun Liao
a2dcba10a7 refactor(stream): 1) notify closing in main thread. 2) not saving the halt status. 2025-02-09 01:42:24 +08:00
xiao-77
adfab1f2b6 Fix some review errors. 2025-02-08 18:51:39 +08:00
xiao-77
4011d01148 Fix some review errors. 2025-02-08 17:42:48 +08:00
xiao-77
7707e5d8dd Fix some review errors. 2025-02-08 17:37:15 +08:00
Jinqing Kuang
d32cf8bcb8 fix(query)[TS-5984]. correct data block filtering logic in tsdbReader
When scanning a table with a primary key, tsdbReader could load
irrelevant data blocks outside the query time range, causing errors
when returning results.

This fix improves filtering logic to ensure only valid blocks are
read and adds test verification.
2025-02-08 17:32:25 +08:00
xiao-77
a2f11f21c9 Fix review problems. 2025-02-08 17:07:55 +08:00
Hongze Cheng
499cf0c294 more code 2025-02-08 14:34:22 +08:00
Hongze Cheng
f2dafd9362 more code 2025-02-08 11:24:45 +08:00