Commit graph

4123 commits

Author SHA1 Message Date
Jing Sima
6788d39c21 feat: [TS-6100] Parse create stream sql: Fix single table check when using %%tbname 2025-06-23 14:49:47 +08:00
Jing Sima
cc868ac28b feat: [TS-6100] Parse create stream sql: Fix out table length bug 2025-06-23 14:23:29 +08:00
Jing Sima
a97841b48d feat: [TS-6100] Parse create stream sql: Change default out subtable name rule 2025-06-23 08:52:21 +08:00
Jing Sima
3c217048ba feat: [TS-6100] Parse create stream sql: Improve error msg when checking period window. 2025-06-21 17:44:15 +08:00
Jing Sima
40a714a020 feat: [TS-6100] Parse create stream sql: change virtual table plan 2025-06-21 17:29:36 +08:00
Jing Sima
a142c1aebb feat: [TS-6100] Parse create stream sql: support fill_history without parameters 2025-06-21 15:24:31 +08:00
Mario Peng
c65e1592fa
feat:insert into subquery (#31401) 2025-06-21 15:11:09 +08:00
Zhixiao Bao
19574797b3
fix: insert using sql use the same stb and ctb name. (#31451) 2025-06-21 14:13:32 +08:00
facetosea
bcc42b2511 fix: error msg 2025-06-21 08:56:47 +08:00
Jing Sima
0bd2a88bad feat: [TS-6100] Parse create stream sql: Add sys db check for create stream. 2025-06-20 16:11:31 +08:00
Jing Sima
2e298ed915 feat: [TS-6100] Parse create stream sql: Add check when partition by supertable. 2025-06-20 15:02:38 +08:00
Simon Guan
9923aedcb6 Merge branch 'main' into merge/mainto3.0 2025-06-20 14:48:16 +08:00
Pan Wei
1eb4a35063
Merge pull request #31348 from taosdata/fix/3.3.6.0/TS-6319
fix(parser): set current statement precision use join table precision
2025-06-20 08:55:03 +08:00
Jing Sima
c0340dcee7 feat: [TS-6100] Parse create stream sql: Fix out col / tag wrong length 2025-06-18 17:57:30 +08:00
hongzhenliu335
ba2f3b2ccc fix(parser): set current statement precision use join table precision 2025-06-18 17:53:40 +08:00
Jing Sima
667063869f feat: [TS-6100] Parse create stream sql: Improve error messages when out table col name mistmatch 2025-06-18 17:14:57 +08:00
Jing Sima
00969609ed feat: [TS-6100] Parse create stream sql: treat %%trows error plan. 2025-06-17 18:44:47 +08:00
Jing Sima
9a114abe06 feat: [TS-6100] Parse create stream sql: treat %%tbname and %%trows with partition by tbname as child table. 2025-06-17 14:30:36 +08:00
Jing Sima
ca2a31d7cd feat: [TS-6100] Parse create stream sql: Fix leaks. 2025-06-17 09:26:48 +08:00
Jing Sima
2b97c86a5c feat: [TS-6100] Parse create stream sql: Remove %%n restrict. 2025-06-17 08:31:57 +08:00
Jing Sima
8ac2d095f7 feat: [TS-6100] Parse create stream sql: Add more error case and fix bugs. 2025-06-17 08:24:35 +08:00
Jing Sima
fe386d0ebb feat: [TS-6100] Parse create stream sql: Add error ut and fix bugs. 2025-06-16 15:11:41 +08:00
Jing Sima
640d1bfabb feat: [TS-6100] Parse create stream sql: Add more ut. 2025-06-14 14:41:43 +08:00
Simon Guan
2838d2f063 Merge branch '3.0' into merge/mainto3.0 2025-06-14 10:41:12 +08:00
Simon Guan
f691365426 Merge branch 'main' into merge/mainto3.0 2025-06-14 10:32:34 +08:00
Zhixiao Bao
49d89407bc
fix: bounded cols is expected for supertable insertion。 (#31351) 2025-06-12 22:30:46 +08:00
Jing Sima
703f6becc6 feat: [TS-6100] Parse create stream sql: Fix bugs and change error message. 2025-06-12 10:20:14 +08:00
Jing Sima
da193ab4b0 feat: [TS-6100] Parse create stream sql: Add more unit test. 2025-06-12 09:39:07 +08:00
Jing Sima
701af46675 feat: [TS-6100] Parse create stream sql: Refactor. 2025-06-10 16:01:43 +08:00
Jing Sima
d8210bc311 feat: [TS-6100] Parse create stream sql: Fix unit test bugs. 2025-06-10 16:01:43 +08:00
Yihao Deng
dc6dba0e06
feat: database engine (taosd) supports IPV6 (#31101) 2025-06-10 09:18:58 +08:00
Jing Sima
bc042f5a5c feat: [TS-6100] Parse create stream sql: Fix varchar schema wrong lengh. 2025-06-07 18:13:40 +08:00
Jing Sima
28f0a4db56
Merge pull request #31314 from taosdata/feat/TS-6100-smj
feat: [TS-6100] Parse create stream sql: Add stream name check
2025-06-07 11:32:02 +08:00
Jing Sima
396f0558e6 feat: [TS-6100] Parse create stream sql: Add stream name check 2025-06-07 11:29:44 +08:00
factosea
b2c646beda feat: show streams 2025-06-07 10:56:03 +08:00
Jing Sima
d7a2183dc4 feat: [TS-6100] Parse create stream sql: sql generator refactor 2025-06-07 10:16:46 +08:00
Jing Sima
b2ff90b455 feat: [TS-6100] Parse create stream sql: Fix sql generator 2025-06-06 17:06:06 +08:00
Jing Sima
4693999486 feat: [TS-6100] Parse create stream sql: Fix %%tbname wrong plan 2025-06-06 15:44:27 +08:00
dapan1121
33ca255671 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw9 2025-06-06 09:15:50 +08:00
dapan1121
bfce943ff0 enh: add more check 2025-06-06 09:09:40 +08:00
Jing Sima
0a33d13264 feat: [TS-6100] Parse create stream sql: Fix %%tbname wrong plan 2025-06-06 09:09:19 +08:00
wangmm0220
4572c0243d fix(stream): add logic for %%tbname 2025-06-05 17:26:09 +08:00
facetosea
3a700fa119 fix: count_window cols 2025-06-05 17:00:25 +08:00
Jing Sima
e9e6db382a feat: [TS-6100] Parse create stream sql: Extract condition from count window 2025-06-05 16:21:35 +08:00
Jing Sima
8c2d06f88f feat: [TS-6100] Parse create stream sql: Fix %%tbname wrong plan 2025-06-05 10:26:36 +08:00
Jing Sima
e97af52e2a feat: [TS-6100] Parse create stream sql: Fix dup col 2025-06-05 09:47:00 +08:00
Jing Sima
d9caf9410d feat: [TS-6100] Parse create stream sql: Add primary key check. 2025-06-05 09:16:30 +08:00
Jing Sima
36e09ed4ec feat: [TS-6100] Parse create stream sql: Fix _twduration wrong type. 2025-06-05 08:45:17 +08:00
Jing Sima
f929f5d39e feat: [TS-6100] Parse create stream sql: Support %%tbname. 2025-06-04 19:06:33 +08:00
facetosea
3f5d755b21 feat: count windows 2025-06-04 17:25:19 +08:00
Jing Sima
48ad39e8c3 feat: [TS-6100] Parse create stream sql: Fix trigger window check. 2025-06-04 14:35:13 +08:00
Jing Sima
29be1c4370 feat: [TS-6100] Parse create stream sql: Add trigger window check. 2025-06-03 19:01:19 +08:00
facetosea
18aa05c71c feat: count_window 2025-06-03 18:31:49 +08:00
Zhixiao Bao
41ae942dbb
feat: use csv reader to parse csv file. (#31238) 2025-06-03 17:44:10 +08:00
Jing Sima
ff873650f7 feat: [TS-6100] Parse create stream sql: Sql gen refactor and fix bugs. 2025-06-03 08:56:51 +08:00
Jing Sima
f8b312db24 feat: [TS-6100] Parse create stream sql: Sql gen refactor and fix bugs. 2025-05-30 10:48:40 +08:00
Jing Sima
cc97e7fb2c feat: [TS-6100] Parse create stream sql: Sql gen refacotr. 2025-05-30 08:53:39 +08:00
dapan1121
829921cc21 fix: start/stop stream 2025-05-28 17:27:53 +08:00
Jing Sima
e313bf7171 feat: [TS-6100] Parse create stream sql: Fix wrong tag name. 2025-05-28 17:13:46 +08:00
Jing Sima
99a241cf37
Merge pull request #31236 from taosdata/feat/TS-6100-smj
feat: [TS-6100] Parse create stream sql
2025-05-28 15:55:58 +08:00
Jing Sima
9768e724af feat: [TS-6100] Parse create stream sql: Fix missing db cfg for triggertable and create stream req's stream name. 2025-05-28 15:48:59 +08:00
dapan1121
6992932a95 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw8 2025-05-28 11:36:31 +08:00
Jing Sima
c02dc5e4e3 feat: [TS-6100] Parse create stream sql: Get trigger table's meta during collectMetaKeyFromCreateStream. 2025-05-28 09:58:12 +08:00
Jinqing Kuang
5f3d1df1fa Merge branch '3.0' into feat/TS-6100-3.0 2025-05-27 19:31:36 +08:00
dapan1121
01d2677fca Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw8 2025-05-27 19:12:25 +08:00
Jing Sima
2ed46b0bc1 feat: [TS-6100] Parse create stream sql: Stream out subtable name refactor. 2025-05-27 18:53:47 +08:00
Jing Sima
46d0932e73 feat: [TS-6100] Parse create stream sql: Support _tprev_ts/_tnext_ts/_tprev_localtime/_tnext_localtime. 2025-05-27 16:49:36 +08:00
Kaili Xu
8d361be3e7
fix: naming rule with quotation char (#31180) 2025-05-27 16:27:57 +08:00
Jing Sima
16a16c1ef9 feat: [TS-6100] Parse create stream sql: Fix basic1.py bug. 2025-05-27 15:56:02 +08:00
Jing Sima
e2147145e0 feat: [TS-6100] Parse create stream sql: Support vtable. 2025-05-27 09:39:59 +08:00
Simon Guan
309f4ffa5c Merge branch 'main' into merge/mainto3.0 2025-05-26 13:46:33 +08:00
dapan1121
c8b36ee449 fix: add watch process 2025-05-24 18:15:32 +08:00
Jing Sima
0b78a63880 feat: [TS-6100] Parse create stream sql: Fix wrong msg type. 2025-05-24 18:05:09 +08:00
Jing Sima
c812498a91 feat: [TS-6100] Parse create stream sql: Support recalculate stream and refactor of drop/start/stop stream. 2025-05-24 17:57:24 +08:00
Jinqing Kuang
18566df281 Merge branch '3.0' into kjq-merge 2025-05-24 14:56:21 +08:00
Jing Sima
be3288f5a1 feat: [TS-6100] Parse create stream sql: Fix parser error ver-3. 2025-05-24 09:54:48 +08:00
Mario Peng
4f7bfed1cf
enh(stmt2):add stmt2 log (#31171) 2025-05-23 16:36:12 +08:00
Jing Sima
365f2c7974 feat: [TS-6100] Parse create stream sql: Fix parser error ver-2. 2025-05-23 16:34:56 +08:00
Jing Sima
9fa1bf5fd5 feat: [TS-6100] Parse create stream sql: Fix out tag. 2025-05-23 14:55:12 +08:00
Jing Sima
90c1c3a9ef feat: [TS-6100] Parse create stream sql: Fix sql parser error. 2025-05-23 14:07:07 +08:00
Jing Sima
98843b05c1 feat: [TS-6100] Parse create stream sql: Fix default tag expr 2025-05-23 11:00:12 +08:00
Jing Sima
31b7882f1d feat: [TS-6100] Parse create stream sql: Fix syntax error. 2025-05-22 18:20:04 +08:00
Simon Guan
08b8673ac5
merge: from main to 3.0 branch (#31161) 2025-05-22 09:13:14 +08:00
Simon Guan
8844c2e1f3 Merge branch 'main' into merge/mainto3.0 2025-05-21 17:19:55 +08:00
wangjiaming0909
bd550258c9 new stream runner impl 2025-05-20 09:25:43 +00:00
Hongze Cheng
adea0fc530
fix: invalid time parse in compact database command (#31135) 2025-05-20 11:21:29 +08:00
Jing Sima
9ae82d7b7b feat: [TS-6100] Parse create stream sql: Fix potential heap buff overflow. 2025-05-20 09:24:28 +08:00
Jing Sima
cd3e0bf4c8 feat: [TS-6100] Parse create stream sql: Fix external window wrong plan. 2025-05-19 16:37:48 +08:00
dapan1121
12f67cd00a Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-19 09:55:47 +08:00
Jing Sima
b0e9b29ff7 feat: [TS-6100] Parse create stream sql: Use %%tbname in SELECT and WHERE clause. 2025-05-19 09:55:44 +08:00
Jing Sima
8c0fba4d91 feat: [TS-6100] Parse create stream sql: Fix partition tag error. 2025-05-19 09:55:44 +08:00
Jing Sima
7478f02b82 feat: [TS-6100] Parse create stream sql: Fix stop stream syntax error. 2025-05-19 09:53:36 +08:00
Jing Sima
0b70fd49ed feat: [TS-6100] Parse create stream sql: Use %%tbname in SELECT and WHERE clause. 2025-05-19 09:16:51 +08:00
Mario Peng
4fab91f800
fix(stmt2):memleak insert into stb (#31127) 2025-05-17 21:02:58 +08:00
Jing Sima
b97c243aba feat: [TS-6100] Parse create stream sql: Fix partition tag error. 2025-05-17 18:20:01 +08:00
dapan1121
5069aa8845 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-17 16:37:12 +08:00
Jing Sima
75812e8ef0 feat: [TS-6100] Parse create stream sql: Fix partition tbname wrong plan. 2025-05-17 14:12:26 +08:00
Simon Guan
556e426880 Merge branch 'main' into merge/mainto3.0 2025-05-17 12:55:32 +08:00
dapan1121
9a2cf31ee6 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-17 10:56:13 +08:00
Jing Sima
1d70fddab9 feat: [TS-6100] Parse create stream sql: Fix placeholder func check. 2025-05-17 09:19:57 +08:00
Jing Sima
1657fb5d63 feat: [TS-6100] Parse create stream sql: Collect tbname function to trigger partition cols 2025-05-16 18:07:58 +08:00
Jing Sima
3875d2a506 feat: [TS-6100] Parse create stream sql: No force output when first col do not have placeholder func. 2025-05-16 17:00:18 +08:00
dapan1121
d98210a7ee Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-16 14:20:45 +08:00
Jing Sima
5dc14fa622 feat: [TS-6100] Parse create stream sql: Fix wrong time range expr. 2025-05-15 18:56:51 +08:00
Mario Peng
24357375d9
fix:core (#31080) 2025-05-15 18:18:08 +08:00
Jing Sima
b45f2fd321 feat: [TS-6100] Parse create stream sql: Support period window. 2025-05-15 14:30:52 +08:00
dapan1121
0793da0526 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-15 11:48:09 +08:00
Jing Sima
d9533a959d feat: [TS-6100] Parse create stream sql: Fix external window on super table wrong plan. 2025-05-15 11:02:46 +08:00
Jing Sima
d8933b57f0 feat: [TS-6100] Parse create stream sql: Fix scan node no scanCols. 2025-05-14 14:27:07 +08:00
Jing Sima
8b45889335 feat: [TS-6100] Parse create stream sql: Fix time range condition. 2025-05-14 11:22:03 +08:00
Jing Sima
d27bef85ce feat: [TS-6100] Parse create stream sql: Fix external window plan. 2025-05-13 19:13:58 +08:00
Jing Sima
211a553d28 feat: [TS-6100] Parse create stream sql: Fix out table check. 2025-05-13 17:03:35 +08:00
Jing Sima
84579d0e74 feat: [TS-6100] Parse create stream sql: Fix wrong subplan num. 2025-05-13 15:57:36 +08:00
dapan1121
08effac8ff Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw7 2025-05-13 14:37:50 +08:00
dapan1121
8ed0f7214e enh: add create snode processing 2025-05-13 14:37:07 +08:00
Simon Guan
be6020af05 Merge remote-tracking branch 'origin/main' into merge/mainto3.0 2025-05-13 14:27:03 +08:00
Jing Sima
0c490df458 feat: [TS-6100] Parse create stream sql: Fix partition by tbname error. 2025-05-13 14:13:20 +08:00
Mario Peng
2889a8ff96
fix(stmt2):memleak (#30996) 2025-05-13 10:52:05 +08:00
taos-support
025eb154a5 feat: [TS-6100] Parse create stream sql: Add unit test. 2025-05-13 09:31:44 +08:00
dapan1121
a4869f5263 fix: compile issues 2025-05-12 17:14:35 +08:00
dapan1121
009e8aa41e Merge remote-tracking branch 'origin/3.0' into feat/TS-6100-3.0 2025-05-12 16:24:22 +08:00
Jing Sima
07026f2a0b feat: [TS-6100] Parse create stream sql: Add tsSlotId for %%trows query. 2025-05-12 11:35:44 +08:00
taos-support
ccd7d5bf53 feat: [TS-6100] Parse create stream sql: Add Unit Test. 2025-05-12 11:34:04 +08:00
Simon Guan
3cfdb304e8 Merge branch 'main' into merge/mainto3.0 2025-05-12 09:01:48 +08:00
Zhixiao Bao
338072e262
enh: add more feat for stb keep. (#31019) 2025-05-10 15:17:22 +08:00
Jing Sima
3de7adb8f8 feat: [TS-6100] Parse create stream sql: Fix out table wrong column name. 2025-05-10 14:23:04 +08:00
Jing Sima
84016904ff
fix: [TS-6445] Fix virtual tables not detecting schema changes. (#30999)
Ensure virtual tables invalidate cached schema metadata and reload it when a schema change (e.g., ALTER VTABLE) is detected. This prevents stale schema references and query errors after structural updates.
2025-05-10 10:34:54 +08:00
Jing Sima
2df77a4994 feat: [TS-6100] Parse create stream sql: Fix bugs and add create check. 2025-05-09 15:53:10 +08:00
Jing Sima
5234048e66 feat: [TS-6100] Parse create stream sql: Add out stb sversion. 2025-05-08 14:48:35 +08:00
Jinqing Kuang
b2a17d5e9f test(stream): add stream basic test script 2025-05-08 11:51:21 +08:00
Jing Sima
5ccdf6f424 feat: [TS-6100] Parse create stream sql: Fix syntax error when using %%trows. 2025-05-08 09:43:46 +08:00
pengrongkun94@qq.com
cd9feaffab fix:debug 2025-05-07 11:06:25 +08:00
pengrongkun94@qq.com
245dc41644 feat:fetch pVgInfo from server 2025-05-07 11:06:02 +08:00
pengrongkun94@qq.com
2043a638e1 fix:rewrite tbname node type 2025-05-07 11:05:42 +08:00
pengrongkun94@qq.com
c64e1ca34b feat: add client parse 2025-05-07 11:05:24 +08:00
taos-support
be3987e6e9 feat: [TS-6100] Process SCMCreateStreamReq : Add unit test and fix bugs. 2025-05-07 09:55:12 +08:00
Jing Sima
0a8f660f97 feat: [TS-6100] Process SCMCreateStreamReq ver-6 2025-05-06 19:13:27 +08:00
Jing Sima
c85e400f76 feat: [TS-6100] Process SCMCreateStreamReq ver-5
1. support time range expr in stream query.
2. support where condition in stream notify.
2025-04-30 17:37:34 +08:00
dapan1121
c7c0d9e8b0 fix: stream vgroup map issue 2025-04-29 17:03:52 +08:00
Jing Sima
6ae805bb7a feat: [TS-6100] Process SCMCreateStreamReq ver-4
support placeHolderBitmap and interval offset in stream trigger.
remove useless code.
2025-04-29 15:19:30 +08:00
dapan1121
b07fafa27f fix: stream hb rsp length issue 2025-04-29 11:02:56 +08:00
Jing Sima
b5558c05c3 feat: [TS-6100] Process SCMCreateStreamReq ver-3 2025-04-28 16:44:56 +08:00
Jing Sima
22ebaece7c feat: [TS-6100] Process SCMCreateStreamReq 2025-04-28 11:28:33 +08:00
Jing Sima
358e8b9e1c feat: [TS-6100] Process SCMCreateStreamReq 2025-04-27 20:10:54 +08:00
Simon Guan
16f90d4de1 Merge branch 'main' into merge/mainto3.0 2025-04-27 19:16:46 +08:00
dapan1121
992042cd00 fix: compile issues 2025-04-27 18:36:08 +08:00
dapan1121
78dbb66af4 Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw3 2025-04-27 17:58:40 +08:00
dapan1121
3793eb2835 enh:add hb msg serilization 2025-04-27 17:53:12 +08:00
Jing Sima
e81a59b2e7 feat: [TS-6100] Fix compile error. 2025-04-27 09:08:26 +08:00
Jing Sima
9d3ded13d0 fix: [TS-6100] Remove useless code and fix bugs 2025-04-24 18:48:28 +08:00
Jing Sima
26d4c933a2 fix: [TS-6100] Fix compile on mac and add toJson/jsonTo func. 2025-04-24 10:16:29 +08:00
Jing Sima
bd5aeda005
fix: [TD-34631] Fix timetruncate crash when using year as time unit in where clause. (#30863) 2025-04-24 09:56:14 +08:00
dapan1121
330cf9982d fix: compile issues 2025-04-24 09:11:54 +08:00
Jing Sima
c1cb4029a1 feat: [TS-6100] Build create request for create stream. 2025-04-21 17:47:15 +08:00
Simon Guan
e8dd9daf11 Merge branch 'main' into merge/mainto3.0 2025-04-19 14:33:11 +08:00
freemine
6267763e85
Freemine.cmake.3.0 (#30663)
* chore(ci): with cmake verbose, temporarily

* chore(cmake): prefer Threads::Threads

* fix(cmake): debug building gtest on ubuntu 20.04 for the moment

* fix(cmake): try adding Threads::Threads

* fix(cmake): debug building gtest on ubuntu 20.04 for the moment

* fix(cmake): revert taosd-ci-build.yml

* fix(cmake): debug building on ubuntu 20.04 for the moment

* fix(cmake): debug building on ubuntu 20.04 for the moment

* fix(cmake): debug building on ubuntu 20.04 for the moment, adding dl right after DEP_ext_libuv

* fix(cmake): debug building on ubuntu 20.04 for the moment, try full run

* fix(cmake): fix building on ubuntu 20.04

* fix(cmake): dl is only valid in non-windows platform

* fix(cmake): dl order

* refactor(cmake): adjust option/cache variables for external dependencies

* refactor(cmake): mv patch files from contrib/ to cmake/

* refactor(cmake): typo

* refactor(cmake): adding cache on ci

* refactor(cmake):
1. ext_lzma2 is only used by Linux
2. fix bug in taosd-ci-build.yml

* enh: adding functionalities of build.sh

* fix(ci): `cmake -B` shall maintain consistency

* refactor(cmake): LOCAL_REPO/LOCAL_URL as cache variable

* refactor(cmake): taosadapter to be built in main build directory rather than .externals

* refactor(cmake): adding rpath for taosadapter, linux now

* refactor(cmake): adding rpath for taosadapter, macos now

* chore(cmake): remove some comments

* debug(ci): bypass TD_EXTERNALS_USE_ONLY

* debug(ci): bypass .externals caching for the moment

* fix(cmake): temporarily use taosadapter/main branch because this branch(freemine.cmake.3.0) has not include taos_fetch_fields_e from upstream

* refactor(cmake): clean GIT_TAG/GIT_SHALLOW pairs

* enh(ci): use build.sh rather than hard-coded in taosd-ci-build.yml, linux for now

* debug(ci): undefined __isoc23_strtoull

* debug(ci): benchmarkTest

* debug(ci): what if use_only = off

* debug(ci): remove .externals to make a refresh build

* debug(ci): back to cache, and ls files of gtest

* debug(ci): remove find coz {} not escaped

* debug(ci): cache key seems missing "matrix.os"

* refactor(ci): fixed cache key and reopen macos/windows

* chore(ci): literally -j4

* chore(ci): Trigger GitHub Actions re-run

* chore(ci): Trigger GitHub Actions re-run

* fix(ci): typo

* chore(ci): JOBS calculated by build.sh itself

* refactor(ci): enable WEBSOCKET in build.sh by default

* refactor(ci): enable WEBSOCKET in build.sh by default, macOS

* chore(cmake): remove obsoletes

* refactor(ci): stop service before running taosd

* chore(ci): `./build.sh install` just install TDengine, you will have to start taosd by `./build.sh start`

* refactor(cmake): adding source code found on http://emfisis.physics.uiowa.edu/Software/C/libargp/

* refactor(cmake): moving jansson/snappy/avro to .externals, and porting BUILD_TEST/WEBSOCKET on Windows

* refactor(cmake): porting linux

* refactor(cmake): porting macos
1. check argp.h
2. re-enable building taosdump

* refactor(cmake): porting linux
1. adjust CMAKE_C/CXX_FLAGS

* refactor(cmake): porting windows, adjust CMAKE_C/CXX_FLAGS

* refactor(cmake): use cmake_parse_arguments in macro INIT_EXT

* refactor(cmake): format ci cache directives

* refactor(cmake): adding comments for ci externals-cache directives

* refactor(cmake): adding check_env.cmake to checking libraries installed on the system

* refactor(cmake): porting linux, make homebrew-installed-libs available

* refactor(cmake): remove BYPRODUCTS from INIT_EXT macro

* refactor(cmake): INC_DIR is oneValueArg

* refactor(cmake): taosdump depends on ext_xz(LZMA)

* refactor(cmake): add copy_pthreadVC3 target on windows

* refactor(cmake): mv taosd-ci-build.yml to tdengine-build.yml

* chore(ci): try to fix yml syntax error

* refactor(cmake): use brew --prefix to get HomeBrew's install path

* refactor(cmake): typo

* debug(ci): build and cache externals first

* debug(ci): adding -Wno-stringop-overread for the moment

* debug(ci): make Threads::Threads public from os target

* debug(ci): make os public

* debug(ci): re-enable start and test

* debug(ci): let it go even if taosBenchmark failed

* debug(ci): copy logic from TDengine/main

* debug(ci): try ./build.sh start/test

* debug(ci): revert to original simple test logic in ci, taosBenchark/taos

* chore(cmake): code-convention and ci-logic

* debug(ci): show versions

* debug(ci): forcefully use specific GIT_TAG by commit-id for taos-connector-rust.git and taosadapter.git

* refactor(cmake): remove empty lines

* debug(ci): typo

* debug(ci): set supportVnodes to 256 before starting taosd

* debug(ci): fix: sudo and pipe

* debug(ci): cat /etc/taos/taos.cfg to check if supportVnodes effective

* debug(ci): cat forceReadConfig to taos.cfg

* debug(ci): adding taos -s "show dnodes"

* debug(ci): print more info

* debug(ci):
1. git log .... in an independant step
2. sleep 3 deliberately

* build: release ver-3.3.6.0

* chore(ci): comment and remove unnecessary code

* refactor(ci): cleanup tools/CMakeLists.txt
1. remove unnecessary or uneffective codes
2. better approach to pass compile flags to go

* chore(cmake): remove unnecessary code

* merge(cmake): porting linux

* merge(cmake): porting macOS

* merge(cmake): porting windows

* merge(cmake): pitfall fix: use literal format string instead

* merge(cmake): ver-3.3.6.0 for both taosadatper and taosws

* merge(cmake): adjust ci for debug purposes

* merge(cmake): add dependenices to make sure native built

* merge(main): link os

* merge(main): revert to main

* chore(cmake): remove freemine'd comments

* chore(cmake): make github ci to run with empty change

* refactor(cmake): remove unnecessaries

* refactor(cmake): remove unnecessaries

* chore(cmake):
1. remove taosudf in build.sh::do_purge
2. packaging taosBenchmark

* chore(cmake):
1. typo corrections
2. add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to bypass compatibility check imposed by latest cmake since 4.0

* chore(cmake): show cmake version

* chore(cmake): add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to bypass compatibility check imposed by latest cmake since 4.0

* chore(cmake): typo

* chore(cmake): remove unnecessaries

* cmake: debug enterprise compilation

* refactor: preparatory work before merging the freemin PR

* refactor(cmake): revert to d91205594a

* refactor(cmake): optimize by adjusting cache key

* chore(cmake): make github ci to run with empty change

* refactor(cmake): move libs3 and azure to external.cmake

* refactor(cmake): porting macOS

* refactor(cmake): move cos to external.cmake

* refactor(cmake): bypass s3/azure/cos on windows for the moment

* refactor(cmake): try find_package(Threads)

* refactor(cmake): add dl/pthread in libs3

* refactor(cmake): enable s3/azure for the moment, hard-coded

* refactor(cmake): adjust BUILD_WITH_ANALYSIS option

* refactor(cmake):
1. enum AVROTYPE => enum enAVROTYPE
2. remove INSTALL(CODE ...) from tools/taos-tools/CMakeLists.txt

* refactor(cmake): portint macOS and typo

* refactor(cmake): ticking external cache key to force refresh external building

* refactor(cmake): remove obsoletes

* refactor(cmake): remove obsoletes

* refactor(cmake): remove obsoletes, contrib/deps-download related

* refactor(cmake): adding build.bat, and use build.bat in .github/workflows/tdengine-build.yml

* refactor(cmake):
1. call .\build.bat
2. remove POST_BUILD which is not valid in this signature of add_custom_command

* refactor(ci): use 'NMake Makefiles JOM'

* refactor(ci): typo

* refactor(ci): debug

* refactor(ci): debug

* refactor(ci): debug

* refactor(ci): use call on windows

* refactor(cmake): move utils/TSZ to contrib/TSZ

* chore(cmake): make github ci to run with empty change

* refactor(cmake): mv cmake.* -> *.cmake and related in CMakeLists.txt

* refactor(cmake): debugging integrating community

* refactor(cmake): debugging integrating community

* chore(cmake): make github ci to run with empty change

* refactor(cmake): revert geos.git back to 3.12.0

* refactor(cmake): revert doc/** to main branch

* refactor(cmake): revert tests/** to main branch, except tests/taosc_test/CMakeLists.txt

* refactor(cmake): revert test/cases/** to main branch

* refactor(cmake): revert test/docs/** to main branch

* refactor(cmake): revert tools/taos-tools/deps/{avro,jansson,libargp,snappy,zlib-1.2.13} to main branch, which need to be removed later

* refactor(ci): revert .github/workflows/{deploy-case-docs.yml,tdengine-doc-build.yml} to main branch

* refactor(cmake): revert tcommon.h and related to main branch

* refactor(cmake): revert test/* stuffs back to main branch

* refactor(cmake): revert libuv.git back to v1.49.2

* refactor(cmake): revert .h/.c and related to main branch

* refactor(cmake): typo format string

* refactor(cmake): typo correction, incorrect use of macro `assert`

* refactor(cmake): adding /wd4028 to bypass thttp.c under enterprise build for the moment

* refactor(cmake):
1. adding some rules to .gitignore for the last resort to save
2. adding source files manually to source/libs/parser/CMakeLists.txt to exclude potential sql.c generated by old build system

* refactor(cmake): add -Wno-unused-result for the moment

* refactor(cmake): adjust target dependencies

* refactor(cmake): tweaking building of mxml

* refactor(cmake): adjust externals CMAKE_ARGS to save compilation time

* refactor(cmake): temporarily use tomchon-patch-3

* refactor(cmake): temporarily adding dumpbin directives

* refactor(cmake): adding NODEFAULTLIB temporarily for debugging purpose

* refactor(cmake): adding NODEFAULTLIB:libcpmt temporarily for debugging purpose

* refactor(cmake): adding NODEFAULTLIB:cpmt temporarily for debugging purpose

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* refactor(ci): use freemine.debug branch for the moment

* refactor(ci): revert back to use run-tests-on-windows.yml of tomchon-patch-3 branch

* chore(cmake): make github ci to run with empty change

* refactor(cmake): remove temporary debug directives

* refactor(cmake): move cmake_policy(..CMP0135..) to the root of this project

* refactor(cmake): Remove temporary debugging conditional and restore original logic

* chore(cmake): adding -B in army tests

* chore(cmake): make github ci to run with empty change

* chore(cmake): revert: adding -B in army tests

* refactor(cmake):
1. use ver-3.3.6.3 of taosadapter
2. pitfall fix: do not link with taosws for taos shell

* refactor(cmake): revert taosadapter to ver-3.3.6.0

* chore(cmake): adding logging message in more detail

* chore(cmake): adding logging message in more detail

* chore(ci): debugging by using ls -l

* chore(ci): typo

* chore(ci): typo

* refactor(cmake): revert to remove debug code, and taosadapter to ver-3.3.6.3

* refactor(cmake): remove DEP_ext_taosws

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): typo correction: utils/test/c/sml_test.c

* debug(cmake): test cases debug

* chore(cmake): make github ci to run with empty change

* chore(ci): using tomchon-patch-3 branch for run-tests-on-linux for the moment

* chore(cmake): make github ci to run with empty change

* debug(test): revert utils/test/c/sml_test.c back to tdengine/main branch

* debug(test): adding VERBOSE=1 and gcc --version

* debug(test): revert tests/parallel_test/cases.task back to tdengine/main branch

* debug: add log in run_case.sh

* fix: test log

* fix: docker run privileged

* tes: add debug test in  cases.task

* refactor(cmake): remove ref to \contrib\<dep-name> and ~/.cos-local-{1,2} from CMakeLists.txt(s)

* refactor(cmake): make taosudf link with libtaos.so

* chore(cmake): fix compiler warning as error problem

* refactor(cmake): revert 7d7f03832d

* chore(cmake): only udf.sim and udfpy.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug only udf.sim for the moment

* debug(ci): debug only udf.sim for the moment, using tee

* debug(ci): debug only udf.sim for the moment, revert using tee

* debug(ci): debug only udf.sim for the moment, adding TAOS_LIB again

* debug(cmake): adding -rdynamic for the moment

* debug(cmake): re-adding udfpy.sim

* debug(cmake): do NOT run with Sanitizer for udfpy.sim for the moment

* chore(cmake): revert cases.task, and remove ubuntu-20.04 from tdengine-build.yml

* refactor(cmake): using ENABLE_EXPORTS to export symbols in taosudf

* chore(cmake): make github ci to run with empty change

* chore(cmake): remove stuffs for debug purpose and revert

---------

Co-authored-by: support-platform <it@taosdata.com>
Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: haoranchen <haoran920c@163.com>
2025-04-19 14:03:29 +08:00
Jing Sima
9498a6271d
fix: [TS-6383] Fix drop vtable error. (#30820) 2025-04-19 11:31:40 +08:00
Simon Guan
888fed8699 Merge branch 'main' into merge/mainto3.0 2025-04-16 19:34:20 +08:00
wangjiaming
7ba3fefde2
fix fill range check for natural units (#30789) 2025-04-16 15:59:55 +08:00
Simon Guan
7437dd026e Merge branch '3.0' into merge/mainto3.0 2025-04-11 13:47:45 +08:00
xinsheng Ren
7376e8401f
fix: when there are offline dnodes, "show dnode * variables" does not return any output. (#30667) 2025-04-11 11:21:55 +08:00
Simon Guan
50d3705bea
enh[TS-6318]: changed the keyword for composite primary keys from "primary key" to "composite key" (#30741) 2025-04-10 20:31:35 +08:00
freemine
9897d85f86
enh(test): adding TD_ALWAYS_ASSERT macro for test cases to use (#30739) 2025-04-10 16:52:55 +08:00
Simon Guan
e777dc5e9f
fix: the REPLICA parameter supports plural forms when used to create and alter a database (#30732) 2025-04-10 16:48:06 +08:00
Simon Guan
0001747378
enh: allow ordinary users to execute the "show disk_usage" command. (#30700) 2025-04-08 21:00:47 +08:00
Mario Peng
abd5830ef4
fix:stmt set tags memleak (#30609) 2025-04-02 19:29:30 +08:00
xinsheng Ren
463430ab15
enh: [TS-6195] support cols in stream (#30580) 2025-04-02 11:31:08 +08:00
Jing Sima
88f2e71dc4
fix: [TS-6094] Fix virtual table get wrong origin table's meta (#30586) 2025-04-02 11:29:34 +08:00
Jing Sima
f84f04398d
fix: [TS-4897] Support query stables cross databases and fix potential deadlock. (#30507) 2025-03-28 10:07:08 +08:00
Mario Peng
9d86e06703
fix : geometry check NULL for interlace mode (#30514) 2025-03-27 10:07:45 +08:00
Zhixiao Bao
df16c95b15
fix(csv): fix lost some ctbs while create table using csv file. (#30483) 2025-03-26 15:44:22 +08:00
Simon Guan
9a89db55ca
enh: allow ordinary users to execute the “show anodes” command. (#30464) 2025-03-25 20:17:16 +08:00
Mario Peng
ce5e0d6c0a
fix(stmt2):sort stmt2 bind rowkey (#30309) 2025-03-24 14:43:13 +08:00
Jing Sima
028c4d793f
fix: [TS-4897] Fix create child table after modify super virtual table failed (#30317) 2025-03-23 17:26:03 +08:00
Mario Peng
8cfb45d257
fix: insert into ntb get fields problem (#30370) 2025-03-23 16:40:05 +08:00
Mario Peng
d3f537275f
fix(stmt2):stmt2 get fields return wrong when tag is value(3.3.6) (#30308)
* fix: add case

* fix: stmt2 get fields return wrong when tag is value

* enh: replace preCtb bool to flag,handle more situation

* fix: some unit test error

* diff: add case and fix some problem

* fix: remove async test, handle in TD-34077

* fix: review

---------

Co-authored-by: Simon Guan <slguan@taosdata.com>
2025-03-22 21:13:47 +08:00
Jing Sima
818bea5568
fix: [TD-34074] Forbid virtual table in tq and stmt and forbid supertable query's origin table from different databases.
fix: [TD-34074] Forbid virtual table in tq and stmt and forbid supertable query's origin table from different databases.
2025-03-20 22:42:10 +08:00
Simon Guan
e5a1539c6d
Merge pull request #30307 from taosdata/fix/TS-5467-3.0
fix(stream): fix stream processing for virtual tables
2025-03-20 22:24:45 +08:00
Jinqing Kuang
4d97d691cf fix(stream): add test cases for vtable stream processing 2025-03-20 18:57:58 +08:00
dapan1121
2c8bc8b097 fix: modify vtable src table number 2025-03-20 14:36:48 +08:00
dapan1121
274cd443ae fix: add stream checking 2025-03-20 11:48:17 +08:00
liuyao
fac36002c1
ci(stream): add ci and fix issue (#30270)
* ci(stream): add ci and fix issue

* ci: adj test

* ci: add test and fix issue

* ci: adj test

* ci(stream): add test for fill operator and fix issue

* fix: fix issue

* fix: fix issue

* fix: adjust defalut rec value
2025-03-20 10:34:31 +08:00
Jing Sima
ccaa0b91ae
feat: [TS-4897] Add more test and fix bugs. (#30208)
* feat: [TS-4897] Fix state window wrong res when all state col is NULL.

* fix: [TD-34074] Forbid decimal type in virtual table.
2025-03-19 17:15:17 +08:00
Pan Wei
0cb0e109a7
enh: add more cases for constant join (#30225)
* fix: add more cases and fix issues

* enh: add more test cases

* enh: add more test cases

* fix: memory leak issue

* enh: add view cases and fix order by issue

* enh: add document description
2025-03-19 16:50:44 +08:00
WANG MINGMING
3fafecb242
feat[TS-6137]: support sliding in force_window_close (#30203)
* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

* feat(stream): force window close support interval sliding

* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
2025-03-19 10:22:06 +08:00
Simon Guan
d02196a231
refactor: adjust some logs (#30245)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* docs: update keywords

* fix: compile errors in windows

* docs: minor changes

* docs: minor changes

* refactor: minor changes

* docs: fminro changes

* docs: format

* refactr: remove uncessory logs

* docs: format doc
2025-03-18 17:55:36 +08:00
Simon Guan
ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID (#30195)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* fix: compile errors in windows

* refactor: minor changes
2025-03-18 16:21:44 +08:00
WANG MINGMING
3bc6635de3
feat[TS-6115]: support deletion of topics with active consumers. (#30232)
* feat[TS-6115]: drop topic & consumer group in force

* feat[TS-6115]: drop topic & consumer group in force

* feat[TS-6115]: drop topic & consumer group in force
2025-03-18 14:11:00 +08:00
WANG MINGMING
930b57b770
feat: support fill_history 1 async when creating stream (#30185)
* feat:[TS-5617]use last_row cache mode if creating stream in fill_history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* fix: heap use after free

* feat: add log

* fix: ci case error

* fix: compile error in windows

* fix: ci case error

* fix: heap user after free

* fix: memory leak

* fix: ci case error

* fix: ci case error

* fix: ci case error

* feat: support fill_history 1 async when creating stream

* feat: support fill_history 1 async when creating stream

* fix: compile error

* feat[TS-5617]: support fill_history 1 async when creating stream

---------

Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-18 10:01:33 +08:00
Haojun Liao
dfe32225de chore: merge main. 2025-03-17 14:51:11 +08:00
wangjiaming
40d32e16b0
fix(TS-6117): fix drop table name with star crash (#30204) 2025-03-17 14:13:03 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
wangjiaming
f50fcb85b8
feat(decimal): support decimal data type (#30060)
* decimal: create table

* decimal: add test case decimal.py

* decimal: add decimal.c

* support input decimal

* decimal test

* refactor svalue

* fix test cases

* add decimal unit test

* add decimal test cmake

* support insert and query decimal type

* define wide integer, support decimal128

* support decimal128 divide

* set decimal type expr res types

* scalar decimal

* convert to decimal

* fix decimal64/128 from str and to str

* fix decimal from str and decimal to str

* decimal simple conversion

* unit test for decimal

* decimal conversion and unit tests

* decimal + - * /

* decimal scalar ops and comparision

* start to refactor GET_TYPED_DATA

* support decimal max func, cast func

* refactor GET_TYPED_DATA interface

* decimal scalar comparision

* start to implement sum for decimal

* support sum and avg for decimal type

* decimal tests

* add decimal test

* decimal add test cases

* decimal use int256/int128

* decimal testing

* fix decimal table meta and add tests for decimal col streams

* fix create stream and create tsma

* test insert decimal values

* decimal from str

* test decimal input

* test parse decimal from string

* add taos_fetch_field_e api

* decimal insert tests

* test decimal operators

* decimal operator test

* feat:support decimal in raw block

* decimal operator tests

* decimal test

* feat:support decimal in raw block

* feat:support decimal in raw block

* feat:add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* decimal test operators

* decimal operator test

* test decimal operators

* test decimal compare operators

* decimal unary operator test

* decimal col with decimal col oper test

* test decimal col filtering

* fix decimal float operator test

* decimal test where filtering

* fix decimal filtering

* fix decimal order by

* fix decimal op test

* test decimal agg funcs

* test decimal functions

* remove assert

* fix ci build for ret check

* fix decimal windows build

* fix ci ret check

* skip decimal ret check

* skip decimal ret check

* fix decimal tests

* fix decimal ci test

* decimal test

* fix(tmq): heap user after free

* fix(tmq): double free

* fix(tmq): double free

* fix decimal tests

* fix(decimal): decimal test ci build

* fix(decimal): windows build

* fix(decimal): decimal test build

* fix(decimal): fix decimal build and tests

* fix(decimal): fix decimal tests

* fix(decimal): fix taos_fetch_fields_e api

* fix(decimal): fix decimal taos_fetch_fields_e api

* fix(decimal): rebase 3.0

* fix(decimal): fix decimal functions

* fix(decimal): fix decimal test case memory leak

* fix(decimal): fix decimal tests

* fix(decimal): fix decimal test case

* fix(decimal): fix decimal tests

* feat(decimal): fix unit tests

* feat(decimal): fix deicmal unit test

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 18:08:07 +08:00
Zhixiao Bao
af7e34e189
feat(keep): support keep on super table level. (#30097)
* Feat: support use keep while create super table.

* Test(keep): add test for create super table with keep option.

* Feat(keep): Add tmsg for create keep.

* Feat(keep): support alter table option keep.

* Fix(keep): Add baisc test for alter table option.

* Fix(keep): memory leek.

* Feat(keep): add keep to metaEntry&metaCache and fix earliestTs with stn keep.

* Test(keep): add some cases for select with stb keep.

* Fix: fix ci core while alter stb.

* Feat(keep): delete expired data in super table level.

* Feat: remove get stb keep while query.

* Fix : build error.

* Revert "Fix : build error."

This reverts commit 0ed66e4e84.

* Revert "Feat(keep): delete expired data in super table level."

This reverts commit 36330f6b4c.

* Fix : build errors.

* Feat : support restart taosd.

* Fix : alter table comment problems.

* Test : add tests for super table keep.

* Fix: change sdb stb reserve size.

* Test: add more tests.

* Feat: Disable normal tables and sub tables from setting the keep parameter

* Fix: add more checks to avoid unknown address.

* Docs: Add docs for stable keep.

* Fix: some review changes.

* Fix: review errors.
2025-03-14 16:10:13 +08:00
Mario Peng
f5a339f03e
enh(stmt2): [TD-33660] interlace mode support auto create table (#30084)
* enh: remove interlace autocreate tb limit

* enh: autocreate tb with single ctb

* enh: multi-insert in one ctb

* enh: Function realization

* fix: some unit test error

fix: stmt1 unit test

* fix: review and autoCreateTb & interlace support insert into stb syntax

* fix: insert into tags fixed value auto create table

* fix: remove a wrong test

* fix: adapter segment fault

* fix: adaptor core

* fix: get fields make interlace error

* fix: adapter core problem 2

* fix: multi bind exec invalid message problem
2025-03-14 14:13:26 +08:00
WANG MINGMING
3d053e2c9b
feat(stream): optimize client logic of creating stream if with history (#30059)
* feat:[TS-5617]use last_row cache mode if creating stream in fill_history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* fix: heap use after free

* feat: add log

* fix: ci case error

* fix: compile error in windows

* fix: ci case error

* fix: heap user after free

* fix: memory leak

* fix: ci case error

* fix: ci case error

* fix: ci case error

---------

Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 13:55:52 +08:00
Kaili Xu
13f9bddf3d
feat: support customized taos/taosd (#29736)
* feat: support TDAcoreOS

* chore: cmake options for TD_ACORE

* chore: disable lemon for TD_ACORE

* chore: add lzma2 and msvcregex

* chore: cmake for lzma2

* chore: adapt for TD_ACORE

* chore: adapt strcasecmp for TD_ACORE

* chore: adapt for geos/threadName

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE termio

* chore: refact transComm.h for TD_ACORE

* chore: refact transportInt.h for TD_ACORE

* chore: refact trans.c for TD_ACORE

* chore: refact trpc.h for TD_ACORE

* chore: refact transCli.c/transComm.c/transSvr.c for TD_ACORE

* chore: refact uv.h for TD_ACORE

* chore: refact geosWrapper.h for TD_ACORE

* chore: refact token/builtins/udf for TD_ACORE

* chore: refact rocks for TD_ACORE

* chore: refact tsdbCache.c for TD_ACORE, use LRU cache for last/last_row, not use rocksdb

* chore: refact FAIL to _ERR to solve conflicts for TD_ACORE

* chore: restore lemon.c/lempar.c

* chore: support build lemon for TD_ACORE

* chore: refact trpc and siginfo_t for TD_ACORE

* chore: refact timezone for TD_ACORE

* chore: refact lz4 for TD_ACORE

* chore: refact TD_ACORE to make compile pass

* chore: code optimization for TD_ASTRA

* feat: support run taos with taosd integrated

* feat: support invoke taos shell

* feat: support invoke taos shell

* feat: support invoke taos shell

* chore: code optimization

* chore: fix undefined reference problem os TD_ASTRA

* chore: resolve compile problem for TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix getpid

* chore: fix typo

* chore: set stack size and ajust min pack size for TD_ASTRA

* chore: fix pthread create parameters

* chore: chmod adapt for TD_ASTRA

* chore: fix trans compile problem

* chore: adapt chmod for TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: conditional compile option

* chore: adapt for TD_ASTRA

* chore: adjust taosPId and msvcregex for TD_ASTRA

* chore: log dir separator for wal build name

* chore: fix type of pointer parameter

* chore: fix compile problem of tsdbGetS3Size

* enh: get last ver from wal log for TD_ASTRA

* enh: refact wal meta ver

* enh: refact wal meta ver

* fix: typo of taosUcs4Compare

* enh: process return value of CI

* chore: more code for TD_ASTRA adaption

* chore: return value of taosCloseFile in walMeta.c

* chore: fix compile problem

* chore: fix compile problem of TD_ASTRA

* fix: update macro for tq and stream task

* chore: code optimization for TD_ASTRA

* chore: restore create log and init cfg interface

* chore: restore strncasecmp and strcasecmp

* fix: adjust the field position of SDataBlockInfo

* fix: pragma pack min size

* fix: pragma pack min size

* chore: more code for TD_ASTRA adaption

* fix: type of parameters

* chore: adapt strncasecmp and strcasecmp for TD_ASTRA

* chore: restore interface of init log

* enh: pack push optimization

* fix: taos init cfg

* add astra support

* fix: fetch the value of suid

* chore: switch of  build with udf

* add temp code

* chore: more code for TD_ASTRA adaption

* chore: add macro ERRNO to replace errno

* chore: bytes align for TD_ASTRA

* fix: remove obsolete codes

* enh: support USE_UDF macro

* fix compile error

* fix: resolve redefinition problem

* fix: compile problem of log.cpp

* fix: compile problem of osTimezone

* fix: resolve compile problem of udf

* fix: pragma definition on windows

* fix: ucs4 and stpncpy for TD_ASTRA

* fix: memory align problem for TD_ASTRA

* enh: solve memory leak for TD_ASTRA_RPC

* fix: compile problem of taosSetInt64Aligned

* fix: restore mndSubscribe.c

* fix: scalar for udf

* chore: code adaption for TD_ASTRA

* chore: code optimization for TD_ASTRA

* fix: typo of add definition

* fix: typo of macro in tudf.h

* chore: remove void to make CI pass

* enh: move macro from cmake.platform to cmake.options

* enh: byte align for hash node and error code

* chore: restore the size for lru cache

* enh: restore some code about pack push

* chore: restore the pack push in tmsg.h

* fix: add macro of pack pop for windows

---------

Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 13:32:13 +08:00
dapan1121
1fc0efee83 fix: join condition issue 2025-03-13 11:46:51 +08:00
dapan1121
d997c144a1 Merge remote-tracking branch 'origin/3.0' into feat/TS-5992 2025-03-12 14:16:22 +08:00
xinsheng Ren
4edddd6038
Merge branch '3.0' into enh/TS-5650/showLike 2025-03-07 10:29:35 +08:00
dapan1121
364381c6f1 fix: constant join issues 2025-03-06 19:27:09 +08:00
Simon Guan
c00d772492
Merge pull request #29649 from taosdata/feat/TS-5927-long-password
feat:[TS-5927]long-password
2025-03-06 17:25:48 +08:00
Simon Guan
9023f2f505
Merge pull request #30022 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2025-03-05 19:44:38 +08:00
Simon Guan
f9681cce1d
Merge pull request #30000 from taosdata/enh/3.0/TD33165
enh(insert): use cache to improve auto create table performance.
2025-03-05 18:52:22 +08:00
Simon Guan
34120a38c5 Merge branch '3.0' into merge/mainto3.0 2025-03-05 18:12:55 +08:00
Simon Guan
292b0cb317 Merge branch 'main' into merge/mainto3.0 2025-03-05 18:10:31 +08:00
dongming chen
e5fb75797a
Merge branch '3.0' into feat/TS-5927-long-password 2025-03-05 12:15:12 +08:00
xiao-77
21269eb366 Fix(insert): keep product behavior consistent with previous. 2025-03-05 09:45:43 +08:00
xiao-77
7f5d687882 Enh(insert): use mini cache in stmt to improve insert speed. 2025-03-04 20:10:40 +08:00
xiao-77
d03423448a Merge branch 'enh/3.0/TD33165' of https://github.com/taosdata/TDengine into enh/3.0/TD33165 2025-03-04 15:11:00 +08:00
xiao-77
69e88f9f5c Fix(stmt): skip stmt while use ctg cache. 2025-03-04 15:10:47 +08:00
Zhixiao Bao
45d05761ae
Merge branch '3.0' into enh/3.0/TD33165 2025-03-04 14:46:51 +08:00
xiao-77
be9732d774 Fix(insert):insert into an exist ctable in another stable. 2025-03-04 14:39:14 +08:00
Simon Guan
1a9f75e663 Merge branch '3.0' into fix/internal 2025-03-04 13:47:03 +08:00
xiao-77
b5ea56d809 Test(insert):Add some test for auto create. 2025-03-04 11:12:41 +08:00
xiao-77
e2b18a7182 End(insert):Use cache to improve auto create table performance. 2025-03-04 10:04:58 +08:00
dapan1121
5204f97a4b fix: add test cases 2025-03-03 19:31:43 +08:00
Haojun Liao
f563a35b3f fix(stream):check the maximum allowed forecast rows, add one test case, and do some internal refactor. 2025-03-03 17:27:05 +08:00
Simon Guan
7326e3d8bc Merge branch '3.0' into merge/mainto3.0 2025-03-03 14:01:51 +08:00
Simon Guan
6826edf5e0 Merge branch 'main' into merge/mainto3.0 2025-03-03 14:01:43 +08:00
Simon Guan
d7207861bb Merge remote-tracking branch 'origin/3.0' into fix/internal 2025-03-03 10:43:07 +08:00
Simon Guan
568ad58079
Merge pull request #29950 from taosdata/enh/3.0/TD-32686
Enh(stmt2)[td-32686] add row format bind
2025-03-03 10:28:59 +08:00
factosea
6da2e6f547 fix: test case 2025-03-02 22:48:21 +08:00
factosea
e91014f807 feat: show variables like 2025-03-02 22:48:05 +08:00
Simon Guan
c0932e3ce0 refactor: adjust some logs 2025-02-28 23:22:38 +08:00
Simon Guan
43ca6d5f9e refactor: adjust some logs 2025-02-28 16:49:46 +08:00
pengrongkun94@qq.com
703a9924a4 fix:review 2025-02-28 16:16:15 +08:00
facetosea
1462f64ce2 fix: different lenth in uion 2025-02-28 14:22:53 +08:00
Hongze Cheng
0d2ca243b1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-27 17:18:33 +08:00
Simon Guan
5d777f9bcf
Merge pull request #29654 from taosdata/feat/TS-5805-force-assign-leader
Feat/ts 5805 force assign leader
2025-02-27 15:42:27 +08:00
Hongze Cheng
541f98037f Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-27 14:06:53 +08:00
Simon Guan
7676a02979 Merge branch '3.0' into fix/internal 2025-02-27 13:48:54 +08:00
Simon Guan
ceb6e49ebb
Merge pull request #29956 from taosdata/feat/TS-5776
feat[TS-5776]: process return value
2025-02-27 13:40:57 +08:00
wangmm0220
ec3bb5b742 feat:[TS-5776]process return value 2025-02-27 10:15:38 +08:00
Simon Guan
7f10288df1 Merge branch '3.0' into fix/internal 2025-02-27 10:04:34 +08:00
Simon Guan
76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
pengrongkun94@qq.com
536042caae Merge remote-tracking branch 'origin/3.0' into enh/3.0/TD-32686 2025-02-26 20:05:27 +08:00
pengrongkun94@qq.com
10f3a388f2 add row format bind control argument 2025-02-26 20:04:33 +08:00
dapan1121
e41cd44c51 enh: add merge join primary expr type 2025-02-26 16:30:36 +08:00
dongming chen
0ce087f2b3
Merge branch '3.0' into feat/TS-5805-force-assign-leader 2025-02-26 13:57:36 +08:00
pengrongkun94@qq.com
8cf363fbf3 Merge remote-tracking branch 'origin/3.0' into enh/3.0/TD-32686 2025-02-26 10:36:19 +08:00
dapan1121
4224d55b39 feat: support const ts as primary cond 2025-02-25 19:26:52 +08:00
Hongze Cheng
b26166b48d support meta_only option 2025-02-25 17:57:25 +08:00
Hongze Cheng
d48547ed64 more code 2025-02-25 16:48:43 +08:00
wangmm0220
9b6a094cac feat:[TS-5613] modify sql.y to move bool_expression to common expression 2025-02-25 09:32:17 +08:00
wangmm0220
ee0f7a4d38 feat:[TS-5613]support bool in cast 2025-02-24 17:45:07 +08:00
wangmm0220
47e23e3d99 feat:[TS-5613]support bool in castfsd 2025-02-24 17:37:01 +08:00
Shengliang Guan
5ad05a662a Merge branch '3.0' into feat/TS-5470-3.0 2025-02-24 16:12:47 +08:00