Commit graph

226 commits

Author SHA1 Message Date
Mario Peng
ce5e0d6c0a
fix(stmt2):sort stmt2 bind rowkey (#30309) 2025-03-24 14:43:13 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
Simon Guan
76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
Simon Guan
b91dd10846 enh: add log level to each log entry 2025-02-27 09:55:11 +08:00
pengrongkun94@qq.com
aef5611d1b switch create thread to taosc task queue 2025-02-18 18:10:26 +08:00
yihaoDeng
76794b74f9 add sync-timeout retry 2025-01-06 09:03:20 +08:00
WANG MINGMING
88f0a42cdc
Merge branch '3.0' into feat/TD-32642 2024-12-07 20:43:26 +08:00
Pengrongkun
ede70d0465 stmt2 support insert into stb(?)values(tbname) 2024-12-05 13:59:24 +08:00
wangmm0220
0e2a16d70f feat:[TD-32642] add charset for connection support 2024-11-27 14:25:34 +08:00
dapan1121
74065f91d8 fix: data source ep issue 2024-10-30 17:39:33 +08:00
Shengliang Guan
4dc0c2f47e feat: data analysis 2024-10-09 17:09:43 +08:00
xsren
e88a8317af fix: buff size 2024-10-09 09:45:56 +08:00
kailixu
9cc0702a77 enh: drop table with uid 2024-09-19 18:34:49 +08:00
kailixu
ba10e95723 enh: support drop table with uid 2024-09-18 16:05:05 +08:00
kailixu
28edf40c2a enh: support drop table with uid 2024-09-18 13:57:17 +08:00
wangjiaming0909
b39b6589c4 fix client taskqueueWorkerpool stuck problem when querypolicy = 4 2024-09-09 13:30:22 +08:00
yihaoDeng
f2a3951c23 refact code 2024-08-06 16:12:41 +08:00
dapan1121
acafca8841
Merge pull request #26685 from taosdata/opti/TD-31017
fix:[TD-31017]process return value in clientRawBlockWrite.c
2024-07-22 09:08:26 +08:00
kailixu
0792b025ea fix: insert clause mixed with bound and unspecified columns 2024-07-19 15:08:34 +08:00
wangmm0220
6b9c00cb9b fix:[TD-31017]process return value in clientRawBlockWrite.c 2024-07-19 14:49:25 +08:00
54liuyao
8fdd64e92e limit the size of query queue 2024-07-01 11:08:39 +08:00
dapan1121
0616d886cb enh: optimize table columns allocation 2024-06-07 13:50:57 +08:00
dapan1121
3f99e5e064 fix: memory issues 2024-06-07 09:25:17 +08:00
dapan1121
da8616d98a fix: add stbInterlace mode test cases 2024-06-05 17:12:15 +08:00
dapan1121
c0e4ab20a4 enh: optimize stmt performance 2024-05-30 13:26:17 +08:00
Yihao Deng
04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
Yihao Deng
6f9de676f0 Merge branch 'fix/compress_3.0' into feat/compress_3.0 2024-04-16 09:27:26 +00:00
wangjiaming0909
a8e00f7410 drop tb in transaction 2024-04-16 14:23:26 +08:00
wangjiaming0909
54100b1c0d add tsma test, fix catalog cache update 2024-04-16 14:14:40 +08:00
dapan1121
55d118d17c Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-04-16 09:12:04 +08:00
yihaoDeng
4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00
kailixu
77d912c210 fix: primary key should not be null or none 2024-04-02 14:39:13 +08:00
factosea
9ddc0b51cb merge 2024-03-29 10:37:59 +08:00
Hongze Cheng
93ca55954f more code change 2024-03-26 15:11:15 +08:00
factosea
5dd4d05b2e desc table 2024-03-12 16:46:41 +08:00
dapan1121
b26716f2e8 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-02-18 22:15:43 -08:00
kailixu
205525dd65 feat: support uniq grant 2024-02-05 07:03:51 +08:00
kailixu
021247c45b feat: support uniq grant 2024-02-05 06:51:44 +08:00
kailixu
3ebc26e1fb feat: support uniq grant 2024-02-04 16:33:43 +08:00
kailixu
6cf7809e8d feat: support uniq grant 2024-02-04 14:59:47 +08:00
kailixu
a9316c3710 feat: support uniq grant 2024-02-04 12:28:00 +08:00
dapan1121
fb20dd51de Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-01-18 17:11:25 +08:00
Yihao Deng
6f8f47a375 fix invalid read write 2024-01-16 05:50:20 +00:00
dapan1121
dec6e3fffe enh: support asof join 2024-01-12 18:29:27 +08:00
dapan1121
969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
dapan1121
aab4cb98dc enh: create & drop view meta processing 2023-10-13 19:16:37 +08:00
dapan1121
f5768494b4 feat: support describe view command 2023-10-11 18:49:47 +08:00
dapan1121
0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
dapan1121
c9656d3f77 fix: fix memory issues 2023-08-11 17:39:41 +08:00