Commit graph

157 commits

Author SHA1 Message Date
Jing Sima
f84f04398d
fix: [TS-4897] Support query stables cross databases and fix potential deadlock. (#30507) 2025-03-28 10:07:08 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
xiao-77
e2b18a7182 End(insert):Use cache to improve auto create table performance. 2025-03-04 10:04:58 +08:00
wangjiaming0909
6c18289de0 fix tsbs perf issue 2024-11-18 14:11:21 +08:00
kailixu
107ad05273 enh: support drop table with uid 2024-09-18 19:04:44 +08:00
kailixu
302c08331f enh: support drop table with uid 2024-09-17 10:33:38 +08:00
kailixu
31bb993e0d enh: support drop table with uid 2024-09-14 17:57:30 +08:00
wangjiaming0909
daf8ed7e06 fix db tsma version not updated by heart beat 2024-08-14 16:23:08 +08:00
wangmm0220
5dcfed2d51 feat:[TS-4921]add logic for slow log 2024-06-19 18:54:26 +08:00
wangjiaming0909
de1c28d623 tsma avoid fetching tsma for no tsma tables 2024-04-16 14:25:34 +08:00
wangjiaming0909
e43580f71b fix ci 2024-04-16 14:25:20 +08:00
wangjiaming0909
70ca830378 support recursive tsma creation 2024-04-16 14:17:12 +08:00
wangjiaming0909
0fd66d7e8a tsma optimization 2024-04-16 14:14:39 +08:00
wangjiaming0909
ef47fd57d6 support tsma catalog cache 2024-04-16 14:14:34 +08:00
kailixu
6098538162 feat: support uniq grant 2024-02-04 18:00:02 +08:00
kailixu
d281bc70b0 feat: remove hb of grantInfo 2024-02-04 16:46:24 +08:00
kailixu
f53d0bce5d feat: support uniq grant 2024-02-04 00:24:42 +08:00
kailixu
3a08926319 feat: support uniq grant 2024-02-03 17:32:02 +08:00
kailixu
3e7884a4f7 feat: support uniq grant 2024-02-02 13:59:45 +08:00
kailixu
3f061a8460 feat: support uniq grant 2024-02-02 13:44:33 +08:00
kailixu
44d264456d feat: support uniq grant 2024-02-02 08:41:45 +08:00
kailixu
adee720128 feat: support uniq grant 2024-02-01 17:48:29 +08:00
dapan1121
9801d5d7b7 fix: desciribe view and memory issues 2023-10-27 19:28:22 +08:00
dapan1121
969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
dapan1121
afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
dapan1121
c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
dapan1121
7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
dapan1121
478de7ae56 feat: add show create view implement 2023-10-11 10:38:22 +08:00
dapan1121
5b639a172d feat: support query from view 2023-10-08 18:36:06 +08:00
dapan1121
0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
dapan1121
14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
dapan1121
170182fecd feat: support fill history with sub request 2023-06-12 16:10:54 +08:00
dapan1121
f5ebc17fae
Merge branch '3.0' into feat/TD-22746 2023-05-18 09:10:49 +08:00
dapan1121
ee2521a6ab Merge remote-tracking branch 'origin/3.0' into feat/TD-22746 2023-05-16 10:53:21 +08:00
dapan1121
9fcf56a4ee feat: support meta cleanup 2023-05-16 10:51:58 +08:00
dapan1121
69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
dapan1121
52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
dapan1121
5db5205e31 fix: schema/tag version update to int32 2023-04-26 13:41:16 +08:00
dapan1121
8c4b73a351 feat: add get table tag sync API 2023-04-24 19:19:12 +08:00
dapan1121
e36bf05f98 enh: support get subtable tag and auth 2023-04-20 17:30:09 +08:00
dapan1121
aa8d25f6e5 feat: support fetching table tag value 2023-04-19 10:03:06 +08:00
dapan1121
7f518ca4ea feat: support cache db cfg 2023-04-13 10:54:57 +08:00
dapan1121
d768f49dd7 feat: table level user auth 2023-04-06 10:01:27 +08:00
dapan1121
36c582c678 feat: add batch get table vgId API 2023-01-04 14:01:43 +08:00
dapan1121
65913f6ad9 enh: support auth read or write 2022-12-20 17:14:10 +08:00
dapan1121
1138d8abb2 enh: add table cached meta and vg new api 2022-12-08 10:33:26 +08:00
dapan1121
9f7e06721c enh: support vgroup epset update 2022-11-09 18:48:52 +08:00
Shengliang Guan
1dbb086045 enh: check vgroup status changes at regular intervals 2022-11-08 17:17:24 +08:00
Xiaoyu Wang
7484ff430c enh: insert optimize 2022-11-05 12:09:11 +08:00
Xiaoyu Wang
80dc658dbb Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-11-04 18:03:21 +08:00