Commit graph

21 commits

Author SHA1 Message Date
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Haojun Liao
8978b7d97f test: add test cases. 2024-12-29 17:52:43 +08:00
Haojun Liao
fea19d5ad1 test: add a new test case. 2024-11-04 20:14:58 +08:00
Haojun Liao
18c1b76cb4 test: add into test suite 2024-10-29 10:09:07 +08:00
kailixu
674e878ffa enh: rsma support delete 2023-11-10 14:44:29 +08:00
kailixu
1ed3149c39 fix: the precision of delete statement 2023-04-12 17:41:43 +08:00
Haojun Liao
31c2aa89ef fix(query): do some internal refactor. 2022-11-27 01:59:49 +08:00
Shengliang Guan
3a7d89a6bb refact: remove bnode codes 2022-10-18 17:34:58 +08:00
Haojun Liao
8b86d7342d fix(query): check the sma load status, and return if succeed. 2022-08-09 17:21:31 +08:00
Haojun Liao
0758751b0c refactor: do some internal refactor. 2022-06-30 14:50:59 +08:00
Haojun Liao
f2a27f5842 refactor: do some internal refactor. 2022-06-18 12:00:41 +08:00
wangmm0220
81acad620c fix:error in CI 2022-06-14 19:33:55 +08:00
Haojun Liao
475a399c31 refactor: do some internal refactor. 2022-06-06 17:29:43 +08:00
Haojun Liao
90cb7966bc refactor: do some internal refactor. 2022-06-06 10:35:19 +08:00
Haojun Liao
4391ed4af6 test:update the test suit. 2022-06-05 15:37:04 +08:00
Haojun Liao
978f73393d enh(query): add retension for the results of show databases; 2022-06-04 12:31:35 +08:00
Haojun Liao
ad5be523e6 refactor: do some internal refactor. 2022-06-02 23:33:38 +08:00
Haojun Liao
84158d861d enh(query): query APIs are built on top of async APIs. 2022-06-02 16:54:35 +08:00
tomchon
1da8d5886e test:add testcase to ci 2022-05-25 22:47:23 +08:00
tomchon
26c2990bbe test:add testcase to ci 2022-05-25 22:27:55 +08:00
Haojun Liao
cded09bf79 enh(query): limit the rsp ssdatablock size. 2022-05-19 23:47:27 +08:00