TDengine/source/dnode/mnode/impl/inc
Jinqing Kuang ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
..
mndAcct.h TD-10431 rename some funcs 2021-11-29 13:29:13 +08:00
mndAnode.h enh(analysis): add the algorithm in telemetry report. 2025-01-23 00:29:18 +08:00
mndArbGroup.h fix/TS-5805-check-arb 2024-12-25 02:43:51 +00:00
mndCluster.h feat: support uniq grant 2024-01-22 13:20:15 +08:00
mndCompact.h fix/TD-30742 2024-08-02 04:46:30 +00:00
mndCompactDetail.h more code 2024-11-13 16:17:16 +08:00
mndConfig.h Move rebuild config sdb to after restored. 2024-12-17 11:22:38 +08:00
mndConsumer.h fix:[TD-TD-31308] error code if topic not exist 2024-08-08 09:46:00 +08:00
mndDb.h more code 2024-11-08 11:13:37 +08:00
mndDef.h feat(stream): support stream processing for virtual tables (#30144) 2025-03-15 17:06:48 +08:00
mndDnode.h Merge branch '3.0' into enh/3.0/TD-31709 2024-12-16 10:00:02 +08:00
mndFunc.h TD-10431 rename some funcs 2021-11-29 13:29:13 +08:00
mndGrant.h feat: support uniq grant 2024-02-13 23:17:05 +08:00
mndIndex.h enh: change redo logs of trans create-stb-index and drop-index as prepare logs 2024-02-23 10:22:58 +08:00
mndIndexComm.h fix iter and case 2023-02-18 18:24:10 +08:00
mndInfoSchema.h feat: system table visible permission 2022-08-24 17:36:10 +08:00
mndInt.h enh: adjust some logs 2025-02-27 09:55:11 +08:00
mndMnode.h feat/restore dnode 2023-05-09 17:15:37 +08:00
mndPerfSchema.h format more code 2022-10-13 11:56:16 +08:00
mndPrivilege.h feat:[TD-28247]add grant for subscribe and stream 2024-01-25 16:07:09 +08:00
mndProfile.h mnode monitor 2022-03-03 20:23:53 +08:00
mndQnode.h feat/restore dnode 2023-05-09 17:15:37 +08:00
mndQuery.h fix: fix coverity check issues 2022-10-17 19:48:36 +08:00
mndScheduler.h feat(stream): support stream processing for virtual tables (#30144) 2025-03-15 17:06:48 +08:00
mndShow.h fix/TD-31891-remove-void-stb 2024-09-05 09:58:02 +00:00
mndSma.h tsma avoid fetching tsma for no tsma tables 2024-04-16 14:25:34 +08:00
mndSnode.h enh: force drop dnode 2022-10-31 17:29:24 +08:00
mndStb.h fix/TD-31891-remove-void-stb 2024-09-05 09:58:02 +00:00
mndStream.h refactor(stream): stop all tasks before drop vnodes. 2025-03-02 02:06:14 +08:00
mndSubscribe.h fix:[TD-31017]process return value in mnode for tmq 2024-07-22 17:30:49 +08:00
mndSync.h refact: post sem in mnode while sync timeout 2022-12-13 11:11:22 +08:00
mndTelem.h TD-10431 rename some funcs 2021-11-29 13:29:13 +08:00
mndTopic.h fix:[TD-31115] add consumer check when drop topic or group in tmq 2024-08-06 19:27:42 +08:00
mndTrans.h Revert "Revert "Revert "Revert "Enh:[td 29974]improve trans"""" 2024-12-29 19:40:32 +08:00
mndUser.h enh: return error code 2024-07-22 15:29:37 +08:00
mndVgroup.h support meta_only option 2025-02-25 17:57:25 +08:00
mndView.h feat: support view meta updating 2023-10-13 16:29:34 +08:00