Commit graph

482 commits

Author SHA1 Message Date
wangmm0220
00e575a48a fix(stream): add streamid groupid for data insert 2025-06-18 15:56:48 +08:00
facetosea
b15d94fd90 fix: datainserter cache 2025-06-18 13:56:27 +08:00
WANG MINGMING
85f8cad63c
Merge pull request #31327 from taosdata/feat/TS-6100-3.0
Feat/ts 6100 3.0
2025-06-10 10:52:55 +08:00
wangmm0220
51500cdb89 fix(stream): add checkpoint logic 2025-06-07 18:32:21 +08:00
facetosea
08ba1864a3 fix: spell error 2025-06-07 17:57:07 +08:00
wangmm0220
4572c0243d fix(stream): add logic for %%tbname 2025-06-05 17:26:09 +08:00
wangmm0220
e7c84442dc fix(stream): add get tsdb/wal interface for vtable 2025-06-03 14:09:25 +08:00
wangmm0220
e6dfbf6295 fix(stream): add interface of get vtable info 2025-05-28 18:34:19 +08:00
wangmm0220
3aa8c175f5 feat(stream): reset agg operator & reset tsdb reader in fetch request 2025-05-26 14:52:02 +08:00
wangmm0220
a716fabbbc feat(stream): set tag value in trigger cols 2025-05-22 15:45:57 +08:00
wangmm0220
2d717c3a4f feat(stream): set tag value in trigger cols 2025-05-22 15:38:32 +08:00
facetosea
3c27b2c14c feat: datainsert, super table 2025-05-20 14:27:17 +08:00
wangjiaming0909
0ffe9e55f3 stream runner force output impl 2025-05-20 03:13:22 +00:00
factosea
2860309b6c fix: crate subtable tags 2025-05-17 14:13:08 +08:00
wangjiaming0909
0c402fbb38 new-stream: runner impl external window and force output 2025-05-16 08:29:34 +00:00
wangjiaming0909
5300a66f5e new-stream: runner impl 2025-05-16 01:41:31 +00:00
wangmm0220
0297c7be2c feat(stream): add ts slotid/blockId in external window 2025-05-15 14:22:46 +08:00
wangmm0220
9ffe95755b feat(stream): add interface of getting cols value of groupid 2025-05-15 10:03:57 +08:00
wangjiaming0909
ef7d67efe0 new-stream: runner notification 2025-05-14 09:55:07 +00:00
facetosea
0a7ac81aeb fix: table schema version start from 1 2025-05-14 17:41:51 +08:00
wangmm0220
5e7aed840e feat(stream): add filter if with external window 2025-05-13 10:53:39 +08:00
dapan1121
009e8aa41e Merge remote-tracking branch 'origin/3.0' into feat/TS-6100-3.0 2025-05-12 16:24:22 +08:00
wangmm0220
df42d12b06 feat(stream): return calc cols and trigger cols from stream reader 2025-05-10 21:22:11 +08:00
wangmm0220
f1155c54ad feat(stream): return calc cols and trigger cols from stream reader 2025-05-10 18:34:01 +08:00
Jing Sima
84016904ff
fix: [TS-6445] Fix virtual tables not detecting schema changes. (#30999)
Ensure virtual tables invalidate cached schema metadata and reload it when a schema change (e.g., ALTER VTABLE) is detected. This prevents stale schema references and query errors after structural updates.
2025-05-10 10:34:54 +08:00
facetosea
a11fc0d7cd fix: data insert, build STSchema 2025-05-09 17:05:56 +08:00
factosea
1fafaae137 fix: save table uid 2025-05-09 10:03:35 +08:00
factosea
e4dd28df92 feat inserter param check 2025-05-08 23:00:37 +08:00
wangmm0220
332d21630c feat(stream): reset task if fetchMsg.reset is true for calc 2025-05-08 19:53:40 +08:00
wangmm0220
9dfcb4d63b feat(stream): add logic of fetch rsp for calc 2025-05-08 17:39:12 +08:00
wangmm0220
bc1c0f272d feat(stream): add logic of fetch rsp for calc 2025-05-08 17:27:09 +08:00
factosea
cd9a532064 feat: data inserter 2025-05-08 15:07:04 +08:00
wangjiaming0909
9fd5f6364c new-stream: runner impl 2025-05-08 14:58:41 +08:00
factosea
48c8ebfb4b fix: data insert interface 2025-05-08 10:45:00 +08:00
factosea
f3027e938e feat: stream data insert 2025-05-08 09:48:53 +08:00
pengrongkun94@qq.com
820a0101ae feat:add auto create table 2025-05-07 11:06:12 +08:00
wangjiaming0909
1ccc6c69a8 new-stream: runner impl 2025-04-29 15:31:17 +08:00
wangmm0220
c632dcf0c1 feat(stream): add logic of stream reader 2025-04-28 19:21:47 +08:00
wangmm0220
a78b09577a feat(stream): add thread worker for stream reader 2025-04-28 14:37:05 +08:00
Kaili Xu
b88ec2f1a8
fix: timeseries statis for virtual table (#30911) 2025-04-27 18:03:20 +08:00
wangmm0220
5ce115cc23 feat(stream): fix compile error 2025-04-24 18:02:12 +08:00
dapan1121
330cf9982d fix: compile issues 2025-04-24 09:11:54 +08:00
WANG MINGMING
c85b195421
Merge branch 'feat/TS-6100-marks' into feat/TS-6100-3.0 2025-04-19 16:18:09 +07:00
wangmm0220
80f368ba51 feat(stream): add stream reader logic 2025-04-19 17:10:43 +08:00
wangmm0220
919628568d feat(stream): add stream reader logic 2025-04-17 19:50:37 +08:00
wangjiaming0909
163dd33a0a new-stream: impl stream runner 2025-04-16 18:16:55 +08:00
Jing Sima
f84f04398d
fix: [TS-4897] Support query stables cross databases and fix potential deadlock. (#30507) 2025-03-28 10:07:08 +08:00
Jinqing Kuang
c82398e175 fix(stream): fix stream processing for virtual tables
- Fixed status check in virtual table stream processing
- Fixed multi-way merge logic for super virtual tables
- Fixed generation of target subtable names during merge
2025-03-20 01:15:54 +08:00
Jing Sima
ccaa0b91ae
feat: [TS-4897] Add more test and fix bugs. (#30208)
* feat: [TS-4897] Fix state window wrong res when all state col is NULL.

* fix: [TD-34074] Forbid decimal type in virtual table.
2025-03-19 17:15:17 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00