Commit graph

48 commits

Author SHA1 Message Date
WANG MINGMING
1c4507ab75
fix(stream): row size error (#30330) 2025-03-28 18:10:57 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
Shengliang Guan
2bee60a41a Merge branch 'main' into merge/mainto3.0 2025-02-20 18:12:02 +08:00
54liuyao
870fe1c071 fix(tsma):drop invalid state for tsma 2025-02-20 11:52:04 +08:00
Jinqing Kuang
fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
54liuyao
f6500b3551 ci(test):delete invalid code&& add ci 2024-12-26 11:16:02 +08:00
54liuyao
a6cd2b16fe adj function name 2024-11-27 08:40:19 +08:00
54liuyao
a62b5a3efd fix issue 2024-10-17 14:55:07 +08:00
54liuyao
3e49f40c74 stream twa 2024-10-16 12:16:59 +08:00
54liuyao
3cac85f3ae fix ci issue 2024-10-09 10:58:11 +08:00
54liuyao
bfb94343fc fix ci issue 2024-10-09 10:34:19 +08:00
54liuyao
d13819bbf4 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-30 09:05:46 +08:00
54liuyao
7517228dde fix(stream):fix issue for stream count window state buff 2024-09-29 14:16:16 +08:00
54liuyao
db50c9230a fix issue 2024-09-24 16:58:46 +08:00
54liuyao
c4566f98b8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-18 16:26:37 +08:00
54liuyao
b649f1f1c4 fix(stream):adj build file state res 2024-09-14 10:51:57 +08:00
54liuyao
216c53f0ae fix issue 2024-08-14 15:22:42 +08:00
54liuyao
bdaf0d419e stream interp force window close 2024-08-06 16:14:15 +08:00
54liuyao
b26750c200 add ci 2024-08-02 13:22:14 +08:00
54liuyao
3ff0256145 steam interp 2024-07-30 16:06:40 +08:00
54liuyao
b5f432bd50 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-07-26 16:44:18 +08:00
54liuyao
4e6b898c9a adj stream operator result 2024-07-18 10:37:14 +08:00
54liuyao
ab642b245c adj stream operator result 2024-07-18 10:09:15 +08:00
54liuyao
113cb57326 adj stream operator result 2024-07-17 19:35:35 +08:00
54liuyao
1c9011e820 stream time slice 2024-07-12 11:03:45 +08:00
54liuyao
c6d492d3fd set ts column index for function 2024-04-10 17:41:59 +08:00
54liuyao
ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
54liuyao
3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
liuyao
f51c985914 stream event window 2023-10-25 17:50:16 +08:00
liuyao
429125be93 session state recover 2023-10-13 11:32:35 +08:00
liuyao
1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
liuyao
c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
liuyao
82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
liuyao
5cc1ae1266 fix issue 2023-09-22 19:25:19 +08:00
liuyao
4979fc5283 fix issue 2023-09-22 09:40:08 +08:00
liuyao
1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
liuyao
7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
liuyao
693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao
c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Haojun Liao
e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
liuyao
502efb3d01 op stream selectivity buff 2023-05-15 16:26:24 +08:00
liuyao
863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
liuyao
9be89ce00a delete expired check point 2023-04-12 17:33:58 +08:00
yihaoDeng
ed4aaade8c add backend 2023-04-12 03:03:51 +00:00
liuyao
1f63859e21 feat:add buff swap 2023-04-07 12:50:59 +08:00
liuyao
0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
54liuyao
1892b806b5 feat:add stream state buff 2023-04-04 17:09:35 +08:00
54liuyao
429b5cd646 feat:add stream file state 2023-04-04 17:09:35 +08:00