Commit graph

225 commits

Author SHA1 Message Date
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
Jinqing Kuang
51ffff2079 feat(query)[TS-5470]: add syntax to specify minimum duration for event and state windows
Introduce the `true for` syntax to allow users to specify the minimum
duration for event and state windows. Add corresponding tests to
validate the feature. Updated the user manual with usage instructions.
2025-02-24 08:02:48 +08:00
Jinqing Kuang
fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
Jinqing Kuang
eb5d463490 feat(stream)[TS-5469]. add support for window event notifications in stream processing
- Introduce new syntax to specify notification type and destination address
- Collect relevant event information during window computations
- Implement websocket-based notification delivery to the specified address
2025-01-21 17:39:46 +08:00
54liuyao
f3b38edb98 add stream event notify 2025-01-21 11:18:49 +08:00
dapan1121
d77147d296 Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-12-06 17:43:19 +08:00
dapan1121
011ff04234 fix: scheduler dead lock issue 2024-12-05 18:07:37 +08:00
Shengliang Guan
41ccb28f86
Merge pull request #28975 from taosdata/feat/main/TS-5667
support interp fill extension
2024-11-29 17:48:25 +08:00
wangjiaming0909
3239a10b76 support interp fill extension 2024-11-28 20:30:53 +08:00
54liuyao
22023575ba opt stream force fill op 2024-11-26 19:46:36 +08:00
54liuyao
f37ae57a87 opt stream row buff 2024-11-26 15:23:57 +08:00
54liuyao
39564a41ae fix(stream):build create table request for force_window_close 2024-11-25 13:54:31 +08:00
54liuyao
ba31bf2c52 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-11-06 09:42:50 +08:00
Jing Sima
355aa885de fix:[TD-32506] fix mem leak in percentile function. 2024-11-04 09:35:15 +08:00
54liuyao
5158bf6b96 fix issue 2024-10-31 15:50:56 +08:00
54liuyao
e9550a6b2c feat(stream):save force window close scan range 2024-10-18 15:40:37 +08:00
54liuyao
39379af1a2 add twa ci 2024-10-16 17:34:03 +08:00
54liuyao
3e49f40c74 stream twa 2024-10-16 12:16:59 +08:00
54liuyao
dd7f705dcc Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-09 19:31:44 +08:00
Jing Sima
8acdbe597d fix:[TD-32372] Clean up in a right way. 2024-10-09 09:26:57 +08:00
54liuyao
d44529e62f Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-25 15:12:15 +08:00
Jing Sima
122b707ac8 enh:[TD-32158] Free memory allocated in function setup. 2024-09-24 11:35:36 +08:00
Jing Sima
23b525458e fix:[TD-32262] Avoid mem leak when error occurs. 2024-09-23 13:50:55 +08:00
54liuyao
b8cd739383 add ci and fix issue 2024-09-18 11:08:47 +08:00
54liuyao
3583237942 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-08-22 14:47:16 +08:00
Haojun Liao
0cbbdf1b88 fix(query): if the return value of addTagPseudoColumnData is not success, not jump out. 2024-08-16 15:42:53 +08:00
54liuyao
d59eb19c37 add ci 2024-08-16 10:54:52 +08:00
54liuyao
6ab21a0d17 fix issue 2024-08-15 13:20:42 +08:00
54liuyao
057f09ffbf fix issue && add ci 2024-08-14 19:20:21 +08:00
54liuyao
77c0324e20 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-08-08 09:12:26 +08:00
54liuyao
bdaf0d419e stream interp force window close 2024-08-06 16:14:15 +08:00
wangjiaming0909
8dd11f9a09 fix exchange operator caused rpc conn not freed 2024-08-06 16:13:07 +08:00
54liuyao
b26750c200 add ci 2024-08-02 13:22:14 +08:00
54liuyao
3ff0256145 steam interp 2024-07-30 16:06:40 +08:00
54liuyao
063b492f72 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-07-30 15:13:15 +08:00
54liuyao
d999c00227 adj operator res 2024-07-29 10:35:06 +08:00
54liuyao
0bd8c57049 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-07-29 09:24:40 +08:00
Haojun Liao
3073d6d067 other: merge 3.0 2024-07-27 00:03:28 +08:00
wangjiaming0909
1994c3339b nodes add ret check 2024-07-26 17:55:48 +08:00
54liuyao
b5f432bd50 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-07-26 16:44:18 +08:00
Hongze Cheng
eaa3634764 enh: refactor error code 2024-07-25 08:51:19 +08:00
Haojun Liao
b228151d8e other: merge 3.0 2024-07-24 17:29:35 +08:00
Haojun Liao
aacf1c3e9a fix(stream): check return value. 2024-07-24 17:08:08 +08:00
54liuyao
1d35ea137a adj query operator result 2024-07-23 10:50:16 +08:00
54liuyao
6e70da62fb adj operator res 2024-07-22 12:51:25 +08:00
54liuyao
13b75ba72a adj operator result 2024-07-19 16:15:37 +08:00
54liuyao
cc9233fdb3 adj stream operator result 2024-07-18 16:08:01 +08:00
54liuyao
4e6b898c9a adj stream operator result 2024-07-18 10:37:14 +08:00
54liuyao
113cb57326 adj stream operator result 2024-07-17 19:35:35 +08:00