Commit graph

153 commits

Author SHA1 Message Date
Simon Guan
2c27c10fa8 Merge branch 'main' into merge/mainto3.0 2025-03-20 14:05:45 +08:00
liuyao
fac36002c1
ci(stream): add ci and fix issue (#30270)
* ci(stream): add ci and fix issue

* ci: adj test

* ci: add test and fix issue

* ci: adj test

* ci(stream): add test for fill operator and fix issue

* fix: fix issue

* fix: fix issue

* fix: adjust defalut rec value
2025-03-20 10:34:31 +08:00
Haojun Liao
db57fc4ba8
fix(stream): fix race condition in send msg. (#30277)
Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-19 23:15:15 +08:00
Simon Guan
d02196a231
refactor: adjust some logs (#30245)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* docs: update keywords

* fix: compile errors in windows

* docs: minor changes

* docs: minor changes

* refactor: minor changes

* docs: fminro changes

* docs: format

* refactr: remove uncessory logs

* docs: format doc
2025-03-18 17:55:36 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
54liuyao
051c34e2f1 fix(stream): fix stream mem leak 2025-03-11 11:30:13 +08:00
54liuyao
1ddc510976 fix(stream): fix stream mem leak 2025-03-10 16:28:28 +08:00
54liuyao
870fe1c071 fix(tsma):drop invalid state for tsma 2025-02-20 11:52:04 +08:00
54liuyao
f6500b3551 ci(test):delete invalid code&& add ci 2024-12-26 11:16:02 +08:00
54liuyao
b6aa299a3c opt stream build twa result 2024-12-05 08:57:12 +08:00
54liuyao
2a8263efea opt force window close memory 2024-12-03 09:11:46 +08:00
54liuyao
1b285f8a1d fix issue 2024-11-27 18:52:04 +08:00
54liuyao
a6cd2b16fe adj function name 2024-11-27 08:40:19 +08:00
54liuyao
22023575ba opt stream force fill op 2024-11-26 19:46:36 +08:00
54liuyao
48d5f0e7cd fix issue 2024-11-05 18:14:35 +08:00
54liuyao
d065d71821 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-30 10:09:48 +08:00
54liuyao
077005a9f9 fix ci issue 2024-10-25 16:08:38 +08:00
54liuyao
6b2d338a20 enh(executor):avoid use dangerous functions 2024-10-25 13:47:09 +08:00
54liuyao
c17bed9807 optimize clear expired state 2024-10-22 17:55:05 +08:00
54liuyao
3365da365f Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-22 10:17:49 +08:00
54liuyao
a62b5a3efd fix issue 2024-10-17 14:55:07 +08:00
54liuyao
b24c9c5d20 fix ci check 2024-10-16 13:39:32 +08:00
54liuyao
3e49f40c74 stream twa 2024-10-16 12:16:59 +08:00
Jing Sima
cf3db4f1a6 fix:[TD-32184] fix heap use after free. 2024-10-14 11:24:02 +08:00
yihaoDeng
5aeb1ec2ad add interface 2024-10-14 11:00:20 +08:00
yihaoDeng
ecfa67510c add serial 2024-10-14 11:00:20 +08:00
54liuyao
58d8b9f84e fix ci issue 2024-10-09 11:32:20 +08:00
54liuyao
d13819bbf4 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-30 09:05:46 +08:00
54liuyao
2c0445fff4 add check 2024-09-29 14:53:47 +08:00
54liuyao
df8cfa65c2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-27 11:37:37 +08:00
yihaoDeng
4cd35d76db fix mem leak 2024-09-26 15:51:32 +08:00
54liuyao
d44529e62f Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-25 15:12:15 +08:00
54liuyao
db50c9230a fix issue 2024-09-24 16:58:46 +08:00
lyh250-666
dc1d1930c2 enh:modify error code passing 2024-09-23 10:15:20 +08:00
54liuyao
813cab6e33 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-19 14:45:38 +08:00
54liuyao
6225f7fa2f fix(stream):use terrno 2024-09-19 13:49:42 +08:00
54liuyao
f6174d0b09 adjust stream slice res 2024-09-18 17:00:38 +08:00
54liuyao
c4566f98b8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-18 16:26:37 +08:00
54liuyao
8ae4e54d65 fix(stream):check null pointer 2024-09-18 16:24:28 +08:00
54liuyao
6a1cde28fb fix(stream):adjust file state res 2024-09-18 14:22:24 +08:00
54liuyao
19a51d82eb fix(stream):fix mem leak and malloc res 2024-09-18 10:58:27 +08:00
54liuyao
b649f1f1c4 fix(stream):adj build file state res 2024-09-14 10:51:57 +08:00
54liuyao
7c32cc7796 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-09-12 09:08:40 +08:00
lyh250-666
6cbb0cf172 enh:modify error code passing libs/ 2024-09-11 09:58:41 +08:00
54liuyao
75727e47b5 remove assert 2024-09-09 17:58:40 +08:00
54liuyao
9c4d34ede1 fix file state issue 2024-09-05 09:27:36 +08:00
54liuyao
9368244f43 fix issue for fill history 2024-09-04 15:34:14 +08:00
54liuyao
2d4ff65509 adj state cache 2024-08-22 15:59:42 +08:00
54liuyao
3583237942 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-08-22 14:47:16 +08:00
54liuyao
99bdcb3f58 enh(stream):remove assert of stream operator 2024-08-20 15:02:09 +08:00