WANG MINGMING
3fafecb242
feat[TS-6137]: support sliding in force_window_close ( #30203 )
...
* feat[TS-6137]: support sliding in force_window_close
* feat[TS-6137]: support sliding in force_window_close
* feat(stream): force window close support interval sliding
* feat[TS-6137]: support sliding in force_window_close
* feat[TS-6137]: support sliding in force_window_close
* feat[TS-6137]: support sliding in force_window_close
---------
Co-authored-by: 54liuyao <54liuyao@163.com>
2025-03-19 10:22:06 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close ( #30125 )
...
* opt stream build twa result
* opt force window close memory
* feat(stream):optimize new interval and scan operator
* adj log
* opt code
* opt code
* fill history
* fix issue for fill history
* add ci
* feat(stream): add new stream nonblock interval operator
* adjust code
* use new scan operator
* use new scan operator
* add log
* fix issue
* recover stream scan next function
* fix issue
* fix issue
* fix issue
* ignore disorder data
* fix issue
* fix issue for interval sliding
* fix issue
* fix ci issue
* fix ci issue
* fix ci issue
* add semi && final nonblock interval operator
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* refactor(stream): track the msgId for each upstream tasks.
* fix(stream): fix race condition.
* fix(stream): update the task last msgId when putting into input queue succ.
* fix issue
* fix issue
* put recalculate data to rocksdb
* fix issue
* fix issue
* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress
- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* add rec interval check
* enh(stream):add recalculate tasks.
* enh(stream): support the re-calculate the tasks.
* fix issue && do refactor
* do refactor
* fix issue
* fix issue
* update backend opt
* add new interface
* add new session operator
* support blob
* add new session operator
* fix issue
* add rec state for rec task
* fix invalid read
* add new session window
* enh(stream): update the stream tasks backend.
* new session operator
* add pull data
* fix(stream): fix error in expand stream backend.
* fix issue
* fix issue
* fix issue
* merge code
* fix issue
* fix(stream): check for null ptr.
* fix(stream): add more check.
* fix issue
* fix issue
* fix issue
* add debug code
* fix issue
* fix issue
* fix issue
* set rec end flag
* fix(stream): opt re-calculate stream tasks.
* fix issue
* fix issue
* add new operator
* enh(stream): dispatch recalculate block to agg tasks.
* fix issue
* fix issue
* fix(stream): adjust filter.
* fix issue
* refactor
* refactor(stream): adjust the recalculate end block.
* fix issue
* fix(stream): set correct create trigger block.
* fix issue
* fix(stream): fix error in build recalculate end block.
* fix(stream): check null ptr.
* add stream client && fix issue
* fix mem leak
* fix(stream): free msg.
* add stream client
* fix(stream): fix error.
* add stream client && fix issue
* add stream client
* refactor(stream): set the recalculate task complete.
* add wend and group_id for session window dest table
* feat(stream): refactor and set the recalcul agg task complete.
* add cfg for adapter
* fix issue
* add state && event operator
* feat(stream): support fill-history task.
* add new fill operator
* fix(stream): set correct backend when updating fill-history task to recalculate task.
* add new fill operator
* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb
* fix(stream):set the correct taskType for sink task.
* new fill operator
* adj stream fill operator
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* fix issue
* adj test
* fix issue
* fix(stream): fix issue
* fix(steam): fix issue
* fix(steam): fix issue
* fix(steam): fix issue
* fix(steam): fix issue
* fix(stream): fix issue
* fix(stream): fix issue
* fix(stream): fix issue
* fix: ut com error
* fix(stream): fix mem leak and adjust operator type check rule
* fix(stream): fix mem leak and adjust test case
* refactor code
* fix(stream): free items.
* fix(stream): free fix memory leak.
* fix(stream): fix syntax error.
* fix: ignore unexpect block
* fix: adjust op type
---------
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
Haojun Liao
ec71572d74
refactor: do some internal refactor.
2024-11-28 14:52:39 +08:00
Haojun Liao
58886a0264
fix(stream): the timestamp when the stream is created is set to be the initial force_window_close start time.
2024-11-27 17:48:02 +08:00
Haojun Liao
cacc7db61c
fix(stream): set the correct start ts.
2024-10-28 19:33:11 +08:00
Haojun Liao
c0932d419d
fix(stream): fix error in pause/resume for force_window_close
2024-10-28 18:07:11 +08:00
54liuyao
3e49f40c74
stream twa
2024-10-16 12:16:59 +08:00
54liuyao
dfa374bc8a
merge 3.0
2024-09-25 15:25:54 +08:00
54liuyao
d44529e62f
Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837
2024-09-25 15:12:15 +08:00
lyh250-666
5f6802e0a1
enh:modify addede rror code passing
2024-09-24 16:29:28 +08:00
Haojun Liao
f3b42fd9d1
enh(stream): generate the force_window_close trigger block.
2024-09-20 19:18:35 +08:00
54liuyao
71df0e0781
adjust block type
2024-09-20 16:55:57 +08:00
Haojun Liao
e1d8e98b11
feat(stream): support the force_window_close trigger.
2024-09-19 16:23:51 +08:00
Haojun Liao
b6084e64ce
refactor: remove assert in stream module.
2024-08-21 10:00:35 +08:00
Haojun Liao
ade444b690
fix(stream): check return value.
2024-08-05 14:45:54 +08:00
Haojun Liao
34ce872eaf
refactor: do some internal refactor.
2024-08-05 10:16:09 +08:00
Haojun Liao
715b6428aa
fix(stream): update the merge result check.
2024-07-31 16:33:44 +08:00
Haojun Liao
75c121c18a
fix(query): check return value.
2024-07-28 14:29:56 +08:00
Haojun Liao
2ca6726922
refactor: check return value for each function.
2024-07-18 22:52:32 +08:00
Haojun Liao
b35d107bf9
refactor: check return value for each function.
2024-07-17 18:55:04 +08:00
Haojun Liao
2b00d6549d
refactor: check return value for each function.
2024-07-17 17:57:08 +08:00
Haojun Liao
0100bb51b9
other: merge 3.0
2024-07-17 17:36:49 +08:00
Haojun Liao
552e59f42b
refactor: check return value for each function.
2024-07-17 15:40:00 +08:00
Hongze Cheng
64363627fe
enh: refact tqueue code
2024-07-16 17:30:32 +08:00
Haojun Liao
4490f40c96
fix(stream): do some internal refactor.
2024-06-14 14:43:57 +08:00
Haojun Liao
f74fad7e60
fix(query): fix error in refactor.
2024-05-19 17:17:40 +08:00
Haojun Liao
0fe2686b63
fix(query): fix bugs caused by refactor.
2024-05-19 14:55:51 +08:00
Haojun Liao
82c10fd709
fix(query): fix bugs caused by refactor.
2024-05-19 13:40:09 +08:00
Haojun Liao
1a1319908d
refactor: do some internal refactor.
2023-11-23 14:25:52 +08:00
Haojun Liao
e1de1de421
fix(stream): fix the invalid free.
2023-11-11 15:40:07 +08:00
Haojun Liao
6a98b11bef
fix(stream): fix invalid read and memory leak.
2023-10-09 20:08:11 +08:00
Haojun Liao
4af7812f0b
fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.
2023-10-09 20:08:10 +08:00
Haojun Liao
ef9efc8a8e
refactor: do refactor the sink task.
2023-10-09 20:07:53 +08:00
Haojun Liao
1f45bd82d2
other: merge stream fix in main.
2023-10-09 20:07:01 +08:00
Haojun Liao
ce85945583
fix(stream): set correct size for results generated by scan history stream tasks.
2023-10-09 20:06:05 +08:00
Haojun Liao
e457d94ac6
refactor: do some internal refactor.
2023-09-12 18:09:02 +08:00
Haojun Liao
ecff0acb73
fix(stream): fix a syntax error.
2023-08-31 11:48:25 +08:00
Haojun Liao
e53b5d4392
refactor: do some internal refactor.
2023-08-31 11:01:53 +08:00
Haojun Liao
8b27f98ee4
refactor: do some internal refactor.
2023-08-21 19:08:27 +08:00
Haojun Liao
edbad45772
other: add logs.
2023-08-18 13:45:08 +08:00
Haojun Liao
ea6574b3c7
other: merge 3.0
2023-08-17 00:07:55 +08:00
Haojun Liao
98f40325e9
fix(stream): fix memory leak.
2023-08-13 20:02:15 +08:00
Haojun Liao
09da6c6840
refactor: do some internal refactor.
2023-08-12 18:51:20 +08:00
Haojun Liao
8dfef8768a
other: merge 3.0
2023-07-29 22:54:16 +08:00
Haojun Liao
d29f835a63
fix(stream): set the correct step2 scan time window range.
2023-07-25 15:09:22 +08:00
Haojun Liao
2f24f776fb
fix(stream): fix error in generating checkpoint for state_window.
2023-07-18 09:04:28 +08:00
Haojun Liao
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-17 11:50:12 +08:00
Haojun Liao
eb7e6152ae
refactor(stream): do some internal refactor.
2023-07-14 17:21:20 +08:00
Haojun Liao
6f2fc4fab3
fix(stream): commit task meta after do vnode-wide checkpoint.
2023-07-12 10:16:14 +08:00
Haojun Liao
3ffdbe923d
other: merge 3.0
2023-07-11 09:12:57 +08:00
