Commit graph

693 commits

Author SHA1 Message Date
Mario Peng
064a380942
fix:stream out table schema change problem (#34024) 2025-12-30 10:55:17 +08:00
wangmm0220
25ac12c1df fix(tmq): merge from 3.3.6 2025-12-22 18:47:59 +08:00
WANG MINGMING
9cf0850bf2
fix(tmq): optimize tablelist in tmq when alter tag & modify tag if ne… (#33988) 2025-12-22 18:14:39 +08:00
Yihao Deng
c2d5e1b41b
fix: mem leak (#33888) 2025-12-12 09:29:33 +08:00
Yihao Deng
fef04727f2
fix mem leak (#33891) 2025-12-12 09:29:05 +08:00
Simon Guan
18fd87f2f5 Merge commit '4c4706619093a5b4a8738563849c4146d2b3f5c8' into merge/3.3.6tomain 2025-11-14 10:15:39 +08:00
yihaoDeng
e8cfe6a86b fix dead lock 2025-11-12 19:56:00 +08:00
yihaoDeng
d019aaaee9 fix dead lock 2025-11-12 19:52:08 +08:00
yihaoDeng
6d8372a9b5 avoid dead lock 2025-11-12 15:13:49 +08:00
yihaoDeng
65af66cd79 avoid dead lock 2025-11-12 11:17:27 +08:00
wangmm0220
a6cb6d4266 enh(stream): fix errors in ci 2025-11-11 11:20:49 +08:00
wangmm0220
b889befe39 enh(stream): fix conflicts 2025-11-07 16:38:02 +08:00
WANG MINGMING
e53920d0f2
Merge pull request #33284 from taosdata/main
enh(stream): merge from main
2025-10-16 17:09:48 +08:00
WANG MINGMING
a190048d55
enh(stream): reset table scan in reader (#33247) 2025-10-16 14:46:49 +08:00
wangmm0220
75e37f1389 enh(stream): fix default found by robot 2025-10-15 18:24:35 +08:00
wangmm0220
f1f994ff05 enh(stream): fix default found by robot 2025-10-15 18:18:46 +08:00
wangmm0220
c7f0635fe2 enh(stream): optimize logic of getting table list for stream reader & fix race condition in table list 2025-10-14 15:18:14 +08:00
WANG MINGMING
90b180fe96
fix(stream): [TD35698]decimal data error if snapshot is true (#33149) 2025-10-10 09:37:05 +08:00
WANG MINGMING
3dadce88b3
fix(stream): [TD35698]decimal data error if snapshot is true (#33189) 2025-10-10 09:37:00 +08:00
WANG MINGMING
558928cbe1
feat(stream): optimize stream logic (#33027)
* fix: remove debug log

* fix: remove assert

* fix: delete unused code

* enh: [TD-37251] Support expr in state window.

* feat(stream): support expr in state window trigger

* enh: [TD-37251] Fix SCL_IS_CONST_CALC condition.

* fix(stream): set ver in wal

* fix: print code

* fix: increase runner replica num

* fix: trigger mem error

* fix: sliding _tnext_ts value

* fix(stream): disable tagFilterCache in stream reader trigger

* fix: crash

* Revert "fix(stream): fix history calc finish check"

This reverts commit f93d17f1d2.

* Revert "fix(stream): fix calc request allocation in trigger"

This reverts commit c5410f6da0.

* fix(stream): fix calc request allocation in trigger

* enh: [TD-37251] External window support more placeholder.

* fix(stream): modify size of return from 1000000->4096

* enh: [TD-37251] Modify error msg when stream query do not have from clause.

* fix(stream): add log for group not found

* fix(stream): do not return gid=0 in walMetaData interface

* enh: [TD-37251] Fix missing ts column in vtable query.

* fix: test case build failed

* fix: invalid read issue

* fix(stream): add vtable logic

* fix(stream): encode error in wal

* fix(stream): add vtable logic

* fix(stream): add log

* fix: diff funcition crash

* Revert "Merge branch 'enh/TD-37251-3.0-dropoutput' into enh/TD-37251-3.0"

This reverts commit e93cbd6fd4, reversing
changes made to dc3230591d.

* Revert "Merge branch 'enh/TD-37251-3.0-vtable' into enh/TD-37251-3.0"

This reverts commit dc3230591d, reversing
changes made to 085e086782.

* fix(stream): fix block data len is too large if data type is vchar

* fix: drop output table

* feat: runner delete output table

* process pDropBlock in trigger task.

* fix(stream): opti log level

* fix(stream): build block for drop table

* fix(stream): set gid for normal table

* fix(stream): set gid for normal table

* feat: Support delete output.

* fix(stream): rows error

* fix(stream): memory leak

* enh: [TD-37251] Fix external window wrong ts column.

* fix(stream): fix calc time check in batch mode

* fix: merge aligned external window issue

* Revert "fix(stream): fix calc time check in batch mode"

This reverts commit d895b7f577.

* fix(stream): add test case

* fix(stream): add insert drop table logic

* fix: external window end issue

* fix(stream): add test case

* fix(stream): fix trigger pull data

* fix(stream): fix history calc request

* enh: drop table on snode

* fix(stream): adjust hash index if data is filtered in wal

* fix(stream): rollback

* enh: add merge aligned extwin window row idx

* fix: drop output table

* fix: compile issue

* enh: [TD-37251] Add flag to identify interval window is overlapped

* fix: overlap

* fix(stream): set gid=-1 for initialized

* fix(stream): modify log level

* fix: trigger slow issue

* fix(stream): add basic test for obj pool

* fix(stream): fix metadata clear in trigger

* fix(stream): fix idle runner allocation in trigger

* fix: handle agg output on externalWin

* fix: test case

* fix(stream): adjust log

* fix: reset pCtx pOutput

* fix: memory leak

* fix: search first win for tsCol

* fix(stream): add test case for schema change

* fix: mem leak

* fix: mem leak

* Reapply "Merge branch 'enh/TD-37251-3.0-vtable' into enh/TD-37251-3.0"

This reverts commit b508e66958.

* fix(stream): fix virtual table data pull

* fix(stream): fix set table request

* fix(stream): process empty uidlist

* fix(stream): fix set table request

* fix(stream): fix data new request in trigger

* fix(stream): tablelist error for vtable

* fix(stream): block ver is null

* fix(stream): remove version limition for wal

* fix(stream): block rows error

* fix(stream): fix pending calc param in batch mode

* fix(stream): auto create table

* fix(stream): fix stream vtable data merge

* fix: _tcurrentts

* fix(stream): destroy hash

* fix(stream): fix trigger status

* fix(stream): colId error in vtable

* fix(stream): update nrows of vtable data block

* fix(stream): fix trigger status

* fix(stream): enable low latency calc for period trigger

* fix: test case file path

* fix: test case file path

* fix: string to node in reader

* enh: add test log

* fix(stream): increase wait time of non-low-latency mode

* fix(stream): fix column capacity in scalar calculation

* fix(stream): fix column capacity in trigger expr calculation

* fix: get origTableInfos

* fix(stream): fix calc data pull in trigger

* fix(stream): fix calc data cache write in trigger

* enh: [TD-37251] Add flag to identify interval wind

* fix: external window memory usage issue

* fix(stream): fix epxr result column in trigger

* fix(stream): add metaCache for calc plan

* fix(stream): fix stream obj list clear

* fix(stream): rollback

* enh: [TD-37251] Add flag to identify interval wind

* fix: mem free

* fix(stream): add metaCache for calc plan

* fix(stream): fix calc data cache write in trigger

* fix(stream): fix calc data cache write in trigger

* enh: optimize external result block memory

* fix(stream): modify logic of judge table for create table

* fix(stream): fix event window check in trigger

* fix(stream): fix count window check in trigger

* fix(stream): colSize=0 while encoding block because pDataCol->hasNull is false in secode time & reload table list if create table

* enh: optimize stream memory

* fix(stream): trigger tag error

* fix: add log

* fix(stream): fix calc data write in trigger

* fix: drop output table

* fix(stream): fix max delay in trigger

* fix: drop output table

* fix(stream): fix max delay in trigger

* fix(build): handle return value of function

* fix(stream): read gid error if it is child table in stream

* fix(stream): fix calc param of history calculation

* fix(stream): fix recalc of delete data

* fix(stream): fix calc data of period trigger

* fix(stream): fix cache read check

* fix(stream): filter error in calc plan

* fix: reset externla window expr

* fix(stream): fix calc parm of max delay

* fix: time range and case issues

* fix(stream): fix crash in trigger

* fix: case issues

* fix: fix window node mem leak.

* fix(stream): fix meta data clear in trigger

* fix(stream): table schema is old in TsdbDataRequest for vtable

* fix: fix slingding window place holder check condition.

* Revert "fix: fix slingding window place holder check condition."

This reverts commit ad864a1dc1.

* fix(stream): null pointer error

* fix: case issue

* fix(stream): calc data error for vtable

* fix(stream): fix data sorter in trigger

* fix(stream): add log for delete data

* fix(stream): fix start version of realtime calculation

* fix(stream): fix cache data merger of vtable

* fix: case issues

* fix(ci): upgrade stream cases in test_cols_function

* fix(stream): gid not found if change tag value

* fix: fix slingding window place holder check condition.

* fix(stream): fix virt table info request in trigger

* fix(stream): set gid = uid if stream table type != SUPER table

* fix: clean cache data by group

* fix: add block info and case issues

* fix: fix heap-buffer-overflow.

* fix(stream): fix state window with extend param

* fix: fix access null pointer.

* fix: case issues

* fix: case issue

* fix(stream): fix ignore_nodata_trigger option for period trigger

* fix(stream): fix pseudo col fetch for calc data

* fix: Extend checking time to avoid timeout.

* fix: case issues

* fix(stream): fix group col fetch for virtual tables

* fix(stream): tag is NULL for non vtable

* fix(stream): fix sliding check of virtual table

* test(stream): check stream status after create all streams

* fix: add log

* fix(stream): fix wal meta truncate when ignore disorder

* fix(stream): gid not found for child table

* fix: fix place holder condition pushdown error.

* fix(stream): suid not equal when delete data for child table

* fix: id issue

* fix(stream): disable recalc for count trigger

* fix: cast result rowSize error in project

* fix(stream): add log for tsdb meta

* fix(stream): fix gid in tsdb meta request

* fix(stream): fix wend of unclosed windows

* fix(stream): fix ignore_nodata_trigger option for period trigger

* fix: case issues

* fix(stream): fix calc data pull for empty interval window

* fix: fix ext window condition.

* fix(ci): smaBasic performance check affectd by debug level log

* fix(stream): add suid when set table list for vtable

* fix: forbid using prefilter when using %%trows an trigger table is virtual table.

* fix: forbid prefilter %%trows cases.

* fix(stream): sort cid in tsdbVirtalDataReq

* fix: forbid prefilter %%trows cases.

* fix(stream): add log for virtual table tsdb data

* fix(stream): get delete msg for vtable

* fix: winRowIndex

* Revert "fix: winRowIndex"

This reverts commit e08b41cf96.

* fix(stream): fix data merge in trigger

* test(stream): fix case ans

* fix(stream): fix empty calc data pull for period trigger

* fix(stream): col index error for tsdbVirtalDataReq

* fix(stream): pTableList is NULL for vtable

* test(stream): fix case ans

* fix(stream): fix notification in trigger

* fix(stream): memory leak

* fix(stream): fix virtual data pull in trigger

* test(stream): fix case ans

* fix(stream): col index error for tsdbVirtalDataReq

* fix(stream): pTableList is NULL for vtable

* test(stream): fix case ans

* fix(stream): fix notification in trigger

* fix(stream): memory leak

* fix(stream): fix virtual data pull in trigger

* test(stream): fix case ans

* fix: case issue

* fix: crash issue

* fix: forbid prefilter %%trows cases.

* fix(stream): session case

* fix(stream): fix data pull for virtual tables

* fix(stream): add log

* fix(stream): fix calc req send in batch mode

* fix: fix stream UT

* fix(stream): tablelist is null for non vtable

* fix: mem leak

* fix(stream): fix compile error in trigger

* fix: return code issue

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
2025-09-25 15:48:14 +08:00
Jing Sima
72d3189367
feat: [TD-37052] Handle origin table's vnode change in stream query. (#32931) 2025-09-10 16:12:11 +08:00
Haojun Liao
5975c363cd
fix(gpt): fix race-condition in preparing tmp files (#32800) 2025-08-29 14:36:36 +08:00
xinsheng Ren
96e5d1e442
fix: check output tbname calc result (#32559)
* fix: check output tbname calc result

* fix: check return code

* fix: return code

* fix: test case time  out
2025-08-13 16:23:35 +08:00
xinsheng Ren
5eef3b8fed
fix: datainserter supports concurrent writing to the same group (#32384) 2025-08-06 13:40:54 +08:00
Jinqing Kuang
bf53db276b fix(stream): fix history data pull in trigger task 2025-07-26 15:25:25 +08:00
wangmm0220
a7d4954467 fix(stream): pTableList is empyt 2025-07-23 17:37:39 +08:00
wangmm0220
16d33ba134 fix(stream): pTableList is empyt 2025-07-23 17:35:50 +08:00
wangmm0220
b71e6d863a fix(stream): pTableList is empty 2025-07-23 15:42:05 +08:00
facetosea
df6d082b64 fix: output tbname contains a dot 2025-07-22 16:04:24 +08:00
wangmm0220
dfdd6fde04 fix(stream): batch get block when fetch data in stream reader 2025-07-21 14:57:37 +08:00
wangmm0220
a8d421a3e3 fix(stream): batch get block when fetch data in stream reader 2025-07-21 13:40:28 +08:00
Pan Wei
7d6d64890e
fix: exchange issues (#31986)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

* fix: add debug log

* fix: conflict

* fix: create stream if not exists issue

* fix: ahandle memory leak

* fix: case issue

* fix: exchange issues

* fix: crash issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-18 08:06:26 +08:00
WANG MINGMING
c2bcb30d00
Merge pull request #31956 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-17 15:51:05 +08:00
wangmm0220
2f21da6287 fix(stream): table name error 2025-07-17 13:37:03 +08:00
Pan Wei
a170f59dd2
fix: ahandle memory leak (#31955)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

* fix: add debug log

* fix: conflict

* fix: create stream if not exists issue

* fix: ahandle memory leak

* fix: case issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-17 13:26:02 +08:00
facetosea
a80a53259e fix: notify 2025-07-16 18:43:02 +08:00
facetosea
68e7360a45 fix: stack overflow 2025-07-16 15:12:26 +08:00
wangmm0220
dcc4a6d1de fix(stream): opti wal interface 2025-07-14 14:40:59 +08:00
wangmm0220
c0587893d7 feat(stream): ts condition error in vtable scan & remove code of old stream 2025-07-11 16:48:04 +08:00
wangmm0220
25dd06bc50 feat(stream): fix tmq error 2025-07-10 14:20:35 +08:00
facetosea
20be65d8c6 fix: memcpy c string 2025-07-10 02:08:03 +08:00
facetosea
82d0a769d7 fix: tbname cpy 2025-07-10 01:44:22 +08:00
facetosea
882a9f23d5 fix: tbname too long 2025-07-09 16:19:39 +08:00
wangmm0220
9da567453a fix(stream): set table scan operator param in vtable scan & fix filter error 2025-07-08 14:30:18 +08:00
facetosea
5195fbc1a1 fix: force output 2025-07-07 19:07:09 +08:00
WANG MINGMING
68d94bb85c
Merge branch 'feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-03 15:05:11 +08:00
wangmm0220
da400252e8 feat(stream): fix sarray init error in vTableInfo & optimize getting tsdb meta info for vtable 2025-07-03 14:59:30 +08:00
Pan Wei
f6ab877e05
fix: case memory issues (#31621)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-03 13:26:22 +08:00
Pan Wei
5e9606f5bb
fix: memory issues (#31561)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues
2025-07-01 08:38:36 +08:00
wangmm0220
564d585619 feat(stream): fix err that no rtInfo in stream fetch 2025-06-28 11:47:31 +08:00