Commit graph

6505 commits

Author SHA1 Message Date
Jing Sima
b25d39c034 feat: [TS-6100] Fix virtual table set null slot 2025-07-17 09:54:17 +08:00
wangmm0220
57651a4bad Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-17 09:16:57 +08:00
wangmm0220
8eb2e55df0 fix(stream): add log 2025-07-17 09:16:42 +08:00
facetosea
a80a53259e fix: notify 2025-07-16 18:43:02 +08:00
wangmm0220
a6c168220c Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-16 17:55:06 +08:00
wangmm0220
286383afc2 fix(stream): add log 2025-07-16 17:55:00 +08:00
Jing Sima
975e4f697e feat: [TS-6100] Fix %%tbname when using virtual super table 2025-07-16 16:41:40 +08:00
facetosea
68e7360a45 fix: stack overflow 2025-07-16 15:12:26 +08:00
Pan Wei
bcc25e56bc
feat: new stream (#31678)
* fix: windows compile issue

* test: add vtable cases (#31829)

* fix: windows compile issues

* test:add test cases

* fix: windows compile issue

* case: em-4 stream case submit

* test: stream4_sub1 found bug2

* test: submit test_scene_meters_bug2.py

* add stream parameters example

* feat: [TS-6100] Do not translate const value as column.

* Feat/ts 6100 3.0 zlv (#31747)

* modify asan exampel

* modify asan exampel

* add example

* add example

* modify case example

---------

Co-authored-by: zelv01 <1101510017@qq.com>

* feat(stream): fix memory leak

* modify sliding example

* test: update test case.

* feat(stream): fix conflicts

* fix: add offset case 10a 10s 10m 10h 10d

* feat(stream): fix conflicts

* chore(stream): rename case name #TS-6100

* add case

* modify example

* fix: windows compile issues

* fix: data null check

* feat: [TS-6100] Forbid where when using %%trows (#31827)

* feat: [TS-6100] Forbid where when using %%trows

* test: update cases

* feat: [TS-6100] Fix leaks.

---------

Co-authored-by: Simon Guan <guanshengliang@qq.com>

* test: reproduce bugs

* test: update test case.

* test: update test case.

* feat: [TS-6100] Fix leaks.

* test: add cases

* Feat/ts 6100 3.0.pw10 (#31841)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* test: reproduce bugs

* fix: add sliding interval combine case

* test: add cases

* test: add recalc test.

* test: reproduce bugs

* case : add vt ts is null check

* modify case

* bug: submit test_idmp_meters_bug3.py

* test: add test for recalc.

* test: add cases

* fix: error code check

* test: add cases

* fix(stream): scan wal with schema in that version

* add case

* test: add cases

* test: update test case.

* fix: windows compile issues

* add case

* test: add cases (#31845)

* modify case

* fix: reset interpPrev

* test: add test_idmp_meters bug4 and bug3

* add case

* fix(stream): opti wal interface

* fix: remove test_idmp_meters_bug5.py

* test: add cases

* fix(stream): fix ts data fetch for virtual tables

* cancel asan case

* test: update test case.

* test: update test case.

* add case

* test: add cases

* test: add cases

* test: add case test_idmp_meters_bug5.py

* test: update test case.

* fix(stream): tmq error

* test: add cases

* feat: [TS-6100] Restore deleted code in mndSma.c since they are still in use.

* fix(stream): optimize val scan logic

* test: add test_recalc_expired_time.py  to ci.

* test: update test case.

* test: update test case.

* feat: [TS-6100] Fix fill range check

* fix(stream): optimize val scan logic

* add case

* test: modify for partition by %%1

* test: add fun case stream4_sub7

* fix(stream): optimize val scan logic

* add case

* feat: [TS-6100] Rename OPTIONS to STREAM_OPTIONS.

* test: add test for recalc.

* test: use stream_options.

* fix: some cases error.

* test: remove recalc from ci.

* fix: ci case issues (#31880)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* fix(stream): fix compilation error

* fix(stream): optimize val scan logic

* test:add test cases

* test: modify case

* fix: external agg error

* test(stream): tobacco scene testing #TD-36514

* test: add stream cases (#31885)

* fix: windows compile issue

* fix: calc timerange

* fix: windows compile issue

* modify case

* fix(stream): compile error

* test: remove one debug test case file

* test: modify

* test: add test cases

* test: reproduce bugs

* test: reproduce bugs

* feat: [TS-6100] Placeholder function should only appera in SELECT and… (#31868)

* feat: [TS-6100] Placeholder function should only appera in SELECT and WHERE and FROM.

* test: update case

---------

Co-authored-by: Simon Guan <guanshengliang@qq.com>

* add example

* add example

* modify case example

* modify case

* test:alter sql

* test: add stream5 case

* fix(stream): get schema error with version

* test: add delete recalc test py.

* test: remove bug cases

* test: stream5 case test passed

* test: add state cases (#31893)

* fix(stream): compile error

* test: modify case

* test: add cases

* test: add test.

* test: update test case.

* chore(test): fix case err

* test: update test case.

* fix: align data get

* fix(stream): fix row index of datablock written into data cache

* fix: put align data

* test: update test case.

* test: add test cases for virtual table

* chore(test): fix case err #TD-36514

* add case

* test: add test for water mark.

* test: add meters bug6 for stream5

* test: add cases (#31903)

* test: add test for recalc.

* feat: [TS-6100] %%trows can only be used when event type is window close.

* test: add precision of database for ms/us/ns

* modify case

* add case

* add case

* test: add test to ci.

* modify case

* fix: ci case issues (#31904)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* fix(stream): ci error

* test: update test case.

* feat: [TS-6100] Disable some failed UT.

* feat: [TS-6100] Fix virtual table

* test: add bug 5.

* test: add test delete recalc to ci.

* test: add bug 6.

* test(stream): tobacco scene #TD-36514

* fix: reqCids,reqCols memory leak in SSTriggerRealtimeContext

Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>

* test: add case stream6

* fix(stream): implement some pending features in trigger task

* modify case

* modify case

* fix: case issues

* modify case

* test: add recalc for warter mark.

* fix(stream): fix count window trigger of virtual tables

* fix(stream): memory leak

* test: fix run err.

* test: add stream6 bug7

* fix: adjust format

* test(stream): tobacco scene testing #TD-36514

* test: change bug7 with update window1 and 2

* test: add test bug 7.

* case: restore write 3 window

* fix: windows compile issue

* fix: notify

* test: add cases

* modify case

* test: update test case.

* test(stream): toobacco scene testing #TD-36514

---------

Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: plum-lihui <huili@taosdata.com>
Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: zelv01 <1101510017@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: xiangyang guo <66111494+happyguoxy@users.noreply.github.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: zyyang90 <zyyang@taosdata.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Li Hui <52318143+plum-lihui@users.noreply.github.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: xiao-77 <berylbao@taosdata.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: happyguoxy <happy_guoxy@163.com>
Co-authored-by: Tony Zhang <34825804+Tony2h@users.noreply.github.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
2025-07-16 14:42:16 +08:00
Jing Sima
84da33463a feat: [TS-6100] Fix virtual table 2025-07-15 17:58:53 +08:00
Pan Wei
a4e6954153
fix: ci case issues (#31904)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-15 17:27:46 +08:00
dapan1121
8a2fd5c6f9 fix: windows compile issue 2025-07-15 08:37:12 +08:00
xinsheng Ren
373f22348d
Merge pull request #31886 from taosdata/fix/6100/externalAggError
fix: external agg error
2025-07-15 05:17:54 +08:00
WANG MINGMING
47d6f0f717
Merge pull request #31864 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-14 21:43:56 +08:00
xinsheng Ren
6c717796c3
Merge branch 'feat/TS-6100-3.0' into fix/6100/externalAggError 2025-07-14 20:51:31 +08:00
facetosea
862e36d0b7 fix: external agg error 2025-07-14 20:41:03 +08:00
Jinqing Kuang
91b6a83ebd Merge branch '3.0' into feat/TS-6100-3.0 2025-07-14 19:31:48 +08:00
Pan Wei
fe6d9c59e0
fix: ci case issues (#31880)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-14 19:15:21 +08:00
wangmm0220
c3586a6684 fix(stream): optimize val scan logic 2025-07-14 17:18:46 +08:00
Bomin Zhang
876979b5f5
feat[ts-6107]: shared storage (#31552)
* add API to use s3 as shared storage

* support using local file system as shared storage

* upload file to shared storage

* support read, compact and drop

* finish basic mnode & vnode msg processing

* follower sync migration state

* implement mnode transaction, and improve log

* send migration progress msg to dnode to avoid deadlock

* implement following migration

* remove mcount

* avoid redo migration on startup

* avoid follower deadlock when leader is down

* trigger migrate by timer,  avoid compact after migration

* comment out the usage of 'tcs' functions in stream

* change config item prefix from s3 to ss

* change db option prefix from s3 to ss

* rename s3 data struct, function, file to ss

* rename s3 macro to ss

* update s3 sql to ss

* rename remaining s3 items to ss

* check ss configruation, improve s3 retry

* grant object storage -> shared storage,  check ssEnabled

* fix memory leaks

* update build options

* omit sensitive information when dump config

* fix backward compatibility issue

* fix issues found in ci-checks

* fix some failed test cases

* avoid follower timeout and improve log

* fix: follower timeout because migration status not updated

* refuse migration if there's an in progress one

* fix ss test case

* remove garbage files and other minor improvement

* fix failed test cases

* update unit test

* fix failed test case

* fix failed test case

* update document

* update document and fix failed test cases

* fix minor issues in code, test and document

* check new commit after migration task is scheduled

* fix several issus

1. migrate information cannot be dropped sometimes because progress response was put into read queue.
2. memory leak in rare cases
3. data corruption in rare cases
4. failed test case

* add shared storage upgrade tool

* fix compile error
2025-07-14 16:33:53 +08:00
wangmm0220
9d29d8ca60 fix(stream): tmq error 2025-07-14 16:12:41 +08:00
xinsheng Ren
310fddfa49
Merge pull request #31861 from taosdata/fix/6100/resetInterpPrev
fix: reset interpPrev
2025-07-14 14:49:42 +08:00
wangmm0220
3cdd41b27f fix(stream): conflicts 2025-07-14 14:46:08 +08:00
wangmm0220
dcc4a6d1de fix(stream): opti wal interface 2025-07-14 14:40:59 +08:00
facetosea
47aef8e042 fix: reset interpPrev 2025-07-14 13:59:07 +08:00
dapan1121
b85b8398bb fix: windows compile issues 2025-07-14 11:50:56 +08:00
Jing Sima
375d49a823 feat: [TS-6100] Fix leaks. 2025-07-12 19:05:15 +08:00
facetosea
32f64aff89 fix: data null check 2025-07-12 17:47:51 +08:00
dapan1121
49b761037f fix: windows compile issues 2025-07-12 17:38:14 +08:00
dapan1121
ee7f3a3a2b fix: windows compile issue 2025-07-12 13:57:42 +08:00
Pan Wei
4c2ae9bd73
fix: external window and msg response issues (#31825)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-12 11:08:37 +08:00
WANG MINGMING
585324ceec
Merge pull request #31806 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-11 17:33:25 +08:00
wangmm0220
f85fc43c8f feat(stream): ts condition error in vtable scan & remove code of old stream 2025-07-11 16:50:27 +08:00
wangmm0220
c0587893d7 feat(stream): ts condition error in vtable scan & remove code of old stream 2025-07-11 16:48:04 +08:00
Pan Wei
2e3cbf4aa9
fix: placeholder function issues (#31789)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-11 13:55:15 +08:00
facetosea
e100ffa4d8 fix: out put ts is null 2025-07-11 11:13:43 +08:00
WANG MINGMING
92941deab9
Merge pull request #31778 from taosdata/feat/TS-6100-3.0-mm
feat(stream): fix dead lock
2025-07-10 18:56:26 +08:00
Jing Sima
e1b4fa198c feat: [TS-6100] Fix tbname/tag query of vtable. 2025-07-10 18:24:46 +08:00
wangmm0220
feb0986cf5 feat(stream): fix dead lock 2025-07-10 17:57:57 +08:00
wangmm0220
25dd06bc50 feat(stream): fix tmq error 2025-07-10 14:20:35 +08:00
Simon Guan
de85dad2a4
fix: comile error if without BUILD_CONTRIB (#31756) 2025-07-10 08:44:08 +08:00
xinsheng Ren
7ed0a24293
Merge pull request #31744 from taosdata/fix/6100/tbnametoolong
fix: tbname too long
2025-07-10 07:07:26 +08:00
facetosea
20be65d8c6 fix: memcpy c string 2025-07-10 02:08:03 +08:00
facetosea
82d0a769d7 fix: tbname cpy 2025-07-10 01:44:22 +08:00
Pan Wei
6cea090c86
fix: memory issues and case issues (#31743)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-09 18:57:01 +08:00
Jing Sima
2133d47fd0 feat: [TS-6100] Fix vstable scan plan 2025-07-09 18:16:00 +08:00
facetosea
882a9f23d5 fix: tbname too long 2025-07-09 16:19:39 +08:00
Jing Sima
a12a9d80d9
feat: [TS-6100] Fix vtable scan wrong plan and fix mem leak (#31721) 2025-07-09 08:57:06 +08:00
WANG MINGMING
88ede44898
Merge pull request #31706 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-08 23:43:43 +08:00
Mario Peng
808d720c1d
feat:insert into subquery (#31401) (#31710) 2025-07-08 17:26:34 +08:00
facetosea
2059de7d7a fix: _rowts in external window 2025-07-08 16:32:49 +08:00
Jing Sima
dd75d09bb2 feat: [TS-6100] Fix wrong vgid for tagscan 2025-07-08 15:14:29 +08:00
wangmm0220
30c692309c Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-08 14:30:25 +08:00
wangmm0220
9da567453a fix(stream): set table scan operator param in vtable scan & fix filter error 2025-07-08 14:30:18 +08:00
facetosea
9693811885 fix: free tbname when quit 2025-07-08 12:56:29 +08:00
facetosea
76debd11c9 fix: tbname 2025-07-08 11:46:19 +08:00
facetosea
c3b49fd4c9 fix: taosStrdup 2025-07-08 11:34:21 +08:00
facetosea
4ced603aed fix: tbname cache 2025-07-08 11:17:25 +08:00
dapan1121
788a5d603f fix: return code issue 2025-07-08 10:24:27 +08:00
dapan1121
2940936108 fix: remove assert 2025-07-08 08:32:38 +08:00
facetosea
5195fbc1a1 fix: force output 2025-07-07 19:07:09 +08:00
Jinqing Kuang
968eeeeb0b Merge branch '3.0' into feat/TS-6100-3.0-merge 2025-07-07 18:04:02 +08:00
Jing Sima
a33a74f412 feat: [TS-6100] Fix mem leak in virtualscan operator. 2025-07-07 17:39:52 +08:00
Pan Wei
e3b186eeff
fix: memory issues (#31671)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-05 18:15:00 +08:00
facetosea
d1bd2b3ee8 fix: group key buff length 2025-07-05 14:23:39 +08:00
wangmm0220
437ed4e2a7 fix(stream): tsIndex error in trigger & runner thread wait because wait use db response 2025-07-05 11:37:34 +08:00
Pan Wei
c97339751b
fix: virtual table address list issue (#31657)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-05 10:17:22 +08:00
wangmm0220
4c4c3a8652 fix(stream): fix reset error in vtablescanoperator & modify log 2025-07-04 18:10:32 +08:00
wangmm0220
520d23a61f fix(stream): fix conflicts 2025-07-04 16:00:38 +08:00
wangmm0220
b7b247beff feat(stream): add limit for external 2025-07-04 15:38:01 +08:00
Jing Sima
179e5c0a5c feat: [TS-6100] Do not generate external window when query has limit. 2025-07-04 15:31:48 +08:00
Jing Sima
a7adc8042f feat: [TS-6100] Support TSMA: Part 1. 2025-07-04 13:31:48 +08:00
Pan Wei
04b8b5e29a
fix: memory issues (#31647)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-04 11:17:39 +08:00
facetosea
57be094d9e fx: invalid vgroup 2025-07-04 10:24:02 +08:00
facetosea
b57ce4f4b4 fix: mem leak 2025-07-03 15:56:15 +08:00
WANG MINGMING
68d94bb85c
Merge branch 'feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-03 15:05:11 +08:00
wangmm0220
da400252e8 feat(stream): fix sarray init error in vTableInfo & optimize getting tsdb meta info for vtable 2025-07-03 14:59:30 +08:00
xinsheng Ren
29036058f8
Merge pull request #31619 from taosdata/feat/6100/filterReset
fix: filter needn't reset
2025-07-03 13:32:11 +08:00
Pan Wei
f6ab877e05
fix: case memory issues (#31621)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-03 13:26:22 +08:00
facetosea
c2a494541b fix: filter needn't reset 2025-07-03 11:12:45 +08:00
Simon Guan
fc2fec02c7
merge: from main to 3.0 branch (#31562) 2025-07-03 09:15:59 +08:00
WANG MINGMING
925432acb1
Merge pull request #31597 from taosdata/feat/TS-6100-3.0
Feat/ts 6100 3.0
2025-07-02 14:12:29 +08:00
wangmm0220
547949b3a9 feat(stream): fix tsIndex error in externalAlignedWindow 2025-07-02 14:03:00 +08:00
Pan Wei
4270f35fb9
fix: crash and memory issues (#31588)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-02 10:14:55 +08:00
facetosea
cf2a932034 fix: get vginfo 2025-07-01 23:06:56 +08:00
Pan Wei
cf0f3c908c
fix: memory issues (#31579)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-01 18:58:32 +08:00
facetosea
33dd18b95e log: format 2025-07-01 17:57:42 +08:00
Jing Sima
8e0fff8991 feat: [TS-6100] Do not eliminate sort node when having external window. 2025-07-01 14:58:06 +08:00
facetosea
61d587fd33 fix: fill 2025-07-01 09:16:43 +08:00
Pan Wei
5e9606f5bb
fix: memory issues (#31561)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues
2025-07-01 08:38:36 +08:00
facetosea
1064dbe38a fix: fill 2025-06-30 17:34:39 +08:00
wangmm0220
564d585619 feat(stream): fix err that no rtInfo in stream fetch 2025-06-28 11:47:31 +08:00
dapan1121
feabdc7be9 fix: crash issues 2025-06-27 18:42:21 +08:00
dapan1121
21f8fd2518 fix: remove assert 2025-06-27 17:52:30 +08:00
facetosea
32dcf48b17 fix: runner get data finished 2025-06-27 17:40:39 +08:00
dapan1121
566e1f46af Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw9 2025-06-27 14:59:13 +08:00
dapan1121
deb16a0639 Merge remote-tracking branch 'origin/feat/TS-6100-3.0.001' into feat/TS-6100-3.0.pw9 2025-06-27 14:24:00 +08:00
facetosea
e9d3794317 fix: crash 2025-06-27 14:16:44 +08:00
dapan1121
b6e07d7cb5 fix: reader crash issue 2025-06-27 13:44:23 +08:00
facetosea
6e79d56370 fix: data inserter crash 2025-06-27 13:42:10 +08:00
dapan1121
77ffdfab71 fix: debug issue 2025-06-27 11:15:01 +08:00
facetosea
0fc2091ca3 fix: crash 2025-06-27 09:55:48 +08:00
dapan1121
1d8c4eb642 fix: add debug log 2025-06-27 09:49:15 +08:00
facetosea
8462a1055f feat: get vginfo for exec 2025-06-26 18:34:18 +08:00
facetosea
782e11dfea fix: fill loop quit 2025-06-26 15:31:34 +08:00
facetosea
954b7dea12 fix: get dbvg info 2025-06-26 10:55:45 +08:00
Haojun Liao
bbeffc59b7
fix(gpt): dynamic allocate the option buffer and remove the limitation on the option serialization. (#31482) 2025-06-26 10:13:38 +08:00
zelv01
dfa1afc47b Merge branch 'feat/TS-6100-3.0' of github.com:taosdata/TDengine into feat/TS-6100-3.0 2025-06-25 18:38:31 +08:00
Jing Sima
a177e75195 feat: [TS-6100] Improve external window condition. 2025-06-25 16:33:02 +08:00
Jing Sima
b0a33e37be feat: [TS-6100] Fix vtable tag error when tag is null 2025-06-25 10:31:31 +08:00
facetosea
7c068ee472 fix: set datainsert msg to vnode 2025-06-24 17:17:29 +08:00
zelv01
3a4720fb51 Merge branch 'feat/TS-6100-3.0' of github.com:taosdata/TDengine into feat/TS-6100-3.0 2025-06-24 17:11:01 +08:00
Jing Sima
1f6470b7f0 feat: [TS-6100] Parse create stream sql: Add more serialize/deserialize 2025-06-24 15:59:58 +08:00
zelv01
fd24e18743 Merge branch 'feat/TS-6100-3.0' of github.com:taosdata/TDengine into feat/TS-6100-3.0 2025-06-24 14:17:20 +08:00
facetosea
1c5fd414d5 log: add log 2025-06-24 14:10:38 +08:00
Jinqing Kuang
85fad8e178 Merge branch '3.0' into temp 2025-06-23 18:08:09 +08:00
wangmm0220
527d93732f fix(stream): interval reset error & checkpoint 2025-06-23 17:47:24 +08:00
wangmm0220
8669fd7863 fix(stream): interval reset error & checkpoint 2025-06-23 17:10:38 +08:00
Jing Sima
6696b73042 feat: [TS-6100] Parse create stream sql: remove table list info in virtual scan operator. 2025-06-23 16:42:02 +08:00
facetosea
ac69b80801 fix: runner table name error 2025-06-23 10:36:26 +08:00
wangmm0220
d0abd81a19 fix(stream): error in interval reset 2025-06-23 09:46:43 +08:00
facetosea
07a6a7a1eb fix: data insert using null tag 2025-06-23 09:13:19 +08:00
wangmm0220
705e3899fc fix(stream): reset operator 2025-06-21 18:03:09 +08:00
Jing Sima
40a714a020 feat: [TS-6100] Parse create stream sql: change virtual table plan 2025-06-21 17:29:36 +08:00
Mario Peng
c65e1592fa
feat:insert into subquery (#31401) 2025-06-21 15:11:09 +08:00
wangmm0220
e7bcb19e50 fix(stream): reset operator 2025-06-21 14:32:22 +08:00
WANG MINGMING
045e1cbdf3
Merge pull request #31453 from taosdata/feat/TS-6100-3.0
Feat/ts 6100 3.0
2025-06-21 13:53:00 +08:00
Simon Guan
55b1f90433
Merge pull request #31424 from taosdata/merge/3.0tomain2
merge: from 3.0 to main branch
2025-06-20 17:49:54 +08:00
Haojun Liao
e35ea17566
fix(gpt): fix error when the primary key exists. (#31418) 2025-06-20 15:54:59 +08:00
wangmm0220
458cca1a98 fix(stream): groupid error 2025-06-20 13:39:25 +08:00
wangmm0220
87936a69ff fix(stream): data error in external align window 2025-06-19 20:29:54 +08:00
facetosea
1dd505b570 enh: put data log 2025-06-19 18:08:16 +08:00
Jinqing Kuang
411fc7fb52 fix(stream): fix unclosed window of history calc 2025-06-19 15:31:29 +08:00
facetosea
2aed4fca48 fix: data inserter cache key 2025-06-19 10:52:55 +08:00
facetosea
ee5da7d522 fix: log 2025-06-19 10:03:01 +08:00
wangmm0220
0cd27abc71 fix(stream): pWin is NULL in external window 2025-06-18 20:11:55 +08:00
wangmm0220
257db6b7f2 fix(stream): coredump if there is case when in stream tag 2025-06-18 17:56:29 +08:00
wangmm0220
2b2178e5e6 fix(stream): add logic of resetting operator 2025-06-18 17:39:59 +08:00
facetosea
061137c11a fix: data insert suid error 2025-06-18 17:05:06 +08:00
facetosea
b15d94fd90 fix: datainserter cache 2025-06-18 13:56:27 +08:00
wangmm0220
4cfa5c4c57 fix(stream): partition by tbname and other tags 2025-06-17 09:32:33 +08:00
Simon Guan
f691365426 Merge branch 'main' into merge/mainto3.0 2025-06-14 10:32:34 +08:00
wangmm0220
395ee23fe8 fix(stream): add logic of resetting operator 2025-06-12 16:56:21 +08:00
facetosea
08ba1864a3 fix: spell error 2025-06-07 17:57:07 +08:00
Haojun Liao
5b9f09b643
fix(gpt): set the return type to be double. (#31308) 2025-06-07 14:00:54 +08:00
wangmm0220
867625ff4b fix(stream): add logic of %%tbname & checkpoint 2025-06-06 19:43:44 +08:00
Haojun Liao
e725e4ab24
fix(gpt): update the timeout parameter. (#31267) 2025-06-06 17:22:46 +08:00
Haojun Liao
952944e269
fix(gpt): support dynamic_real parameter for forecasting (#31297) 2025-06-06 16:27:36 +08:00
wangmm0220
4572c0243d fix(stream): add logic for %%tbname 2025-06-05 17:26:09 +08:00
facetosea
34c85401a1 feat: data insert vgid changed 2025-06-05 16:23:07 +08:00
wangmm0220
3a82e07bc4 fix(stream): data error for external window & add pesudo function & multi instance for calc reader 2025-06-04 14:09:47 +08:00
wangmm0220
e7c84442dc fix(stream): add get tsdb/wal interface for vtable 2025-06-03 14:09:25 +08:00
facetosea
734e09a22f fix: table uid hash cache 2025-05-29 11:30:28 +08:00
facetosea
d587a3e3be Merge branch 'feat/TS-6100-3.0' of github.com:taosdata/TDengine into feat/TS-6100-3.0 2025-05-28 18:56:14 +08:00
wangmm0220
e6dfbf6295 fix(stream): add interface of get vtable info 2025-05-28 18:34:19 +08:00
facetosea
cdd445513e feat: data cache 2025-05-28 18:08:15 +08:00
factosea
6234b3a48b fix: build tschema 2025-05-28 16:31:09 +08:00
factosea
efc8187f28 fix: return submit res code 2025-05-27 18:25:56 +08:00
wangmm0220
9a398675ba fix(stream): support decimal in tag 2025-05-27 09:28:17 +08:00
wangmm0220
9772e9846c fix(stream): error if %%n with varchar tag 2025-05-26 19:56:41 +08:00
wangmm0220
3aa8c175f5 feat(stream): reset agg operator & reset tsdb reader in fetch request 2025-05-26 14:52:02 +08:00
Jinqing Kuang
cd5ef52a9d fix(stream): remove unused files 2025-05-26 09:38:40 +08:00
Jinqing Kuang
18566df281 Merge branch '3.0' into kjq-merge 2025-05-24 14:56:21 +08:00
wangmm0220
a716fabbbc feat(stream): set tag value in trigger cols 2025-05-22 15:45:57 +08:00
wangmm0220
2d717c3a4f feat(stream): set tag value in trigger cols 2025-05-22 15:38:32 +08:00
wangjiaming0909
a3ca501368 new-stream: runner remove comments 2025-05-21 00:50:15 +00:00
facetosea
20902279d3 fix: sversion when create subtable 2025-05-20 18:35:59 +08:00
facetosea
585a3a7960 fix: create table 2025-05-20 17:20:42 +08:00
facetosea
403b35a049 fix: create subtable 2025-05-20 16:19:38 +08:00
facetosea
3c27b2c14c feat: datainsert, super table 2025-05-20 14:27:17 +08:00
wangjiaming0909
0ffe9e55f3 stream runner force output impl 2025-05-20 03:13:22 +00:00
facetosea
1942ae210c feat: data sink 2025-05-17 18:25:41 +08:00
factosea
2860309b6c fix: crate subtable tags 2025-05-17 14:13:08 +08:00
Simon Guan
556e426880 Merge branch 'main' into merge/mainto3.0 2025-05-17 12:55:32 +08:00
wangmm0220
96ab95e33b feat(stream): add group values 2025-05-17 11:41:46 +08:00
wangjiaming0909
7ec1177168 fix runner agg external window calc error 2025-05-16 10:18:36 +00:00
Jinqing Kuang
aca888c6b7 fix(stream): pull group col value in stream trigger task 2025-05-16 17:12:01 +08:00
wangjiaming0909
0c402fbb38 new-stream: runner impl external window and force output 2025-05-16 08:29:34 +00:00
wangmm0220
a5007823b8 feat(stream): add ctime for getting wal meta 2025-05-16 16:14:42 +08:00
wangjiaming0909
5300a66f5e new-stream: runner impl 2025-05-16 01:41:31 +00:00
wangmm0220
39015385f9 feat(stream): add some logs 2025-05-16 09:23:52 +08:00
wangmm0220
88414a1b09 feat(stream): use TimeRangeExpr to filter data in tsdb reader 2025-05-15 19:07:42 +08:00
Haojun Liao
d31a9bd1d2 refactor: update the logs. 2025-05-15 17:52:26 +08:00
factosea
d37770936c fix: tag name 2025-05-15 16:02:40 +08:00
wangmm0220
0297c7be2c feat(stream): add ts slotid/blockId in external window 2025-05-15 14:22:46 +08:00
wangmm0220
9ffe95755b feat(stream): add interface of getting cols value of groupid 2025-05-15 10:03:57 +08:00
Haojun Liao
df067af08a refactor: update logs. 2025-05-15 09:43:07 +08:00
facetosea
a93c63053c feat: build insert data 2025-05-14 19:38:26 +08:00
wangjiaming0909
3db03588bd impl runner external window operator 2025-05-14 09:55:32 +00:00
wangjiaming0909
ef7d67efe0 new-stream: runner notification 2025-05-14 09:55:07 +00:00
facetosea
0a7ac81aeb fix: table schema version start from 1 2025-05-14 17:41:51 +08:00
facetosea
11760abea2 fix: subtable schema check when table has exist 2025-05-14 11:12:14 +08:00
Haojun Liao
380c3ac348 fix(stream): fix double release obj. 2025-05-13 11:35:52 +08:00
wangmm0220
5e7aed840e feat(stream): add filter if with external window 2025-05-13 10:53:39 +08:00
wangjiaming0909
bfdad60c2e new-stream: external window operator impl 2025-05-12 17:36:10 +08:00
dapan1121
a4869f5263 fix: compile issues 2025-05-12 17:14:35 +08:00
dapan1121
009e8aa41e Merge remote-tracking branch 'origin/3.0' into feat/TS-6100-3.0 2025-05-12 16:24:22 +08:00
Haojun Liao
558a6132e8 refactor: do some internal refactor. 2025-05-12 15:11:44 +08:00
facetosea
c913791ffb fix: clear decoder 2025-05-12 11:16:09 +08:00
facetosea
b0a9169dd7 fix: insertcallback, tdecoder clear 2025-05-12 11:06:52 +08:00