Commit graph

117 commits

Author SHA1 Message Date
Pan Wei
bcc25e56bc
feat: new stream (#31678)
* fix: windows compile issue

* test: add vtable cases (#31829)

* fix: windows compile issues

* test:add test cases

* fix: windows compile issue

* case: em-4 stream case submit

* test: stream4_sub1 found bug2

* test: submit test_scene_meters_bug2.py

* add stream parameters example

* feat: [TS-6100] Do not translate const value as column.

* Feat/ts 6100 3.0 zlv (#31747)

* modify asan exampel

* modify asan exampel

* add example

* add example

* modify case example

---------

Co-authored-by: zelv01 <1101510017@qq.com>

* feat(stream): fix memory leak

* modify sliding example

* test: update test case.

* feat(stream): fix conflicts

* fix: add offset case 10a 10s 10m 10h 10d

* feat(stream): fix conflicts

* chore(stream): rename case name #TS-6100

* add case

* modify example

* fix: windows compile issues

* fix: data null check

* feat: [TS-6100] Forbid where when using %%trows (#31827)

* feat: [TS-6100] Forbid where when using %%trows

* test: update cases

* feat: [TS-6100] Fix leaks.

---------

Co-authored-by: Simon Guan <guanshengliang@qq.com>

* test: reproduce bugs

* test: update test case.

* test: update test case.

* feat: [TS-6100] Fix leaks.

* test: add cases

* Feat/ts 6100 3.0.pw10 (#31841)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* test: reproduce bugs

* fix: add sliding interval combine case

* test: add cases

* test: add recalc test.

* test: reproduce bugs

* case : add vt ts is null check

* modify case

* bug: submit test_idmp_meters_bug3.py

* test: add test for recalc.

* test: add cases

* fix: error code check

* test: add cases

* fix(stream): scan wal with schema in that version

* add case

* test: add cases

* test: update test case.

* fix: windows compile issues

* add case

* test: add cases (#31845)

* modify case

* fix: reset interpPrev

* test: add test_idmp_meters bug4 and bug3

* add case

* fix(stream): opti wal interface

* fix: remove test_idmp_meters_bug5.py

* test: add cases

* fix(stream): fix ts data fetch for virtual tables

* cancel asan case

* test: update test case.

* test: update test case.

* add case

* test: add cases

* test: add cases

* test: add case test_idmp_meters_bug5.py

* test: update test case.

* fix(stream): tmq error

* test: add cases

* feat: [TS-6100] Restore deleted code in mndSma.c since they are still in use.

* fix(stream): optimize val scan logic

* test: add test_recalc_expired_time.py  to ci.

* test: update test case.

* test: update test case.

* feat: [TS-6100] Fix fill range check

* fix(stream): optimize val scan logic

* add case

* test: modify for partition by %%1

* test: add fun case stream4_sub7

* fix(stream): optimize val scan logic

* add case

* feat: [TS-6100] Rename OPTIONS to STREAM_OPTIONS.

* test: add test for recalc.

* test: use stream_options.

* fix: some cases error.

* test: remove recalc from ci.

* fix: ci case issues (#31880)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* fix(stream): fix compilation error

* fix(stream): optimize val scan logic

* test:add test cases

* test: modify case

* fix: external agg error

* test(stream): tobacco scene testing #TD-36514

* test: add stream cases (#31885)

* fix: windows compile issue

* fix: calc timerange

* fix: windows compile issue

* modify case

* fix(stream): compile error

* test: remove one debug test case file

* test: modify

* test: add test cases

* test: reproduce bugs

* test: reproduce bugs

* feat: [TS-6100] Placeholder function should only appera in SELECT and… (#31868)

* feat: [TS-6100] Placeholder function should only appera in SELECT and WHERE and FROM.

* test: update case

---------

Co-authored-by: Simon Guan <guanshengliang@qq.com>

* add example

* add example

* modify case example

* modify case

* test:alter sql

* test: add stream5 case

* fix(stream): get schema error with version

* test: add delete recalc test py.

* test: remove bug cases

* test: stream5 case test passed

* test: add state cases (#31893)

* fix(stream): compile error

* test: modify case

* test: add cases

* test: add test.

* test: update test case.

* chore(test): fix case err

* test: update test case.

* fix: align data get

* fix(stream): fix row index of datablock written into data cache

* fix: put align data

* test: update test case.

* test: add test cases for virtual table

* chore(test): fix case err #TD-36514

* add case

* test: add test for water mark.

* test: add meters bug6 for stream5

* test: add cases (#31903)

* test: add test for recalc.

* feat: [TS-6100] %%trows can only be used when event type is window close.

* test: add precision of database for ms/us/ns

* modify case

* add case

* add case

* test: add test to ci.

* modify case

* fix: ci case issues (#31904)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* fix(stream): ci error

* test: update test case.

* feat: [TS-6100] Disable some failed UT.

* feat: [TS-6100] Fix virtual table

* test: add bug 5.

* test: add test delete recalc to ci.

* test: add bug 6.

* test(stream): tobacco scene #TD-36514

* fix: reqCids,reqCols memory leak in SSTriggerRealtimeContext

Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>

* test: add case stream6

* fix(stream): implement some pending features in trigger task

* modify case

* modify case

* fix: case issues

* modify case

* test: add recalc for warter mark.

* fix(stream): fix count window trigger of virtual tables

* fix(stream): memory leak

* test: fix run err.

* test: add stream6 bug7

* fix: adjust format

* test(stream): tobacco scene testing #TD-36514

* test: change bug7 with update window1 and 2

* test: add test bug 7.

* case: restore write 3 window

* fix: windows compile issue

* fix: notify

* test: add cases

* modify case

* test: update test case.

* test(stream): toobacco scene testing #TD-36514

---------

Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: plum-lihui <huili@taosdata.com>
Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: zelv01 <1101510017@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: xiangyang guo <66111494+happyguoxy@users.noreply.github.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: zyyang90 <zyyang@taosdata.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Li Hui <52318143+plum-lihui@users.noreply.github.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: xiao-77 <berylbao@taosdata.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: happyguoxy <happy_guoxy@163.com>
Co-authored-by: Tony Zhang <34825804+Tony2h@users.noreply.github.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
2025-07-16 14:42:16 +08:00
Jing Sima
ffd0a5eb57
fix: [TD-34205] Fix vtable mem leak (#30608) 2025-04-07 18:49:49 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
Jinqing Kuang
51ffff2079 feat(query)[TS-5470]: add syntax to specify minimum duration for event and state windows
Introduce the `true for` syntax to allow users to specify the minimum
duration for event and state windows. Add corresponding tests to
validate the feature. Updated the user manual with usage instructions.
2025-02-24 08:02:48 +08:00
dapan1121
2bd493f77b fix: return code issues 2024-12-11 19:18:50 +08:00
dapan1121
7fd0d024fc fix: windows compile issue 2024-12-10 09:15:15 +08:00
dapan1121
d77147d296 Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-12-06 17:43:19 +08:00
dapan1121
011ff04234 fix: scheduler dead lock issue 2024-12-05 18:07:37 +08:00
Shengliang Guan
6db8a25c98 Merge branch 'main' into merge/mainto3.0 2024-11-27 22:31:17 +08:00
factosea
8f1eda88ad enh: error code 2024-11-22 17:18:42 +08:00
wangjiaming0909
fc39ea70ac fix tsma stream same tbname with same group id 2024-11-08 09:42:59 +08:00
xsren
974591f265 fix: colDataSetOrCover 2024-10-31 14:23:28 +08:00
xsren
e8835c2caa blockDataCheck 2024-10-23 15:37:49 +08:00
Haojun Liao
84da5eab2e
Merge pull request #28187 from taosdata/fix/3_liaohj
fix(stream): use meta id instead of ptr.
2024-09-30 09:00:56 +08:00
Jing Sima
5a2c78daa2 fix:[TD-32385] Return true errcode when error occurs. 2024-09-29 10:09:15 +08:00
Haojun Liao
cc6daa0855 Merge branch '3.0' into fix/3_liaohj 2024-09-24 19:14:50 +08:00
Haojun Liao
4e4003c5a7 Merge branch '3.0' into fix/3_liaohj 2024-09-24 18:36:18 +08:00
Haojun Liao
2b78b660bd refactor: update the error logs. 2024-09-24 18:19:47 +08:00
Jing Sima
122b707ac8 enh:[TD-32158] Free memory allocated in function setup. 2024-09-24 11:35:36 +08:00
Jing Sima
23b525458e fix:[TD-32262] Avoid mem leak when error occurs. 2024-09-23 13:50:55 +08:00
lyh250-666
116844208d enh:modify error code passing 2024-09-20 13:23:44 +08:00
54liuyao
19a51d82eb fix(stream):fix mem leak and malloc res 2024-09-18 10:58:27 +08:00
Pan Wei
b795638456
Merge pull request #27760 from taosdata/fix/3.0/TD-31974
fix:[TD-31974] fix memory leak when error occurs after mode function init
2024-09-12 08:44:08 +08:00
Jing Sima
d670778802 fix:[TD-31974] fix memory leak when error occurs after mode function init. 2024-09-11 14:47:14 +08:00
dapan1121
dc983b9a39 fix: add block data check 2024-09-10 16:56:36 +08:00
Haojun Liao
0236db51f6 fix(query): fix memory leak and do some internal refactor. 2024-09-06 15:44:25 +08:00
Pan Wei
090e8d9921
Merge pull request #27630 from taosdata/enh/TD-31691
enh:modify error code passing in libs/executor/
2024-09-03 18:23:21 +08:00
lyh250-666
9c8f630759 enh:modify error code passing in libs/executor/ 2024-09-03 11:01:02 +08:00
54liuyao
ae158487b7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-31833 2024-09-02 16:00:50 +08:00
54liuyao
983962238e fix(query):fix query operator memory leak 2024-09-02 13:46:21 +08:00
Jing Sima
c2d9178bf0 fix:[TD-31828] fix crash in mode function. 2024-09-02 10:25:23 +08:00
Haojun Liao
c118df0ec4 fix(query): fix memory leak. 2024-08-27 17:04:44 +08:00
54liuyao
de4f09b8fd ehn(query): remove query executor assert 2024-08-23 11:01:45 +08:00
54liuyao
99bdcb3f58 enh(stream):remove assert of stream operator 2024-08-20 15:02:09 +08:00
Haojun Liao
a8eedcfdc6
Merge pull request #27012 from taosdata/fix/syntax
fix(query):check return code
2024-08-07 09:17:56 +08:00
Haojun Liao
e0fc36ce97 fix(query):check return code 2024-08-06 17:32:20 +08:00
54liuyao
351779024d Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-08-06 10:46:03 +08:00
54liuyao
1edcd654d4 adj operator res 2024-08-06 09:24:31 +08:00
54liuyao
5c50970cca Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-08-05 16:37:08 +08:00
Haojun Liao
666e813b5f
Merge pull request #26969 from taosdata/fix/TD-31209
fix issue for function res
2024-08-05 16:24:05 +08:00
54liuyao
57068232ff fix res issue 2024-08-05 16:09:01 +08:00
54liuyao
f0e4d2f085 fix malloc issue 2024-08-05 12:22:25 +08:00
54liuyao
1b5cf65ab9 fix issue for function res 2024-08-05 11:17:49 +08:00
54liuyao
d999c00227 adj operator res 2024-07-29 10:35:06 +08:00
Haojun Liao
8876b2602d fix(stream): check return value. 2024-07-27 11:02:35 +08:00
Haojun Liao
3073d6d067 other: merge 3.0 2024-07-27 00:03:28 +08:00
54liuyao
efa65256da adj operator result 2024-07-25 19:11:32 +08:00
Haojun Liao
b228151d8e other: merge 3.0 2024-07-24 17:29:35 +08:00
Haojun Liao
aacf1c3e9a fix(stream): check return value. 2024-07-24 17:08:08 +08:00
Haojun Liao
a09ad7a81e
Merge pull request #26743 from taosdata/fix/syntax
fix(stream): check return value, and do some internal refactor.
2024-07-24 15:47:45 +08:00