Commit graph

136 commits

Author SHA1 Message Date
Pan Wei
bcc25e56bc
feat: new stream (#31678)
* fix: windows compile issue

* test: add vtable cases (#31829)

* fix: windows compile issues

* test:add test cases

* fix: windows compile issue

* case: em-4 stream case submit

* test: stream4_sub1 found bug2

* test: submit test_scene_meters_bug2.py

* add stream parameters example

* feat: [TS-6100] Do not translate const value as column.

* Feat/ts 6100 3.0 zlv (#31747)

* modify asan exampel

* modify asan exampel

* add example

* add example

* modify case example

---------

Co-authored-by: zelv01 <1101510017@qq.com>

* feat(stream): fix memory leak

* modify sliding example

* test: update test case.

* feat(stream): fix conflicts

* fix: add offset case 10a 10s 10m 10h 10d

* feat(stream): fix conflicts

* chore(stream): rename case name #TS-6100

* add case

* modify example

* fix: windows compile issues

* fix: data null check

* feat: [TS-6100] Forbid where when using %%trows (#31827)

* feat: [TS-6100] Forbid where when using %%trows

* test: update cases

* feat: [TS-6100] Fix leaks.

---------

Co-authored-by: Simon Guan <guanshengliang@qq.com>

* test: reproduce bugs

* test: update test case.

* test: update test case.

* feat: [TS-6100] Fix leaks.

* test: add cases

* Feat/ts 6100 3.0.pw10 (#31841)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* test: reproduce bugs

* fix: add sliding interval combine case

* test: add cases

* test: add recalc test.

* test: reproduce bugs

* case : add vt ts is null check

* modify case

* bug: submit test_idmp_meters_bug3.py

* test: add test for recalc.

* test: add cases

* fix: error code check

* test: add cases

* fix(stream): scan wal with schema in that version

* add case

* test: add cases

* test: update test case.

* fix: windows compile issues

* add case

* test: add cases (#31845)

* modify case

* fix: reset interpPrev

* test: add test_idmp_meters bug4 and bug3

* add case

* fix(stream): opti wal interface

* fix: remove test_idmp_meters_bug5.py

* test: add cases

* fix(stream): fix ts data fetch for virtual tables

* cancel asan case

* test: update test case.

* test: update test case.

* add case

* test: add cases

* test: add cases

* test: add case test_idmp_meters_bug5.py

* test: update test case.

* fix(stream): tmq error

* test: add cases

* feat: [TS-6100] Restore deleted code in mndSma.c since they are still in use.

* fix(stream): optimize val scan logic

* test: add test_recalc_expired_time.py  to ci.

* test: update test case.

* test: update test case.

* feat: [TS-6100] Fix fill range check

* fix(stream): optimize val scan logic

* add case

* test: modify for partition by %%1

* test: add fun case stream4_sub7

* fix(stream): optimize val scan logic

* add case

* feat: [TS-6100] Rename OPTIONS to STREAM_OPTIONS.

* test: add test for recalc.

* test: use stream_options.

* fix: some cases error.

* test: remove recalc from ci.

* fix: ci case issues (#31880)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* fix(stream): fix compilation error

* fix(stream): optimize val scan logic

* test:add test cases

* test: modify case

* fix: external agg error

* test(stream): tobacco scene testing #TD-36514

* test: add stream cases (#31885)

* fix: windows compile issue

* fix: calc timerange

* fix: windows compile issue

* modify case

* fix(stream): compile error

* test: remove one debug test case file

* test: modify

* test: add test cases

* test: reproduce bugs

* test: reproduce bugs

* feat: [TS-6100] Placeholder function should only appera in SELECT and… (#31868)

* feat: [TS-6100] Placeholder function should only appera in SELECT and WHERE and FROM.

* test: update case

---------

Co-authored-by: Simon Guan <guanshengliang@qq.com>

* add example

* add example

* modify case example

* modify case

* test:alter sql

* test: add stream5 case

* fix(stream): get schema error with version

* test: add delete recalc test py.

* test: remove bug cases

* test: stream5 case test passed

* test: add state cases (#31893)

* fix(stream): compile error

* test: modify case

* test: add cases

* test: add test.

* test: update test case.

* chore(test): fix case err

* test: update test case.

* fix: align data get

* fix(stream): fix row index of datablock written into data cache

* fix: put align data

* test: update test case.

* test: add test cases for virtual table

* chore(test): fix case err #TD-36514

* add case

* test: add test for water mark.

* test: add meters bug6 for stream5

* test: add cases (#31903)

* test: add test for recalc.

* feat: [TS-6100] %%trows can only be used when event type is window close.

* test: add precision of database for ms/us/ns

* modify case

* add case

* add case

* test: add test to ci.

* modify case

* fix: ci case issues (#31904)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* fix(stream): ci error

* test: update test case.

* feat: [TS-6100] Disable some failed UT.

* feat: [TS-6100] Fix virtual table

* test: add bug 5.

* test: add test delete recalc to ci.

* test: add bug 6.

* test(stream): tobacco scene #TD-36514

* fix: reqCids,reqCols memory leak in SSTriggerRealtimeContext

Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>

* test: add case stream6

* fix(stream): implement some pending features in trigger task

* modify case

* modify case

* fix: case issues

* modify case

* test: add recalc for warter mark.

* fix(stream): fix count window trigger of virtual tables

* fix(stream): memory leak

* test: fix run err.

* test: add stream6 bug7

* fix: adjust format

* test(stream): tobacco scene testing #TD-36514

* test: change bug7 with update window1 and 2

* test: add test bug 7.

* case: restore write 3 window

* fix: windows compile issue

* fix: notify

* test: add cases

* modify case

* test: update test case.

* test(stream): toobacco scene testing #TD-36514

---------

Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: plum-lihui <huili@taosdata.com>
Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: zelv01 <1101510017@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: xiangyang guo <66111494+happyguoxy@users.noreply.github.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: zyyang90 <zyyang@taosdata.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Li Hui <52318143+plum-lihui@users.noreply.github.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: xiao-77 <berylbao@taosdata.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: happyguoxy <happy_guoxy@163.com>
Co-authored-by: Tony Zhang <34825804+Tony2h@users.noreply.github.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
2025-07-16 14:42:16 +08:00
xiao-77
5d2bc35569 Add more log info. 2024-11-25 16:23:34 +08:00
xiao-77
07de144000 serialize and persist local config 2024-11-04 16:16:24 +08:00
dmchen
5934fe8857 fix/TD-31891-remove-void-mnode4 2024-09-20 06:17:33 +00:00
dmchen
0da625bf55 dmchen/delete-trans-tool 2024-09-03 02:21:31 +00:00
wangjiaming0909
5040ff5bd9 mnode/qnode support QueryAutoQWorkerPool 2024-07-01 11:08:40 +08:00
Shungang Li
a8383369ba enh: arb check roletime before check sync 2024-05-28 15:13:58 +08:00
Shungang Li
3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
cadem
470fef6452 fix/block check to async check for mnode 2023-04-24 13:38:55 +08:00
cadem
3b78d4382b add learner 2023-04-18 19:03:45 +08:00
Shengliang Guan
e79e50ae36 enh: refact syncMsg code 2022-11-01 13:58:25 +08:00
Minghao Li
5965629b2e refactor(sync): refacotr sync 2022-10-20 16:05:14 +08:00
Minghao Li
5745223bca refactor(sync): add double queues in mnode 2022-10-17 10:33:27 +08:00
Shengliang Guan
78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Shengliang Guan
555a99bf90 enh: dump sdb info from mnode 2022-09-26 16:18:48 +08:00
Shengliang Guan
e9d4948e84 enh: transfer leader before close vnode and mnode 2022-07-12 14:46:52 +08:00
Shengliang Guan
9f0d89d6ff enh: add stbinfo to minotor 2022-06-23 21:09:50 +08:00
Shengliang Guan
53198f58bb refactor: add post process for query msg 2022-06-21 09:48:31 +08:00
dapan1121
ef21c6b339 enh: add rpc msg abort preprocess 2022-06-20 11:37:40 +08:00
Shengliang Guan
c9509acf22 refactor: mnode pre process msg 2022-06-14 16:01:32 +08:00
Shengliang Guan
a3f1273640 refactor: mnode sync 2022-06-14 10:58:36 +08:00
Shengliang Guan
877cb761f1 refactor: mnode worker 2022-06-14 09:43:22 +08:00
Shengliang Guan
b5a1131c25 enh: sdb snapshot 2022-05-28 12:56:33 +08:00
Shengliang Guan
1100ec3fb3 refacor: alter mnode 2022-05-25 17:44:43 +08:00
Shengliang Guan
b638d0ef8c refactor: let mnode report sync state 2022-05-25 16:41:38 +08:00
Shengliang Guan
229cb7b7d9 refactor: sdb header 2022-05-25 12:32:28 +08:00
Shengliang Guan
7f3c60421a refactor: mnode sync 2022-05-24 22:34:48 +08:00
Shengliang Guan
d2d0ae20aa refactor: mnode snapshot 2022-05-24 19:29:23 +08:00
Shengliang Guan
f99b20aaa9 refactor: add standby option for mnode 2022-05-24 17:28:33 +08:00
Shengliang Guan
cb2527f71f refactor: sync integrate into mnode 2022-05-23 13:44:49 +08:00
Shengliang Guan
68b7f6946d refactor: sync integrate into mnode 2022-05-23 13:15:27 +08:00
Shengliang Guan
6c1d1927c9 refactor: sync integrate into mnode 2022-05-23 09:58:21 +08:00
Shengliang Guan
e06f9fd05c refactor: sync integrate into mnode 2022-05-22 16:04:50 +08:00
Minghao Li
a1cd6839a7 enh(sync) sync/mnode integration 2022-05-21 22:15:23 +08:00
Minghao Li
249aecacda enh(sync) sync/mnode integration 2022-05-21 21:26:27 +08:00
Shengliang Guan
2ee38b94fd refactor: change lockfree to rwlock 2022-05-19 15:52:35 +08:00
Shengliang Guan
96b7f2696a refactor: adjust SRpcMsg 2022-05-16 14:55:31 +08:00
Shengliang Guan
0052d5bc21 refactor: adjust status in sdb 2022-04-29 14:20:28 +08:00
Shengliang Guan
7d3dd776f1 test: add unitest for sdb 2022-04-28 13:56:10 +08:00
Shengliang Guan
0136cae760 refactor(cluster): add cb func on transaction start and stop 2022-04-27 10:35:21 +08:00
Shengliang Guan
9e41cce370 refactor(cluster): adjust acct log 2022-04-26 15:47:45 +08:00
Liu Jicong
558edd3713 merge from 3.0 2022-04-20 22:12:10 +08:00
Shengliang Guan
b66718a4d8 feat: report service status 2022-04-19 21:39:42 +08:00
Liu Jicong
3277607503 merge from 3.0 2022-04-19 17:10:58 +08:00
Liu Jicong
b7bf0fe10b refactor(tmq): subscribe and rebalance process 2022-04-19 17:02:49 +08:00
Shengliang Guan
b086dcafac refact<cluster>: adjust auth code 2022-04-14 18:29:07 +08:00
Shengliang Guan
6958f3abfc refact(cluster): node mgmt 2022-04-14 13:44:40 +08:00
Shengliang Guan
3663c6441d refact(cluster): node mgmt 2022-04-13 15:52:14 +08:00
Shengliang Guan
1649d0ddda shm 2022-04-01 16:36:36 +08:00
Liu Jicong
d3e62358b1 merge from 3.0 2022-03-24 11:39:18 +08:00