Simon Guan
58bdc656c8
Merge branch '3.3.6' into merge/3.3.6tomain
2025-11-05 14:35:39 +08:00
dongming chen
2e1be8f777
enh(TD-38474): modify sdb data ( #33457 )
2025-11-04 09:26:24 +08:00
Haojun Liao
40c6c8a2bc
feat(query): add high priority queries process queue in mnode to avoid normal queries blocking critical processing. ( #33088 )
2025-09-29 10:01:33 +08:00
dmchen
486aca36a0
Merge branch '3.3.6' into merge/3.3.6tomain
2025-09-08 10:09:21 +08:00
dongming chen
624577ea8c
enh/TD-37682-set-sync-timeout ( #32762 )
...
* enh/TD-37682-set-sync-timeout
* add reset vnode sync timeout
* add 4 parameter
* change default
* rename parameter
* refactor: replace strcmp with taosStrncasecmp for syncTimeout checks
* feat: add support for additional sync interval configuration options
* feat: update sync timeout configuration handling in dmProcessConfigReq
* fix: adjust sync interval calculations in dmProcessConfigReq for accuracy
* fix: correct parameter names for sync vnode and mnode election intervals
* fix: update expected row count for 'show variables' in test_show_basic
* fix: update expected row count for 'show variables' in test_valgrind_checkerror1
* feat: add millisecond precision for status intervals and timeouts
* fix: update expected row count for 'show variables' in test_show_basic and test_valgrind_checkerror1
* fix: reduce sleep duration in management threads for improved responsiveness
* feat: add internal parameters for debugging synchronization module in taosd documentation
2025-09-08 09:02:28 +08:00
Pan Wei
bcc25e56bc
feat: new stream ( #31678 )
...
* fix: windows compile issue
* test: add vtable cases (#31829 )
* fix: windows compile issues
* test:add test cases
* fix: windows compile issue
* case: em-4 stream case submit
* test: stream4_sub1 found bug2
* test: submit test_scene_meters_bug2.py
* add stream parameters example
* feat: [TS-6100] Do not translate const value as column.
* Feat/ts 6100 3.0 zlv (#31747 )
* modify asan exampel
* modify asan exampel
* add example
* add example
* modify case example
---------
Co-authored-by: zelv01 <1101510017@qq.com>
* feat(stream): fix memory leak
* modify sliding example
* test: update test case.
* feat(stream): fix conflicts
* fix: add offset case 10a 10s 10m 10h 10d
* feat(stream): fix conflicts
* chore(stream): rename case name #TS-6100
* add case
* modify example
* fix: windows compile issues
* fix: data null check
* feat: [TS-6100] Forbid where when using %%trows (#31827 )
* feat: [TS-6100] Forbid where when using %%trows
* test: update cases
* feat: [TS-6100] Fix leaks.
---------
Co-authored-by: Simon Guan <guanshengliang@qq.com>
* test: reproduce bugs
* test: update test case.
* test: update test case.
* feat: [TS-6100] Fix leaks.
* test: add cases
* Feat/ts 6100 3.0.pw10 (#31841 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* test: reproduce bugs
* fix: add sliding interval combine case
* test: add cases
* test: add recalc test.
* test: reproduce bugs
* case : add vt ts is null check
* modify case
* bug: submit test_idmp_meters_bug3.py
* test: add test for recalc.
* test: add cases
* fix: error code check
* test: add cases
* fix(stream): scan wal with schema in that version
* add case
* test: add cases
* test: update test case.
* fix: windows compile issues
* add case
* test: add cases (#31845 )
* modify case
* fix: reset interpPrev
* test: add test_idmp_meters bug4 and bug3
* add case
* fix(stream): opti wal interface
* fix: remove test_idmp_meters_bug5.py
* test: add cases
* fix(stream): fix ts data fetch for virtual tables
* cancel asan case
* test: update test case.
* test: update test case.
* add case
* test: add cases
* test: add cases
* test: add case test_idmp_meters_bug5.py
* test: update test case.
* fix(stream): tmq error
* test: add cases
* feat: [TS-6100] Restore deleted code in mndSma.c since they are still in use.
* fix(stream): optimize val scan logic
* test: add test_recalc_expired_time.py to ci.
* test: update test case.
* test: update test case.
* feat: [TS-6100] Fix fill range check
* fix(stream): optimize val scan logic
* add case
* test: modify for partition by %%1
* test: add fun case stream4_sub7
* fix(stream): optimize val scan logic
* add case
* feat: [TS-6100] Rename OPTIONS to STREAM_OPTIONS.
* test: add test for recalc.
* test: use stream_options.
* fix: some cases error.
* test: remove recalc from ci.
* fix: ci case issues (#31880 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
* fix: external window idx issue
* fix: ci issues
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* fix(stream): fix compilation error
* fix(stream): optimize val scan logic
* test:add test cases
* test: modify case
* fix: external agg error
* test(stream): tobacco scene testing #TD-36514
* test: add stream cases (#31885 )
* fix: windows compile issue
* fix: calc timerange
* fix: windows compile issue
* modify case
* fix(stream): compile error
* test: remove one debug test case file
* test: modify
* test: add test cases
* test: reproduce bugs
* test: reproduce bugs
* feat: [TS-6100] Placeholder function should only appera in SELECT and… (#31868 )
* feat: [TS-6100] Placeholder function should only appera in SELECT and WHERE and FROM.
* test: update case
---------
Co-authored-by: Simon Guan <guanshengliang@qq.com>
* add example
* add example
* modify case example
* modify case
* test:alter sql
* test: add stream5 case
* fix(stream): get schema error with version
* test: add delete recalc test py.
* test: remove bug cases
* test: stream5 case test passed
* test: add state cases (#31893 )
* fix(stream): compile error
* test: modify case
* test: add cases
* test: add test.
* test: update test case.
* chore(test): fix case err
* test: update test case.
* fix: align data get
* fix(stream): fix row index of datablock written into data cache
* fix: put align data
* test: update test case.
* test: add test cases for virtual table
* chore(test): fix case err #TD-36514
* add case
* test: add test for water mark.
* test: add meters bug6 for stream5
* test: add cases (#31903 )
* test: add test for recalc.
* feat: [TS-6100] %%trows can only be used when event type is window close.
* test: add precision of database for ms/us/ns
* modify case
* add case
* add case
* test: add test to ci.
* modify case
* fix: ci case issues (#31904 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
* fix: external window idx issue
* fix: ci issues
* fix: ci case issues
* fix: drop dnode issue
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* fix(stream): ci error
* test: update test case.
* feat: [TS-6100] Disable some failed UT.
* feat: [TS-6100] Fix virtual table
* test: add bug 5.
* test: add test delete recalc to ci.
* test: add bug 6.
* test(stream): tobacco scene #TD-36514
* fix: reqCids,reqCols memory leak in SSTriggerRealtimeContext
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
* test: add case stream6
* fix(stream): implement some pending features in trigger task
* modify case
* modify case
* fix: case issues
* modify case
* test: add recalc for warter mark.
* fix(stream): fix count window trigger of virtual tables
* fix(stream): memory leak
* test: fix run err.
* test: add stream6 bug7
* fix: adjust format
* test(stream): tobacco scene testing #TD-36514
* test: change bug7 with update window1 and 2
* test: add test bug 7.
* case: restore write 3 window
* fix: windows compile issue
* fix: notify
* test: add cases
* modify case
* test: update test case.
* test(stream): toobacco scene testing #TD-36514
---------
Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: plum-lihui <huili@taosdata.com>
Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: zelv01 <1101510017@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: xiangyang guo <66111494+happyguoxy@users.noreply.github.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: zyyang90 <zyyang@taosdata.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Li Hui <52318143+plum-lihui@users.noreply.github.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: xiao-77 <berylbao@taosdata.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: happyguoxy <happy_guoxy@163.com>
Co-authored-by: Tony Zhang <34825804+Tony2h@users.noreply.github.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
2025-07-16 14:42:16 +08:00
Minglei Jin
66c4ef3e90
feat(mqtt): mqtt subscription ( #30127 )
...
* feat(mqtt): Initial commit for mqtt
* chore(xnode/mnd): xnode message handlers for mnode
* chore(mnd/xnode): mnode part for xnode
* chore(xnode/translater): fix show commands
* fix(ast/creater): fix xnode create option
* fix(xnode/ci): fix ci & doc's error codes
* chore(xnode/sql): make create/drop/show work properly
* fix(xnode/sql): commit new files
* fix(xnode/sql): commit cmake files
* fix: fix testing cases
* fix(xnode/tsc): fix tokens
* fix(ast/anode): fix anode update decl.
* fix(xnode/error): fix xnode error codes
* fix: xnode make/destroy
* chore: xnode with option & dnode id
* chore: use taosmqtt for xnode
* chore: new error code for xnode launching
* chore(xnode): new error code
* chore: header for _xnode_mgmt_mqtt
* chore: source for _xnode_mgmt_mqtt
* chore: remove test directory from cmake
* chore: remove taosmqtt for ci to compile
* chore: remove taosudf header from xnode
* chore: new window macro
* chore: remove xnode mgmt mqtt for windows compilation
* Revert "chore: remove xnode mgmt mqtt for windows compilation"
This reverts commit 197e1640c7
2025-06-25 14:58:51 +08:00
Haojun Liao
4743cc3683
refactor(stream): check for write queue size for sink tasks.
2025-05-22 17:55:47 +08:00
Simon Guan
b74b038f4f
Merge branch '3.0' into merge/mainto3.0
2025-03-04 11:32:29 +08:00
Haojun Liao
a71f414d97
refactor(stream): stop all tasks before drop vnodes.
2025-03-02 02:06:14 +08:00
Haojun Liao
3e55f8edfe
fix(stream): follower nodes not restart tasks.
2025-02-28 13:54:26 +08:00
xiao-77
5d2bc35569
Add more log info.
2024-11-25 16:23:34 +08:00
xiao-77
07de144000
serialize and persist local config
2024-11-04 16:16:24 +08:00
dmchen
5934fe8857
fix/TD-31891-remove-void-mnode4
2024-09-20 06:17:33 +00:00
dmchen
0da625bf55
dmchen/delete-trans-tool
2024-09-03 02:21:31 +00:00
sima
32faa6fccc
enh:[TD-31063] Handling return value in qnode.c
2024-07-23 15:02:54 +08:00
Haojun Liao
acde36a25b
Merge branch '3.0' into fix/3_liaohj
2024-07-09 14:43:35 +08:00
Haojun Liao
8e6bb176c2
fix(stream): use trans to set the consensus-checkpoint id
2024-07-05 16:17:20 +08:00
Haojun Liao
420b59fea5
Merge pull request #26344 from taosdata/fix/3_liaohj
...
fix(stream): validate the stream hb msg, and discard the invalid hb msg.
2024-07-02 09:07:31 +08:00
wangjiaming0909
5040ff5bd9
mnode/qnode support QueryAutoQWorkerPool
2024-07-01 11:08:40 +08:00
Haojun Liao
1818edcb2b
fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file.
2024-06-26 10:18:32 +08:00
Haojun Liao
2cb9644471
fix(stream): update the checkpoint info only when the status is normal.
2024-06-21 09:23:29 +08:00
Haojun Liao
42e0dff589
fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already.
2024-06-14 17:03:04 +08:00
Haojun Liao
cbf8b363fc
fix(stream): update checkpoint info by using trans.
2024-06-10 00:46:01 +08:00
Haojun Liao
bef1953b24
Merge branch '3.0' into fix/3_liaohj
2024-05-31 14:27:46 +08:00
Haojun Liao
d1d868f239
refactor: do some internal refactor and set the pActiveInfo for rsma.
2024-05-29 00:08:29 +08:00
Shungang Li
a8383369ba
enh: arb check roletime before check sync
2024-05-28 15:13:58 +08:00
Haojun Liao
bd514fe4d3
other: merge rows.
2024-05-28 11:13:09 +08:00
Haojun Liao
be107b204c
enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes.
2024-05-28 09:54:22 +08:00
wangjiaming0909
22aad41810
fix smaTest failed caused by mnode not inited
2024-05-24 11:42:01 +08:00
Haojun Liao
6898eba6ed
fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks.
2024-05-14 14:34:31 +08:00
Haojun Liao
7f93ec2c53
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-05-11 09:37:02 +08:00
Haojun Liao
7ad7ef7cfc
refactor: do some internal refactor.
2024-05-06 17:03:41 +08:00
Haojun Liao
ea527b19b8
fix(stream): set correct start version if no checkpoint exist.
2024-04-19 19:12:23 +08:00
Haojun Liao
d799212fb2
refactor: do some internal refactor.
2024-04-12 10:02:18 +08:00
Shungang Li
3a656c3595
feat: support 2 replica with arbitrator
2024-03-19 09:30:35 +08:00
Haojun Liao
aee0460daf
enh(stream):rsp the checkpoint ready msg.
2024-02-27 11:15:09 +08:00
Haojun Liao
dafac591f7
enh(stream): add rsp for req-checkpoint
2024-02-27 10:53:25 +08:00
Haojun Liao
b361eb4a7c
fix(stream): add hb rsp handle function for vnode and snode.
2024-02-21 15:16:07 +08:00
Haojun Liao
cb2ea4a721
fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened.
2024-02-01 11:37:57 +08:00
Haojun Liao
ac08f659c3
refactor: remove invalid procedure in fill-history.
2024-01-26 16:20:43 +08:00
Haojun Liao
80793c94c2
fix(stream): reset the tasks status before start all tasks, and do some other internal refactor.
2024-01-16 14:32:45 +08:00
Haojun Liao
bff0ad89a4
other: merge 3.0
2024-01-11 09:51:12 +08:00
wangmm0220
df69a89da2
fix:[TD-28185]add pause & resume logic for snode
2024-01-10 18:46:10 +08:00
Haojun Liao
29219ba9f4
fix(stream): add task number check.
2024-01-07 01:32:50 +08:00
Haojun Liao
0c4b91dc72
enh(stream): start task async.
2024-01-05 17:55:39 +08:00
Haojun Liao
b175a4b7b3
refactor(stream): async stop tasks, and do some internal refactor.
2023-12-22 17:56:16 +08:00
Haojun Liao
92045f5485
fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode.
2023-12-19 18:34:30 +08:00
Haojun Liao
fee198f9ad
refactor: do some internal refactor.
2023-12-19 16:21:11 +08:00
Haojun Liao
ea6e78cbaa
fix(stream): add async call restart, instead of sync wait.
2023-12-18 16:33:44 +08:00
