Commit graph

1219 commits

Author SHA1 Message Date
Bomin Zhang
56bea7d81a
feat: support create/drop totp_secret statement (#34162) 2026-01-06 09:28:58 +08:00
guichuan zhang
2c62466aa0
feat(taosx): support distributed taosx (#34126)
* feat: add xnode syntax

* refactor(xnode): reduce function complexity

* chore: add lost xnode.h file

* feat(xnode): create xnode task

* chore: fix double free error

* add xnoded

* start xnoded as subprocess

* complete xnode task feature

* complete show xnode jobs feature

* complete with option feature

* complete alter xnode job feature

* complete alter xnode task feature

* complete user pass feature

* clean code

* modify status type as char

* fix leader ep null

* fix start task req null

* fix pass id for status

* support timeout msg

* drop xnode task relative jobs

* clean code

* wip

* chore: add test cases for xnode

* chore: fix 3.0 merge changes

* fix drain core dump and create task core dump

* add password check

* retrieve xnode status from xnoded

* pass integer as double to cjson

* add some debug log

* add some job log

* fix start task lock

* do not handle http response

* fix coredump drop xnode task by name

* support start/stop/drop task by name

* remove mock xnoded

* support unix socket

* kill pre-xnoded before start

* support dnode close xnoded

* test(xnode): add unit test cases for xnode

* rebalance support where clause

* fix some test issue

* unformat http post content json string

* add xnode zh doc

* modify drain description

* remove job create/stop/drop operation

* support rebalance all without where condition

* support alter task by name

* add NULL param for mndCheckOperPrivilege

* add xnode txnode module for libmnode.a

* code clean

* change parser len to 4096

* clean code

* chore: try to fix gtest/gtest.h not found

* chore: fix markdown files

* chore: fix markdown in zh

* chore: fix enum issue and add ci

* chore: fix test case problem

* chore: fix pKeyVal overflow

* chore: rename to 排空节点

* chore: external cmake remove parallel

* chore: add DEP_ext_gtest for xnode test

* chore: fix gtest errors

* chore: remove gtest pthread lib

* chore: fix data type not match

* chore: fix some lint errors

* chore: fix void unlink

* chore: fix return with null pointer check

* chore: fix pointer double free and xnodeMemoryTest strncpy null

* chore: fix xnode encode action invalid datelen

* chore: remove TD_LINUX condition

* chore: use PRIu64 denote long long

* chore: fix task parser NULL and allow no with clause

* fix(xnode): fix windows build error

* chore: fix windows curl error

* chore: fix test case ins_tables relative error

* chore: fix memory leak

* docs: update taosx docs

* chore: update taosx docs

* chore: add role priviledge table

* chore: fix error code doc

* chore: fix test_xnode.py

* chore: fix doc typo

* fix: ci error while run test_user_privilege_sysinfo.py

---------

Co-authored-by: Linhe Huo <linhehuo@gmail.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
2026-01-01 14:51:03 +08:00
Kaili Xu
31126ab2b6
feat(rbac): access control (#33822) 2025-12-29 19:27:11 +08:00
Bomin Zhang
02f627bc71
fix several issues in token and totp (#34057) 2025-12-26 17:14:19 +08:00
Bomin Zhang
9f0271d715
feat: support token authentication (#34026) 2025-12-25 16:30:10 +08:00
dongming chen
d3d5798cd2
feat/TS-6863-add-use-token-para (#34029) 2025-12-25 15:52:01 +08:00
WANG MINGMING
acfe352b5b
feat(stream): [TD-37208] process schema changed in vtable (#33871) 2025-12-25 14:41:08 +08:00
dongming chen
55f5bc0dd2
feat[TS-7233]: audit (#33850) 2025-12-16 16:27:11 +08:00
Yihao Deng
f5298caa15
enh: support reload ssl (#33858) 2025-12-15 16:48:20 +08:00
WANG MINGMING
79a5c48ffa
feat(tmq): [TS-6379]remove limition for table operation in tmq (#33834) 2025-12-15 11:26:46 +08:00
Bomin Zhang
d4e29c97fc
feat[TS-7529]: support TOTP authentication (#33852) 2025-12-10 15:25:21 +08:00
Yihao Deng
00e9ae3719
handle time unsync (#33223) 2025-12-09 17:43:11 +08:00
Bomin Zhang
93fe726f9c
feat[TS-7231]: identity authentication (#33702) 2025-12-05 17:35:10 +08:00
dongming chen
643dfcb4fc
feat(TS-7270): encrypt algr (#33783) 2025-12-05 13:26:28 +08:00
Mario Peng
3b0d0e3742
feat:register instance (#33666) 2025-11-28 10:10:37 +08:00
Simon Guan
5cb3a201b2 fix: conflict while merge from main to 3.0 2025-11-28 09:47:05 +08:00
Jinqing Kuang
8dad32d2a3
fix(stream): ignore window open when trigger is recovering from checkpoint (#33698) 2025-11-26 19:59:50 +08:00
Simon Guan
a70b79e334
merge: merge main to 3.0 #33663 2025-11-24 16:26:44 +08:00
Simon Guan
d529e7534b Merge branch 'main' into merge/mainto3.0 2025-11-22 08:53:31 +08:00
Haojun Liao
67c1035853
feat(gpt): display model status when retrieving model info. (#33664) 2025-11-22 08:34:55 +08:00
Pan Wei
49d48c1242
fix: stream mgmt request error handling issue (#33665)
* fix: stream mgmt req error handling issue

* fix: deploy original trigger reader issue
2025-11-21 10:23:41 +08:00
Tony Zhang
e2024229fd Merge branch 'main' into merge/mainto3.0 2025-11-20 17:11:07 +08:00
Tony Zhang
0044dfecc7
fix: stream compatibility between 3.3.7 and 3.3.8 (#33599) 2025-11-20 09:07:18 +08:00
Simon Guan
169d535242 Merge branch 'main' into merge/mainto3.0 2025-11-15 11:29:18 +08:00
Simon Guan
fec690899e
merge: from 3.3.6 to main branch #33572 2025-11-14 10:11:01 +08:00
dapan1121
d92f21339b Merge remote-tracking branch 'origin/main' into merge/mainto3.0 2025-11-13 15:57:26 +08:00
xiao-77
e004167333 Merge remote-tracking branch 'origin/3.3.6' into merge/3.3.6tomain 2025-11-13 11:07:32 +08:00
WANG MINGMING
1ced706b9d
enh(wal): [TS-7567]set wal keep version to avoid deleting (#33517) 2025-11-13 09:28:26 +08:00
wangmm0220
62efbc7baf fix(stream): conflicts 2025-11-07 16:49:53 +08:00
Simon Guan
6eb0c3b07c Merge branch 'main' into merge/mainto3.0 2025-11-06 17:49:17 +08:00
Simon Guan
eb90b38991 Merge branch '3.3.6' into merge/3.3.6tomain 2025-11-06 16:35:52 +08:00
dapan1121
6c2a1d72b6 Merge remote-tracking branch 'origin/main' into enh/addStreamLatency-marks 2025-11-06 10:23:28 +08:00
dongming chen
fd77b1b4ef
fix/TD-38490-reset-heartbeat-after-mnode-leader-restart (#33473) 2025-11-06 09:17:27 +08:00
Simon Guan
96f4fdd896 Merge branch 'main' into merge/mainto3.0 2025-11-05 16:51:58 +08:00
Hongze Cheng
dd784968b9
enh: compact command now support the force option (#33427) 2025-11-04 16:31:58 +08:00
dongming chen
5671fe95d6
fix: TD-38395 memory leak 3.3.6 (#33430) 2025-10-30 15:57:10 +08:00
dongming chen
e1685dc875
fix/TD-38395-memory-leak (#33414) 2025-10-30 15:56:19 +08:00
dapan1121
faec792217 fix: change replica number 2025-10-20 19:36:40 +08:00
Pan Wei
06a358d1cf
fix: get stream tasks list crash issue (#33238)
* fix: get stream tasks list crash issue

* fix: return code issue
2025-10-14 13:33:32 +08:00
Kaili Xu
348907e4b1
enh: rsma docs and task monitor (#33219) 2025-10-13 17:00:00 +08:00
Kaili Xu
6241cce3a1
enh(rsma): support alter/decimal/composite key (#33177) 2025-10-10 11:24:13 +08:00
Kaili Xu
2f4981e2c4
enh: check privilege for show stables (#33097) 2025-09-29 14:31:03 +08:00
Kaili Xu
7e18a4d177
enh: check privilege for show stables (#33129) 2025-09-29 14:30:21 +08:00
Kaili Xu
13ae5350b7
feat: rollup sma (#33063) 2025-09-26 17:32:32 +08:00
WANG MINGMING
558928cbe1
feat(stream): optimize stream logic (#33027)
* fix: remove debug log

* fix: remove assert

* fix: delete unused code

* enh: [TD-37251] Support expr in state window.

* feat(stream): support expr in state window trigger

* enh: [TD-37251] Fix SCL_IS_CONST_CALC condition.

* fix(stream): set ver in wal

* fix: print code

* fix: increase runner replica num

* fix: trigger mem error

* fix: sliding _tnext_ts value

* fix(stream): disable tagFilterCache in stream reader trigger

* fix: crash

* Revert "fix(stream): fix history calc finish check"

This reverts commit f93d17f1d2.

* Revert "fix(stream): fix calc request allocation in trigger"

This reverts commit c5410f6da0.

* fix(stream): fix calc request allocation in trigger

* enh: [TD-37251] External window support more placeholder.

* fix(stream): modify size of return from 1000000->4096

* enh: [TD-37251] Modify error msg when stream query do not have from clause.

* fix(stream): add log for group not found

* fix(stream): do not return gid=0 in walMetaData interface

* enh: [TD-37251] Fix missing ts column in vtable query.

* fix: test case build failed

* fix: invalid read issue

* fix(stream): add vtable logic

* fix(stream): encode error in wal

* fix(stream): add vtable logic

* fix(stream): add log

* fix: diff funcition crash

* Revert "Merge branch 'enh/TD-37251-3.0-dropoutput' into enh/TD-37251-3.0"

This reverts commit e93cbd6fd4, reversing
changes made to dc3230591d.

* Revert "Merge branch 'enh/TD-37251-3.0-vtable' into enh/TD-37251-3.0"

This reverts commit dc3230591d, reversing
changes made to 085e086782.

* fix(stream): fix block data len is too large if data type is vchar

* fix: drop output table

* feat: runner delete output table

* process pDropBlock in trigger task.

* fix(stream): opti log level

* fix(stream): build block for drop table

* fix(stream): set gid for normal table

* fix(stream): set gid for normal table

* feat: Support delete output.

* fix(stream): rows error

* fix(stream): memory leak

* enh: [TD-37251] Fix external window wrong ts column.

* fix(stream): fix calc time check in batch mode

* fix: merge aligned external window issue

* Revert "fix(stream): fix calc time check in batch mode"

This reverts commit d895b7f577.

* fix(stream): add test case

* fix(stream): add insert drop table logic

* fix: external window end issue

* fix(stream): add test case

* fix(stream): fix trigger pull data

* fix(stream): fix history calc request

* enh: drop table on snode

* fix(stream): adjust hash index if data is filtered in wal

* fix(stream): rollback

* enh: add merge aligned extwin window row idx

* fix: drop output table

* fix: compile issue

* enh: [TD-37251] Add flag to identify interval window is overlapped

* fix: overlap

* fix(stream): set gid=-1 for initialized

* fix(stream): modify log level

* fix: trigger slow issue

* fix(stream): add basic test for obj pool

* fix(stream): fix metadata clear in trigger

* fix(stream): fix idle runner allocation in trigger

* fix: handle agg output on externalWin

* fix: test case

* fix(stream): adjust log

* fix: reset pCtx pOutput

* fix: memory leak

* fix: search first win for tsCol

* fix(stream): add test case for schema change

* fix: mem leak

* fix: mem leak

* Reapply "Merge branch 'enh/TD-37251-3.0-vtable' into enh/TD-37251-3.0"

This reverts commit b508e66958.

* fix(stream): fix virtual table data pull

* fix(stream): fix set table request

* fix(stream): process empty uidlist

* fix(stream): fix set table request

* fix(stream): fix data new request in trigger

* fix(stream): tablelist error for vtable

* fix(stream): block ver is null

* fix(stream): remove version limition for wal

* fix(stream): block rows error

* fix(stream): fix pending calc param in batch mode

* fix(stream): auto create table

* fix(stream): fix stream vtable data merge

* fix: _tcurrentts

* fix(stream): destroy hash

* fix(stream): fix trigger status

* fix(stream): colId error in vtable

* fix(stream): update nrows of vtable data block

* fix(stream): fix trigger status

* fix(stream): enable low latency calc for period trigger

* fix: test case file path

* fix: test case file path

* fix: string to node in reader

* enh: add test log

* fix(stream): increase wait time of non-low-latency mode

* fix(stream): fix column capacity in scalar calculation

* fix(stream): fix column capacity in trigger expr calculation

* fix: get origTableInfos

* fix(stream): fix calc data pull in trigger

* fix(stream): fix calc data cache write in trigger

* enh: [TD-37251] Add flag to identify interval wind

* fix: external window memory usage issue

* fix(stream): fix epxr result column in trigger

* fix(stream): add metaCache for calc plan

* fix(stream): fix stream obj list clear

* fix(stream): rollback

* enh: [TD-37251] Add flag to identify interval wind

* fix: mem free

* fix(stream): add metaCache for calc plan

* fix(stream): fix calc data cache write in trigger

* fix(stream): fix calc data cache write in trigger

* enh: optimize external result block memory

* fix(stream): modify logic of judge table for create table

* fix(stream): fix event window check in trigger

* fix(stream): fix count window check in trigger

* fix(stream): colSize=0 while encoding block because pDataCol->hasNull is false in secode time & reload table list if create table

* enh: optimize stream memory

* fix(stream): trigger tag error

* fix: add log

* fix(stream): fix calc data write in trigger

* fix: drop output table

* fix(stream): fix max delay in trigger

* fix: drop output table

* fix(stream): fix max delay in trigger

* fix(build): handle return value of function

* fix(stream): read gid error if it is child table in stream

* fix(stream): fix calc param of history calculation

* fix(stream): fix recalc of delete data

* fix(stream): fix calc data of period trigger

* fix(stream): fix cache read check

* fix(stream): filter error in calc plan

* fix: reset externla window expr

* fix(stream): fix calc parm of max delay

* fix: time range and case issues

* fix(stream): fix crash in trigger

* fix: case issues

* fix: fix window node mem leak.

* fix(stream): fix meta data clear in trigger

* fix(stream): table schema is old in TsdbDataRequest for vtable

* fix: fix slingding window place holder check condition.

* Revert "fix: fix slingding window place holder check condition."

This reverts commit ad864a1dc1.

* fix(stream): null pointer error

* fix: case issue

* fix(stream): calc data error for vtable

* fix(stream): fix data sorter in trigger

* fix(stream): add log for delete data

* fix(stream): fix start version of realtime calculation

* fix(stream): fix cache data merger of vtable

* fix: case issues

* fix(ci): upgrade stream cases in test_cols_function

* fix(stream): gid not found if change tag value

* fix: fix slingding window place holder check condition.

* fix(stream): fix virt table info request in trigger

* fix(stream): set gid = uid if stream table type != SUPER table

* fix: clean cache data by group

* fix: add block info and case issues

* fix: fix heap-buffer-overflow.

* fix(stream): fix state window with extend param

* fix: fix access null pointer.

* fix: case issues

* fix: case issue

* fix(stream): fix ignore_nodata_trigger option for period trigger

* fix(stream): fix pseudo col fetch for calc data

* fix: Extend checking time to avoid timeout.

* fix: case issues

* fix(stream): fix group col fetch for virtual tables

* fix(stream): tag is NULL for non vtable

* fix(stream): fix sliding check of virtual table

* test(stream): check stream status after create all streams

* fix: add log

* fix(stream): fix wal meta truncate when ignore disorder

* fix(stream): gid not found for child table

* fix: fix place holder condition pushdown error.

* fix(stream): suid not equal when delete data for child table

* fix: id issue

* fix(stream): disable recalc for count trigger

* fix: cast result rowSize error in project

* fix(stream): add log for tsdb meta

* fix(stream): fix gid in tsdb meta request

* fix(stream): fix wend of unclosed windows

* fix(stream): fix ignore_nodata_trigger option for period trigger

* fix: case issues

* fix(stream): fix calc data pull for empty interval window

* fix: fix ext window condition.

* fix(ci): smaBasic performance check affectd by debug level log

* fix(stream): add suid when set table list for vtable

* fix: forbid using prefilter when using %%trows an trigger table is virtual table.

* fix: forbid prefilter %%trows cases.

* fix(stream): sort cid in tsdbVirtalDataReq

* fix: forbid prefilter %%trows cases.

* fix(stream): add log for virtual table tsdb data

* fix(stream): get delete msg for vtable

* fix: winRowIndex

* Revert "fix: winRowIndex"

This reverts commit e08b41cf96.

* fix(stream): fix data merge in trigger

* test(stream): fix case ans

* fix(stream): fix empty calc data pull for period trigger

* fix(stream): col index error for tsdbVirtalDataReq

* fix(stream): pTableList is NULL for vtable

* test(stream): fix case ans

* fix(stream): fix notification in trigger

* fix(stream): memory leak

* fix(stream): fix virtual data pull in trigger

* test(stream): fix case ans

* fix(stream): col index error for tsdbVirtalDataReq

* fix(stream): pTableList is NULL for vtable

* test(stream): fix case ans

* fix(stream): fix notification in trigger

* fix(stream): memory leak

* fix(stream): fix virtual data pull in trigger

* test(stream): fix case ans

* fix: case issue

* fix: crash issue

* fix: forbid prefilter %%trows cases.

* fix(stream): session case

* fix(stream): fix data pull for virtual tables

* fix(stream): add log

* fix(stream): fix calc req send in batch mode

* fix: fix stream UT

* fix(stream): tablelist is null for non vtable

* fix: mem leak

* fix(stream): fix compile error in trigger

* fix: return code issue

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
2025-09-25 15:48:14 +08:00
Hongze Cheng
e61fc3c3a6
feat: impl vnode scan (#32942)
* feat: support SQL commands

* feat: impl `scan database` client part code

* feat: impl `scan db.vgroups` client part code

* feat: impl `show scans` client codes

* feat: impl `show scan <id>` client code

* feat: impl `kill scan <id>` client code

* feat: impl mnode part code

* more code

* feat: impl mndScanDb

* feat: Impl all command mnode code

* feat: impl vnode part code

* fix: ci return code check

* fix: return code ci

* doc: change document

* fix: forever loop

* fix: fix some test cases

* add more codes

* fix: compile error

* fix: CI cases

* fix: some scan issues
2025-09-19 13:41:41 +08:00
Jing Sima
a656416e2e
feat: [TD-37209] Support TSMA. (#33005) 2025-09-19 12:09:11 +08:00
Jing Sima
72d3189367
feat: [TD-37052] Handle origin table's vnode change in stream query. (#32931) 2025-09-10 16:12:11 +08:00
dmchen
486aca36a0 Merge branch '3.3.6' into merge/3.3.6tomain 2025-09-08 10:09:21 +08:00
dongming chen
624577ea8c
enh/TD-37682-set-sync-timeout (#32762)
* enh/TD-37682-set-sync-timeout

* add reset vnode sync timeout

* add 4 parameter

* change default

* rename parameter

* refactor: replace strcmp with taosStrncasecmp for syncTimeout checks

* feat: add support for additional sync interval configuration options

* feat: update sync timeout configuration handling in dmProcessConfigReq

* fix: adjust sync interval calculations in dmProcessConfigReq for accuracy

* fix: correct parameter names for sync vnode and mnode election intervals

* fix: update expected row count for 'show variables' in test_show_basic

* fix: update expected row count for 'show variables' in test_valgrind_checkerror1

* feat: add millisecond precision for status intervals and timeouts

* fix: update expected row count for 'show variables' in test_show_basic and test_valgrind_checkerror1

* fix: reduce sleep duration in management threads for improved responsiveness

* feat: add internal parameters for debugging synchronization module in taosd documentation
2025-09-08 09:02:28 +08:00