Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
78869 commits 554 branches 514 tags 1.7 GiB
Commit graph

10179 commits

Author SHA1 Message Date
Kaili Xu
799b3341de
enh: mounted vnode may have no tq (#31916) 2025-07-19 09:12:12 +08:00
Hongze Cheng
29e8ae40bb
fix: possible memory leak (#31972) 2025-07-18 16:27:55 +08:00
Yihao Deng
bcabf3536a
feat: support BLOB data type (#31704) 2025-07-17 14:17:47 +08:00
Simon Guan
6f5f0c3e9c Merge branch '3.0' into merge/mainto3.0_1 2025-07-16 18:07:06 +08:00
Pan Wei
bcc25e56bc
feat: new stream (#31678) 
* fix: windows compile issue

* test: add vtable cases (#31829)

* fix: windows compile issues

* test:add test cases

* fix: windows compile issue

* case: em-4 stream case submit

* test: stream4_sub1 found bug2

* test: submit test_scene_meters_bug2.py

* add stream parameters example

* feat: [TS-6100] Do not translate const value as column.

* Feat/ts 6100 3.0 zlv (#31747)

* modify asan exampel

* modify asan exampel

* add example

* add example

* modify case example

---------

Co-authored-by: zelv01 <1101510017@qq.com>

* feat(stream): fix memory leak

* modify sliding example

* test: update test case.

* feat(stream): fix conflicts

* fix: add offset case 10a 10s 10m 10h 10d

* feat(stream): fix conflicts

* chore(stream): rename case name #TS-6100

* add case

* modify example

* fix: windows compile issues

* fix: data null check

* feat: [TS-6100] Forbid where when using %%trows (#31827)

* feat: [TS-6100] Forbid where when using %%trows

* test: update cases

* feat: [TS-6100] Fix leaks.

---------

Co-authored-by: Simon Guan <guanshengliang@qq.com>

* test: reproduce bugs

* test: update test case.

* test: update test case.

* feat: [TS-6100] Fix leaks.

* test: add cases

* Feat/ts 6100 3.0.pw10 (#31841)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* test: reproduce bugs

* fix: add sliding interval combine case

* test: add cases

* test: add recalc test.

* test: reproduce bugs

* case : add vt ts is null check

* modify case

* bug: submit test_idmp_meters_bug3.py

* test: add test for recalc.

* test: add cases

* fix: error code check

* test: add cases

* fix(stream): scan wal with schema in that version

* add case

* test: add cases

* test: update test case.

* fix: windows compile issues

* add case

* test: add cases (#31845)

* modify case

* fix: reset interpPrev

* test: add test_idmp_meters bug4 and bug3

* add case

* fix(stream): opti wal interface

* fix: remove test_idmp_meters_bug5.py

* test: add cases

* fix(stream): fix ts data fetch for virtual tables

* cancel asan case

* test: update test case.

* test: update test case.

* add case

* test: add cases

* test: add cases

* test: add case test_idmp_meters_bug5.py

* test: update test case.

* fix(stream): tmq error

* test: add cases

* feat: [TS-6100] Restore deleted code in mndSma.c since they are still in use.

* fix(stream): optimize val scan logic

* test: add test_recalc_expired_time.py  to ci.

* test: update test case.

* test: update test case.

* feat: [TS-6100] Fix fill range check

* fix(stream): optimize val scan logic

* add case

* test: modify for partition by %%1

* test: add fun case stream4_sub7

* fix(stream): optimize val scan logic

* add case

* feat: [TS-6100] Rename OPTIONS to STREAM_OPTIONS.

* test: add test for recalc.

* test: use stream_options.

* fix: some cases error.

* test: remove recalc from ci.

* fix: ci case issues (#31880)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* fix(stream): fix compilation error

* fix(stream): optimize val scan logic

* test:add test cases

* test: modify case

* fix: external agg error

* test(stream): tobacco scene testing #TD-36514

* test: add stream cases (#31885)

* fix: windows compile issue

* fix: calc timerange

* fix: windows compile issue

* modify case

* fix(stream): compile error

* test: remove one debug test case file

* test: modify

* test: add test cases

* test: reproduce bugs

* test: reproduce bugs

* feat: [TS-6100] Placeholder function should only appera in SELECT and… (#31868)

* feat: [TS-6100] Placeholder function should only appera in SELECT and WHERE and FROM.

* test: update case

---------

Co-authored-by: Simon Guan <guanshengliang@qq.com>

* add example

* add example

* modify case example

* modify case

* test:alter sql

* test: add stream5 case

* fix(stream): get schema error with version

* test: add delete recalc test py.

* test: remove bug cases

* test: stream5 case test passed

* test: add state cases (#31893)

* fix(stream): compile error

* test: modify case

* test: add cases

* test: add test.

* test: update test case.

* chore(test): fix case err

* test: update test case.

* fix: align data get

* fix(stream): fix row index of datablock written into data cache

* fix: put align data

* test: update test case.

* test: add test cases for virtual table

* chore(test): fix case err #TD-36514

* add case

* test: add test for water mark.

* test: add meters bug6 for stream5

* test: add cases (#31903)

* test: add test for recalc.

* feat: [TS-6100] %%trows can only be used when event type is window close.

* test: add precision of database for ms/us/ns

* modify case

* add case

* add case

* test: add test to ci.

* modify case

* fix: ci case issues (#31904)

* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>

* fix(stream): ci error

* test: update test case.

* feat: [TS-6100] Disable some failed UT.

* feat: [TS-6100] Fix virtual table

* test: add bug 5.

* test: add test delete recalc to ci.

* test: add bug 6.

* test(stream): tobacco scene #TD-36514

* fix: reqCids,reqCols memory leak in SSTriggerRealtimeContext

Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>

* test: add case stream6

* fix(stream): implement some pending features in trigger task

* modify case

* modify case

* fix: case issues

* modify case

* test: add recalc for warter mark.

* fix(stream): fix count window trigger of virtual tables

* fix(stream): memory leak

* test: fix run err.

* test: add stream6 bug7

* fix: adjust format

* test(stream): tobacco scene testing #TD-36514

* test: change bug7 with update window1 and 2

* test: add test bug 7.

* case: restore write 3 window

* fix: windows compile issue

* fix: notify

* test: add cases

* modify case

* test: update test case.

* test(stream): toobacco scene testing #TD-36514

---------

Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: plum-lihui <huili@taosdata.com>
Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: zelv01 <1101510017@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: xiangyang guo <66111494+happyguoxy@users.noreply.github.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: zyyang90 <zyyang@taosdata.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Li Hui <52318143+plum-lihui@users.noreply.github.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: xiao-77 <berylbao@taosdata.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: happyguoxy <happy_guoxy@163.com>
Co-authored-by: Tony Zhang <34825804+Tony2h@users.noreply.github.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
 2025-07-16 14:42:16 +08:00
Bomin Zhang
0d2fd16e22 check return values 2025-07-15 15:51:08 +08:00
Bomin Zhang
1160e7e689 replace the usage of strdup 2025-07-15 11:49:50 +08:00
Bomin Zhang
876979b5f5
feat[ts-6107]: shared storage (#31552) 
* add API to use s3 as shared storage

* support using local file system as shared storage

* upload file to shared storage

* support read, compact and drop

* finish basic mnode & vnode msg processing

* follower sync migration state

* implement mnode transaction, and improve log

* send migration progress msg to dnode to avoid deadlock

* implement following migration

* remove mcount

* avoid redo migration on startup

* avoid follower deadlock when leader is down

* trigger migrate by timer,  avoid compact after migration

* comment out the usage of 'tcs' functions in stream

* change config item prefix from s3 to ss

* change db option prefix from s3 to ss

* rename s3 data struct, function, file to ss

* rename s3 macro to ss

* update s3 sql to ss

* rename remaining s3 items to ss

* check ss configruation, improve s3 retry

* grant object storage -> shared storage,  check ssEnabled

* fix memory leaks

* update build options

* omit sensitive information when dump config

* fix backward compatibility issue

* fix issues found in ci-checks

* fix some failed test cases

* avoid follower timeout and improve log

* fix: follower timeout because migration status not updated

* refuse migration if there's an in progress one

* fix ss test case

* remove garbage files and other minor improvement

* fix failed test cases

* update unit test

* fix failed test case

* fix failed test case

* update document

* update document and fix failed test cases

* fix minor issues in code, test and document

* check new commit after migration task is scheduled

* fix several issus

1. migrate information cannot be dropped sometimes because progress response was put into read queue.
2. memory leak in rare cases
3. data corruption in rare cases
4. failed test case

* add shared storage upgrade tool

* fix compile error
 2025-07-14 16:33:53 +08:00
Kaili Xu
dc2b021778
feat: support mount data path (#31677) 2025-07-12 15:39:29 +08:00
WANG MINGMING
753624fa03
fix(tmq): [TS-6569]tdb error if write tmq meta data in multi thread (#31808) 2025-07-12 13:43:53 +08:00
Zhixiao Bao
95cf8b751a
fix: set lcn before do s3 migrate. (#31782) 2025-07-11 16:24:46 +08:00
Kaili Xu
61ba6634ad
fix: overflow check in snprintf (#31780) 2025-07-11 09:08:47 +08:00
Tony Zhang
83b0fb43dc
fix: taosd crush in query when insufficient memory (#31746) 
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
 2025-07-11 08:11:57 +08:00
dongming chen
d7c25bba93
enh: add log for snapshot (#31681) 2025-07-10 09:48:18 +08:00
Mario Peng
808d720c1d
feat:insert into subquery (#31401) (#31710) 2025-07-08 17:26:34 +08:00
Simon Guan
d497a960eb Merge branch 'main' into merge/mainto3.0 2025-07-08 16:35:39 +08:00
Haojun Liao
4abc6c071d
fix(query): fix bug caused by shallow copy. (#31638) 2025-07-08 08:49:55 +08:00
Yihao Deng
f142278ec7
use no-default-index (#31623) 2025-07-04 14:16:26 +08:00
Kaili Xu
a86e09e4e3
enh: grant support vnodes and storage size (#31380) 2025-07-03 16:44:29 +08:00
dongming chen
68f7094041
fix/TS-6785-fix-return-code (#31593) 2025-07-03 14:22:12 +08:00
Simon Guan
fc2fec02c7
merge: from main to 3.0 branch (#31562) 2025-07-03 09:15:59 +08:00
xiao-77
fee17fa423 fix: can not open vnodes while change sub dataDir. 2025-06-30 17:07:28 +08:00
hongzhenliu
99b30bf096
fix(query) subscriptions memory leak (#31533) 
Co-authored-by: hongzhenliu335 <ethanliu@taosdata.com>
 2025-06-30 13:55:57 +08:00
Zhixiao Bao
62d8b35fd0
feat: add write metrics. (#31198) 2025-06-30 10:33:34 +08:00
Hongze Cheng
7508267906 enh: adjust log level 2025-06-26 09:38:45 +08:00
Yihao Deng
a4909ebe29
fix index perf (#31474) 2025-06-25 15:00:11 +08:00
dongming chen
73261908b5
fix: implement retry mechanism for vnodeProcessWriteMsg in vnodeApply… (#31388) 2025-06-24 16:53:11 +08:00
Mario Peng
c65e1592fa
feat:insert into subquery (#31401) 2025-06-21 15:11:09 +08:00
Simon Guan
9923aedcb6 Merge branch 'main' into merge/mainto3.0 2025-06-20 14:48:16 +08:00
Simon Guan
441a2472d7 Merge branch '3.0' into merge/3.0tomain2 2025-06-19 18:26:02 +08:00
Hongze Cheng
d9e56a61e4 enh: make info to debug 2025-06-18 16:45:29 +08:00
Minglei Jin
082c1ebfa9
relean mutex when returning (#31389) 2025-06-18 09:40:14 +08:00
Minglei Jin
4ddfb76cb9
relean mutex when returning (#31390) 2025-06-18 09:40:03 +08:00
Hongze Cheng
696d29d916 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-6672-taosd-main 2025-06-17 10:37:02 +08:00
Hongze Cheng
3e68b4cdd4 enh: add more check of submit message 2025-06-16 14:54:17 +08:00
Simon Guan
2838d2f063 Merge branch '3.0' into merge/mainto3.0 2025-06-14 10:41:12 +08:00
Hongze Cheng
8924124917 fix: check column number when alter table 2025-06-12 16:04:18 +08:00
Haojun Liao
e725e4ab24
fix(gpt): update the timeout parameter. (#31267) 2025-06-06 17:22:46 +08:00
Mario Peng
cc3fabdc08
fix:tsdb select error (#31300) 2025-06-06 15:09:54 +08:00
dongming chen
87c969b168
fix: [TD-35276] add-log-apply-internal-error (#31274) 2025-06-04 17:24:49 +08:00
Hongze Cheng
98e23733ba
fix: add duplicate tolerance (#31217) 2025-05-28 16:54:48 +08:00
Hongze Cheng
430da1f872
enh: add memory usage monitor for vnode (#31212) 2025-05-27 16:40:03 +08:00
Haojun Liao
11665b6efe fix(stream): control the global parameters. 2025-05-23 14:36:20 +08:00
Haojun Liao
8b2eb18323 fix(stream): update the stream info for update. 2025-05-23 11:01:28 +08:00
Haojun Liao
02d70186d2 refactor(stream): add parameters to config the stream queue size. 2025-05-22 19:56:49 +08:00
Haojun Liao
f5db6532dc refactor(stream): add parameters to config the write queue size. 2025-05-22 19:54:54 +08:00
Haojun Liao
4743cc3683 refactor(stream): check for write queue size for sink tasks. 2025-05-22 17:55:47 +08:00
Haojun Liao
231d8b416e fix(stream): fix memory leak. 2025-05-22 09:55:18 +08:00
WANG MINGMING
40216c6143
opti(tmq): save tmq offset in vnode commit time & change log level (#30993) 2025-05-15 18:15:01 +08:00
Haojun Liao
d02b17be0e
fix(stream): extends the node update check interval. (#31048) 2025-05-14 10:15:17 +08:00