Commit graph

6356 commits

Author SHA1 Message Date
Pan Wei
7d6d64890e
fix: exchange issues (#31986)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

* fix: add debug log

* fix: conflict

* fix: create stream if not exists issue

* fix: ahandle memory leak

* fix: case issue

* fix: exchange issues

* fix: crash issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-18 08:06:26 +08:00
WANG MINGMING
c2bcb30d00
Merge pull request #31956 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-17 15:51:05 +08:00
wangmm0220
2f21da6287 fix(stream): table name error 2025-07-17 13:37:03 +08:00
Pan Wei
a170f59dd2
fix: ahandle memory leak (#31955)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

* fix: add debug log

* fix: conflict

* fix: create stream if not exists issue

* fix: ahandle memory leak

* fix: case issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-17 13:26:02 +08:00
Jing Sima
b25d39c034 feat: [TS-6100] Fix virtual table set null slot 2025-07-17 09:54:17 +08:00
wangmm0220
57651a4bad Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-17 09:16:57 +08:00
wangmm0220
8eb2e55df0 fix(stream): add log 2025-07-17 09:16:42 +08:00
facetosea
a80a53259e fix: notify 2025-07-16 18:43:02 +08:00
wangmm0220
a6c168220c Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-16 17:55:06 +08:00
wangmm0220
286383afc2 fix(stream): add log 2025-07-16 17:55:00 +08:00
Jing Sima
975e4f697e feat: [TS-6100] Fix %%tbname when using virtual super table 2025-07-16 16:41:40 +08:00
facetosea
68e7360a45 fix: stack overflow 2025-07-16 15:12:26 +08:00
Jing Sima
84da33463a feat: [TS-6100] Fix virtual table 2025-07-15 17:58:53 +08:00
Pan Wei
a4e6954153
fix: ci case issues (#31904)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-15 17:27:46 +08:00
dapan1121
8a2fd5c6f9 fix: windows compile issue 2025-07-15 08:37:12 +08:00
xinsheng Ren
373f22348d
Merge pull request #31886 from taosdata/fix/6100/externalAggError
fix: external agg error
2025-07-15 05:17:54 +08:00
WANG MINGMING
47d6f0f717
Merge pull request #31864 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-14 21:43:56 +08:00
xinsheng Ren
6c717796c3
Merge branch 'feat/TS-6100-3.0' into fix/6100/externalAggError 2025-07-14 20:51:31 +08:00
facetosea
862e36d0b7 fix: external agg error 2025-07-14 20:41:03 +08:00
Jinqing Kuang
91b6a83ebd Merge branch '3.0' into feat/TS-6100-3.0 2025-07-14 19:31:48 +08:00
Pan Wei
fe6d9c59e0
fix: ci case issues (#31880)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-14 19:15:21 +08:00
wangmm0220
c3586a6684 fix(stream): optimize val scan logic 2025-07-14 17:18:46 +08:00
Bomin Zhang
876979b5f5
feat[ts-6107]: shared storage (#31552)
* add API to use s3 as shared storage

* support using local file system as shared storage

* upload file to shared storage

* support read, compact and drop

* finish basic mnode & vnode msg processing

* follower sync migration state

* implement mnode transaction, and improve log

* send migration progress msg to dnode to avoid deadlock

* implement following migration

* remove mcount

* avoid redo migration on startup

* avoid follower deadlock when leader is down

* trigger migrate by timer,  avoid compact after migration

* comment out the usage of 'tcs' functions in stream

* change config item prefix from s3 to ss

* change db option prefix from s3 to ss

* rename s3 data struct, function, file to ss

* rename s3 macro to ss

* update s3 sql to ss

* rename remaining s3 items to ss

* check ss configruation, improve s3 retry

* grant object storage -> shared storage,  check ssEnabled

* fix memory leaks

* update build options

* omit sensitive information when dump config

* fix backward compatibility issue

* fix issues found in ci-checks

* fix some failed test cases

* avoid follower timeout and improve log

* fix: follower timeout because migration status not updated

* refuse migration if there's an in progress one

* fix ss test case

* remove garbage files and other minor improvement

* fix failed test cases

* update unit test

* fix failed test case

* fix failed test case

* update document

* update document and fix failed test cases

* fix minor issues in code, test and document

* check new commit after migration task is scheduled

* fix several issus

1. migrate information cannot be dropped sometimes because progress response was put into read queue.
2. memory leak in rare cases
3. data corruption in rare cases
4. failed test case

* add shared storage upgrade tool

* fix compile error
2025-07-14 16:33:53 +08:00
wangmm0220
9d29d8ca60 fix(stream): tmq error 2025-07-14 16:12:41 +08:00
xinsheng Ren
310fddfa49
Merge pull request #31861 from taosdata/fix/6100/resetInterpPrev
fix: reset interpPrev
2025-07-14 14:49:42 +08:00
wangmm0220
3cdd41b27f fix(stream): conflicts 2025-07-14 14:46:08 +08:00
wangmm0220
dcc4a6d1de fix(stream): opti wal interface 2025-07-14 14:40:59 +08:00
facetosea
47aef8e042 fix: reset interpPrev 2025-07-14 13:59:07 +08:00
dapan1121
b85b8398bb fix: windows compile issues 2025-07-14 11:50:56 +08:00
Jing Sima
375d49a823 feat: [TS-6100] Fix leaks. 2025-07-12 19:05:15 +08:00
facetosea
32f64aff89 fix: data null check 2025-07-12 17:47:51 +08:00
dapan1121
49b761037f fix: windows compile issues 2025-07-12 17:38:14 +08:00
dapan1121
ee7f3a3a2b fix: windows compile issue 2025-07-12 13:57:42 +08:00
Pan Wei
4c2ae9bd73
fix: external window and msg response issues (#31825)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-12 11:08:37 +08:00
WANG MINGMING
585324ceec
Merge pull request #31806 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-11 17:33:25 +08:00
wangmm0220
f85fc43c8f feat(stream): ts condition error in vtable scan & remove code of old stream 2025-07-11 16:50:27 +08:00
wangmm0220
c0587893d7 feat(stream): ts condition error in vtable scan & remove code of old stream 2025-07-11 16:48:04 +08:00
Pan Wei
2e3cbf4aa9
fix: placeholder function issues (#31789)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-11 13:55:15 +08:00
facetosea
e100ffa4d8 fix: out put ts is null 2025-07-11 11:13:43 +08:00
WANG MINGMING
92941deab9
Merge pull request #31778 from taosdata/feat/TS-6100-3.0-mm
feat(stream): fix dead lock
2025-07-10 18:56:26 +08:00
Jing Sima
e1b4fa198c feat: [TS-6100] Fix tbname/tag query of vtable. 2025-07-10 18:24:46 +08:00
wangmm0220
feb0986cf5 feat(stream): fix dead lock 2025-07-10 17:57:57 +08:00
wangmm0220
25dd06bc50 feat(stream): fix tmq error 2025-07-10 14:20:35 +08:00
Simon Guan
de85dad2a4
fix: comile error if without BUILD_CONTRIB (#31756) 2025-07-10 08:44:08 +08:00
xinsheng Ren
7ed0a24293
Merge pull request #31744 from taosdata/fix/6100/tbnametoolong
fix: tbname too long
2025-07-10 07:07:26 +08:00
facetosea
20be65d8c6 fix: memcpy c string 2025-07-10 02:08:03 +08:00
facetosea
82d0a769d7 fix: tbname cpy 2025-07-10 01:44:22 +08:00
Pan Wei
6cea090c86
fix: memory issues and case issues (#31743)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-09 18:57:01 +08:00
Jing Sima
2133d47fd0 feat: [TS-6100] Fix vstable scan plan 2025-07-09 18:16:00 +08:00
facetosea
882a9f23d5 fix: tbname too long 2025-07-09 16:19:39 +08:00