Commit graph

6181 commits

Author SHA1 Message Date
facetosea
a80a53259e fix: notify 2025-07-16 18:43:02 +08:00
Jing Sima
975e4f697e feat: [TS-6100] Fix %%tbname when using virtual super table 2025-07-16 16:41:40 +08:00
facetosea
68e7360a45 fix: stack overflow 2025-07-16 15:12:26 +08:00
Jing Sima
84da33463a feat: [TS-6100] Fix virtual table 2025-07-15 17:58:53 +08:00
Pan Wei
a4e6954153
fix: ci case issues (#31904)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

* fix: ci case issues

* fix: drop dnode issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-15 17:27:46 +08:00
dapan1121
8a2fd5c6f9 fix: windows compile issue 2025-07-15 08:37:12 +08:00
xinsheng Ren
373f22348d
Merge pull request #31886 from taosdata/fix/6100/externalAggError
fix: external agg error
2025-07-15 05:17:54 +08:00
WANG MINGMING
47d6f0f717
Merge pull request #31864 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-14 21:43:56 +08:00
xinsheng Ren
6c717796c3
Merge branch 'feat/TS-6100-3.0' into fix/6100/externalAggError 2025-07-14 20:51:31 +08:00
facetosea
862e36d0b7 fix: external agg error 2025-07-14 20:41:03 +08:00
Jinqing Kuang
91b6a83ebd Merge branch '3.0' into feat/TS-6100-3.0 2025-07-14 19:31:48 +08:00
Pan Wei
fe6d9c59e0
fix: ci case issues (#31880)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

* fix: deploy msg issue

* fix: compile issue

* fix: external window idx issue

* fix: ci issues

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-14 19:15:21 +08:00
wangmm0220
c3586a6684 fix(stream): optimize val scan logic 2025-07-14 17:18:46 +08:00
Bomin Zhang
876979b5f5
feat[ts-6107]: shared storage (#31552)
* add API to use s3 as shared storage

* support using local file system as shared storage

* upload file to shared storage

* support read, compact and drop

* finish basic mnode & vnode msg processing

* follower sync migration state

* implement mnode transaction, and improve log

* send migration progress msg to dnode to avoid deadlock

* implement following migration

* remove mcount

* avoid redo migration on startup

* avoid follower deadlock when leader is down

* trigger migrate by timer,  avoid compact after migration

* comment out the usage of 'tcs' functions in stream

* change config item prefix from s3 to ss

* change db option prefix from s3 to ss

* rename s3 data struct, function, file to ss

* rename s3 macro to ss

* update s3 sql to ss

* rename remaining s3 items to ss

* check ss configruation, improve s3 retry

* grant object storage -> shared storage,  check ssEnabled

* fix memory leaks

* update build options

* omit sensitive information when dump config

* fix backward compatibility issue

* fix issues found in ci-checks

* fix some failed test cases

* avoid follower timeout and improve log

* fix: follower timeout because migration status not updated

* refuse migration if there's an in progress one

* fix ss test case

* remove garbage files and other minor improvement

* fix failed test cases

* update unit test

* fix failed test case

* fix failed test case

* update document

* update document and fix failed test cases

* fix minor issues in code, test and document

* check new commit after migration task is scheduled

* fix several issus

1. migrate information cannot be dropped sometimes because progress response was put into read queue.
2. memory leak in rare cases
3. data corruption in rare cases
4. failed test case

* add shared storage upgrade tool

* fix compile error
2025-07-14 16:33:53 +08:00
wangmm0220
9d29d8ca60 fix(stream): tmq error 2025-07-14 16:12:41 +08:00
xinsheng Ren
310fddfa49
Merge pull request #31861 from taosdata/fix/6100/resetInterpPrev
fix: reset interpPrev
2025-07-14 14:49:42 +08:00
wangmm0220
3cdd41b27f fix(stream): conflicts 2025-07-14 14:46:08 +08:00
wangmm0220
dcc4a6d1de fix(stream): opti wal interface 2025-07-14 14:40:59 +08:00
facetosea
47aef8e042 fix: reset interpPrev 2025-07-14 13:59:07 +08:00
dapan1121
b85b8398bb fix: windows compile issues 2025-07-14 11:50:56 +08:00
Jing Sima
375d49a823 feat: [TS-6100] Fix leaks. 2025-07-12 19:05:15 +08:00
facetosea
32f64aff89 fix: data null check 2025-07-12 17:47:51 +08:00
dapan1121
49b761037f fix: windows compile issues 2025-07-12 17:38:14 +08:00
dapan1121
ee7f3a3a2b fix: windows compile issue 2025-07-12 13:57:42 +08:00
Pan Wei
4c2ae9bd73
fix: external window and msg response issues (#31825)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

* fix: add debug log

* fix: compile issues

* fix: double free issue

* fix: runner addr update issue

* fix: msg rsp issue

* fix: external window reset issue

* fix: configuration issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-12 11:08:37 +08:00
WANG MINGMING
585324ceec
Merge pull request #31806 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-11 17:33:25 +08:00
wangmm0220
c0587893d7 feat(stream): ts condition error in vtable scan & remove code of old stream 2025-07-11 16:48:04 +08:00
Pan Wei
2e3cbf4aa9
fix: placeholder function issues (#31789)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

* fix: external window issues

* fix: external window placeholder issue

* fix: placeholder function init issues

* fix: memory leak issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-11 13:55:15 +08:00
facetosea
e100ffa4d8 fix: out put ts is null 2025-07-11 11:13:43 +08:00
WANG MINGMING
92941deab9
Merge pull request #31778 from taosdata/feat/TS-6100-3.0-mm
feat(stream): fix dead lock
2025-07-10 18:56:26 +08:00
Jing Sima
e1b4fa198c feat: [TS-6100] Fix tbname/tag query of vtable. 2025-07-10 18:24:46 +08:00
wangmm0220
feb0986cf5 feat(stream): fix dead lock 2025-07-10 17:57:57 +08:00
wangmm0220
25dd06bc50 feat(stream): fix tmq error 2025-07-10 14:20:35 +08:00
xinsheng Ren
7ed0a24293
Merge pull request #31744 from taosdata/fix/6100/tbnametoolong
fix: tbname too long
2025-07-10 07:07:26 +08:00
facetosea
20be65d8c6 fix: memcpy c string 2025-07-10 02:08:03 +08:00
facetosea
82d0a769d7 fix: tbname cpy 2025-07-10 01:44:22 +08:00
Pan Wei
6cea090c86
fix: memory issues and case issues (#31743)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

* fix: memory issues

* fix: add debug test

* enh: add ignore nodata trigger

* fix: memory leaks

* fix: configuration issue

* fix: memory issue

* fix: external window issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-09 18:57:01 +08:00
Jing Sima
2133d47fd0 feat: [TS-6100] Fix vstable scan plan 2025-07-09 18:16:00 +08:00
facetosea
882a9f23d5 fix: tbname too long 2025-07-09 16:19:39 +08:00
Jing Sima
a12a9d80d9
feat: [TS-6100] Fix vtable scan wrong plan and fix mem leak (#31721) 2025-07-09 08:57:06 +08:00
WANG MINGMING
88ede44898
Merge pull request #31706 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-08 23:43:43 +08:00
facetosea
2059de7d7a fix: _rowts in external window 2025-07-08 16:32:49 +08:00
Jing Sima
dd75d09bb2 feat: [TS-6100] Fix wrong vgid for tagscan 2025-07-08 15:14:29 +08:00
wangmm0220
30c692309c Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-08 14:30:25 +08:00
wangmm0220
9da567453a fix(stream): set table scan operator param in vtable scan & fix filter error 2025-07-08 14:30:18 +08:00
facetosea
9693811885 fix: free tbname when quit 2025-07-08 12:56:29 +08:00
facetosea
76debd11c9 fix: tbname 2025-07-08 11:46:19 +08:00
facetosea
c3b49fd4c9 fix: taosStrdup 2025-07-08 11:34:21 +08:00
facetosea
4ced603aed fix: tbname cache 2025-07-08 11:17:25 +08:00
dapan1121
788a5d603f fix: return code issue 2025-07-08 10:24:27 +08:00