Commit graph

10812 commits

Author SHA1 Message Date
wangmm0220
22acf0a3ed fix(stream): get tag value for vtable 2025-07-20 15:51:55 +08:00
wangmm0220
7c8574aa4a fix(stream): get tag for virtual child table 2025-07-20 15:51:55 +08:00
facetosea
ac7a084c5e fix: stack overflow 2025-07-19 13:50:13 +08:00
facetosea
064cc88b15 fix: errlog 2025-07-18 18:47:39 +08:00
wangmm0220
63bd11f78a fix(stream): heap use after free 2025-07-17 10:34:28 +08:00
wangmm0220
8eb2e55df0 fix(stream): add log 2025-07-17 09:16:42 +08:00
Jing Sima
975e4f697e feat: [TS-6100] Fix %%tbname when using virtual super table 2025-07-16 16:41:40 +08:00
facetosea
45c6063693 fix: notify 2025-07-16 13:57:08 +08:00
Jinqing Kuang
a20e5f97b9 Merge branch '3.0' into feat/TS-6100-3.0 2025-07-15 20:36:46 +08:00
Bomin Zhang
0d2fd16e22 check return values 2025-07-15 15:51:08 +08:00
Bomin Zhang
1160e7e689 replace the usage of strdup 2025-07-15 11:49:50 +08:00
wangmm0220
49fbc40076 fix(stream): get schema error with version 2025-07-15 11:20:18 +08:00
wangmm0220
cc822b1a8e Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-15 09:01:03 +08:00
Jinqing Kuang
91b6a83ebd Merge branch '3.0' into feat/TS-6100-3.0 2025-07-14 19:31:48 +08:00
wangmm0220
4dd226b1a9 fix(stream): optimize val scan logic 2025-07-14 17:14:59 +08:00
Bomin Zhang
876979b5f5
feat[ts-6107]: shared storage (#31552)
* add API to use s3 as shared storage

* support using local file system as shared storage

* upload file to shared storage

* support read, compact and drop

* finish basic mnode & vnode msg processing

* follower sync migration state

* implement mnode transaction, and improve log

* send migration progress msg to dnode to avoid deadlock

* implement following migration

* remove mcount

* avoid redo migration on startup

* avoid follower deadlock when leader is down

* trigger migrate by timer,  avoid compact after migration

* comment out the usage of 'tcs' functions in stream

* change config item prefix from s3 to ss

* change db option prefix from s3 to ss

* rename s3 data struct, function, file to ss

* rename s3 macro to ss

* update s3 sql to ss

* rename remaining s3 items to ss

* check ss configruation, improve s3 retry

* grant object storage -> shared storage,  check ssEnabled

* fix memory leaks

* update build options

* omit sensitive information when dump config

* fix backward compatibility issue

* fix issues found in ci-checks

* fix some failed test cases

* avoid follower timeout and improve log

* fix: follower timeout because migration status not updated

* refuse migration if there's an in progress one

* fix ss test case

* remove garbage files and other minor improvement

* fix failed test cases

* update unit test

* fix failed test case

* fix failed test case

* update document

* update document and fix failed test cases

* fix minor issues in code, test and document

* check new commit after migration task is scheduled

* fix several issus

1. migrate information cannot be dropped sometimes because progress response was put into read queue.
2. memory leak in rare cases
3. data corruption in rare cases
4. failed test case

* add shared storage upgrade tool

* fix compile error
2025-07-14 16:33:53 +08:00
wangmm0220
0772b9f6c5 fix(stream): optimize val scan logic 2025-07-14 16:33:37 +08:00
wangmm0220
9d29d8ca60 fix(stream): tmq error 2025-07-14 16:12:41 +08:00
wangmm0220
3cdd41b27f fix(stream): conflicts 2025-07-14 14:46:08 +08:00
wangmm0220
dcc4a6d1de fix(stream): opti wal interface 2025-07-14 14:40:59 +08:00
WANG MINGMING
a051a73a62
Merge pull request #31857 from taosdata/feat/TS-6100-3.0-mm
Feat/ts 6100 3.0 mm
2025-07-14 14:40:10 +08:00
wangmm0220
a3de606eda Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-14 11:27:00 +08:00
wangmm0220
b86d0959f5 fix(stream): scan wal with schema in that version 2025-07-14 11:26:31 +08:00
facetosea
0e0e4a2b1c fix: error code check 2025-07-14 11:17:37 +08:00
Jinqing Kuang
69dd276f7f Merge branch '3.0' into feat/TS-6100-3.0 2025-07-14 09:39:13 +08:00
facetosea
86cc038981 fix: gen crash 2025-07-12 16:21:07 +08:00
wangmm0220
35878f4b4a fix(stream): memory leak 2025-07-12 16:19:43 +08:00
Kaili Xu
dc2b021778
feat: support mount data path (#31677) 2025-07-12 15:39:29 +08:00
wangmm0220
4145df030d feat(stream): fix delete msg error 2025-07-11 17:39:51 +08:00
wangmm0220
9b8b23b378 feat(stream): delete msg from wal 2025-07-10 19:40:00 +08:00
wangmm0220
25dd06bc50 feat(stream): fix tmq error 2025-07-10 14:20:35 +08:00
Pan Wei
baf6a52153
Merge branch '3.0' into feat/TS-6100-3.0 2025-07-10 08:25:34 +08:00
wangmm0220
7b341af2b3 fix(stream): cid error when scan wal 2025-07-09 10:28:36 +08:00
wangmm0220
7ec5dd8990 fix(stream): set table scan operator param in vtable scan & fix filter error 2025-07-08 16:47:43 +08:00
Simon Guan
d497a960eb Merge branch 'main' into merge/mainto3.0 2025-07-08 16:35:39 +08:00
wangmm0220
30c692309c Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0-mm 2025-07-08 14:30:25 +08:00
wangmm0220
9da567453a fix(stream): set table scan operator param in vtable scan & fix filter error 2025-07-08 14:30:18 +08:00
facetosea
ce6e15a74d fix: log level 2025-07-08 10:58:10 +08:00
Jinqing Kuang
d932cfcd88 fix(stream): fix hist calc of stream trigger task 2025-07-08 10:27:35 +08:00
Pan Wei
489990a787
fix: memory issues (#31700)
* enh: add operator reset func

* fix: merge join reset issue

* fix: memory issues

* fix: add debug assert

* fix: memory issues

* fix: memory leak

* fix: memory issues

* fix taos log miss

* fix: case issue

* fix: case issue

* fix: case issues

* fix: drop dnode issue

* fix: memory issues

* fix: memory issues

* fix: memory leak issues

* fix: recalculate time range issue

* fix: add debug log

* fix: memory issues

* fix: enable case asan

* Update streamlist_for_ci.task

* fix: case asan issue

* fix: stream name issue

* fix: external window compile issues

* fix: deploy memory issue

* fix: ahandle issue

* fix: ahandle issue

* fix: ahandle issue

* fix: virtual table reader list issue

* fix: log info

* fix: msg error

* fix: virtual table addr list issue

* fix: memory issues

* fix: memory leak issue

* fix: memory issues

* fix: memory free issues

* fix: memory issues

* fix: snode deploy issue

* fix: mnode reader issue

---------

Co-authored-by: huohong <sallyhuo@taosdata.com>
2025-07-08 09:32:12 +08:00
facetosea
083db4f837 fix: log level 2025-07-08 09:29:12 +08:00
Haojun Liao
4abc6c071d
fix(query): fix bug caused by shallow copy. (#31638) 2025-07-08 08:49:55 +08:00
Jinqing Kuang
968eeeeb0b Merge branch '3.0' into feat/TS-6100-3.0-merge 2025-07-07 18:04:02 +08:00
wangmm0220
7dcc4d5292 fix(stream): release tsdb reader lock 2025-07-07 15:22:45 +08:00
wangmm0220
ed0aea6918 fix(stream): double free of notify content and timestamp not the firset col when getting tsdbmeta in reader 2025-07-05 14:17:52 +08:00
wangmm0220
4c4c3a8652 fix(stream): fix reset error in vtablescanoperator & modify log 2025-07-04 18:10:32 +08:00
Yihao Deng
f142278ec7
use no-default-index (#31623) 2025-07-04 14:16:26 +08:00
Jing Sima
a7adc8042f feat: [TS-6100] Support TSMA: Part 1. 2025-07-04 13:31:48 +08:00
facetosea
31ff18a0be fix: mem leak 2025-07-03 17:54:09 +08:00
Kaili Xu
a86e09e4e3
enh: grant support vnodes and storage size (#31380) 2025-07-03 16:44:29 +08:00