Pan Wei
d10105f152
fix: notify free issue ( #32206 )
...
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
* fix: external window idx issue
* fix: ci issues
* fix: ci case issues
* fix: drop dnode issue
* fix: add debug log
* fix: conflict
* fix: create stream if not exists issue
* fix: ahandle memory leak
* fix: case issue
* fix: exchange issues
* fix: crash issue
* fix: exchange prefetch issue
* fix: snode quit issue
* enh: support indef rows func
* fix: crash issues
* Fix external window collect vector function
* fix: external window indef rows issues
* fix: external window issue
* enh: support count always return value in external window
* fix: force output when has more result block
* fix: runner block retrieve issue
* fix: crash issue
* fix: count cases issue
* fix: reader deploy message issue
* fix: task deploy issue
* fix: external window scalar issue
* fix: compile issue
* fix: group cache reset issue
* fix: add protection check
* fix: add grant check
* fix: add disableStream config
* fix: notify free issue
* fix: case issue
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: facetosea <285808407@qq.com>
2025-07-24 16:55:10 +08:00
Pan Wei
f0df7a26d7
Feat/ts 6100 3.0.0722m ( #32103 )
...
* migrate system-test/2-query
* revert file
* update case.task
* resolve script migrate
* run new test framework on new_testcases
* migrate system-test/2-query
* format docstring
* fix test validation
* fix test validation
* fix error
* migrate army case
* migrate army case
* fix error
* migrate system-test/2-query
* migrate system-test/2-query
* migrate system-test/2-query
* migrate system-test/2-query
* test exe time
* fix ci error
* migrate system-test/1-insert
* new common function
* migrate system-test/1-insert
* fix ci error
* migrate system-test/1-insert
* feat: add configuration and script for memory allocator settings
* fix: correct HEAPPROFILE path and remove redundant metadata_thp setting in memory allocator script
* fix ci error
* migrate system-test/1-insert, 2-query
* feat:insert into subquery (#31401 ) (#31710 )
* migrate system-test/99-TDcase
* feat(gpt): add grant check for gpt. (#31708 )
* migrate system-test/99-TDcase
* migrate system-test/99-TDcase
* migrate system-test/99-TDcase
* fix/send-heartbeat-statis (#31680 )
* migrate system-test/7-tmq
* chore: support cmake option TAOSWS_GIT_TAG like taosadapter [skip ci] (#31486 )
* add system-test/6/cluster test
* chore: move default branch from main to 3.3.6 for adapter/taosws
* fix docstring validation
* migrate system-test/7-tmq
* migrate system-test/7-tmq
* feat: add set_taos_malloc_env configuration and update related scripts
* Update 03-kubernetes.md
* enh: add log for snapshot (#31681 )
* simple test
* more
* migrate system-test/7-tmq
* migrate system-test 0-others cases
* migrate system-test/7-tmq
* fix docstring validation
* migrate system-test/7-tmq
* fix docstring validation
* fix: invalid queue
* fix docstring validation
* refactor: reorganize memory allocator script constants and improve mode descriptions
* enh: TD-36324-improve-sync-heartbeat-log (#31727 )
* recover log level
* fix: taosd crush in query when insufficient memory (#31746 )
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
* fix: overflow check in snprintf (#31780 )
* migrate system-test/7-tmq
* migrate some cases
* migrate system-test/7-tmq
* fix failed cases
* fix failed cases
* migrate some cases
* fix failed cases
* fix failed cases
* migrate testcases
* fix: update environment file path in taosd.service and adjust set_taos_malloc.sh configuration
* fix: set lcn before do s3 migrate. (#31782 )
* migrate testcases
* fix failed cases
* fix: add condition to set default malloc config for taosd service
* fix: update usage message in set_taos_malloc.sh to include quiet mode option
* fix: add quiet mode option to set malloc config in install script
* fix: update set_taos_malloc.sh to improve output messages and adjust default malloc config invocation
* recover log level
* fix(tmq): [TS-6569]tdb error if write tmq meta data in multi thread (#31808 )
* fix: the calculation of dnode uptime (#31832 )
* migrate testcase
* fix: correct timediff function bug and redress docs (#31798 )
* fix: enhance malloc configuration for taosd and taosadapter in install script
* fix: TD-36442 show full condition (#31796 )
* enh/TD-36466-sync-heartbeat (#31805 )
* fix(plan) virtual table support BI moudle when use in select (#31787 )
* fix failed cases
* enh: TS-5926-force-repair-wal (#31828 )
* migrate testcase
* rename taos & taosd (#31855 )
* migrate testcase
* migrate testcase
* fix failed cases
* fix: update environment file paths in taosd.service and set_taos_malloc.sh
* feat: add performance tuning documentation for memory optimization and set_taos_malloc.sh usage
* fix: update file paths in performance tuning documentation for consistency
* feat: add performance tuning documentation for memory allocator configuration script
* fix: add missing line breaks for improved readability in performance tuning documentation
* fix: adjust heading levels for consistency in performance tuning documentation
* fix cases
* fix new_testcases
* fix failed cases
* fix(query): support show tags on virtual table (#31831 )
* fix failed cases
* docs: replace mysql screenshot (#31888 )
* feat: use the new TDengine product name (#31859 )
* merge 3.0
* fix failed cases
* fix failed cases
* merge 3.0
* fix cases
* fix cases
* doc: Update 03-stream.md (#31675 )
* chore(deps): bump requests from 2.27.1 to 2.32.4 in /test (#31326 )
Bumps [requests](https://github.com/psf/requests ) from 2.27.1 to 2.32.4.
- [Release notes](https://github.com/psf/requests/releases )
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md )
- [Commits](https://github.com/psf/requests/compare/v2.27.1...v2.32.4 )
---
updated-dependencies:
- dependency-name: requests
dependency-version: 2.32.4
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* fix new cases
* fix:Convert line endings from LF to CRLF for ans file
* build(deps): bump golang.org/x/net in /tools/keeper (#30811 )
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.36.0 to 0.38.0.
- [Commits](https://github.com/golang/net/compare/v0.36.0...v0.38.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-version: 0.38.0
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump urllib3 from 1.26.20 to 2.5.0 in /test (#31414 )
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 1.26.20 to 2.5.0.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.20...2.5.0 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.5.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump org.apache.tomcat.embed:tomcat-embed-core (#31392 )
Bumps org.apache.tomcat.embed:tomcat-embed-core from 9.0.104 to 9.0.106.
---
updated-dependencies:
- dependency-name: org.apache.tomcat.embed:tomcat-embed-core
dependency-version: 9.0.106
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump org.apache.tomcat.embed:tomcat-embed-core (#31393 )
Bumps org.apache.tomcat.embed:tomcat-embed-core from 9.0.104 to 9.0.106.
---
updated-dependencies:
- dependency-name: org.apache.tomcat.embed:tomcat-embed-core
dependency-version: 9.0.106
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump org.apache.kafka:kafka-clients (#31341 )
Bumps org.apache.kafka:kafka-clients from 3.9.0 to 3.9.1.
---
updated-dependencies:
- dependency-name: org.apache.kafka:kafka-clients
dependency-version: 3.9.1
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* fix: add lock when calculating log buffer start/end (#31883 )
* fix new cases
* fix new cases
* fix failed cases
* feat: new stream (#31678 )
* fix: windows compile issue
* test: add vtable cases (#31829 )
* fix: windows compile issues
* test:add test cases
* fix: windows compile issue
* case: em-4 stream case submit
* test: stream4_sub1 found bug2
* test: submit test_scene_meters_bug2.py
* add stream parameters example
* feat: [TS-6100] Do not translate const value as column.
* Feat/ts 6100 3.0 zlv (#31747 )
* modify asan exampel
* modify asan exampel
* add example
* add example
* modify case example
---------
Co-authored-by: zelv01 <1101510017@qq.com>
* feat(stream): fix memory leak
* modify sliding example
* test: update test case.
* feat(stream): fix conflicts
* fix: add offset case 10a 10s 10m 10h 10d
* feat(stream): fix conflicts
* chore(stream): rename case name #TS-6100
* add case
* modify example
* fix: windows compile issues
* fix: data null check
* feat: [TS-6100] Forbid where when using %%trows (#31827 )
* feat: [TS-6100] Forbid where when using %%trows
* test: update cases
* feat: [TS-6100] Fix leaks.
---------
Co-authored-by: Simon Guan <guanshengliang@qq.com>
* test: reproduce bugs
* test: update test case.
* test: update test case.
* feat: [TS-6100] Fix leaks.
* test: add cases
* Feat/ts 6100 3.0.pw10 (#31841 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* test: reproduce bugs
* fix: add sliding interval combine case
* test: add cases
* test: add recalc test.
* test: reproduce bugs
* case : add vt ts is null check
* modify case
* bug: submit test_idmp_meters_bug3.py
* test: add test for recalc.
* test: add cases
* fix: error code check
* test: add cases
* fix(stream): scan wal with schema in that version
* add case
* test: add cases
* test: update test case.
* fix: windows compile issues
* add case
* test: add cases (#31845 )
* modify case
* fix: reset interpPrev
* test: add test_idmp_meters bug4 and bug3
* add case
* fix(stream): opti wal interface
* fix: remove test_idmp_meters_bug5.py
* test: add cases
* fix(stream): fix ts data fetch for virtual tables
* cancel asan case
* test: update test case.
* test: update test case.
* add case
* test: add cases
* test: add cases
* test: add case test_idmp_meters_bug5.py
* test: update test case.
* fix(stream): tmq error
* test: add cases
* feat: [TS-6100] Restore deleted code in mndSma.c since they are still in use.
* fix(stream): optimize val scan logic
* test: add test_recalc_expired_time.py to ci.
* test: update test case.
* test: update test case.
* feat: [TS-6100] Fix fill range check
* fix(stream): optimize val scan logic
* add case
* test: modify for partition by %%1
* test: add fun case stream4_sub7
* fix(stream): optimize val scan logic
* add case
* feat: [TS-6100] Rename OPTIONS to STREAM_OPTIONS.
* test: add test for recalc.
* test: use stream_options.
* fix: some cases error.
* test: remove recalc from ci.
* fix: ci case issues (#31880 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
* fix: external window idx issue
* fix: ci issues
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* fix(stream): fix compilation error
* fix(stream): optimize val scan logic
* test:add test cases
* test: modify case
* fix: external agg error
* test(stream): tobacco scene testing #TD-36514
* test: add stream cases (#31885 )
* fix: windows compile issue
* fix: calc timerange
* fix: windows compile issue
* modify case
* fix(stream): compile error
* test: remove one debug test case file
* test: modify
* test: add test cases
* test: reproduce bugs
* test: reproduce bugs
* feat: [TS-6100] Placeholder function should only appera in SELECT and… (#31868 )
* feat: [TS-6100] Placeholder function should only appera in SELECT and WHERE and FROM.
* test: update case
---------
Co-authored-by: Simon Guan <guanshengliang@qq.com>
* add example
* add example
* modify case example
* modify case
* test:alter sql
* test: add stream5 case
* fix(stream): get schema error with version
* test: add delete recalc test py.
* test: remove bug cases
* test: stream5 case test passed
* test: add state cases (#31893 )
* fix(stream): compile error
* test: modify case
* test: add cases
* test: add test.
* test: update test case.
* chore(test): fix case err
* test: update test case.
* fix: align data get
* fix(stream): fix row index of datablock written into data cache
* fix: put align data
* test: update test case.
* test: add test cases for virtual table
* chore(test): fix case err #TD-36514
* add case
* test: add test for water mark.
* test: add meters bug6 for stream5
* test: add cases (#31903 )
* test: add test for recalc.
* feat: [TS-6100] %%trows can only be used when event type is window close.
* test: add precision of database for ms/us/ns
* modify case
* add case
* add case
* test: add test to ci.
* modify case
* fix: ci case issues (#31904 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
* fix: external window idx issue
* fix: ci issues
* fix: ci case issues
* fix: drop dnode issue
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* fix(stream): ci error
* test: update test case.
* feat: [TS-6100] Disable some failed UT.
* feat: [TS-6100] Fix virtual table
* test: add bug 5.
* test: add test delete recalc to ci.
* test: add bug 6.
* test(stream): tobacco scene #TD-36514
* fix: reqCids,reqCols memory leak in SSTriggerRealtimeContext
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
* test: add case stream6
* fix(stream): implement some pending features in trigger task
* modify case
* modify case
* fix: case issues
* modify case
* test: add recalc for warter mark.
* fix(stream): fix count window trigger of virtual tables
* fix(stream): memory leak
* test: fix run err.
* test: add stream6 bug7
* fix: adjust format
* test(stream): tobacco scene testing #TD-36514
* test: change bug7 with update window1 and 2
* test: add test bug 7.
* case: restore write 3 window
* fix: windows compile issue
* fix: notify
* test: add cases
* modify case
* test: update test case.
* test(stream): toobacco scene testing #TD-36514
---------
Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: plum-lihui <huili@taosdata.com>
Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: zelv01 <1101510017@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: xiangyang guo <66111494+happyguoxy@users.noreply.github.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: zyyang90 <zyyang@taosdata.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Li Hui <52318143+plum-lihui@users.noreply.github.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: xiao-77 <berylbao@taosdata.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: happyguoxy <happy_guoxy@163.com>
Co-authored-by: Tony Zhang <34825804+Tony2h@users.noreply.github.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
* test: rename TSDB
* docs: fix rust examples (#31908 )
* docs: modify rust native test case
* docs: modify rust ws test case
* docs: modify rust examples
* docs: update rust pool docs
* fix new cases
* migrate test case
* feat: support reading sub table names and tag values from CSV files to create sub tables (#31909 )
* feat: add obtaining table names from tag files
* feat: add write data table control
* feat: add table params to write
* feat: delete log file
* feat: modify test case csv path
* feat: resolve memory leakage in the table building thread
* feat: resolve compilation errors
* feat: resolve table name copy len error
* feat: modify create table log level
* feat: modifying query configuration parameter array out of bounds
* feat: support custom primary key names
* feat: modify log level
* feat: add set primary key name case
* feat: add column keywords case
* feat: add keywords case data
* feat: modify primaryKeyName value len
* feat: modify primaryKeyName value define
* feat: modify primaryKeyName value size
* fix: compile issue (#31943 )
Co-authored-by: taos-support <it@taosdata.com>
* package: fix error
* package: fix error
* fix failed cases
* merge 3.0
* rename create_table_keywords.py to test_create_table_keywords.py
* fix failed cases
* fix new cases
* docs: update stream (#31957 )
* docs: update jdbc out-dated descripiton (#31959 )
* fix: TD-36560 refactor arbitrator group function name and log (#31852 )
* feat: support BLOB data type (#31704 )
* rename 0-others/mounts.py to 0-others/test_mounts.py
* fix failed cases
* docs: update gpt (#31975 )
* fix failed cases
* fix failed cases
* package: fix error
* feat: add taosBenchmark command line parameters (#31967 )
* feat: add command line parameters
* feat: add command line parameter test cases
* fix: tableName len error
* enh: set TD Release build in tdengine-build.yml
* Update tdengine-build.yml
* fix: add json file path log
* fix: streamline TD_CONFIG export in build steps
* fix: Restore the build configuration
---------
Co-authored-by: haoranchen <haoran920c@163.com>
* fix: tableName len error (#31977 )
* fix: tableName len error
* fix: modify TD_CONFIG=Release
* fix: code format
* fix: Restore the build configuration
* enh: set TD Release build in tdengine-build.yml (#31980 )
* enh: set TD Release build in tdengine-build.yml
* Update tdengine-build.yml
* fix: update cache key for externals to include debug build version
* fix: remove verbose flag from build commands in tdengine-build.yml
* skip memleak cases
* fix failed case
* fix failed cases
* package: fix error
* fix(stmt2):tbname error output (#31997 )
* fix: possible memory leak (#31972 )
* feat: create connect add dbname params (#32002 )
* feat: create connect add dbname params
* fix: connect param error
* skip failed cases
* fix cases on windows
* fix cases
* support connect bi mode and fix log level
* unique sql connect username and password
* fix log level
* enh: mounted vnode may have no tq (#31916 )
* fix: subquery memleak (#32024 )
* fix failed case
* fix cases
* rename 2-query/test_insert_select.py to 2-query/test_system_insert_select.py
* skip memleak cases
* enh: rename data forecast/detect to forecasting/anomaly detection (#32021 )
* package: unique product name
* package: update for main
* skip tsim cases
* chore: update jdbc connection pool validation query sql (#32056 )
* refactor: quotes usage in bash scripts
Signed-off-by: WANG Xu <feici02@outlook.com>
* enhn(mqtt/rawblock): new format for msg payload (#31801 )
* fix: fix broken link in 14-stream.md
* docs: 15-spark.md is missing end semicolon (#32068 )
* chore: bump dev version to 3.3.7.0.alpha (#32066 )
* fix: blob test (#32020 )
* fix blob query error
* fix blob query error
* fix blob query error
* fix blob query error
* fix blob query error
* opt query
* opt write
* opt write
* opt write
* opt bse
* opt write
* opt write
* opt write
* opt write
* opt write
* opt write
* opt write
* opt write
* opt write
* opt write
* opt write
* opt write
* opt write
* add cache
* opt query
* opt query
* opt bse
* add data iter
* add data iter
* add more compress
* add more compress
* add more compress
* add more compress
* add more compress
* add more compress
* opt blob transfer
* opt blob transfer
* opt blob transfer
* opt write
* avoid unordered data write
* avoid unordered data write
* opt read
* refactor log
* fix invalid write
* refactor code
* fix merge error
* fix merge error
* add error code
* support blob type len
* support blob type len
* support blob type len
* support blob type len
* support blob type len
* support blob type len
* support blob type len
* support blob type len
* support blob type len
* support blob type len
* Merge remote-tracking branch 'origin/3.0' into enh/blob
* refactor code
* support blob type len
* refactor code
* refactor code
* benchmark support blob type
* benchmark support blob type
* add log
* handle sort and merge row
* change file set
* change file set
* change file set
* change file set
* change file set
* change file set
* change file set
* opt code
* opt read
* add restart error and add unit test
* add restart error and add unit test
* add restart error and add unit test
* add restart error and add unit test
* add restart error and add unit test
* refactor code
* add restart error and add unit test
* opt code
* refactor code
* fix invalid write
* blob test
* blob test
* blob test
* blob test
* blob test
* support blob
* add str trim
* add str trim
* Merge remote-tracking branch 'origin/3.0' into feat/blob
* Merge remote-tracking branch 'origin/3.0' into feat/blob
* update test case
* fix invalid read
* fix invalid read
* fix invalid read
* add stmt2
* add stmt2
* add stmt2
* update parameter
* refactor test case
* refactor test case
* support blob
* support stmt2
* add sub
* support blob
* support blob
* support sub
* fix tmq crash
* support windows/darwin
* fix stmt2 bind row
* fix blob crash
* fix blob crash
* fix blob query error
* fix blob crash
* fix merge error
* refactor bse
* add blob transfer
* add blob transfer
* add transfer snapshot
* refactor code
* change log level
* change log level
* add test case
* refactor code
* revert taosBenchmark
* revert taosbench
* fix: improve error handling and encoding for file reading in grep_asserts_in_file function
* rm assert
* fix mem leak
* fix compile error
* fix conflict
* fix conflict
* fix compile error
* fix compile error
* fix pre check error
* fix pre check error
* fix compile error on windows
* fix error on window
* fix error on windows
* fix error on windows
* opt no-blob sql
* fix compile error on dawain
* fix compile error on dawain
* fix invalid read
* fix mem leak
* fix invalid read
* fix invalid read
* fix error on windows
* remove unused code
* refactor code
* fix mem leak
* fix mem leak
* rm unused code
* rm unused code
* fix invalid copy
* fix invalid copy
* fix invalid copy
* fix invalid copy
* fix invalid copy
* refactor code
* make ci happy
* refactor code
* change make
* update test case
* update ignore code
* update bse snapshot and test case
* update bse snapshot and test case
* refactor code
* change unit test
* update bse snapshot
* update bse snapshot
* fix test case
* fix bse snapshot
* fix bse snapshot
* fix snapshot transfer
* remove unused log
* support func query
* add test case
* forbidden unsupport code
* merge 3.0
* merge 3.0
* change test case
* add forbidden code
* add forbidden code
* add code
* support length func
* support length func
* taosBenchmark support blob
* support blob raw block
* support write raw block
* support more query
* Merge branch 'feat/blob' into feat/blob_test
* SBlobRow2
* change bse commit change
* refactor code
* rm exe test
* refactor code
* checke return code
* rename blob name
* refactor code
* refactor code
* refactor code
* refactor code
* fix unordere write
* fix unordere write
* fix row merge error
* fix row merge error
* fix row merge error
* fix row merge error
* support ordered data
* support ordered data
* Merge remote-tracking branch 'origin/3.0' into feat/blob_test
* fix stmt2 blob crash
* add not support write type
* add not support write type
* add not support write type
* rm exe
* fix col-formate error
* fix col-formate error
* fix mem leak
* refactor code
* add error code for single blob column restriction and update error message
* add error code for single blob column restriction and update error message
* add error code for single blob column restriction and update error message
* refactor code
* change error code
* make ci happy
---------
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
Co-authored-by: chenhaoran <haoran920c@163.com>
* package: update for main (#32091 )
* fix compile error on windows (#32089 )
* fix: source code merge issues
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: WANG Xu <feici02@outlook.com>
Co-authored-by: minhuinie <nminhui@163.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: chenhaoran <haoran920c@163.com>
Co-authored-by: Nie Minhui <143420805+minhuinie@users.noreply.github.com>
Co-authored-by: Mario Peng <48949600+Pengrongkun@users.noreply.github.com>
Co-authored-by: Haojun Liao <hjxilinx@users.noreply.github.com>
Co-authored-by: dongming chen <cademfly@hotmail.com>
Co-authored-by: Linhe Huo <linhehuo@gmail.com>
Co-authored-by: huohong <346479823@qq.com>
Co-authored-by: Joel Brass <joel@jbrass.com>
Co-authored-by: WANG Xu <feici02@outlook.com>
Co-authored-by: Hongze Cheng <hzcheng@taosdata.com>
Co-authored-by: Tony Zhang <34825804+Tony2h@users.noreply.github.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
Co-authored-by: Kaili Xu <klxu@taosdata.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: WANG MINGMING <wangmm0220@gmail.com>
Co-authored-by: hongzhenliu <wluckyjob@gmail.com>
Co-authored-by: Daniel Clow <106956386+danielclow@users.noreply.github.com>
Co-authored-by: She Yanjie <57549981+sheyanjie-qq@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: plum-lihui <huili@taosdata.com>
Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: zelv01 <1101510017@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: xiangyang guo <66111494+happyguoxy@users.noreply.github.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: zyyang90 <zyyang@taosdata.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: Li Hui <52318143+plum-lihui@users.noreply.github.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: xiao-77 <berylbao@taosdata.com>
Co-authored-by: happyguoxy <happy_guoxy@163.com>
Co-authored-by: guozhenwei <2227465945@qq.com>
Co-authored-by: kevin men <men_shi_bin@163.com>
Co-authored-by: taos-support <it@taosdata.com>
Co-authored-by: Yihao Deng <luomoxyz@126.com>
Co-authored-by: Minglei Jin <49711132+stephenkgu@users.noreply.github.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-07-22 13:25:21 +08:00
Jinqing Kuang
91b6a83ebd
Merge branch '3.0' into feat/TS-6100-3.0
2025-07-14 19:31:48 +08:00
Bomin Zhang
876979b5f5
feat[ts-6107]: shared storage ( #31552 )
...
* add API to use s3 as shared storage
* support using local file system as shared storage
* upload file to shared storage
* support read, compact and drop
* finish basic mnode & vnode msg processing
* follower sync migration state
* implement mnode transaction, and improve log
* send migration progress msg to dnode to avoid deadlock
* implement following migration
* remove mcount
* avoid redo migration on startup
* avoid follower deadlock when leader is down
* trigger migrate by timer, avoid compact after migration
* comment out the usage of 'tcs' functions in stream
* change config item prefix from s3 to ss
* change db option prefix from s3 to ss
* rename s3 data struct, function, file to ss
* rename s3 macro to ss
* update s3 sql to ss
* rename remaining s3 items to ss
* check ss configruation, improve s3 retry
* grant object storage -> shared storage, check ssEnabled
* fix memory leaks
* update build options
* omit sensitive information when dump config
* fix backward compatibility issue
* fix issues found in ci-checks
* fix some failed test cases
* avoid follower timeout and improve log
* fix: follower timeout because migration status not updated
* refuse migration if there's an in progress one
* fix ss test case
* remove garbage files and other minor improvement
* fix failed test cases
* update unit test
* fix failed test case
* fix failed test case
* update document
* update document and fix failed test cases
* fix minor issues in code, test and document
* check new commit after migration task is scheduled
* fix several issus
1. migrate information cannot be dropped sometimes because progress response was put into read queue.
2. memory leak in rare cases
3. data corruption in rare cases
4. failed test case
* add shared storage upgrade tool
* fix compile error
2025-07-14 16:33:53 +08:00
Jinqing Kuang
69dd276f7f
Merge branch '3.0' into feat/TS-6100-3.0
2025-07-14 09:39:13 +08:00
Kaili Xu
dc2b021778
feat: support mount data path ( #31677 )
2025-07-12 15:39:29 +08:00
Pan Wei
baf6a52153
Merge branch '3.0' into feat/TS-6100-3.0
2025-07-10 08:25:34 +08:00
Simon Guan
d497a960eb
Merge branch 'main' into merge/mainto3.0
2025-07-08 16:35:39 +08:00
Jinqing Kuang
968eeeeb0b
Merge branch '3.0' into feat/TS-6100-3.0-merge
2025-07-07 18:04:02 +08:00
Jing Sima
a7adc8042f
feat: [TS-6100] Support TSMA: Part 1.
2025-07-04 13:31:48 +08:00
Kaili Xu
a86e09e4e3
enh: grant support vnodes and storage size ( #31380 )
2025-07-03 16:44:29 +08:00
Simon Guan
fc2fec02c7
merge: from main to 3.0 branch ( #31562 )
2025-07-03 09:15:59 +08:00
Zhixiao Bao
62d8b35fd0
feat: add write metrics. ( #31198 )
2025-06-30 10:33:34 +08:00
dongming chen
b46c54f843
refactor: remove unused fileLock mutex from SVnodeMgmt structure ( #31441 )
2025-06-24 16:54:26 +08:00
facetosea
60d4228e16
fix: log error
2025-06-24 14:39:50 +08:00
facetosea
8f0dec3362
fix: build error
2025-06-24 14:34:58 +08:00
facetosea
3f98c5af36
log: dnode get failed
2025-06-24 14:33:40 +08:00
Jinqing Kuang
85fad8e178
Merge branch '3.0' into temp
2025-06-23 18:08:09 +08:00
dongming chen
7126f40688
feat: [TD-29445] add error handling for offline vnode state ( #31232 )
2025-05-29 16:44:08 +08:00
wangjiaming0909
a3ca501368
new-stream: runner remove comments
2025-05-21 00:50:15 +00:00
dapan1121
009e8aa41e
Merge remote-tracking branch 'origin/3.0' into feat/TS-6100-3.0
2025-05-12 16:24:22 +08:00
Jinqing Kuang
27d7d71057
fix(stream): fix response type of stream reader task
2025-05-09 14:41:45 +08:00
wangmm0220
145a535e12
feat(stream): remove useless code
2025-04-30 09:12:20 +08:00
wangmm0220
7dc6557b46
fix(stream): message error
2025-04-29 21:10:12 +08:00
wangmm0220
19a878cc79
feat(stream): add thread worker for stream reader
2025-04-29 18:51:21 +08:00
wangjiaming0909
1ccc6c69a8
new-stream: runner impl
2025-04-29 15:31:17 +08:00
wangmm0220
eee6456cc4
feat(stream): add thread worker for stream reader
2025-04-25 18:18:17 +08:00
dapan1121
330cf9982d
fix: compile issues
2025-04-24 09:11:54 +08:00
dapan1121
ae0e1ded7d
enh: add hb processing
2025-04-22 17:46:17 +08:00
dapan1121
7c714f7d5f
Merge remote-tracking branch 'origin/feat/TS-6100-3.0.pw1' into feat/TS-6100-3.0
2025-04-17 10:48:44 +08:00
dapan1121
38bdafd329
enh: add deploy processing
2025-04-17 10:45:06 +08:00
wangjiaming0909
ceaf69184c
new-stream: create new-stream threads
2025-04-16 18:16:09 +08:00
Jing Sima
f84f04398d
fix: [TS-4897] Support query stables cross databases and fix potential deadlock. ( #30507 )
2025-03-28 10:07:08 +08:00
Haojun Liao
af06bea439
fix(stream): add start/stop message. ( #30400 )
2025-03-24 19:38:00 +08:00
Simon Guan
2c27c10fa8
Merge branch 'main' into merge/mainto3.0
2025-03-20 14:05:45 +08:00
Haojun Liao
db57fc4ba8
fix(stream): fix race condition in send msg. ( #30277 )
...
Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-19 23:15:15 +08:00
Simon Guan
ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID ( #30195 )
...
* refactor: adjust wal log infos
* refactor: adjust some log's level
* refactor: adjust some log's level
* fix: add traceId for sync module
* refactor: adjust log level
* refactor: adjust log level
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* fix: compile errors in windows
* refactor: minor changes
2025-03-18 16:21:44 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables ( #30144 )
...
* enh: add client processing
* enh: add mnode vtables processing
* enh: add mnode vtable processing
* enh: add normal child vtable support
* fix: compile issues
* fix: compile issues
* fix: create stream issues
* fix: multi stream scan issue
* fix: remove debug info
* fix: agg task and task level issues
* fix: correct task output type
* fix: split vtablescan from agg
* fix: memory leak issues
* fix: add limitations
* Update 09-error-code.md
* Update 09-error-code.md
* fix: remove usless case
* feat(stream): extract original table data in source scan task
Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.
* feat(stream): multi-way merge using loser tree in virtual merge task
Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing. Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.
* fix(test): remove useless cases
---------
Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Kaili Xu
13f9bddf3d
feat: support customized taos/taosd ( #29736 )
...
* feat: support TDAcoreOS
* chore: cmake options for TD_ACORE
* chore: disable lemon for TD_ACORE
* chore: add lzma2 and msvcregex
* chore: cmake for lzma2
* chore: adapt for TD_ACORE
* chore: adapt strcasecmp for TD_ACORE
* chore: adapt for geos/threadName
* chore: build adapt for TD_ACORE
* chore: build adapt for TD_ACORE
* chore: build adapt for TD_ACORE
* chore: build adapt for TD_ACORE
* chore: build adapt for TD_ACORE termio
* chore: refact transComm.h for TD_ACORE
* chore: refact transportInt.h for TD_ACORE
* chore: refact trans.c for TD_ACORE
* chore: refact trpc.h for TD_ACORE
* chore: refact transCli.c/transComm.c/transSvr.c for TD_ACORE
* chore: refact uv.h for TD_ACORE
* chore: refact geosWrapper.h for TD_ACORE
* chore: refact token/builtins/udf for TD_ACORE
* chore: refact rocks for TD_ACORE
* chore: refact tsdbCache.c for TD_ACORE, use LRU cache for last/last_row, not use rocksdb
* chore: refact FAIL to _ERR to solve conflicts for TD_ACORE
* chore: restore lemon.c/lempar.c
* chore: support build lemon for TD_ACORE
* chore: refact trpc and siginfo_t for TD_ACORE
* chore: refact timezone for TD_ACORE
* chore: refact lz4 for TD_ACORE
* chore: refact TD_ACORE to make compile pass
* chore: code optimization for TD_ASTRA
* feat: support run taos with taosd integrated
* feat: support invoke taos shell
* feat: support invoke taos shell
* feat: support invoke taos shell
* chore: code optimization
* chore: fix undefined reference problem os TD_ASTRA
* chore: resolve compile problem for TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix getpid
* chore: fix typo
* chore: set stack size and ajust min pack size for TD_ASTRA
* chore: fix pthread create parameters
* chore: chmod adapt for TD_ASTRA
* chore: fix trans compile problem
* chore: adapt chmod for TD_ASTRA
* chore: byte alignment for TD_ASTRA
* chore: more code for adaption of TD_ASTRA
* chore: more code for adaption of TD_ASTRA
* chore: more code for adaption of TD_ASTRA
* chore: byte alignment for TD_ASTRA
* chore: conditional compile option
* chore: adapt for TD_ASTRA
* chore: adjust taosPId and msvcregex for TD_ASTRA
* chore: log dir separator for wal build name
* chore: fix type of pointer parameter
* chore: fix compile problem of tsdbGetS3Size
* enh: get last ver from wal log for TD_ASTRA
* enh: refact wal meta ver
* enh: refact wal meta ver
* fix: typo of taosUcs4Compare
* enh: process return value of CI
* chore: more code for TD_ASTRA adaption
* chore: return value of taosCloseFile in walMeta.c
* chore: fix compile problem
* chore: fix compile problem of TD_ASTRA
* fix: update macro for tq and stream task
* chore: code optimization for TD_ASTRA
* chore: restore create log and init cfg interface
* chore: restore strncasecmp and strcasecmp
* fix: adjust the field position of SDataBlockInfo
* fix: pragma pack min size
* fix: pragma pack min size
* chore: more code for TD_ASTRA adaption
* fix: type of parameters
* chore: adapt strncasecmp and strcasecmp for TD_ASTRA
* chore: restore interface of init log
* enh: pack push optimization
* fix: taos init cfg
* add astra support
* fix: fetch the value of suid
* chore: switch of build with udf
* add temp code
* chore: more code for TD_ASTRA adaption
* chore: add macro ERRNO to replace errno
* chore: bytes align for TD_ASTRA
* fix: remove obsolete codes
* enh: support USE_UDF macro
* fix compile error
* fix: resolve redefinition problem
* fix: compile problem of log.cpp
* fix: compile problem of osTimezone
* fix: resolve compile problem of udf
* fix: pragma definition on windows
* fix: ucs4 and stpncpy for TD_ASTRA
* fix: memory align problem for TD_ASTRA
* enh: solve memory leak for TD_ASTRA_RPC
* fix: compile problem of taosSetInt64Aligned
* fix: restore mndSubscribe.c
* fix: scalar for udf
* chore: code adaption for TD_ASTRA
* chore: code optimization for TD_ASTRA
* fix: typo of add definition
* fix: typo of macro in tudf.h
* chore: remove void to make CI pass
* enh: move macro from cmake.platform to cmake.options
* enh: byte align for hash node and error code
* chore: restore the size for lru cache
* enh: restore some code about pack push
* chore: restore the pack push in tmsg.h
* fix: add macro of pack pop for windows
---------
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 13:32:13 +08:00
Haojun Liao
d24bc139a5
chore: merge 3.0
2025-03-10 18:31:56 +08:00
Simon Guan
b74b038f4f
Merge branch '3.0' into merge/mainto3.0
2025-03-04 11:32:29 +08:00
Simon Guan
65d5fd0578
Merge pull request #29975 from taosdata/enh/stopall
...
refactor(stream): stop all tasks before drop vnodes.
2025-03-03 20:01:56 +08:00
Simon Guan
eee9976a44
Merge pull request #29958 from taosdata/fix/TD-33872-improve-status-sync-heartbeat
...
fix: [td-33872] improve status sync heartbeat
2025-03-03 13:51:44 +08:00
Haojun Liao
a71f414d97
refactor(stream): stop all tasks before drop vnodes.
2025-03-02 02:06:14 +08:00
dmchen
45cdd871db
fix/remove-get-queue-size-when-print-heartbeat-log
2025-02-28 14:15:20 +08:00
dmchen
aa7cb880bb
fix/remove-get-queue-size-when-print-heartbeat-log
2025-02-28 11:53:18 +08:00
dmchen
1237e762c1
fix/remove-get-queue-size-when-print-heartbeat-log
2025-02-28 11:52:27 +08:00
Haojun Liao
45b0e47a19
refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution.
2025-02-27 00:15:03 +08:00
Haojun Liao
ecc667c22b
Revert "refactor(stream): drop task in async ways"
2025-02-21 01:10:18 +08:00
Haojun Liao
6766e6db53
refactor(stream): add checkpoint queue to handle chkpt.
2025-02-20 16:13:33 +08:00
