Commit graph

6106 commits

Author SHA1 Message Date
Simon Guan
e8dd9daf11 Merge branch 'main' into merge/mainto3.0 2025-04-19 14:33:11 +08:00
freemine
6267763e85
Freemine.cmake.3.0 (#30663)
* chore(ci): with cmake verbose, temporarily

* chore(cmake): prefer Threads::Threads

* fix(cmake): debug building gtest on ubuntu 20.04 for the moment

* fix(cmake): try adding Threads::Threads

* fix(cmake): debug building gtest on ubuntu 20.04 for the moment

* fix(cmake): revert taosd-ci-build.yml

* fix(cmake): debug building on ubuntu 20.04 for the moment

* fix(cmake): debug building on ubuntu 20.04 for the moment

* fix(cmake): debug building on ubuntu 20.04 for the moment, adding dl right after DEP_ext_libuv

* fix(cmake): debug building on ubuntu 20.04 for the moment, try full run

* fix(cmake): fix building on ubuntu 20.04

* fix(cmake): dl is only valid in non-windows platform

* fix(cmake): dl order

* refactor(cmake): adjust option/cache variables for external dependencies

* refactor(cmake): mv patch files from contrib/ to cmake/

* refactor(cmake): typo

* refactor(cmake): adding cache on ci

* refactor(cmake):
1. ext_lzma2 is only used by Linux
2. fix bug in taosd-ci-build.yml

* enh: adding functionalities of build.sh

* fix(ci): `cmake -B` shall maintain consistency

* refactor(cmake): LOCAL_REPO/LOCAL_URL as cache variable

* refactor(cmake): taosadapter to be built in main build directory rather than .externals

* refactor(cmake): adding rpath for taosadapter, linux now

* refactor(cmake): adding rpath for taosadapter, macos now

* chore(cmake): remove some comments

* debug(ci): bypass TD_EXTERNALS_USE_ONLY

* debug(ci): bypass .externals caching for the moment

* fix(cmake): temporarily use taosadapter/main branch because this branch(freemine.cmake.3.0) has not include taos_fetch_fields_e from upstream

* refactor(cmake): clean GIT_TAG/GIT_SHALLOW pairs

* enh(ci): use build.sh rather than hard-coded in taosd-ci-build.yml, linux for now

* debug(ci): undefined __isoc23_strtoull

* debug(ci): benchmarkTest

* debug(ci): what if use_only = off

* debug(ci): remove .externals to make a refresh build

* debug(ci): back to cache, and ls files of gtest

* debug(ci): remove find coz {} not escaped

* debug(ci): cache key seems missing "matrix.os"

* refactor(ci): fixed cache key and reopen macos/windows

* chore(ci): literally -j4

* chore(ci): Trigger GitHub Actions re-run

* chore(ci): Trigger GitHub Actions re-run

* fix(ci): typo

* chore(ci): JOBS calculated by build.sh itself

* refactor(ci): enable WEBSOCKET in build.sh by default

* refactor(ci): enable WEBSOCKET in build.sh by default, macOS

* chore(cmake): remove obsoletes

* refactor(ci): stop service before running taosd

* chore(ci): `./build.sh install` just install TDengine, you will have to start taosd by `./build.sh start`

* refactor(cmake): adding source code found on http://emfisis.physics.uiowa.edu/Software/C/libargp/

* refactor(cmake): moving jansson/snappy/avro to .externals, and porting BUILD_TEST/WEBSOCKET on Windows

* refactor(cmake): porting linux

* refactor(cmake): porting macos
1. check argp.h
2. re-enable building taosdump

* refactor(cmake): porting linux
1. adjust CMAKE_C/CXX_FLAGS

* refactor(cmake): porting windows, adjust CMAKE_C/CXX_FLAGS

* refactor(cmake): use cmake_parse_arguments in macro INIT_EXT

* refactor(cmake): format ci cache directives

* refactor(cmake): adding comments for ci externals-cache directives

* refactor(cmake): adding check_env.cmake to checking libraries installed on the system

* refactor(cmake): porting linux, make homebrew-installed-libs available

* refactor(cmake): remove BYPRODUCTS from INIT_EXT macro

* refactor(cmake): INC_DIR is oneValueArg

* refactor(cmake): taosdump depends on ext_xz(LZMA)

* refactor(cmake): add copy_pthreadVC3 target on windows

* refactor(cmake): mv taosd-ci-build.yml to tdengine-build.yml

* chore(ci): try to fix yml syntax error

* refactor(cmake): use brew --prefix to get HomeBrew's install path

* refactor(cmake): typo

* debug(ci): build and cache externals first

* debug(ci): adding -Wno-stringop-overread for the moment

* debug(ci): make Threads::Threads public from os target

* debug(ci): make os public

* debug(ci): re-enable start and test

* debug(ci): let it go even if taosBenchmark failed

* debug(ci): copy logic from TDengine/main

* debug(ci): try ./build.sh start/test

* debug(ci): revert to original simple test logic in ci, taosBenchark/taos

* chore(cmake): code-convention and ci-logic

* debug(ci): show versions

* debug(ci): forcefully use specific GIT_TAG by commit-id for taos-connector-rust.git and taosadapter.git

* refactor(cmake): remove empty lines

* debug(ci): typo

* debug(ci): set supportVnodes to 256 before starting taosd

* debug(ci): fix: sudo and pipe

* debug(ci): cat /etc/taos/taos.cfg to check if supportVnodes effective

* debug(ci): cat forceReadConfig to taos.cfg

* debug(ci): adding taos -s "show dnodes"

* debug(ci): print more info

* debug(ci):
1. git log .... in an independant step
2. sleep 3 deliberately

* build: release ver-3.3.6.0

* chore(ci): comment and remove unnecessary code

* refactor(ci): cleanup tools/CMakeLists.txt
1. remove unnecessary or uneffective codes
2. better approach to pass compile flags to go

* chore(cmake): remove unnecessary code

* merge(cmake): porting linux

* merge(cmake): porting macOS

* merge(cmake): porting windows

* merge(cmake): pitfall fix: use literal format string instead

* merge(cmake): ver-3.3.6.0 for both taosadatper and taosws

* merge(cmake): adjust ci for debug purposes

* merge(cmake): add dependenices to make sure native built

* merge(main): link os

* merge(main): revert to main

* chore(cmake): remove freemine'd comments

* chore(cmake): make github ci to run with empty change

* refactor(cmake): remove unnecessaries

* refactor(cmake): remove unnecessaries

* chore(cmake):
1. remove taosudf in build.sh::do_purge
2. packaging taosBenchmark

* chore(cmake):
1. typo corrections
2. add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to bypass compatibility check imposed by latest cmake since 4.0

* chore(cmake): show cmake version

* chore(cmake): add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to bypass compatibility check imposed by latest cmake since 4.0

* chore(cmake): typo

* chore(cmake): remove unnecessaries

* cmake: debug enterprise compilation

* refactor: preparatory work before merging the freemin PR

* refactor(cmake): revert to d91205594a

* refactor(cmake): optimize by adjusting cache key

* chore(cmake): make github ci to run with empty change

* refactor(cmake): move libs3 and azure to external.cmake

* refactor(cmake): porting macOS

* refactor(cmake): move cos to external.cmake

* refactor(cmake): bypass s3/azure/cos on windows for the moment

* refactor(cmake): try find_package(Threads)

* refactor(cmake): add dl/pthread in libs3

* refactor(cmake): enable s3/azure for the moment, hard-coded

* refactor(cmake): adjust BUILD_WITH_ANALYSIS option

* refactor(cmake):
1. enum AVROTYPE => enum enAVROTYPE
2. remove INSTALL(CODE ...) from tools/taos-tools/CMakeLists.txt

* refactor(cmake): portint macOS and typo

* refactor(cmake): ticking external cache key to force refresh external building

* refactor(cmake): remove obsoletes

* refactor(cmake): remove obsoletes

* refactor(cmake): remove obsoletes, contrib/deps-download related

* refactor(cmake): adding build.bat, and use build.bat in .github/workflows/tdengine-build.yml

* refactor(cmake):
1. call .\build.bat
2. remove POST_BUILD which is not valid in this signature of add_custom_command

* refactor(ci): use 'NMake Makefiles JOM'

* refactor(ci): typo

* refactor(ci): debug

* refactor(ci): debug

* refactor(ci): debug

* refactor(ci): use call on windows

* refactor(cmake): move utils/TSZ to contrib/TSZ

* chore(cmake): make github ci to run with empty change

* refactor(cmake): mv cmake.* -> *.cmake and related in CMakeLists.txt

* refactor(cmake): debugging integrating community

* refactor(cmake): debugging integrating community

* chore(cmake): make github ci to run with empty change

* refactor(cmake): revert geos.git back to 3.12.0

* refactor(cmake): revert doc/** to main branch

* refactor(cmake): revert tests/** to main branch, except tests/taosc_test/CMakeLists.txt

* refactor(cmake): revert test/cases/** to main branch

* refactor(cmake): revert test/docs/** to main branch

* refactor(cmake): revert tools/taos-tools/deps/{avro,jansson,libargp,snappy,zlib-1.2.13} to main branch, which need to be removed later

* refactor(ci): revert .github/workflows/{deploy-case-docs.yml,tdengine-doc-build.yml} to main branch

* refactor(cmake): revert tcommon.h and related to main branch

* refactor(cmake): revert test/* stuffs back to main branch

* refactor(cmake): revert libuv.git back to v1.49.2

* refactor(cmake): revert .h/.c and related to main branch

* refactor(cmake): typo format string

* refactor(cmake): typo correction, incorrect use of macro `assert`

* refactor(cmake): adding /wd4028 to bypass thttp.c under enterprise build for the moment

* refactor(cmake):
1. adding some rules to .gitignore for the last resort to save
2. adding source files manually to source/libs/parser/CMakeLists.txt to exclude potential sql.c generated by old build system

* refactor(cmake): add -Wno-unused-result for the moment

* refactor(cmake): adjust target dependencies

* refactor(cmake): tweaking building of mxml

* refactor(cmake): adjust externals CMAKE_ARGS to save compilation time

* refactor(cmake): temporarily use tomchon-patch-3

* refactor(cmake): temporarily adding dumpbin directives

* refactor(cmake): adding NODEFAULTLIB temporarily for debugging purpose

* refactor(cmake): adding NODEFAULTLIB:libcpmt temporarily for debugging purpose

* refactor(cmake): adding NODEFAULTLIB:cpmt temporarily for debugging purpose

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* refactor(ci): use freemine.debug branch for the moment

* refactor(ci): revert back to use run-tests-on-windows.yml of tomchon-patch-3 branch

* chore(cmake): make github ci to run with empty change

* refactor(cmake): remove temporary debug directives

* refactor(cmake): move cmake_policy(..CMP0135..) to the root of this project

* refactor(cmake): Remove temporary debugging conditional and restore original logic

* chore(cmake): adding -B in army tests

* chore(cmake): make github ci to run with empty change

* chore(cmake): revert: adding -B in army tests

* refactor(cmake):
1. use ver-3.3.6.3 of taosadapter
2. pitfall fix: do not link with taosws for taos shell

* refactor(cmake): revert taosadapter to ver-3.3.6.0

* chore(cmake): adding logging message in more detail

* chore(cmake): adding logging message in more detail

* chore(ci): debugging by using ls -l

* chore(ci): typo

* chore(ci): typo

* refactor(cmake): revert to remove debug code, and taosadapter to ver-3.3.6.3

* refactor(cmake): remove DEP_ext_taosws

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): make github ci to run with empty change

* chore(cmake): typo correction: utils/test/c/sml_test.c

* debug(cmake): test cases debug

* chore(cmake): make github ci to run with empty change

* chore(ci): using tomchon-patch-3 branch for run-tests-on-linux for the moment

* chore(cmake): make github ci to run with empty change

* debug(test): revert utils/test/c/sml_test.c back to tdengine/main branch

* debug(test): adding VERBOSE=1 and gcc --version

* debug(test): revert tests/parallel_test/cases.task back to tdengine/main branch

* debug: add log in run_case.sh

* fix: test log

* fix: docker run privileged

* tes: add debug test in  cases.task

* refactor(cmake): remove ref to \contrib\<dep-name> and ~/.cos-local-{1,2} from CMakeLists.txt(s)

* refactor(cmake): make taosudf link with libtaos.so

* chore(cmake): fix compiler warning as error problem

* refactor(cmake): revert 7d7f03832d

* chore(cmake): only udf.sim and udfpy.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug udf.sim for the moment

* debug(ci): debug only udf.sim for the moment

* debug(ci): debug only udf.sim for the moment, using tee

* debug(ci): debug only udf.sim for the moment, revert using tee

* debug(ci): debug only udf.sim for the moment, adding TAOS_LIB again

* debug(cmake): adding -rdynamic for the moment

* debug(cmake): re-adding udfpy.sim

* debug(cmake): do NOT run with Sanitizer for udfpy.sim for the moment

* chore(cmake): revert cases.task, and remove ubuntu-20.04 from tdengine-build.yml

* refactor(cmake): using ENABLE_EXPORTS to export symbols in taosudf

* chore(cmake): make github ci to run with empty change

* chore(cmake): remove stuffs for debug purpose and revert

---------

Co-authored-by: support-platform <it@taosdata.com>
Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: haoranchen <haoran920c@163.com>
2025-04-19 14:03:29 +08:00
WANG MINGMING
ca724865b9
fix(stream): parName is null (#30592) 2025-04-19 10:26:32 +08:00
Zhixiao Bao
e25da1cd35
fix: taosd fails to start after modifying the timezone configuration parameter. 2025-04-17 19:19:05 +08:00
Simon Guan
888fed8699 Merge branch 'main' into merge/mainto3.0 2025-04-16 19:34:20 +08:00
dongming chen
c38f9eda0c
fix: TS-6336-get-epset (#30770) 2025-04-15 16:44:58 +08:00
dongming chen
d9b7511b0e
fix: [TS-6245]add-protection-when-drop-db (#30567) 2025-04-12 09:47:11 +08:00
dongming chen
f04b57dc9e
fix: [TS-6245]-add-trans-timeout (#30740) 2025-04-12 09:46:59 +08:00
Simon Guan
7437dd026e Merge branch '3.0' into merge/mainto3.0 2025-04-11 13:47:45 +08:00
xinsheng Ren
7376e8401f
fix: when there are offline dnodes, "show dnode * variables" does not return any output. (#30667) 2025-04-11 11:21:55 +08:00
dongming chen
b2fec10beb
fix[TS-6166]: when the transaction to create a database fails, repeatedly sending messages can cause high CPU usage.(#30724) 2025-04-10 20:41:38 +08:00
freemine
9897d85f86
enh(test): adding TD_ALWAYS_ASSERT macro for test cases to use (#30739) 2025-04-10 16:52:55 +08:00
Zhixiao Bao
34a41bf54c
fix: crash while upgrade taosd to 3362. (#30712) 2025-04-09 18:53:47 +08:00
dongming chen
8710e539a0
fix: [TD-34436] double-release (#30668) 2025-04-09 14:50:20 +08:00
dongming chen
712cb6652b
fix: TS-6276-grant-format (#30701) 2025-04-09 14:40:24 +08:00
dongming chen
c5c86af7b5
fix/TS-6226-send-check-when-not-sync (#30588) 2025-04-09 11:18:53 +08:00
Simon Guan
de5f5866a8
fix[TS-6276]: when the authorization statement exceeds a certain length, it cannot be displayed in full (#30657) 2025-04-07 09:21:13 +08:00
dongming chen
915a6e5609
fix: [TD-34250] wrong-createdb (#30555) 2025-04-01 10:02:05 +08:00
Zhixiao Bao
c6216a02ab
fix(s3): wrong condition where alter db ops s3_compact. (#30568) 2025-04-01 09:19:12 +08:00
WANG MINGMING
1c4507ab75
fix(stream): row size error (#30330) 2025-03-28 18:10:57 +08:00
Simon Guan
9a89db55ca
enh: allow ordinary users to execute the “show anodes” command. (#30464) 2025-03-25 20:17:16 +08:00
dongming chen
13475700c5
enh: [TD-34190] remove-wrong-log (#30408) 2025-03-25 12:37:20 +08:00
Haojun Liao
af06bea439
fix(stream): add start/stop message. (#30400) 2025-03-24 19:38:00 +08:00
Haojun Liao
cfcdfdd2e7
fix(stream): update the update node info. (#30364) 2025-03-24 10:18:06 +08:00
Haojun Liao
82ffeb82a9
fix(gpt): fix the bug for algo name case sensitive (#30362) 2025-03-23 13:20:24 +08:00
Simon Guan
e5a1539c6d
Merge pull request #30307 from taosdata/fix/TS-5467-3.0
fix(stream): fix stream processing for virtual tables
2025-03-20 22:24:45 +08:00
liuyao
f7beaeebfe
ci: adjust test && fix issue
ci: adjust test && fix issue
2025-03-20 17:54:20 +08:00
Zhixiao Bao
0b8bff92c6
enh: add keep option while show stable. (#30294) 2025-03-20 15:30:22 +08:00
Haojun Liao
cd10173454
fix(gpt): fix error in gpt (#30275)
* fix(stream): support packaging enterprise edition.

* feat(gpt): support lstm and do some internal refactor, add sample autoencoder model.

* feat(gpt): support lstm and do some internal refactor, add sample autoencoder model.

* test(gpt): disable model case.

* test(gpt): disable model case.

* doc: fix title error in doc.

* doc: add mlp doc.

* fix(gpt): add gpt

* fix(gpt): update the test cases.

* fix(gpt): update the test cases.

* test(gpt): disable gpt test in github action.

* fix(gpt): check the grant, check the rsp code.

* fix(gpt): limit the forecast rows.

* fix(gpt): use default gpt service

* fix(gpt): update error code.
2025-03-20 15:18:58 +08:00
Jinqing Kuang
c82398e175 fix(stream): fix stream processing for virtual tables
- Fixed status check in virtual table stream processing
- Fixed multi-way merge logic for super virtual tables
- Fixed generation of target subtable names during merge
2025-03-20 01:15:54 +08:00
Simon Guan
d02196a231
refactor: adjust some logs (#30245)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* docs: update keywords

* fix: compile errors in windows

* docs: minor changes

* docs: minor changes

* refactor: minor changes

* docs: fminro changes

* docs: format

* refactr: remove uncessory logs

* docs: format doc
2025-03-18 17:55:36 +08:00
Simon Guan
ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID (#30195)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* fix: compile errors in windows

* refactor: minor changes
2025-03-18 16:21:44 +08:00
WANG MINGMING
3bc6635de3
feat[TS-6115]: support deletion of topics with active consumers. (#30232)
* feat[TS-6115]: drop topic & consumer group in force

* feat[TS-6115]: drop topic & consumer group in force

* feat[TS-6115]: drop topic & consumer group in force
2025-03-18 14:11:00 +08:00
Simon Guan
cf8d7cd0ac Merge branch 'main' into merge/mainto3.0 2025-03-17 21:42:42 +08:00
Yihao Deng
2151c5cae0
update telemInterval (#29703) 2025-03-17 17:42:24 +08:00
Haojun Liao
dfe32225de chore: merge main. 2025-03-17 14:51:11 +08:00
Haojun Liao
ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
wangjiaming
f50fcb85b8
feat(decimal): support decimal data type (#30060)
* decimal: create table

* decimal: add test case decimal.py

* decimal: add decimal.c

* support input decimal

* decimal test

* refactor svalue

* fix test cases

* add decimal unit test

* add decimal test cmake

* support insert and query decimal type

* define wide integer, support decimal128

* support decimal128 divide

* set decimal type expr res types

* scalar decimal

* convert to decimal

* fix decimal64/128 from str and to str

* fix decimal from str and decimal to str

* decimal simple conversion

* unit test for decimal

* decimal conversion and unit tests

* decimal + - * /

* decimal scalar ops and comparision

* start to refactor GET_TYPED_DATA

* support decimal max func, cast func

* refactor GET_TYPED_DATA interface

* decimal scalar comparision

* start to implement sum for decimal

* support sum and avg for decimal type

* decimal tests

* add decimal test

* decimal add test cases

* decimal use int256/int128

* decimal testing

* fix decimal table meta and add tests for decimal col streams

* fix create stream and create tsma

* test insert decimal values

* decimal from str

* test decimal input

* test parse decimal from string

* add taos_fetch_field_e api

* decimal insert tests

* test decimal operators

* decimal operator test

* feat:support decimal in raw block

* decimal operator tests

* decimal test

* feat:support decimal in raw block

* feat:support decimal in raw block

* feat:add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* decimal test operators

* decimal operator test

* test decimal operators

* test decimal compare operators

* decimal unary operator test

* decimal col with decimal col oper test

* test decimal col filtering

* fix decimal float operator test

* decimal test where filtering

* fix decimal filtering

* fix decimal order by

* fix decimal op test

* test decimal agg funcs

* test decimal functions

* remove assert

* fix ci build for ret check

* fix decimal windows build

* fix ci ret check

* skip decimal ret check

* skip decimal ret check

* fix decimal tests

* fix decimal ci test

* decimal test

* fix(tmq): heap user after free

* fix(tmq): double free

* fix(tmq): double free

* fix decimal tests

* fix(decimal): decimal test ci build

* fix(decimal): windows build

* fix(decimal): decimal test build

* fix(decimal): fix decimal build and tests

* fix(decimal): fix decimal tests

* fix(decimal): fix taos_fetch_fields_e api

* fix(decimal): fix decimal taos_fetch_fields_e api

* fix(decimal): rebase 3.0

* fix(decimal): fix decimal functions

* fix(decimal): fix decimal test case memory leak

* fix(decimal): fix decimal tests

* fix(decimal): fix decimal test case

* fix(decimal): fix decimal tests

* feat(decimal): fix unit tests

* feat(decimal): fix deicmal unit test

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 18:08:07 +08:00
Zhixiao Bao
af7e34e189
feat(keep): support keep on super table level. (#30097)
* Feat: support use keep while create super table.

* Test(keep): add test for create super table with keep option.

* Feat(keep): Add tmsg for create keep.

* Feat(keep): support alter table option keep.

* Fix(keep): Add baisc test for alter table option.

* Fix(keep): memory leek.

* Feat(keep): add keep to metaEntry&metaCache and fix earliestTs with stn keep.

* Test(keep): add some cases for select with stb keep.

* Fix: fix ci core while alter stb.

* Feat(keep): delete expired data in super table level.

* Feat: remove get stb keep while query.

* Fix : build error.

* Revert "Fix : build error."

This reverts commit 0ed66e4e84.

* Revert "Feat(keep): delete expired data in super table level."

This reverts commit 36330f6b4c.

* Fix : build errors.

* Feat : support restart taosd.

* Fix : alter table comment problems.

* Test : add tests for super table keep.

* Fix: change sdb stb reserve size.

* Test: add more tests.

* Feat: Disable normal tables and sub tables from setting the keep parameter

* Fix: add more checks to avoid unknown address.

* Docs: Add docs for stable keep.

* Fix: some review changes.

* Fix: review errors.
2025-03-14 16:10:13 +08:00
WANG MINGMING
3d053e2c9b
feat(stream): optimize client logic of creating stream if with history (#30059)
* feat:[TS-5617]use last_row cache mode if creating stream in fill_history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* fix: heap use after free

* feat: add log

* fix: ci case error

* fix: compile error in windows

* fix: ci case error

* fix: heap user after free

* fix: memory leak

* fix: ci case error

* fix: ci case error

* fix: ci case error

---------

Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 13:55:52 +08:00
Kaili Xu
13f9bddf3d
feat: support customized taos/taosd (#29736)
* feat: support TDAcoreOS

* chore: cmake options for TD_ACORE

* chore: disable lemon for TD_ACORE

* chore: add lzma2 and msvcregex

* chore: cmake for lzma2

* chore: adapt for TD_ACORE

* chore: adapt strcasecmp for TD_ACORE

* chore: adapt for geos/threadName

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE termio

* chore: refact transComm.h for TD_ACORE

* chore: refact transportInt.h for TD_ACORE

* chore: refact trans.c for TD_ACORE

* chore: refact trpc.h for TD_ACORE

* chore: refact transCli.c/transComm.c/transSvr.c for TD_ACORE

* chore: refact uv.h for TD_ACORE

* chore: refact geosWrapper.h for TD_ACORE

* chore: refact token/builtins/udf for TD_ACORE

* chore: refact rocks for TD_ACORE

* chore: refact tsdbCache.c for TD_ACORE, use LRU cache for last/last_row, not use rocksdb

* chore: refact FAIL to _ERR to solve conflicts for TD_ACORE

* chore: restore lemon.c/lempar.c

* chore: support build lemon for TD_ACORE

* chore: refact trpc and siginfo_t for TD_ACORE

* chore: refact timezone for TD_ACORE

* chore: refact lz4 for TD_ACORE

* chore: refact TD_ACORE to make compile pass

* chore: code optimization for TD_ASTRA

* feat: support run taos with taosd integrated

* feat: support invoke taos shell

* feat: support invoke taos shell

* feat: support invoke taos shell

* chore: code optimization

* chore: fix undefined reference problem os TD_ASTRA

* chore: resolve compile problem for TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix getpid

* chore: fix typo

* chore: set stack size and ajust min pack size for TD_ASTRA

* chore: fix pthread create parameters

* chore: chmod adapt for TD_ASTRA

* chore: fix trans compile problem

* chore: adapt chmod for TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: conditional compile option

* chore: adapt for TD_ASTRA

* chore: adjust taosPId and msvcregex for TD_ASTRA

* chore: log dir separator for wal build name

* chore: fix type of pointer parameter

* chore: fix compile problem of tsdbGetS3Size

* enh: get last ver from wal log for TD_ASTRA

* enh: refact wal meta ver

* enh: refact wal meta ver

* fix: typo of taosUcs4Compare

* enh: process return value of CI

* chore: more code for TD_ASTRA adaption

* chore: return value of taosCloseFile in walMeta.c

* chore: fix compile problem

* chore: fix compile problem of TD_ASTRA

* fix: update macro for tq and stream task

* chore: code optimization for TD_ASTRA

* chore: restore create log and init cfg interface

* chore: restore strncasecmp and strcasecmp

* fix: adjust the field position of SDataBlockInfo

* fix: pragma pack min size

* fix: pragma pack min size

* chore: more code for TD_ASTRA adaption

* fix: type of parameters

* chore: adapt strncasecmp and strcasecmp for TD_ASTRA

* chore: restore interface of init log

* enh: pack push optimization

* fix: taos init cfg

* add astra support

* fix: fetch the value of suid

* chore: switch of  build with udf

* add temp code

* chore: more code for TD_ASTRA adaption

* chore: add macro ERRNO to replace errno

* chore: bytes align for TD_ASTRA

* fix: remove obsolete codes

* enh: support USE_UDF macro

* fix compile error

* fix: resolve redefinition problem

* fix: compile problem of log.cpp

* fix: compile problem of osTimezone

* fix: resolve compile problem of udf

* fix: pragma definition on windows

* fix: ucs4 and stpncpy for TD_ASTRA

* fix: memory align problem for TD_ASTRA

* enh: solve memory leak for TD_ASTRA_RPC

* fix: compile problem of taosSetInt64Aligned

* fix: restore mndSubscribe.c

* fix: scalar for udf

* chore: code adaption for TD_ASTRA

* chore: code optimization for TD_ASTRA

* fix: typo of add definition

* fix: typo of macro in tudf.h

* chore: remove void to make CI pass

* enh: move macro from cmake.platform to cmake.options

* enh: byte align for hash node and error code

* chore: restore the size for lru cache

* enh: restore some code about pack push

* chore: restore the pack push in tmsg.h

* fix: add macro of pack pop for windows

---------

Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 13:32:13 +08:00
Simon Guan
abaf48ae15 Merge branch '3.0' into merge/mainto3.0 2025-03-10 11:07:48 +08:00
Simon Guan
1170955b95 Merge branch 'main' into merge/mainto3.0 2025-03-10 11:05:52 +08:00
xinsheng Ren
4edddd6038
Merge branch '3.0' into enh/TS-5650/showLike 2025-03-07 10:29:35 +08:00
Simon Guan
c00d772492
Merge pull request #29649 from taosdata/feat/TS-5927-long-password
feat:[TS-5927]long-password
2025-03-06 17:25:48 +08:00
Simon Guan
6fa7a7bb99
Merge pull request #29996 from taosdata/fix/droptask
feat(stream): add timeout parameter.
2025-03-05 18:49:23 +08:00
Simon Guan
34120a38c5 Merge branch '3.0' into merge/mainto3.0 2025-03-05 18:12:55 +08:00
Simon Guan
292b0cb317 Merge branch 'main' into merge/mainto3.0 2025-03-05 18:10:31 +08:00
Haojun Liao
24882459e3 chore: merge main 2025-03-05 13:40:44 +08:00
dongming chen
e5fb75797a
Merge branch '3.0' into feat/TS-5927-long-password 2025-03-05 12:15:12 +08:00
yihaoDeng
d1ded07b43 fix(index): fix return error 2025-03-05 11:07:59 +08:00
yihaoDeng
a4b738b3c6 enh(index): opt error code 2025-03-05 11:04:39 +08:00
Simon Guan
6656460320
Merge pull request #29988 from taosdata/fix/chkptq
fix(stream):check the maximum allowed forecast rows, add one test case
2025-03-05 09:29:01 +08:00
Haojun Liao
2eea385485 fix(analytics): check return value. 2025-03-04 15:29:54 +08:00
Haojun Liao
c186d31c7d fix(analytics): check return value. 2025-03-04 14:30:48 +08:00
Simon Guan
1a9f75e663 Merge branch '3.0' into fix/internal 2025-03-04 13:47:03 +08:00
Simon Guan
b74b038f4f Merge branch '3.0' into merge/mainto3.0 2025-03-04 11:32:29 +08:00
Simon Guan
16ada1f0d3 Merge branch 'main' into merge/mainto3.0 2025-03-04 11:24:13 +08:00
Haojun Liao
19f09d679d feat(stream): add timeout parameter. 2025-03-03 23:05:14 +08:00
Simon Guan
65d5fd0578
Merge pull request #29975 from taosdata/enh/stopall
refactor(stream): stop all tasks before drop vnodes.
2025-03-03 20:01:56 +08:00
Haojun Liao
f563a35b3f fix(stream):check the maximum allowed forecast rows, add one test case, and do some internal refactor. 2025-03-03 17:27:05 +08:00
Haojun Liao
ac667164ed refactor: do some internal refactor. 2025-03-03 16:20:58 +08:00
Simon Guan
7326e3d8bc Merge branch '3.0' into merge/mainto3.0 2025-03-03 14:01:51 +08:00
Simon Guan
6826edf5e0 Merge branch 'main' into merge/mainto3.0 2025-03-03 14:01:43 +08:00
Simon Guan
f88c249fa4
Merge pull request #29946 from taosdata/fix/remove-sync-heartbeat-lock
fix: remove sync heartbeat lock
2025-03-03 13:52:16 +08:00
Simon Guan
eee9976a44
Merge pull request #29958 from taosdata/fix/TD-33872-improve-status-sync-heartbeat
fix: [td-33872] improve status sync heartbeat
2025-03-03 13:51:44 +08:00
Simon Guan
d7207861bb Merge remote-tracking branch 'origin/3.0' into fix/internal 2025-03-03 10:43:07 +08:00
factosea
6da2e6f547 fix: test case 2025-03-02 22:48:21 +08:00
factosea
e91014f807 feat: show variables like 2025-03-02 22:48:05 +08:00
Haojun Liao
a71f414d97 refactor(stream): stop all tasks before drop vnodes. 2025-03-02 02:06:14 +08:00
Haojun Liao
f8cc9648f6 fix(stream): fix memory leak. 2025-03-01 15:33:31 +08:00
dmchen
3359483836 fix:decouple get mload 2025-03-01 00:22:40 +08:00
dmchen
774c512148 fix:add-status-timestamp 2025-03-01 00:22:37 +08:00
dmchen
48787ba1aa fix/move-status-to-new-queue 2025-03-01 00:22:35 +08:00
Simon Guan
43ca6d5f9e refactor: adjust some logs 2025-02-28 16:49:46 +08:00
Simon Guan
24fae6adbb
Merge pull request #29900 from taosdata/fix/checkfh
refactor(stream): scan wal is driven by time, instead of insert events.
2025-02-28 13:42:43 +08:00
Hongze Cheng
0174d7404d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-28 13:26:53 +08:00
Simon Guan
ed2d3b258d Merge branch '3.0' into merge/mainto3.0 2025-02-28 09:11:14 +08:00
Simon Guan
f5429637fa Merge branch 'main' into merge/mainto3.0 2025-02-28 09:11:10 +08:00
dmchen
4dd0622594 fix:decouple get mload 2025-02-27 19:07:33 +08:00
dmchen
f6a472ae68 fix:decouple get mload 2025-02-27 19:05:06 +08:00
Hongze Cheng
0d2ca243b1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-27 17:18:33 +08:00
Simon Guan
5d777f9bcf
Merge pull request #29654 from taosdata/feat/TS-5805-force-assign-leader
Feat/ts 5805 force assign leader
2025-02-27 15:42:27 +08:00
dmchen
7eeb800213 fix:add-status-timestamp 2025-02-27 15:29:52 +08:00
dmchen
1f6c4df422 fix/move-status-to-new-queue 2025-02-27 15:26:06 +08:00
dmchen
93992f3d6e fix:add-status-timestamp 2025-02-27 15:22:33 +08:00
Haojun Liao
7b56df0adc refactor(stream): create task epset update trans out of lock, to avoid blocking mnode-read thread. 2025-02-27 14:51:26 +08:00
dmchen
5635b285cd feat/TS-5805-force-assign-leader-fix-check 2025-02-27 03:17:21 +00:00
dmchen
031f176aa1 fix/move-status-to-new-queue 2025-02-27 11:02:18 +08:00
Simon Guan
7f10288df1 Merge branch '3.0' into fix/internal 2025-02-27 10:04:34 +08:00
Simon Guan
76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
Simon Guan
b91dd10846 enh: add log level to each log entry 2025-02-27 09:55:11 +08:00
Hongze Cheng
df96529e0d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-26 15:09:54 +08:00
Simon Guan
ac056f153f
Merge pull request #29871 from taosdata/fix/TS-6028-check-column-name
fix:[TS-6028]check-column-name
2025-02-26 14:00:45 +08:00
dongming chen
0ce087f2b3
Merge branch '3.0' into feat/TS-5805-force-assign-leader 2025-02-26 13:57:36 +08:00
dmchen
ebd2e657c6 fix/TS-6028-check-column-name-fix-review 2025-02-26 01:30:33 +00:00
dmchen
26f3adcf6a fix/TS-6028-check-column-name-fix-review 2025-02-25 10:27:32 +00:00
Hongze Cheng
b26166b48d support meta_only option 2025-02-25 17:57:25 +08:00
Hongze Cheng
d48547ed64 more code 2025-02-25 16:48:43 +08:00
Shengliang Guan
e429264432
Merge pull request #29884 from taosdata/enh/killtrans
enh(stream): auto kill checkpoint trans that last long time
2025-02-25 11:29:49 +08:00
Shengliang Guan
3a1d06f4d7
Merge pull request #29354 from taosdata/enh/TS-5255/colsFunc2
enh: ts5255/cols func2
2025-02-24 14:19:37 +08:00
Haojun Liao
91271f3fa4 refactor: do some internal refactor. 2025-02-24 13:53:28 +08:00
Haojun Liao
4d21d5e055 fix(stream): fix memory leak. 2025-02-24 13:50:38 +08:00
Haojun Liao
97071f1d29 other: add some logs. 2025-02-24 09:42:15 +08:00
Haojun Liao
ea549364d4 fix(stream): free array and check the return values. 2025-02-21 16:38:26 +08:00
dmchen
6a81665ffa fix/TS-6028-check-column-name-add-case 2025-02-21 14:51:40 +08:00
dmchen
cdb11dd497 fix/TS-6028-column-name-fix-cases 2025-02-21 10:10:44 +08:00
dmchen
078c7bdc31 fix/TS-6028-check-column-name 2025-02-20 17:33:48 +08:00
Haojun Liao
6d5984421f refactor(stream): update the long trans threshold. 2025-02-20 17:27:41 +08:00
Haojun Liao
0a672f1b96 refactor(stream): update logs. 2025-02-20 16:55:10 +08:00
Haojun Liao
99d6086c5a enh(stream): kill too long checkpoint trans. 2025-02-20 15:07:24 +08:00
Shengliang Guan
d0eb99809f Merge branch 'main' into merge/mainto3.03 2025-02-20 11:38:41 +08:00
Haojun Liao
3048654484 refactor(stream): kill too long checkpoint trans. 2025-02-20 10:01:30 +08:00
Shengliang Guan
f2f8cb1648 Merge branch '3.0' into merge/mainto3.03 2025-02-19 17:00:41 +08:00
Haojun Liao
7d617a7cde
fix(stream): fix the invalid start task condition
1. Get the basic checkpointId, and wait for 10 s, it's allowed to go.  2. All tasks have the same checkpointId, go immedidately.
2025-02-19 00:39:01 +08:00
Shengliang Guan
b43aaa5f8a Merge branch '3.0' into merge/mainto3.02 2025-02-18 16:48:55 +08:00
Zhixiao Bao
05112546fd
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-18 16:07:47 +08:00
Shengliang Guan
63fc5dea34 Merge branch '3.0' into merge/mainto3.0 2025-02-18 10:29:16 +08:00
xiao-77
d071f40328 Fix review errors. 2025-02-18 09:31:15 +08:00
Jinqing Kuang
fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
dmchen
cc3b883a43 feat/TS-5927-long-password-compatable 2025-02-14 06:04:22 +00:00
dmchen
8f2370f3fa feat/TS-5927-long-password-fix-case 2025-02-14 01:12:09 +00:00
dmchen
55e12e520b feat/TS-5927-long-password-encrypt-pass 2025-02-13 07:45:42 +00:00
Zhixiao Bao
e71c03a90f
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-13 10:17:58 +08:00
dongming chen
2fd8792c7a
Merge branch '3.0' into feat/TS-5927-long-password 2025-02-12 15:26:41 +08:00
xiao-77
359399f1cd feat rename some names. 2025-02-12 14:49:59 +08:00
dmchen
b422e2b2f2 feat/TS-5805-force-assign-leader-msg-type 2025-02-12 06:29:24 +00:00
dongming chen
0350f46ba4
Merge pull request #29756 from taosdata/3.0
3.0
2025-02-12 14:00:02 +08:00
Shengliang Guan
67b678f9f0
Merge pull request #29746 from taosdata/merge/mainto3.02
merge: from main to 3.0 branch
2025-02-12 13:57:36 +08:00
dmchen
d128c3927d fix/TS-5805-check-arb-fix-comment 2025-02-12 02:04:13 +00:00
xiao-77
bdcec392b4 Merge remote-tracking branch 'origin/3.0' into feat/3.0/TS-5584 2025-02-12 09:56:23 +08:00
xiao-77
a1a3f83283 Add unapplied to show vnodes. 2025-02-12 09:55:36 +08:00
xiao-77
b62d8d37b1 Feat(sync):Use remaining time to replace progress. 2025-02-11 15:51:05 +08:00
Shengliang Guan
cd52401303 Merge branch 'main' into merge/mainto3.02 2025-02-11 15:15:35 +08:00
dmchen
635b4a5cb1 fix/TS-5805-check-arb-trans-compatable 2025-02-11 02:56:12 +00:00
Haojun Liao
267f7d3b08 refactor(stream): limit the maximum number of consensus checkpoint trans. 2025-02-11 10:31:11 +08:00
Haojun Liao
d08a81cc98 fix(stream): fix bug in limiting concurrent checkpoints 2025-02-10 19:24:37 +08:00
Haojun Liao
6c7a8e9774 refactor(stream): allow ready stream to start checkpoint procedure. 2025-02-10 19:24:36 +08:00
Shengliang Guan
dae17cd1b0
Merge pull request #29718 from taosdata/enh/streamqueue
refactor(stream): notify close stream in main thread
2025-02-10 18:44:27 +08:00
xiao-77
fbe65197d6 Feat(sync):Add restore progress to the "show vnodes" command, and add the applied index to the "show vgroups" command. 2025-02-10 15:58:25 +08:00
dmchen
b1dc31a2bd fix/TS-5805-check-arb-add-column 2025-02-10 06:57:50 +00:00
dmchen
946a0c1bb5 fix/TS-5805-check-arb-remve-useless-code 2025-02-10 02:58:42 +00:00
dongming chen
240a8b5d5b
Merge pull request #29723 from taosdata/3.0
3.0
2025-02-10 09:56:12 +08:00
Haojun Liao
ec954bf408 refactor(stream): record the dropped stream. 2025-02-09 21:13:10 +08:00
xiao-77
adfab1f2b6 Fix some review errors. 2025-02-08 18:51:39 +08:00
xiao-77
4011d01148 Fix some review errors. 2025-02-08 17:42:48 +08:00
xiao-77
7707e5d8dd Fix some review errors. 2025-02-08 17:37:15 +08:00
xiao-77
a2f11f21c9 Fix review problems. 2025-02-08 17:07:55 +08:00
xiao-77
72f228fa97 Fix build errors. 2025-02-07 18:52:54 +08:00
xiao-77
2cbb7a7814 Fix sdb config compare errors. 2025-02-07 18:49:00 +08:00
Shengliang Guan
a004d95996 Merge branch '3.0' into merge/mainto3.02 2025-02-06 13:46:36 +08:00
factosea
fbe345a82e fix: cols funcs, sub query 2025-02-05 15:26:03 +08:00
dmchen
2b4d4162a7 feat/TS-5805-force-set-assign 2025-01-24 08:50:04 +00:00
Haojun Liao
2f6977dfda Merge branch 'main' into enh/analysis 2025-01-23 18:55:32 +08:00
dmchen
d9401fd75d feat/TS-5805-add-sql-command 2025-01-23 09:37:07 +00:00
dmchen
3c5b8037e3 feat/TS-5927-long-password 2025-01-23 08:46:29 +00:00
Haojun Liao
55ca679571 fix(analysis): fix compiling error on windows. 2025-01-23 09:06:55 +08:00
Haojun Liao
989c20078a refactor: do some internal refactor. 2025-01-23 00:32:46 +08:00
Haojun Liao
883b1b79a2 enh(analysis): add the algorithm in telemetry report. 2025-01-23 00:29:18 +08:00
Haojun Liao
d6dc966ed1 fix(analysis): fix compiler error on windows. 2025-01-22 15:12:43 +08:00
Haojun Liao
9f2c448e36 fix(stream): fix error in check node update trans. 2025-01-22 14:05:40 +08:00
Haojun Liao
30358f1297 fix(stream): fix error in check node update trans. 2025-01-22 12:52:30 +08:00
Haojun Liao
84580286ce enh(analysis): enable community edition to support anodes. 2025-01-22 11:11:06 +08:00
Haojun Liao
2f065062c3 fix(stream): adjust position of checking trans. 2025-01-21 19:04:14 +08:00
Haojun Liao
88a94919c4 fix(stream): check for nodeupdate trans before create streams. 2025-01-21 18:41:52 +08:00
Jinqing Kuang
eb5d463490 feat(stream)[TS-5469]. add support for window event notifications in stream processing
- Introduce new syntax to specify notification type and destination address
- Collect relevant event information during window computations
- Implement websocket-based notification delivery to the specified address
2025-01-21 17:39:46 +08:00
Haojun Liao
0ea46585f4 fix(stream): update checkpoint-info after check the failed checkpointId, and update the consensus-checkpoint id in mnode. 2025-01-21 16:29:00 +08:00
Haojun Liao
df6ec3afc2 fix(stream): check null ptr. 2025-01-21 11:21:53 +08:00
Haojun Liao
08092aeb0c fix(stream): not clear task list if check failed, and add more checks. 2025-01-21 10:27:39 +08:00
Haojun Liao
7900c725d5 fix(stream): fix syntax error. 2025-01-21 09:15:27 +08:00
Haojun Liao
efd33aa4d7 fix(stream): check the checkpoint-report transId and checkpointId, and identify the expired checkpoint-report info. 2025-01-21 01:25:53 +08:00
Shengliang Guan
e48b48f93c Merge branch 'main' into merge/mainto3.0 2025-01-10 12:07:40 +08:00
Hongze Cheng
74c7420c1d
Merge pull request #29527 from taosdata/fix/main/TD-33457
Test(cfg): add alter config to compatibility.py and fix some memory leak.
2025-01-09 17:22:07 +08:00
Shengliang Guan
c62e189496 Merge branch 'main' into merge/mainto3.0 2025-01-09 13:38:37 +08:00
xiao-77
c3e025713b Rename some vars. 2025-01-09 13:38:20 +08:00
xiao-77
c1732ba41d Fix asan problems at ci test. 2025-01-09 13:36:23 +08:00
Shengliang Guan
081c902c64
Merge pull request #29520 from taosdata/fix/TD-32471-main
fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL
2025-01-09 13:33:48 +08:00
xiao-77
9eb1239783 Fix mem leak. 2025-01-09 10:50:23 +08:00
Shengliang Guan
fe4555f060
Merge pull request #29517 from taosdata/fix/tag
fix(stream): check the stream task last ready timestamp before start the checkpoint procedure.
2025-01-08 18:29:55 +08:00
wangmm0220
ba9892bae0 fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL 2025-01-08 16:50:38 +08:00
xiao-77
742e3251b7 Remove unused rpcRsp. 2025-01-08 15:51:58 +08:00
xiao-77
4a5d575894 Fix unhandle msg. 2025-01-08 15:45:58 +08:00
Haojun Liao
130ad28d2c fix(stream): check stream task status before start checkpoint. 2025-01-08 15:31:15 +08:00
xiao-77
430e62aab6 Fix double free. 2025-01-08 14:55:37 +08:00
xiao-77
b46bd98f6d Fix mem leak. 2025-01-08 09:29:46 +08:00
xiao-77
e597baa345 Fix mnode = 3 , trans stuck. 2025-01-07 22:01:33 +08:00
xiao-77
77359f26b3 Fix(cfg): resolve dynamic configuration update failure after rolling upgrade to 3.3.5.0 2025-01-07 15:26:01 +08:00
Shengliang Guan
fcca5e7c2e
Merge pull request #29381 from taosdata/fix/liaohj
test: add test cases and fix related bugs.
2024-12-31 11:10:34 +08:00
Haojun Liao
f03e2305e0 fix(stream): add logs and set the reset-stream rsp. 2024-12-30 14:26:20 +08:00
kailixu
b0fa490dd6 test: add test case for auto compact 2024-12-29 15:13:38 +08:00
kailixu
458a72c66a test: add test case for auto compact 2024-12-29 13:45:59 +08:00
kailixu
f529339fb8 test: add test case for auto compact 2024-12-29 13:26:40 +08:00
kailixu
7b69c29c9e test: add test case for auto compact 2024-12-29 12:49:03 +08:00
kailixu
104f37337f test: add test case for auto compact 2024-12-29 12:24:15 +08:00
kailixu
5f3e8ef5aa test: add test case for auto compact 2024-12-28 15:35:12 +08:00
kailixu
bf33ef0c07 test: add test case for auto compact 2024-12-27 18:57:12 +08:00
kailixu
fcd436830f test: add test case for auto compact 2024-12-27 18:54:22 +08:00