Commit graph

4708 commits

Author SHA1 Message Date
Simon Guan
a6e1578460
test: adding continue running method (#31216) 2025-05-27 13:40:38 +08:00
Simon Guan
309f4ffa5c Merge branch 'main' into merge/mainto3.0 2025-05-26 13:46:33 +08:00
Simon Guan
e35b774f8b
test: frame work (#31201) 2025-05-26 13:40:58 +08:00
Haojun Liao
ba35fc3411 test: update test cases. 2025-05-23 12:49:30 +08:00
Haojun Liao
2ebc730eec test(stream): update test cases. 2025-05-23 09:25:47 +08:00
Simon Guan
08b8673ac5
merge: from main to 3.0 branch (#31161) 2025-05-22 09:13:14 +08:00
Mario Peng
4fab91f800
fix(stmt2):memleak insert into stb (#31127) 2025-05-17 21:02:58 +08:00
Simon Guan
75e2b3917f Merge branch 'main' into merge/mainto3.0 2025-05-12 11:33:33 +08:00
Haojun Liao
e439569455
test(stream): update the test cases. (#31044) 2025-05-12 11:25:07 +08:00
dongming chen
b318684a52
fix: mnode-status-case (#30871) 2025-04-28 13:42:11 +08:00
Simon Guan
16f90d4de1 Merge branch 'main' into merge/mainto3.0 2025-04-27 19:16:46 +08:00
Minglei Jin
856bb2721a
fix(tdb/flush): malloc from os when no pages flushed (#30867) 2025-04-25 17:22:37 +08:00
Simon Guan
e8dd9daf11 Merge branch 'main' into merge/mainto3.0 2025-04-19 14:33:11 +08:00
Simon Guan
75df845c05
fix: show create table and desc table statements return composite key instead of primary key (#30830) 2025-04-19 13:32:34 +08:00
Haojun Liao
7a724c84f4
feat(gpt): support covariate forecasting (#30806) 2025-04-18 14:01:54 +08:00
Simon Guan
888fed8699 Merge branch 'main' into merge/mainto3.0 2025-04-16 19:34:20 +08:00
Haojun Liao
a90b41e4ce
fix: tables with a composite primary key of type varchar may have incorrect counts of projected results when sorted. 2025-04-11 15:44:34 +08:00
Simon Guan
7437dd026e Merge branch '3.0' into merge/mainto3.0 2025-04-11 13:47:45 +08:00
Simon Guan
28be0d950b Merge branch 'main' into merge/mainto3.0 2025-04-11 13:40:13 +08:00
Simon Guan
50d3705bea
enh[TS-6318]: changed the keyword for composite primary keys from "primary key" to "composite key" (#30741) 2025-04-10 20:31:35 +08:00
Simon Guan
e777dc5e9f
fix: the REPLICA parameter supports plural forms when used to create and alter a database (#30732) 2025-04-10 16:48:06 +08:00
Simon Guan
7314c3b145 Merge branch 'main' into merge/mainto3.0 2025-04-09 19:39:57 +08:00
Simon Guan
0001747378
enh: allow ordinary users to execute the "show disk_usage" command. (#30700) 2025-04-08 21:00:47 +08:00
Simon Guan
962aac540b
merge: from main to 3.0 branch (#30643) 2025-04-03 21:23:18 +08:00
jiajingbin
9a642d489e docs: update README 2025-04-03 17:25:47 +08:00
jiajingbin
77438c2f9a enh: add statistics for crash count in different versions 2025-04-03 17:20:59 +08:00
Simon Guan
dbbf4cbaa7 Merge branch 'main' into merge/mainto3.0 2025-04-02 23:24:27 +08:00
xinsheng Ren
463430ab15
enh: [TS-6195] support cols in stream (#30580) 2025-04-02 11:31:08 +08:00
Haojun Liao
841ae19707
Merge pull request #30520 from taosdata/doc/analysis
fix(gpt): check for the number of rows for analysis
2025-04-02 09:51:16 +08:00
Simon Guan
574f92c5d8 Merge branch 'main' into merge/mainto3.0 2025-04-01 18:45:10 +08:00
Simon Guan
28c9473513
refactor: adjust qid for connector log (#30577) 2025-04-01 16:34:33 +08:00
Haojun Liao
bf1b2ef121 test(gpt): add case for detecting too few rows for analysising. 2025-03-27 10:07:30 +08:00
Simon Guan
55de802a4c fix: anode scripts 2025-03-26 13:37:58 +08:00
Simon Guan
9a89db55ca
enh: allow ordinary users to execute the “show anodes” command. (#30464) 2025-03-25 20:17:16 +08:00
Jinqing Kuang
0639bb12d2
fix(stream): ignore still reachable error in case checkError1 (#30394) 2025-03-24 21:32:22 +08:00
Linhe Huo
b008ef17af Merge branch '3.0' into dev/merge-3.0-0322
* 3.0: (24 commits)
  doc: update docs. (#30347)
  doc: update docs for analysis (#30352)
  docs: fix virtual table err code (#30348)
  fix(stmt2):stmt2 get fields return wrong when tag is value (#30283)
  docs: [TS-4897] Add docs for virtual table. (#30325)
  fix: add show connMode string (#30323)
  fix: add requests pkg in tdgpt install.sh
  ci: add release build
  Update remove.sh
  refactor: streamline library removal and linking in installation scripts
  doc: add error code information about tdgpt (#30338)
  Update 09-error-code.md (#30327)
  chore: update taosadapter depends (#30326)
  chore: use taosws 3.0 branch in TDengine 3.0
  fix: show connMode is ok for taos
  fix: remove old setConnMode
  fix: build error
  fix: get default port rule
  chore: use taosadapter 3.0 branch in 3.0
  ci: fix pthread_tryjoin_np compile error
  ...
2025-03-22 22:44:07 +08:00
Linhe Huo
e273a943ea
fix: add show connMode string (#30323)
* fix: add show connMode string

* fix: add stdbool.h to pub.h

* fix: remove trash file army/output.txt

* fix: caseBase.py modify syntax error

* fix: restore -R option for taosdump

* fix: taosdumpCommandline.py case

* fix: native stmt write normal table failed

* fix: taosdumpCommandline.py case passed

* fix: restore test.py from main branch

* fix: taosCli.py check default conn mode

* fix: commandline-sml.py case pass

* fix: websiteCase.py case passed

* fix: connMode.py case

* fix: modify default port is 0

* fix: taos_options with config dir not work

* fix: websocket.py delete -D timeout options

* fix: default_tmq_json.py context move to default_json.py, so delete

* fix python kafka bug

* chore: improve taos_init in wrapper

* chore: add installation path preparation in build workflow

* fix connMode bug

* fix: fix tmq conf/consumer new error in wrapperFunc.c

* fix: correct the spelling toss -> taosGetInstall...

* chore: fix compile error in wrapperFunc.c

* fix: createConnect fix memory leak

* fix: tsim forbid CHECK  ODR

* modify userOperTest uuse static lib

* reverse userOperTest use static lib

---------

Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: taos-support <it@taosdata.com>
Co-authored-by: “chris <“zk662144@163.com”>
Co-authored-by: t_max <1172915550@qq.com>
Co-authored-by: sheyanjie-qq <249478495@qq.com>
2025-03-22 20:44:07 +08:00
Haojun Liao
b4e5aafac2 Merge branch '3.3.6' into fix/mergegpt 2025-03-21 16:36:17 +08:00
Haojun Liao
47004861c7 fix(gpt): 1. fix error in anomalywindow count; 2. update gpt model name; 3. update the expired test case. 4. support the user specified valid_code 2025-03-21 12:52:41 +08:00
liuyao
f7beaeebfe
ci: adjust test && fix issue
ci: adjust test && fix issue
2025-03-20 17:54:20 +08:00
liuyao
fac36002c1
ci(stream): add ci and fix issue (#30270)
* ci(stream): add ci and fix issue

* ci: adj test

* ci: add test and fix issue

* ci: adj test

* ci(stream): add test for fill operator and fix issue

* fix: fix issue

* fix: fix issue

* fix: adjust defalut rec value
2025-03-20 10:34:31 +08:00
WANG MINGMING
3fafecb242
feat[TS-6137]: support sliding in force_window_close (#30203)
* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

* feat(stream): force window close support interval sliding

* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
2025-03-19 10:22:06 +08:00
xinsheng Ren
789f36edda
docs: udf function, extract_avg (#30244) 2025-03-18 17:52:21 +08:00
Simon Guan
ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID (#30195)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* fix: compile errors in windows

* refactor: minor changes
2025-03-18 16:21:44 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
Mario Peng
f5a339f03e
enh(stmt2): [TD-33660] interlace mode support auto create table (#30084)
* enh: remove interlace autocreate tb limit

* enh: autocreate tb with single ctb

* enh: multi-insert in one ctb

* enh: Function realization

* fix: some unit test error

fix: stmt1 unit test

* fix: review and autoCreateTb & interlace support insert into stb syntax

* fix: insert into tags fixed value auto create table

* fix: remove a wrong test

* fix: adapter segment fault

* fix: adaptor core

* fix: get fields make interlace error

* fix: adapter core problem 2

* fix: multi bind exec invalid message problem
2025-03-14 14:13:26 +08:00
WANG MINGMING
3d053e2c9b
feat(stream): optimize client logic of creating stream if with history (#30059)
* feat:[TS-5617]use last_row cache mode if creating stream in fill_history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* feat(stream): optimize client logic of creating stream if with history

* fix: heap use after free

* feat: add log

* fix: ci case error

* fix: compile error in windows

* fix: ci case error

* fix: heap user after free

* fix: memory leak

* fix: ci case error

* fix: ci case error

* fix: ci case error

---------

Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 13:55:52 +08:00
Simon Guan
abaf48ae15 Merge branch '3.0' into merge/mainto3.0 2025-03-10 11:07:48 +08:00
Simon Guan
1170955b95 Merge branch 'main' into merge/mainto3.0 2025-03-10 11:05:52 +08:00