Commit graph

1278 commits

Author SHA1 Message Date
dapan1121
3341e4994c fix: cases failed 2025-07-09 15:25:01 +08:00
Alex Duan
4bc58eda0b fix: delete stream_function_test.py case and remove stream function from benchMark 2025-07-08 17:55:27 +08:00
Alex Duan
62aa0a174f fix: delete stream-test.py case 2025-07-08 17:31:05 +08:00
dapan1121
2b6a1a66c3 fix: remove failed cases 2025-07-08 17:17:12 +08:00
Simon Guan
fc2fec02c7
merge: from main to 3.0 branch (#31562) 2025-07-03 09:15:59 +08:00
Simon Guan
2838d2f063 Merge branch '3.0' into merge/mainto3.0 2025-06-14 10:41:12 +08:00
Simon Guan
f691365426 Merge branch 'main' into merge/mainto3.0 2025-06-14 10:32:34 +08:00
haoranchen
708a393a75
Update cases.task (#31223) 2025-06-10 16:15:19 +08:00
Zhixiao Bao
41ae942dbb
feat: use csv reader to parse csv file. (#31238) 2025-06-03 17:44:10 +08:00
Simon Guan
556e426880 Merge branch 'main' into merge/mainto3.0 2025-05-17 12:55:32 +08:00
WANG MINGMING
40216c6143
opti(tmq): save tmq offset in vnode commit time & change log level (#30993) 2025-05-15 18:15:01 +08:00
xiao-77
69c8888e88 fix: concurrent execution compatibility test cases. 2025-05-15 10:38:10 +08:00
Zhixiao Bao
c807799d90
test: add more versions while exec compatibility.py. (#30856) 2025-05-14 17:40:02 +08:00
Simon Guan
75e2b3917f Merge branch 'main' into merge/mainto3.0 2025-05-12 11:33:33 +08:00
Haojun Liao
e439569455
test(stream): update the test cases. (#31044) 2025-05-12 11:25:07 +08:00
kevin men
9ef73dd93d
enh: improve code coverage of taos-tools (#30915)
* feat: add insert mix  test cases

* feat: add insert mix auto create table cases

* feat: delete unnecessary characters

* feat: Adjust the code structure of benchCsv

* feat: add stmt2 execInsert fail retry

* feat: modify sml auto create table params

* feat: modify bench csv case

* feat: modfiy code format

* feat: modify dmeters set drop yes

* feat: modify insert Mix config

* feat: delete unused parseLocaltimeWithDst

* feat: modify cases list error

* feat: Delete unused function in benchDataMix

* feat: modify demters check sql

* feat: modify sin mix range
2025-04-29 09:31:15 +08:00
Jing Sima
227c4c81d5
fix: [TD-34638] Fix schema is old error in vtable queries. (#30891) 2025-04-27 16:06:52 +08:00
kevin men
c2116c7752
fix: tag data from a CSV file cause core dump (#30855)
* fix: tag data from a CSV file, a core dump occurred.

* fix: add auto create table case

* fix: modfify auto create table case

* fix: modfify auto create table json

* fix: modify stmt2 automatic table creation tag binding
2025-04-25 09:09:36 +08:00
WANG MINGMING
ddd32e23d9
fix(tmq): init tmq handle error if snapshotVer is out of range (#30859) 2025-04-24 09:50:51 +08:00
Alex Duan
b6a63a76f5
merge: taos-tools and case 3.0 to main branch (#30802)
* merge: taos-tools and case 3.0 to main branch

* add -s option and modify concurrent name to threads
2025-04-17 15:29:23 +08:00
kevin men
55dbdb81c9
fix: json configuration not effective (#30785)
* fix: json configuration not effective

* fix: add ci cases config
2025-04-16 19:33:59 +08:00
Jing Sima
82b068ef8a
feat: [TS-6333] Fix decimal attempting free on address which was not malloc()-ed. (#30764) 2025-04-15 10:58:28 +08:00
zk662144
4e908b917b add case to cases.task 2025-04-12 17:30:05 +08:00
kevin men
f1b45f2298
fix: taosBenchmark online issues (#30722)
* fix: add abnormal exit logic

* fix: add interrupt exit mechanism

* fix: add insert error case

* fix: add Mac memory statistics

* fix: multi threaded table building with skip logic added

* fix: multi threaded table building increases task allocation

* fix: add csv tag file multi-threaded table creation case

* fix: add 'contrl c' to tmq and exit

* fix: add 'contrl c'  cases

* fix: add 'contrl c'  cases

* fix: add tmq cancel cases

* fix: add ci execute cases

* fix: restore mistakenly deleted files

---------

Co-authored-by: taos-support <it@taosdata.com>
2025-04-10 22:04:15 +08:00
Simon Guan
e6883f59d5
fix: unstable cases (#30727) 2025-04-09 22:00:24 +08:00
Zhixiao Bao
34a41bf54c
fix: crash while upgrade taosd to 3362. (#30712) 2025-04-09 18:53:47 +08:00
wangjiaming
b3b6c3d3ff
fix(fill): fix fill next/prev got different result with asc/desc order 2025-04-03 21:24:39 +08:00
Alex Duan
2d2e6c8f54
feat: taosdump support add or del cols/tags (#30624)
This reverts commit ae1c982ed6.
2025-04-02 21:16:03 +08:00
Simon Guan
ae1c982ed6
Revert "feat: taosdump support add or del cols/tags (#30604)" (#30618)
This reverts commit 862fd41d78.
2025-04-02 19:54:46 +08:00
Alex Duan
862fd41d78
feat: taosdump support add or del cols/tags (#30604) 2025-04-02 19:37:02 +08:00
Jing Sima
88f2e71dc4
fix: [TS-6094] Fix virtual table get wrong origin table's meta (#30586) 2025-04-02 11:29:34 +08:00
Zhixiao Bao
c6216a02ab
fix(s3): wrong condition where alter db ops s3_compact. (#30568) 2025-04-01 09:19:12 +08:00
Jing Sima
39d12640e0
fix: [TS-4897] Add test for query after alter vtable. (#30530) 2025-03-28 14:40:54 +08:00
Jing Sima
f84f04398d
fix: [TS-4897] Support query stables cross databases and fix potential deadlock. (#30507) 2025-03-28 10:07:08 +08:00
Yaming Pei
4d16f5bfe1
feat(taosBenchmark): supports decimal data type on main branch (#30504)
* feat: taosBenchmark supports decimal data type

* build: decimal script not use pytest.sh

* fix: fix typo for decimal script

* test: insertBasic.py debug

* build: update python connector version to 2.7.23

* docs: add decimal data type for python connector

* docs: format optimization

* docs: fix typo

* build: update docker taospy version to v2.7.23
2025-03-26 20:28:37 +08:00
Zhixiao Bao
df16c95b15
fix(csv): fix lost some ctbs while create table using csv file. (#30483) 2025-03-26 15:44:22 +08:00
Linhe Huo
e273a943ea
fix: add show connMode string (#30323)
* fix: add show connMode string

* fix: add stdbool.h to pub.h

* fix: remove trash file army/output.txt

* fix: caseBase.py modify syntax error

* fix: restore -R option for taosdump

* fix: taosdumpCommandline.py case

* fix: native stmt write normal table failed

* fix: taosdumpCommandline.py case passed

* fix: restore test.py from main branch

* fix: taosCli.py check default conn mode

* fix: commandline-sml.py case pass

* fix: websiteCase.py case passed

* fix: connMode.py case

* fix: modify default port is 0

* fix: taos_options with config dir not work

* fix: websocket.py delete -D timeout options

* fix: default_tmq_json.py context move to default_json.py, so delete

* fix python kafka bug

* chore: improve taos_init in wrapper

* chore: add installation path preparation in build workflow

* fix connMode bug

* fix: fix tmq conf/consumer new error in wrapperFunc.c

* fix: correct the spelling toss -> taosGetInstall...

* chore: fix compile error in wrapperFunc.c

* fix: createConnect fix memory leak

* fix: tsim forbid CHECK  ODR

* modify userOperTest uuse static lib

* reverse userOperTest use static lib

---------

Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: taos-support <it@taosdata.com>
Co-authored-by: “chris <“zk662144@163.com”>
Co-authored-by: t_max <1172915550@qq.com>
Co-authored-by: sheyanjie-qq <249478495@qq.com>
2025-03-22 20:44:07 +08:00
Alex Duan
c133489917
new-libtaos-with-ws (#29971)
* enh: rename libtaos.so to libtaosinternal.so

* enh: let python system-test work

* enh: shell for libinternal.so

* enh: refact script

* enh: wrapper for libtaosinternal

* enh: rename some files

* enh: let shell support internal driver

* enh: minor changes

* enh: minor changes

* add intenal.h

* enh: remove unused codes

* enh: minor changs

* feat: mac os issues

* enh: let python test use internal connection

* enh: let nettest work

* enh: let taosc -C work

* enh: test shell in mac os

* enh: minor changes

* enh: let libtaosinternal.so work in linux

* enh: update install script

* enh: for ci

* enh: for windows compile

* enh: minor changes

* enh: compile in windows

* enh: minor changes

* enh: taosinternal work in windows

* enh: add taos_internal_static

* enh: rollback os_for_wrapper

* fix: conflicts

* fix: conflicts

* fix: compile errors

* fix: conflicts

* enh: rename taosinternal to taosnative

* enh: rename taosinternal to taosnative

* fix: compile error

* enh: remove taosnative.h

* fix: compile errors

* enh: set default shell options

* fix: compile errors

* fix: compile errors

* debug: switch taosws branch to feat/new-libtaos-with-ws

* enh: taosBenchmark remove WEBSOCKET finished

* fix: CMakeLists.txt remove WEBSOCKET

* fix: compile errors

* fix: taosBenchmark delete restful code

* .gitignore remove taos-tools folder

* fix: remove taosdump WEBSOCKET MACRO

* fix: build error for taosdump

* fix: build project passed

* fix: support -Z for connect mode

* fix: build error

* fix: build error fixed

* fix: add -Z options

* fix: native and websocket with string

* fix: -Z option core

* fix: build unit test

* fix: build error

* fix: add colon for array

* fix: unit test can not include fun

* fix: CTest pointer null is nullptr

* fix: include pub.h

* fix: taosdump add -Z --driver options

* fix: taosdump support -Z with pub.h pub.c

* fix: toolsGetTimeDay move to pub.c

* fix: restore pub.c only simple fun

* fix: add error tips

* fix: tmfree remove from taosdump

* fix: remove double declare taos variant

* fix: taos support -Z option

* enh: configDir set with main fun

* fix: add g_arguments.configDir

* fix: show tips add cfgdir

* fix: g_argument is pointer

* fix: configDir is global var

* fix: declare g_configDir in benchMain.c

* fix: taos version not show on websocket

* stmt2 websocket prepare with supertable

* stmt2 websocket prepare build

* fix: stmt and stmt2 prepare add db name

* fix: remove -R --restful test case

* fix: taosBenchmark adjust priority cmd > json > evn

* fix: add connect mode test case connMode.py

* fix: clear evn and add host port check

* fix: army/test.py modify start taosAdapter is default

* change: system-test/test.py default start taosAdapter

* fix: add taosAdapter variant to system-test/test.py

* fix: -y must put behind other options

* fix: remove rest sml and add -N normal case

* fix: add -c work cfg test case

* del: queryMain.py remove rest query

* fix: remove groups have a blank append bug

* fix: caseBase.py add db in sql query

* fix: query_json.py remove rest test

* fix: taosBenchmark uniform dsn describe

* fix: add pub.h pub.c to tools public

* fix: case remove restful interface

* fix: build error

* fix: taosDriverCleanup no arg call

* fix: taosdump add test conn mode case taosdumpCommandline.py

* fix: modify insertFullType.json db name

* fix: taosdump connMode test case taosDumpCommandline.py passed

* enh: priority cmd > env > json

* fix: taosCli remove is_native variant

* fix: password is not pointer

* fix: comment -o test case

* fix: solve fun return code check

* fix: windows unresolved strcasecmp

* fix: remove coverHostToServAddr

* fix: forbid check ODR violation

* ci: trigger pr run

* fix: build error not del >>>>>3.0

* fix: support json dbinfo->vgroups have blank space

* fix: solve conflict with merge

* fix: with TrimCaseCmp fun to compare vgroups

* fix: del vgroups support blank code

* feat: wrapper add taos_fetch_fields_e

* fix: move jni from libtaosnative.so to libtaos.so

* fix: move clientTmqConnector.c for jni

* fix: fix assert check with del comment code

* fix: taosBenchmark add prepare stmt debug log

* fix: stmt2 already have debug log on preapare

* fix:  (double)LLONG_MAX force covert

* fix: stmt insert normal table with websocket

* fix: normal table with stmt too many ?

* fix: taosdump stmt_prepare with child tbname

* fix: build error add int code

* feat: stmtPrepare with child table to do

* taos -a options move to native test case

* fix:unit test benchmarkTest passed

* fix: query_json-with-sqlfile.py case no check results

* fix: queryMain.py case lost, put in tasks again

---------

Co-authored-by: Shengliang Guan <slguan@taosdata.com>
2025-03-20 22:54:29 +08:00
Simon Guan
eff763dc91
fix(stream): fix stream processing for virtual tables 2025-03-20 22:31:29 +08:00
Jinqing Kuang
4d97d691cf fix(stream): add test cases for vtable stream processing 2025-03-20 18:57:58 +08:00
Simon Guan
08da50dc8f Merge branch 'main' into merge/mainto3.0 2025-03-20 17:52:00 +08:00
Alex Duan
d27848fe3b
docs: query forbid super table and special-table together (#30284)
* docs: query forbid super table and special-table together

* fix: taosBenchmark official case add to CI

* fix: tmq check consumer result

* docs: adjust json format and add note tips for both query

* docs: json format indent for query.json

* fix: forbid both query from v3.3.5.6
2025-03-20 15:59:07 +08:00
xinsheng Ren
59f45345fb
fix: memleak while stop udfd
* fix: use address sanitizer to detect buffer overflow in udfTest.py

* fix: improve UDF process termination in udfTest.py

* fix: udf test case, stack overflow

---------

Co-authored-by: chenhaoran <haoran920c@163.com>
2025-03-20 13:45:33 +08:00
wangjiaming
77f9707f89
feat: add more test cases for decimal
* add decimal tests

* decimal: add more decimal tests

* test(decimal): add more tests for decimal

* fix(decimal): fix decimal.py

* test(decimal): fix decimal test

* fix(decimal): fix decimal3.py test case
2025-03-19 17:13:56 +08:00
Pan Wei
0cb0e109a7
enh: add more cases for constant join (#30225)
* fix: add more cases and fix issues

* enh: add more test cases

* enh: add more test cases

* fix: memory leak issue

* enh: add view cases and fix order by issue

* enh: add document description
2025-03-19 16:50:44 +08:00
WANG MINGMING
3fafecb242
feat[TS-6137]: support sliding in force_window_close (#30203)
* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

* feat(stream): force window close support interval sliding

* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

* feat[TS-6137]: support sliding in force_window_close

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
2025-03-19 10:22:06 +08:00
WANG MINGMING
3bc6635de3
feat[TS-6115]: support deletion of topics with active consumers. (#30232)
* feat[TS-6115]: drop topic & consumer group in force

* feat[TS-6115]: drop topic & consumer group in force

* feat[TS-6115]: drop topic & consumer group in force
2025-03-18 14:11:00 +08:00
Haojun Liao
dfe32225de chore: merge main. 2025-03-17 14:51:11 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00