Commit graph

258 commits

Author SHA1 Message Date
Pan Wei
c5841939d8
fix: add ahandle release log (#30395) 2025-03-24 13:26:49 +08:00
Simon Guan
ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID (#30195)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* fix: compile errors in windows

* refactor: minor changes
2025-03-18 16:21:44 +08:00
Zhixiao Bao
2523e60d3b
fix: remove meaningless error logs when fetching child table metadata. (#30201)
* Enh: remove useless error logs.

* Fix: solving performance issues.

* fix: format code

---------

Co-authored-by: Simon Guan <slguan@taosdata.com>
2025-03-18 14:01:06 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
wangjiaming
f50fcb85b8
feat(decimal): support decimal data type (#30060)
* decimal: create table

* decimal: add test case decimal.py

* decimal: add decimal.c

* support input decimal

* decimal test

* refactor svalue

* fix test cases

* add decimal unit test

* add decimal test cmake

* support insert and query decimal type

* define wide integer, support decimal128

* support decimal128 divide

* set decimal type expr res types

* scalar decimal

* convert to decimal

* fix decimal64/128 from str and to str

* fix decimal from str and decimal to str

* decimal simple conversion

* unit test for decimal

* decimal conversion and unit tests

* decimal + - * /

* decimal scalar ops and comparision

* start to refactor GET_TYPED_DATA

* support decimal max func, cast func

* refactor GET_TYPED_DATA interface

* decimal scalar comparision

* start to implement sum for decimal

* support sum and avg for decimal type

* decimal tests

* add decimal test

* decimal add test cases

* decimal use int256/int128

* decimal testing

* fix decimal table meta and add tests for decimal col streams

* fix create stream and create tsma

* test insert decimal values

* decimal from str

* test decimal input

* test parse decimal from string

* add taos_fetch_field_e api

* decimal insert tests

* test decimal operators

* decimal operator test

* feat:support decimal in raw block

* decimal operator tests

* decimal test

* feat:support decimal in raw block

* feat:support decimal in raw block

* feat:add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* decimal test operators

* decimal operator test

* test decimal operators

* test decimal compare operators

* decimal unary operator test

* decimal col with decimal col oper test

* test decimal col filtering

* fix decimal float operator test

* decimal test where filtering

* fix decimal filtering

* fix decimal order by

* fix decimal op test

* test decimal agg funcs

* test decimal functions

* remove assert

* fix ci build for ret check

* fix decimal windows build

* fix ci ret check

* skip decimal ret check

* skip decimal ret check

* fix decimal tests

* fix decimal ci test

* decimal test

* fix(tmq): heap user after free

* fix(tmq): double free

* fix(tmq): double free

* fix decimal tests

* fix(decimal): decimal test ci build

* fix(decimal): windows build

* fix(decimal): decimal test build

* fix(decimal): fix decimal build and tests

* fix(decimal): fix decimal tests

* fix(decimal): fix taos_fetch_fields_e api

* fix(decimal): fix decimal taos_fetch_fields_e api

* fix(decimal): rebase 3.0

* fix(decimal): fix decimal functions

* fix(decimal): fix decimal test case memory leak

* fix(decimal): fix decimal tests

* fix(decimal): fix decimal test case

* fix(decimal): fix decimal tests

* feat(decimal): fix unit tests

* feat(decimal): fix deicmal unit test

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 18:08:07 +08:00
Simon Guan
1a9f75e663 Merge branch '3.0' into fix/internal 2025-03-04 13:47:03 +08:00
Simon Guan
6826edf5e0 Merge branch 'main' into merge/mainto3.0 2025-03-03 14:01:43 +08:00
facetosea
887444669c fix: error log 2025-02-28 16:51:25 +08:00
Simon Guan
43ca6d5f9e refactor: adjust some logs 2025-02-28 16:49:46 +08:00
Simon Guan
76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
pengrongkun94@qq.com
aef5611d1b switch create thread to taosc task queue 2025-02-18 18:10:26 +08:00
dapan1121
bd450fe751 fix: add meta debug log 2025-01-23 16:12:54 +08:00
dapan1121
b1702132b4 fix: add ut cases 2024-12-20 13:52:53 +08:00
dapan1121
2bd493f77b fix: return code issues 2024-12-11 19:18:50 +08:00
wangmm0220
f338357477 feat:[TD-32642] add test case for charset 2024-12-04 18:50:52 +08:00
wangmm0220
0e2a16d70f feat:[TD-32642] add charset for connection support 2024-11-27 14:25:34 +08:00
Shengliang Guan
d097e307f7
Merge pull request #28745 from taosdata/enh/TD-32167/query
enh: param valid, query
2024-11-13 14:39:15 +08:00
factosea
6b37b32997 fix: transportedid 2024-11-12 18:13:35 +08:00
factosea
057d388451 fix: set pointer to null after free 2024-11-12 17:59:58 +08:00
factosea
e3499f2377 enh:queryUtil 2024-11-12 16:47:39 +08:00
factosea
c1f8e59c1b enh: query 2024-11-12 16:11:47 +08:00
xsren
e03ccdc6e2 replace snprintf 2024-10-10 10:35:48 +08:00
xsren
eaf8bf0ca6 tstrncpy 2024-10-09 11:26:35 +08:00
xsren
95a26d7ee9 tstrncpy 2024-10-09 09:53:32 +08:00
xsren
e88a8317af fix: buff size 2024-10-09 09:45:56 +08:00
xsren
7f2a2cfbd0 enh: safe function 2024-10-08 14:25:51 +08:00
Hongze Cheng
5639fd0baf
Merge pull request #27947 from taosdata/enh/TS-5111-3.0
enh: support drop table with uid
2024-09-23 13:36:27 +08:00
lyh250-666
df147c60b0 enh:modify error code passing 2024-09-23 08:58:10 +08:00
kailixu
9cc0702a77 enh: drop table with uid 2024-09-19 18:34:49 +08:00
kailixu
2ea574fa4f chore: merge 3.0 2024-09-18 19:06:15 +08:00
kailixu
ba10e95723 enh: support drop table with uid 2024-09-18 16:05:05 +08:00
kailixu
d7fcf21f8b enh: support drop table with uid 2024-09-17 15:41:10 +08:00
kailixu
1b6694af20 enh: support drop table with uid 2024-09-16 11:39:11 +08:00
xsren
f684e12c27 pointer check 2024-09-14 18:11:36 +08:00
lyh250-666
6cbb0cf172 enh:modify error code passing libs/ 2024-09-11 09:58:41 +08:00
wangjiaming0909
b39b6589c4 fix client taskqueueWorkerpool stuck problem when querypolicy = 4 2024-09-09 13:30:22 +08:00
Jing Sima
2eb1f95224 fix:[TS-5349] fix wrong dbFName setted in mndPerfsInitMeta. 2024-09-04 13:34:11 +08:00
yihaoDeng
198486977e fix mem leak 2024-09-02 17:35:10 +08:00
dapan1121
905d1eb762
Merge pull request #26972 from taosdata/fix/TD-29679/l2cache
Fix/td 29679/l2cache
2024-08-08 16:51:44 +08:00
xsren
bec6dfe16b return value 2024-08-07 16:51:39 +08:00
dapan1121
dd28770bf7
Merge pull request #26914 from taosdata/fix/TD-31167
add new interface
2024-08-07 16:41:17 +08:00
yihaoDeng
f2a3951c23 refact code 2024-08-06 16:12:41 +08:00
yihaoDeng
e063a8092c refact code 2024-08-06 16:12:41 +08:00
dapan1121
ce52865c46 fix: db vgroup info clone issue 2024-08-06 13:20:51 +08:00
xsren
aa46b1d99f return:queryUtil 2024-07-29 14:58:47 +08:00
xsren
e86189d9ea check serialize result 2024-07-22 09:36:59 +08:00
xsren
99dcaaff21 build on windows 2024-07-22 09:36:59 +08:00
xsren
ebec7c928b array push 2024-07-22 09:36:59 +08:00
xsren
010a1da482 return value: querymsg.c 2024-07-22 09:36:56 +08:00