Commit graph

128 commits

Author SHA1 Message Date
dapan1121
330cf9982d fix: compile issues 2025-04-24 09:11:54 +08:00
Simon Guan
ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID (#30195)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* fix: compile errors in windows

* refactor: minor changes
2025-03-18 16:21:44 +08:00
Zhixiao Bao
2523e60d3b
fix: remove meaningless error logs when fetching child table metadata. (#30201)
* Enh: remove useless error logs.

* Fix: solving performance issues.

* fix: format code

---------

Co-authored-by: Simon Guan <slguan@taosdata.com>
2025-03-18 14:01:06 +08:00
Jinqing Kuang
ac23a4fc55
feat(stream): support stream processing for virtual tables (#30144)
* enh: add client processing

* enh: add mnode vtables processing

* enh: add mnode vtable processing

* enh: add normal child vtable support

* fix: compile issues

* fix: compile issues

* fix: create stream issues

* fix: multi stream scan issue

* fix: remove debug info

* fix: agg task and task level issues

* fix: correct task output type

* fix: split vtablescan from agg

* fix: memory leak issues

* fix: add limitations

* Update 09-error-code.md

* Update 09-error-code.md

* fix: remove usless case

* feat(stream): extract original table data in source scan task

Implemented functionality in the source task to extract data
corresponding to the virtual table from the original table using WAL.
The extracted data is then sent to the downstream merge task for further
processing.

* feat(stream): multi-way merge using loser tree in virtual merge task

Implemented multi-way merge in the merge task using a loser tree to
combine data from multiple original table into a single virtual table.
The merged virtual table data is then pushed downstream for further
processing.  Introduced memory limit handling during the merge process
with configurable behavior when the memory limit is reached.

* fix(test): remove useless cases

---------

Co-authored-by: dapan1121 <wpan@taosdata.com>
Co-authored-by: Pan Wei <72057773+dapan1121@users.noreply.github.com>
2025-03-15 17:06:48 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
wangjiaming
f50fcb85b8
feat(decimal): support decimal data type (#30060)
* decimal: create table

* decimal: add test case decimal.py

* decimal: add decimal.c

* support input decimal

* decimal test

* refactor svalue

* fix test cases

* add decimal unit test

* add decimal test cmake

* support insert and query decimal type

* define wide integer, support decimal128

* support decimal128 divide

* set decimal type expr res types

* scalar decimal

* convert to decimal

* fix decimal64/128 from str and to str

* fix decimal from str and decimal to str

* decimal simple conversion

* unit test for decimal

* decimal conversion and unit tests

* decimal + - * /

* decimal scalar ops and comparision

* start to refactor GET_TYPED_DATA

* support decimal max func, cast func

* refactor GET_TYPED_DATA interface

* decimal scalar comparision

* start to implement sum for decimal

* support sum and avg for decimal type

* decimal tests

* add decimal test

* decimal add test cases

* decimal use int256/int128

* decimal testing

* fix decimal table meta and add tests for decimal col streams

* fix create stream and create tsma

* test insert decimal values

* decimal from str

* test decimal input

* test parse decimal from string

* add taos_fetch_field_e api

* decimal insert tests

* test decimal operators

* decimal operator test

* feat:support decimal in raw block

* decimal operator tests

* decimal test

* feat:support decimal in raw block

* feat:support decimal in raw block

* feat:add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* decimal test operators

* decimal operator test

* test decimal operators

* test decimal compare operators

* decimal unary operator test

* decimal col with decimal col oper test

* test decimal col filtering

* fix decimal float operator test

* decimal test where filtering

* fix decimal filtering

* fix decimal order by

* fix decimal op test

* test decimal agg funcs

* test decimal functions

* remove assert

* fix ci build for ret check

* fix decimal windows build

* fix ci ret check

* skip decimal ret check

* skip decimal ret check

* fix decimal tests

* fix decimal ci test

* decimal test

* fix(tmq): heap user after free

* fix(tmq): double free

* fix(tmq): double free

* fix decimal tests

* fix(decimal): decimal test ci build

* fix(decimal): windows build

* fix(decimal): decimal test build

* fix(decimal): fix decimal build and tests

* fix(decimal): fix decimal tests

* fix(decimal): fix taos_fetch_fields_e api

* fix(decimal): fix decimal taos_fetch_fields_e api

* fix(decimal): rebase 3.0

* fix(decimal): fix decimal functions

* fix(decimal): fix decimal test case memory leak

* fix(decimal): fix decimal tests

* fix(decimal): fix decimal test case

* fix(decimal): fix decimal tests

* feat(decimal): fix unit tests

* feat(decimal): fix deicmal unit test

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 18:08:07 +08:00
Simon Guan
1a9f75e663 Merge branch '3.0' into fix/internal 2025-03-04 13:47:03 +08:00
facetosea
887444669c fix: error log 2025-02-28 16:51:25 +08:00
Simon Guan
43ca6d5f9e refactor: adjust some logs 2025-02-28 16:49:46 +08:00
Simon Guan
76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
dapan1121
2bd493f77b fix: return code issues 2024-12-11 19:18:50 +08:00
factosea
c1f8e59c1b enh: query 2024-11-12 16:11:47 +08:00
xsren
eaf8bf0ca6 tstrncpy 2024-10-09 11:26:35 +08:00
xsren
95a26d7ee9 tstrncpy 2024-10-09 09:53:32 +08:00
xsren
7f2a2cfbd0 enh: safe function 2024-10-08 14:25:51 +08:00
Hongze Cheng
5639fd0baf
Merge pull request #27947 from taosdata/enh/TS-5111-3.0
enh: support drop table with uid
2024-09-23 13:36:27 +08:00
lyh250-666
df147c60b0 enh:modify error code passing 2024-09-23 08:58:10 +08:00
kailixu
9cc0702a77 enh: drop table with uid 2024-09-19 18:34:49 +08:00
kailixu
2ea574fa4f chore: merge 3.0 2024-09-18 19:06:15 +08:00
kailixu
ba10e95723 enh: support drop table with uid 2024-09-18 16:05:05 +08:00
kailixu
d7fcf21f8b enh: support drop table with uid 2024-09-17 15:41:10 +08:00
kailixu
1b6694af20 enh: support drop table with uid 2024-09-16 11:39:11 +08:00
xsren
f684e12c27 pointer check 2024-09-14 18:11:36 +08:00
Jing Sima
2eb1f95224 fix:[TS-5349] fix wrong dbFName setted in mndPerfsInitMeta. 2024-09-04 13:34:11 +08:00
xsren
bec6dfe16b return value 2024-08-07 16:51:39 +08:00
xsren
e86189d9ea check serialize result 2024-07-22 09:36:59 +08:00
xsren
99dcaaff21 build on windows 2024-07-22 09:36:59 +08:00
xsren
ebec7c928b array push 2024-07-22 09:36:59 +08:00
xsren
010a1da482 return value: querymsg.c 2024-07-22 09:36:56 +08:00
factosea
5f582723eb fix: pSchemaExt crash 2024-04-30 10:23:40 +08:00
Yihao Deng
04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
wangjiaming0909
e947a2fb0d catalog cache get stream progress 2024-04-16 14:18:10 +08:00
wangjiaming0909
6e7dc4b7b4 normal table tsma and add tests 2024-04-16 14:17:12 +08:00
wangjiaming0909
70ca830378 support recursive tsma creation 2024-04-16 14:17:12 +08:00
wangjiaming0909
ef47fd57d6 support tsma catalog cache 2024-04-16 14:14:34 +08:00
yihaoDeng
4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00
kailixu
77d912c210 fix: primary key should not be null or none 2024-04-02 14:39:13 +08:00
yihaoDeng
3964f01793 fix invalid read 2024-03-18 07:23:55 +00:00
yihaoDeng
064e7ef017 fix desc crash 2024-03-13 08:03:43 +00:00
factosea
9711c830fe show create table 2024-03-13 15:17:43 +08:00
yihaoDeng
066a22443d fix invalid free 2024-03-12 09:50:26 +00:00
yihaoDeng
796ff03eb5 fix invalid copy 2024-03-12 09:47:01 +00:00
factosea
5dd4d05b2e desc table 2024-03-12 16:46:41 +08:00
dapan1121
6dcc555bbc fix: view privilege issue 2023-10-25 10:47:01 +08:00
dapan1121
0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
dapan1121
5db5205e31 fix: schema/tag version update to int32 2023-04-26 13:41:16 +08:00
shenglian zhou
32523d72f9 fix: add created time to file name and keep file reuse 2023-04-08 10:11:57 +08:00
shenglian zhou
4612d6d14b fix: catalog not processing version 2023-04-06 15:37:19 +08:00
Haojun Liao
22aa03307c fix(query): fix syntax errors on centos. 2023-02-24 11:38:54 +08:00
Shengliang Guan
d9c261cd13 refact: remove some error codes 2022-12-03 10:17:02 +08:00