Commit graph

89 commits

Author SHA1 Message Date
dongming chen
643dfcb4fc
feat(TS-7270): encrypt algr (#33783) 2025-12-05 13:26:28 +08:00
Hongze Cheng
5779aad973
enh: refactor some tsdb log info (#32159) 2025-07-25 09:12:37 +08:00
Bomin Zhang
876979b5f5
feat[ts-6107]: shared storage (#31552)
* add API to use s3 as shared storage

* support using local file system as shared storage

* upload file to shared storage

* support read, compact and drop

* finish basic mnode & vnode msg processing

* follower sync migration state

* implement mnode transaction, and improve log

* send migration progress msg to dnode to avoid deadlock

* implement following migration

* remove mcount

* avoid redo migration on startup

* avoid follower deadlock when leader is down

* trigger migrate by timer,  avoid compact after migration

* comment out the usage of 'tcs' functions in stream

* change config item prefix from s3 to ss

* change db option prefix from s3 to ss

* rename s3 data struct, function, file to ss

* rename s3 macro to ss

* update s3 sql to ss

* rename remaining s3 items to ss

* check ss configruation, improve s3 retry

* grant object storage -> shared storage,  check ssEnabled

* fix memory leaks

* update build options

* omit sensitive information when dump config

* fix backward compatibility issue

* fix issues found in ci-checks

* fix some failed test cases

* avoid follower timeout and improve log

* fix: follower timeout because migration status not updated

* refuse migration if there's an in progress one

* fix ss test case

* remove garbage files and other minor improvement

* fix failed test cases

* update unit test

* fix failed test case

* fix failed test case

* update document

* update document and fix failed test cases

* fix minor issues in code, test and document

* check new commit after migration task is scheduled

* fix several issus

1. migrate information cannot be dropped sometimes because progress response was put into read queue.
2. memory leak in rare cases
3. data corruption in rare cases
4. failed test case

* add shared storage upgrade tool

* fix compile error
2025-07-14 16:33:53 +08:00
wangjiaming
f50fcb85b8
feat(decimal): support decimal data type (#30060)
* decimal: create table

* decimal: add test case decimal.py

* decimal: add decimal.c

* support input decimal

* decimal test

* refactor svalue

* fix test cases

* add decimal unit test

* add decimal test cmake

* support insert and query decimal type

* define wide integer, support decimal128

* support decimal128 divide

* set decimal type expr res types

* scalar decimal

* convert to decimal

* fix decimal64/128 from str and to str

* fix decimal from str and decimal to str

* decimal simple conversion

* unit test for decimal

* decimal conversion and unit tests

* decimal + - * /

* decimal scalar ops and comparision

* start to refactor GET_TYPED_DATA

* support decimal max func, cast func

* refactor GET_TYPED_DATA interface

* decimal scalar comparision

* start to implement sum for decimal

* support sum and avg for decimal type

* decimal tests

* add decimal test

* decimal add test cases

* decimal use int256/int128

* decimal testing

* fix decimal table meta and add tests for decimal col streams

* fix create stream and create tsma

* test insert decimal values

* decimal from str

* test decimal input

* test parse decimal from string

* add taos_fetch_field_e api

* decimal insert tests

* test decimal operators

* decimal operator test

* feat:support decimal in raw block

* decimal operator tests

* decimal test

* feat:support decimal in raw block

* feat:support decimal in raw block

* feat:add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* feat:remove add schemaExt to SMqDataRsp

* decimal test operators

* decimal operator test

* test decimal operators

* test decimal compare operators

* decimal unary operator test

* decimal col with decimal col oper test

* test decimal col filtering

* fix decimal float operator test

* decimal test where filtering

* fix decimal filtering

* fix decimal order by

* fix decimal op test

* test decimal agg funcs

* test decimal functions

* remove assert

* fix ci build for ret check

* fix decimal windows build

* fix ci ret check

* skip decimal ret check

* skip decimal ret check

* fix decimal tests

* fix decimal ci test

* decimal test

* fix(tmq): heap user after free

* fix(tmq): double free

* fix(tmq): double free

* fix decimal tests

* fix(decimal): decimal test ci build

* fix(decimal): windows build

* fix(decimal): decimal test build

* fix(decimal): fix decimal build and tests

* fix(decimal): fix decimal tests

* fix(decimal): fix taos_fetch_fields_e api

* fix(decimal): fix decimal taos_fetch_fields_e api

* fix(decimal): rebase 3.0

* fix(decimal): fix decimal functions

* fix(decimal): fix decimal test case memory leak

* fix(decimal): fix decimal tests

* fix(decimal): fix decimal test case

* fix(decimal): fix decimal tests

* feat(decimal): fix unit tests

* feat(decimal): fix deicmal unit test

---------

Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: yihaoDeng <yhdeng@taosdata.com>
2025-03-14 18:08:07 +08:00
Hongze Cheng
d537b2f8b6 adjust api code 2025-02-10 15:56:23 +08:00
Hongze Cheng
708fa269b5 more code 2025-02-08 11:10:17 +08:00
Hongze Cheng
cfb8cdb991 more code 2025-02-07 18:52:53 +08:00
xiao-77
362aac2de1 Enh(tsdb):print fid while data file corrupted. 2025-01-22 16:46:10 +08:00
wangjiaming0909
6c18289de0 fix tsbs perf issue 2024-11-18 14:11:21 +08:00
Hongze Cheng
53caf9f018 ehn: remove void 2024-09-26 10:43:16 +08:00
lyh250-666
ae7dde1aa2 enh:modify error code passing 2024-09-19 19:51:51 +08:00
Hongze Cheng
9b3cd3fb8d enh: error code handle 2024-09-11 10:56:40 +08:00
Hongze Cheng
63b64a90c0 enh: remove void with error code handle 2024-09-10 13:12:05 +08:00
Hongze Cheng
6bc44239c0 enh: remove void in tsdb 2024-09-10 10:05:38 +08:00
Pan Wei
8b0a040c64
Merge pull request #27500 from taosdata/enh/TD-31691
Modify error code passing for taosMemoryCalloc function in vnode
2024-08-28 11:24:26 +08:00
lyh250-666
06daf85130 Modify error code passing for taosMemoryCalloc function in vnode 2024-08-27 17:37:01 +08:00
Hongze Cheng
8dcc59495b ehn: remote some asserts 2024-08-26 10:23:21 +08:00
Hongze Cheng
e20c36c022 enh: clear some useless asserts 2024-08-20 14:47:05 +08:00
kailixu
f6ad63ac14 enh: code optimization 2024-08-14 13:59:33 +08:00
kailixu
cec7643ea8 enh: code optimization 2024-08-14 13:57:33 +08:00
kailixu
413a57f4cb fix(query): retry when column dropped in latest schema 2024-08-13 18:55:48 +08:00
Hongze Cheng
8ef31bc186 enh: refactor return code 2024-07-29 20:14:15 +08:00
Hongze Cheng
51e7ffa6c3 refact return code 2024-07-27 18:46:30 +08:00
Hongze Cheng
decd68f811 refact more code 2024-07-17 22:09:09 +08:00
Hongze Cheng
2cac0d5691 enh: recover file 2024-04-24 18:04:10 +08:00
dm chen
1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
Yihao Deng
a7722fbf3c Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:33:15 +00:00
Yihao Deng
ea9385912f Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:06:30 +00:00
dmchen
9a99b8526d resolve conflict 2024-04-15 08:24:40 +00:00
kailixu
123090e18a fix: solve conflicts 2024-04-15 16:12:15 +08:00
dmchen
a6c36a6cf3 resolve conflict 2024-04-15 07:36:41 +00:00
dm chen
4d660d89c0
Merge branch '3.0' into feat/TD-24834 2024-04-15 15:12:32 +08:00
Minglei Jin
6eb014e32b Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-09 19:11:46 +08:00
Minglei Jin
d5e9169769 cos/multi-write: dnode part including mnode/vnode/tsdb 2024-04-08 10:31:49 +08:00
yihaoDeng
684055bc7c Merge branch '3.0' into feature/compressData 2024-04-02 04:20:39 +00:00
yihaoDeng
d85ae3c26e fix invalid free 2024-04-02 12:14:02 +08:00
yihaoDeng
d7cee5dd80 fix invalid compress/decompress 2024-03-29 13:48:58 +00:00
yihaoDeng
b7067e61c8 fix ci error 2024-03-29 08:40:19 +00:00
dmchen
b9deb71fc5 basic function 2024-03-29 02:48:49 +00:00
yihaoDeng
f607cd60e3 tsdb support compress 2024-03-15 10:22:57 +00:00
yihaoDeng
ec227180e1 add alg to block col 2024-03-14 12:37:15 +00:00
facetosea
6678a65dc4 merge ts-4243 2024-03-14 19:06:34 +08:00
yihaoDeng
cc7d5ce484 add api 2024-03-13 12:58:05 +00:00
Hongze Cheng
f6c2a6bba2 more fix 2024-03-11 19:17:30 +08:00
Hongze Cheng
797a30ec02 more fix 2024-03-11 14:25:26 +08:00
Hongze Cheng
409c170404 fix more 2024-03-11 14:18:04 +08:00
Hongze Cheng
b764d51fae more code 2024-03-07 14:02:13 +08:00
Hongze Cheng
456db5b4c3 more code 2024-03-07 13:14:56 +08:00
Hongze Cheng
4dbdd2e35b more code 2024-03-07 10:42:20 +08:00
Hongze Cheng
f05fe86ef0 more code 2024-03-06 16:23:02 +08:00