Commit graph

501 commits

Author SHA1 Message Date
Simon Guan
d02196a231
refactor: adjust some logs (#30245)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* docs: update keywords

* fix: compile errors in windows

* docs: minor changes

* docs: minor changes

* refactor: minor changes

* docs: fminro changes

* docs: format

* refactr: remove uncessory logs

* docs: format doc
2025-03-18 17:55:36 +08:00
Haojun Liao
dfe32225de chore: merge main. 2025-03-17 14:51:11 +08:00
Haojun Liao
ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
Kaili Xu
13f9bddf3d
feat: support customized taos/taosd (#29736)
* feat: support TDAcoreOS

* chore: cmake options for TD_ACORE

* chore: disable lemon for TD_ACORE

* chore: add lzma2 and msvcregex

* chore: cmake for lzma2

* chore: adapt for TD_ACORE

* chore: adapt strcasecmp for TD_ACORE

* chore: adapt for geos/threadName

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE termio

* chore: refact transComm.h for TD_ACORE

* chore: refact transportInt.h for TD_ACORE

* chore: refact trans.c for TD_ACORE

* chore: refact trpc.h for TD_ACORE

* chore: refact transCli.c/transComm.c/transSvr.c for TD_ACORE

* chore: refact uv.h for TD_ACORE

* chore: refact geosWrapper.h for TD_ACORE

* chore: refact token/builtins/udf for TD_ACORE

* chore: refact rocks for TD_ACORE

* chore: refact tsdbCache.c for TD_ACORE, use LRU cache for last/last_row, not use rocksdb

* chore: refact FAIL to _ERR to solve conflicts for TD_ACORE

* chore: restore lemon.c/lempar.c

* chore: support build lemon for TD_ACORE

* chore: refact trpc and siginfo_t for TD_ACORE

* chore: refact timezone for TD_ACORE

* chore: refact lz4 for TD_ACORE

* chore: refact TD_ACORE to make compile pass

* chore: code optimization for TD_ASTRA

* feat: support run taos with taosd integrated

* feat: support invoke taos shell

* feat: support invoke taos shell

* feat: support invoke taos shell

* chore: code optimization

* chore: fix undefined reference problem os TD_ASTRA

* chore: resolve compile problem for TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix getpid

* chore: fix typo

* chore: set stack size and ajust min pack size for TD_ASTRA

* chore: fix pthread create parameters

* chore: chmod adapt for TD_ASTRA

* chore: fix trans compile problem

* chore: adapt chmod for TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: conditional compile option

* chore: adapt for TD_ASTRA

* chore: adjust taosPId and msvcregex for TD_ASTRA

* chore: log dir separator for wal build name

* chore: fix type of pointer parameter

* chore: fix compile problem of tsdbGetS3Size

* enh: get last ver from wal log for TD_ASTRA

* enh: refact wal meta ver

* enh: refact wal meta ver

* fix: typo of taosUcs4Compare

* enh: process return value of CI

* chore: more code for TD_ASTRA adaption

* chore: return value of taosCloseFile in walMeta.c

* chore: fix compile problem

* chore: fix compile problem of TD_ASTRA

* fix: update macro for tq and stream task

* chore: code optimization for TD_ASTRA

* chore: restore create log and init cfg interface

* chore: restore strncasecmp and strcasecmp

* fix: adjust the field position of SDataBlockInfo

* fix: pragma pack min size

* fix: pragma pack min size

* chore: more code for TD_ASTRA adaption

* fix: type of parameters

* chore: adapt strncasecmp and strcasecmp for TD_ASTRA

* chore: restore interface of init log

* enh: pack push optimization

* fix: taos init cfg

* add astra support

* fix: fetch the value of suid

* chore: switch of  build with udf

* add temp code

* chore: more code for TD_ASTRA adaption

* chore: add macro ERRNO to replace errno

* chore: bytes align for TD_ASTRA

* fix: remove obsolete codes

* enh: support USE_UDF macro

* fix compile error

* fix: resolve redefinition problem

* fix: compile problem of log.cpp

* fix: compile problem of osTimezone

* fix: resolve compile problem of udf

* fix: pragma definition on windows

* fix: ucs4 and stpncpy for TD_ASTRA

* fix: memory align problem for TD_ASTRA

* enh: solve memory leak for TD_ASTRA_RPC

* fix: compile problem of taosSetInt64Aligned

* fix: restore mndSubscribe.c

* fix: scalar for udf

* chore: code adaption for TD_ASTRA

* chore: code optimization for TD_ASTRA

* fix: typo of add definition

* fix: typo of macro in tudf.h

* chore: remove void to make CI pass

* enh: move macro from cmake.platform to cmake.options

* enh: byte align for hash node and error code

* chore: restore the size for lru cache

* enh: restore some code about pack push

* chore: restore the pack push in tmsg.h

* fix: add macro of pack pop for windows

---------

Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 13:32:13 +08:00
Simon Guan
1a9f75e663 Merge branch '3.0' into fix/internal 2025-03-04 13:47:03 +08:00
Simon Guan
76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
Haojun Liao
c14ba08d7c refactor(stream): drop task in async ways 2025-02-27 00:12:11 +08:00
Haojun Liao
ecc667c22b
Revert "refactor(stream): drop task in async ways" 2025-02-21 01:10:18 +08:00
Haojun Liao
fd96b096ea refactor(stream): drop task in async ways 2025-02-13 23:41:06 +08:00
Hongze Cheng
389f545a53 more code 2024-12-14 18:06:50 +08:00
kailixu
f48e0727e6 enh: use memory safe functions 2024-12-11 16:40:11 +08:00
Shengliang Guan
e99b888654 Merge branch 'main' into merge/mainto3.0 2024-12-09 19:06:06 +08:00
Haojun Liao
43ad35f911 refactor: adjust the lock procedure for unregister stream tasks. 2024-12-06 09:20:39 +08:00
wangjiaming0909
a5a3d1d8ad fix same timestamp written into same tsma res ctb 2024-11-08 09:40:06 +08:00
Haojun Liao
4802f59dfe fix(stream): use the refId in stream meta list, in order to avoid access already freed stream tasks. 2024-10-27 15:49:40 +08:00
Hongze Cheng
53caf9f018 ehn: remove void 2024-09-26 10:43:16 +08:00
Hongze Cheng
e16af0e45c more 2024-09-24 18:04:58 +08:00
Hongze Cheng
645160d251 ehn: remove void 2024-09-24 10:06:30 +08:00
Hongze Cheng
17dfd6ba42 enh: handle void 2024-09-23 13:48:34 +08:00
kailixu
6561e164d4 enh: return value process 2024-09-20 16:17:55 +08:00
lyh250-666
63d98e2c5c enh:modify error code passing 2024-09-19 15:51:30 +08:00
Hongze Cheng
3aed4386ba fix: quick exit when there is snapshot task in progress 2024-09-18 17:06:05 +08:00
Haojun Liao
1a90e9612d refactor: check return value. 2024-09-13 23:04:41 +08:00
Hongze Cheng
6bc44239c0 enh: remove void in tsdb 2024-09-10 10:05:38 +08:00
xsren
3fb89fb814 fix: distinguish the calling scenarios of the metaGetTbTSchema function 2024-09-06 14:16:58 +08:00
wangjiaming0909
38e8d9f2fa fix querytask.c memory leak when random malloc error
remove (void)
2024-09-03 09:13:40 +08:00
Pan Wei
8b0a040c64
Merge pull request #27500 from taosdata/enh/TD-31691
Modify error code passing for taosMemoryCalloc function in vnode
2024-08-28 11:24:26 +08:00
lyh250-666
06daf85130 Modify error code passing for taosMemoryCalloc function in vnode 2024-08-27 17:37:01 +08:00
Hongze Cheng
e7fc467c59
Merge pull request #27450 from taosdata/enh/TD-30988-3.0
enh: refactor return code
2024-08-26 14:18:14 +08:00
kailixu
e2e782d724 enh: remove assert 2024-08-26 11:30:56 +08:00
kailixu
901107df16 enh: refactor return code 2024-08-26 10:13:09 +08:00
kailixu
cfd722e5a8 enh: refact to remove assert 2024-08-23 14:26:51 +08:00
kailixu
18cb94bd1e enh: refact to remove assert 2024-08-23 14:22:24 +08:00
Shengliang Guan
5ce7bcad1e refact: remove the return value of function taosCloseRef 2024-08-19 17:30:10 +08:00
kailixu
4b6bd5b43d fix: refactor return code 2024-07-29 11:11:51 +08:00
kailixu
87e3c17ada enh: refactor return code 2024-07-25 23:55:35 +08:00
kailixu
7ee18c5178 fix: refactor return code 2024-07-25 09:31:35 +08:00
kailixu
2fd3bf87fc Merge branch '3.0' into enh/TD-30988-3.0 2024-07-24 16:08:34 +08:00
kailixu
7b49327463 enh: refactor return code 2024-07-24 10:09:24 +08:00
Haojun Liao
923c791201 other: update test cases. 2024-07-23 19:53:32 +08:00
kailixu
994a08ad41 enh: refactor return code 2024-07-23 19:30:55 +08:00
kailixu
66dda35f75 Merge branch '3.0' into enh/TD-30988-3.0 2024-07-23 18:06:44 +08:00
kailixu
0a8be1fd3d enh: return error code 2024-07-23 13:55:26 +08:00
Haojun Liao
c08ee33dca other: merge 3.0 2024-07-23 13:45:31 +08:00
Shungang Li
f5f84c3cc6 feat: (errcode) ttime.c 2024-07-23 09:13:42 +08:00
kailixu
cdc85d9588 enh: return error code 2024-07-22 15:53:20 +08:00
Haojun Liao
7201526674 fix(stream): check return value. 2024-07-22 09:13:39 +08:00
kailixu
98a1145091 enh: return error code 2024-07-21 23:45:59 +08:00
kailixu
cd8a54cbf7 enh: return error code 2024-07-21 11:43:39 +08:00