Commit graph

59 commits

Author SHA1 Message Date
dmchen
486aca36a0 Merge branch '3.3.6' into merge/3.3.6tomain 2025-09-08 10:09:21 +08:00
dongming chen
624577ea8c
enh/TD-37682-set-sync-timeout (#32762)
* enh/TD-37682-set-sync-timeout

* add reset vnode sync timeout

* add 4 parameter

* change default

* rename parameter

* refactor: replace strcmp with taosStrncasecmp for syncTimeout checks

* feat: add support for additional sync interval configuration options

* feat: update sync timeout configuration handling in dmProcessConfigReq

* fix: adjust sync interval calculations in dmProcessConfigReq for accuracy

* fix: correct parameter names for sync vnode and mnode election intervals

* fix: update expected row count for 'show variables' in test_show_basic

* fix: update expected row count for 'show variables' in test_valgrind_checkerror1

* feat: add millisecond precision for status intervals and timeouts

* fix: update expected row count for 'show variables' in test_show_basic and test_valgrind_checkerror1

* fix: reduce sleep duration in management threads for improved responsiveness

* feat: add internal parameters for debugging synchronization module in taosd documentation
2025-09-08 09:02:28 +08:00
Zhixiao Bao
62d8b35fd0
feat: add write metrics. (#31198) 2025-06-30 10:33:34 +08:00
Minglei Jin
66c4ef3e90
feat(mqtt): mqtt subscription (#30127)
* feat(mqtt): Initial commit for mqtt

* chore(xnode/mnd): xnode message handlers for mnode

* chore(mnd/xnode): mnode part for xnode

* chore(xnode/translater): fix show commands

* fix(ast/creater): fix xnode create option

* fix(xnode/ci): fix ci & doc's error codes

* chore(xnode/sql): make create/drop/show work properly

* fix(xnode/sql): commit new files

* fix(xnode/sql): commit cmake files

* fix: fix testing cases

* fix(xnode/tsc): fix tokens

* fix(ast/anode): fix anode update decl.

* fix(xnode/error): fix xnode error codes

* fix: xnode make/destroy

* chore: xnode with option & dnode id

* chore: use taosmqtt for xnode

* chore: new error code for xnode launching

* chore(xnode): new error code

* chore: header for _xnode_mgmt_mqtt

* chore: source for _xnode_mgmt_mqtt

* chore: remove test directory from cmake

* chore: remove taosmqtt for ci to compile

* chore: remove taosudf header from xnode

* chore: new window macro

* chore: remove xnode mgmt mqtt for windows compilation

* Revert "chore: remove xnode mgmt mqtt for windows compilation"

This reverts commit 197e1640c7.

* chore: cleanup code

* chore: xnode mgmt comment windows part out

* chore: mgmt/mqtt, move uv head toppest

* xnode/mnode: create xnode once per dnode

* fix(xnode/systable/test): fix column count

* xnode/sdb: renumber sdb type for xnode to make start/stop order correct

* xnode/mqtt: new param mqttPort

* fix SXnode's struct type

* transfer dnode id to mqtt subscription

* tmqtt: remove uv_a linking

* tmqtt/tools: sources for tools

* tools: fix windows compilation

* tools/producer: fix windows sleep param

* tools/producer: fix uninited var rc

* make tools only for linux

* test/mnodes: wail 1 or 2 seconds for offline to be leader

* update topic producer tool for geometry data type testing

* format tool sql statements

* show xnodes' ep

* make shell auto complete xnodes

* use usleep instead of sleep

* mqtt/proto: first version mqtt protocol

* remove assert styles

* build with linux only

* fix libuv for taosmqtt building

* fix log printing

* mem: use ttq_ prefix instead of tmqtt

* xnode/parser/proto: protocol option for xnode

* xnode/translater/option: translate xnode option proto

* xnode/translator: translate proto param

* xnode/tmsg: encode/decode proto param

* xnode/mnode: proto parma for mndXnode

* xnode/proto: protocol param for xnode

* xnode/mqtt: save/load proto from xnode json

* rename tmqtt proto header

* rename head directories

* rename header name styles

* restyle func names

* update

* update

* use camel db

* use camel for cxt

* update count of information_schema

* fix exceptional cases

* fix w.r.t reviews

* fixes w.r.t reviews

* use ttq_free

* append xnode msgs

* update information schema count

* support tmq meta data sub

* success typo fix

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix error line var w.r.t. suggestions from copilot

* denote mqtt node with bnode instead of xnode

* smoke testing for mqtt

* soak testing

* new package for test framework: paho 2.1.0

* import mqtt into util

* fix soak testing

* test/soak: user 5 topics per client

* test/soak: cover qos

* update docker image references to tdengine-ci:0.1 in CI scripts and common.py

* refactor: rename bnode msg to backup node

* refactor: rename xnode to bnode 1

* refactor: rename xnode to bnode 2

* refactor: rename xnode to bnode 3

* refactor: rename xnode to bnode 4

* refactor: rename xnode to bnode 4

* refactor: rename xnode to bnode 5

* refactor: rename xnode to bnode 6

* refactor: rename some files 1

* refactor: rename some files 2

* refactor: rename some files 3

* refactor: rename some files 4

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: chenhaoran <haoran920c@163.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
2025-06-25 14:58:51 +08:00
Kaili Xu
13f9bddf3d
feat: support customized taos/taosd (#29736)
* feat: support TDAcoreOS

* chore: cmake options for TD_ACORE

* chore: disable lemon for TD_ACORE

* chore: add lzma2 and msvcregex

* chore: cmake for lzma2

* chore: adapt for TD_ACORE

* chore: adapt strcasecmp for TD_ACORE

* chore: adapt for geos/threadName

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE termio

* chore: refact transComm.h for TD_ACORE

* chore: refact transportInt.h for TD_ACORE

* chore: refact trans.c for TD_ACORE

* chore: refact trpc.h for TD_ACORE

* chore: refact transCli.c/transComm.c/transSvr.c for TD_ACORE

* chore: refact uv.h for TD_ACORE

* chore: refact geosWrapper.h for TD_ACORE

* chore: refact token/builtins/udf for TD_ACORE

* chore: refact rocks for TD_ACORE

* chore: refact tsdbCache.c for TD_ACORE, use LRU cache for last/last_row, not use rocksdb

* chore: refact FAIL to _ERR to solve conflicts for TD_ACORE

* chore: restore lemon.c/lempar.c

* chore: support build lemon for TD_ACORE

* chore: refact trpc and siginfo_t for TD_ACORE

* chore: refact timezone for TD_ACORE

* chore: refact lz4 for TD_ACORE

* chore: refact TD_ACORE to make compile pass

* chore: code optimization for TD_ASTRA

* feat: support run taos with taosd integrated

* feat: support invoke taos shell

* feat: support invoke taos shell

* feat: support invoke taos shell

* chore: code optimization

* chore: fix undefined reference problem os TD_ASTRA

* chore: resolve compile problem for TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix getpid

* chore: fix typo

* chore: set stack size and ajust min pack size for TD_ASTRA

* chore: fix pthread create parameters

* chore: chmod adapt for TD_ASTRA

* chore: fix trans compile problem

* chore: adapt chmod for TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: conditional compile option

* chore: adapt for TD_ASTRA

* chore: adjust taosPId and msvcregex for TD_ASTRA

* chore: log dir separator for wal build name

* chore: fix type of pointer parameter

* chore: fix compile problem of tsdbGetS3Size

* enh: get last ver from wal log for TD_ASTRA

* enh: refact wal meta ver

* enh: refact wal meta ver

* fix: typo of taosUcs4Compare

* enh: process return value of CI

* chore: more code for TD_ASTRA adaption

* chore: return value of taosCloseFile in walMeta.c

* chore: fix compile problem

* chore: fix compile problem of TD_ASTRA

* fix: update macro for tq and stream task

* chore: code optimization for TD_ASTRA

* chore: restore create log and init cfg interface

* chore: restore strncasecmp and strcasecmp

* fix: adjust the field position of SDataBlockInfo

* fix: pragma pack min size

* fix: pragma pack min size

* chore: more code for TD_ASTRA adaption

* fix: type of parameters

* chore: adapt strncasecmp and strcasecmp for TD_ASTRA

* chore: restore interface of init log

* enh: pack push optimization

* fix: taos init cfg

* add astra support

* fix: fetch the value of suid

* chore: switch of  build with udf

* add temp code

* chore: more code for TD_ASTRA adaption

* chore: add macro ERRNO to replace errno

* chore: bytes align for TD_ASTRA

* fix: remove obsolete codes

* enh: support USE_UDF macro

* fix compile error

* fix: resolve redefinition problem

* fix: compile problem of log.cpp

* fix: compile problem of osTimezone

* fix: resolve compile problem of udf

* fix: pragma definition on windows

* fix: ucs4 and stpncpy for TD_ASTRA

* fix: memory align problem for TD_ASTRA

* enh: solve memory leak for TD_ASTRA_RPC

* fix: compile problem of taosSetInt64Aligned

* fix: restore mndSubscribe.c

* fix: scalar for udf

* chore: code adaption for TD_ASTRA

* chore: code optimization for TD_ASTRA

* fix: typo of add definition

* fix: typo of macro in tudf.h

* chore: remove void to make CI pass

* enh: move macro from cmake.platform to cmake.options

* enh: byte align for hash node and error code

* chore: restore the size for lru cache

* enh: restore some code about pack push

* chore: restore the pack push in tmsg.h

* fix: add macro of pack pop for windows

---------

Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 13:32:13 +08:00
xiao77
97bcdfb86c resolve comments 2024-09-03 20:09:06 +08:00
xiao77
d3518fbc89 fix:TD-31587:Repeated insert performance degradation 2024-09-03 15:24:33 +08:00
Yihao Deng
6c39f81c7b refactor error 2024-07-16 01:04:16 +00:00
dmchen
3a4412b282 fix/TD-30876 2024-07-05 06:24:53 +00:00
dm chen
6d2d37d964
Merge pull request #24751 from taosdata/3.0
merge 3.0
2024-02-06 19:16:53 +08:00
dmchen
d9af07de6f new table structure 2024-01-24 09:44:44 +00:00
kailixu
414e15a810 chore: merge 3.0 2024-01-15 10:42:45 +08:00
Yihao Deng
b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
kailixu
70006bb711 feat: support alter cluster 2023-12-18 16:34:31 +08:00
kailixu
9fa90fc953 Merge branch '3.0' into feat/TD-27463-3.0 2023-12-18 14:20:10 +08:00
kailixu
b7bfbdd2b3 Merge branch '3.0' into fix/TD-27839-3.0 2023-12-14 19:48:13 +08:00
kailixu
7d18bd9811 chore: reduce the dependencies 2023-12-14 18:49:32 +08:00
kailixu
e2fcf79089 chore: remove obsolote code 2023-12-14 10:28:56 +08:00
dapan1121
7803a717c2
Merge pull request #24051 from taosdata/fix/TD-27839-3.0
enh: add check and reduce offset dependencies in lib
2023-12-14 10:19:02 +08:00
Cary Xu
46f27a77f1
Update dmMgmt.h 2023-12-13 23:05:46 +08:00
kailixu
f685b6c34a enh: reduce offset dependencies in lib 2023-12-13 16:56:45 +08:00
dmchen
daa2c2238a fix/TS-4251 2023-12-12 12:17:49 +08:00
kailixu
4a5b4b51e2 chore: remove obsolete codes 2023-10-30 17:51:42 +08:00
kailixu
22d6b95585 enh: dm init API 2023-10-29 21:13:18 +08:00
yihaoDeng
0188289308 statusClientRpc 2023-10-19 14:07:54 +08:00
yihaoDeng
e62f3fa86a opt status send 2023-10-18 16:03:55 +08:00
Ping Xiao
4f23ea2a8c enh: dmodule logic 2023-09-26 11:47:53 +08:00
kailixu
8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
Benguang Zhao
e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
dapan1121
dfefb68aa6 feat: support crash report 2022-12-30 13:30:54 +08:00
Shengliang Guan
8764cf9adb refact: remove multi process codes 2022-10-19 11:08:42 +08:00
Shengliang Guan
3a7d89a6bb refact: remove bnode codes 2022-10-18 17:34:58 +08:00
Cary Xu
02979f081d fix: support statistics of insert_req 2022-10-11 17:47:23 +08:00
dapan1121
496ae4ca89 schedule based on qnode's load 2022-05-31 14:03:47 +08:00
Shengliang Guan
f4c3141821 refactor: rpc msg handler 2022-05-21 18:30:17 +08:00
Shengliang Guan
e847cb3de2 refactor: adjust error codes 2022-05-21 13:03:43 +08:00
Shengliang Guan
79f660a222 refactor: adjust error codes 2022-05-21 12:00:56 +08:00
Shengliang Guan
380780331d refactor: change lockfree to rwlock 2022-05-19 15:19:19 +08:00
Shengliang Guan
a41dc27e6d refactor: dnode monitor 2022-05-19 11:10:13 +08:00
Shengliang Guan
77575d1e70 refactor: shm queue in multi process mode 2022-05-18 14:20:46 +08:00
Shengliang Guan
9a9a1927a5 refactor: make more object global 2022-05-17 16:01:06 +08:00
Shengliang Guan
23707bfcb9 refactor: multi-process test mode 2022-05-17 11:13:35 +08:00
Shengliang Guan
46d566d345 refactor: make more object global 2022-05-16 23:47:48 +08:00
Shengliang Guan
36fe62fbd2 refactor: make more object global 2022-05-16 23:23:49 +08:00
Shengliang Guan
1f886b1117 refactor: make more object global 2022-05-16 22:31:56 +08:00
Shengliang Guan
96b7f2696a refactor: adjust SRpcMsg 2022-05-16 14:55:31 +08:00
Shengliang Guan
893fb646d5 refactor: enable multi-process mode 2022-05-16 09:40:13 +08:00
Shengliang Guan
24feb934eb refactor: adjust dnode logs 2022-05-15 13:23:24 +08:00
Shengliang Guan
6e523a4706 refactor: multi-process mode 2022-05-14 22:23:52 +08:00
Shengliang Guan
a5a4da4d49 refactor: multi process mode 2022-05-14 18:16:52 +08:00