Commit graph

238 commits

Author SHA1 Message Date
dapan1121
0e69cb3886 Merge remote-tracking branch 'origin/3.0' into feat/TS-6100-3.0 2025-06-27 14:53:03 +08:00
Minglei Jin
66c4ef3e90
feat(mqtt): mqtt subscription (#30127)
* feat(mqtt): Initial commit for mqtt

* chore(xnode/mnd): xnode message handlers for mnode

* chore(mnd/xnode): mnode part for xnode

* chore(xnode/translater): fix show commands

* fix(ast/creater): fix xnode create option

* fix(xnode/ci): fix ci & doc's error codes

* chore(xnode/sql): make create/drop/show work properly

* fix(xnode/sql): commit new files

* fix(xnode/sql): commit cmake files

* fix: fix testing cases

* fix(xnode/tsc): fix tokens

* fix(ast/anode): fix anode update decl.

* fix(xnode/error): fix xnode error codes

* fix: xnode make/destroy

* chore: xnode with option & dnode id

* chore: use taosmqtt for xnode

* chore: new error code for xnode launching

* chore(xnode): new error code

* chore: header for _xnode_mgmt_mqtt

* chore: source for _xnode_mgmt_mqtt

* chore: remove test directory from cmake

* chore: remove taosmqtt for ci to compile

* chore: remove taosudf header from xnode

* chore: new window macro

* chore: remove xnode mgmt mqtt for windows compilation

* Revert "chore: remove xnode mgmt mqtt for windows compilation"

This reverts commit 197e1640c7.

* chore: cleanup code

* chore: xnode mgmt comment windows part out

* chore: mgmt/mqtt, move uv head toppest

* xnode/mnode: create xnode once per dnode

* fix(xnode/systable/test): fix column count

* xnode/sdb: renumber sdb type for xnode to make start/stop order correct

* xnode/mqtt: new param mqttPort

* fix SXnode's struct type

* transfer dnode id to mqtt subscription

* tmqtt: remove uv_a linking

* tmqtt/tools: sources for tools

* tools: fix windows compilation

* tools/producer: fix windows sleep param

* tools/producer: fix uninited var rc

* make tools only for linux

* test/mnodes: wail 1 or 2 seconds for offline to be leader

* update topic producer tool for geometry data type testing

* format tool sql statements

* show xnodes' ep

* make shell auto complete xnodes

* use usleep instead of sleep

* mqtt/proto: first version mqtt protocol

* remove assert styles

* build with linux only

* fix libuv for taosmqtt building

* fix log printing

* mem: use ttq_ prefix instead of tmqtt

* xnode/parser/proto: protocol option for xnode

* xnode/translater/option: translate xnode option proto

* xnode/translator: translate proto param

* xnode/tmsg: encode/decode proto param

* xnode/mnode: proto parma for mndXnode

* xnode/proto: protocol param for xnode

* xnode/mqtt: save/load proto from xnode json

* rename tmqtt proto header

* rename head directories

* rename header name styles

* restyle func names

* update

* update

* use camel db

* use camel for cxt

* update count of information_schema

* fix exceptional cases

* fix w.r.t reviews

* fixes w.r.t reviews

* use ttq_free

* append xnode msgs

* update information schema count

* support tmq meta data sub

* success typo fix

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix error line var w.r.t. suggestions from copilot

* denote mqtt node with bnode instead of xnode

* smoke testing for mqtt

* soak testing

* new package for test framework: paho 2.1.0

* import mqtt into util

* fix soak testing

* test/soak: user 5 topics per client

* test/soak: cover qos

* update docker image references to tdengine-ci:0.1 in CI scripts and common.py

* refactor: rename bnode msg to backup node

* refactor: rename xnode to bnode 1

* refactor: rename xnode to bnode 2

* refactor: rename xnode to bnode 3

* refactor: rename xnode to bnode 4

* refactor: rename xnode to bnode 4

* refactor: rename xnode to bnode 5

* refactor: rename xnode to bnode 6

* refactor: rename some files 1

* refactor: rename some files 2

* refactor: rename some files 3

* refactor: rename some files 4

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: chenhaoran <haoran920c@163.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
2025-06-25 14:58:51 +08:00
dapan1121
78bd13a68a enh: add stream health check 2025-05-30 18:15:49 +08:00
Haojun Liao
704686ece6
fix(stream): fix the double release stream object in mnode. (#30942) 2025-05-06 15:56:24 +08:00
dongming chen
8710e539a0
fix: [TD-34436] double-release (#30668) 2025-04-09 14:50:20 +08:00
Kaili Xu
13f9bddf3d
feat: support customized taos/taosd (#29736)
* feat: support TDAcoreOS

* chore: cmake options for TD_ACORE

* chore: disable lemon for TD_ACORE

* chore: add lzma2 and msvcregex

* chore: cmake for lzma2

* chore: adapt for TD_ACORE

* chore: adapt strcasecmp for TD_ACORE

* chore: adapt for geos/threadName

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE

* chore: build adapt for TD_ACORE termio

* chore: refact transComm.h for TD_ACORE

* chore: refact transportInt.h for TD_ACORE

* chore: refact trans.c for TD_ACORE

* chore: refact trpc.h for TD_ACORE

* chore: refact transCli.c/transComm.c/transSvr.c for TD_ACORE

* chore: refact uv.h for TD_ACORE

* chore: refact geosWrapper.h for TD_ACORE

* chore: refact token/builtins/udf for TD_ACORE

* chore: refact rocks for TD_ACORE

* chore: refact tsdbCache.c for TD_ACORE, use LRU cache for last/last_row, not use rocksdb

* chore: refact FAIL to _ERR to solve conflicts for TD_ACORE

* chore: restore lemon.c/lempar.c

* chore: support build lemon for TD_ACORE

* chore: refact trpc and siginfo_t for TD_ACORE

* chore: refact timezone for TD_ACORE

* chore: refact lz4 for TD_ACORE

* chore: refact TD_ACORE to make compile pass

* chore: code optimization for TD_ASTRA

* feat: support run taos with taosd integrated

* feat: support invoke taos shell

* feat: support invoke taos shell

* feat: support invoke taos shell

* chore: code optimization

* chore: fix undefined reference problem os TD_ASTRA

* chore: resolve compile problem for TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix undefined reference problem os TD_ASTRA

* chore: fix getpid

* chore: fix typo

* chore: set stack size and ajust min pack size for TD_ASTRA

* chore: fix pthread create parameters

* chore: chmod adapt for TD_ASTRA

* chore: fix trans compile problem

* chore: adapt chmod for TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: more code for adaption of TD_ASTRA

* chore: byte alignment for TD_ASTRA

* chore: conditional compile option

* chore: adapt for TD_ASTRA

* chore: adjust taosPId and msvcregex for TD_ASTRA

* chore: log dir separator for wal build name

* chore: fix type of pointer parameter

* chore: fix compile problem of tsdbGetS3Size

* enh: get last ver from wal log for TD_ASTRA

* enh: refact wal meta ver

* enh: refact wal meta ver

* fix: typo of taosUcs4Compare

* enh: process return value of CI

* chore: more code for TD_ASTRA adaption

* chore: return value of taosCloseFile in walMeta.c

* chore: fix compile problem

* chore: fix compile problem of TD_ASTRA

* fix: update macro for tq and stream task

* chore: code optimization for TD_ASTRA

* chore: restore create log and init cfg interface

* chore: restore strncasecmp and strcasecmp

* fix: adjust the field position of SDataBlockInfo

* fix: pragma pack min size

* fix: pragma pack min size

* chore: more code for TD_ASTRA adaption

* fix: type of parameters

* chore: adapt strncasecmp and strcasecmp for TD_ASTRA

* chore: restore interface of init log

* enh: pack push optimization

* fix: taos init cfg

* add astra support

* fix: fetch the value of suid

* chore: switch of  build with udf

* add temp code

* chore: more code for TD_ASTRA adaption

* chore: add macro ERRNO to replace errno

* chore: bytes align for TD_ASTRA

* fix: remove obsolete codes

* enh: support USE_UDF macro

* fix compile error

* fix: resolve redefinition problem

* fix: compile problem of log.cpp

* fix: compile problem of osTimezone

* fix: resolve compile problem of udf

* fix: pragma definition on windows

* fix: ucs4 and stpncpy for TD_ASTRA

* fix: memory align problem for TD_ASTRA

* enh: solve memory leak for TD_ASTRA_RPC

* fix: compile problem of taosSetInt64Aligned

* fix: restore mndSubscribe.c

* fix: scalar for udf

* chore: code adaption for TD_ASTRA

* chore: code optimization for TD_ASTRA

* fix: typo of add definition

* fix: typo of macro in tudf.h

* chore: remove void to make CI pass

* enh: move macro from cmake.platform to cmake.options

* enh: byte align for hash node and error code

* chore: restore the size for lru cache

* enh: restore some code about pack push

* chore: restore the pack push in tmsg.h

* fix: add macro of pack pop for windows

---------

Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 13:32:13 +08:00
Simon Guan
b91dd10846 enh: add log level to each log entry 2025-02-27 09:55:11 +08:00
xiao-77
474113da4e Move rebuild config sdb to after restored. 2024-12-17 11:22:38 +08:00
xiao-77
19ea042318 Fix some review errors. 2024-12-13 12:32:08 +08:00
xiao-77
a79fbfd318 Merge branch '3.0' into enh/3.0/TS-5007 2024-12-12 09:49:17 +08:00
Shengliang Guan
ebcf538c05 Merge branch 'main' into merge/mainto3.0 2024-12-11 20:12:50 +08:00
Zhixiao Bao
405d924a6f
Merge branch '3.0' into enh/3.0/TS-5007 2024-12-10 14:32:43 +08:00
yihaoDeng
abc4a3768f opt code 2024-12-09 14:48:21 +08:00
yihaoDeng
32b5ec1da7 opt code 2024-12-09 14:35:12 +08:00
xiao-77
053ad5557f Skip invalid sdb raw. 2024-12-06 11:15:28 +08:00
yihaoDeng
c5c56606c4 use safe sys func 2024-12-05 16:35:45 +08:00
xiao-77
90af4457ef Add func sdb set&get float. 2024-11-27 10:50:04 +08:00
xiao-77
4b8feab900 fix mnd config persist. 2024-11-18 19:52:41 +08:00
xiao-77
9b9b3e8e96 Write configs to mnd sdb. 2024-11-18 12:05:08 +08:00
xiao-77
4a03483683 add prepare func. 2024-11-15 14:39:10 +08:00
xiao-77
cc3f4504bf Add mnd init cfg and mnd cfg trans. 2024-11-14 17:20:50 +08:00
dmchen
9f69124708 fix/TD-32622-add-closed-hash 2024-10-25 02:53:48 +00:00
Shengliang Guan
3003e7286e feat: data analysis 2024-10-15 10:00:38 +08:00
Shengliang Guan
9f05ca5ee8 revert: data analysis 2024-10-14 23:27:11 +08:00
dmchen
1e87baf730 fix/TS-5507-config-generate-ley-and-add-more-log 2024-10-10 03:49:07 +00:00
Shengliang Guan
a5b5bd61f6 feat: anode 2024-10-09 17:20:13 +08:00
dmchen
fd2a8d869c fix/TD-32316-add-try-at-trans-sync-context 2024-09-26 05:38:13 +00:00
lyh250-666
726b133721 modify error code passing 2024-09-12 07:46:30 +00:00
xsren
aea768d2c0 osFile 2024-09-10 17:40:19 +08:00
xsren
aa5683cfd9 osfile 2024-09-10 14:55:14 +08:00
xsren
2a3917029f osFile 2024-09-10 11:29:50 +08:00
dmchen
5e4c610142 fix/TD-31891-fix-case 2024-09-05 05:55:46 +00:00
dmchen
cbb1186e03 fix/TD-31891-remove-void-sdb 2024-09-05 04:00:49 +00:00
dmchen
0da625bf55 dmchen/delete-trans-tool 2024-09-03 02:21:31 +00:00
lyh250-666
f91305c52f enh:modify error code pass for taosMemoryCalloc in dnode/mgmt mnode/ 2024-09-02 04:40:20 +00:00
dmchen
79ec0da132 fix/TD-31622-unlock-and-free-when-error 2024-08-30 04:10:26 +00:00
dmchen
fee9a14b69 fix/TD-31622-avoid-refrence-prow 2024-08-29 03:39:10 +00:00
dmchen
81c4f26c59 fix/TD-31560 2024-08-21 04:23:42 +00:00
dmchen
ef0bd5d89b fix/TD-30989 2024-07-29 04:42:42 +00:00
kailixu
280c5d4b3d enh: return error code 2024-07-22 16:33:42 +08:00
kailixu
cdc85d9588 enh: return error code 2024-07-22 15:53:20 +08:00
kailixu
98a1145091 enh: return error code 2024-07-21 23:45:59 +08:00
dmchen
42eb599d35 resolve comment 2024-07-17 09:50:21 +00:00
dmchen
86ddcac6d4 one return success 2024-07-16 09:23:23 +00:00
dmchen
cfe7c552bc fix/TD-30989 2024-07-16 03:25:30 +00:00
kailixu
89be170305 enh: sdb table name for grant 2024-06-23 21:00:45 +08:00
kailixu
0ef8d3510a fix: use unsigned type for union bit operation 2024-06-14 15:46:11 +08:00
kailixu
74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
wangjiaming0909
7de0a34ae6 support maxTsmaCalcDelay, maxTsmaNum, skip_tsma 2024-04-16 14:25:01 +08:00
wangjiaming0909
3566cac206 add max tsma num opt 2024-04-16 14:23:26 +08:00