Commit graph

80 commits

Author SHA1 Message Date
dapan1121
0e69cb3886 Merge remote-tracking branch 'origin/3.0' into feat/TS-6100-3.0 2025-06-27 14:53:03 +08:00
Minglei Jin
66c4ef3e90
feat(mqtt): mqtt subscription (#30127)
* feat(mqtt): Initial commit for mqtt

* chore(xnode/mnd): xnode message handlers for mnode

* chore(mnd/xnode): mnode part for xnode

* chore(xnode/translater): fix show commands

* fix(ast/creater): fix xnode create option

* fix(xnode/ci): fix ci & doc's error codes

* chore(xnode/sql): make create/drop/show work properly

* fix(xnode/sql): commit new files

* fix(xnode/sql): commit cmake files

* fix: fix testing cases

* fix(xnode/tsc): fix tokens

* fix(ast/anode): fix anode update decl.

* fix(xnode/error): fix xnode error codes

* fix: xnode make/destroy

* chore: xnode with option & dnode id

* chore: use taosmqtt for xnode

* chore: new error code for xnode launching

* chore(xnode): new error code

* chore: header for _xnode_mgmt_mqtt

* chore: source for _xnode_mgmt_mqtt

* chore: remove test directory from cmake

* chore: remove taosmqtt for ci to compile

* chore: remove taosudf header from xnode

* chore: new window macro

* chore: remove xnode mgmt mqtt for windows compilation

* Revert "chore: remove xnode mgmt mqtt for windows compilation"

This reverts commit 197e1640c7.

* chore: cleanup code

* chore: xnode mgmt comment windows part out

* chore: mgmt/mqtt, move uv head toppest

* xnode/mnode: create xnode once per dnode

* fix(xnode/systable/test): fix column count

* xnode/sdb: renumber sdb type for xnode to make start/stop order correct

* xnode/mqtt: new param mqttPort

* fix SXnode's struct type

* transfer dnode id to mqtt subscription

* tmqtt: remove uv_a linking

* tmqtt/tools: sources for tools

* tools: fix windows compilation

* tools/producer: fix windows sleep param

* tools/producer: fix uninited var rc

* make tools only for linux

* test/mnodes: wail 1 or 2 seconds for offline to be leader

* update topic producer tool for geometry data type testing

* format tool sql statements

* show xnodes' ep

* make shell auto complete xnodes

* use usleep instead of sleep

* mqtt/proto: first version mqtt protocol

* remove assert styles

* build with linux only

* fix libuv for taosmqtt building

* fix log printing

* mem: use ttq_ prefix instead of tmqtt

* xnode/parser/proto: protocol option for xnode

* xnode/translater/option: translate xnode option proto

* xnode/translator: translate proto param

* xnode/tmsg: encode/decode proto param

* xnode/mnode: proto parma for mndXnode

* xnode/proto: protocol param for xnode

* xnode/mqtt: save/load proto from xnode json

* rename tmqtt proto header

* rename head directories

* rename header name styles

* restyle func names

* update

* update

* use camel db

* use camel for cxt

* update count of information_schema

* fix exceptional cases

* fix w.r.t reviews

* fixes w.r.t reviews

* use ttq_free

* append xnode msgs

* update information schema count

* support tmq meta data sub

* success typo fix

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix error line var w.r.t. suggestions from copilot

* denote mqtt node with bnode instead of xnode

* smoke testing for mqtt

* soak testing

* new package for test framework: paho 2.1.0

* import mqtt into util

* fix soak testing

* test/soak: user 5 topics per client

* test/soak: cover qos

* update docker image references to tdengine-ci:0.1 in CI scripts and common.py

* refactor: rename bnode msg to backup node

* refactor: rename xnode to bnode 1

* refactor: rename xnode to bnode 2

* refactor: rename xnode to bnode 3

* refactor: rename xnode to bnode 4

* refactor: rename xnode to bnode 4

* refactor: rename xnode to bnode 5

* refactor: rename xnode to bnode 6

* refactor: rename some files 1

* refactor: rename some files 2

* refactor: rename some files 3

* refactor: rename some files 4

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: chenhaoran <haoran920c@163.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
2025-06-25 14:58:51 +08:00
dapan1121
78bd13a68a enh: add stream health check 2025-05-30 18:15:49 +08:00
Simon Guan
b91dd10846 enh: add log level to each log entry 2025-02-27 09:55:11 +08:00
xiao-77
474113da4e Move rebuild config sdb to after restored. 2024-12-17 11:22:38 +08:00
xiao-77
90af4457ef Add func sdb set&get float. 2024-11-27 10:50:04 +08:00
xiao-77
4a03483683 add prepare func. 2024-11-15 14:39:10 +08:00
xiao-77
cc3f4504bf Add mnd init cfg and mnd cfg trans. 2024-11-14 17:20:50 +08:00
Shengliang Guan
3003e7286e feat: data analysis 2024-10-15 10:00:38 +08:00
Shengliang Guan
9f05ca5ee8 revert: data analysis 2024-10-14 23:27:11 +08:00
Shengliang Guan
a5b5bd61f6 feat: anode 2024-10-09 17:20:13 +08:00
dmchen
0da625bf55 dmchen/delete-trans-tool 2024-09-03 02:21:31 +00:00
dmchen
fee9a14b69 fix/TD-31622-avoid-refrence-prow 2024-08-29 03:39:10 +00:00
kailixu
280c5d4b3d enh: return error code 2024-07-22 16:33:42 +08:00
kailixu
0ef8d3510a fix: use unsigned type for union bit operation 2024-06-14 15:46:11 +08:00
wangjiaming0909
3566cac206 add max tsma num opt 2024-04-16 14:23:26 +08:00
Shungang Li
3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
Benguang Zhao
dfef26866a enh: decode sdb raw object in SdbValidateFp instead 2024-02-23 10:39:50 +08:00
kailixu
76558da849 feat: support uniq grant 2024-01-18 15:23:38 +08:00
Hongze Cheng
04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
dmchen
4e1a355052 mnode for compact 2023-11-23 04:43:28 +00:00
yihaoDeng
08e3448498 add seq 2023-11-08 19:54:57 +08:00
dapan1121
14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
Benguang Zhao
9f1c8cc7b8 enh: unify validation of prepare actions with cb validateFp 2023-08-18 18:21:30 +08:00
Benguang Zhao
3c698b2461 enh: add mndAddPrepareNewVgAction 2023-05-29 14:13:11 +08:00
Benguang Zhao
d27f392beb enh: control frequency of mnode sdb flushing with mndSdbWriteDelta 2023-03-03 17:30:23 +08:00
Benguang Zhao
caaff5c546 enh: rotate wal of mnode properly 2023-03-01 10:02:33 +08:00
yihaoDeng
a05eb4b110 refactor tag index 2023-02-03 22:19:01 +08:00
Shengliang Guan
f02f3e7a07 fix: allow mnode start even dnode in dropping state 2023-01-11 10:12:54 +08:00
Shengliang Guan
9c8b194c34 refact: set FpSnapshotStopRead return type to void 2022-12-20 15:07:27 +08:00
Minghao Li
a35ad361d0 refacotr(sync): call syncBeginSnapshot instead of walBeginSnapshot 2022-10-20 18:01:43 +08:00
Shengliang Guan
3a7d89a6bb refact: remove bnode codes 2022-10-18 17:34:58 +08:00
Shengliang Guan
00080750fa fix: mnode may deadlock while drop another mnode if it crashed 2022-10-17 20:40:11 +08:00
Shengliang Guan
78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Shengliang Guan
390264db3f enh: assert the term of the snapshot as same as the memory 2022-07-19 17:11:15 +08:00
Liu Jicong
af0f398121
Merge pull request #14960 from taosdata/feature/stream
feat(stream): recover from failure
2022-07-15 18:32:48 +08:00
Liu Jicong
9394e3380f feat(stream): recover from failure 2022-07-15 17:58:53 +08:00
wangmm0220
e711f56027 fix:remove code for resolve the core of amotic_load_n 2022-07-14 16:33:11 +08:00
wangmm0220
2b442621e8 feat:get child table name in tmq meta 2022-07-12 18:58:33 +08:00
Shengliang Guan
ab0d7d31bc refactor: get sdb snapshot in atomic way 2022-06-20 18:37:46 +08:00
Shengliang Guan
96434756de refactor: save sdb file on needed 2022-06-20 16:23:04 +08:00
Shengliang Guan
db4e02c7c7 fix: add log to debug mnode sync 2022-06-17 15:23:17 +08:00
Shengliang Guan
ad5f9555fb refactor: sdb commit index 2022-06-17 14:48:30 +08:00
Shengliang Guan
4da408afe6 enh: call walEndSnapshot while sdb writefile 2022-06-09 17:44:39 +08:00
Shengliang Guan
17f8ccc901 enh: record config index 2022-06-09 14:12:52 +08:00
Shengliang Guan
a047d4a559 Merge remote-tracking branch 'origin/feature/sync-refactor' into fix/mnode 2022-06-07 16:37:50 +08:00
Shengliang Guan
e5f2b786fb feat: drop dnode 2022-06-07 13:41:41 +08:00
Shengliang Guan
a56f149af9 refactor: get last commit index to mnode 2022-06-07 13:01:48 +08:00
Shengliang Guan
1907c0e66c enh: add creating and dropping states to mnode 2022-06-01 21:16:22 +08:00
Shengliang Guan
86f8bf6cb1 refactor: make trans support multi steps 2022-05-31 14:38:15 +08:00