Commit graph

5954 commits

Author SHA1 Message Date
Shengliang Guan
e429264432
Merge pull request #29884 from taosdata/enh/killtrans
enh(stream): auto kill checkpoint trans that last long time
2025-02-25 11:29:49 +08:00
Shengliang Guan
3a1d06f4d7
Merge pull request #29354 from taosdata/enh/TS-5255/colsFunc2
enh: ts5255/cols func2
2025-02-24 14:19:37 +08:00
Haojun Liao
91271f3fa4 refactor: do some internal refactor. 2025-02-24 13:53:28 +08:00
Haojun Liao
4d21d5e055 fix(stream): fix memory leak. 2025-02-24 13:50:38 +08:00
Haojun Liao
97071f1d29 other: add some logs. 2025-02-24 09:42:15 +08:00
Haojun Liao
ea549364d4 fix(stream): free array and check the return values. 2025-02-21 16:38:26 +08:00
dmchen
6a81665ffa fix/TS-6028-check-column-name-add-case 2025-02-21 14:51:40 +08:00
dmchen
cdb11dd497 fix/TS-6028-column-name-fix-cases 2025-02-21 10:10:44 +08:00
dmchen
078c7bdc31 fix/TS-6028-check-column-name 2025-02-20 17:33:48 +08:00
Haojun Liao
6d5984421f refactor(stream): update the long trans threshold. 2025-02-20 17:27:41 +08:00
Haojun Liao
0a672f1b96 refactor(stream): update logs. 2025-02-20 16:55:10 +08:00
Haojun Liao
99d6086c5a enh(stream): kill too long checkpoint trans. 2025-02-20 15:07:24 +08:00
Shengliang Guan
d0eb99809f Merge branch 'main' into merge/mainto3.03 2025-02-20 11:38:41 +08:00
Haojun Liao
3048654484 refactor(stream): kill too long checkpoint trans. 2025-02-20 10:01:30 +08:00
Shengliang Guan
f2f8cb1648 Merge branch '3.0' into merge/mainto3.03 2025-02-19 17:00:41 +08:00
Haojun Liao
7d617a7cde
fix(stream): fix the invalid start task condition
1. Get the basic checkpointId, and wait for 10 s, it's allowed to go.  2. All tasks have the same checkpointId, go immedidately.
2025-02-19 00:39:01 +08:00
Shengliang Guan
b43aaa5f8a Merge branch '3.0' into merge/mainto3.02 2025-02-18 16:48:55 +08:00
Zhixiao Bao
05112546fd
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-18 16:07:47 +08:00
Shengliang Guan
63fc5dea34 Merge branch '3.0' into merge/mainto3.0 2025-02-18 10:29:16 +08:00
xiao-77
d071f40328 Fix review errors. 2025-02-18 09:31:15 +08:00
Jinqing Kuang
fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
dmchen
cc3b883a43 feat/TS-5927-long-password-compatable 2025-02-14 06:04:22 +00:00
dmchen
8f2370f3fa feat/TS-5927-long-password-fix-case 2025-02-14 01:12:09 +00:00
dmchen
55e12e520b feat/TS-5927-long-password-encrypt-pass 2025-02-13 07:45:42 +00:00
Zhixiao Bao
e71c03a90f
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-13 10:17:58 +08:00
dongming chen
2fd8792c7a
Merge branch '3.0' into feat/TS-5927-long-password 2025-02-12 15:26:41 +08:00
xiao-77
359399f1cd feat rename some names. 2025-02-12 14:49:59 +08:00
dmchen
b422e2b2f2 feat/TS-5805-force-assign-leader-msg-type 2025-02-12 06:29:24 +00:00
dongming chen
0350f46ba4
Merge pull request #29756 from taosdata/3.0
3.0
2025-02-12 14:00:02 +08:00
Shengliang Guan
67b678f9f0
Merge pull request #29746 from taosdata/merge/mainto3.02
merge: from main to 3.0 branch
2025-02-12 13:57:36 +08:00
dmchen
d128c3927d fix/TS-5805-check-arb-fix-comment 2025-02-12 02:04:13 +00:00
xiao-77
bdcec392b4 Merge remote-tracking branch 'origin/3.0' into feat/3.0/TS-5584 2025-02-12 09:56:23 +08:00
xiao-77
a1a3f83283 Add unapplied to show vnodes. 2025-02-12 09:55:36 +08:00
xiao-77
b62d8d37b1 Feat(sync):Use remaining time to replace progress. 2025-02-11 15:51:05 +08:00
Shengliang Guan
cd52401303 Merge branch 'main' into merge/mainto3.02 2025-02-11 15:15:35 +08:00
dmchen
635b4a5cb1 fix/TS-5805-check-arb-trans-compatable 2025-02-11 02:56:12 +00:00
Haojun Liao
267f7d3b08 refactor(stream): limit the maximum number of consensus checkpoint trans. 2025-02-11 10:31:11 +08:00
Haojun Liao
d08a81cc98 fix(stream): fix bug in limiting concurrent checkpoints 2025-02-10 19:24:37 +08:00
Haojun Liao
6c7a8e9774 refactor(stream): allow ready stream to start checkpoint procedure. 2025-02-10 19:24:36 +08:00
Shengliang Guan
dae17cd1b0
Merge pull request #29718 from taosdata/enh/streamqueue
refactor(stream): notify close stream in main thread
2025-02-10 18:44:27 +08:00
xiao-77
fbe65197d6 Feat(sync):Add restore progress to the "show vnodes" command, and add the applied index to the "show vgroups" command. 2025-02-10 15:58:25 +08:00
dmchen
b1dc31a2bd fix/TS-5805-check-arb-add-column 2025-02-10 06:57:50 +00:00
dmchen
946a0c1bb5 fix/TS-5805-check-arb-remve-useless-code 2025-02-10 02:58:42 +00:00
dongming chen
240a8b5d5b
Merge pull request #29723 from taosdata/3.0
3.0
2025-02-10 09:56:12 +08:00
Haojun Liao
ec954bf408 refactor(stream): record the dropped stream. 2025-02-09 21:13:10 +08:00
xiao-77
adfab1f2b6 Fix some review errors. 2025-02-08 18:51:39 +08:00
xiao-77
4011d01148 Fix some review errors. 2025-02-08 17:42:48 +08:00
xiao-77
7707e5d8dd Fix some review errors. 2025-02-08 17:37:15 +08:00
xiao-77
a2f11f21c9 Fix review problems. 2025-02-08 17:07:55 +08:00
xiao-77
72f228fa97 Fix build errors. 2025-02-07 18:52:54 +08:00
xiao-77
2cbb7a7814 Fix sdb config compare errors. 2025-02-07 18:49:00 +08:00
Shengliang Guan
a004d95996 Merge branch '3.0' into merge/mainto3.02 2025-02-06 13:46:36 +08:00
factosea
fbe345a82e fix: cols funcs, sub query 2025-02-05 15:26:03 +08:00
dmchen
2b4d4162a7 feat/TS-5805-force-set-assign 2025-01-24 08:50:04 +00:00
Haojun Liao
2f6977dfda Merge branch 'main' into enh/analysis 2025-01-23 18:55:32 +08:00
dmchen
d9401fd75d feat/TS-5805-add-sql-command 2025-01-23 09:37:07 +00:00
dmchen
3c5b8037e3 feat/TS-5927-long-password 2025-01-23 08:46:29 +00:00
Haojun Liao
55ca679571 fix(analysis): fix compiling error on windows. 2025-01-23 09:06:55 +08:00
Haojun Liao
989c20078a refactor: do some internal refactor. 2025-01-23 00:32:46 +08:00
Haojun Liao
883b1b79a2 enh(analysis): add the algorithm in telemetry report. 2025-01-23 00:29:18 +08:00
Haojun Liao
d6dc966ed1 fix(analysis): fix compiler error on windows. 2025-01-22 15:12:43 +08:00
Haojun Liao
9f2c448e36 fix(stream): fix error in check node update trans. 2025-01-22 14:05:40 +08:00
Haojun Liao
30358f1297 fix(stream): fix error in check node update trans. 2025-01-22 12:52:30 +08:00
Haojun Liao
84580286ce enh(analysis): enable community edition to support anodes. 2025-01-22 11:11:06 +08:00
Haojun Liao
2f065062c3 fix(stream): adjust position of checking trans. 2025-01-21 19:04:14 +08:00
Haojun Liao
88a94919c4 fix(stream): check for nodeupdate trans before create streams. 2025-01-21 18:41:52 +08:00
Jinqing Kuang
eb5d463490 feat(stream)[TS-5469]. add support for window event notifications in stream processing
- Introduce new syntax to specify notification type and destination address
- Collect relevant event information during window computations
- Implement websocket-based notification delivery to the specified address
2025-01-21 17:39:46 +08:00
Haojun Liao
0ea46585f4 fix(stream): update checkpoint-info after check the failed checkpointId, and update the consensus-checkpoint id in mnode. 2025-01-21 16:29:00 +08:00
Haojun Liao
df6ec3afc2 fix(stream): check null ptr. 2025-01-21 11:21:53 +08:00
Haojun Liao
08092aeb0c fix(stream): not clear task list if check failed, and add more checks. 2025-01-21 10:27:39 +08:00
Haojun Liao
7900c725d5 fix(stream): fix syntax error. 2025-01-21 09:15:27 +08:00
Haojun Liao
efd33aa4d7 fix(stream): check the checkpoint-report transId and checkpointId, and identify the expired checkpoint-report info. 2025-01-21 01:25:53 +08:00
Shengliang Guan
e48b48f93c Merge branch 'main' into merge/mainto3.0 2025-01-10 12:07:40 +08:00
Hongze Cheng
74c7420c1d
Merge pull request #29527 from taosdata/fix/main/TD-33457
Test(cfg): add alter config to compatibility.py and fix some memory leak.
2025-01-09 17:22:07 +08:00
Shengliang Guan
c62e189496 Merge branch 'main' into merge/mainto3.0 2025-01-09 13:38:37 +08:00
xiao-77
c3e025713b Rename some vars. 2025-01-09 13:38:20 +08:00
xiao-77
c1732ba41d Fix asan problems at ci test. 2025-01-09 13:36:23 +08:00
Shengliang Guan
081c902c64
Merge pull request #29520 from taosdata/fix/TD-32471-main
fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL
2025-01-09 13:33:48 +08:00
xiao-77
9eb1239783 Fix mem leak. 2025-01-09 10:50:23 +08:00
Shengliang Guan
fe4555f060
Merge pull request #29517 from taosdata/fix/tag
fix(stream): check the stream task last ready timestamp before start the checkpoint procedure.
2025-01-08 18:29:55 +08:00
wangmm0220
ba9892bae0 fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL 2025-01-08 16:50:38 +08:00
xiao-77
742e3251b7 Remove unused rpcRsp. 2025-01-08 15:51:58 +08:00
xiao-77
4a5d575894 Fix unhandle msg. 2025-01-08 15:45:58 +08:00
Haojun Liao
130ad28d2c fix(stream): check stream task status before start checkpoint. 2025-01-08 15:31:15 +08:00
xiao-77
430e62aab6 Fix double free. 2025-01-08 14:55:37 +08:00
xiao-77
b46bd98f6d Fix mem leak. 2025-01-08 09:29:46 +08:00
xiao-77
e597baa345 Fix mnode = 3 , trans stuck. 2025-01-07 22:01:33 +08:00
xiao-77
77359f26b3 Fix(cfg): resolve dynamic configuration update failure after rolling upgrade to 3.3.5.0 2025-01-07 15:26:01 +08:00
Shengliang Guan
fcca5e7c2e
Merge pull request #29381 from taosdata/fix/liaohj
test: add test cases and fix related bugs.
2024-12-31 11:10:34 +08:00
Haojun Liao
f03e2305e0 fix(stream): add logs and set the reset-stream rsp. 2024-12-30 14:26:20 +08:00
kailixu
b0fa490dd6 test: add test case for auto compact 2024-12-29 15:13:38 +08:00
kailixu
458a72c66a test: add test case for auto compact 2024-12-29 13:45:59 +08:00
kailixu
f529339fb8 test: add test case for auto compact 2024-12-29 13:26:40 +08:00
kailixu
7b69c29c9e test: add test case for auto compact 2024-12-29 12:49:03 +08:00
kailixu
104f37337f test: add test case for auto compact 2024-12-29 12:24:15 +08:00
kailixu
5f3e8ef5aa test: add test case for auto compact 2024-12-28 15:35:12 +08:00
kailixu
bf33ef0c07 test: add test case for auto compact 2024-12-27 18:57:12 +08:00
kailixu
fcd436830f test: add test case for auto compact 2024-12-27 18:54:22 +08:00
kailixu
78018b3a16 test: add test case for auto compact 2024-12-27 17:05:09 +08:00
54liuyao
0bf9fb1e31 add reset stream 2024-12-27 15:11:19 +08:00
dmchen
1aec478c45 fix/TS-5805-check-arb 2024-12-26 03:06:33 +00:00
dmchen
1bc47199be fix/TS-5805-check-arb 2024-12-25 02:43:51 +00:00
dmchen
d3ab816838 fix/TS-5805-check-arb-updatetime 2024-12-25 02:10:21 +00:00
dmchen
0da606c7fb show code 2024-12-24 12:14:47 +00:00
dongming chen
c6f3ac65dc
Merge branch '3.0' into enh/TD-29974-improve-trans 2024-12-24 19:15:27 +08:00
Hongze Cheng
91a9bc30e2
Merge pull request #29228 from taosdata/fix/TD-33284-compact-coverage
Fix/td 33284 compact coverage
2024-12-24 19:01:42 +08:00
dmchen
150dd5af3f fix/TS-5805-check-arb 2024-12-24 10:50:56 +00:00
dongming chen
48b24804d4
Merge pull request #29275 from taosdata/3.0
3.0
2024-12-23 13:53:16 +08:00
Shengliang Guan
e2011c9ffb Merge branch '3.0' into merge/mainto3.0 2024-12-20 17:58:11 +08:00
Shengliang Guan
b6b14f7a1a
Merge pull request #29236 from taosdata/fix/contrib
enh: skip password check if create user with is_import options
2024-12-20 15:12:51 +08:00
dmchen
9715bb59fe fix/TD-33294-compact-coverage-fix-case 2024-12-20 11:33:26 +08:00
Shengliang Guan
2dda013646 enh: skil password check if create user with is_import 2024-12-20 10:13:53 +08:00
Shengliang Guan
ab58fdd6da
Merge pull request #29213 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2024-12-19 11:15:30 +08:00
Shengliang Guan
3040260bfe
Merge pull request #29181 from taosdata/fix/TD-33225-main
fix:[TD-33225]remove the limitation when creating index or modifing col…
2024-12-18 21:07:03 +08:00
wangmm0220
c7615868b0 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-32166 2024-12-18 17:37:02 +08:00
wangmm0220
c2baa7e177 fix:ci error 2024-12-18 17:36:06 +08:00
dongming chen
69980ac5a8
Merge pull request #29194 from taosdata/3.0
3.0
2024-12-18 08:33:58 +08:00
dmchen
6f124e7b23 enh/TD-29974-improve-trans-fix-case 2024-12-17 10:36:12 +00:00
54liuyao
e6ac454303 Merge branch 'main' of https://github.com/taosdata/TDengine 2024-12-17 18:02:36 +08:00
54liuyao
63a6428e34 fix(stream):adjust status of ins_streams 2024-12-17 17:59:53 +08:00
Shengliang Guan
cdfd618157
Merge pull request #29107 from taosdata/fix/liaohj
fix(stream): record the failure of dispatch msg, and set the update nodeId
2024-12-17 17:41:45 +08:00
Shengliang Guan
40e246059e
Merge pull request #29178 from taosdata/fix/main/TD-33227
Fix(cfg):can not restart taosd  cause cfg trans exec failed.
2024-12-17 15:25:10 +08:00
wangmm0220
5972054c2d fix:[TD-33225]remove the limition when creating index or modifing column compression if there is a topic/stream/tsma 2024-12-17 14:33:44 +08:00
dmchen
134d593458 enh/TD-29974-improve-trans-fix-case 2024-12-17 14:23:44 +08:00
dmchen
26507e6faa enh/TD-29974-improve-trans-fix-case 2024-12-17 11:32:38 +08:00
xiao-77
474113da4e Move rebuild config sdb to after restored. 2024-12-17 11:22:38 +08:00
dmchen
4b6eec21f4 enh/TD-29974-improve-trans-fix-case 2024-12-17 09:54:54 +08:00
xiao-77
6eb183a032 Fix(cfg):only write sdb on leader. 2024-12-17 09:50:18 +08:00
Haojun Liao
d2146a2efb other: merge main 2024-12-17 09:23:13 +08:00
yihaoDeng
10f2094bd4 Merge remote-tracking branch 'origin/main' into enh/TD-32951 2024-12-17 08:33:43 +08:00
yihaoDeng
638b0ab7f0 Merge remote-tracking branch 'origin/main' into enh/TD-32951 2024-12-16 21:41:53 +08:00
Shengliang Guan
4c1499ebeb
Merge pull request #29122 from taosdata/enh/3.0/TD-31709
Replace unsafe memory functions with safe versions in wal&sync&mnode.
2024-12-16 21:37:33 +08:00
dmchen
ce86b1d687 change show transtion detial timestamp 2024-12-16 16:30:09 +08:00
xiao-77
8a2ae888cc fix ci errors. 2024-12-16 15:41:19 +08:00
xiao-77
9d733c03b4 Fix merge errors. 2024-12-16 14:13:23 +08:00
Haojun Liao
779c1bd8ad refactor(stream): inject the reject dispatch error in stream to test the effect of fix. 2024-12-16 13:53:13 +08:00
xiao-77
b4afa6ff90 Fix merge errors. 2024-12-16 13:44:58 +08:00
Hongze Cheng
1ca396f6d0
Merge pull request #29149 from taosdata/feat/TS-4994-3.0
fix: compile problem of community
2024-12-16 13:24:03 +08:00
Shengliang Guan
3311e71cd9
Merge pull request #29152 from taosdata/main
merge: from main to 3.0 branch
2024-12-16 11:27:02 +08:00
kailixu
2fa755d49c fix: compile problem of community 2024-12-16 10:49:58 +08:00
dongming chen
20cc54aaaa
Merge branch 'enh/TD-29974-improve-trans' into dmchen/trans-improve 2024-12-16 10:34:11 +08:00
xiao-77
c4ed102c11 Merge branch '3.0' into enh/3.0/TD-31709 2024-12-16 10:00:02 +08:00
Shengliang Guan
6b49eededd
Merge pull request #29105 from taosdata/fix/3_liaohj
enh: update the mnode epset in stream hb rsp.
2024-12-16 09:23:38 +08:00
Shengliang Guan
5461502ed1
Merge pull request #29106 from taosdata/fix/init_meta
refactor(stream): check mnode when issue the nodeEp update trans.
2024-12-16 09:23:18 +08:00
yihaoDeng
d586026e25 telemetry refactor 2024-12-15 18:01:21 +08:00
yihaoDeng
0922b28123 update test case 2024-12-15 12:16:24 +08:00
Shengliang Guan
e8fcf16b89
Merge pull request #29138 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2024-12-15 12:08:55 +08:00
Hongze Cheng
37c1be4818 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-12-14 23:51:25 +08:00
yihaoDeng
cd4f92ebf2 telemetry refactor 2024-12-14 21:27:37 +08:00
Shengliang Guan
ea96f51ba2 Merge branch '3.0' into merge/mainto3.0 2024-12-14 18:24:39 +08:00