Commit graph

16884 commits

Author SHA1 Message Date
Haojun Liao
a2dcba10a7 refactor(stream): 1) notify closing in main thread. 2) not saving the halt status. 2025-02-09 01:42:24 +08:00
xiao-77
adfab1f2b6 Fix some review errors. 2025-02-08 18:51:39 +08:00
xiao-77
4011d01148 Fix some review errors. 2025-02-08 17:42:48 +08:00
xiao-77
7707e5d8dd Fix some review errors. 2025-02-08 17:37:15 +08:00
Jinqing Kuang
d32cf8bcb8 fix(query)[TS-5984]. correct data block filtering logic in tsdbReader
When scanning a table with a primary key, tsdbReader could load
irrelevant data blocks outside the query time range, causing errors
when returning results.

This fix improves filtering logic to ensure only valid blocks are
read and adds test verification.
2025-02-08 17:32:25 +08:00
xiao-77
a2f11f21c9 Fix review problems. 2025-02-08 17:07:55 +08:00
xiao-77
72f228fa97 Fix build errors. 2025-02-07 18:52:54 +08:00
xiao-77
2cbb7a7814 Fix sdb config compare errors. 2025-02-07 18:49:00 +08:00
Haojun Liao
68faa300af fix(stream): fix memory leak. 2025-02-07 11:11:22 +08:00
Haojun Liao
a5cdf3320c refactor(stream): handle stream check in ctrl queue. 2025-02-05 15:03:30 +08:00
Haojun Liao
0f04f47337 refactor(stream): dispatch req handled in ctrl queue. 2025-02-05 15:03:24 +08:00
Haojun Liao
fa2229c453 refactor(stream): dispatch rsp handled in ctrl queue. 2025-02-05 15:03:10 +08:00
Haojun Liao
5e130c4d53 enh(stream): add ctrl queue to handle hb rsp, to avoid hb rsp not being confirmed if all stream threads are occupied. 2025-02-05 14:57:15 +08:00
Haojun Liao
79284e7414 Merge branch 'main' into fix/disp_lost 2025-01-24 17:15:22 +08:00
Haojun Liao
093233203d
Revert "refactor(stream): do some internal refactor ." 2025-01-24 17:11:15 +08:00
Shengliang Guan
3089e3d904
Merge pull request #29544 from taosdata/fix/tag
refactor(stream): do some internal refactor .
2025-01-24 16:27:22 +08:00
Linhe Huo
bc0570f9ad
Merge pull request #29632 from taosdata/enh/analysis
enh(analysis): enable community edition to support anodes.
2025-01-24 15:33:16 +08:00
Pan Wei
d6633a27ac
Merge pull request #29651 from taosdata/fix/addMetaDebugLog.m
fix: add table meta validation error and debug log
2025-01-24 09:54:36 +08:00
Haojun Liao
2f6977dfda Merge branch 'main' into enh/analysis 2025-01-23 18:55:32 +08:00
dapan1121
bd450fe751 fix: add meta debug log 2025-01-23 16:12:54 +08:00
Haojun Liao
963e397984 fix(stream): update logs. 2025-01-23 14:45:47 +08:00
Hongze Cheng
3405a007bd enh: accelerate tsdb snapshot when data are all in stt file 2025-01-23 14:23:54 +08:00
Haojun Liao
6cc3b5da0e fix(stream): add upper bound for the time of waiting for creating table. 2025-01-23 13:37:41 +08:00
Haojun Liao
6c4dc665e0 fix(stream): wait for queue to be empty. 2025-01-23 13:37:06 +08:00
Haojun Liao
e5e57923cd fix(stream): add upper bound for the time of waiting for creating table. 2025-01-23 13:18:56 +08:00
Shengliang Guan
f6f08fa846
Merge pull request #29615 from taosdata/fix/disp_lost
fix(stream): check the checkpoint-report transId and checkpointId
2025-01-23 09:47:36 +08:00
Haojun Liao
55ca679571 fix(analysis): fix compiling error on windows. 2025-01-23 09:06:55 +08:00
Haojun Liao
989c20078a refactor: do some internal refactor. 2025-01-23 00:32:46 +08:00
Haojun Liao
883b1b79a2 enh(analysis): add the algorithm in telemetry report. 2025-01-23 00:29:18 +08:00
Shengliang Guan
3bbecbbba4
Merge pull request #29626 from taosdata/fix/TS-5932
fix: invalid subtable in tbname list
2025-01-22 17:24:03 +08:00
Haojun Liao
d6dc966ed1 fix(analysis): fix compiler error on windows. 2025-01-22 15:12:43 +08:00
Haojun Liao
9f2c448e36 fix(stream): fix error in check node update trans. 2025-01-22 14:05:40 +08:00
Haojun Liao
30358f1297 fix(stream): fix error in check node update trans. 2025-01-22 12:52:30 +08:00
Haojun Liao
84580286ce enh(analysis): enable community edition to support anodes. 2025-01-22 11:11:06 +08:00
Haojun Liao
2f065062c3 fix(stream): adjust position of checking trans. 2025-01-21 19:04:14 +08:00
Haojun Liao
88a94919c4 fix(stream): check for nodeupdate trans before create streams. 2025-01-21 18:41:52 +08:00
dapan1121
89cea7859a fix: invalid subtable in tbname in clause issue 2025-01-21 17:41:37 +08:00
Haojun Liao
0ea46585f4 fix(stream): update checkpoint-info after check the failed checkpointId, and update the consensus-checkpoint id in mnode. 2025-01-21 16:29:00 +08:00
xiao-77
a4e88660db fix(rpc):use tsApplyMemoryAllowed to control memory alloc while apply msg. 2025-01-21 11:33:08 +08:00
Haojun Liao
df6ec3afc2 fix(stream): check null ptr. 2025-01-21 11:21:53 +08:00
Haojun Liao
08092aeb0c fix(stream): not clear task list if check failed, and add more checks. 2025-01-21 10:27:39 +08:00
Haojun Liao
7900c725d5 fix(stream): fix syntax error. 2025-01-21 09:15:27 +08:00
Haojun Liao
efd33aa4d7 fix(stream): check the checkpoint-report transId and checkpointId, and identify the expired checkpoint-report info. 2025-01-21 01:25:53 +08:00
Haojun Liao
84eaed0bbb fix(stream): fix invalid read. 2025-01-19 00:13:58 +08:00
Haojun Liao
b4a6523aa6 fix(stream): fix invalid read. 2025-01-18 01:35:24 +08:00
Haojun Liao
c93fe999ba refactor(stream): injection error. 2025-01-18 01:26:49 +08:00
Haojun Liao
6274eea7c4 fix(stream): adjust the free stream meta position and check the close flag of streamMeta before starting scan wal. 2025-01-17 19:15:08 +08:00
Haojun Liao
05a27eb7b0 fix(stream): fix memory leak. 2025-01-12 01:50:54 +08:00
Shengliang Guan
ad6e9c46d8
Merge pull request #29534 from taosdata/fix/TD-31605/crashLogMain
fix: ts31605, write crash log
2025-01-10 11:22:59 +08:00
factosea
bd9ec86061 crash log: safe code 2025-01-10 06:10:20 +08:00
Haojun Liao
3223cc0287 other: add todo 2025-01-09 18:37:05 +08:00
Hongze Cheng
74c7420c1d
Merge pull request #29527 from taosdata/fix/main/TD-33457
Test(cfg): add alter config to compatibility.py and fix some memory leak.
2025-01-09 17:22:07 +08:00
xiao-77
c3e025713b Rename some vars. 2025-01-09 13:38:20 +08:00
xiao-77
c1732ba41d Fix asan problems at ci test. 2025-01-09 13:36:23 +08:00
Shengliang Guan
081c902c64
Merge pull request #29520 from taosdata/fix/TD-32471-main
fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL
2025-01-09 13:33:48 +08:00
Hongze Cheng
dbfb910bff
Merge pull request #29522 from taosdata/fix/TS-5853-main
enh: add strict message check for submit message
2025-01-09 13:18:38 +08:00
factosea
5c60015cad fix: write crash log in new thread 2025-01-09 12:37:25 +08:00
Hongze Cheng
c2528b8535 more code 2025-01-09 11:11:19 +08:00
xiao-77
9eb1239783 Fix mem leak. 2025-01-09 10:50:23 +08:00
Haojun Liao
30039bb53b enh(stream): add ctrl queue to handle hb rsp, to avoid hb rsp not being confirmed if all stream threads are occupied. 2025-01-09 09:17:08 +08:00
Shengliang Guan
fe4555f060
Merge pull request #29517 from taosdata/fix/tag
fix(stream): check the stream task last ready timestamp before start the checkpoint procedure.
2025-01-08 18:29:55 +08:00
Hongze Cheng
a881103c86 more code 2025-01-08 18:13:10 +08:00
Shengliang Guan
37eb686d7c
Merge pull request #29502 from taosdata/fix/main/TD-33457
Fix(cfg): resolve dynamic configuration update failure after rolling …
2025-01-08 17:31:13 +08:00
Hongze Cheng
00b0a46060 enh: add strict message check for submit message 2025-01-08 17:29:32 +08:00
wangmm0220
ba9892bae0 fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL 2025-01-08 16:50:38 +08:00
xiao-77
742e3251b7 Remove unused rpcRsp. 2025-01-08 15:51:58 +08:00
xiao-77
4a5d575894 Fix unhandle msg. 2025-01-08 15:45:58 +08:00
Haojun Liao
130ad28d2c fix(stream): check stream task status before start checkpoint. 2025-01-08 15:31:15 +08:00
xiao-77
430e62aab6 Fix double free. 2025-01-08 14:55:37 +08:00
xiao-77
b46bd98f6d Fix mem leak. 2025-01-08 09:29:46 +08:00
xiao-77
e597baa345 Fix mnode = 3 , trans stuck. 2025-01-07 22:01:33 +08:00
xiao-77
77359f26b3 Fix(cfg): resolve dynamic configuration update failure after rolling upgrade to 3.3.5.0 2025-01-07 15:26:01 +08:00
Hongze Cheng
bb01c4d763 fix: compile issue 2025-01-07 15:13:26 +08:00
Hongze Cheng
4587beb849 fix: meta entry snapshot problem for old version 2025-01-07 14:09:29 +08:00
Shengliang Guan
ee89a84ff2
Merge pull request #29449 from taosdata/fix/TS-5651-skip-sync-heartbeat-main
fix:[TS-5651]skip-sync-heartbeat
2025-01-06 13:44:54 +08:00
Shengliang Guan
b81ade633f
Merge pull request #29478 from taosdata/fix/TD-33440-3.0m
fix: eliminate duplicated read locks in one thread
2025-01-06 13:34:19 +08:00
kailixu
c69215576d fix: eliminate duplicated read locks in one thread 2025-01-03 19:00:06 +08:00
Hongze Cheng
55a27061da fix: possible snapshot.py fail 2025-01-03 15:51:59 +08:00
Shengliang Guan
0bbbab1bfa
Merge pull request #29447 from taosdata/fix/tag
fix(stream): fix dead-lock caused by invalid repeatly unlock.
2025-01-02 14:02:35 +08:00
dmchen
ad4bf2a136 fix/TS-5651-skip-sync-heartbeat 2025-01-02 02:17:29 +00:00
Haojun Liao
055441d8fb fix(stream): fix dead-lock caused by invalid repeatly unlock. 2025-01-02 09:55:05 +08:00
wangmm0220
85aad90d3a fix:[TD-33396]add log for tmq 2024-12-31 11:22:56 +08:00
wangmm0220
b63787aa09 fix:[TD-33396]add log for tmq 2024-12-30 17:23:11 +08:00
Shengliang Guan
e53600fee2
Merge pull request #29380 from taosdata/fix/tag
fix(stream): check if the altered tag value table
2024-12-29 22:16:11 +08:00
Shengliang Guan
0312435deb
Merge pull request #29390 from taosdata/enh/TS-4994-more-test-case
Enh/ts 4994 more test case
2024-12-29 22:14:40 +08:00
kailixu
b0fa490dd6 test: add test case for auto compact 2024-12-29 15:13:38 +08:00
Haojun Liao
a73ad9642a fix(stream): check if the altered tag value table should be added into stream/tq scan table list. 2024-12-28 21:25:40 +08:00
Shengliang Guan
ec2c8c435e
Revert "Enh:[td 29974]improve trans" 2024-12-27 22:26:43 +08:00
Hongze Cheng
a72c46a7fc more cases 2024-12-27 17:44:05 +08:00
Shengliang Guan
912fcb13bf
Merge pull request #29351 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2024-12-27 09:06:35 +08:00
Hongze Cheng
ed9e3397be
Merge pull request #29347 from taosdata/enh/TS-4994-enh
enh: compact more enh
2024-12-27 08:49:24 +08:00
Shengliang Guan
2bff7a835c
Merge pull request #29165 from taosdata/enh/TD-29974-improve-trans
Enh:[td 29974]improve trans
2024-12-26 22:49:32 +08:00
Hongze Cheng
098ab9f4b4 enh: change some documents 2024-12-26 18:25:23 +08:00
xiao-77
8fd42c034a Fix(cfg):use write thread to update dnode config. 2024-12-26 14:34:38 +08:00
Shengliang Guan
bc17e0aa9a
Merge pull request #29328 from taosdata/fix/TS-5812-main
fix[TS-5812]:add params check
2024-12-26 11:35:06 +08:00
54liuyao
f6500b3551 ci(test):delete invalid code&& add ci 2024-12-26 11:16:02 +08:00
Shengliang Guan
173e6191f3
Merge pull request #29331 from taosdata/fix/fixMetaDeadlock
fix dead lock
2024-12-26 10:04:12 +08:00
yihaoDeng
ae168b2560 fix dead lock 2024-12-25 19:14:52 +08:00
wangmm0220
25dc5d7b5c fix[TS-5812]:add params check 2024-12-25 17:53:34 +08:00
wangmm0220
a95304a857 fix[TS-5812]:add params check 2024-12-25 11:59:48 +08:00