Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
78026 commits 554 branches 514 tags 1.7 GiB
Commit graph

10595 commits

Author SHA1 Message Date
Hongze Cheng
9a95abd26d more code 2025-02-24 16:32:09 +08:00
wangmm0220
e87541efaa feat:[TD-33798]modify metadata logic for tmq 2025-02-24 16:18:27 +08:00
Hongze Cheng
b01ed3bb80 more code 2025-02-24 15:32:46 +08:00
Hongze Cheng
b048c597dc more code 2025-02-24 14:41:56 +08:00
Hongze Cheng
f8a0dc8fe0 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-24 09:49:31 +08:00
Haojun Liao
514a63ab37 fix(stream): fix the error in check scan interval 2025-02-24 00:40:16 +08:00
Haojun Liao
00edb8e612 fix(stream): adjust init tmr position. 2025-02-23 16:27:18 +08:00
Haojun Liao
787590b6c9 fix(stream): adjust init tmr position. 2025-02-23 16:25:17 +08:00
Haojun Liao
b4de2d16b6 fix(stream): add some logs. 2025-02-23 16:18:49 +08:00
Haojun Liao
f4c3fdedbd fix(stream): add some logs. 2025-02-23 16:18:19 +08:00
Haojun Liao
4ff74ab2ea fix(stream): adjust log. 2025-02-23 15:37:59 +08:00
Haojun Liao
8c0ead7c61 refactor: add some comments. 2025-02-23 11:03:49 +08:00
Haojun Liao
2fdb31a41a fix(stream): adjust scan timer 2025-02-23 10:49:13 +08:00
Haojun Liao
f1c4d2734f fix(stream): follower nodes not restart tasks. 2025-02-23 10:43:56 +08:00
Haojun Liao
e378b5cb8a fix(stream): adjust scan timer 2025-02-23 03:42:44 +08:00
Haojun Liao
9018970135 refactor: do some internal refactor. 2025-02-23 01:39:00 +08:00
Haojun Liao
034c907ee1 refactor: do some internal refactor. 2025-02-23 01:38:05 +08:00
Shengliang Guan
3a739beaa5 Merge branch 'main' into merge/mainto3.0 2025-02-22 20:07:40 +08:00
Haojun Liao
a8d50f28a6 fix(stream): disable error injection. 2025-02-22 14:19:44 +08:00
Haojun Liao
56f1c80018 fix(stream): disable error injection. 2025-02-22 14:18:44 +08:00
Haojun Liao
4d62c60aaf fix(stream): fix syntax error. 2025-02-22 14:17:19 +08:00
Haojun Liao
6c92474afd fix(stream): fix syntax error. 2025-02-22 14:16:46 +08:00
Haojun Liao
a9b5d0fbf0 fix(stream): update function return value. 2025-02-22 14:13:42 +08:00
Haojun Liao
9bd8b532ad fix(stream): update function return value. 2025-02-22 14:12:38 +08:00
Haojun Liao
0ec8e1e202 refactor(stream): remove comments. 2025-02-22 12:38:19 +08:00
Haojun Liao
0f89421b62 refactor(stream): scan wal is driven by time, instead of insert events. 2025-02-22 12:38:03 +08:00
Haojun Liao
b5fdb44193 refactor(stream): remove comments. 2025-02-22 12:35:37 +08:00
Haojun Liao
09b6642e45 refactor(stream): scan wal is driven by time, instead of insert events. 2025-02-22 12:33:32 +08:00
Hongze Cheng
93e17112e1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-21 15:22:22 +08:00
wangmm0220
e594c2bbd5 feat:[TD-33798]modify metadata logic for tmq 2025-02-21 11:49:17 +08:00
Haojun Liao
2228a9fc33
Merge branch 'main' into fix/checkfh 2025-02-21 11:11:36 +08:00
Haojun Liao
ecc667c22b
Revert "refactor(stream): drop task in async ways" 2025-02-21 01:10:18 +08:00
wangmm0220
7b5edade95 fix:[TD-337958]send batch metadata & remove data if subscribe only meta 2025-02-20 19:50:37 +08:00
Haojun Liao
9d5735703b Merge branch 'fix/checkfh' into fix/checkpoint 2025-02-20 18:28:46 +08:00
Haojun Liao
bea8fe42db fix(stream): check status before scan history. 2025-02-20 18:28:19 +08:00
Haojun Liao
66697ee188 fix(stream): check status before scan history. 2025-02-20 18:22:45 +08:00
Shengliang Guan
2bee60a41a Merge branch 'main' into merge/mainto3.0 2025-02-20 18:12:02 +08:00
Hongze Cheng
b980bb35bc more code 2025-02-20 18:08:20 +08:00
Haojun Liao
6766e6db53 refactor(stream): add checkpoint queue to handle chkpt. 2025-02-20 16:13:33 +08:00
Haojun Liao
55f03f2187 fix(stream): try starting task even the inputQ is full. 2025-02-20 16:07:05 +08:00
Shengliang Guan
42bafc0d47
Merge pull request #29848 from taosdata/fix/ly_stream 
fix(tsma):drop invalid state for tsma
 2025-02-20 15:04:03 +08:00
Shengliang Guan
0a9f5086f0
Merge pull request #29775 from taosdata/fix/analysis 
refactor(stream): drop task in async ways
 2025-02-20 13:38:53 +08:00
54liuyao
870fe1c071 fix(tsma):drop invalid state for tsma 2025-02-20 11:52:04 +08:00
Shengliang Guan
f16ae7abe1
Merge pull request #29809 from taosdata/merge/mainto3.0 
merge: from main to 3.0 branch
 2025-02-20 10:27:20 +08:00
Shengliang Guan
4e064b5aec
Merge pull request #29823 from taosdata/feat/TS-5928 
fix:[TS-5928]add consumer parameters
 2025-02-19 19:22:26 +08:00
Shengliang Guan
d13f9448eb
Merge pull request #29730 from taosdata/feat/3.0/TS-5584 
Feat(sync):Add restore progress to the "show vnodes" command, and add…
 2025-02-19 16:30:27 +08:00
wangmm0220
fc3995a10c fix:[TS-5776]add test case 2025-02-19 11:12:13 +08:00
Shengliang Guan
6735e5e948
Merge pull request #29822 from taosdata/kjq/enh-code-clarity 
enh(stream): add options to control message and frame size
 2025-02-18 18:59:28 +08:00
Shengliang Guan
8bee0e7030
Merge pull request #29666 from taosdata/feat/TS-5776 
fix:[TS-5776]add raw type from consumer
 2025-02-18 17:53:52 +08:00
wangmm0220
bdfa67e4a9 fix:[TS-5928]add consumer parameters 2025-02-18 17:32:00 +08:00
Jinqing Kuang
a48095d467 enh(streams): add options to control message and frame size 
Add options to allow users to specify message and frame size limits for
event notifications.
 2025-02-18 17:20:38 +08:00
Zhixiao Bao
05112546fd
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-18 16:07:47 +08:00
wangmm0220
f824a75f4d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-5776 2025-02-18 15:28:10 +08:00
wangmm0220
07e4265dde fix:[TS-5776]error in create table time 2025-02-18 15:21:51 +08:00
Shengliang Guan
92eb6038e2
Merge pull request #29762 from taosdata/feat/TS-5469-3.0 
feat(stream)[TS-5469]: add more stream event notifications
 2025-02-18 15:14:58 +08:00
wangmm0220
9dcac195cb fix:[TS-5776]error in ci 2025-02-18 11:20:42 +08:00
Shengliang Guan
63fc5dea34 Merge branch '3.0' into merge/mainto3.0 2025-02-18 10:29:16 +08:00
wangmm0220
6f2ccfc3b2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-5776 2025-02-17 17:41:25 +08:00
wangmm0220
bf5dc63a30 fix:[TS-5776]add test case 2025-02-17 17:40:54 +08:00
Shengliang Guan
6dedab4bba
Merge pull request #29784 from taosdata/fix/TS-6017-3.0m 
fix: timeseries statistics and test case
 2025-02-17 10:25:44 +08:00
wangmm0220
3da00b7c74 fix:[TS-5776]add raw type from consumer 2025-02-17 10:13:49 +08:00
Haojun Liao
c4cd6dd62d fix(stream): drop task in synch model in write thread. 2025-02-17 10:06:09 +08:00
Shengliang Guan
596e381e0e
Merge pull request #29779 from taosdata/fix/metanull 
fix(stream): access value after null ptr check.
 2025-02-17 09:36:09 +08:00
Jinqing Kuang
fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications 
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
 2025-02-16 11:07:16 +08:00
wangmm0220
47a6836c27 fix:[TS-5776]add raw type from consumer 2025-02-16 00:15:01 +08:00
Haojun Liao
465e5eabd7 fix(stream): drop task in synch model in write thread. 2025-02-15 23:20:05 +08:00
Haojun Liao
0a101fc3c1 fix(stream): add missing release 2025-02-15 00:05:24 +08:00
Haojun Liao
57a2471cc6 fix(stream): add missing release 2025-02-15 00:03:33 +08:00
Haojun Liao
8848ae61a4 fix(stream): add missing release 2025-02-15 00:00:45 +08:00
Haojun Liao
25cdfa5ee9 refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution. 2025-02-14 18:34:20 +08:00
kailixu
5fa20d8cb3 Merge branch 'main' into fix/TS-6017-3.0m 2025-02-14 17:02:47 +08:00
wangmm0220
39f77e45fc fix:[TS-5776]add raw type from consumer 2025-02-14 16:54:53 +08:00
kailixu
6885b942b1 fix: timeseries statistics and test case 2025-02-14 16:53:32 +08:00
wangmm0220
f16f21897e fix:[TS-5776]add raw type from consumer 2025-02-14 16:12:00 +08:00
Haojun Liao
73ec4af4a7 Merge branch 'main' into fix/analysis 2025-02-14 15:37:11 +08:00
wangmm0220
d67de02a31 fix:[TS-5776]add raw type from consumer 2025-02-14 15:09:32 +08:00
Shengliang Guan
d6bd52ece7
Merge pull request #29750 from taosdata/enh/streamqueue 
refactor(stream): add more operation handled in ctrl queue, and limit the stream input q size
 2025-02-14 15:02:23 +08:00
Haojun Liao
03041d0f61 other: merge main 2025-02-14 10:18:19 +08:00
Haojun Liao
43d45e9f9a refactor(stream): drop task in async ways 2025-02-13 23:43:07 +08:00
Haojun Liao
fd96b096ea refactor(stream): drop task in async ways 2025-02-13 23:41:06 +08:00
kailixu
e3aaab405d fix: timeseries statistics and test case 2025-02-13 18:55:28 +08:00
kailixu
61a606a410 fix: timeseries calculation when create table 2025-02-13 14:03:54 +08:00
wangmm0220
daea0ec61a fix:[TS-5776]add raw type from consumer 2025-02-13 13:54:54 +08:00
Zhixiao Bao
e71c03a90f
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-13 10:17:58 +08:00
Shengliang Guan
67b678f9f0
Merge pull request #29746 from taosdata/merge/mainto3.02 
merge: from main to 3.0 branch
 2025-02-12 13:57:36 +08:00
Shengliang Guan
54c8a2be0a
Merge pull request #29310 from taosdata/fix/TS-5805-check-arb 
fix/TS-5805-check-arb
 2025-02-12 13:46:06 +08:00
xiao-77
bdcec392b4 Merge remote-tracking branch 'origin/3.0' into feat/3.0/TS-5584 2025-02-12 09:56:23 +08:00
wangmm0220
878bac1556 fix:[TS-5776]avoid memcpy fo DataRspObj 2025-02-11 18:04:53 +08:00
Shengliang Guan
cd52401303 Merge branch 'main' into merge/mainto3.02 2025-02-11 15:15:35 +08:00
Haojun Liao
81b718ec69 refactor(stream): handle retrieve chkpt trigger in ctrl queue. 2025-02-11 13:07:06 +08:00
Haojun Liao
9ad6fd170b fix(stream): update the process queue. 2025-02-10 19:24:36 +08:00
Shengliang Guan
dae17cd1b0
Merge pull request #29718 from taosdata/enh/streamqueue 
refactor(stream): notify close stream in main thread
 2025-02-10 18:44:27 +08:00
Hongze Cheng
3d081041ba fix: invalid pointer 2025-02-10 18:38:27 +08:00
xiao-77
fbe65197d6 Feat(sync):Add restore progress to the "show vnodes" command, and add the applied index to the "show vgroups" command. 2025-02-10 15:58:25 +08:00
Hongze Cheng
d537b2f8b6 adjust api code 2025-02-10 15:56:23 +08:00
Hongze Cheng
b2bfbebfb1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5794-3.0 2025-02-10 14:29:13 +08:00
dongming chen
240a8b5d5b
Merge pull request #29723 from taosdata/3.0 
3.0
 2025-02-10 09:56:12 +08:00
Haojun Liao
694b6385d5 refactor(stream): adjust reset and mark failed Id. 2025-02-09 21:40:33 +08:00
Haojun Liao
a2dcba10a7 refactor(stream): 1) notify closing in main thread. 2) not saving the halt status. 2025-02-09 01:42:24 +08:00
Jinqing Kuang
d32cf8bcb8 fix(query)[TS-5984]. correct data block filtering logic in tsdbReader 
When scanning a table with a primary key, tsdbReader could load
irrelevant data blocks outside the query time range, causing errors
when returning results.

This fix improves filtering logic to ensure only valid blocks are
read and adds test verification.
 2025-02-08 17:32:25 +08:00
Hongze Cheng
499cf0c294 more code 2025-02-08 14:34:22 +08:00
Hongze Cheng
f2dafd9362 more code 2025-02-08 11:24:45 +08:00
Shengliang Guan
1c8b1520d6 Merge branch 'main' into merge/mainto3.02 2025-02-08 11:12:14 +08:00
Hongze Cheng
708fa269b5 more code 2025-02-08 11:10:17 +08:00
Hongze Cheng
cfb8cdb991 more code 2025-02-07 18:52:53 +08:00
wangmm0220
94b74cc20f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-5776 2025-02-07 18:25:08 +08:00
Shengliang Guan
a004d95996 Merge branch '3.0' into merge/mainto3.02 2025-02-06 13:46:36 +08:00
yihaoDeng
14bc7b03bc feat:add test logic 2025-02-05 18:20:02 +08:00
Haojun Liao
a5cdf3320c refactor(stream): handle stream check in ctrl queue. 2025-02-05 15:03:30 +08:00
Haojun Liao
0f04f47337 refactor(stream): dispatch req handled in ctrl queue. 2025-02-05 15:03:24 +08:00
Haojun Liao
fa2229c453 refactor(stream): dispatch rsp handled in ctrl queue. 2025-02-05 15:03:10 +08:00
Haojun Liao
5e130c4d53 enh(stream): add ctrl queue to handle hb rsp, to avoid hb rsp not being confirmed if all stream threads are occupied. 2025-02-05 14:57:15 +08:00
Shengliang Guan
e1cd2735a6
Merge pull request #29639 from taosdata/feat/3.0/TS-5795 
Enh(tsdb):print fid while data file corrupted.
 2025-02-05 09:41:28 +08:00
Haojun Liao
79284e7414 Merge branch 'main' into fix/disp_lost 2025-01-24 17:15:22 +08:00
Haojun Liao
093233203d
Revert "refactor(stream): do some internal refactor ." 2025-01-24 17:11:15 +08:00
wangmm0220
b5edb79d48 fix:[TS-5776]add raw type from consumer 2025-01-24 16:55:53 +08:00
Shengliang Guan
3089e3d904
Merge pull request #29544 from taosdata/fix/tag 
refactor(stream): do some internal refactor .
 2025-01-24 16:27:22 +08:00
wangmm0220
902d067776 fix:[TS-5776]add raw type from consumer 2025-01-24 14:56:00 +08:00
wangmm0220
7fad4bceb0 fix:[TS-5776]add raw type from consumer 2025-01-24 13:44:56 +08:00
Pan Wei
d6633a27ac
Merge pull request #29651 from taosdata/fix/addMetaDebugLog.m 
fix: add table meta validation error and debug log
 2025-01-24 09:54:36 +08:00
dapan1121
bd450fe751 fix: add meta debug log 2025-01-23 16:12:54 +08:00
Haojun Liao
963e397984 fix(stream): update logs. 2025-01-23 14:45:47 +08:00
Hongze Cheng
3405a007bd enh: accelerate tsdb snapshot when data are all in stt file 2025-01-23 14:23:54 +08:00
Haojun Liao
6cc3b5da0e fix(stream): add upper bound for the time of waiting for creating table. 2025-01-23 13:37:41 +08:00
Haojun Liao
e5e57923cd fix(stream): add upper bound for the time of waiting for creating table. 2025-01-23 13:18:56 +08:00
xiao-77
362aac2de1 Enh(tsdb):print fid while data file corrupted. 2025-01-22 16:46:10 +08:00
wangmm0220
7c5c9f6245 fix:[TS-5776]add raw type from consumer 2025-01-22 16:38:37 +08:00
Shengliang Guan
8c0600649f
Merge pull request #29623 from taosdata/merge/mainto3.0 
merge: from main to 3.0 branch
 2025-01-22 16:36:17 +08:00
dapan1121
89cea7859a fix: invalid subtable in tbname in clause issue 2025-01-21 17:41:37 +08:00
Jinqing Kuang
eb5d463490 feat(stream)[TS-5469]. add support for window event notifications in stream processing 
- Introduce new syntax to specify notification type and destination address
- Collect relevant event information during window computations
- Implement websocket-based notification delivery to the specified address
 2025-01-21 17:39:46 +08:00
Haojun Liao
84eaed0bbb fix(stream): fix invalid read. 2025-01-19 00:13:58 +08:00
Haojun Liao
b4a6523aa6 fix(stream): fix invalid read. 2025-01-18 01:35:24 +08:00
Haojun Liao
c93fe999ba refactor(stream): injection error. 2025-01-18 01:26:49 +08:00
Haojun Liao
6274eea7c4 fix(stream): adjust the free stream meta position and check the close flag of streamMeta before starting scan wal. 2025-01-17 19:15:08 +08:00
Haojun Liao
3223cc0287 other: add todo 2025-01-09 18:37:05 +08:00
Shengliang Guan
081c902c64
Merge pull request #29520 from taosdata/fix/TD-32471-main 
fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL
 2025-01-09 13:33:48 +08:00
Hongze Cheng
dbfb910bff
Merge pull request #29522 from taosdata/fix/TS-5853-main 
enh: add strict message check for submit message
 2025-01-09 13:18:38 +08:00
Hongze Cheng
c2528b8535 more code 2025-01-09 11:11:19 +08:00
Haojun Liao
30039bb53b enh(stream): add ctrl queue to handle hb rsp, to avoid hb rsp not being confirmed if all stream threads are occupied. 2025-01-09 09:17:08 +08:00
Hongze Cheng
a881103c86 more code 2025-01-08 18:13:10 +08:00
Shengliang Guan
37eb686d7c
Merge pull request #29502 from taosdata/fix/main/TD-33457 
Fix(cfg): resolve dynamic configuration update failure after rolling …
 2025-01-08 17:31:13 +08:00
Hongze Cheng
00b0a46060 enh: add strict message check for submit message 2025-01-08 17:29:32 +08:00
wangmm0220
ba9892bae0 fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL 2025-01-08 16:50:38 +08:00
xiao-77
77359f26b3 Fix(cfg): resolve dynamic configuration update failure after rolling upgrade to 3.3.5.0 2025-01-07 15:26:01 +08:00
Hongze Cheng
bb01c4d763 fix: compile issue 2025-01-07 15:13:26 +08:00
Hongze Cheng
4587beb849 fix: meta entry snapshot problem for old version 2025-01-07 14:09:29 +08:00
Shengliang Guan
b81ade633f
Merge pull request #29478 from taosdata/fix/TD-33440-3.0m 
fix: eliminate duplicated read locks in one thread
 2025-01-06 13:34:19 +08:00
kailixu
c69215576d fix: eliminate duplicated read locks in one thread 2025-01-03 19:00:06 +08:00
Hongze Cheng
55a27061da fix: possible snapshot.py fail 2025-01-03 15:51:59 +08:00
Shengliang Guan
0bbbab1bfa
Merge pull request #29447 from taosdata/fix/tag 
fix(stream): fix dead-lock caused by invalid repeatly unlock.
 2025-01-02 14:02:35 +08:00