Commit graph

9972 commits

Author SHA1 Message Date
dongming chen
03fe3e5430
fix: [TD-34000] remove lock when send heartbeat reply main (#30123)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix: TD-34000-remove-lock-when-send-heartbeat-reply

* fix: TD-34000-remove-lock-when-send-heartbeat-reply

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 17:13:54 +08:00
Haojun Liao
ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
Yihao Deng
0806cca09e
fix(query): fix ins_usage error on multi storage (#30134)
* fix calc disk usage error

* fix calc disk usage error

* fix calc disk usage error

* fix calc disk usage error

* fix calc disk usage error

* add test case

* add test case

* add test case

* add test case

* add test case

* add test case

* refactor code

* refactor code

* refactor code

* refactor code

* refactor code

* refactor code
2025-03-14 18:11:39 +08:00
Simon Guan
c642f5e6e0
Merge pull request #30033 from taosdata/fix/TS-6078-main
fix(query): change error log to warning when failed to acquire tsdb reader
2025-03-06 17:19:03 +08:00
Jinqing Kuang
7a7aacd6cc fix(query): change error log to warning when failed to acquire tsdb reader
Jira: https://jira.taosdata.com:18080/browse/TS-6066
2025-03-06 14:23:00 +08:00
Haojun Liao
eb0553b737 refactor: do some internal refactor. 2025-03-04 18:45:29 +08:00
Haojun Liao
936f0af929 fix(analytics): check return value. 2025-03-04 17:04:07 +08:00
Haojun Liao
d2d7279f0d fix(stream): fix memory leak if error occurs. 2025-03-01 19:22:26 +08:00
Haojun Liao
c726420081 Merge branch 'main' into fix/droptask 2025-02-28 19:42:35 +08:00
Haojun Liao
e1c4451f81 fix(stream): avoid lock in timer to avoid sync operation blocks. 2025-02-28 17:46:54 +08:00
Haojun Liao
5f6ecab854 fix(stream): check the return values. 2025-02-28 15:05:00 +08:00
Haojun Liao
6e1206bbc1 fix(stream): add some logs. 2025-02-28 13:55:37 +08:00
Haojun Liao
951b469b10 fix(stream): add some logs. 2025-02-28 13:55:24 +08:00
Haojun Liao
14ef25101d fix(stream): adjust log. 2025-02-28 13:55:09 +08:00
Haojun Liao
3e55f8edfe fix(stream): follower nodes not restart tasks. 2025-02-28 13:54:26 +08:00
Haojun Liao
ed03b3a22c fix(stream): try starting task even the inputQ is full. 2025-02-28 13:48:05 +08:00
Simon Guan
24fae6adbb
Merge pull request #29900 from taosdata/fix/checkfh
refactor(stream): scan wal is driven by time, instead of insert events.
2025-02-28 13:42:43 +08:00
Haojun Liao
899d2cef20 fix(stream): not discard stream msg 2025-02-27 00:39:30 +08:00
Haojun Liao
786ee101cd other: merge main. 2025-02-27 00:18:25 +08:00
Haojun Liao
bf1f162aa0 fix(stream): drop task in synch model in write thread. 2025-02-27 00:15:36 +08:00
Haojun Liao
012ee53d35 fix(stream): drop task in synch model in write thread. 2025-02-27 00:15:31 +08:00
Haojun Liao
45b0e47a19 refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution. 2025-02-27 00:15:03 +08:00
Haojun Liao
7319f544c2 refactor(stream): drop task in async ways 2025-02-27 00:14:34 +08:00
Haojun Liao
c14ba08d7c refactor(stream): drop task in async ways 2025-02-27 00:12:11 +08:00
Haojun Liao
514a63ab37 fix(stream): fix the error in check scan interval 2025-02-24 00:40:16 +08:00
Haojun Liao
00edb8e612 fix(stream): adjust init tmr position. 2025-02-23 16:27:18 +08:00
Haojun Liao
e378b5cb8a fix(stream): adjust scan timer 2025-02-23 03:42:44 +08:00
Haojun Liao
034c907ee1 refactor: do some internal refactor. 2025-02-23 01:38:05 +08:00
Haojun Liao
a8d50f28a6 fix(stream): disable error injection. 2025-02-22 14:19:44 +08:00
Haojun Liao
6c92474afd fix(stream): fix syntax error. 2025-02-22 14:16:46 +08:00
Haojun Liao
9bd8b532ad fix(stream): update function return value. 2025-02-22 14:12:38 +08:00
Haojun Liao
b5fdb44193 refactor(stream): remove comments. 2025-02-22 12:35:37 +08:00
Haojun Liao
09b6642e45 refactor(stream): scan wal is driven by time, instead of insert events. 2025-02-22 12:33:32 +08:00
Haojun Liao
2228a9fc33
Merge branch 'main' into fix/checkfh 2025-02-21 11:11:36 +08:00
Haojun Liao
ecc667c22b
Revert "refactor(stream): drop task in async ways" 2025-02-21 01:10:18 +08:00
Haojun Liao
bea8fe42db fix(stream): check status before scan history. 2025-02-20 18:28:19 +08:00
Haojun Liao
66697ee188 fix(stream): check status before scan history. 2025-02-20 18:22:45 +08:00
Shengliang Guan
42bafc0d47
Merge pull request #29848 from taosdata/fix/ly_stream
fix(tsma):drop invalid state for tsma
2025-02-20 15:04:03 +08:00
Shengliang Guan
0a9f5086f0
Merge pull request #29775 from taosdata/fix/analysis
refactor(stream): drop task in async ways
2025-02-20 13:38:53 +08:00
54liuyao
870fe1c071 fix(tsma):drop invalid state for tsma 2025-02-20 11:52:04 +08:00
Shengliang Guan
6dedab4bba
Merge pull request #29784 from taosdata/fix/TS-6017-3.0m
fix: timeseries statistics and test case
2025-02-17 10:25:44 +08:00
Haojun Liao
c4cd6dd62d fix(stream): drop task in synch model in write thread. 2025-02-17 10:06:09 +08:00
Shengliang Guan
596e381e0e
Merge pull request #29779 from taosdata/fix/metanull
fix(stream): access value after null ptr check.
2025-02-17 09:36:09 +08:00
Haojun Liao
465e5eabd7 fix(stream): drop task in synch model in write thread. 2025-02-15 23:20:05 +08:00
Haojun Liao
57a2471cc6 fix(stream): add missing release 2025-02-15 00:03:33 +08:00
Haojun Liao
8848ae61a4 fix(stream): add missing release 2025-02-15 00:00:45 +08:00
Haojun Liao
25cdfa5ee9 refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution. 2025-02-14 18:34:20 +08:00
kailixu
5fa20d8cb3 Merge branch 'main' into fix/TS-6017-3.0m 2025-02-14 17:02:47 +08:00
kailixu
6885b942b1 fix: timeseries statistics and test case 2025-02-14 16:53:32 +08:00
Haojun Liao
73ec4af4a7 Merge branch 'main' into fix/analysis 2025-02-14 15:37:11 +08:00