Commit graph

77 commits

Author SHA1 Message Date
dapan1121
d5d42e5b97 fix: task list issues 2025-06-16 11:43:51 +08:00
dapan1121
270e383229 enh: add mnode error handling 2025-05-23 18:14:34 +08:00
dapan1121
2dadaf6f52 fix: add stream addr 2025-04-29 19:22:55 +08:00
dapan1121
b07fafa27f fix: stream hb rsp length issue 2025-04-29 11:02:56 +08:00
dapan1121
706d297232 fix: msg encode issues 2025-04-29 08:38:03 +08:00
dapan1121
cc025dbd59 enh: add task plan update 2025-04-25 14:59:41 +08:00
dapan1121
330cf9982d fix: compile issues 2025-04-24 09:11:54 +08:00
dapan1121
ae0e1ded7d enh: add hb processing 2025-04-22 17:46:17 +08:00
dapan1121
21e5aae05c enh: add stream hb processing 2025-04-19 18:58:51 +08:00
dapan1121
279595240e enh: add deploy processing 2025-04-18 19:28:43 +08:00
dapan1121
b5b9ba0faa enh: add mnode processing 2025-04-14 13:20:57 +08:00
dapan1121
675790a63c fix: remove codes 2025-04-10 09:09:30 +08:00
Haojun Liao
ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
xiao-77
c4ed102c11 Merge branch '3.0' into enh/3.0/TD-31709 2024-12-16 10:00:02 +08:00
xiao-77
c66a834d1e Replace unsafe memory functions with safe versions in wal&sync. 2024-12-13 15:19:29 +08:00
Haojun Liao
cfcb85ef94 refactor(stream): update mnode epset in hb. 2024-12-11 17:25:01 +08:00
Haojun Liao
f65651f6ef fix(stream): update the msg encoder. 2024-11-15 00:19:35 +08:00
Haojun Liao
b88a786fdf fix(stream): set correct error code and open inputq for upstream . 2024-11-14 17:42:49 +08:00
Haojun Liao
187997d5f0 fix(stream): record the failed checkpointId, after receive reset task info. 2024-11-14 17:40:37 +08:00
Haojun Liao
b2b5a14d9d fix(stream): reset task add the failed chkptId info. 2024-11-14 17:38:40 +08:00
Haojun Liao
0335799e1c refactor: remove void. 2024-09-12 21:48:54 +08:00
lyh250-666
726b133721 modify error code passing 2024-09-12 07:46:30 +00:00
Haojun Liao
a29903101a refactor: remove void and do some internal refactor. 2024-09-09 14:49:05 +08:00
Haojun Liao
979c6e20e6 fix(stream):set the code to be in_progress and do some internal refactor. 2024-09-09 11:12:30 +08:00
Haojun Liao
f4bac23906 refactor: do some internal refactor 2024-08-17 01:47:30 +08:00
Haojun Liao
dfa74f82d7 fix(stream): avoid repeat send checkpoint-report msg. 2024-08-09 00:40:05 +08:00
Haojun Liao
aefb9d275e fix(stream): add ts in HbMsg. 2024-08-01 15:22:37 +08:00
Haojun Liao
6ba428fbf8 other: merge 3.0. 2024-08-01 11:15:49 +08:00
Haojun Liao
52b3e1be6f fix(stream): drop orphan tasks/reset task in trans done by write-queue. 2024-07-31 14:08:22 +08:00
Haojun Liao
0bb263076e fix(stream): check return value 2024-07-30 10:13:02 +08:00
Haojun Liao
ad96333336 fix(stream): discard the processed hbmsg in the mnode. 2024-07-23 17:16:40 +08:00
Haojun Liao
7497f193c7 fix(stream): check return value, and do some internal refactor. 2024-07-23 14:47:29 +08:00
Haojun Liao
be162fb62f fix(stream): check return value. 2024-07-22 13:31:57 +08:00
Haojun Liao
ebe1d09d74 fix(stream): check return value. 2024-07-22 10:07:18 +08:00
Haojun Liao
cb42806148 fix(stream): update some logs. 2024-07-12 13:31:39 +08:00
Haojun Liao
6e15c16cf7 fix(stream): check the set consensus-checkpointId ts. 2024-07-08 14:33:28 +08:00
Haojun Liao
ce4153b6fc fix(stream): use hb to send the consens-checkpointid req. 2024-07-08 09:05:33 +08:00
Haojun Liao
e00e83b398 fix(stream):update some logs. 2024-07-01 13:37:40 +08:00
Haojun Liao
8144df956a fix(stream): validate the stream hb msg, and discard the invalid hb msg. 2024-07-01 13:36:06 +08:00
Haojun Liao
48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Haojun Liao
a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
Hongze Cheng
b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao
0245d82e54 fix(stream): make sure that the unit test case can work. 2024-06-11 14:26:29 +08:00
Haojun Liao
00eb621825 fix(stream): do scan checkpoint-report in write queue. 2024-06-11 14:09:50 +08:00
Haojun Liao
cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao
d0675a660e fix(stream): init the node list and task list when starting mnode. 2024-06-07 17:53:53 +08:00
Haojun Liao
1e47cb7eba other: update the test case. 2024-06-07 11:15:23 +08:00
Haojun Liao
34205ba62c refactor: do some internal refactor. 2024-06-07 10:09:40 +08:00
Haojun Liao
88e77d6bc6 fix(stream): remove expired stream in buf. 2024-06-06 23:54:48 +08:00
Haojun Liao
29648be30d fix(stream): add the new node info when adding stream tasks. 2024-06-04 23:28:08 +08:00