Commit graph

111 commits

Author SHA1 Message Date
dapan1121
85767a9cbf enh: enhance drop snode 2025-05-17 16:36:35 +08:00
dapan1121
66ab04dc49 enh: add stream and snode assignment 2025-05-17 10:55:32 +08:00
dapan1121
929d923994 enh: add drop snode processing 2025-05-16 14:19:36 +08:00
dapan1121
8ed0f7214e enh: add create snode processing 2025-05-13 14:37:07 +08:00
dapan1121
73d13075b1 enh: add snode failover 2025-05-12 15:19:22 +08:00
dapan1121
ca2241f6ad fix: add snode task redeploy 2025-05-10 17:16:39 +08:00
dapan1121
ee09c9643c Merge remote-tracking branch 'origin/feat/TS-6100-3.0' into feat/TS-6100-3.0.pw5 2025-05-09 11:32:10 +08:00
dapan1121
77a024f96f fix: add cache fetch 2025-05-07 19:16:56 +08:00
dapan1121
404d0da770 fix: plan source addr update issue 2025-05-07 13:43:30 +08:00
dapan1121
9e707f65da enh: add task undeploy processing 2025-05-07 09:48:09 +08:00
dapan1121
7af00e7330 fix: plan clone issue 2025-05-06 18:51:40 +08:00
dapan1121
88599ad4e7 enh: add drop stream processing 2025-05-06 10:27:12 +08:00
dapan1121
2dd6d3eb28 enh: add drop stream processing 2025-04-30 18:39:59 +08:00
dapan1121
2dadaf6f52 fix: add stream addr 2025-04-29 19:22:55 +08:00
dapan1121
2d499c9572 fix: stream queue issue 2025-04-29 15:32:56 +08:00
dapan1121
7f5cd8a70d fix: add stream id 2025-04-29 13:59:53 +08:00
dapan1121
b07fafa27f fix: stream hb rsp length issue 2025-04-29 11:02:56 +08:00
dapan1121
706d297232 fix: msg encode issues 2025-04-29 08:38:03 +08:00
dapan1121
87c8b3f8b7 fix: add stream phase 2025-04-29 08:38:03 +08:00
dapan1121
0c7504944f fix: add hb processing 2025-04-29 08:38:03 +08:00
dapan1121
3793eb2835 enh:add hb msg serilization 2025-04-27 17:53:12 +08:00
dapan1121
cc025dbd59 enh: add task plan update 2025-04-25 14:59:41 +08:00
dapan1121
330cf9982d fix: compile issues 2025-04-24 09:11:54 +08:00
dapan1121
ae0e1ded7d enh: add hb processing 2025-04-22 17:46:17 +08:00
dapan1121
21e5aae05c enh: add stream hb processing 2025-04-19 18:58:51 +08:00
dapan1121
279595240e enh: add deploy processing 2025-04-18 19:28:43 +08:00
dapan1121
38bdafd329 enh: add deploy processing 2025-04-17 10:45:06 +08:00
dapan1121
b5b9ba0faa enh: add mnode processing 2025-04-14 13:20:57 +08:00
dapan1121
45d0af0a63 enh: add create stream 2025-04-10 19:41:37 +08:00
dapan1121
675790a63c fix: remove codes 2025-04-10 09:09:30 +08:00
Haojun Liao
af06bea439
fix(stream): add start/stop message. (#30400) 2025-03-24 19:38:00 +08:00
Haojun Liao
dfe32225de chore: merge main. 2025-03-17 14:51:11 +08:00
Haojun Liao
ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
Haojun Liao
a71f414d97 refactor(stream): stop all tasks before drop vnodes. 2025-03-02 02:06:14 +08:00
Haojun Liao
99d6086c5a enh(stream): kill too long checkpoint trans. 2025-02-20 15:07:24 +08:00
Haojun Liao
3048654484 refactor(stream): kill too long checkpoint trans. 2025-02-20 10:01:30 +08:00
Haojun Liao
88a94919c4 fix(stream): check for nodeupdate trans before create streams. 2025-01-21 18:41:52 +08:00
Haojun Liao
0ea46585f4 fix(stream): update checkpoint-info after check the failed checkpointId, and update the consensus-checkpoint id in mnode. 2025-01-21 16:29:00 +08:00
xiao-77
c66a834d1e Replace unsafe memory functions with safe versions in wal&sync. 2024-12-13 15:19:29 +08:00
Shengliang Guan
84ea0f1ddd Merge branch 'main' into merge/mainto2.0 2024-12-03 15:50:18 +08:00
Haojun Liao
9a9a1828c1 refactor: display the time window for force_window_close. 2024-11-29 13:47:20 +08:00
Haojun Liao
b2b5a14d9d fix(stream): reset task add the failed chkptId info. 2024-11-14 17:38:40 +08:00
Haojun Liao
39495ec935 refactor: do some internal refactor. 2024-10-09 10:07:08 +08:00
Haojun Liao
6170bb5c1c enh(stream): check the existence for snode. 2024-10-09 09:39:32 +08:00
Haojun Liao
0a7022693c refactor: do some internal refactor. 2024-09-19 18:13:46 +08:00
Haojun Liao
979c6e20e6 fix(stream):set the code to be in_progress and do some internal refactor. 2024-09-09 11:12:30 +08:00
Haojun Liao
868898d11c fix(stream): delay to load the stream task. 2024-08-16 00:28:49 +08:00
Haojun Liao
54fdea3173 fix(stream): perform node update when mnode leader/follower switches. 2024-08-15 18:01:28 +08:00
Haojun Liao
eb029395a2 fix(stream): init exec when mnd become leader. 2024-08-14 00:38:15 +08:00
Haojun Liao
dfa74f82d7 fix(stream): avoid repeat send checkpoint-report msg. 2024-08-09 00:40:05 +08:00