Commit graph

1404 commits

Author SHA1 Message Date
Shungang Li
16e0fc44e2 fix: arb reply to set-assigned no matter what error 2024-04-08 19:56:22 +08:00
Benguang Zhao
ced7c19943 enh: not to start snap replication if too many open files already 2024-03-25 17:01:23 +08:00
Shungang Li
acf42a3d7a fix: arb append noop after become assigned 2024-03-21 18:13:25 +08:00
Shungang Li
4180eea091 enh: arb add more log 2024-03-21 18:13:04 +08:00
Shungang Li
d0df927dfa feat: arb add version in sarbgroup 2024-03-19 09:31:05 +08:00
Shungang Li
3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
Benguang Zhao
dd7f375d8e enh: use reference id of sync node in timer callbacks of sync 2024-02-28 19:01:22 +08:00
Alex Duan
ed4a7b0719 coverage: comment no call file syncMain.c 2024-02-16 21:48:01 +08:00
Benguang Zhao
57714dff65 fix: reset sync timer although failed to enqueue since Out of Memory in rpc queue 2024-02-01 11:07:17 +08:00
Yihao Deng
663b5b4ecf sort epset 2024-01-23 09:09:29 +00:00
Yihao Deng
62e6b5ca31 sort epset 2024-01-23 06:23:34 +00:00
Yihao Deng
04538f9049 add test case 2024-01-22 08:59:40 +00:00
Yihao Deng
aa14e67da9 refactor retry 2024-01-22 07:21:14 +00:00
Yihao Deng
a20845ec69 refactor retry 2024-01-22 01:04:06 +00:00
Yihao Deng
6c732a14a3 refactor retry 2024-01-19 06:20:16 +00:00
Benguang Zhao
84810185c7 fix: skip acked msg in snapshotReSend 2024-01-18 11:16:18 +08:00
Haojun Liao
3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
Haojun Liao
9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Benguang Zhao
485bad1ebd refact: use config syncSnapReplMaxWaitN instead 2024-01-10 11:31:00 +08:00
Benguang Zhao
7979d4532b enh: let max num of concurrent msgs of snap replication be configurable 2024-01-09 16:49:27 +08:00
Benguang Zhao
a811a60ad4 enh: restore sync log store from snap on fsm state incomplete 2024-01-04 20:15:17 +08:00
Benguang Zhao
baa7f9c895 enh: adjust error msg as warn for not ready to propose etc 2023-12-28 17:29:49 +08:00
Benguang Zhao
d83f85bf26 enh: send rsp msg on rejecting snap replication due to smaller term 2023-12-28 17:26:46 +08:00
Benguang Zhao
0e6ea7af71 enh: check snapshot begin index for unexpected change in syncNodeOnSnapshotBegin 2023-12-26 10:54:40 +08:00
Benguang Zhao
7b967ffdc6 enh: retry on fsm commit when rpc out of memory in syncFsmExecute 2023-12-25 20:34:38 +08:00
wade zhang
40994c3fbd
Merge pull request #24174 from taosdata/FIX/TD-28001-3.0
enh: protect syncNodeRestore with log buffer mutex
2023-12-25 10:08:43 +08:00
Benguang Zhao
4137a44fd0 enh: protect syncNodeRestore with log buffer mutex 2023-12-21 17:49:20 +08:00
Benguang Zhao
4c13dee721 enh: protect processing of snap preparation rsp with sender buf mutex 2023-12-19 12:49:48 +08:00
Benguang Zhao
41ef6075e2 enh: check result of FpGetSnapshotInfo for exchange snap info 2023-12-13 18:38:47 +08:00
Benguang Zhao
926c28f62f enh: clear info data of snap sender and receiver at stop 2023-12-13 18:38:44 +08:00
Benguang Zhao
0a7ef098ba enh: reduce wait time to start a new snap replication 2023-12-13 14:01:52 +08:00
Benguang Zhao
6eb64fcd9b fix: set start of snap replication incremental properly 2023-12-13 13:48:45 +08:00
Benguang Zhao
c74c4fe208 enh: clean WAL logs based on size if one follower is offline. 2023-12-13 10:10:02 +08:00
Benguang Zhao
af8a5c0ada enh: protect stop of snap sender and receiver with the mutex of its buffer 2023-12-12 19:22:34 +08:00
Benguang Zhao
c5cde7ffe8 enh: resend new snap replication msg on all acked if not finished yet 2023-12-12 18:35:11 +08:00
Benguang Zhao
1255b46469 fix: destroy dataReaderArr properly in tsdbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao
081c83710e enh: save a copy of snapshot info in syncNodeOnSnapshotPrepRsp 2023-12-07 15:29:37 +08:00
Benguang Zhao
030f3db4d6 refact: improve code of syncNodeOnSnapshotBegin with syncSnapSendRsp 2023-12-07 15:28:14 +08:00
Benguang Zhao
41fe39de3e refact: improve code with syncNodeExchangeSnapInfo 2023-12-07 15:28:14 +08:00
Benguang Zhao
d4add073cc refact: improve code with syncSnapSendRsp 2023-12-07 15:28:14 +08:00
Benguang Zhao
1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
facetosea
845493294d osfile 2023-11-21 16:31:31 +08:00
Benguang Zhao
8f1e3197b2 enh: print lastApplyTerm of snap sender in format of int64 2023-11-06 17:31:31 +08:00
Benguang Zhao
2cf6b3c1e4 fix: release duplicate msgs in syncSnapBufferRecv 2023-11-03 14:01:39 +08:00
Benguang Zhao
456c8d23f3 fix: set cursor properly in syncSnapBufferRecv 2023-11-03 10:09:07 +08:00
Benguang Zhao
ce4fb52926 enh: resend end msg on timeout in snapshotReSend 2023-11-02 18:56:00 +08:00
Benguang Zhao
995a1e1f8e enh: send rsp on duplicate msgs in syncSnapBufferRecv 2023-11-02 18:41:25 +08:00
Benguang Zhao
3221aef1a3 refact: improve code with syncSnapSendMsg 2023-11-02 18:41:25 +08:00
Benguang Zhao
7852b2cecf fix: set ack of response properly in syncSnapSendRsp 2023-11-02 18:41:25 +08:00
Benguang Zhao
70e261f662 enh: terminate snap replication on timeout 2023-10-30 10:14:26 +08:00
Benguang Zhao
c3f9cae36b refact: improve code of syncNodeOnSnapshot 2023-10-27 18:55:30 +08:00
Benguang Zhao
4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
Benguang Zhao
fe553352b8 enh: cache snap blocks sent in snapshotSend for resending 2023-10-25 20:26:11 +08:00
Benguang Zhao
ec5b1f2ec1 enh: logging buf info for snapshot reader and sender 2023-10-25 15:04:14 +08:00
Benguang Zhao
7d9d1c6877 enh: terminate snap replication on timeout 2023-10-25 14:50:53 +08:00
Benguang Zhao
4e3a8b893d enh: restore wal log from snapshot after finish 2023-10-24 20:03:48 +08:00
Benguang Zhao
374217ceff fixup: adjust a logging msg in syncNodeStartSnapshot 2023-10-24 19:29:09 +08:00
Benguang Zhao
95188ab8c3 enh: adjust some logging msgs for sync log replication mgr 2023-10-24 19:11:27 +08:00
Benguang Zhao
4d61e87c0f enh: add signature info in logging msgs of snap replication 2023-10-24 17:28:46 +08:00
Benguang Zhao
811f1bbbea enh: tidy up logging msg in syncNodeOnSnapshotRsp 2023-10-24 15:47:47 +08:00
Benguang Zhao
1c60e67a83 enh: send the END snap msg at last 2023-10-24 14:16:46 +08:00
Benguang Zhao
f444cd7a6d enh: log signature of snap sender/receiver while started or stopped 2023-10-24 11:11:11 +08:00
Benguang Zhao
e34da43e38 feat: support pipelining of snap replication 2023-10-23 19:32:44 +08:00
Benguang Zhao
a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao
d671283b8b refact: adjust logging msg for incomplete fsm state 2023-10-19 11:18:57 +08:00
Benguang Zhao
9643799dc5 fixup: compiler error at labels since allowed only at statements 2023-10-19 11:04:39 +08:00
Benguang Zhao
233a3c4034 enh: terminate on incompletenss of fsm state for dbs of single replica 2023-10-19 11:04:39 +08:00
Benguang Zhao
810678ebcb enh: tidy up debugging msgs of snapshot replication 2023-10-19 11:04:39 +08:00
Benguang Zhao
c89c69f951 enh: use waitTime to prevent from starting snapshot too frequently 2023-10-19 11:04:39 +08:00
Benguang Zhao
be6411ebbe fixup: set lastSendTime with taosGetTimestampMs 2023-10-19 11:04:39 +08:00
Benguang Zhao
a53ba24118 fix: set startTime in snapshotReSend 2023-10-19 11:04:39 +08:00
Benguang Zhao
e901adfdf3 enh: check snapshot receiver and sender by signature 2023-10-19 11:04:39 +08:00
Benguang Zhao
eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao
e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao
410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao
517f1f7e40 fixup: fix syncNodeOnSnapshotPrep 2023-10-19 10:37:34 +08:00
Benguang Zhao
083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Benguang Zhao
4ca897246c enh: proceed sync log buffer on failure of appending too 2023-10-17 14:56:07 +08:00
Benguang Zhao
be3ba000a1 enh: reserve half a buffer size at syncLogBufferInit 2023-10-07 14:17:46 +08:00
Haojun Liao
372747cc23
Merge pull request #22818 from taosdata/fix/3_liaohj
fix(stream): fix error in fill history and check quit status of vnode.
2023-09-10 20:47:06 +08:00
Haojun Liao
aa8909b267 other: add some logs. 2023-09-09 15:18:54 +08:00
xsren
e5302b1677 stack overflow 2023-09-07 11:00:52 +08:00
dapan1121
cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
dm chen
e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
Benguang Zhao
7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
dmchen
fee4b875d1 error code 2023-08-16 17:49:17 +08:00
dm chen
e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
dmchen
de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
Haojun Liao
ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Benguang Zhao
239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
Minglei Jin
fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
dm chen
5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
dmchen
5d4f0cbc71 myindex 2023-08-02 16:36:07 +08:00
dmchen
8a0e9ff0e0 fix/retry_resolve_fqdn 2023-08-01 14:24:28 +08:00
wade zhang
cc3cc73cfc
Merge pull request #22199 from taosdata/fix/TS-3708
fix/TS-3708: check term for role time
2023-07-27 15:43:23 +08:00
Shungang Li
167ecea705 fix: check term for role time
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
2023-07-27 14:16:54 +08:00
Benguang Zhao
f5fced5ab9 fix: not to walEndSnapshot in syncNodeTimerRoutine 2023-07-26 20:06:51 +08:00
dmchen
7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
dmchen
154bc177a7 memory leak 2023-07-19 17:33:55 +08:00
dmchen
7468749666 memory leak 2023-07-19 10:48:04 +08:00