7599 commits

Author	SHA1	Message	Date
Haojun Liao	0db357401d	fix(stream): add new status for meta.	2023-10-09 20:08:12 +08:00
Haojun Liao	3912d80c02	fix(stream): do some internal refactor.	2023-10-09 20:08:11 +08:00
Haojun Liao	feb09c8361	fix(stream): fix error in pause scan-history data.	2023-10-09 20:08:11 +08:00
Haojun Liao	4af7812f0b	fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.	2023-10-09 20:08:10 +08:00
Haojun Liao	f4f55fcbce	fix(stream): record the tasks started info, and do some internal refactor.	2023-10-09 20:08:09 +08:00
Haojun Liao	68b003c804	fix(stream): fix race condition.	2023-10-09 20:08:09 +08:00
Haojun Liao	52763ca2a3	refactor: do some internal refactor.	2023-10-09 20:08:07 +08:00
Haojun Liao	c05a8de3e8	fix(stream): rsp when checkpoint source failed.	2023-10-09 20:08:06 +08:00
Haojun Liao	5eee76df65	fix(stream): add msg identifier check.	2023-10-09 20:08:05 +08:00
Haojun Liao	e0d19af000	fix(stream): refactor re-try dispatch msg for stream tasks.	2023-10-09 20:08:03 +08:00
Haojun Liao	2b16976902	refactor(stream): refactor send msg.	2023-10-09 20:08:03 +08:00
Haojun Liao	27e00b1f19	fix(stream): add some logs, and remove invalid assert.	2023-10-09 20:08:02 +08:00
Haojun Liao	12687eb287	fix(stream): add check info detailed information.	2023-10-09 20:08:02 +08:00
Haojun Liao	ef9efc8a8e	refactor: do refactor the sink task.	2023-10-09 20:07:53 +08:00
Haojun Liao	1f45bd82d2	other: merge stream fix in main.	2023-10-09 20:07:01 +08:00
Haojun Liao	e27111ecd1	enh(stream): add node stage check.	2023-10-09 20:06:09 +08:00
Haojun Liao	5c0b8ea804	enh(stream): log the checkpoint time.	2023-10-09 20:06:04 +08:00
Haojun Liao	b95ad74c7f	fix(stream): not handle the check msg for follower tasks.	2023-10-09 20:06:04 +08:00
Haojun Liao	636eccc160	fix(stream): add null check	2023-10-09 20:05:37 +08:00
Haojun Liao	0459a4628c	fix(stream): fix stream task id error.	2023-10-09 20:05:36 +08:00
Haojun Liao	7ccc273206	other: merge stream fix in main.	2023-10-09 20:05:29 +08:00
Haojun Liao	98ef566eb4	fix(stream): remove fill-history sink task.	2023-10-09 20:04:17 +08:00
Haojun Liao	e84eeee6b8	refactor: do some internal refactor.	2023-10-09 20:04:17 +08:00
Haojun Liao	6fa54789cb	fix(stream): disable follower send hb to mnode. and do some internal refactor.	2023-10-09 19:59:31 +08:00
Haojun Liao	1256eafddb	other: merge stream fix.	2023-10-09 19:59:24 +08:00
Haojun Liao	aaa12ed4f8	refactor: do some internal refactor about the sched status set	2023-10-09 19:56:17 +08:00
Haojun Liao	60f5056ab7	other: merge 3.0	2023-09-12 22:00:40 +08:00
Haojun Liao	f6a097d96f	refactor: do some internal refactor.	2023-09-12 21:58:22 +08:00
Haojun Liao	e457d94ac6	refactor: do some internal refactor.	2023-09-12 18:09:02 +08:00
xsren	8787e0d58c	build failed on linux	2023-09-12 14:30:11 +08:00
Haojun Liao	93159729f6	fix(stream):check error when vnode is closing.	2023-09-12 11:45:51 +08:00
Haojun Liao	85a5c45098	fix(stream): limit the already processed data.	2023-09-10 00:01:25 +08:00
Haojun Liao	aa8909b267	other: add some logs.	2023-09-09 15:18:54 +08:00
Haojun Liao	b317c8ebff	fix(stream): disable merge submit blocks.	2023-09-08 12:46:15 +08:00
Haojun Liao	55ac835294	Merge branch 'main' into fix/3_liaohj	2023-09-07 11:47:25 +08:00
dapan1121	fdeb924d0d	Merge pull request #22715 from taosdata/fix/m/TD-26114 ... fix: desc fill missed one window	2023-09-07 11:36:30 +08:00
Haojun Liao	b240e91c91	enh(stream): add token bucket to limit the rate of sink operation.	2023-09-07 09:58:48 +08:00
Haojun Liao	0f909285c4	Merge pull request #22684 from taosdata/mark/tmq-3.0 ... fix:use vgstatus before if rebalance	2023-09-07 09:20:27 +08:00
Haojun Liao	8edf86b3bb	fix(stream): add some logs.	2023-09-06 19:08:09 +08:00
liuyao	d7caed1c44	opt stream state	2023-09-06 16:34:25 +08:00
dapan1121	ed9085281d	Merge pull request #22623 from taosdata/feat/TD-25964-3.0 ... feat: get cpu cores from quota	2023-09-06 16:03:33 +08:00
Haojun Liao	8783ebcb02	enh(stream): add some logs and record the submit package performance.	2023-09-06 14:34:36 +08:00
wangjiaming0909	5dedaebb01	fix: desc fill missed one window	2023-09-06 10:53:19 +08:00
wangmm0220	ef87b9c571	fix:conflicts from 3.0	2023-09-05 16:19:04 +08:00
Haojun Liao	5dcbae3594	Merge pull request #22681 from taosdata/fix/3_liaohj ... refactor: do some internal refactor.	2023-09-05 12:54:09 +08:00
Haojun Liao	aeea699c9c	Merge branch '3.0' into fix/3_liaohj	2023-09-04 15:53:39 +08:00
Haojun Liao	037a232bfa	refactor: do some internal refactor.	2023-09-01 17:05:36 +08:00
wangmm0220	fd85d5885a	fix:add limit time for consume in 1 seconds	2023-09-01 16:57:49 +08:00
wangmm0220	f0fbe08e1d	fix:core dump if tmq is null	2023-09-01 16:45:46 +08:00
yihaoDeng	5f78c27535	add enable white list	2023-09-01 15:11:25 +08:00