7562 commits

Author	SHA1	Message	Date
Haojun Liao	15debda7cd	refactor: update some logs.	2023-10-11 11:04:57 +08:00
Haojun Liao	d58d663a36	refactor: update some logs.	2023-10-11 10:38:15 +08:00
Haojun Liao	a03f09c00f	refactor: update some logs.	2023-10-11 10:32:31 +08:00
Haojun Liao	b4d7e66f19	other: add some logs.	2023-10-10 19:57:17 +08:00
Haojun Liao	56147120b9	fix(tsdb): remove invalid assert, and do some internal refactor.	2023-10-10 17:04:12 +08:00
Haojun Liao	5f9b858fc1	other: merge main.	2023-10-10 15:38:46 +08:00
Haojun Liao	adf6f65d09	fix(stream): set initial version for fill-history task. disable reentry of scan-history task function.	2023-10-10 14:00:30 +08:00
Alex Duan	9da96ebf63	Merge pull request #23017 from taosdata/case/TD-26408-MAIN ... fix: add case for lost data after split vgroup (main)	2023-10-10 00:54:34 -05:00
Hongze Cheng	1b559a0254	Merge pull request #23180 from taosdata/fix/TS-4121-main ... fix(tsdb/cache reader): reset current fileset in cache reader	2023-10-09 20:46:33 -05:00
Hongze Cheng	4224f90661	Merge pull request #23184 from taosdata/enh/TS-4107 ... enh: clear files fset by fset	2023-10-09 20:05:12 -05:00
yihaoDeng	0fc6ffe6b6	change test case	2023-10-09 20:51:26 +08:00
Hongze Cheng	cd61dd39fa	Merge pull request #23176 from taosdata/enh/TS-4103 ... enh: control number of stt files	2023-10-09 05:08:01 -05:00
Hongze Cheng	e3525dba6e	enh: clear files fset by fset	2023-10-09 17:11:50 +08:00
Hongze Cheng	258181e387	change block commit factor	2023-10-09 16:03:42 +08:00
Haojun Liao	8266c4ff77	fix(stream): remove invalid clear of rspmsg list.	2023-10-09 15:26:42 +08:00
Minglei Jin	93438ed838	fix(tsdb/carch reader): reset current fileset in cache reader	2023-10-09 15:24:24 +08:00
Hongze Cheng	2c9a0dbcda	enh: control stt max level	2023-10-09 14:00:11 +08:00
Haojun Liao	74ff0c5b50	Merge branch 'main' into fix/liaohj	2023-10-09 10:14:53 +08:00
Haojun Liao	ee6516f3c4	enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.	2023-10-09 10:13:53 +08:00
Haojun Liao	0fda1793e7	fix(stream): fix error in fill-history process.	2023-10-09 10:08:48 +08:00
Haojun Liao	167484ab3a	Merge pull request #23145 from taosdata/mark/tmq ... opti:set default offset to latest in subscription	2023-10-08 18:56:37 +08:00
Hongze Cheng	880e8c1941	fix: block commit when there are too many stt file	2023-10-08 18:27:19 +08:00
Hongze Cheng	ba27cc0605	fix: fid overflow	2023-10-08 14:54:24 +08:00
yihaoDeng	9d430c39ae	fix mem leak	2023-10-08 11:47:06 +08:00
wangmm0220	fb3197ea89	fix:test case error for reset=latest	2023-10-08 10:55:35 +08:00
Haojun Liao	ab17bfdf09	refactor: do some internal refactor.	2023-10-07 19:16:55 +08:00
yihaoDeng	97fdcbc60b	fix mem leak	2023-10-07 17:48:24 +08:00
wangmm0220	9c470e9297	opti:set default offset to latest in subscription & return error if use snapshot when consume column	2023-10-07 15:25:24 +08:00
Hongze Cheng	d1e59b9e0e	enh: optimize merge strategy	2023-10-07 15:18:08 +08:00
Haojun Liao	7ce3d2c200	fix(stream): quit from loop when input queue is full.	2023-10-07 14:54:11 +08:00
Haojun Liao	c20dd002fb	enh(stream): add more info for sink task.	2023-10-07 01:14:00 +08:00
Haojun Liao	5bf8d16ee1	refactor(stream): idle for 100ms when starting next round scan wal.	2023-10-04 23:33:03 +08:00
Haojun Liao	41ef1a45c1	enh(stream): optimize the scan wal perf	2023-10-04 22:06:46 +08:00
Haojun Liao	45e413f8d5	refactor: wait for 100ms before scan wal again.	2023-10-03 20:57:19 +08:00
Haojun Liao	5564eb215c	fix(stream): fix invalid check.	2023-10-03 00:38:24 +08:00
Haojun Liao	5718158fc0	refactor: do some internal refactor.	2023-10-01 22:27:29 +08:00
Haojun Liao	ff44539468	fix(stream): drop related fill-history task when dropping stream tasks.	2023-09-28 23:00:29 +08:00
Haojun Liao	31acbc6fe2	refactor: do some internal refactor (discard the checkpoint source msg during restoring).	2023-09-28 22:44:13 +08:00
Haojun Liao	f2d8431619	fix(stream): enable new time range for stream task.	2023-09-28 18:26:52 +08:00
Haojun Liao	0047d1e1a6	Merge branch 'main' into fix/liaohj	2023-09-28 14:35:14 +08:00
Haojun Liao	0a8f4530f7	fix(tsdb): replace destroy with reset.	2023-09-28 11:42:19 +08:00
Haojun Liao	22e485d132	fix(stream): opt perf.	2023-09-28 09:25:23 +08:00
Haojun Liao	cc9b9d1054	Merge pull request #23102 from taosdata/fix/liaohj ... fix(stream): fix several bugs and do some internal refactor for stream processing.	2023-09-28 09:12:39 +08:00
Haojun Liao	e13efd5b04	refactor: optimize the fill-history task launch policy, and do some other internal refactor.	2023-09-27 14:00:48 +08:00
kailixu	e1cd54a1b3	fix: rwlock reentrant problem on windows	2023-09-26 15:44:35 +08:00
Haojun Liao	890d658aea	refactor: do some internal refactor.	2023-09-26 14:11:45 +08:00
Haojun Liao	525ee369d3	Merge pull request #23032 from taosdata/fix/liaohj ... fix(stream): fix several stability-related bugs in stream framework.	2023-09-26 14:10:58 +08:00
Haojun Liao	f3f18b0fa3	fix(stream): add new status for meta.	2023-09-26 12:15:12 +08:00
Hongze Cheng	03456ce443	fix: upgrade error when has tomb data	2023-09-26 09:23:22 +08:00
Haojun Liao	6cc3618ed9	fix(stream): fix error in pause scan-history data.	2023-09-26 01:09:55 +08:00