7662 commits

Author	SHA1	Message	Date
kailixu	ff3e36e679	enh: timeseries calculation	2023-09-24 08:41:45 +08:00
kailixu	53a9459c20	enh: update timeseries	2023-09-24 07:52:27 +08:00
Haojun Liao	4ea737571d	refactor: do some internal refactor.	2023-09-24 01:26:51 +08:00
kailixu	bc8ebf1562	Merge branch '3.0' into enh/TS-3812-3.0	2023-09-23 18:19:08 +08:00
Haojun Liao	b58ec1ee57	fix(stream): update logs.	2023-09-23 15:22:48 +08:00
Haojun Liao	acd3321494	fix(stream): rsp when checkpoint source failed.	2023-09-23 14:13:33 +08:00
Haojun Liao	7d5f76c6f1	fix(stream): disable auto rsp for checkpoint source.	2023-09-23 11:31:14 +08:00
Haojun Liao	5155519559	fix(stream): fix invalid assert.	2023-09-22 23:06:48 +08:00
Haojun Liao	cf6c255f22	refactor: do some internal refactor.	2023-09-22 22:50:21 +08:00
kailixu	8f828e052b	enh: timeseries calculation optimization	2023-09-22 20:07:51 +08:00
liuyao	0d983e28ef	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-22 19:25:41 +08:00
Haojun Liao	5b12e276cf	fix(stream): add msg identifier check.	2023-09-22 18:13:18 +08:00
wade zhang	849b05a09b	Merge pull request #22927 from taosdata/fix/TD-26189 ... s3/block_cache: new tsdb block cache	2023-09-22 16:15:07 +08:00
liuyao	4f8e6d7795	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-22 15:00:52 +08:00
Haojun Liao	898aea5cfb	refactor(stream): refactor send msg.	2023-09-22 14:52:18 +08:00
Minglei Jin	4c151f2031	tsdb/readerwriter: remove size with download	2023-09-22 14:06:06 +08:00
Haojun Liao	7e4410f094	Merge pull request #22992 from taosdata/feat/TD-26052 ... feat:support vnode split in tmq	2023-09-22 13:57:21 +08:00
Haojun Liao	87ea745861	fix(stream): add some logs, and remove invalid assert.	2023-09-22 10:53:03 +08:00
Haojun Liao	f7bcff862d	fix(stream): add check info detailed information.	2023-09-22 10:23:56 +08:00
wangmm0220	19806cbcab	fix:memory leak	2023-09-22 10:12:11 +08:00
wangmm0220	5555371fbc	fix:memory leak	2023-09-22 10:04:53 +08:00
wangmm0220	86a4bfe28d	fix:memory leak	2023-09-22 10:02:16 +08:00
liuyao	dc2f7872f8	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-22 09:41:15 +08:00
wangmm0220	803b17a2db	fix:memory leak	2023-09-22 09:31:58 +08:00
Haojun Liao	b1ba716299	refactor: do some internal refactor.	2023-09-22 09:24:36 +08:00
Haojun Liao	b075b4438b	fix(stream): handle dispatch checkpoint-trigger failure.	2023-09-21 23:15:18 +08:00
Haojun Liao	3c921ba66e	Merge pull request #23006 from taosdata/fix/3_liaohj ... fix(tsdb): set the correct scaninfo to load the tomb data.	2023-09-21 22:13:16 +08:00
Haojun Liao	f93df639c1	fix(tsdb): set the correct scaninfo to load the tomb data.	2023-09-21 17:32:21 +08:00
Minglei Jin	ce1f866416	tsdb/reader: use pTsdb handle instead of pgsz to open file	2023-09-21 16:36:17 +08:00
kailixu	7445b9ff50	Merge branch '3.0' into enh/TS-3812-3.0	2023-09-21 16:25:06 +08:00
Haojun Liao	2efd155adf	fix(stream): wait for the task checkpoint before stop.	2023-09-21 15:53:21 +08:00
Haojun Liao	0f97a21163	fix(tsdb): set the correct scaninfo to load the tomb data.	2023-09-21 15:21:01 +08:00
Haojun Liao	e4073bd9a8	fix(stream): update logs.	2023-09-21 14:03:14 +08:00
Haojun Liao	09accc71d2	log(stream): update log.	2023-09-21 14:01:41 +08:00
Haojun Liao	17586af0ce	refactor: do refactor the sink task.	2023-09-21 13:32:57 +08:00
liuyao	3b3c5d7cb8	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-21 10:11:36 +08:00
wangmm0220	f9c5aa01af	fix:enable split if there are topics & fix memory leak	2023-09-21 09:20:34 +08:00
Haojun Liao	6633fb971b	fix(stream): update logs.	2023-09-20 18:18:31 +08:00
Minglei Jin	f206fa07d0	s3/put: use put2	2023-09-20 15:59:58 +08:00
Haojun Liao	2418f509ea	fix(stream): avoid invalid read.	2023-09-20 15:47:09 +08:00
Haojun Liao	1d1d9a1b0b	fix(stream): unlock when returning.	2023-09-20 15:45:15 +08:00
Haojun Liao	c8ab761d2a	fix(stream): return if failed.	2023-09-20 15:38:49 +08:00
Haojun Liao	2a781c509f	fix(stream): add task status check.	2023-09-20 15:32:15 +08:00
Minglei Jin	d155cfcf0f	tsdb/readerwriter: use tsdb's s3 block cache to read file page	2023-09-20 15:24:54 +08:00
liuyao	1cebda368a	session&state operator buff	2023-09-20 15:06:08 +08:00
Haojun Liao	af487c9048	fix(stream): fix obj.	2023-09-20 14:50:43 +08:00
Haojun Liao	361cde6497	fix(stream): fix deadlock caused by streamTaskHalt function.	2023-09-20 14:49:09 +08:00
Haojun Liao	55d4a9686c	log(tsdb): remove some logs.	2023-09-20 13:18:42 +08:00
dm chen	4497a01168	Merge branch 'main' into feat/TD-26127-audit-sql	2023-09-20 11:13:34 +08:00
Haojun Liao	392aaeb592	log(stream): remove logs.	2023-09-20 10:49:18 +08:00
Haojun Liao	779c0c5f19	Merge pull request #22970 from taosdata/fix/liaohj ... fix(stream): keep the status entry in hash table, instead entry index.	2023-09-20 10:33:05 +08:00
wangmm0220	2881a2504c	fix:conflicts from 3.0	2023-09-19 18:39:40 +08:00
dmchen	1a7bffb079	ci break	2023-09-19 18:01:38 +08:00
Haojun Liao	b99232fd7a	fix(stream): limit the max scan times.	2023-09-19 17:45:28 +08:00
Haojun Liao	271e492188	refactor: update the log level.	2023-09-19 17:40:26 +08:00
wangmm0220	766652a88a	fix:vnode tranform support in tmq	2023-09-19 17:27:19 +08:00
dm chen	ee913cbfbc	Merge branch 'main' into feat/TD-26127-audit-sql	2023-09-19 14:39:20 +08:00
dmchen	e36ff1282c	revert dependency	2023-09-19 13:42:02 +08:00
wangmm0220	ad70dc178f	fix:conflicts from 3.0	2023-09-19 11:56:52 +08:00
wangmm0220	edb42aa2aa	fix:move from main to 3.0	2023-09-19 11:51:52 +08:00
Haojun Liao	e76bab7122	fix(stream): not handle the check msg for follower tasks.	2023-09-19 09:43:14 +08:00
slzhou	900aacd428	fix: fix sanitizer error	2023-09-19 09:40:00 +08:00
kailixu	6698861c8b	chore: timeseries distribute	2023-09-19 08:29:51 +08:00
Hongze Cheng	b1797834c1	fix: set snapshot writer compression	2023-09-18 20:58:20 +08:00
wangmm0220	1e859084b7	fix:conflicts from 3.0	2023-09-18 19:57:33 +08:00
wangmm0220	4b74135350	fix:vnode tranform support in tmq	2023-09-18 19:47:28 +08:00
Haojun Liao	101161c52e	Merge pull request #22954 from taosdata/fix/TD-26323 ... fix:core in race condition for pTq->pExecStore & return if poll too l…	2023-09-18 17:41:01 +08:00
Haojun Liao	c33ef4ce88	fix(stream): add null check	2023-09-18 15:14:51 +08:00
wangmm0220	c3498fbfe8	fix:core in race condition for pTq->pExecStore & return if poll too long & fix test cases if submit empty	2023-09-18 14:35:07 +08:00
wangmm0220	7869b693f2	add test case for tmq in vnode transform & fix core in race condition for pTq->pExecStore	2023-09-18 14:09:28 +08:00
dmchen	b473122dac	break dependency	2023-09-18 12:29:08 +08:00
dm chen	fda32dcc51	Merge branch 'main' into feat/TD-26127-audit-sql	2023-09-18 09:41:47 +08:00
dmchen	c674e025e2	skip auto create tb	2023-09-18 09:29:51 +08:00
kailixu	8111c18cc4	chore: merge 3.0	2023-09-18 09:20:43 +08:00
Haojun Liao	8aa9960760	Merge pull request #22944 from taosdata/fix/liaohj ... refactor: do some internal refactor, and fix some bugs.	2023-09-17 21:25:33 +08:00
Haojun Liao	01144c58a7	fix(stream): fix stream task id error.	2023-09-17 01:19:59 +08:00
Haojun Liao	4846194bbb	refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node.	2023-09-16 21:37:30 +08:00
Haojun Liao	caa7542cea	Merge pull request #22913 from taosdata/fix/liaohj ... fix(stream): fix error in drop task.	2023-09-16 21:36:38 +08:00
Haojun Liao	91e3d70796	fix(stream): remove fill-history sink task.	2023-09-15 17:46:17 +08:00
Minglei Jin	0181bb24d3	tsdb/readerwriter: use PRId64 instead of lld	2023-09-15 16:40:04 +08:00
Alex Duan	47f2c38a56	Merge pull request #22910 from taosdata/fix/TS-3987 ... fix: delete data error	2023-09-15 16:19:29 +08:00
Minglei Jin	318281356b	s3/block_cache: new tsdb block cache	2023-09-15 16:19:21 +08:00
kailixu	03aea454d7	chore: more code	2023-09-15 14:33:35 +08:00
wade zhang	b123dd7df3	Merge pull request #22904 from taosdata/FIX/TD-26292-main ... enh: ignore compact req during restoring	2023-09-15 11:05:18 +08:00
Haojun Liao	2bfd6e3355	refactor: do some internal refactor.	2023-09-15 09:25:22 +08:00
Haojun Liao	117de7ab7d	fix(stream): fix error in drop task.	2023-09-15 00:51:13 +08:00
Haojun Liao	500fcad36c	Merge pull request #22892 from taosdata/fix/liaohj ... refactor: do some internal refactor.	2023-09-15 00:46:46 +08:00
Haojun Liao	73c2782d78	fix(stream): update some logs.	2023-09-14 23:17:23 +08:00
Haojun Liao	5f55f489d8	fix(stream): fix memory leak.	2023-09-14 22:59:11 +08:00
Haojun Liao	303e8caf0c	fix(stream): set the correct guard flag.	2023-09-14 22:44:16 +08:00
kailixu	449092c5dc	enh: timeseries update optimize	2023-09-14 20:16:02 +08:00
Haojun Liao	27f626769e	fix(stream): fix memory leak.	2023-09-14 19:33:05 +08:00
Haojun Liao	f2c3e0a6e8	fix(stream): disable follower send hb to mnode. and do some internal refactor.	2023-09-14 17:22:31 +08:00
Hongze Cheng	925cc8f55f	fix: delete data error	2023-09-14 17:20:10 +08:00
Benguang Zhao	bbcbe460d4	enh: ignore compact req during restoring	2023-09-14 16:17:17 +08:00
Benguang Zhao	2886913fd8	enh: ignore compact req during restoring	2023-09-14 16:09:00 +08:00
Haojun Liao	fce5be0eb4	fix(stream): fix dead lock.	2023-09-14 14:09:05 +08:00
Haojun Liao	fd6344b319	fix(tsdb): check return code.	2023-09-14 09:25:35 +08:00
Haojun Liao	9b70c0c457	fix:fix coverity issue and remove unnecessary files.	2023-09-14 09:06:10 +08:00
wangmm0220	39fb5f4334	fix:add vnode snaphot for tmq	2023-09-13 18:09:47 +08:00
Haojun Liao	7305c8dbe1	refactor: do some internal refactor about the sched status set	2023-09-13 14:00:34 +08:00
wangmm0220	1dbd322fa0	fix:remove useless code	2023-09-13 11:42:09 +08:00
Haojun Liao	99477babca	Merge pull request #22872 from taosdata/fix/coverityScanDyh ... fix coverity scan problem	2023-09-13 09:18:27 +08:00
Haojun Liao	09a15bf340	refactor: do some internal refactor.	2023-09-12 22:07:52 +08:00
Haojun Liao	60f5056ab7	other: merge 3.0	2023-09-12 22:00:40 +08:00
Haojun Liao	f6a097d96f	refactor: do some internal refactor.	2023-09-12 21:58:22 +08:00
Haojun Liao	4325a0a433	Merge pull request #22866 from taosdata/fix/3_liaohj ... refactor: do some internal refactor.	2023-09-12 21:56:44 +08:00
yihaoDeng	8fc33dd74d	fix coverity scan problem	2023-09-12 18:52:16 +08:00
Haojun Liao	e457d94ac6	refactor: do some internal refactor.	2023-09-12 18:09:02 +08:00
yihaoDeng	8e064cdd03	fix merge error	2023-09-12 16:41:14 +08:00
Haojun Liao	4d33387e80	Merge pull request #22814 from taosdata/fix/fixTransferCrash2 ... fix merge error	2023-09-12 16:10:07 +08:00
Haojun Liao	52931b530d	Merge pull request #22855 from taosdata/fix/3_liaohj ... fix(stream):check error when vnode is closing.	2023-09-12 15:58:02 +08:00
dapan1121	ef7eb478e4	Merge pull request #22834 from taosdata/fix/TS-3945 ... fix: remove incorrect assert	2023-09-12 15:55:51 +08:00
yihaoDeng	63c53b6a3a	fix transfer crash	2023-09-12 15:03:13 +08:00
yihaoDeng	ccb75a9c11	fix transfer crash	2023-09-12 14:46:56 +08:00
yihaoDeng	3e48f3639c	fix transfer crash	2023-09-12 14:46:32 +08:00
wade zhang	f4e785788a	Merge pull request #22833 from taosdata/fix/TS-3943-3.m ... fix: neighbor block overlap judgement	2023-09-12 11:51:03 +08:00
Haojun Liao	93159729f6	fix(stream):check error when vnode is closing.	2023-09-12 11:45:51 +08:00
Haojun Liao	025a2a3b50	Merge pull request #22846 from taosdata/fix/3_liaohj ... fix(tsdb): check the schema before merge rows in buffer	2023-09-12 11:43:27 +08:00
yihaoDeng	6ce85f5cae	fix transfer crash	2023-09-12 10:44:56 +08:00
Haojun Liao	f602aa965f	fix(stream): fix coverity scan issues.	2023-09-12 09:16:18 +08:00
Haojun Liao	a5b93aaf97	fix(tsdb): fix invalid read.	2023-09-11 23:55:34 +08:00
Haojun Liao	e8f7146a2c	fix(tsdb): check the schema before merge rows in buffer, and do some refactor.	2023-09-11 22:19:10 +08:00
Haojun Liao	cd1f0ea414	Merge pull request #22826 from taosdata/fix/3_liaohj ... fix(stream): set the correct start version for the step 2 stage in fill history.	2023-09-11 21:43:58 +08:00
Haojun Liao	5ab739ae46	fix(stream): fix memory leak.	2023-09-11 15:29:12 +08:00
dapan1121	5c21f1ca22	fix: remove incorrect assert	2023-09-11 15:16:22 +08:00
kailixu	78d136dffd	fix: neighbor block overlap judgement	2023-09-11 15:10:39 +08:00
Haojun Liao	c729fc989f	fix(stream): set the init start timestamp.	2023-09-11 13:49:43 +08:00
Haojun Liao	0980e021e5	fix(stream): set the correct start version for the step 2 stage in fill history.	2023-09-11 13:37:19 +08:00
Haojun Liao	50ef500f51	refactor(stream): do sink module refactor.	2023-09-11 10:09:31 +08:00
Minglei Jin	443756c6ff	fix(meta): null txn after abort	2023-09-11 08:55:30 +08:00
Haojun Liao	372747cc23	Merge pull request #22818 from taosdata/fix/3_liaohj ... fix(stream): fix error in fill history and check quit status of vnode.	2023-09-10 20:47:06 +08:00
Haojun Liao	85a5c45098	fix(stream): limit the already processed data.	2023-09-10 00:01:25 +08:00
Haojun Liao	9a30573b8b	fix(stream): disable scan wal when halt is set.	2023-09-09 16:12:08 +08:00
Haojun Liao	aa8909b267	other: add some logs.	2023-09-09 15:18:54 +08:00
Haojun Liao	6f5c855a4b	fix(stream): fix msg lost bug.	2023-09-09 15:08:36 +08:00
Haojun Liao	47fd144447	other: add some logs.	2023-09-09 11:19:51 +08:00
yihaoDeng	af08289a06	Merge branch 'fix/mainNew' into fix/fixTransferCrash2	2023-09-08 19:58:21 +08:00
yihaoDeng	a0494695de	fix merge error	2023-09-08 19:48:06 +08:00
Haojun Liao	b317c8ebff	fix(stream): disable merge submit blocks.	2023-09-08 12:46:15 +08:00
Benguang Zhao	55a9668908	fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord	2023-09-07 17:26:30 +08:00
Benguang Zhao	2d5b18039d	fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord	2023-09-07 17:14:50 +08:00
wade zhang	d3f0c5ac3e	Merge pull request #22770 from taosdata/fix/TD-25445-main ... fix/TD-25445: search memory in ttlMgrFindExpired	2023-09-07 16:13:32 +08:00
Haojun Liao	55ac835294	Merge branch 'main' into fix/3_liaohj	2023-09-07 11:47:25 +08:00
Haojun Liao	b240e91c91	enh(stream): add token bucket to limit the rate of sink operation.	2023-09-07 09:58:48 +08:00
Shungang Li	a6ba7e678f	fix: search memory in ttlMgrFindExpired	2023-09-07 09:33:26 +08:00
Haojun Liao	0f909285c4	Merge pull request #22684 from taosdata/mark/tmq-3.0 ... fix:use vgstatus before if rebalance	2023-09-07 09:20:27 +08:00
Haojun Liao	2b84e0b02e	refactor: check if the put data into queue is success or failed.	2023-09-06 19:39:00 +08:00
Haojun Liao	8edf86b3bb	fix(stream): add some logs.	2023-09-06 19:08:09 +08:00
Haojun Liao	5ba6a68e7a	fix(stream): fix syntax error.	2023-09-06 19:00:39 +08:00