9491 commits

Author	SHA1	Message	Date
Haojun Liao	0b18192b23	fix(stream): fix error in finishing event handling.	2023-10-31 16:40:16 +08:00
Haojun Liao	4c0242a58d	fix(stream): fix error in finishing event handling.	2023-10-31 16:39:14 +08:00
liuyao	696294c208	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-10-31 15:41:04 +08:00
wade zhang	76c9b9afc5	Merge pull request #23377 from taosdata/FIX/TD-26596-3.0 ... feat: support pipelining of snap replication	2023-10-31 15:19:07 +08:00
wade zhang	25b09b467f	Merge pull request #23439 from taosdata/feat/TD-26971-3.0 ... TD-26971	2023-10-31 13:53:49 +08:00
kailixu	28cd8f4915	enh: file duration for rsma	2023-10-31 11:38:33 +08:00
Hongze Cheng	ac3df85d8a	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684	2023-10-31 11:23:23 +08:00
Haojun Liao	fc70fa053c	fix(tsdb): fix syntax error.	2023-10-31 10:45:14 +08:00
Haojun Liao	6a7ba0f5f5	fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1.	2023-10-31 10:45:14 +08:00
Haojun Liao	00626de6e4	fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files.	2023-10-31 10:45:13 +08:00
Haojun Liao	cb43299faa	fix(tsdb): avoid to read duplicated rows in buf.	2023-10-31 10:45:13 +08:00
Haojun Liao	635243f01a	refactor: do some internal refactor.	2023-10-31 10:45:12 +08:00
Haojun Liao	6e2240a3d1	fix(stream): fix the deadlock.	2023-10-31 10:45:12 +08:00
Haojun Liao	0c982093cd	fix(stream): enable the set of fill-history task to be un-init.	2023-10-31 10:45:12 +08:00
Haojun Liao	8b9bc988f1	fix(tsdb): fix syntax error.	2023-10-31 10:42:34 +08:00
Haojun Liao	eaf76854f6	fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1.	2023-10-31 09:29:24 +08:00
dmchen	ffb1e1e8c3	end point	2023-10-30 12:05:20 +00:00
kailixu	b03baaed2c	chore: revert the code change	2023-10-30 19:49:50 +08:00
kailixu	89651626e3	chore: reopen rsma stream commit	2023-10-30 19:45:18 +08:00
dmchen	fe044051c8	memory leak	2023-10-30 19:36:27 +08:00
dmchen	5120d25297	memory leak	2023-10-30 11:34:34 +00:00
Minglei Jin	867ce92dcc	tsdb/file-rw: fix log msg	2023-10-30 19:28:18 +08:00
Minglei Jin	800cbfbb05	tsdb/file: new s3flag in mem	2023-10-30 17:36:49 +08:00
Haojun Liao	6e118c7963	fix(stream): fix memory leak.	2023-10-30 17:28:57 +08:00
dmchen	0f40e1dbb9	memory leak	2023-10-30 16:59:12 +08:00
dmchen	40c9622df5	memory leak	2023-10-30 08:57:07 +00:00
Haojun Liao	ed07486405	fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files.	2023-10-30 16:40:09 +08:00
Haojun Liao	bc1c2a879a	fix(tsdb): avoid to read duplicated rows in buf.	2023-10-30 16:12:08 +08:00
dmchen	be0a85a0ff	memory leak	2023-10-30 15:22:54 +08:00
Minglei Jin	84d2f9c379	tsdb/upload: delay data file uploading	2023-10-30 15:22:34 +08:00
dmchen	6172b820ac	memory leak	2023-10-30 07:19:08 +00:00
Haojun Liao	fdf3f210ac	refactor: do some internal refactor.	2023-10-30 14:39:24 +08:00
Haojun Liao	3275452bce	fix(stream): fix the deadlock.	2023-10-30 14:38:51 +08:00
kailixu	c77153cb81	enh: use placeholder '-' for interval of 1st retention level	2023-10-30 14:02:31 +08:00
Haojun Liao	15d217fc3e	fix(stream): fix memory leak.	2023-10-30 13:29:35 +08:00
Haojun Liao	b0700d6095	Merge branch '3.0' into fix/3_liaohj	2023-10-30 11:57:54 +08:00
Haojun Liao	93232a0e14	fix(stream): enable the set of fill-history task to be un-init.	2023-10-30 11:48:51 +08:00
liuyao	1a37f19c82	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-10-30 11:43:23 +08:00
dapan1121	1b7a6bccdf	Merge pull request #23430 from taosdata/enh/TD-26641-3.0 ... enh: only float/double allowed for sum/avg of rsma	2023-10-30 10:08:55 +08:00
Minglei Jin	4fede02da4	tsdb/retention: remove s3 evict cache hook	2023-10-30 10:06:42 +08:00
Haojun Liao	c7285c0ede	fix(stream): add expired epset node list for stream tasks in hb to mnode.	2023-10-27 23:41:57 +08:00
Haojun Liao	4c267b538f	fix(stream): add expired epset node list for stream tasks in hb to mnode.	2023-10-27 23:05:41 +08:00
Hongze Cheng	a7f3041ff3	more fix	2023-10-27 17:59:27 +08:00
Benguang Zhao	4163a3be7c	feat: resend snap replication of data on timeout	2023-10-27 17:58:26 +08:00
Hongze Cheng	cdb1d8296d	feat: concurrency on fileset	2023-10-27 17:48:19 +08:00
dmchen	43e6dec6c2	TD-26971	2023-10-27 17:39:50 +08:00
dmchen	34c4ffde26	TD-26971	2023-10-27 09:30:30 +00:00
Minglei Jin	8c6f452f09	tsdb/write: make last tier writable to mem	2023-10-27 15:51:52 +08:00
Haojun Liao	dcca6b0868	other: merge 3.0.	2023-10-27 11:41:28 +08:00
Haojun Liao	9c9d02b181	fix(stream): disable follower nodes exec reset.	2023-10-27 09:59:52 +08:00
Haojun Liao	454624516c	fix(stream): handle the repeatly issued nodeUpdate msg from dnode.	2023-10-27 09:59:51 +08:00
Haojun Liao	33dc51cc86	fix(stream): add some logs.	2023-10-27 09:59:44 +08:00
Haojun Liao	1ccbb77981	fix(stream): fix dead lock when shutdown all tasks.	2023-10-27 09:59:37 +08:00
Haojun Liao	2493c21ed3	fix(stream): fix the invalid write in sma	2023-10-27 09:58:52 +08:00
Haojun Liao	7cce53f7e5	fix(stream): ignore the check status when is ready.	2023-10-27 09:58:52 +08:00
Haojun Liao	c99f434706	fix(stream): set checkpoint failure when in pause status.	2023-10-27 09:58:52 +08:00
Haojun Liao	2c1af8dad8	refactor: do some internal refactor.	2023-10-27 09:58:52 +08:00
Haojun Liao	1ad2c3029a	refactor(stream): do some internal refactor.	2023-10-27 09:58:52 +08:00
Haojun Liao	7311f9d2fe	fix(sma): fix bugs in sma and do some internal refactor.	2023-10-27 09:58:51 +08:00
Haojun Liao	3bcffcf1da	other: merge stream refactor from main.	2023-10-27 09:56:02 +08:00
Haojun Liao	226b6596d6	fix(stream): fix bugs caused by refactor.	2023-10-27 09:54:58 +08:00
Haojun Liao	091238e7be	fix(stream): fix bugs caused by refactor sm.	2023-10-27 09:54:58 +08:00
Haojun Liao	e1f6043eed	fix(stream): fix bugs caused by refactor sm.	2023-10-27 09:54:57 +08:00
Haojun Liao	8729bdac1e	fix(stream): fix bugs caused by refactor.	2023-10-27 09:54:57 +08:00
Haojun Liao	1eac7f44c0	fix(stream): fix error in stream.	2023-10-27 09:54:56 +08:00
Haojun Liao	579dd8e6b2	refactor(stream): do some internal refactor.	2023-10-27 09:54:56 +08:00
Haojun Liao	6f3c0d17cc	refactor(stream): add state machine to manage the state of stream tasks.	2023-10-27 09:54:49 +08:00
Haojun Liao	596eb073b7	refactor(stream): do some internal refactor.	2023-10-27 09:54:48 +08:00
Haojun Liao	62c58ecd8b	fix(stream):add more check for test cases.	2023-10-27 09:54:06 +08:00
liuyao	cf3bfe9310	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-10-27 09:39:00 +08:00
dmchen	ca5e252c0c	atomic init	2023-10-27 01:20:33 +00:00
dmchen	21dd6f70a9	atomic init	2023-10-27 01:16:53 +00:00
Hongze Cheng	b8c379a20d	Merge pull request #23413 from taosdata/fix/TD-26669 ... fix(tsdb/commmit): make ts big enough to skip row	2023-10-26 07:17:53 -05:00
dmchen	9af7b7b178	init error	2023-10-26 11:50:34 +00:00
wade zhang	d1e4e909c3	Merge pull request #23384 from taosdata/fix/TD-26884-3.0 ... Fix/td 26884 3.0	2023-10-26 17:00:00 +08:00
wade zhang	951442e3db	Merge pull request #23381 from taosdata/fix/TD-26884-main ... TD-26884	2023-10-26 16:59:39 +08:00
Minglei Jin	b314758108	tsdb/commit: make ts big enough to skip row	2023-10-26 16:24:06 +08:00
yihaoDeng	4c03d372ef	fix stream case error	2023-10-26 14:19:34 +08:00
kailixu	bb77015998	Merge branch '3.0' into enh/TD-26641-3.0	2023-10-26 10:40:54 +08:00
Hongze Cheng	209ebbde84	Merge pull request #23402 from taosdata/fix/TD-26189-libs3 ... cmake/xml2: use sha256 to verify distribution release	2023-10-25 20:27:29 -05:00
kailixu	64765579e9	enh: check interval and keep for retentions	2023-10-25 22:42:01 +08:00
yihaoDeng	db0f6258fe	fix stream case error	2023-10-25 19:38:22 +08:00
liuyao	f51c985914	stream event window	2023-10-25 17:50:16 +08:00
Minglei Jin	d77ecbbb1b	cmake/xml2: use sha256 to verify distribution release	2023-10-25 17:41:55 +08:00
dmchen	14be9c81e2	create table user and clusterid	2023-10-25 14:53:06 +08:00
dmchen	7ef019d105	create table user and clusterid	2023-10-25 06:49:23 +00:00
Haojun Liao	f36b24ed24	fix(stream): disable follower nodes exec reset.	2023-10-25 14:16:36 +08:00
Hongze Cheng	3ff331b8b7	Merge pull request #23391 from taosdata/fix/TD-26189-libs3 ... cmake: new option: BUILD_S3	2023-10-24 22:37:20 -05:00
Haojun Liao	03165d5327	fix(stream): handle the repeatly issued nodeUpdate msg from dnode.	2023-10-25 09:55:02 +08:00
Haojun Liao	26aaa4a83c	other: merge main.	2023-10-25 00:39:14 +08:00
Haojun Liao	13d979a2ee	fix(stream): add some logs.	2023-10-25 00:03:46 +08:00
Haojun Liao	8cde39eebd	fix(stream): fix dead lock when shutdown all tasks.	2023-10-24 19:11:24 +08:00
Minglei Jin	f9ca8fe962	cmake: new option: BUILD_S3	2023-10-24 16:10:46 +08:00
Haojun Liao	f1498f8929	fix(stream): fix the invalid write in sma	2023-10-24 15:24:34 +08:00
dmchen	162066235b	create table	2023-10-24 14:31:27 +08:00
Hongze Cheng	e7e7748e6d	Merge pull request #23366 from taosdata/fix/TD-26669 ... tsdb/commit: skip last tier ts data committing	2023-10-24 01:29:01 -05:00
dmchen	ae728ab412	create table	2023-10-24 06:17:13 +00:00
yihaoDeng	95b0d4f083	Merge branch 'enh/new3.0' into enh/refactorBackend	2023-10-24 13:40:47 +08:00
Haojun Liao	a6e706ba2d	fix(stream): ignore the check status when is ready.	2023-10-24 11:38:14 +08:00
Haojun Liao	e92b276e3e	fix(stream): set checkpoint failure when in pause status.	2023-10-24 10:14:29 +08:00
Minglei Jin	e826532592	cmake/vnode: specify no default path for ssl & crypto	2023-10-24 10:10:43 +08:00
Haojun Liao	0dae8c3c76	refactor: do some internal refactor.	2023-10-24 09:49:14 +08:00
Haojun Liao	f446ff1c36	refactor(stream): do some internal refactor.	2023-10-24 09:48:10 +08:00
Haojun Liao	7a8b046a35	fix(sma): fix bugs in sma and do some internal refactor.	2023-10-24 09:40:38 +08:00
Minglei Jin	7fdf6cc696	cmake: use new dir for libs3	2023-10-24 09:04:24 +08:00
dmchen	dec257ff59	TD-26529	2023-10-23 08:59:54 +00:00
Minglei Jin	80fb38f172	Merge branch '3.0' into fix/TD-26189-libs3	2023-10-23 16:31:21 +08:00
Minglei Jin	f630fc38f8	tsdb/commit: skip last tier ts data committing	2023-10-23 15:46:32 +08:00
Haojun Liao	2ee3319611	Merge pull request #23360 from taosdata/fix/liaohj ... fix(tsdb): apply the window range when building blocks from stt files.	2023-10-23 12:45:42 +08:00
Haojun Liao	6dc8fc50bc	Merge pull request #23359 from taosdata/fix/3_liaohj ... fix(tsdb): apply the window range when building blocks from stt files.	2023-10-21 14:57:14 +08:00
Haojun Liao	f667bf3866	fix(tsdb): apply the window range when building blocks from stt files.	2023-10-20 18:19:45 +08:00
Haojun Liao	f1207d8d42	fix(tsdb): apply the window range when building blocks from stt files.	2023-10-20 18:18:58 +08:00
Haojun Liao	c4268ca395	fix(stream): fix bugs caused by refactor.	2023-10-20 15:54:30 +08:00
yihaoDeng	1a4cfd11a5	Merge branch 'enh/new3.0' into enh/refactorBackend	2023-10-20 15:28:10 +08:00
Minglei Jin	55647f9ce9	cos/put: make chunk small to not block other reqs	2023-10-20 15:15:03 +08:00
Haojun Liao	3b8c85f632	fix(stream): fix bugs caused by refactor sm.	2023-10-20 14:19:57 +08:00
Minglei Jin	74d05c2771	vnode/cos: fix multipart uploading	2023-10-20 13:47:25 +08:00
Haojun Liao	270a847809	fix(stream): fix bugs caused by refactor sm.	2023-10-20 10:23:48 +08:00
Benguang Zhao	959f8105ee	enh: require command to trigger repairing vnodes on replaced disks	2023-10-19 18:55:12 +08:00
Haojun Liao	d5059826a8	fix(stream): fix bugs caused by refactor.	2023-10-19 17:59:04 +08:00
Haojun Liao	c1cebae6ba	fix(stream): fix error in stream.	2023-10-19 16:20:27 +08:00
Haojun Liao	402aefd95d	refactor(stream): do some internal refactor.	2023-10-19 15:09:47 +08:00
Benguang Zhao	a2e0480839	refact: rename as SYNC_FSM_STATE_COMPLETE	2023-10-19 11:18:57 +08:00
Benguang Zhao	a515f8a94f	feat: use vnode config info if existing during vnodeCreate	2023-10-19 11:18:57 +08:00
Benguang Zhao	a95f6e6862	feat: support restore dnode with vnodes of replaced disks for primary dirs	2023-10-19 11:18:57 +08:00
Benguang Zhao	c4e9069a66	fix: set nextProcessedVer properly in tqProcessTaskScanHistory	2023-10-19 11:18:57 +08:00
Benguang Zhao	5c85525fd0	enh: add tsdbFSCreateRefSnapshotWithoutLock	2023-10-19 11:18:57 +08:00
Benguang Zhao	f2bd43c07e	fix: set field length properly in tsdbGetSnapDetails	2023-10-19 11:18:57 +08:00
Benguang Zhao	83013e0fe5	enh: return error in case of out of memory for tsdbGetSnapRangeHash	2023-10-19 11:18:57 +08:00
Benguang Zhao	59e8a2104c	refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen	2023-10-19 11:18:57 +08:00
Benguang Zhao	eb8c4d3e8c	enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen	2023-10-19 11:18:57 +08:00
Benguang Zhao	4e74533878	enh: avoid _Static_assert	2023-10-19 11:18:57 +08:00
Benguang Zhao	094cf408df	enh: prepare vnode dir again in vnodeOpen	2023-10-19 11:18:57 +08:00
Benguang Zhao	c1f1709d59	fix: add rsmaSnapWriterPrepareClose	2023-10-19 11:18:57 +08:00
Benguang Zhao	74185b8b9c	feat: exchange snapshot info for rsma tsdbs	2023-10-19 11:18:57 +08:00
Benguang Zhao	d5d713b1b4	enh: fill snapshot info for rsma tsdbs	2023-10-19 11:04:39 +08:00
Benguang Zhao	b80f8201ce	feat: detect fs incompleteness of RSMA tsdbs	2023-10-19 11:04:39 +08:00
Benguang Zhao	29bbebc323	enh: refactor a func name as tsdbSnapGetDetails	2023-10-19 11:04:39 +08:00
Benguang Zhao	00aeb031d4	enh: replicate a fset if it is corrupted without valid minVer	2023-10-19 11:04:39 +08:00
Benguang Zhao	a6d5deb5d1	fixup: fix tsdbFSDoSanAndFix	2023-10-19 11:04:39 +08:00
Benguang Zhao	eb4e2aa58f	feat: restore incomplete fsm state with maxVerValid via snapshot replication	2023-10-19 11:04:36 +08:00
Benguang Zhao	0c41fa56dc	feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot	2023-10-19 11:00:44 +08:00
Benguang Zhao	e1c03118ab	enh: extract snapshot info for both of snap reader and writer	2023-10-19 10:51:13 +08:00
Benguang Zhao	410ced8320	feat: use TLV format to encode data of snapshot info	2023-10-19 10:51:13 +08:00
Benguang Zhao	f99795d027	enh: use tsdbSnapRangeArrayDestroy	2023-10-19 10:51:13 +08:00
Benguang Zhao	c1b2eedd3c	feat: impl tsdbSnapGetInfo	2023-10-19 10:51:08 +08:00
Benguang Zhao	4d55488495	feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen	2023-10-19 10:37:34 +08:00
Benguang Zhao	083dd148be	feat: exchange difference of snapshot info for replication	2023-10-19 10:37:34 +08:00
Benguang Zhao	b23bcee690	fixup: about to revert this commit	2023-10-19 10:37:34 +08:00
Benguang Zhao	0ddbcd50d0	enh: maintain independent version range of tombs for SDataFileWriter	2023-10-19 10:37:34 +08:00
Benguang Zhao	4540bcb170	fixup: work-around a compiler bug	2023-10-19 10:37:34 +08:00
Benguang Zhao	44a7f5df47	feat: add tsdbSnapDiff	2023-10-19 10:37:34 +08:00
Benguang Zhao	6ae9bd0e9a	feat: add tsdbFSToSnapRangeArray	2023-10-19 10:37:34 +08:00
Benguang Zhao	0a67cc8477	refact: use tsdbTFileUpdVerRange in tsdbSttFWriterCloseCommit	2023-10-19 10:37:34 +08:00
Benguang Zhao	54a10154a4	fixup: remove unused minVer and maxVer in ctx of SCommitter2	2023-10-19 10:37:34 +08:00
Benguang Zhao	6b753cc0cd	refact: remove unused code is_same_file	2023-10-19 10:37:34 +08:00
Benguang Zhao	dc402e21e3	fix: merge old version range of head and tomb files in tsdbDataFileWriterCloseCommit	2023-10-19 10:37:34 +08:00
Benguang Zhao	f8c6e8744a	refact: change field name of pExclude in SVSnapReader	2023-10-19 10:37:34 +08:00
Benguang Zhao	01d0c1247d	enh: record ver range in writer ctx	2023-10-19 10:37:34 +08:00
Benguang Zhao	f207b3ddd5	refact: rename func names of tsdbDataWriterUpdVerRange and tsdbSttWriterUpdVerRange	2023-10-19 10:37:34 +08:00
Benguang Zhao	399afe1094	refact: tidy up declarations of funcs in tsdbUpgrade.c	2023-10-19 10:37:25 +08:00
Haojun Liao	f4caeca24a	refactor(stream): add state machine to manage the state of stream tasks.	2023-10-19 10:34:20 +08:00
Benguang Zhao	ed6d7c4c4d	refact: relocate declarations and defs of tsdbFileWriteTombBlock and tsdbFileWriteTombBlk	2023-10-19 10:17:34 +08:00
Benguang Zhao	823aad4a5e	enh: record version range of STFile for data and stt files	2023-10-19 10:17:34 +08:00
Benguang Zhao	3cd458f5c9	enh: fill minVer and maxVer of nf in STFileObj during migration	2023-10-19 10:17:34 +08:00
Benguang Zhao	1446b44733	fixup: remove minVer and maxVer in FSetWriterConfig	2023-10-19 10:17:34 +08:00
Benguang Zhao	c8a46394f1	enh: set default values of minVer and maxVer while upgrading from CURRENT	2023-10-19 10:17:34 +08:00
Benguang Zhao	ab7a20c117	enh: write stt and data files with minVer and maxVer	2023-10-19 10:17:34 +08:00
Benguang Zhao	da28d490aa	enh: filterByVersion with snap ranges	2023-10-19 10:17:34 +08:00
Benguang Zhao	7a13e4b2cf	enh: add minVer and maxVer for entries in current.json	2023-10-19 10:17:34 +08:00
Benguang Zhao	1be2835fc1	enh: exclude a list of snap ranges in tsdbSnapReaderOpen	2023-10-19 10:17:34 +08:00
Benguang Zhao	573c28fd06	enh: iterate over a list of snap ranges for STsdbSnapReader	2023-10-19 10:17:28 +08:00
Minglei Jin	52c8bc91f9	cos/delete: fix delete object cond and double free	2023-10-18 18:21:45 +08:00
Haojun Liao	54ec679b58	refactor(stream): do some internal refactor.	2023-10-18 15:34:53 +08:00
Minglei Jin	f26ec41b8e	vnode/cos: fix get callback buffer	2023-10-18 15:30:02 +08:00
Haojun Liao	c6dd73b68b	Merge pull request #23187 from taosdata/feat/TD-26056 ... feat:add replay logic	2023-10-18 11:43:43 +08:00
yihaoDeng	e49b9b2276	fix transfer crash	2023-10-18 11:34:11 +08:00
Haojun Liao	df07443379	Merge pull request #23288 from taosdata/fix/liaohj ... fix(stream):add more check for test cases.	2023-10-18 08:13:15 +08:00
yihaoDeng	d67fdb5e46	fix transfer crash	2023-10-17 21:08:31 +08:00
yihaoDeng	2004c1a346	fix transfer crash	2023-10-17 18:19:52 +08:00
Minglei Jin	11b65e2779	vnode/cos: make dependent lib public	2023-10-17 18:11:13 +08:00
Minglei Jin	dd21d8e3ad	cos/multipart: first round multipart uploading	2023-10-17 17:24:50 +08:00
Minglei Jin	8fa8c40391	cos/put: simple object putting(< 5 gigabytes)	2023-10-17 14:59:03 +08:00
yihaoDeng	b793c92fed	fix stream snap deadlock	2023-10-16 22:00:34 +08:00
yihaoDeng	b133418d88	fix stream snap deadlock	2023-10-16 20:03:44 +08:00
yihaoDeng	f1186be19a	fix stream snap deadlock	2023-10-16 19:38:55 +08:00
yihaoDeng	0adefd5e59	fix stream snap deadlock	2023-10-16 19:26:33 +08:00
yihaoDeng	f5ea3649c5	fix stream snap deadlock	2023-10-16 19:26:08 +08:00
yihaoDeng	0a84d7a8b3	fix stream snap deadlock	2023-10-16 19:20:48 +08:00
yihaoDeng	252b90bfab	fix stream snap deadlock	2023-10-16 19:20:09 +08:00
Haojun Liao	a1aa2c9e0c	fix(stream):add more check for test cases.	2023-10-16 18:47:01 +08:00
Minglei Jin	2479bb343e	prefix/delete: delete with prefix	2023-10-16 15:54:51 +08:00
Minglei Jin	4a77a49a3e	prefix/list: list bucket with prefix	2023-10-16 15:25:48 +08:00
Haojun Liao	f98e454c5d	Merge pull request #23193 from taosdata/fix/3_liaohj ... other: merge stream fix in main branch.	2023-10-16 15:17:04 +08:00
Haojun Liao	33018a0bdb	fix(tsdb): fix syntax error.	2023-10-16 14:07:09 +08:00
Haojun Liao	fa6ba6faf8	fix(tdsb): adjust the log level.	2023-10-16 13:26:13 +08:00
Haojun Liao	6b86d050f2	fix(tsdb): record the pinned block iter.	2023-10-16 13:26:13 +08:00
Haojun Liao	5fe7c8de24	fix(stream): fix syntax error.	2023-10-16 13:26:12 +08:00
Haojun Liao	fb2172933a	fix(tsdb): enable pin stt datablock.	2023-10-16 13:26:06 +08:00
Haojun Liao	8f2c1944c0	fix(tdsb): adjust the log level.	2023-10-16 11:55:57 +08:00
Haojun Liao	ccecf05ff8	fix(tsdb): record the pinned block iter.	2023-10-16 11:48:57 +08:00
wangmm0220	473142fab7	fix:conflicts from 3.0	2023-10-16 11:35:56 +08:00
Haojun Liao	18bb27cdff	fix(stream): fix syntax error.	2023-10-16 10:16:39 +08:00
Haojun Liao	67bee17e5e	other: merge main.	2023-10-16 09:55:41 +08:00
Haojun Liao	f751f2bb3d	fix(tsdb): enable pin stt datablock.	2023-10-16 09:49:51 +08:00
wade zhang	0f9da01c88	Merge pull request #23264 from taosdata/3.0_main_merge.2 ... 3.0 main merge	2023-10-14 09:45:49 +08:00
Minglei Jin	0a1ff3283e	vnode/cos: first round size delte and get	2023-10-13 16:59:05 +08:00
Haojun Liao	bd72d080a9	Merge pull request #23242 from taosdata/fix/liaohj ... refactor: do some internal refactor.	2023-10-13 16:40:14 +08:00
yihaoDeng	8392c99d36	refactor backend	2023-10-13 14:54:00 +08:00
dapan1121	a418307570	Merge pull request #23236 from taosdata/fix/TD-26658-3.0 ... enh: close stt before untake read snap	2023-10-13 14:16:47 +08:00
Haojun Liao	0240ae87c3	Merge pull request #23241 from taosdata/3.0_main_merge ... 3.0 branch to main merge	2023-10-13 10:22:48 +08:00
Alex Duan	35fced8796	Merge pull request #23234 from taosdata/main_3_merge ... other: merge main into 3.0	2023-10-12 07:48:20 -05:00
yihaoDeng	a56d831a14	refactor backend	2023-10-12 20:16:41 +08:00
Haojun Liao	506c55001d	fix(tsdb): fix race condition.	2023-10-12 17:57:03 +08:00
Haojun Liao	b782af2534	fix(stream): avoid double free.	2023-10-12 17:56:42 +08:00
Haojun Liao	90f866352b	Merge pull request #23221 from taosdata/feat/TD-26052 ... fix:[TD-26671] judge if pointer is null to avoid core dump	2023-10-12 17:23:41 +08:00
kailixu	3d32d55ea5	enh: close stt before untake read snap	2023-10-12 16:44:55 +08:00
Haojun Liao	eb4449999f	other: merge 3.0	2023-10-12 10:33:48 +08:00
Hongze Cheng	11aa9326b9	fix more	2023-10-11 20:15:46 +08:00
yihaoDeng	031506aef8	refactor backend	2023-10-11 19:46:35 +08:00
Hongze Cheng	38b036ff36	fix: possible race condition	2023-10-11 17:39:58 +08:00
Haojun Liao	ea6ffac403	refactor: do some internal refactor.	2023-10-11 16:51:27 +08:00
Minglei Jin	8253874398	enh(tsdb/cos): new sdk for s3	2023-10-11 14:47:26 +08:00
wangmm0220	f7d1e0ea82	fix:[TD-26671] judge if pointer is null to avoid core dump	2023-10-11 11:08:14 +08:00
Haojun Liao	15debda7cd	refactor: update some logs.	2023-10-11 11:04:57 +08:00
Haojun Liao	d58d663a36	refactor: update some logs.	2023-10-11 10:38:15 +08:00
Haojun Liao	a03f09c00f	refactor: update some logs.	2023-10-11 10:32:31 +08:00
Shungang Li	2c66f44b31	fix(tsdb): ensure sst trigger array size for upgrade	2023-10-10 21:07:08 +08:00
Haojun Liao	b4d7e66f19	other: add some logs.	2023-10-10 19:57:17 +08:00
Haojun Liao	56147120b9	fix(tsdb): remove invalid assert, and do some internal refactor.	2023-10-10 17:04:12 +08:00
wangmm0220	440fa77282	fix:merge datablock if data in same wal version	2023-10-10 16:55:36 +08:00
Haojun Liao	5f9b858fc1	other: merge main.	2023-10-10 15:38:46 +08:00
Haojun Liao	adf6f65d09	fix(stream): set initial version for fill-history task. disable reentry of scan-history task function.	2023-10-10 14:00:30 +08:00
Alex Duan	9da96ebf63	Merge pull request #23017 from taosdata/case/TD-26408-MAIN ... fix: add case for lost data after split vgroup (main)	2023-10-10 00:54:34 -05:00
wangmm0220	9113c3c3b6	fix:rollback removed code	2023-10-10 11:53:54 +08:00
Hongze Cheng	1b559a0254	Merge pull request #23180 from taosdata/fix/TS-4121-main ... fix(tsdb/cache reader): reset current fileset in cache reader	2023-10-09 20:46:33 -05:00
Hongze Cheng	4224f90661	Merge pull request #23184 from taosdata/enh/TS-4107 ... enh: clear files fset by fset	2023-10-09 20:05:12 -05:00
yihaoDeng	0fc6ffe6b6	change test case	2023-10-09 20:51:26 +08:00
wangmm0220	3e2e924e98	feat:[TD-26056] add replay logic	2023-10-09 18:36:39 +08:00
Hongze Cheng	cd61dd39fa	Merge pull request #23176 from taosdata/enh/TS-4103 ... enh: control number of stt files	2023-10-09 05:08:01 -05:00
wangmm0220	33045e63ae	feat:[TD-26056] add replay logic	2023-10-09 17:35:40 +08:00
kailixu	5dd277248e	fix: alter active code for different server	2023-10-09 17:16:56 +08:00
Hongze Cheng	e3525dba6e	enh: clear files fset by fset	2023-10-09 17:11:50 +08:00
Hongze Cheng	258181e387	change block commit factor	2023-10-09 16:03:42 +08:00
yihaoDeng	2aa88dfe9b	fix mem leak	2023-10-09 15:53:42 +08:00
Haojun Liao	8266c4ff77	fix(stream): remove invalid clear of rspmsg list.	2023-10-09 15:26:42 +08:00
Minglei Jin	93438ed838	fix(tsdb/carch reader): reset current fileset in cache reader	2023-10-09 15:24:24 +08:00
yihaoDeng	addb1107d2	fix mem leak	2023-10-09 15:11:59 +08:00
Hongze Cheng	2c9a0dbcda	enh: control stt max level	2023-10-09 14:00:11 +08:00
liuyao	1fbfdb5ab4	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-10-09 11:40:27 +08:00
Haojun Liao	74ff0c5b50	Merge branch 'main' into fix/liaohj	2023-10-09 10:14:53 +08:00
Haojun Liao	ee6516f3c4	enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.	2023-10-09 10:13:53 +08:00
Haojun Liao	0fda1793e7	fix(stream): fix error in fill-history process.	2023-10-09 10:08:48 +08:00
wangmm0220	5f7b6f19ba	feat:[TD-26056] add replay logic	2023-10-08 19:05:59 +08:00
Haojun Liao	167484ab3a	Merge pull request #23145 from taosdata/mark/tmq ... opti:set default offset to latest in subscription	2023-10-08 18:56:37 +08:00
Hongze Cheng	880e8c1941	fix: block commit when there are too many stt file	2023-10-08 18:27:19 +08:00
yihaoDeng	bffa6387fe	refact task backend	2023-10-08 18:16:45 +08:00
yihaoDeng	f49a2cbeb0	refact task backend	2023-10-08 18:14:17 +08:00
wangmm0220	b04d57fcc3	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056	2023-10-08 16:15:19 +08:00
wangmm0220	3f2d890560	feat:[TD-26056] add replay logic	2023-10-08 16:06:15 +08:00
Minglei Jin	ca809924cd	fix(tsdb/retention): free fopArr & fs snapshot resources	2023-10-08 15:10:54 +08:00
Hongze Cheng	ba27cc0605	fix: fid overflow	2023-10-08 14:54:24 +08:00
yihaoDeng	9d430c39ae	fix mem leak	2023-10-08 11:47:06 +08:00
wangmm0220	fb3197ea89	fix:test case error for reset=latest	2023-10-08 10:55:35 +08:00
liuyao	c75506b271	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-10-08 09:02:51 +08:00
Haojun Liao	ab17bfdf09	refactor: do some internal refactor.	2023-10-07 19:16:55 +08:00
liuyao	c088ee7f91	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-10-07 19:13:07 +08:00
yihaoDeng	97fdcbc60b	fix mem leak	2023-10-07 17:48:24 +08:00
kailixu	b9767707cb	chore: code optimization for array size	2023-10-07 15:57:26 +08:00
wangmm0220	9c470e9297	opti:set default offset to latest in subscription & return error if use snapshot when consume column	2023-10-07 15:25:24 +08:00
Hongze Cheng	d1e59b9e0e	enh: optimize merge strategy	2023-10-07 15:18:08 +08:00
Haojun Liao	7ce3d2c200	fix(stream): quit from loop when input queue is full.	2023-10-07 14:54:11 +08:00
yihaoDeng	fa70221238	refact task backend	2023-10-07 12:17:55 +08:00
kailixu	85226d05a3	chore: code refactor for time series	2023-10-07 09:30:32 +08:00
kailixu	6efe3845d4	chore: more logic	2023-10-07 07:02:16 +08:00
Haojun Liao	c20dd002fb	enh(stream): add more info for sink task.	2023-10-07 01:14:00 +08:00
kailixu	c70a1b77e6	chore: code optimization for time series	2023-10-07 00:17:21 +08:00
kailixu	c59498d90a	chore: code refactor for time series statis	2023-10-06 07:37:18 +08:00
kailixu	e4a86aa70a	chore: remove obsolete codes	2023-10-05 23:52:50 +08:00
kailixu	07f043f143	enh: exclude sys tbl for time series	2023-10-05 23:48:52 +08:00
kailixu	47e79ff5b7	enh: exclude sys tbl for time series	2023-10-05 23:45:54 +08:00
kailixu	d0a046c7a3	enh: exclude sys tbl for time series	2023-10-05 23:30:30 +08:00
kailixu	88fdeca5cf	enh: dnode notify logic	2023-10-05 22:31:25 +08:00
kailixu	086213a6c2	enh: dnode notify logic	2023-10-05 21:35:57 +08:00
Haojun Liao	5bf8d16ee1	refactor(stream): idle for 100ms when starting next round scan wal.	2023-10-04 23:33:03 +08:00
Haojun Liao	41ef1a45c1	enh(stream): optimize the scan wal perf	2023-10-04 22:06:46 +08:00
Haojun Liao	45e413f8d5	refactor: wait for 100ms before scan wal again.	2023-10-03 20:57:19 +08:00
Haojun Liao	5564eb215c	fix(stream): fix invalid check.	2023-10-03 00:38:24 +08:00
Haojun Liao	5718158fc0	refactor: do some internal refactor.	2023-10-01 22:27:29 +08:00
Haojun Liao	ff44539468	fix(stream): drop related fill-history task when dropping stream tasks.	2023-09-28 23:00:29 +08:00
Haojun Liao	31acbc6fe2	refactor: do some internal refactor (discard the checkpoint source msg during restoring).	2023-09-28 22:44:13 +08:00
Haojun Liao	f2d8431619	fix(stream): enable new time range for stream task.	2023-09-28 18:26:52 +08:00
yihaoDeng	bb265887e6	refact task backend	2023-09-28 17:07:19 +08:00
yihaoDeng	54e3ac2c1e	refact task backend	2023-09-28 15:46:12 +08:00
Haojun Liao	0047d1e1a6	Merge branch 'main' into fix/liaohj	2023-09-28 14:35:14 +08:00
Haojun Liao	0a8f4530f7	fix(tsdb): replace destroy with reset.	2023-09-28 11:42:19 +08:00
kailixu	b1a0912a61	enh: exclude systables in log/audit db	2023-09-28 10:15:34 +08:00
Haojun Liao	22e485d132	fix(stream): opt perf.	2023-09-28 09:25:23 +08:00
Haojun Liao	cc9b9d1054	Merge pull request #23102 from taosdata/fix/liaohj ... fix(stream): fix several bugs and do some internal refactor for stream processing.	2023-09-28 09:12:39 +08:00
Minglei Jin	cd811577f3	fix(vnode/cos): use EIO as object put errno	2023-09-27 15:10:34 +08:00
Minglei Jin	5ce1dd6284	fix(tsdb/readerwriter): fix fd writing	2023-09-27 14:02:37 +08:00
Haojun Liao	e13efd5b04	refactor: optimize the fill-history task launch policy, and do some other internal refactor.	2023-09-27 14:00:48 +08:00
Minglei Jin	e6287c1a89	fix(tsdb/readerwriter): fix var shadowing	2023-09-26 19:18:10 +08:00
liuyao	ebf4283e91	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-26 17:19:41 +08:00
kailixu	e1cd54a1b3	fix: rwlock reentrant problem on windows	2023-09-26 15:44:35 +08:00
kailixu	c680180894	fix: rwlock reentrant problem on windows	2023-09-26 15:37:29 +08:00
wade zhang	f6134b42d7	Merge pull request #23036 from taosdata/feat/TS-4011-3.0 ... feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db	2023-09-26 14:25:54 +08:00
Haojun Liao	890d658aea	refactor: do some internal refactor.	2023-09-26 14:11:45 +08:00
Haojun Liao	525ee369d3	Merge pull request #23032 from taosdata/fix/liaohj ... fix(stream): fix several stability-related bugs in stream framework.	2023-09-26 14:10:58 +08:00
Haojun Liao	f3f18b0fa3	fix(stream): add new status for meta.	2023-09-26 12:15:12 +08:00
liuyao	ca2325f886	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-26 10:41:31 +08:00
Hongze Cheng	03456ce443	fix: upgrade error when has tomb data	2023-09-26 09:23:22 +08:00
wade zhang	92f5803303	Merge pull request #23050 from taosdata/fix/TD-26478 ... fix(cos): use EIO as failed code	2023-09-26 09:02:59 +08:00
Haojun Liao	6cc3618ed9	fix(stream): fix error in pause scan-history data.	2023-09-26 01:09:55 +08:00
Haojun Liao	5a4a0aa0e3	fix(stream): fix invalid read and memory leak.	2023-09-25 23:10:33 +08:00
Minglei Jin	7fd7902dda	fix(cos): use EIO as failed code	2023-09-25 18:38:55 +08:00
Benguang Zhao	5d588cb7d2	enh: trigger failover if tsdbMerge failure	2023-09-25 17:22:38 +08:00
kailixu	126a371170	chore: more code	2023-09-25 16:24:03 +08:00
kailixu	0632fb838a	chore: code refactor	2023-09-25 16:17:57 +08:00
Haojun Liao	966ce4f30e	Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj	2023-09-25 16:00:02 +08:00
Haojun Liao	fcf4cc7169	fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.	2023-09-25 15:58:24 +08:00
kailixu	b0b4d782fc	chore: code refactor	2023-09-25 15:57:54 +08:00
Shungang Li	743a5b0640	feat: add db config item keep_time_offset	2023-09-25 15:46:08 +08:00
Haojun Liao	dbc53069db	Merge branch 'main' into fix/liaohj	2023-09-25 10:41:18 +08:00
Haojun Liao	eb4078b7f3	fix(stream): record the tasks started info, and do some internal refactor.	2023-09-25 09:59:05 +08:00
Haojun Liao	c987f61300	fix(stream): fix race condition.	2023-09-25 01:37:27 +08:00
kailixu	986788d4fe	enh: timeseries calculation	2023-09-24 09:14:52 +08:00
kailixu	ff3e36e679	enh: timeseries calculation	2023-09-24 08:41:45 +08:00
kailixu	53a9459c20	enh: update timeseries	2023-09-24 07:52:27 +08:00
Haojun Liao	4ea737571d	refactor: do some internal refactor.	2023-09-24 01:26:51 +08:00
kailixu	bc8ebf1562	Merge branch '3.0' into enh/TS-3812-3.0	2023-09-23 18:19:08 +08:00
Haojun Liao	b58ec1ee57	fix(stream): update logs.	2023-09-23 15:22:48 +08:00
Haojun Liao	acd3321494	fix(stream): rsp when checkpoint source failed.	2023-09-23 14:13:33 +08:00
Haojun Liao	7d5f76c6f1	fix(stream): disable auto rsp for checkpoint source.	2023-09-23 11:31:14 +08:00
Haojun Liao	5155519559	fix(stream): fix invalid assert.	2023-09-22 23:06:48 +08:00
Haojun Liao	cf6c255f22	refactor: do some internal refactor.	2023-09-22 22:50:21 +08:00
kailixu	8f828e052b	enh: timeseries calculation optimization	2023-09-22 20:07:51 +08:00
liuyao	0d983e28ef	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-22 19:25:41 +08:00
Haojun Liao	5b12e276cf	fix(stream): add msg identifier check.	2023-09-22 18:13:18 +08:00
yihaoDeng	11da631bb5	add cvt state	2023-09-22 09:08:42 +00:00
wade zhang	849b05a09b	Merge pull request #22927 from taosdata/fix/TD-26189 ... s3/block_cache: new tsdb block cache	2023-09-22 16:15:07 +08:00
liuyao	4f8e6d7795	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-22 15:00:52 +08:00
Haojun Liao	898aea5cfb	refactor(stream): refactor send msg.	2023-09-22 14:52:18 +08:00
Minglei Jin	4c151f2031	tsdb/readerwriter: remove size with download	2023-09-22 14:06:06 +08:00
Haojun Liao	7e4410f094	Merge pull request #22992 from taosdata/feat/TD-26052 ... feat:support vnode split in tmq	2023-09-22 13:57:21 +08:00
Haojun Liao	87ea745861	fix(stream): add some logs, and remove invalid assert.	2023-09-22 10:53:03 +08:00
Haojun Liao	f7bcff862d	fix(stream): add check info detailed information.	2023-09-22 10:23:56 +08:00
wangmm0220	19806cbcab	fix:memory leak	2023-09-22 10:12:11 +08:00
wangmm0220	5555371fbc	fix:memory leak	2023-09-22 10:04:53 +08:00
wangmm0220	86a4bfe28d	fix:memory leak	2023-09-22 10:02:16 +08:00
liuyao	dc2f7872f8	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-22 09:41:15 +08:00
wangmm0220	803b17a2db	fix:memory leak	2023-09-22 09:31:58 +08:00
Haojun Liao	b1ba716299	refactor: do some internal refactor.	2023-09-22 09:24:36 +08:00
Haojun Liao	b075b4438b	fix(stream): handle dispatch checkpoint-trigger failure.	2023-09-21 23:15:18 +08:00
Haojun Liao	3c921ba66e	Merge pull request #23006 from taosdata/fix/3_liaohj ... fix(tsdb): set the correct scaninfo to load the tomb data.	2023-09-21 22:13:16 +08:00
Haojun Liao	f93df639c1	fix(tsdb): set the correct scaninfo to load the tomb data.	2023-09-21 17:32:21 +08:00
Minglei Jin	ce1f866416	tsdb/reader: use pTsdb handle instead of pgsz to open file	2023-09-21 16:36:17 +08:00
kailixu	7445b9ff50	Merge branch '3.0' into enh/TS-3812-3.0	2023-09-21 16:25:06 +08:00
Haojun Liao	2efd155adf	fix(stream): wait for the task checkpoint before stop.	2023-09-21 15:53:21 +08:00
Haojun Liao	0f97a21163	fix(tsdb): set the correct scaninfo to load the tomb data.	2023-09-21 15:21:01 +08:00
Haojun Liao	e4073bd9a8	fix(stream): update logs.	2023-09-21 14:03:14 +08:00
Haojun Liao	09accc71d2	log(stream): update log.	2023-09-21 14:01:41 +08:00
Haojun Liao	17586af0ce	refactor: do refactor the sink task.	2023-09-21 13:32:57 +08:00
liuyao	3b3c5d7cb8	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174	2023-09-21 10:11:36 +08:00
wangmm0220	f9c5aa01af	fix:enable split if there are topics & fix memory leak	2023-09-21 09:20:34 +08:00
Haojun Liao	6633fb971b	fix(stream): update logs.	2023-09-20 18:18:31 +08:00
Minglei Jin	f206fa07d0	s3/put: use put2	2023-09-20 15:59:58 +08:00
Haojun Liao	2418f509ea	fix(stream): avoid invalid read.	2023-09-20 15:47:09 +08:00
Haojun Liao	1d1d9a1b0b	fix(stream): unlock when returning.	2023-09-20 15:45:15 +08:00
Haojun Liao	c8ab761d2a	fix(stream): return if failed.	2023-09-20 15:38:49 +08:00
Haojun Liao	2a781c509f	fix(stream): add task status check.	2023-09-20 15:32:15 +08:00
Minglei Jin	d155cfcf0f	tsdb/readerwriter: use tsdb's s3 block cache to read file page	2023-09-20 15:24:54 +08:00
liuyao	1cebda368a	session&state operator buff	2023-09-20 15:06:08 +08:00
Haojun Liao	af487c9048	fix(stream): fix obj.	2023-09-20 14:50:43 +08:00
Haojun Liao	361cde6497	fix(stream): fix deadlock caused by streamTaskHalt function.	2023-09-20 14:49:09 +08:00
Haojun Liao	55d4a9686c	log(tsdb): remove some logs.	2023-09-20 13:18:42 +08:00
dm chen	4497a01168	Merge branch 'main' into feat/TD-26127-audit-sql	2023-09-20 11:13:34 +08:00
Haojun Liao	392aaeb592	log(stream): remove logs.	2023-09-20 10:49:18 +08:00
Haojun Liao	779c0c5f19	Merge pull request #22970 from taosdata/fix/liaohj ... fix(stream): keep the status entry in hash table, instead entry index.	2023-09-20 10:33:05 +08:00
kailixu	a9d30f25d2	enh: rsma support delete raw data	2023-09-20 10:11:03 +08:00
wangmm0220	2881a2504c	fix:conflicts from 3.0	2023-09-19 18:39:40 +08:00
dmchen	1a7bffb079	ci break	2023-09-19 18:01:38 +08:00
Haojun Liao	b99232fd7a	fix(stream): limit the max scan times.	2023-09-19 17:45:28 +08:00
Haojun Liao	271e492188	refactor: update the log level.	2023-09-19 17:40:26 +08:00
wangmm0220	766652a88a	fix:vnode tranform support in tmq	2023-09-19 17:27:19 +08:00
dm chen	ee913cbfbc	Merge branch 'main' into feat/TD-26127-audit-sql	2023-09-19 14:39:20 +08:00
dmchen	e36ff1282c	revert dependency	2023-09-19 13:42:02 +08:00
wangmm0220	ad70dc178f	fix:conflicts from 3.0	2023-09-19 11:56:52 +08:00
wangmm0220	edb42aa2aa	fix:move from main to 3.0	2023-09-19 11:51:52 +08:00
Haojun Liao	e76bab7122	fix(stream): not handle the check msg for follower tasks.	2023-09-19 09:43:14 +08:00
slzhou	900aacd428	fix: fix sanitizer error	2023-09-19 09:40:00 +08:00
kailixu	6698861c8b	chore: timeseries distribute	2023-09-19 08:29:51 +08:00
Hongze Cheng	b1797834c1	fix: set snapshot writer compression	2023-09-18 20:58:20 +08:00
wangmm0220	1e859084b7	fix:conflicts from 3.0	2023-09-18 19:57:33 +08:00
wangmm0220	4b74135350	fix:vnode tranform support in tmq	2023-09-18 19:47:28 +08:00
Haojun Liao	101161c52e	Merge pull request #22954 from taosdata/fix/TD-26323 ... fix:core in race condition for pTq->pExecStore & return if poll too l…	2023-09-18 17:41:01 +08:00
Haojun Liao	c33ef4ce88	fix(stream): add null check	2023-09-18 15:14:51 +08:00
wangmm0220	c3498fbfe8	fix:core in race condition for pTq->pExecStore & return if poll too long & fix test cases if submit empty	2023-09-18 14:35:07 +08:00
wangmm0220	7869b693f2	add test case for tmq in vnode transform & fix core in race condition for pTq->pExecStore	2023-09-18 14:09:28 +08:00
dmchen	b473122dac	break dependency	2023-09-18 12:29:08 +08:00
dm chen	fda32dcc51	Merge branch 'main' into feat/TD-26127-audit-sql	2023-09-18 09:41:47 +08:00
dmchen	c674e025e2	skip auto create tb	2023-09-18 09:29:51 +08:00
kailixu	8111c18cc4	chore: merge 3.0	2023-09-18 09:20:43 +08:00
Haojun Liao	8aa9960760	Merge pull request #22944 from taosdata/fix/liaohj ... refactor: do some internal refactor, and fix some bugs.	2023-09-17 21:25:33 +08:00
Haojun Liao	01144c58a7	fix(stream): fix stream task id error.	2023-09-17 01:19:59 +08:00
Haojun Liao	4846194bbb	refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node.	2023-09-16 21:37:30 +08:00
Haojun Liao	caa7542cea	Merge pull request #22913 from taosdata/fix/liaohj ... fix(stream): fix error in drop task.	2023-09-16 21:36:38 +08:00
Haojun Liao	91e3d70796	fix(stream): remove fill-history sink task.	2023-09-15 17:46:17 +08:00
Minglei Jin	0181bb24d3	tsdb/readerwriter: use PRId64 instead of lld	2023-09-15 16:40:04 +08:00
Alex Duan	47f2c38a56	Merge pull request #22910 from taosdata/fix/TS-3987 ... fix: delete data error	2023-09-15 16:19:29 +08:00
Minglei Jin	318281356b	s3/block_cache: new tsdb block cache	2023-09-15 16:19:21 +08:00
kailixu	03aea454d7	chore: more code	2023-09-15 14:33:35 +08:00
wade zhang	b123dd7df3	Merge pull request #22904 from taosdata/FIX/TD-26292-main ... enh: ignore compact req during restoring	2023-09-15 11:05:18 +08:00
Haojun Liao	2bfd6e3355	refactor: do some internal refactor.	2023-09-15 09:25:22 +08:00
Haojun Liao	117de7ab7d	fix(stream): fix error in drop task.	2023-09-15 00:51:13 +08:00
Haojun Liao	500fcad36c	Merge pull request #22892 from taosdata/fix/liaohj ... refactor: do some internal refactor.	2023-09-15 00:46:46 +08:00
Haojun Liao	73c2782d78	fix(stream): update some logs.	2023-09-14 23:17:23 +08:00
Haojun Liao	5f55f489d8	fix(stream): fix memory leak.	2023-09-14 22:59:11 +08:00
Haojun Liao	303e8caf0c	fix(stream): set the correct guard flag.	2023-09-14 22:44:16 +08:00
kailixu	449092c5dc	enh: timeseries update optimize	2023-09-14 20:16:02 +08:00
Haojun Liao	27f626769e	fix(stream): fix memory leak.	2023-09-14 19:33:05 +08:00
Haojun Liao	f2c3e0a6e8	fix(stream): disable follower send hb to mnode. and do some internal refactor.	2023-09-14 17:22:31 +08:00
Hongze Cheng	925cc8f55f	fix: delete data error	2023-09-14 17:20:10 +08:00
Benguang Zhao	bbcbe460d4	enh: ignore compact req during restoring	2023-09-14 16:17:17 +08:00
Benguang Zhao	2886913fd8	enh: ignore compact req during restoring	2023-09-14 16:09:00 +08:00
Haojun Liao	fce5be0eb4	fix(stream): fix dead lock.	2023-09-14 14:09:05 +08:00
Haojun Liao	fd6344b319	fix(tsdb): check return code.	2023-09-14 09:25:35 +08:00
Haojun Liao	9b70c0c457	fix:fix coverity issue and remove unnecessary files.	2023-09-14 09:06:10 +08:00
wangmm0220	39fb5f4334	fix:add vnode snaphot for tmq	2023-09-13 18:09:47 +08:00
Haojun Liao	7305c8dbe1	refactor: do some internal refactor about the sched status set	2023-09-13 14:00:34 +08:00
wangmm0220	1dbd322fa0	fix:remove useless code	2023-09-13 11:42:09 +08:00
Haojun Liao	99477babca	Merge pull request #22872 from taosdata/fix/coverityScanDyh ... fix coverity scan problem	2023-09-13 09:18:27 +08:00
Haojun Liao	09a15bf340	refactor: do some internal refactor.	2023-09-12 22:07:52 +08:00
Haojun Liao	60f5056ab7	other: merge 3.0	2023-09-12 22:00:40 +08:00
Haojun Liao	f6a097d96f	refactor: do some internal refactor.	2023-09-12 21:58:22 +08:00
Haojun Liao	4325a0a433	Merge pull request #22866 from taosdata/fix/3_liaohj ... refactor: do some internal refactor.	2023-09-12 21:56:44 +08:00
yihaoDeng	8fc33dd74d	fix coverity scan problem	2023-09-12 18:52:16 +08:00
Haojun Liao	e457d94ac6	refactor: do some internal refactor.	2023-09-12 18:09:02 +08:00
yihaoDeng	8e064cdd03	fix merge error	2023-09-12 16:41:14 +08:00
Haojun Liao	4d33387e80	Merge pull request #22814 from taosdata/fix/fixTransferCrash2 ... fix merge error	2023-09-12 16:10:07 +08:00
Haojun Liao	52931b530d	Merge pull request #22855 from taosdata/fix/3_liaohj ... fix(stream):check error when vnode is closing.	2023-09-12 15:58:02 +08:00
dapan1121	ef7eb478e4	Merge pull request #22834 from taosdata/fix/TS-3945 ... fix: remove incorrect assert	2023-09-12 15:55:51 +08:00
yihaoDeng	63c53b6a3a	fix transfer crash	2023-09-12 15:03:13 +08:00
yihaoDeng	ccb75a9c11	fix transfer crash	2023-09-12 14:46:56 +08:00
yihaoDeng	3e48f3639c	fix transfer crash	2023-09-12 14:46:32 +08:00
wade zhang	f4e785788a	Merge pull request #22833 from taosdata/fix/TS-3943-3.m ... fix: neighbor block overlap judgement	2023-09-12 11:51:03 +08:00
Haojun Liao	93159729f6	fix(stream):check error when vnode is closing.	2023-09-12 11:45:51 +08:00
Haojun Liao	025a2a3b50	Merge pull request #22846 from taosdata/fix/3_liaohj ... fix(tsdb): check the schema before merge rows in buffer	2023-09-12 11:43:27 +08:00
yihaoDeng	6ce85f5cae	fix transfer crash	2023-09-12 10:44:56 +08:00
Haojun Liao	f602aa965f	fix(stream): fix coverity scan issues.	2023-09-12 09:16:18 +08:00
Haojun Liao	a5b93aaf97	fix(tsdb): fix invalid read.	2023-09-11 23:55:34 +08:00
Haojun Liao	e8f7146a2c	fix(tsdb): check the schema before merge rows in buffer, and do some refactor.	2023-09-11 22:19:10 +08:00
Haojun Liao	cd1f0ea414	Merge pull request #22826 from taosdata/fix/3_liaohj ... fix(stream): set the correct start version for the step 2 stage in fill history.	2023-09-11 21:43:58 +08:00
Haojun Liao	5ab739ae46	fix(stream): fix memory leak.	2023-09-11 15:29:12 +08:00
dapan1121	5c21f1ca22	fix: remove incorrect assert	2023-09-11 15:16:22 +08:00
kailixu	78d136dffd	fix: neighbor block overlap judgement	2023-09-11 15:10:39 +08:00
Haojun Liao	c729fc989f	fix(stream): set the init start timestamp.	2023-09-11 13:49:43 +08:00
Haojun Liao	0980e021e5	fix(stream): set the correct start version for the step 2 stage in fill history.	2023-09-11 13:37:19 +08:00
Haojun Liao	50ef500f51	refactor(stream): do sink module refactor.	2023-09-11 10:09:31 +08:00
Minglei Jin	443756c6ff	fix(meta): null txn after abort	2023-09-11 08:55:30 +08:00
Haojun Liao	372747cc23	Merge pull request #22818 from taosdata/fix/3_liaohj ... fix(stream): fix error in fill history and check quit status of vnode.	2023-09-10 20:47:06 +08:00
Haojun Liao	85a5c45098	fix(stream): limit the already processed data.	2023-09-10 00:01:25 +08:00
Haojun Liao	9a30573b8b	fix(stream): disable scan wal when halt is set.	2023-09-09 16:12:08 +08:00
Haojun Liao	aa8909b267	other: add some logs.	2023-09-09 15:18:54 +08:00
Haojun Liao	6f5c855a4b	fix(stream): fix msg lost bug.	2023-09-09 15:08:36 +08:00
Haojun Liao	47fd144447	other: add some logs.	2023-09-09 11:19:51 +08:00
yihaoDeng	af08289a06	Merge branch 'fix/mainNew' into fix/fixTransferCrash2	2023-09-08 19:58:21 +08:00
yihaoDeng	a0494695de	fix merge error	2023-09-08 19:48:06 +08:00
Haojun Liao	b317c8ebff	fix(stream): disable merge submit blocks.	2023-09-08 12:46:15 +08:00
Benguang Zhao	55a9668908	fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord	2023-09-07 17:26:30 +08:00
Benguang Zhao	2d5b18039d	fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord	2023-09-07 17:14:50 +08:00
wade zhang	d3f0c5ac3e	Merge pull request #22770 from taosdata/fix/TD-25445-main ... fix/TD-25445: search memory in ttlMgrFindExpired	2023-09-07 16:13:32 +08:00
Haojun Liao	55ac835294	Merge branch 'main' into fix/3_liaohj	2023-09-07 11:47:25 +08:00
Haojun Liao	b240e91c91	enh(stream): add token bucket to limit the rate of sink operation.	2023-09-07 09:58:48 +08:00
Shungang Li	a6ba7e678f	fix: search memory in ttlMgrFindExpired	2023-09-07 09:33:26 +08:00
Haojun Liao	0f909285c4	Merge pull request #22684 from taosdata/mark/tmq-3.0 ... fix:use vgstatus before if rebalance	2023-09-07 09:20:27 +08:00
Haojun Liao	2b84e0b02e	refactor: check if the put data into queue is success or failed.	2023-09-06 19:39:00 +08:00
Haojun Liao	8edf86b3bb	fix(stream): add some logs.	2023-09-06 19:08:09 +08:00
Haojun Liao	5ba6a68e7a	fix(stream): fix syntax error.	2023-09-06 19:00:39 +08:00
Haojun Liao	a82027f492	enh(stream): pack multi-datablock into one submit message.	2023-09-06 18:58:47 +08:00
wade zhang	e493f983ed	Merge pull request #22735 from taosdata/fix/TD-26133 ... fix: coverity scan	2023-09-06 18:45:23 +08:00
Haojun Liao	f8a321695a	Merge pull request #22711 from taosdata/fix/TD-26069-1 ... fix rc	2023-09-06 17:58:33 +08:00
Hongze Cheng	1d343fa57e	more fix	2023-09-06 17:10:36 +08:00
Haojun Liao	926cc01cff	refactor: do some internal refactor.	2023-09-06 16:48:43 +08:00
Hongze Cheng	cd88c8ec31	fix: little test	2023-09-06 14:45:53 +08:00
Haojun Liao	b382cba58c	fix(stream): fix syntax error.	2023-09-06 14:37:58 +08:00
Haojun Liao	236b363996	fix(stream): fix syntax error.	2023-09-06 14:37:11 +08:00
Haojun Liao	8783ebcb02	enh(stream): add some logs and record the submit package performance.	2023-09-06 14:34:36 +08:00
Hongze Cheng	a6743a31b5	Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-26133	2023-09-06 14:12:21 +08:00
dapan1121	698b0b21f7	Merge pull request #22630 from taosdata/enh/TS-3812-3.0 ... enh: report time series by period and quantity	2023-09-06 13:38:24 +08:00
Haojun Liao	e607a0a5cb	fix(stream): add some logs.	2023-09-06 11:39:07 +08:00
dmchen	231ba12f70	feat/TD-26127	2023-09-06 11:00:24 +08:00
Haojun Liao	c86eeb3938	fix(stream): add task status check when waiting for the table create.	2023-09-06 10:58:33 +08:00
wangmm0220	ef87b9c571	fix:conflicts from 3.0	2023-09-05 16:19:04 +08:00
wangmm0220	4e46ce4c03	fix:wait pHandle idle if vnode receives subscribe msg	2023-09-05 16:04:44 +08:00
Haojun Liao	ac8f4f1558	Merge pull request #22736 from taosdata/fix/fixTransferCrash ... fix invalid read	2023-09-05 15:42:03 +08:00
yihaoDeng	d0503a8a3f	fix invalid read	2023-09-05 12:11:58 +08:00
Hongze Cheng	8dbdeccc8f	fix: coverity scan	2023-09-05 11:41:36 +08:00
wade zhang	8f27724f1f	Merge pull request #22701 from taosdata/fix/test_1x ... test: add stream cases to main	2023-09-05 10:57:38 +08:00
Haojun Liao	0441c7a870	Merge branch 'fix/3_liaohj' of github.com:taosdata/tdengine into fix/3_liaohj	2023-09-05 10:40:48 +08:00
Haojun Liao	5b3cb8ec42	fix(stream): fix memory leak.	2023-09-05 09:27:16 +08:00
Haojun Liao	db8073dadd	fix(stream): fix memory leak.	2023-09-04 23:13:57 +08:00
Haojun Liao	77eed06bcd	Merge branch '3.0' into fix/3_liaohj	2023-09-04 18:51:07 +08:00
Haojun Liao	aeea699c9c	Merge branch '3.0' into fix/3_liaohj	2023-09-04 15:53:39 +08:00
Haojun Liao	ed22dd5f26	fix(stream): fix deadlock caused during merging branch.	2023-09-04 14:09:39 +08:00
Haojun Liao	375d0abea5	fix(stream): merge main.	2023-09-04 13:12:53 +08:00
Haojun Liao	21dab8ceab	other: merge 3.0	2023-09-04 13:08:19 +08:00
yihaoDeng	03cddfa7ce	fix rc	2023-09-04 10:33:01 +08:00
wangmm0220	fd85d5885a	fix:add limit time for consume in 1 seconds	2023-09-01 16:57:49 +08:00
wangmm0220	02ac3eac5a	fix:logic error	2023-09-01 16:51:44 +08:00
Haojun Liao	4fee5ba59a	fix(stream): even in ck, start stream tasks.	2023-09-01 14:40:30 +08:00
dapan1121	cc17848b78	fix: merge 3.0 to main	2023-09-01 13:24:47 +08:00
dapan1121	2141ac8460	Merge remote-tracking branch 'origin/main' into fix/m23.2	2023-09-01 11:21:38 +08:00
Hongze Cheng	113867081e	enh: upgrade more efficiently	2023-09-01 10:16:10 +08:00
dapan1121	228e6c6acd	Merge remote-tracking branch 'origin/main' into 3.0	2023-09-01 10:01:10 +08:00
Haojun Liao	e8294ed8dc	fix(stream): fix bug in multi-replica vnode redistribute.	2023-09-01 03:10:12 +08:00
Haojun Liao	e816d0efa5	Merge pull request #22669 from taosdata/fix/TD-26069 ... fix invalid insert	2023-08-31 18:29:25 +08:00
wangmm0220	a02ab4ccfb	fix:coredump if saved epoch bigger than request epoch & modify test cases	2023-08-31 17:35:41 +08:00
yihaoDeng	1833be028f	fix invalid insert	2023-08-31 15:28:31 +08:00
yihaoDeng	9fd0bff673	fix invalid insert	2023-08-31 14:57:26 +08:00
Haojun Liao	92e258617a	refactor: do some internal refactor.	2023-08-31 14:31:45 +08:00
Haojun Liao	e2bb64eb18	refactor: do some internal refactor.	2023-08-31 14:23:46 +08:00
Haojun Liao	3fc3dafca6	refactor: do some internal refactor.	2023-08-31 13:46:48 +08:00
Haojun Liao	e53b5d4392	refactor: do some internal refactor.	2023-08-31 11:01:53 +08:00
Haojun Liao	0facde6ddc	Merge pull request #22659 from taosdata/fix/TD-26035 ... fix(stream): do not restart the stream tasks when it is running.	2023-08-31 10:16:59 +08:00
Haojun Liao	0c599fa869	Merge pull request #22415 from taosdata/szhou/tsdb-neigh-block ... tsdb neighbouring block search and set it to global block iterator	2023-08-31 09:46:37 +08:00
wangmm0220	7f2a9a7262	fix:cancel the limit time for consume	2023-08-31 09:07:40 +08:00
wade zhang	68e4a72021	Merge pull request #22643 from taosdata/feat/audit-user-typestr ... alter user type to str	2023-08-31 07:59:31 +08:00
wangmm0220	4f20359f43	fix:modify log level to trace	2023-08-30 23:57:48 +08:00
Haojun Liao	a2c6e4306a	fix(stream): reset the counter.	2023-08-30 20:20:20 +08:00
Haojun Liao	fd2f988cdb	fix(stream): reset the counter.	2023-08-30 20:19:51 +08:00
Haojun Liao	5d23df100c	fix(stream): ignore the fill-history tasks.	2023-08-30 19:07:06 +08:00
Haojun Liao	65eaa9b15f	fix(stream): add task release.	2023-08-30 19:06:12 +08:00
wangmm0220	23c4d7eb0a	fix:dead lock	2023-08-30 18:10:19 +08:00
dmchen	3d9274d713	create table db name	2023-08-30 17:28:03 +08:00
Haojun Liao	d99d8875e1	fix(stream): if stream task is running, do not recheck its status.	2023-08-30 17:24:13 +08:00
Haojun Liao	c5b279f045	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-30 16:01:08 +08:00
Haojun Liao	24b1a050fc	other: merge 3.0	2023-08-30 16:00:14 +08:00
liuyao	0a72e576bd	op stream pause ... pause data dispatch opt stream pause	2023-08-30 14:53:49 +08:00
kailixu	1a34cd1020	chore: optimize of report time series by quantity	2023-08-30 11:45:07 +08:00
kailixu	8e20740622	enh: report time series by quantity	2023-08-30 11:39:21 +08:00
dapan1121	f6321d0c4f	Merge remote-tracking branch 'origin/main' into fix/m23.1	2023-08-30 11:03:33 +08:00
Haojun Liao	dec4d69529	fix(stream): set correct user-define table name in sink table info cache.	2023-08-30 10:52:39 +08:00
Haojun Liao	3a7a220d43	fix(stream): fix error found by ci.	2023-08-30 10:14:01 +08:00
kailixu	9d1ac801ed	Merge branch '3.0' into enh/TS-3812-3.0	2023-08-30 09:27:17 +08:00
Haojun Liao	610132e29a	Merge pull request #22633 from taosdata/fix/update_db_attr ... fix(tsdb): add more check for block rows	2023-08-29 22:05:57 +08:00
wade zhang	701ac939c1	Merge pull request #22632 from taosdata/fix/ttl ... fix/TD-26032: ttl cache entry record the original information for deletion	2023-08-29 18:27:50 +08:00
Haojun Liao	8dadae5d3a	fix(stream): fix invalid read.	2023-08-29 18:24:32 +08:00
Haojun Liao	d6368798da	fix(query): disable the set quit flag for tsdbreader.	2023-08-29 18:11:17 +08:00
Haojun Liao	b740ce8ad6	fix(tsdb): add more check for block rows to detect the duplicate rows in data block.	2023-08-29 17:49:43 +08:00
Haojun Liao	204fb97f68	fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task.	2023-08-29 17:34:31 +08:00
Shungang Li	df2b2484df	fix: ttl cache entry record the original information for deletion	2023-08-29 17:18:22 +08:00
Minglei Jin	82fc1f41fb	fix(tsdb/cache read): remove all null row	2023-08-29 16:15:00 +08:00
kailixu	f00596868f	fix: remove duplicated line	2023-08-29 16:12:49 +08:00
kailixu	db07511c93	enh: report time series by period and quantity	2023-08-29 16:08:51 +08:00
wade zhang	53a24e04f2	Merge pull request #22604 from taosdata/feat/audit-db-detail ... audit db detail	2023-08-29 15:46:10 +08:00
Haojun Liao	6e4acddd96	Merge pull request #22603 from taosdata/fix/TD-25962 ... fix:unregister push manager if delete subscribe to avoid tqProcessPol…	2023-08-29 10:58:49 +08:00
Minglei Jin	432eaf5110	Merge branch '3.0' into fix/TD-25963	2023-08-29 10:51:53 +08:00
Minglei Jin	b88d79d2ef	fix(tsdb/open fs): fix retval	2023-08-29 10:33:20 +08:00
wade zhang	ff6de8ebe2	Merge pull request #22600 from taosdata/fix/TD-25010-10 ... enh(s3/evict): evict cache data files for other migrated head, stt, etc.	2023-08-28 18:12:40 +08:00
dmchen	1372cede48	init	2023-08-28 17:44:10 +08:00
dapan1121	778e50da79	Merge pull request #22592 from taosdata/fix/m23.0 ... Fix/m23.0	2023-08-28 17:35:35 +08:00
wangmm0220	2e04d513a4	fix:unregister push manager if delete subscribe to avoid tqProcessPollPush	2023-08-28 16:41:28 +08:00
Minglei Jin	9ef455a454	enh(s3/evict): evict cache data files for other migrated head, stt, etc.	2023-08-28 15:57:13 +08:00
Haojun Liao	05bb164675	fix(stream): release tasks.	2023-08-28 15:56:02 +08:00
Haojun Liao	391103bc5a	fix(stream): do dome internal refactor.	2023-08-28 15:54:01 +08:00
Haojun Liao	33672f2f35	fix(stream): release stream tasks.	2023-08-28 15:52:54 +08:00
wade zhang	cd3702e91c	Merge pull request #22596 from taosdata/fix/TD-25963 ... fix(tsdb/s3): fix scan and fix with s3 files	2023-08-28 15:19:47 +08:00
Minglei Jin	f299ae9bc3	fix(tsdb/s3): fix scan and fix with s3 files	2023-08-28 12:22:53 +08:00
Haojun Liao	da0b4e1f92	Merge branch '3.0' into enh/triggerCheckPoint2	2023-08-28 10:55:38 +08:00
dapan1121	0cce255a02	Merge remote-tracking branch 'origin/3.0' into fix/m23.0	2023-08-28 10:06:53 +08:00
Haojun Liao	b75ae217f6	fix(stream): notify close for snode.	2023-08-28 09:53:08 +08:00
Haojun Liao	b11975f00c	Merge pull request #22534 from taosdata/mark/tmq ... fix:[TD-258900]modify tmq trans conflict to db level	2023-08-28 09:45:47 +08:00
dapan1121	1f40da6fef	Merge remote-tracking branch 'origin/main' into 3.0	2023-08-28 09:28:55 +08:00
dmchen	06083e1eb9	init	2023-08-28 09:15:51 +08:00
dapan1121	cda08087b9	Merge pull request #22586 from taosdata/fix/TD-25936.3 ... fix: no explain response issue	2023-08-28 08:52:13 +08:00
Haojun Liao	6b327886e9	fix(stream): add null ptr check.	2023-08-27 00:27:04 +08:00
Haojun Liao	d8a6ec024a	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-25 19:21:00 +08:00
Haojun Liao	7ceb8dc627	fix(stream): disable the follower to execute the stop/resume instruction.	2023-08-25 19:20:49 +08:00
yihaoDeng	22b8d90fbc	fix invalid read	2023-08-25 18:34:11 +08:00
wangmm0220	047707fa17	fix:error in privilege	2023-08-25 17:56:17 +08:00
Haojun Liao	43a3f9f535	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-25 17:32:50 +08:00
Haojun Liao	e013ba6795	fix(stream): fix the counter.	2023-08-25 17:32:34 +08:00
Minglei Jin	f0fdbaa3f3	fix(tsdb/close): fix uaf with file closing	2023-08-25 17:27:32 +08:00
Haojun Liao	60d1df0e25	Merge branch '3.0' into enh/triggerCheckPoint2	2023-08-25 15:49:28 +08:00
Haojun Liao	ab2aad2b2c	fix(stream): update the task status even it is in stop status.	2023-08-25 15:32:55 +08:00
dapan1121	e24498b0fd	enh: add task notify	2023-08-25 14:59:34 +08:00
Hongze Cheng	e1095e7d02	fix: improve upgrade speed	2023-08-25 14:40:29 +08:00
Haojun Liao	4c7ad54c9c	fix(stream): not restart tasks when in restoring procedure.	2023-08-25 11:28:28 +08:00
Haojun Liao	38bb123701	fix(stream): release task.	2023-08-25 10:33:15 +08:00
Haojun Liao	ce1a3a379c	fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived.	2023-08-25 10:12:12 +08:00
Haojun Liao	6f514b2bee	Merge pull request #22561 from taosdata/fix/TD-25651 ... fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no…	2023-08-25 09:09:41 +08:00
wade zhang	abe97e1e21	Merge pull request #22566 from taosdata/fix/TD-25952 ... enh(tsdb/openfile): lazy file open to read/write	2023-08-25 07:57:52 +08:00
Haojun Liao	f7ea875af1	fix(stream): add some logs.	2023-08-24 23:27:48 +08:00
Haojun Liao	f7dada53b9	Merge pull request #22559 from taosdata/fix/liaohj ... other: merge main.	2023-08-24 19:01:18 +08:00
Haojun Liao	82e356a9b5	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/dnode/vnode/src/tq/tq.c	2023-08-24 18:04:44 +08:00
Haojun Liao	70396aa5a5	fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure.	2023-08-24 17:54:50 +08:00
yihaoDeng	286ac3e3fc	fix merge error	2023-08-24 17:35:53 +08:00
yihaoDeng	9310d138a6	Merge branch 'enh/3.0' into enh/triggerCheckPoint2	2023-08-24 17:30:35 +08:00
yihaoDeng	8883d66227	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-08-24 17:20:12 +08:00
yihaoDeng	090515c684	refactor code	2023-08-24 17:20:04 +08:00
Haojun Liao	caf20d7b5d	fix(stream): release the stream task.	2023-08-24 17:16:34 +08:00
Minglei Jin	70871139bf	enh(tsdb/openfile): lazy file open to read/write	2023-08-24 17:16:28 +08:00
wangmm0220	b83cc11043	fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no data	2023-08-24 16:38:53 +08:00
wangmm0220	49216ffa54	fix:transaction in tmq	2023-08-24 16:32:15 +08:00
Haojun Liao	7d9d4ae850	fix(stream): fix the ptr ref.	2023-08-24 16:26:30 +08:00
Haojun Liao	5344efe181	fix(stream): adjust the ptr.	2023-08-24 16:22:24 +08:00
Haojun Liao	4c6bc4d2c3	fix(stream): continue check wal when meeting empty delete block msg.	2023-08-24 16:10:03 +08:00
Haojun Liao	523bad3951	fix(stream): continue check wal when meeting empty delete block msg.	2023-08-24 15:45:43 +08:00
Haojun Liao	2c9f28d97f	Merge branch 'main' into fix/liaohj	2023-08-24 14:12:15 +08:00
wangjiaming0909	7fad1de841	Revert "feat: show create table, desc table with col comments" ... This reverts commit 16754b5ac1.	2023-08-24 13:38:41 +08:00
wade zhang	0860670d37	Merge pull request #22526 from taosdata/enh/TD-25445-new ... enh/TD-25445: ttl split flush and drop table	2023-08-24 13:57:07 +08:00
shenglian-zhou	e76e6bbb84	Update tsdbReadUtil.c	2023-08-24 11:34:56 +08:00
shenglian-zhou	1965703d53	Merge branch '3.0' into szhou/tsdb-neigh-block	2023-08-24 10:58:23 +08:00
yihaoDeng	3afea998ac	refactor log	2023-08-24 10:15:15 +08:00
Haojun Liao	230d8c2d80	fix(stream): fix error in stream computing after vnode is transferred to other dnodes.	2023-08-23 17:50:44 +08:00
Haojun Liao	b0c5fa8290	fix(stream): reset the task status.	2023-08-23 14:10:41 +08:00
Hongze Cheng	a601cd21bd	fix: alter stt_trigger bug	2023-08-23 13:31:19 +08:00
Shungang Li	458fd07976	enh: ttl split flush and drop table ... config: 1. ttlFlushThreshold: maximum number of dirty items in memory 2. tsTtlBatchDropNum: number of tables dropped per batch 3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups	2023-08-23 11:13:34 +08:00
wade zhang	8c4062c1b0	Merge pull request #22515 from taosdata/fix/TD-25819-2 ... fix(tsdb/file): save errno for shell reporting	2023-08-23 10:49:48 +08:00
wade zhang	e069d72229	Merge pull request #22513 from taosdata/FIX/TD-25864-3.0 ... enh: adjust the order of pre-close actions in vnodePreClose	2023-08-22 17:27:17 +08:00
Haojun Liao	af80d94a88	refactor: do some internal refactor.	2023-08-22 15:43:50 +08:00
Minglei Jin	345743aba5	fix(tsdb/file): save errno for shell reporting	2023-08-22 14:44:32 +08:00
Haojun Liao	cc8b2263cb	fix(stream): fix error in heartbeat from vnode.	2023-08-22 13:37:38 +08:00
Benguang Zhao	8be670aee8	enh: place vnodeSyncPreStop ahead of vnodeQueryPreStop in vnodePreClose	2023-08-22 11:30:40 +08:00
Haojun Liao	64556c9f1d	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-22 10:47:02 +08:00
Haojun Liao	def0877980	fix(stream): add timer to check stream task status.	2023-08-22 10:46:49 +08:00
dm chen	b899a8b7df	Merge branch '3.0' into feat/TD-22970	2023-08-22 10:12:30 +08:00
yihaoDeng	1531e2d7d3	Merge branch 'enh/3.0' into enh/triggerCheckPoint2	2023-08-22 09:51:38 +08:00
Haojun Liao	873c22abb1	fix(stream): reset update stream tasks.	2023-08-21 19:32:27 +08:00
Haojun Liao	8b27f98ee4	refactor: do some internal refactor.	2023-08-21 19:08:27 +08:00
yihaoDeng	387b4d365e	refactor checkpoint	2023-08-21 19:07:15 +08:00
Hongze Cheng	b8d62a86ed	feat: clean useless file	2023-08-21 16:29:48 +08:00
Haojun Liao	29bb5854cc	fix(stream): fix error in check stream state.	2023-08-21 11:48:55 +08:00
dm chen	dda51d8019	Merge branch '3.0' into feat/TD-22970	2023-08-21 10:50:45 +08:00
wade zhang	54e1f69db4	Merge pull request #22481 from taosdata/fix/TD-25822 ... enh(tsdb/write): timestamp out of range with s3's last tier storage	2023-08-21 09:33:06 +08:00
yihaoDeng	6fe649c458	Merge branch 'enh/3.0' into enh/triggerCheckPoint2	2023-08-21 09:12:40 +08:00
Haojun Liao	b8101afbe2	fix(stream): refactor the tasks restart mechanism.	2023-08-18 22:36:38 +08:00
Minglei Jin	c4a3a5da35	vnode: fix write to s3 last tier	2023-08-18 18:02:53 +08:00
wade zhang	a7e11c2520	Merge pull request #22482 from taosdata/fix/TD-25818 ... fix(vnode/destroy): delete objects	2023-08-18 17:49:22 +08:00
wade zhang	87a8fe34ef	Merge pull request #22480 from taosdata/fix/TD-25819 ... fix(tsdb/reader): use ENOENT for not found objects	2023-08-18 16:49:54 +08:00
Minglei Jin	7b4bb72392	fix(vnode/destroy): delete objects	2023-08-18 16:38:26 +08:00
Minglei Jin	0242d4ce33	enh(tsdb/write): timestamp out of range with s3's last tier storage	2023-08-18 16:07:15 +08:00
Haojun Liao	c26d625152	Merge branch '3.0' into enh/triggerCheckPoint2	2023-08-18 15:51:07 +08:00
Minglei Jin	73ae493fa7	tsdb/reader: use ENOENT for not found objects	2023-08-18 15:43:08 +08:00
liuyao	9afd5155ed	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-08-18 15:33:37 +08:00
liuyao	87c65f3b68	Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2	2023-08-18 15:27:02 +08:00
dapan1121	9b953707b8	Merge remote-tracking branch 'origin/main' into fix/mainto3.0	2023-08-18 14:42:43 +08:00
Haojun Liao	edbad45772	other: add logs.	2023-08-18 13:45:08 +08:00
dm chen	e393a98ee9	Merge branch '3.0' into feat/TD-22970	2023-08-18 13:37:18 +08:00
Haojun Liao	a8b53c2e69	other: add logs.	2023-08-18 10:51:59 +08:00
Haojun Liao	633ecf66e5	other: add logs.	2023-08-18 10:39:32 +08:00
Haojun Liao	9ad8cf48dc	other: add logs.	2023-08-18 10:38:24 +08:00
Haojun Liao	87785b1d9c	refactor: add some logs.	2023-08-18 10:30:00 +08:00
slzhou	4e2a26e8be	Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan	2023-08-18 08:46:17 +08:00
Hongze Cheng	8582e0c71a	fix: important fix for compact file corruption	2023-08-17 18:13:37 +08:00
dmchen	5f138941f8	tsdb snap core	2023-08-17 17:58:35 +08:00
slzhou	85d1dbe00a	Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan	2023-08-17 16:27:37 +08:00
Benguang Zhao	7735e6f388	Merge branch 3.0 to FEAT/TD-25699-3.0	2023-08-17 16:04:23 +08:00
shenglian zhou	4a9391929c	fix: select tags - ctb cursor pause/unlock and lock/resume	2023-08-17 14:59:17 +08:00
dapan1121	0e10e94a40	Merge pull request #22453 from taosdata/feat/TD-25685 ... feat: support column comment	2023-08-17 14:23:54 +08:00
wangjiaming0909	16754b5ac1	feat: show create table, desc table with col comments	2023-08-17 11:39:34 +08:00
liuyao	5ce7688a93	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor	2023-08-17 09:06:46 +08:00
wade zhang	e493a30a0b	Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug ... fix: tsdb snapshot bug	2023-08-17 08:25:32 +08:00
Haojun Liao	6746339609	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/libs/stream/src/streamSnapshot.c	2023-08-17 00:08:44 +08:00
Haojun Liao	ea6574b3c7	other: merge 3.0	2023-08-17 00:07:55 +08:00
Haojun Liao	f8f8e7a8f0	Merge pull request #22465 from taosdata/fix/3_liaohj ... fix(stream): add the back pressure for sink node.	2023-08-16 22:59:36 +08:00
yihaoDeng	114df7c349	fix transfer error	2023-08-16 11:37:15 +00:00
Haojun Liao	80506b564b	Merge pull request #22461 from taosdata/fix/liaohj ... refactor: do some internal refactcor	2023-08-16 19:26:39 +08:00
Haojun Liao	9a76ae72d6	fix(stream): add the back pressure for sink node.	2023-08-16 19:11:43 +08:00
Hongze Cheng	32c5b6a947	fix: tsdb snapshot bug	2023-08-16 18:21:02 +08:00
Haojun Liao	cbd24bb254	refactor: do some internal refactor	2023-08-16 18:20:34 +08:00
dmchen	fee4b875d1	error code	2023-08-16 17:49:17 +08:00
Hongze Cheng	cedc7bf1b6	fix: memory leak when commit	2023-08-16 17:21:51 +08:00
yihaoDeng	ab7e2b3122	Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2	2023-08-16 09:00:30 +00:00
dm chen	e020c4e8c5	Merge pull request #22456 from taosdata/3.0 ... merge 3.0 to feat/TD-22970	2023-08-16 16:49:43 +08:00
Haojun Liao	f1359076c1	Merge pull request #22450 from taosdata/fix/3_liaohj ... other: merge main.	2023-08-16 16:48:33 +08:00
Haojun Liao	d63758a1c5	fix(stream): fix error in execute task on a tranferred node.	2023-08-16 15:24:24 +08:00
yihaoDeng	993ae84398	close backend	2023-08-16 07:17:15 +00:00
Haojun Liao	4ea58e5682	refactor: do some internal refactor.	2023-08-16 11:44:05 +08:00
Haojun Liao	6609882f9f	fix(tsdb): add stt statistics block buffer, and do some internal refactor.	2023-08-16 10:55:07 +08:00
dmchen	de5aedd8f3	vnode.json	2023-08-16 10:20:48 +08:00
liuyao	919ffbaf72	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor	2023-08-16 10:04:07 +08:00
Haojun Liao	63bc50a723	Merge pull request #22427 from taosdata/feature/rebuildIndex0 ... rebuild index at tag0	2023-08-16 09:47:43 +08:00
liuyao	fc09f8ef1e	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor	2023-08-16 09:36:28 +08:00
Haojun Liao	ad9f3cbc43	other: merge main.	2023-08-16 09:14:10 +08:00
Haojun Liao	7628be236d	other: merge main.	2023-08-16 09:03:54 +08:00
dapan1121	df13c6fa3e	Merge pull request #22410 from taosdata/szhou/tag-scan-opt ... enhance: tag scan optimization	2023-08-16 08:58:17 +08:00
wade zhang	1a1a12b7b8	Merge pull request #22327 from taosdata/fix/TD-25010-3 ... feat(tsdb/cos): s3 migration	2023-08-16 08:02:20 +08:00
slzhou	4fdaaba3ce	Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt	2023-08-15 17:18:25 +08:00
Benguang Zhao	239a79d405	enh: add some vnode info in SStatusReq	2023-08-15 17:06:33 +08:00
Minglei Jin	1792bf306e	vnode: fix cos cache evicting	2023-08-15 16:54:26 +08:00
Haojun Liao	39079ab64a	fix(stream): load term from sync model to decide if the node is restart or not	2023-08-15 15:52:06 +08:00
Minglei Jin	c4e5cfd2fb	retention: return code from copy	2023-08-15 15:40:40 +08:00
Minglei Jin	bd758e0269	retention: remove old files last	2023-08-15 15:14:34 +08:00
Minglei Jin	8639c22cc0	vnode, common: USE_COS def	2023-08-15 14:53:58 +08:00
liuyao	1b4e51ee4a	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor	2023-08-15 14:20:49 +08:00
Haojun Liao	b1d35f43ba	enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.	2023-08-15 09:25:05 +08:00
Haojun Liao	ff17763ed6	Merge pull request #22417 from taosdata/mark/tmq ... opti:wal logic	2023-08-15 09:16:29 +08:00
Haojun Liao	9e3733a02c	Merge pull request #22358 from taosdata/feat/TD-24559 ... feat:[TD-24559]support geomety type in schemaless	2023-08-14 22:06:41 +08:00
liuyao	9d1e5a512d	add stream task id	2023-08-14 17:52:39 +08:00
Haojun Liao	2e6263b43f	fix(stream): fix memory leak.	2023-08-14 17:16:11 +08:00
yihaoDeng	cf9f9ab471	rebuild index at tag0	2023-08-14 08:01:20 +00:00
Haojun Liao	a1e554fbf3	refactor: exec directly not asynchnoized.	2023-08-14 15:05:13 +08:00
Minglei Jin	989abc2bf6	vnode/cos: move includes into USE_COS	2023-08-14 15:03:17 +08:00
Haojun Liao	91710b0c0f	fix(stream):	2023-08-14 14:56:17 +08:00
Minglei Jin	c97b9249fc	cos: only for linux	2023-08-14 14:38:28 +08:00
slzhou	692d436d68	fix: fix ci error	2023-08-14 14:14:16 +08:00
Haojun Liao	5ec6b64aab	fix(stream): add logs.	2023-08-14 13:12:41 +08:00
Haojun Liao	ead04964fd	Merge branch 'main' into fix/liaohj	2023-08-14 12:11:15 +08:00
dapan1121	c2417eb5cd	Merge pull request #22404 from taosdata/fix/TD-25621-3.0 ... fix: dup read lock on windows	2023-08-14 11:37:05 +08:00
Haojun Liao	2806fe1c56	fix(stream): ignore the related stream task destory msg in transfer state.	2023-08-14 10:58:24 +08:00
slzhou	646e52ae7f	Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt	2023-08-14 10:19:36 +08:00
yihaoDeng	246efd83c6	refactor chpt transfer	2023-08-14 02:03:41 +00:00
wangmm0220	dd0bc0e050	fix:heap use after free	2023-08-14 09:42:55 +08:00
wade zhang	1b51f53c15	Merge pull request #22407 from taosdata/fix/TD-25671 ... fix: infinite tomb data sync loop	2023-08-14 09:25:47 +08:00
shenglian zhou	46f92d222d	fix: typo error	2023-08-14 08:52:25 +08:00
shenglian zhou	db25f6c01b	Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block	2023-08-14 08:49:25 +08:00
shenglian zhou	c5a6cac34f	fix: fix compilation error	2023-08-14 08:49:10 +08:00
Haojun Liao	01ac99a651	Merge pull request #22413 from taosdata/fix/liaohj ... refactor: refactor the transfer state procedure.	2023-08-13 23:28:18 +08:00
slzhou	8e7fc91095	enhance: set file data block iter	2023-08-13 18:30:30 +08:00
Haojun Liao	0d38f389ab	refactor: do some internal refactor.	2023-08-13 16:25:35 +08:00
Haojun Liao	ce721a0146	fix(stream): fix error.	2023-08-12 16:32:05 +08:00
wangmm0220	efb472d54a	fix:heap use after free	2023-08-12 10:15:40 +08:00
Haojun Liao	f24b22000f	enh(stream): stop stream task before redistribute vnodes.	2023-08-11 23:46:53 +08:00
wangmm0220	767563752a	opti:wal logic	2023-08-11 20:21:13 +08:00
wangmm0220	deda4b9eed	opti:wal logic	2023-08-11 19:26:17 +08:00
Hongze Cheng	847bc0da08	fix: infinite tomb data sync loop	2023-08-11 18:10:16 +08:00
slzhou	47d2f9ad6d	fix: first run without tag cond	2023-08-11 17:52:52 +08:00
wangmm0220	7b22d37f12	fix:lost data when consumer db	2023-08-11 17:25:43 +08:00
slzhou	42a4f364c1	Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt	2023-08-11 16:48:49 +08:00
Minglei Jin	84452c8dee	cos: use static sdk	2023-08-11 16:36:53 +08:00
shenglian zhou	eb9d77d639	ehance: destroy blocklist of table scan info, add block global index list to table scan info	2023-08-11 16:33:49 +08:00
Haojun Liao	87c7e4c0fe	fix(stream): not launch stream tasks when restarting the stream tasks.	2023-08-11 16:19:46 +08:00
yihaoDeng	6e6eb05d5c	Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer	2023-08-11 08:03:02 +00:00
Haojun Liao	e984affe90	fix(stream): disable the stream in the followers nodes.	2023-08-11 15:58:15 +08:00
wangmm0220	25e32bbf7c	fix:offset error in tmq & add test cases	2023-08-11 14:25:12 +08:00
Haojun Liao	9322f80343	fix(stream): register the rsp callback.	2023-08-11 13:31:50 +08:00
kailixu	64a1636dd2	chore: trigger CI	2023-08-11 12:54:45 +08:00
kailixu	1d089fe085	fix: dup read lock on windows	2023-08-11 11:34:57 +08:00
yihaoDeng	99be2836b2	Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer	2023-08-11 02:50:12 +00:00
Haojun Liao	1e636a2ef9	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-11 10:37:40 +08:00
Haojun Liao	6a9826cf6e	enh(stream): update the stream task epset.	2023-08-11 10:37:25 +08:00
yihaoDeng	ba4ce9db02	Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer	2023-08-11 02:15:07 +00:00
Haojun Liao	d9bc881fb3	Merge pull request #22384 from taosdata/mark/tmq ... fix:offset error in tmq & add test cases	2023-08-11 10:00:08 +08:00
Minglei Jin	4513acfee9	cos: use static libs for mxml, apr, apu, curl	2023-08-11 09:54:54 +08:00
yihaoDeng	32983a11e1	add log and fix crash	2023-08-10 20:34:00 +08:00
shenglian zhou	b2e615d4e7	enhance: tag scan cursor based block	2023-08-10 17:30:01 +08:00
wangmm0220	78fd70202c	fix:offset error in tmq & add test cases	2023-08-10 16:18:53 +08:00
Minglei Jin	c04ada3573	cos: link with static libs	2023-08-10 15:28:22 +08:00
Minglei Jin	cd63e81450	cos: separate building phase for apr & apr-util	2023-08-10 14:18:12 +08:00
dm chen	dd271bca6d	Merge pull request #22394 from taosdata/3.0 ... merge 3.0 to feat/TD-22970	2023-08-10 14:14:22 +08:00
Haojun Liao	a713b37f35	fix(stream): add more logs.	2023-08-10 14:07:29 +08:00
Haojun Liao	161fd6902a	fix(stream): fix the acquire task.	2023-08-10 12:45:20 +08:00
Minglei Jin	33967b243b	Merge branch '3.0' into fix/TD-25010-3	2023-08-10 12:14:01 +08:00
Haojun Liao	f633c7fe2b	other: merge 3.0.	2023-08-10 11:56:30 +08:00
Haojun Liao	b658608541	Merge pull request #22388 from taosdata/fix/3_liaohj ... other: merge main.	2023-08-10 11:43:02 +08:00
yihaoDeng	ef247cdb1d	support reopen stream state	2023-08-10 01:49:26 +00:00
Haojun Liao	c10b323188	other: merge main.	2023-08-10 09:26:33 +08:00
Haojun Liao	4393375e47	fix(stream): set correct task id.	2023-08-10 02:16:04 +08:00
Haojun Liao	0757e88ced	fix(stream): set the correct hash keys.	2023-08-09 23:52:14 +08:00
Haojun Liao	7e3f1d92fc	Merge branch 'main' into fix/liaohj	2023-08-09 19:43:24 +08:00
wangmm0220	1f5532fd67	fix:offset error in tmq & add test cases	2023-08-09 19:41:22 +08:00
Minglei Jin	a853d9d40c	mxml: use ~/local/include	2023-08-09 18:21:55 +08:00
Haojun Liao	1e8579e8c5	fix(stream): fix other cases.	2023-08-09 16:04:48 +08:00
Haojun Liao	4c92997328	fix(stream): use streamId&taskId to identify the stream task in the stream meta.	2023-08-09 15:52:23 +08:00
Hui Li	584427dd44	Merge pull request #22374 from taosdata/szhou/restore-minglei-main ... fix: restore stt/block merge back	2023-08-09 14:40:03 +08:00
Minglei Jin	b08d5b4d42	mxml: add include dir to vnode	2023-08-09 14:02:10 +08:00
Minglei Jin	7e2859ed43	apr: use tarball to avoid ./buildconf	2023-08-09 13:03:37 +08:00
Haojun Liao	3cdb16352c	fix(stream): avoid launching check downstream when failed to add stream task into stream meta.	2023-08-09 12:03:14 +08:00
Minglei Jin	2e0519b960	apr: fix apr & apr-util project names	2023-08-09 11:01:42 +08:00
Minglei Jin	7114ad63e5	apr：makefile for apr & apr-util	2023-08-09 10:54:17 +08:00
Minglei Jin	4d1155a5cf	curl: makefile for curl	2023-08-09 10:43:27 +08:00
shenglian zhou	e9e06d1eae	fix: restore stt block/data block merge back	2023-08-09 10:36:54 +08:00
shenglian zhou	2b1478f46e	Revert "fix(tsdb/read2): reset stt reader when suspended" ... This reverts commit 079d7ff69e.	2023-08-09 10:36:26 +08:00
Haojun Liao	f3c5f20ee2	enh(stream): add timer to check the node changing.	2023-08-09 10:25:16 +08:00
Minglei Jin	16e015253b	s3/mxml: remove os external dependency	2023-08-09 10:10:25 +08:00
Haojun Liao	bb39d94f9c	Merge pull request #22357 from taosdata/fix/liaohj ... other: merge fix from 3.0 to main.	2023-08-09 09:05:54 +08:00
wangmm0220	d322cfce50	fix:add hashIteratorCancel for hash iterator	2023-08-08 16:28:51 +08:00
Haojun Liao	17c6143471	fix(stream): check more status when handling the state transfer.	2023-08-08 15:08:11 +08:00
Hongze Cheng	c8f106106a	fix: update assert issue	2023-08-08 14:49:05 +08:00
dm chen	70a598f072	Merge pull request #22355 from taosdata/3.0 ... merge 3.0 to TD-22970	2023-08-08 09:53:07 +08:00
Hui Li	05e356cd81	Merge pull request #22346 from taosdata/fix/TD-25612 ... fix: snapshot invalid read	2023-08-08 09:19:55 +08:00
Haojun Liao	458143c8b7	Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei ... fix: restore stt block and data block merge back	2023-08-08 08:58:02 +08:00
Haojun Liao	f8ee055641	other: merge 3.0	2023-08-08 00:19:08 +08:00
Haojun Liao	ad3e231b2f	Merge pull request #22350 from taosdata/fix/3_liaohj ... other: merge main and fix bugs in stop stream tasks.	2023-08-07 22:57:13 +08:00
Haojun Liao	aea1690cd1	fix(stream): fix the stream task after checking if it is in the timer activities.	2023-08-07 17:49:36 +08:00
shenglian zhou	ec1270f75c	fix: restore stt block/data block merge back	2023-08-07 17:17:12 +08:00
Minglei Jin	9e4da6c089	s3/config: parsing s3 configuration	2023-08-07 17:14:58 +08:00
shenglian zhou	9ddab11d98	Revert "fix(tsdb/read2): reset stt reader when suspended" ... This reverts commit 079d7ff69e.	2023-08-07 17:13:49 +08:00
yihaoDeng	b6c991f896	support reopen stream state	2023-08-07 08:59:04 +00:00
yihaoDeng	eeb97351e8	support reopen stream state	2023-08-07 08:51:01 +00:00
Haojun Liao	e6b80e6c52	Merge branch '3.0' into fix/3_liaohj	2023-08-07 16:26:31 +08:00
Haojun Liao	225c0e61dc	hen(stream): support the rollback and checkdown stream tasks.	2023-08-07 16:13:39 +08:00
Hongze Cheng	a545d45b5e	fix: snapshot invalid read	2023-08-07 16:12:03 +08:00
Minglei Jin	fac7e521e9	s3/evict: fetch atime from stat file	2023-08-07 15:59:37 +08:00
Hongze Cheng	661f2aca98	fix: memory leak	2023-08-07 14:13:44 +08:00
wangmm0220	9ecabb30f5	fix:ref is not there	2023-08-07 10:27:44 +08:00
wangmm0220	5f02e2ddfb	fix:ref is not there	2023-08-07 09:31:29 +08:00
Haojun Liao	8a11a0418f	other: merge 3.0	2023-08-07 09:19:26 +08:00
wangmm0220	d9a1695257	fix:add log	2023-08-04 18:07:44 +08:00
Minglei Jin	65d8af19ed	s3: new api s3Size	2023-08-04 16:35:35 +08:00
Minglei Jin	87783a9650	s3query/get: pull object to local	2023-08-04 15:37:52 +08:00
Minglei Jin	ebd09ca532	tsdb/write: use keep1 as minKey instead of keep2	2023-08-04 13:44:17 +08:00
Minglei Jin	88d755be76	feat(tsdb/cos): s3 migration	2023-08-04 13:31:00 +08:00
wade zhang	abe15cc68e	Merge pull request #22315 from taosdata/szhou/fix-td25385-main ... fix: keep stt iterator valid in the list	2023-08-04 08:02:16 +08:00
slzhou	fef091b13d	fix: keep the stt iterator valid	2023-08-03 21:50:50 +08:00
shenglian zhou	b85c1ae8a1	fix: remove the core	2023-08-03 21:50:50 +08:00
shenglian zhou	5322e38dfe	fix: add init add check it	2023-08-03 21:50:50 +08:00
shenglian zhou	97b15ed718	fix: delete SLDataItem if stt level files num is smaller	2023-08-03 21:50:50 +08:00
slzhou	1cb1451e41	fix: set nextIndex when get neighbouring index	2023-08-03 18:26:29 +08:00
dm chen	5b03ab1705	Merge branch '3.0' into feat/TD-22970	2023-08-03 17:43:51 +08:00
yihaoDeng	f9d0874e45	support reopen stream state	2023-08-03 08:24:50 +00:00
wade zhang	68f2018246	Merge pull request #22289 from taosdata/szhou/fix-25385 ... fix: keep stt iterator valid	2023-08-02 20:22:54 +08:00
wade zhang	13c713d33b	Merge pull request #22290 from taosdata/3.0_main ... merge 3.0 into branch main	2023-08-02 16:04:08 +08:00
Hongze Cheng	f90f0b7047	disable infinite count loop	2023-08-02 15:51:51 +08:00
Minglei Jin	cff85550f9	Merge branch '3.0' into 3.0_main	2023-08-02 14:10:45 +08:00
wade zhang	c24b52ad82	Merge pull request #22277 from taosdata/fix/TD-25400 ... enh(tsdb/cache/read): lazy init table map hash and entries	2023-08-02 14:08:43 +08:00
Haojun Liao	0feffc687b	fix(tsdb): check uid in multiple stt statistics blocks.	2023-08-02 12:44:45 +08:00
Minglei Jin	0e51277521	cache/reader: cleanup contiue nex row	2023-08-02 12:43:57 +08:00
Haojun Liao	2c357f1958	fix(stream): enable filter table based on table statistics.	2023-08-02 11:18:35 +08:00
Minglei Jin	7fca057a81	cache/reader: move pLastCols into single block	2023-08-02 11:10:12 +08:00
slzhou	dd8e893508	fix: keep the stt iterator valid	2023-08-02 11:02:27 +08:00
Minglei Jin	95cc540d9b	cache/reader: clean uid in all loop	2023-08-02 10:48:55 +08:00
shenglian zhou	38e797b4ff	fix: remove the core	2023-08-02 10:43:26 +08:00
shenglian zhou	d5ca51e94d	fix: add init add check it	2023-08-02 10:43:26 +08:00
shenglian zhou	6bf95c0c4d	fix: delete SLDataItem if stt level files num is smaller	2023-08-02 10:43:26 +08:00
Haojun Liao	13543f7daa	feature(stream): handle task update in tq module.	2023-08-02 10:33:41 +08:00
Minglei Jin	ed76525c4f	cache/reader: cleanup uid in signle loop	2023-08-02 10:28:13 +08:00
Minglei Jin	29b2f32821	cache reader: cleanup stt init	2023-08-02 09:49:41 +08:00
Haojun Liao	53aefa531f	Merge branch '3.0' into fix/3_liaohj	2023-08-02 09:45:21 +08:00
Haojun Liao	e1e5e9bb0f	enh(stream): check stream tasks dag.	2023-08-02 09:44:39 +08:00
Hongze Cheng	4ba4e83b5b	fix: retention file corruption	2023-08-01 20:19:13 +08:00
Minglei Jin	7d294cac5f	tsdb/cache: load current fileset's brinblk once	2023-08-01 18:56:10 +08:00
Minglei Jin	a593e887fa	cache: remove nFileset from fs state	2023-08-01 18:37:23 +08:00
Minglei Jin	7ad628417a	fix mem issue: stack-use-after-scope	2023-08-01 17:57:38 +08:00
Minglei Jin	4716fc6400	cache/fs: remove fs state's tsdb handle	2023-08-01 17:49:05 +08:00
Minglei Jin	1d5532019f	tsdb/merge-tree: cleanup comment	2023-08-01 17:25:15 +08:00
Minglei Jin	f72f129d41	cache/skyline: cleanup del array	2023-08-01 17:23:53 +08:00
Minglei Jin	c997662ba0	tsdb/cache: build skyline only if there's del data	2023-08-01 16:50:00 +08:00
Minglei Jin	94b9599f95	fix null pointer dereference	2023-08-01 16:39:14 +08:00
Haojun Liao	637f09359a	other: merge main.	2023-08-01 16:15:34 +08:00
Minglei Jin	72ac5a4e3b	tsdb/cache: use read util's uid compare functor	2023-08-01 16:08:20 +08:00
Minglei Jin	c0a0e07597	cache/read: lazy init uidList when laoding from tsdb	2023-08-01 16:02:09 +08:00
Minglei Jin	b3fae65d90	enh(tsdb/cache/read): lazy init table map hash and entries	2023-08-01 15:53:42 +08:00
Hongze Cheng	78c23f407e	fix compile issue	2023-08-01 15:04:14 +08:00
Hongze Cheng	07c40943a4	fix: TD-25408	2023-08-01 15:01:06 +08:00
wade zhang	347e78ecb5	Merge pull request #22272 from taosdata/fix/TD-25466 ... Fix/td 25466	2023-08-01 14:22:24 +08:00
Hongze Cheng	1b39147496	more refact	2023-08-01 11:36:37 +08:00
Hongze Cheng	0e46041c1a	fix: tsdbRetention memory leak	2023-08-01 11:21:40 +08:00
Haojun Liao	ae9745ecf2	Merge pull request #22258 from taosdata/mark/tmq-3.0 ... fix:add committed & seek process logic	2023-08-01 09:52:09 +08:00
Haojun Liao	ea875c58f2	Merge pull request #22263 from taosdata/mark/tmq-main ... fix:add committed & seek process logic	2023-08-01 09:43:23 +08:00
Haojun Liao	36ef9a537f	Merge pull request #22256 from taosdata/fix/TD-25457 ... check update data	2023-07-31 22:56:05 +08:00
Haojun Liao	2640e41705	Merge pull request #22261 from taosdata/fix/3_liaohj ... fix(stream): set the correct end key of delete block.	2023-07-31 22:55:50 +08:00
wangmm0220	68ae64cdb2	fix:add committed & seek process logic	2023-07-31 18:53:25 +08:00
wangmm0220	cddf27e8b4	fix:add committed & seek process logic	2023-07-31 18:48:50 +08:00
Haojun Liao	d45596bb33	fix(stream): kill task when pause the stream execution.	2023-07-31 18:07:37 +08:00
wangmm0220	6179618b17	fix:add committed & seek process logic	2023-07-31 17:56:04 +08:00
liuyao	32b59af4b1	check update data	2023-07-31 17:32:24 +08:00
wangmm0220	8093ef2dc8	Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq	2023-07-31 16:14:25 +08:00
Haojun Liao	9981cecbed	refactor: do some internal refactor.	2023-07-31 15:24:35 +08:00
Minglei Jin	079d7ff69e	fix(tsdb/read2): reset stt reader when suspended	2023-07-31 15:21:47 +08:00
wade zhang	c7fa5ed6ef	Merge pull request #22247 from taosdata/fix/TD-25436 ... fix(tsdb/cache): check stt data with empty brin index	2023-07-31 11:24:37 +08:00
Minglei Jin	135beebc0a	fix(tsdb/cache): check stt data with empty brin index	2023-07-31 09:15:08 +08:00
wade zhang	bae028d65c	Merge pull request #22230 from taosdata/mark/tmq ... fix:semaphore always wait in tmq commit logic	2023-07-31 09:10:13 +08:00
wade zhang	c26165975d	Merge pull request #22227 from taosdata/fix/TS-3728 ... fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version	2023-07-30 14:28:56 +08:00
Haojun Liao	8dfef8768a	other: merge 3.0	2023-07-29 22:54:16 +08:00
Haojun Liao	0bd2548937	fix(stream): initialize the filter window initial range.	2023-07-29 16:41:01 +08:00
Haojun Liao	f6e07d1fdb	other: merge 3.0	2023-07-29 01:32:02 +08:00
wade zhang	c19feb2fa1	Merge pull request #22236 from taosdata/fix/TD-25416 ... fix(tsdb/cache/del): use lru mutex to fix race with committing	2023-07-28 23:17:45 +08:00
Haojun Liao	936afeb5ac	refactor: do internal refactor to simple the pause/resume in case of fill history exists.	2023-07-28 19:13:03 +08:00
Haojun Liao	d5974a8f25	refactor(stream): refactor the pause/resume for fill history execution.	2023-07-28 18:05:32 +08:00
Minglei Jin	1fcbf3432c	tsdb/cache/del: remove duplicate lruMutex lock	2023-07-28 17:20:20 +08:00
wangmm0220	d982a7cb80	fix:heap use after free for wal	2023-07-28 16:59:35 +08:00
Minglei Jin	b0f65dfa62	fix(tsdb/cache/del): use lru mutex to fix race with committing	2023-07-28 16:32:07 +08:00
wangmm0220	6e673072cd	fix:conflicts	2023-07-28 14:57:13 +08:00
Haojun Liao	9f943213ed	enh(stream): update the hb info.	2023-07-28 14:23:53 +08:00
Haojun Liao	74834aea11	enh(stream): prepare hb to mnode from stream meta.	2023-07-28 13:07:16 +08:00
Haojun Liao	2a78cd2d23	Merge pull request #22215 from taosdata/fix/liaohj ... other: merge main.	2023-07-28 13:06:17 +08:00
wangmm0220	2f6c565392	fix:pHandle not load if taosd restart	2023-07-28 11:48:53 +08:00
wade zhang	b3e5b5bd24	Merge pull request #22217 from taosdata/fix/TD-25386 ... fix(tsdb/cache): move to stt next row if data file exausted	2023-07-28 08:56:29 +08:00
Haojun Liao	ccc0f13649	Merge pull request #22214 from taosdata/fix/3_liaohj ... fix(stream): scan wal in step2	2023-07-28 00:42:15 +08:00
Haojun Liao	7f3d1dc464	fix(stream): fix memory leak.	2023-07-27 23:06:53 +08:00
wangmm0220	77d43ef5fd	fix:tmq ci error	2023-07-27 20:28:45 +08:00
Haojun Liao	fbb33be85d	other: add some comments.	2023-07-27 18:59:38 +08:00
Haojun Liao	22a5a18fff	fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.	2023-07-27 18:57:36 +08:00
Minglei Jin	cc9b9bd0b9	fix(tsdb/cache): move to stt next row if data file exausted	2023-07-27 17:19:42 +08:00
Haojun Liao	b145771a1b	other: merge 3.0	2023-07-27 16:38:57 +08:00
Haojun Liao	3d403dca5a	other: merge main.	2023-07-27 16:23:41 +08:00
Haojun Liao	6ff50d4eaf	fix(stream): update the step2 scan wal files.	2023-07-27 16:10:55 +08:00
wangmm0220	75eacd56f1	fix:add log	2023-07-27 15:58:32 +08:00
wade zhang	a72c11c8de	Merge pull request #22205 from taosdata/fix/TD-25315 ... fix(tsdb/commit2): new maxDelKey for commit context	2023-07-27 15:48:46 +08:00
wangmm0220	2d41a42976	Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728	2023-07-27 15:31:16 +08:00
Haojun Liao	40fe3ef4f6	fix(stream): refactor the step2 wal scan.	2023-07-27 14:49:20 +08:00
Minglei Jin	fe495f7013	tsdb/commit2: fix commit minKey for del	2023-07-27 13:54:48 +08:00
Haojun Liao	e89f530db2	fix(stream): scan wal in step2	2023-07-27 10:55:59 +08:00
Minglei Jin	8a2764c698	tsdb/commit2: use max fileset's maxKey as initial maxDelKey	2023-07-27 10:51:17 +08:00
Minglei Jin	dd32f12f92	tsdb/commit2: reset nextKey to max to stop commit	2023-07-27 09:50:32 +08:00
Minglei Jin	992d623ae5	fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN	2023-07-27 09:34:47 +08:00
Minglei Jin	580b7124cf	fix(tsdb/commit2): new maxDelKey for commit context	2023-07-27 09:16:28 +08:00
Haojun Liao	087d54a807	Merge pull request #22198 from taosdata/fix/3_liaohj ... fix(stream): do filter before the update check.	2023-07-26 18:57:48 +08:00
yihaoDeng	287088ae3f	fix stream state transfer	2023-07-26 10:16:06 +00:00
Haojun Liao	c57defa1c9	Merge pull request #22195 from taosdata/szhou/fix-td25369 ... fix: stt and data block merge	2023-07-26 17:11:18 +08:00
Haojun Liao	6a6830761d	fix(tsdb): check for null ptr of pScanInfo	2023-07-26 17:08:29 +08:00
Haojun Liao	3c387f6e91	fix(stream): fix syntax error.	2023-07-26 17:00:41 +08:00
Haojun Liao	432c943c25	fix(stream): do filter before the update check.	2023-07-26 16:34:39 +08:00
Haojun Liao	610f9d19c1	Merge pull request #22188 from taosdata/fix/3_liaohj ... fix(stream): set the correct step2 scan time window range.	2023-07-26 16:34:10 +08:00
shenglian zhou	1357e623d0	fix: fix compilation error	2023-07-26 15:43:50 +08:00
shenglian zhou	79020ea4a4	fix: stt and data block merge	2023-07-26 15:01:20 +08:00
Haojun Liao	df57768a3e	Merge branch '3.0' into fix/3_liaohj	2023-07-26 14:45:11 +08:00
Haojun Liao	cdffabcdad	fix(stream): fix memory leak.	2023-07-26 14:37:04 +08:00
Haojun Liao	728112ed89	fix(stream): set correct upstream epinfo.	2023-07-26 10:26:59 +08:00
wade zhang	d8fd5b9394	Merge pull request #22190 from taosdata/fix/TD-25315 ... fix(tsdb/del): reset next key to del record's ekey	2023-07-26 10:23:01 +08:00
yihaoDeng	c61393a7a1	fix stream state transfer	2023-07-26 01:33:41 +00:00
Haojun Liao	b6eb739ae0	fix(tsdb): fix the	2023-07-26 09:14:19 +08:00
Minglei Jin	fb860726de	fix(tsdb/del): reset next key to del record's ekey	2023-07-26 08:40:44 +08:00
Haojun Liao	1c1bf63e1f	other: merge 3.0	2023-07-25 18:17:11 +08:00
wade zhang	02bc1b2a8f	Merge pull request #22186 from taosdata/fix/TD-25315 ... fix(tsdb/del): continue committing fileset if more del left	2023-07-25 17:41:30 +08:00
Haojun Liao	0bdccd2681	refactor: do some internal refactor.	2023-07-25 17:31:54 +08:00
Minglei Jin	7bfb4e0f88	fix(tsdb/del): continue committing fileset if more del left	2023-07-25 16:42:45 +08:00
wangmm0220	be4e47e9a7	fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version	2023-07-25 16:15:33 +08:00
Haojun Liao	d29f835a63	fix(stream): set the correct step2 scan time window range.	2023-07-25 15:09:22 +08:00
Haojun Liao	c2588d71c3	Merge pull request #22173 from taosdata/fix/TS-3728 ... fix:avoid request offset type is 0	2023-07-25 14:59:30 +08:00
wade zhang	2bf84c2676	Merge pull request #22179 from taosdata/FIX/TS-3702-3.0 ... enh: compatibility between getFileNamePrefix and tsdbTFileName	2023-07-25 14:26:14 +08:00
Benguang Zhao	01f45b2a99	enh: compatibility between getFileNamePrefix and tsdbTFileName	2023-07-25 11:35:35 +08:00
Minglei Jin	1bce96ea27	fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's)	2023-07-25 10:46:03 +08:00
wade zhang	7ea9cf1ddc	Merge pull request #22166 from taosdata/fix/TD-24422 ... fix(tsdb/cache): reuse data file reader	2023-07-25 10:28:59 +08:00
Haojun Liao	96722a07b1	Merge pull request #22174 from taosdata/fix/3_liaohj ... fix(stream): fix the invalid check of step2 .	2023-07-25 00:30:06 +08:00
Haojun Liao	a2694b9ce9	fix(stream): fix the invalid check of step2 .	2023-07-24 19:44:28 +08:00
wangmm0220	6a0e994169	fix:avoid request offset type is 0	2023-07-24 19:24:05 +08:00
Haojun Liao	d36903bf08	Merge pull request #22162 from taosdata/fix/3_liaohj ... fix(stream): add some logs, and remove the invalid loop.	2023-07-24 16:29:51 +08:00
wangmm0220	9628a9f74e	fix:open info log in tmq & ignore wal apply ver when read wal	2023-07-24 15:53:02 +08:00
Haojun Liao	01f11bf5a6	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/common/src/tglobal.c # source/libs/executor/src/timewindowoperator.c	2023-07-24 15:25:43 +08:00
Haojun Liao	1e34f84f78	other: merge 3.0	2023-07-24 15:23:03 +08:00
Minglei Jin	424dd40078	tsdb/cache: reuse pDataFileReader for same fileset	2023-07-24 14:45:35 +08:00
Haojun Liao	9bae91bcba	fix(stream): add some logs, and remove the invalid loop.	2023-07-24 13:37:44 +08:00
Haojun Liao	13bab114cb	Merge pull request #22155 from taosdata/fix/3_liaohj ... fix(stream): refactor the halt status to check more status.	2023-07-24 11:04:08 +08:00
Minglei Jin	968cfd9e65	tsdb/cache: pLastIter null pointer check	2023-07-24 11:03:07 +08:00
wade zhang	5f25d70fc2	Merge pull request #22154 from taosdata/enh/tsdb_optimize ... fix(tsdb/cache): new next stt row state for fs tranverse	2023-07-24 10:47:51 +08:00
Haojun Liao	1367552f38	fix(stream): refactor the halt status to check more status.	2023-07-24 10:04:15 +08:00
Haojun Liao	6a19ad3127	Merge pull request #22151 from taosdata/fix/3_liaohj ... fix(stream): set the correct flag of pause/resume.	2023-07-24 09:07:49 +08:00
Minglei Jin	13491fab95	tsdb/cache: new next stt row state for fs tranverse	2023-07-24 08:51:20 +08:00
Haojun Liao	0b6e1a12bb	refactor: do some internal refactor.	2023-07-23 19:09:43 +08:00
Haojun Liao	e387b2f932	refactor: do some internal refactor.	2023-07-23 18:59:34 +08:00
Haojun Liao	4e0f7ffbf8	fix(stream): set the correct flag of pause/resume.	2023-07-23 18:49:56 +08:00
Haojun Liao	321be1f83f	Merge pull request #22135 from taosdata/fix/3_liaohj ... refactor: do some internal refactor.	2023-07-22 15:06:28 +08:00
Haojun Liao	bfc4a07207	fix(stream): fix memory leak.	2023-07-22 00:20:02 +08:00
Haojun Liao	1b2636028a	fix(stream): fix memory leak.	2023-07-21 23:05:42 +08:00
Haojun Liao	16d7707b90	fix(stream): align the scan real time data for stream task.	2023-07-21 19:33:43 +08:00
wade zhang	7b1e809d98	Merge pull request #21794 from taosdata/enh/tsdb_optimize ... for test purpose	2023-07-21 14:18:32 +08:00
wangmm0220	bb86f5c580	fix:commit offset should not plus 1	2023-07-21 11:13:05 +08:00
wangmm0220	10ebf1f438	fix:subscribeStb.py maybe failed	2023-07-21 11:07:34 +08:00
dmchen	7d480cf3ac	compatible old sync config	2023-07-21 10:31:53 +08:00
Haojun Liao	39ca9b537f	fix(stream): fix syntax error	2023-07-21 09:43:08 +08:00
Haojun Liao	c9d75eab5a	refactor: do some internal refactor.	2023-07-21 09:16:13 +08:00
Haojun Liao	db46d31ca5	fix(stream): refactor the halt function.	2023-07-21 01:32:42 +08:00
yihaoDeng	519d3b74d1	fix stream state transfer	2023-07-20 09:51:18 +00:00
Haojun Liao	9353f7c8cf	refactor: do some internal refactor.	2023-07-20 16:35:02 +08:00
Haojun Liao	c9fa170e65	refactor: do some internal refactor.	2023-07-20 16:31:46 +08:00
Haojun Liao	45cb478b31	refactor: do some internal refactor.	2023-07-20 15:36:46 +08:00
Haojun Liao	87fa8f0c4c	Merge branch '3.0' into fix/3_liaohj	2023-07-20 12:15:23 +08:00
Haojun Liao	aed99da6c1	refactor: refactor the stream task starting order.	2023-07-20 12:14:53 +08:00
yihaoDeng	6e5be0d30e	fix stream state transfer	2023-07-20 03:49:32 +00:00
Minglei Jin	48222f5dc3	tsdb/cache: move data file reader for fs iter to cache reader	2023-07-20 09:11:26 +08:00
Minglei Jin	6dd4ec41ae	tsdb/cache cleanup: remove unused fs methods	2023-07-20 08:51:03 +08:00
Minglei Jin	7f0ea10573	Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-07-20 08:42:12 +08:00
Minglei Jin	46d6dcda3e	tsdb/cache: reset skyline when clearing fileset	2023-07-20 08:41:32 +08:00
Haojun Liao	bfcc538205	fix(tsdb):disable stt statistics.	2023-07-20 00:01:30 +08:00
yihaoDeng	733db123ad	refactor code	2023-07-19 13:24:59 +00:00
Haojun Liao	97c44e7c18	refactor: do some internal refactor.	2023-07-19 18:42:02 +08:00
wangmm0220	d7d81d82a0	feat:add committed & position & commite_offset interface	2023-07-19 18:27:19 +08:00
Yihao Deng	91a15fd7bd	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-19 18:14:08 +08:00
Minglei Jin	ce71b8bbe7	Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-07-19 18:11:14 +08:00
Minglei Jin	4eaecd11de	tsdb/cache: merge fs & stt row	2023-07-19 18:10:36 +08:00
wangmm0220	5cb35f2fa6	feat:add committed & position & commite_offset interface	2023-07-19 17:29:39 +08:00
Haojun Liao	37ae80d135	fix(tsdb): fix memory leak.	2023-07-19 16:42:51 +08:00
Haojun Liao	d82fb45a4f	Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize	2023-07-19 15:01:37 +08:00
Haojun Liao	a84efab2c8	enh(tsdb): add table filter according to stt block statistics data.	2023-07-19 15:01:25 +08:00
Minglei Jin	913cfe43e8	tsdb/cache: remove input[3]	2023-07-19 12:20:54 +08:00
Minglei Jin	7a716d452e	tsdb/fs2: fix vnode get primary dir args	2023-07-19 11:36:26 +08:00
Minglei Jin	4b96bc7147	Merge branch '3.0' into enh/tsdb_optimize	2023-07-19 11:15:57 +08:00
Shungang Li	1d88a6a7c6	enh: ttlMgrFlush adjust log level	2023-07-19 11:15:54 +08:00
Minglei Jin	185081a948	tsdb/fsreader: clear last fileset's resources	2023-07-19 11:04:28 +08:00
dm chen	141004bf77	Merge branch '3.0' into feat/TD-22970	2023-07-19 10:57:40 +08:00
yihaoDeng	b1f3dfe88f	Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2	2023-07-19 02:17:42 +00:00
yihaoDeng	34c2e6a180	forbidden streamsnapshot reader	2023-07-19 02:15:12 +00:00
Haojun Liao	a32c650248	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-19 10:05:48 +08:00
Haojun Liao	2ae95217bd	fix(stream): open inputQ by default for task deployed on snode.	2023-07-19 10:05:35 +08:00
liuyao	fd02b9a71e	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-19 10:02:06 +08:00
wade zhang	c3e5375f15	Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0 ... feat: distribute vnode primary dirs among disks of level 0	2023-07-19 09:44:43 +08:00
wangmm0220	5c344b0159	fix:conflicts from main	2023-07-19 09:05:05 +08:00
Haojun Liao	9513f76172	fix(stream): set downstream task ready state.	2023-07-18 19:02:24 +08:00
Minglei Jin	a127e91534	tsdb/cache skyline: first round implementation of cache skyline	2023-07-18 17:17:06 +08:00
dmchen	3711fdd865	feat/TD-22970	2023-07-18 16:09:38 +08:00
Benguang Zhao	2faa3d2e7b	enh: check validity of diskPrimary during vnodeOpen	2023-07-18 15:39:29 +08:00
Minglei Jin	9f9efe9a5e	tsdb/cache reader: remove dataf & dataf last readers	2023-07-18 15:30:31 +08:00
Haojun Liao	901b7d8ecc	fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.	2023-07-18 15:18:57 +08:00
Benguang Zhao	24fed51137	enh: tfsRename dir on primary disk at last	2023-07-18 13:58:43 +08:00
Benguang Zhao	5624ecc8df	fix: prepare vnode dir recursively in vnodeCreate	2023-07-18 11:32:23 +08:00
Benguang Zhao	6b6b7d8d8f	enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk	2023-07-18 11:32:23 +08:00
Haojun Liao	92106312d2	fix(stream): not dispatch checkpoint block result to downstream.	2023-07-18 09:43:38 +08:00
Minglei Jin	998fbe574d	tsdb/cache reader: move suid into reader's info field	2023-07-17 19:10:33 +08:00
yihaoDeng	40eb50676d	add checkpoint	2023-07-17 11:04:19 +00:00
Minglei Jin	463b5b608b	tsdb/read2: fix null pointer runtime error	2023-07-17 18:35:56 +08:00
Minglei Jin	62cfda1a88	tsdb/read2: fix UAF	2023-07-17 17:35:08 +08:00
Minglei Jin	832b68e17d	tsdb/cache: load mem del data	2023-07-17 15:48:08 +08:00
Minglei Jin	a05383e29e	tsdb/cache: new load tomb callback from tsdb mergetree	2023-07-17 15:07:10 +08:00
Minglei Jin	27b8671f97	tsdb/cache: new cacheReader field for tsdb & cache reader	2023-07-17 14:27:27 +08:00
Minglei Jin	9b0b4061e0	tsdb/cache: relayout cache row reader	2023-07-17 14:16:54 +08:00
Haojun Liao	eaaf306c81	fix(stream): fix syntax error	2023-07-17 12:54:05 +08:00
Haojun Liao	d7f7a7d6cf	fix(stream): fix syntax error	2023-07-17 12:53:36 +08:00
Haojun Liao	b2a905bd91	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-17 11:50:12 +08:00
Benguang Zhao	b21e603481	enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json	2023-07-17 11:48:48 +08:00
Minglei Jin	8263c49c17	tsdb/cache: fix compilation	2023-07-17 09:00:17 +08:00
Minglei Jin	2b21c5e0f6	tsdb2: adapt cache with tsdb2 API	2023-07-17 08:50:54 +08:00
Haojun Liao	a9757637d9	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-16 12:47:24 +08:00
Haojun Liao	c6a322e0ef	refactor(stream): back pressure is active, which is trigger by dispatch rsp.	2023-07-16 12:47:08 +08:00
yihaoDeng	e18c9ea672	add checkpoint	2023-07-15 04:26:34 +00:00
yihaoDeng	3c4631ef1f	add checkpoint	2023-07-14 10:06:24 +00:00
wade zhang	c2b3c2db52	Merge pull request #22066 from taosdata/fix/TD-25215-main ... fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main	2023-07-14 17:53:25 +08:00
wade zhang	021fcf2a59	Merge pull request #22059 from taosdata/fix/TD-25215 ... fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables	2023-07-14 17:53:06 +08:00
Haojun Liao	b16432280e	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-14 17:21:37 +08:00
Haojun Liao	eb7e6152ae	refactor(stream): do some internal refactor.	2023-07-14 17:21:20 +08:00
wangmm0220	6762a01d88	Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq	2023-07-14 16:44:00 +08:00
wangmm0220	bbdcbcb75b	fix:modify commit version to next validate version	2023-07-14 16:43:28 +08:00
Hongze Cheng	145c43e346	little fix	2023-07-14 16:38:35 +08:00
yihaoDeng	15f5fd19eb	fix recover error	2023-07-14 14:47:06 +08:00
yihaoDeng	e16a3935a5	fix coverity scan problem	2023-07-14 14:40:32 +08:00
Shungang Li	a48d359f8b	fix: ttlMgrDeleteTtl should ignore ttl 0 tables	2023-07-14 14:37:17 +08:00
Hongze Cheng	25120cede4	fix sma merge error	2023-07-14 13:46:01 +08:00
Hongze Cheng	5a89b96e91	make compile	2023-07-14 10:21:06 +08:00
Hongze Cheng	1fad69df3b	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-07-14 10:13:15 +08:00
dapan1121	9bf7180074	Merge pull request #21969 from taosdata/enh/TD-23769-3.0 ... enh: rsma stream state adaption	2023-07-13 19:19:37 +08:00
Haojun Liao	e0ea0f2df4	Merge pull request #22020 from taosdata/fix/liaohj ... other: merge main	2023-07-13 17:55:28 +08:00
Shungang Li	a39a9428af	fix: ttlMgrDeleteTtl should ignore ttl 0 tables	2023-07-13 17:43:32 +08:00
Benguang Zhao	81a2cd16e7	enh: unify handling of vnode primary dir in current_fname	2023-07-13 17:37:53 +08:00
kailixu	6ee135cb52	chore: more code	2023-07-13 17:37:31 +08:00
kailixu	67461d92a7	chore: merge 3.0 and solve conflict	2023-07-13 17:35:55 +08:00
Hongze Cheng	d81d2790ea	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-07-13 17:20:45 +08:00
Haojun Liao	e2ae868377	Merge pull request #22032 from taosdata/mark/tmq ... fix:set firset version to reqOffset of response	2023-07-13 16:35:21 +08:00
Haojun Liao	813f4cb363	refactor: do some internal refactor.	2023-07-13 16:32:25 +08:00
wade zhang	ec86a68b6f	Merge pull request #22045 from taosdata/FEAT/TS-2699-3.0 ... enh: unify handling of vnode primary dir for vnd, tsdb and sma	2023-07-13 13:55:46 +08:00
Benguang Zhao	dc75f7ce21	enh: use VNODE_RSMA_DIR in tdRSmaGetCurrentFName	2023-07-13 11:27:31 +08:00
Haojun Liao	f41bcd73b0	other: merge main.	2023-07-13 11:02:09 +08:00
Benguang Zhao	e209b487c6	enh: rename func name vnodeGetPrimaryDir	2023-07-13 10:38:05 +08:00
Haojun Liao	2f90a53548	fix(stream): set checkpoint id when expanding task.	2023-07-13 10:16:57 +08:00
Haojun Liao	08a4fb06ae	fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.	2023-07-13 09:17:20 +08:00
kailixu	466f1037b4	Merge branch '3.0' into enh/TD-23769-3.0	2023-07-12 18:50:16 +08:00
Haojun Liao	c388802bda	Merge pull request #22024 from taosdata/fix/3_liaohj ... fix(stream): fix concurrent bug in save task meta.	2023-07-12 18:17:27 +08:00
kailixu	8f58f9aa5b	fix: skip primary key for block sma	2023-07-12 18:07:01 +08:00
Benguang Zhao	05e8af4837	enh: unify handling of vnode primary dir for vnd and tsdb	2023-07-12 17:58:18 +08:00
Benguang Zhao	4c3bf41178	enh: unify handling of vnode primary dir for sma	2023-07-12 17:56:21 +08:00
Benguang Zhao	bbf58d2d9d	enh: unify handling of vnode primary dir in vnodeCreate and metaOpen	2023-07-12 17:56:21 +08:00
wangmm0220	cf64d4c9c5	fix:set get_assignment offset to first version of response block	2023-07-12 17:22:23 +08:00
Hongze Cheng	3fc282f035	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-07-12 11:57:19 +08:00
Haojun Liao	3ce54423a5	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-12 11:38:27 +08:00
Haojun Liao	d392bb60ba	refactor(stream): set the initial version from the checkpoint.	2023-07-12 11:38:13 +08:00
kailixu	8cb6356b99	chore: more code	2023-07-12 10:47:02 +08:00
Haojun Liao	9484f3da94	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-12 10:20:18 +08:00
kailixu	f282acbc4c	chore: rsma refactor	2023-07-12 10:13:50 +08:00
kailixu	8c8bcabdd4	Merge branch '3.0' into enh/TD-23769-3.0	2023-07-12 09:11:34 +08:00
wade zhang	2cfdd234b3	Merge pull request #22034 from taosdata/feat/TS-3239 ... feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0	2023-07-12 08:18:38 +08:00
Haojun Liao	fed3803739	fix(stream): fix memory leak.	2023-07-11 19:29:52 +08:00
kailixu	ba0bce8092	chore: code revert	2023-07-11 18:52:51 +08:00
kailixu	30f8c9c79e	chore: more check	2023-07-11 18:08:48 +08:00
Shungang Li	4886cb4674	feat: port 'keepTimeOffset' from 2.6 to 3.0	2023-07-11 17:40:35 +08:00
kailixu	7c85f7701d	chore: more check	2023-07-11 16:32:29 +08:00
wangmm0220	8dd7f36993	fix:set firset version to reqOffset of response	2023-07-11 16:19:38 +08:00
wangmm0220	7bc19df0ef	fix:set firset version to reqOffset of response	2023-07-11 15:48:19 +08:00
Haojun Liao	2e386a6fdf	fix(stream): check if stream task is in normal state.	2023-07-11 15:23:49 +08:00
wangmm0220	cb62d4cb97	fix:set firset version to reqOffset of response	2023-07-11 14:49:53 +08:00
Haojun Liao	6d78816d22	fix(stream): fix syntax error.	2023-07-11 14:06:25 +08:00
kailixu	314123ef34	chore: add check	2023-07-11 14:05:09 +08:00
Haojun Liao	09b764494d	fix(stream): set correct checkpoint version when starting stream tasks.	2023-07-11 14:03:43 +08:00
kailixu	d5435926c2	chore: more code	2023-07-11 12:37:01 +08:00
Haojun Liao	3ffdbe923d	other: merge 3.0	2023-07-11 09:12:57 +08:00
Haojun Liao	04f5bcd23a	fix(stream): remove invalid set of task status .	2023-07-11 08:51:13 +08:00
kailixu	14b438ec64	chore: bug fix	2023-07-11 07:02:36 +08:00
kailixu	f391462e34	chore: more code	2023-07-10 20:01:50 +08:00
kailixu	57ceaed535	chore: code revert	2023-07-10 19:55:01 +08:00
kailixu	f16fa6d000	enh: exclude tk log from time series check	2023-07-10 19:48:50 +08:00
Haojun Liao	87bedef2cd	fix(stream): fix error in checkpointing.	2023-07-10 19:20:05 +08:00
Haojun Liao	385a5c9651	fix(stream): fix error in generating checkpoint.	2023-07-10 18:20:50 +08:00
Hongze Cheng	7014f790a0	optmize table statistic info	2023-07-10 17:35:26 +08:00
liuyao	84f0dfd6d4	stream operator checkpoint	2023-07-10 11:07:08 +08:00
kailixu	802112c00a	chore: more code	2023-07-09 21:49:37 +08:00
Haojun Liao	98349a4265	refactor(tsdb): do some internal refactor.	2023-07-09 18:05:24 +08:00
kailixu	a7253fc390	Merge branch '3.0' into enh/TD-25083-3.0	2023-07-09 16:04:38 +08:00
wangmm0220	35ba132a29	fix:conflicts from main	2023-07-09 12:52:18 +08:00
wangmm0220	a5363e6e03	fix:test case in tmq	2023-07-09 12:49:50 +08:00
Haojun Liao	ba4d726af6	fix(tsdb): fix error in tsdbread.	2023-07-09 01:31:02 +08:00
Haojun Liao	b39198a53a	refactor: do some internal refactor.	2023-07-08 21:44:58 +08:00
Haojun Liao	1470e51dc1	Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize	2023-07-08 21:25:24 +08:00
Haojun Liao	14844c7b4b	refactor(tsdb): opt tsdb read perf	2023-07-08 21:25:11 +08:00
wangmm0220	f9f656b21a	fix:return offset stored if get assignment in init mode	2023-07-08 13:25:39 +08:00
Haojun Liao	4f534ce6e9	fix(stream): fix error in generating checkpoint.	2023-07-08 10:29:09 +08:00
Haojun Liao	a5c19427e7	fix(stream): send correct rsp to mnode.	2023-07-08 09:39:44 +08:00
Haojun Liao	9c30abf95b	fix(stream): fix error in generating checkpoint.	2023-07-07 21:38:53 +08:00
wangmm0220	4436eb7e0f	fix:set commitOffset is send msg success & optimize log & add test cases for TD-25129	2023-07-07 19:12:18 +08:00
kailixu	a746d288a1	chore: add debug info	2023-07-07 18:53:01 +08:00
Haojun Liao	128f67784a	fix(stream): fix error in parsing checkpoint msg.	2023-07-07 18:17:50 +08:00
Haojun Liao	8298f30e56	fix(stream): fix bug in checkpoint.	2023-07-07 17:16:08 +08:00
wangmm0220	106e273157	fix:bugs in get_assignment	2023-07-07 16:12:15 +08:00
Haojun Liao	47877898d0	enh(stream): generate the checkpoint framework.	2023-07-07 16:07:52 +08:00
wade zhang	0865b1a828	Merge pull request #21973 from luckeverda/fix/TD-25074-main ... fix/TD-25074 for main	2023-07-07 11:24:33 +08:00
Hongze Cheng	090ca39132	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-07-07 10:38:04 +08:00
kailixu	cb8b10f6a2	Merge branch '3.0' into enh/TD-23769-3.0	2023-07-07 10:19:43 +08:00
kailixu	64ef48e0dd	Merge branch '3.0' into enh/TD-23769-3.0	2023-07-07 10:17:25 +08:00
kailixu	06c52af2c2	enh: exclude tk_log from timeseries check	2023-07-07 10:14:37 +08:00
wade zhang	47a7a45d1d	Merge pull request #21978 from taosdata/fix/TD-24962 ... fix(coverity): fix coverity scan issues	2023-07-07 08:20:07 +08:00
wangmm0220	0928bd5510	fix:send rsp offset to client if unregister push mgr	2023-07-06 19:35:48 +08:00
wangmm0220	b2d41ce907	Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-25071	2023-07-06 19:34:22 +08:00
Haojun Liao	aad906f2b0	fix(stream): fix syntax error.	2023-07-06 18:26:44 +08:00
Haojun Liao	d7101f7109	enh(stream): support dispatch checkpoint msg.	2023-07-06 18:26:22 +08:00
Minglei Jin	09222801c4	fix(coverity): fix coverity scan issues	2023-07-06 17:52:48 +08:00
wangmm0220	f1ce91f600	fix:race condition for pTq->pStore->pHash	2023-07-06 16:49:59 +08:00
wangmm0220	9e6e59adc2	fix:race condition for pTq->pStore->pHash	2023-07-06 16:47:48 +08:00
Shungang Li	a31e054146	fix: ttlmgr convert in metaUpgrade	2023-07-06 15:47:32 +08:00
Shungang Li	a1a2b8331f	fix: ttl fill cache only in initialization	2023-07-06 15:47:32 +08:00
wade zhang	84740e96ee	Merge pull request #21939 from luckeverda/fix/TD-25074 ... fix/TD-25074	2023-07-06 15:44:22 +08:00
Haojun Liao	a94ace4cc8	refactor:do some internal refactor.	2023-07-06 15:10:45 +08:00
wangmm0220	47ae92af93	fix:conflicts from main	2023-07-06 13:40:04 +08:00
wangmm0220	11e6856d3e	fix:init char array	2023-07-06 13:37:58 +08:00
kailixu	c1393fb2e2	chore: invoke streamStateCommit for rsma	2023-07-06 13:26:25 +08:00
Haojun Liao	5a9461a69a	other: merge 3.0	2023-07-06 11:52:21 +08:00
kailixu	e8cdf132fb	chore: rsma code refactor	2023-07-06 11:32:20 +08:00
Haojun Liao	f4a3567935	other: merge 3.0	2023-07-06 11:24:30 +08:00
kailixu	61380b7822	chore: test case adaption	2023-07-06 11:09:44 +08:00
Haojun Liao	851f6df094	enh(tsdb): opt perf.	2023-07-06 09:58:15 +08:00
wangmm0220	34a62c3f38	fix:vginfo assigment not in same time,we should get vginfo by vg,not all vg	2023-07-05 22:55:41 +08:00
kailixu	3f6768d8cf	chore: rsma rocksdb adaption	2023-07-05 19:43:29 +08:00
Haojun Liao	aeb9473382	enh(tsdb): add some logs.	2023-07-05 19:41:34 +08:00
Haojun Liao	a0a116b674	fix(tsdb): fix error in sma extracting and do NOT clear fileDelData when extracting data from stt files.	2023-07-05 19:11:14 +08:00
kailixu	df7866e9f6	chore: refactor	2023-07-05 19:08:43 +08:00
kailixu	59e83fca5d	chore: build fix	2023-07-05 18:33:09 +08:00
Benguang Zhao	9b477eed81	enh: terminate on failure to recover WAL from writing errors, or to commit vnode	2023-07-05 17:54:56 +08:00
Haojun Liao	74f5b3f80e	Merge pull request #21959 from taosdata/refact/fillhistory ... refactor: do some internal refactor.	2023-07-05 17:47:00 +08:00
Shungang Li	e6e52c3641	fix: ttlmgr convert in metaUpgrade	2023-07-05 17:44:17 +08:00
Haojun Liao	8f8dfc593b	Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize	2023-07-05 17:43:56 +08:00
Haojun Liao	a738b6eba6	fix(tsdb): add empty del skyline check.	2023-07-05 17:43:41 +08:00
Hongze Cheng	21d972938f	more fix	2023-07-05 17:43:15 +08:00
Haojun Liao	f35db3ba6c	fix(tsdb): add none check.	2023-07-05 17:36:55 +08:00
Haojun Liao	f0cec22d4f	fix(tsdb): fix some error.	2023-07-05 17:20:17 +08:00
kailixu	d093b0e20f	chore: merge 3.0	2023-07-05 16:45:12 +08:00
Haojun Liao	8c8aa5cd57	fix(tsdb): fix error in extract brinblock.	2023-07-05 16:39:04 +08:00
wangmm0220	bdfeb32923	fix:bugs in tmq_get_topic_assignment	2023-07-05 16:04:34 +08:00
Haojun Liao	03dbcbf055	refactor: do some internal refactor.	2023-07-05 15:55:55 +08:00
Haojun Liao	7d7e12a5e7	fix(tsdb): fix syntax error.	2023-07-05 11:22:58 +08:00
Hongze Cheng	1304c08cdd	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-07-05 10:57:55 +08:00
Haojun Liao	9b3e34d589	Merge pull request #21735 from taosdata/refact/fillhistory ... refactor: refactor the fill history operation	2023-07-05 10:48:51 +08:00
Haojun Liao	6e15478c43	fix(tsdb): do some internal refactor.	2023-07-05 10:31:38 +08:00
Haojun Liao	6fb1e716c0	Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize	2023-07-05 10:31:09 +08:00
Haojun Liao	8ab10a8da1	fix(tsdb): fix error in check tomb record. #TD-25117	2023-07-05 10:30:55 +08:00
Hongze Cheng	23a743fd66	fix snapshot coredump	2023-07-05 10:01:00 +08:00
Haojun Liao	37ff3a419a	fix(tsdb): fix error in load tomb from stt files.	2023-07-04 23:35:52 +08:00
wade zhang	bc8efd7014	Merge pull request #21949 from taosdata/FIX/TD-25103-3.0 ... enh: tfsRename in the reverse order of levels with tiered storages	2023-07-04 17:34:49 +08:00
Benguang Zhao	1ca4256927	enh: use var prefixLen instead in vnodeRenameVgroupId	2023-07-04 15:36:42 +08:00
Haojun Liao	ff2bf35603	fix(stream): fix error in set the version range for secondary scan.	2023-07-04 15:08:39 +08:00
wade zhang	35a35ad4f9	Merge pull request #21930 from taosdata/fix/TD-24966 ... fix: coverity scan	2023-07-04 14:55:54 +08:00
Hongze Cheng	acde8586e0	ignore file check	2023-07-04 14:16:09 +08:00
Hongze Cheng	2e88ad2c14	fix: upgrade bug	2023-07-04 14:00:44 +08:00
Haojun Liao	82342ebdc7	Merge pull request #21934 from taosdata/feature/TD-20678 ... feat:subscribe only meta info	2023-07-04 11:28:27 +08:00
Shungang Li	dbf47f5fc1	fix: ttl fill cache only in initialization	2023-07-03 21:30:53 -04:00
wangmm0220	dbcd33a402	fix:memory leak	2023-07-03 18:43:12 +08:00
Benguang Zhao	ddaba463c0	enh: check failure of tfsMkdirRecurAt	2023-07-03 16:16:27 +08:00
Haojun Liao	200575647c	Merge branch '3.0' into refact/fillhistory	2023-07-03 15:16:18 +08:00
Haojun Liao	20d099dfa6	Merge pull request #21901 from taosdata/fix/liaohj ... fix: fix coverity issue.	2023-07-03 15:15:21 +08:00
Hongze Cheng	8384b6ce29	fix CI case	2023-07-03 15:01:05 +08:00
Hongze Cheng	5390732f42	fix: coverity scan	2023-07-03 14:13:01 +08:00
Hongze Cheng	214c92264c	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-07-03 11:27:26 +08:00
wangmm0220	136bc379d1	feat:ignore delete info	2023-07-03 11:02:08 +08:00
Haojun Liao	9e98c64b1e	fix(tsdb): set correct stt load info. update the test case.	2023-06-30 22:57:49 +08:00
Haojun Liao	450a9f3ca1	Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize	2023-06-30 18:22:35 +08:00
Haojun Liao	c2a7c37b00	fix(tsdb): opt perf for reading data from stt files.	2023-06-30 18:22:20 +08:00
wade zhang	84c20463f3	Merge pull request #21907 from luckeverda/fix/ttlpresubmit ... fix: ttl compatibility for main	2023-06-30 16:47:25 +08:00
wade zhang	617115ba85	Merge pull request #21906 from luckeverda/fix/ttlpresubmit ... fix: ttl compatibility for 3.0	2023-06-30 16:45:58 +08:00
Hongze Cheng	9fd453d78a	more code	2023-06-30 16:13:48 +08:00
yihaoDeng	93391f73e5	vnode snapshot read	2023-06-30 07:46:56 +00:00
Hongze Cheng	2f57c8439b	more fix	2023-06-30 15:04:18 +08:00
Hongze Cheng	e79fe91ba0	more code	2023-06-30 14:57:57 +08:00
Shungang Li	8f164a7922	fix: ttl compatibility	2023-06-30 14:57:34 +08:00
Hongze Cheng	c714138e9e	fix snapshot problem	2023-06-30 14:37:26 +08:00
Hongze Cheng	55840709ed	skip dropped table tomb data commit	2023-06-30 13:54:49 +08:00
wangmm0220	58c7011e0e	feat:support only meta in tmq subscriptions	2023-06-30 11:42:40 +08:00
yihaoDeng	e25df41536	vnode snapshot read	2023-06-30 03:11:55 +00:00
Haojun Liao	ee5e3b7cc0	fix(tsdb): fix error in tsdb2	2023-06-30 00:38:53 +08:00
Haojun Liao	9740d1353c	fix(tsdb): opt perf for read data in stt files.	2023-06-29 23:16:07 +08:00
Haojun Liao	15487c9c8f	fix(tsdb): fix memory leak.	2023-06-29 22:52:07 +08:00
yihaoDeng	60a0b1e1bd	vnode snapshot read	2023-06-29 11:52:34 +00:00
Haojun Liao	17c6b9f81b	fix(tsdb): fix error in set file reader.	2023-06-29 18:40:14 +08:00
Hongze Cheng	eee8007736	fix bug	2023-06-29 17:48:36 +08:00
yihaoDeng	9eb6d8cf1e	vnode snapshot read	2023-06-29 09:35:09 +00:00
Haojun Liao	622e1cb608	fix: fix coverity issue.	2023-06-29 15:54:09 +08:00
Haojun Liao	63834713b2	Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize	2023-06-29 15:09:14 +08:00
Haojun Liao	81eb8523f1	fix(tsdb): fix invalid ptr.	2023-06-29 15:09:01 +08:00
Hongze Cheng	1e5fef9dbe	fix retention CI cases	2023-06-29 15:01:54 +08:00
yihaoDeng	5cebd36c1c	add checkpoint	2023-06-29 06:56:14 +00:00
dapan1121	c8435de64a	Merge branch '3.0' into fix/m23.0	2023-06-29 14:03:56 +08:00
Hongze Cheng	1556dedb85	fix file remove by edit	2023-06-29 14:03:01 +08:00
Haojun Liao	ba38a625cf	fix(stream): remove the shared ptr between reader ptr.	2023-06-29 13:42:23 +08:00
dapan1121	3519e9170e	Merge remote-tracking branch 'origin/main' into 3.0	2023-06-29 11:13:45 +08:00
Haojun Liao	c4a6b85bdf	fix(tsdb): support stt and file block overlap.	2023-06-28 22:38:51 +08:00
yihaoDeng	3d532a54a8	add checkpoint	2023-06-28 12:22:27 +00:00
yihaoDeng	6b6e237079	add checkpoint	2023-06-28 09:57:08 +00:00
liuyao	2fc5eeb810	session win range	2023-06-28 17:20:08 +08:00
Hongze Cheng	9be13427f6	fix tomb record loss bug	2023-06-28 17:01:08 +08:00
yihaoDeng	871f66565d	add checkpoint	2023-06-28 07:02:20 +00:00
Haojun Liao	8867a57262	fix(stream): fix syntax error.	2023-06-28 14:48:59 +08:00
Haojun Liao	57fcd553f8	refactor: do some internal refactor.	2023-06-28 13:13:13 +08:00
wangmm0220	1fc664693e	fix:continue consume if wal is dropped	2023-06-28 11:54:48 +08:00
yihaoDeng	f6d5d0c8ca	add checkpoint	2023-06-28 02:39:01 +00:00
Haojun Liao	3710ea4aca	refactor: do some internal refactor.	2023-06-28 09:41:08 +08:00
Hongze Cheng	c3a34f5012	Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-28 09:16:48 +08:00
Hongze Cheng	b13010c490	fix retention infinit loop	2023-06-28 09:16:43 +08:00
Haojun Liao	9116a4092a	fix(tsdb):fix memory leak.	2023-06-28 01:04:58 +08:00
Haojun Liao	15c55508ac	fix(stream): fix error in read tombblock in stt files.	2023-06-27 23:37:11 +08:00
Haojun Liao	a19e63fd23	fix(stream): fix error in handling fill history.	2023-06-27 23:00:14 +08:00
yihaoDeng	9adccf5715	add checkpoint	2023-06-27 14:31:50 +00:00
yihaoDeng	977d6b7803	add checkpoint	2023-06-27 12:52:27 +00:00
yihaoDeng	74764108fd	add checkpoint	2023-06-27 12:46:08 +00:00
yihaoDeng	f2b96fb4b3	add checkpoint	2023-06-27 12:28:28 +00:00
yihaoDeng	9d69b284db	add checkpoint	2023-06-27 12:03:29 +00:00
Yihao Deng	4de7db06f9	Merge branch '3.0' into enh/triggerCheckPoint2	2023-06-27 17:57:14 +08:00
yihaoDeng	0a0410cd09	add checkpoint	2023-06-27 09:56:14 +00:00
Haojun Liao	4bb78df27c	fix(stream): reduce the sleep time.	2023-06-27 16:44:35 +08:00
Haojun Liao	32fddeff18	fix(stream): fix error retrieve data from source task.And optimize the test cases.	2023-06-27 16:24:47 +08:00
yihaoDeng	a824db4fd5	add checkpoint	2023-06-27 07:46:30 +00:00
Hongze Cheng	d23902877e	make it compile on win	2023-06-27 14:33:55 +08:00
Haojun Liao	1ad05a06d6	Merge branch '3.0' into enh/tsdb_optimize	2023-06-27 11:46:37 +08:00
Haojun Liao	3289ad62be	other: merge 3.0	2023-06-27 11:33:40 +08:00
Haojun Liao	1073b5e4c2	fix(tsdb): support to read multi-level of stt files.	2023-06-27 11:15:53 +08:00
liuyao	71f4226e15	fix coverity san issues	2023-06-27 10:39:38 +08:00
Haojun Liao	b73444b291	fix(stream): start stream task in case of scan history completing.	2023-06-27 09:44:51 +08:00
Hongze Cheng	3edee3fe9f	fix memory leak	2023-06-26 22:04:29 +08:00
dapan1121	4dae9f4eff	merge main to 3.0	2023-06-26 18:43:00 +08:00
Hongze Cheng	3172306f65	more fix	2023-06-26 16:38:26 +08:00
Hongze Cheng	5a0218d1ca	fix memory leak	2023-06-26 16:34:58 +08:00
Hongze Cheng	58ce6a3f26	fix vnode close	2023-06-26 16:28:33 +08:00
Haojun Liao	6a29bce44e	Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize	2023-06-26 15:56:11 +08:00
Haojun Liao	9f664cbf14	fix(tsdb): fix error in extracting block distribution.	2023-06-26 15:54:44 +08:00
Hongze Cheng	5ad9bd938f	change default stt trigger as 2	2023-06-26 15:47:36 +08:00
Hongze Cheng	e79683a684	fix more	2023-06-26 13:57:18 +08:00
Minglei Jin	020678391c	fix(tsdb/cache): refine del locks	2023-06-26 11:19:31 +08:00
Hongze Cheng	27e17048ac	fix: retention coredump	2023-06-26 09:06:59 +08:00
Minglei Jin	5eb57f2e6e	enh(tsdb/cache): writebatch with rcache locked	2023-06-26 08:41:14 +08:00
yihaoDeng	04ab8e19d0	Merge branch 'enh/dev30' into enh/triggerCheckPoint2	2023-06-25 19:58:45 +08:00
Haojun Liao	402c091df0	fix(stream): fix sma error.	2023-06-25 19:41:44 +08:00
Hongze Cheng	b881b87218	more code	2023-06-25 18:02:31 +08:00
liuyao	e236bf818c	set fill history info	2023-06-25 17:47:10 +08:00
Hongze Cheng	cc0727aee3	more code	2023-06-25 17:13:12 +08:00
Hongze Cheng	014bfc4ad4	more code	2023-06-25 16:27:14 +08:00
Hongze Cheng	5b1492cb4b	refact code	2023-06-25 15:09:15 +08:00
wangmm0220	7a49d67078	Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495	2023-06-25 14:54:16 +08:00
Haojun Liao	7e7feeffdf	fix: fix memory leak.	2023-06-25 14:38:31 +08:00
liuyao	c950c7379d	Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory	2023-06-25 10:58:43 +08:00
liuyao	e9d3198e05	mem leak	2023-06-25 10:57:10 +08:00
Haojun Liao	6ac179501a	fix: fix syntax error.	2023-06-25 10:46:21 +08:00
Haojun Liao	6857881742	Merge branch '3.0' into refact/fillhistory	2023-06-25 10:41:32 +08:00
Hongze Cheng	c161943fe0	fix snapshot problem	2023-06-25 10:01:30 +08:00
Hongze Cheng	3582046129	fix coredump	2023-06-25 09:45:58 +08:00
Haojun Liao	3099ec31cb	fix(tsdb): fix syntax error.	2023-06-25 09:36:43 +08:00
Haojun Liao	dad1854cbb	other: merge 3.0	2023-06-25 09:33:37 +08:00
Haojun Liao	7c23630fe4	fix(stream): set correct stream error code.	2023-06-25 09:26:37 +08:00
wade zhang	254a20bdf3	Merge pull request #21660 from luckeverda/feat/TD-23739 ... feat/TD-23739: enhance ttl, deletetime modified by writing-op	2023-06-25 09:06:57 +08:00
Haojun Liao	a8de3694fa	Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory	2023-06-24 18:55:03 +08:00
Haojun Liao	ceb78fdad2	Merge branch '3.0' into refact/fillhistory	2023-06-24 18:53:48 +08:00
Haojun Liao	4a7698d4ab	fix(tsdb): add null ptr check.	2023-06-24 00:41:05 +08:00
Haojun Liao	4ce1614045	fix(tsdb): fix error in retrieve sma.	2023-06-24 00:33:47 +08:00
Haojun Liao	5cac7c7a02	fix(tsdb): fix error in query super table.	2023-06-23 02:06:50 +08:00
yihaoDeng	c36d14df77	add compile opt	2023-06-22 13:19:14 +08:00
Hongze Cheng	a5049b4861	fix bug	2023-06-21 20:26:52 +08:00
Haojun Liao	0c2273daf2	fix(tsdb): fix memory leak.	2023-06-21 19:38:25 +08:00
Haojun Liao	3ca3dc54ae	Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize	2023-06-21 19:22:58 +08:00
Haojun Liao	cf02ac7229	fix(tsdb): extract tomb data in stt files.	2023-06-21 18:57:14 +08:00
Haojun Liao	92249d892a	Merge pull request #21717 from taosdata/enh/staticLibMain ... Enh/static lib main	2023-06-21 17:46:30 +08:00
Hongze Cheng	feda122fdc	more code	2023-06-21 17:29:41 +08:00
Haojun Liao	f49f96049e	Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize	2023-06-21 16:56:11 +08:00
Hongze Cheng	32a256bfee	fix commit bug	2023-06-21 16:55:31 +08:00
Haojun Liao	e76ae4ffc5	fix(tsdb) : fix memory leak.	2023-06-21 16:53:47 +08:00
Hongze Cheng	1160f53062	more code	2023-06-21 16:35:06 +08:00
Haojun Liao	84bd2fb7a1	Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize	2023-06-21 16:15:04 +08:00
Hongze Cheng	5e9d263e19	fix: infinite loop	2023-06-21 15:08:16 +08:00
Hongze Cheng	0e97340e50	more code	2023-06-21 14:53:36 +08:00
Haojun Liao	6261359efe	fix(tsdb): reset the stt reader for new files.	2023-06-21 14:46:35 +08:00
yihaoDeng	ff3ad6c65f	add static lib to 3.0	2023-06-21 14:38:52 +08:00
Hongze Cheng	4a1010cdec	more	2023-06-21 13:39:29 +08:00
wade zhang	e95b430e89	Merge pull request #21786 from taosdata/FIX/TD-24817-3.0 ... enh: make alter-hashrange atomic and idempotent	2023-06-21 13:29:04 +08:00
Haojun Liao	ea7b8e91d3	fix(stream): fix memory leak.	2023-06-21 12:03:26 +08:00
Haojun Liao	f6e3ad27f0	fix(tsdb): fix memory leak.	2023-06-21 11:38:35 +08:00
Haojun Liao	a92d16a508	fix(tsdb): adjust invalid assert.	2023-06-21 00:12:08 +08:00
Hongze Cheng	413d00db9e	fix memory leak	2023-06-20 20:10:57 +08:00
yihaoDeng	daa3b5238f	add static lib	2023-06-20 19:29:43 +08:00
Haojun Liao	f8437789f9	Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize	2023-06-20 18:38:59 +08:00
Haojun Liao	a16dce1873	fix(tsdb): set correct callback fp.	2023-06-20 18:38:45 +08:00
Hongze Cheng	a3f784a5bc	more code	2023-06-20 18:25:24 +08:00
Hongze Cheng	ccc8faf3ee	Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-20 18:24:02 +08:00
Hongze Cheng	8855659534	more code	2023-06-20 18:23:58 +08:00
liuyao	74bea44300	stream op transform	2023-06-20 17:30:59 +08:00
Haojun Liao	2d4eed4234	other: merge other branch.	2023-06-20 17:12:31 +08:00
Hongze Cheng	fbc4cc9053	fix commit issue	2023-06-20 16:48:54 +08:00
Haojun Liao	7627035629	fix(tsdb): set the hasVal initial value.	2023-06-20 15:58:22 +08:00
Benguang Zhao	424086e324	enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange	2023-06-20 15:40:09 +08:00
Haojun Liao	a87c3cfd24	fix(tsdb):check null ptr.	2023-06-20 15:39:53 +08:00
liuyao	aafbdcb492	set task status	2023-06-20 15:20:04 +08:00
Haojun Liao	a1f2ce389b	fix(tsdb): fix memory leak.	2023-06-20 14:46:32 +08:00
Hongze Cheng	09f2858927	fix some coredump	2023-06-20 14:34:52 +08:00
Haojun Liao	976dc322db	enh(tsdb): support delete data read.	2023-06-20 14:26:15 +08:00
Hongze Cheng	a33ce92e5d	more code	2023-06-20 13:33:31 +08:00
liuyao	870d75bf82	fill history pause&resume	2023-06-20 11:34:09 +08:00
Hongze Cheng	927f6861be	more code	2023-06-20 10:41:24 +08:00
Hongze Cheng	a4ca770449	refact code	2023-06-20 09:33:22 +08:00
Shungang Li	aa3dd2bbe8	fix for compile	2023-06-20 09:06:23 +08:00
yihaoDeng	548e439aa2	add checkpoint	2023-06-19 20:48:49 +08:00
Shungang Li	b93f653d7e	feat: enhance ttl, deletetime modified by writing-ops ... new config item: ttlChangeOnWrite (default 0) ttl delete time changes on last write if true	2023-06-19 19:03:35 +08:00
Haojun Liao	77af819708	Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize	2023-06-19 17:57:00 +08:00
Haojun Liao	524ef6edda	fix(tsdb): read data from new storage format.	2023-06-19 17:51:05 +08:00
liuyao	41c193945f	fill history pause&resume	2023-06-19 17:28:19 +08:00
Benguang Zhao	090a1a1595	enh: rename dir at the end in vnodeRenameVgroupId	2023-06-19 15:48:32 +08:00
Hongze Cheng	6d2ce5cd39	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-19 14:13:08 +08:00
Hongze Cheng	3074ab6541	more code	2023-06-19 14:12:48 +08:00
Hongze Cheng	de60e688f6	more fix	2023-06-19 12:52:09 +08:00
Hongze Cheng	9ce58a2d80	refact more code	2023-06-19 11:32:19 +08:00
Hongze Cheng	073a2b8dd3	refact more code	2023-06-19 09:32:29 +08:00
yihaoDeng	fd85a8495a	Merge branch 'dev30' into enh/triggerCheckPoint2	2023-06-17 14:17:21 +08:00
kailixu	b40069c0e1	chore: log optimization	2023-06-17 05:05:43 +08:00
Hongze Cheng	aba73614df	more code	2023-06-17 00:12:11 +08:00
wangmm0220	c5dfe169a6	fix:error	2023-06-16 19:33:03 +08:00
kailixu	4097b860d3	enh: support delete tsma interval	2023-06-16 19:04:12 +08:00
dapan1121	1329dce320	Merge pull request #21712 from taosdata/fix/TS-3484 ... fix: fix order by ts desc error	2023-06-16 18:01:16 +08:00
Hongze Cheng	a9fcebbdaf	more code	2023-06-16 17:12:05 +08:00
Haojun Liao	64365666b7	fix(stream): update the info, and do some internal refactor.	2023-06-16 16:04:43 +08:00
Hongze Cheng	d97f34931d	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-16 13:54:59 +08:00
Hongze Cheng	ec288ade15	change stt from multi seg to one seg	2023-06-16 12:16:53 +08:00
wade zhang	01b1cfe965	Merge pull request #21676 from taosdata/fix/TD-24715 ... enh(vnd/svr): convert msyType to string	2023-06-16 12:06:47 +08:00
wade zhang	d5f37359f4	Merge pull request #21722 from taosdata/fix/TD-24761 ... fix(tsdb/cache): rewrite cache update to fix cpu usage	2023-06-16 11:52:02 +08:00
Minglei Jin	968e3cf1ea	lru/applyF: fix ret value	2023-06-16 10:00:17 +08:00
Haojun Liao	4c82558eab	Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory	2023-06-16 09:55:24 +08:00
Haojun Liao	933801269a	fix(stream): fix memory leak and failed to close vnode.	2023-06-16 09:55:11 +08:00
Yihao Deng	97fa74ae2e	Merge branch 'main' into enh/staticLibMain	2023-06-15 21:37:01 +08:00
liuyao	0aa141ec77	use stream task state	2023-06-15 18:24:40 +08:00
Haojun Liao	a3e1882fb2	fix: fix dead lock.	2023-06-15 18:17:38 +08:00
Haojun Liao	2ad30e2946	other: add files.	2023-06-15 17:31:59 +08:00
Minglei Jin	2cb6c7af16	cache/commit: use outter lock	2023-06-15 17:16:14 +08:00
Minglei Jin	9d6a22e35e	cache/apply: use tsdb's flushState as ud	2023-06-15 17:07:56 +08:00
Minglei Jin	c56f29c031	cache/flushState: init flush state when open cache	2023-06-15 17:01:27 +08:00
Minglei Jin	158ae209bf	cache/lru: new applyF API for tlrucache	2023-06-15 16:34:51 +08:00
Haojun Liao	74e0138f72	Merge branch '3.0' into refact/fillhistory	2023-06-15 15:25:00 +08:00
wangmm0220	22776e60d5	fix:control memory size if consumer group is too much	2023-06-15 14:51:04 +08:00
Hongze Cheng	b6a567f92e	more code	2023-06-15 14:43:14 +08:00
Hongze Cheng	eacd2ac234	more code	2023-06-15 14:23:12 +08:00
liuyao	693942b821	trans state	2023-06-15 14:13:17 +08:00
Hongze Cheng	e34ff2a894	more code	2023-06-15 14:10:35 +08:00
Haojun Liao	5fdfe98696	fix: fix syntax error.	2023-06-15 13:31:30 +08:00
Hongze Cheng	56dfeadd50	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-15 13:17:44 +08:00
Haojun Liao	1b9eca5ce0	other: merge main.	2023-06-15 13:03:17 +08:00
Haojun Liao	13028744df	refactor: do some internal refactor.	2023-06-15 10:24:21 +08:00
Minglei Jin	6d23ea93ea	cache/update: fix memory leak	2023-06-15 08:40:36 +08:00
Haojun Liao	53377c2c1f	fix(stream): wait for stream task completed.	2023-06-15 01:14:41 +08:00
Benguang Zhao	b86fc3a697	fix: vnodeRenameVgroupId correctly	2023-06-14 21:38:25 +08:00
Yihao Deng	7ded6fc7a2	Merge branch '3.0' into enh/triggerCheckPoint2	2023-06-14 16:30:38 +08:00
Hongze Cheng	33eaeb743c	more code	2023-06-14 16:15:40 +08:00
liuyao	9a3708e17b	pause&resume fill history	2023-06-14 15:54:07 +08:00
Minglei Jin	d04a33f349	fix(tsdb/cache): rewrite cache update to fix cpu usage	2023-06-14 15:35:21 +08:00
Haojun Liao	7c6fbd7772	enh(stream): do some internal refactor and support secondary scan for history data.	2023-06-14 14:10:09 +08:00
Hongze Cheng	4138361839	refact code	2023-06-14 14:05:41 +08:00
Hongze Cheng	5bacfb4f94	refact code	2023-06-14 13:38:51 +08:00
Hongze Cheng	48ea3963e7	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-14 13:12:31 +08:00
yihaoDeng	30ea3aa419	add static lib	2023-06-14 12:15:02 +08:00
yihaoDeng	ee3017ed3a	add static lib	2023-06-14 12:14:49 +08:00
Haojun Liao	b44447e6f3	enh(stream): support restore from disk.	2023-06-14 10:19:03 +08:00
Haojun Liao	844a23225a	Merge pull request #21600 from taosdata/mark/tmq ... fix:check wal not exist again before register to push & move push log…	2023-06-14 10:18:39 +08:00
Ganlin Zhao	4bd1ae90fa	fix: fix order by ts desc error	2023-06-14 09:52:41 +08:00
Hongze Cheng	c85c032158	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-14 09:14:16 +08:00
wangmm0220	8070223aba	fix:lock error	2023-06-13 18:27:06 +08:00
Ganlin Zhao	647ddaad97	fix: fix order by ts desc error	2023-06-13 17:28:31 +08:00
Hongze Cheng	e01d598da9	more code	2023-06-13 17:16:06 +08:00
Haojun Liao	97da2a8fac	fix(stream): set the fill history status.	2023-06-13 16:10:55 +08:00
wangmm0220	d8d6b6dd21	Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749	2023-06-13 15:15:05 +08:00
wangmm0220	8a81278024	fix:load pHandle if necessary wher tq restore	2023-06-13 15:14:11 +08:00
Haojun Liao	933d08b489	Merge pull request #21690 from taosdata/feature/TS-3495 ... feat:add parameters for consumer & add offset rows for subscription	2023-06-13 14:59:15 +08:00
Hongze Cheng	42a09cc9df	more code	2023-06-13 14:30:24 +08:00
Hongze Cheng	7baeabc6b9	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-13 13:21:12 +08:00
wangmm0220	fb123d8761	fix:conflict from 3.0	2023-06-13 09:47:08 +08:00
Haojun Liao	fb24ed161d	enh(stream): set correct task status.	2023-06-12 22:48:23 +08:00
yihaoDeng	83dde6a212	add trigger checkpoint	2023-06-12 14:33:08 +00:00
Hongze Cheng	e4840cb5ab	fix	2023-06-12 17:48:49 +08:00
Hongze Cheng	bd01d08b05	mroe code	2023-06-12 17:19:31 +08:00
Hongze Cheng	71df0a00be	more code	2023-06-12 17:17:00 +08:00
Hongze Cheng	438d0caef7	mroe code	2023-06-12 16:55:20 +08:00
Hongze Cheng	9a4f6abe54	more code	2023-06-12 16:12:29 +08:00
Benguang Zhao	16fbcbb67a	fix: filter by tbFName in metaFilterTableByHash	2023-06-12 14:19:50 +08:00
Hongze Cheng	5405a967fb	refact code	2023-06-12 13:39:25 +08:00
Hongze Cheng	4813af0867	refact code	2023-06-12 13:27:02 +08:00
Haojun Liao	78a240be8f	enh(stream): add dispatch msg.	2023-06-12 13:12:45 +08:00
Hongze Cheng	22b80c55bf	refact code	2023-06-12 10:27:22 +08:00
Hongze Cheng	e6039839f1	refact code	2023-06-12 10:26:18 +08:00
Hongze Cheng	b8fb34e6c6	refact	2023-06-12 10:13:15 +08:00
Hongze Cheng	8be0e1710e	refact code	2023-06-12 10:08:35 +08:00
wangmm0220	1903b815d4	fix:modify offset description to string	2023-06-12 09:45:06 +08:00
wangmm0220	6657b8d849	fix:modify offset description to string	2023-06-12 09:44:00 +08:00
Benguang Zhao	3689b41f3a	Merge branch '3.0' into FIX/TD-24182-3.0	2023-06-12 09:39:49 +08:00
Hongze Cheng	0c6acda102	refact code	2023-06-10 17:16:01 +08:00
yihaoDeng	a2030dc378	add trigger checkpoint	2023-06-09 12:12:51 +00:00
Minglei Jin	4884d0af53	vnd/svr: convert msyType to string	2023-06-09 18:00:04 +08:00
Hongze Cheng	9cdaf24113	more code	2023-06-09 17:52:57 +08:00
Hongze Cheng	2c5b5289d0	fix more code	2023-06-09 16:43:09 +08:00
Hongze Cheng	cbd5da5dee	more code	2023-06-09 16:07:06 +08:00
Hongze Cheng	1ee9f80e1f	more code	2023-06-09 15:10:54 +08:00
Haojun Liao	69c9eda7af	fix(stream): fix race condition.	2023-06-09 11:37:38 +08:00
Haojun Liao	63ef04593d	fix: fix syntax error.	2023-06-09 09:48:18 +08:00
Haojun Liao	53246ed6bb	other: merge other branch.	2023-06-09 09:41:10 +08:00
Hongze Cheng	3753c7d602	refact more	2023-06-09 09:23:56 +08:00
Minglei Jin	cab07b2736	vnode/svr: fix missing colon post vgId	2023-06-09 08:21:45 +08:00
wangmm0220	3f46a9bbc9	feat:add parameters for consumer & add offset rows for subscription	2023-06-08 18:14:02 +08:00
Haojun Liao	6726edae0c	fix(stream): add more logs.	2023-06-08 17:54:22 +08:00
Hongze Cheng	cb52b7a747	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-08 17:39:01 +08:00
Hongze Cheng	e9a0210ea6	more code	2023-06-08 17:31:35 +08:00
Haojun Liao	2b6ace653a	refactor: do some internal refactor.	2023-06-08 16:14:27 +08:00
Hongze Cheng	ef524f6965	more code	2023-06-08 15:35:43 +08:00
yihaoDeng	8b91617145	Merge branch 'enh/dv3' into enh/triggerCheckpoint	2023-06-08 07:20:41 +00:00
yihaoDeng	77f287d9be	add trigger checkpoint	2023-06-08 07:19:59 +00:00
Minglei Jin	a6968485a8	enh(vnd/sync): refine invalid message log	2023-06-08 14:45:02 +08:00
Haojun Liao	30eba472c3	Merge pull request #21602 from taosdata/fix/TD-24600-dv3 ... fix/td-24600-dv3	2023-06-08 13:42:02 +08:00
Hongze Cheng	13229b0ee1	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-08 13:38:32 +08:00
Hongze Cheng	9d4a626f42	more code	2023-06-08 13:28:13 +08:00
Hongze Cheng	685c0e5593	more code	2023-06-08 11:41:01 +08:00
Hongze Cheng	0c9b66b574	more code	2023-06-08 10:51:43 +08:00
yihaoDeng	9b749b8faa	change link op t	2023-06-08 02:43:44 +00:00
Hongze Cheng	2f5f0b75df	refact code	2023-06-08 10:31:19 +08:00
Hongze Cheng	91c8391bff	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-08 09:53:57 +08:00
yihaoDeng	1f1f37312d	add trigger checkpoint	2023-06-07 14:32:48 +00:00
Haojun Liao	06cf3588da	refactor: do some internal refactor.	2023-06-07 15:03:04 +08:00
yihaoDeng	4fa1cc6dd3	change link opt	2023-06-07 05:26:07 +00:00
liuyao	1e9c4d5fac	opt stream block dispatch	2023-06-07 10:45:27 +08:00
Haojun Liao	6a3c935b4a	fix(stream): fix error in fill history scan.	2023-06-07 09:15:55 +08:00
Hongze Cheng	e6fb46c072	more code	2023-06-06 16:42:51 +08:00
Hongze Cheng	89a9e01375	more code	2023-06-06 16:17:29 +08:00
Hongze Cheng	96d29bc93b	more code	2023-06-06 11:07:45 +08:00
Minglei Jin	57b0cb84eb	fix(cache/binary): fix crash in freeItem	2023-06-06 10:23:50 +08:00
Hongze Cheng	d3bf34e92a	more code	2023-06-05 22:55:00 +08:00
Hongze Cheng	aad386e795	more code	2023-06-05 22:35:06 +08:00
yihaoDeng	ae09d1d031	fix:wal error	2023-06-05 19:49:54 +08:00
Hongze Cheng	5d1783f4d4	more code	2023-06-05 18:31:59 +08:00
Hongze Cheng	9caf359ee1	more code	2023-06-05 18:29:05 +08:00
Minglei Jin	c4418046e1	Merge branch '3.0' into fix/TS-3247	2023-06-05 18:17:18 +08:00
Haojun Liao	0dd933013c	enh(stream): make history task for stream running.	2023-06-05 17:58:00 +08:00
wade zhang	11321aa279	Merge pull request #21386 from taosdata/fix/TD-23549 ... fix(meta): split meta	2023-06-05 17:47:19 +08:00
wangmm0220	1b9387b683	fix:remove tq lock in write thread	2023-06-05 17:45:46 +08:00
wangmm0220	f2ee657b62	fix:check wal not exist again before register to push & move push logic from write thread to query thread	2023-06-05 17:21:47 +08:00
Hongze Cheng	46aa6d4896	refact code	2023-06-05 16:22:06 +08:00
Hongze Cheng	37ae918114	more code	2023-06-05 16:08:02 +08:00
Hongze Cheng	934a170e64	more code	2023-06-05 16:02:53 +08:00
Haojun Liao	fcc706c45c	enh(stream): refactor the fill history task.	2023-06-05 15:59:01 +08:00
Hongze Cheng	ac62592140	more code	2023-06-05 15:46:35 +08:00
Minglei Jin	d02746d86f	fix(query/sys): pause/resume with sys scan operator	2023-06-05 15:24:39 +08:00
Haojun Liao	077e1a1ed4	Merge branch '3.0' into refact/fillhistory	2023-06-05 11:41:13 +08:00
Hongze Cheng	efff4e77f0	more code	2023-06-05 09:36:26 +08:00
Hongze Cheng	5649401a65	more code	2023-06-05 09:22:20 +08:00
Hongze Cheng	3df9620450	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-05 09:10:16 +08:00
Haojun Liao	044e56fc97	Merge branch '3.0' into fix/resume_mem	2023-06-03 12:19:17 +08:00
Haojun Liao	4bb6429249	fix(query): fix syntax error.	2023-06-03 00:20:59 +08:00
Haojun Liao	becacbc84b	fix(query): fix syntax error.	2023-06-02 23:36:47 +08:00
Haojun Liao	b5b4cd2a05	fix(query): load del info with upper version limitation.	2023-06-02 23:15:27 +08:00
Hongze Cheng	53ff6edad7	fix bug	2023-06-02 19:03:34 +08:00
Hongze Cheng	632c6fb4dd	more code	2023-06-02 18:42:15 +08:00
Haojun Liao	cca69f3038	Merge branch '3.0' into fix/resume_mem	2023-06-02 18:40:48 +08:00
Hongze Cheng	a2dafefe03	more code	2023-06-02 17:36:14 +08:00
wangmm0220	56f7a137ee	fix:conflict	2023-06-02 15:47:53 +08:00
wangmm0220	b2f0d88639	fix:conflict	2023-06-02 15:43:35 +08:00
Hongze Cheng	33afb08e5c	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-02 14:40:01 +08:00
Hongze Cheng	da31d92b7e	more code	2023-06-02 14:39:54 +08:00
yihaoDeng	f4bde33dc3	avoid mem leak	2023-06-02 06:06:05 +00:00
Haojun Liao	cce87a036f	other: merge 3.0.	2023-06-02 13:34:20 +08:00
Haojun Liao	709e3f5079	Merge pull request #21566 from taosdata/fix/TD-24570 ... reset ud table name	2023-06-02 13:26:49 +08:00
Haojun Liao	d45aa7ef84	Merge pull request #21555 from taosdata/fix/liaohj_main ... other: merge main into 3.0.	2023-06-02 13:11:12 +08:00
Haojun Liao	f1bd829977	refactor: do some internal refactor.	2023-06-02 13:10:54 +08:00
Haojun Liao	27b7d1ec88	refactor: do some internal refactor.	2023-06-02 11:17:44 +08:00
liuyao	27f791ac7f	reset ud table name	2023-06-02 11:05:39 +08:00
Hongze Cheng	884d2cc834	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-02 09:31:54 +08:00
yihaoDeng	4d0ce625c4	Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042	2023-06-01 22:55:30 +08:00
wangmm0220	a7418d439b	Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042	2023-06-01 22:50:51 +08:00
Hongze Cheng	5e75fe006c	more code	2023-06-01 18:56:40 +08:00
wangmm0220	56782a5d41	fix:open task case & modify mqRebVgReq encode/decode style	2023-06-01 18:29:16 +08:00
Haojun Liao	ee8a9856cb	Merge pull request #21557 from taosdata/feature/TD-19042 ... fix:make version compatible	2023-06-01 18:25:37 +08:00
Hongze Cheng	9d1e90f914	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-06-01 17:20:37 +08:00
Hongze Cheng	65720b80fa	more code	2023-06-01 17:12:26 +08:00
Hongze Cheng	a3cacfe68b	more code	2023-06-01 17:08:46 +08:00
Hongze Cheng	e07afeeeaf	more code	2023-06-01 17:05:20 +08:00
wangmm0220	69499b9582	fix:make version compatible	2023-06-01 16:09:17 +08:00
wangmm0220	d20e0a06f6	fix:make version compatible	2023-06-01 16:04:45 +08:00
wangmm0220	21920721f3	fix:make version compatible	2023-06-01 15:10:08 +08:00
Hongze Cheng	e99b33ede5	more code	2023-06-01 15:08:45 +08:00
Hongze Cheng	bdc9fc473c	more code	2023-06-01 11:11:02 +08:00
Minglei Jin	9b9bf2de68	meta/tbc: key cannot be null	2023-06-01 10:41:01 +08:00
Hongze Cheng	fbc4d649de	more code	2023-06-01 10:36:12 +08:00
Haojun Liao	5d98a319c7	Merge pull request #21515 from taosdata/feature/TD-19042 ... feat: support create topic as stable with conditions	2023-06-01 09:56:55 +08:00
Haojun Liao	5301c5756a	other: merge main into 3.0.	2023-06-01 09:29:18 +08:00
Minglei Jin	fb2f367aac	meta/split: trim invalidated uids	2023-06-01 08:13:32 +08:00
Haojun Liao	6d04c4e2fd	refactor: do some internal refactor.	2023-05-31 19:05:40 +08:00
Haojun Liao	9e021087a9	refactor: do some internal refactor.	2023-05-31 19:04:53 +08:00
Haojun Liao	a3abe25539	refactor: do some internal refactor.	2023-05-31 19:03:37 +08:00
Hongze Cheng	d4f4ac1d89	more code	2023-05-31 17:49:08 +08:00
Haojun Liao	fa5c024b3e	refactor: do some internal refactor.	2023-05-31 17:22:59 +08:00
Haojun Liao	18b971c666	fix(query): check the version range when dump partial rows of file block to sdata block directly.	2023-05-31 17:06:38 +08:00
Haojun Liao	bbb6359ea2	fix(query): add check for version range when dumping partial rows of file block to data block	2023-05-31 17:03:39 +08:00
Hongze Cheng	dc8901268e	fix code	2023-05-31 16:34:50 +08:00
Hongze Cheng	cf0228f87e	more code	2023-05-31 15:57:51 +08:00
Minglei Jin	99d6c5cfa0	Merge branch '3.0' into fix/TD-23549	2023-05-31 15:31:20 +08:00
Hongze Cheng	10e6e52670	more code	2023-05-31 15:19:28 +08:00
Hongze Cheng	616a675682	more code	2023-05-31 10:59:47 +08:00
Benguang Zhao	28efd7dcd7	enh: check trans conflicts in mndTransValidate	2023-05-31 10:53:36 +08:00
Haojun Liao	e237b4ac39	refactor: do some internal refactor.	2023-05-31 09:19:05 +08:00
Hongze Cheng	938d87f601	more code	2023-05-31 09:02:50 +08:00
Hongze Cheng	838a47cb45	more code	2023-05-30 18:08:32 +08:00
Hongze Cheng	03f7c6533e	more code	2023-05-30 18:06:28 +08:00
Haojun Liao	eda06081ff	enh(stream): refactor and serialize the attributes of history tasks.	2023-05-30 16:55:37 +08:00
wangmm0220	689ee05527	Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042	2023-05-30 15:45:46 +08:00
Hongze Cheng	e0889b404d	more code	2023-05-30 15:31:11 +08:00
Hongze Cheng	9222d9651e	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-30 14:21:19 +08:00
Hongze Cheng	29c29871d2	more code	2023-05-30 14:20:15 +08:00
Haojun Liao	d122a398b3	Merge pull request #21516 from taosdata/fix/TD-24447 ... set sched status	2023-05-30 10:59:28 +08:00
Hongze Cheng	8626d3e691	more code	2023-05-30 10:43:44 +08:00
wangmm0220	d490ca753f	Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042	2023-05-30 09:48:49 +08:00
Haojun Liao	65b1574fbe	Merge pull request #21499 from taosdata/mark/tmq ... fix:put poll to push manager if wal not exist when offset is latest	2023-05-30 09:36:53 +08:00
Haojun Liao	20a0054c4a	Merge pull request #21472 from taosdata/enh/addCompileError ... change parameter	2023-05-30 09:36:36 +08:00
dapan1121	2d6859d5d6	Merge pull request #21510 from taosdata/szhou/fix-ts3461 ... fix: if block row num is less than definit min rows, set the bucket index to 0	2023-05-30 08:51:24 +08:00
wade zhang	3a2831a3f4	Merge pull request #21517 from taosdata/fix/TD-24472 ... fix(rocks/log): set info log level to warn_level	2023-05-30 08:35:00 +08:00
Hongze Cheng	b479a0a06b	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-29 21:46:26 +08:00
Hongze Cheng	41459a92c0	more code	2023-05-29 18:42:31 +08:00
wangmm0220	41ed0138b4	fix:compile error	2023-05-29 17:25:11 +08:00
wangmm0220	07bdb95b1a	fix:compile error	2023-05-29 17:10:11 +08:00
wangmm0220	9eb15e41ef	fix:put poll to push manager if wal not exist when offset is latest	2023-05-29 16:44:03 +08:00
Hongze Cheng	6aac0e0c49	more code	2023-05-29 15:58:54 +08:00
Minglei Jin	3a9d55ca35	fix(rocks/log): set info log level to warn_level	2023-05-29 15:56:28 +08:00
wangmm0220	5eb1c559e5	fix:save offset if latest	2023-05-29 15:51:00 +08:00
liuyao	b541a0a053	set sched status	2023-05-29 15:42:47 +08:00
wangmm0220	78db3520a6	fix:conflict	2023-05-29 14:57:03 +08:00
wangmm0220	a71878d07f	feat: support create topic as stable with conditions	2023-05-29 11:46:59 +08:00
Haojun Liao	8f61e2d6ef	refactor: do some internal refactor.	2023-05-29 10:50:50 +08:00
shenglian zhou	43c0656df2	fix: if block row num is less than definit min rows, set the bucket index to 0	2023-05-29 10:45:26 +08:00
yihaoDeng	342ce14c7d	Merge branch 'enh/3.0' into fix/shared_link_rocksdb	2023-05-29 02:37:47 +00:00
yihaoDeng	58cc631c22	Merge branch 'enh/3.0' into fix/shared_link_rocksdb	2023-05-29 02:29:56 +00:00
Haojun Liao	953a69a829	refactor: do some internal refactor.	2023-05-29 10:12:27 +08:00
Hongze Cheng	9d6a264e4d	more code	2023-05-28 23:33:03 +08:00
Hongze Cheng	9d031f4d7b	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-28 11:08:39 +08:00
Hongze Cheng	5bcc9c540a	more code	2023-05-27 23:08:08 +08:00
Haojun Liao	1e786624b2	Merge pull request #21501 from taosdata/refact/fillhistory ... fix(stream): set the skip offset when resume stream task.	2023-05-27 22:45:54 +08:00
Hongze Cheng	6668da43f8	more code	2023-05-27 20:13:07 +08:00
Hongze Cheng	e4b7318ced	more code	2023-05-27 19:54:07 +08:00
Hongze Cheng	442586692b	more code	2023-05-27 19:01:52 +08:00
Haojun Liao	d9de1813da	Merge branch '3.0' into refact/fillhistory	2023-05-27 16:31:11 +08:00
Hongze Cheng	2cf70ab0cc	more code	2023-05-27 15:29:22 +08:00
Hongze Cheng	880359ddb3	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-27 11:50:25 +08:00
Hongze Cheng	62a3c27176	more code	2023-05-27 11:49:59 +08:00
Hongze Cheng	b4b0db9a3d	more code	2023-05-26 23:51:18 +08:00
Hongze Cheng	0090d02226	more code	2023-05-26 23:42:47 +08:00
Haojun Liao	b38e253019	fix(stream): set the skip offset when resume stream task.	2023-05-26 22:51:58 +08:00
Hongze Cheng	9abfe52c4d	more code	2023-05-26 19:41:27 +08:00
Hongze Cheng	4cb4c6388c	more code	2023-05-26 19:32:02 +08:00
wangmm0220	a3e214b9e8	fix:put poll to push manager if wal not exist when offset is latest	2023-05-26 19:17:04 +08:00
wangmm0220	50487255b3	fix:put poll to push manager if wal not exist when offset is latest	2023-05-26 19:02:40 +08:00
wade zhang	66b7d90849	Merge pull request #21479 from taosdata/fix/TD-24405 ... fix(cache): fix deleted data	2023-05-26 17:02:33 +08:00
Haojun Liao	87957e2bb0	Merge pull request #21478 from taosdata/fix/TD-23423 ... fix tsdb read error version	2023-05-26 16:56:09 +08:00
Hongze Cheng	f5286359fa	more code	2023-05-26 15:57:31 +08:00
Hongze Cheng	7acc124dfc	more code	2023-05-26 15:25:29 +08:00
Minglei Jin	34b9b322cd	cache/var-data: realloc for cache reading	2023-05-26 15:01:57 +08:00
Hongze Cheng	b07ad168c3	more code	2023-05-26 14:49:50 +08:00
Haojun Liao	f61f37c936	fix(tmq): set the correct offset rsp when no poll occuring.	2023-05-26 14:20:01 +08:00
Minglei Jin	6e29d7879f	cache/var-data: realloc var data	2023-05-26 14:13:01 +08:00
Hongze Cheng	9156b297ae	more code	2023-05-26 11:51:08 +08:00
Haojun Liao	1e845acabe	fix(tmq): allow seek before get assignment	2023-05-26 11:34:12 +08:00
Minglei Jin	bb481c52b6	cache/skyline: fix skyline false condition	2023-05-26 11:26:55 +08:00
Haojun Liao	ccbea13012	Merge branch '3.0' into refact/fillhistory	2023-05-26 10:40:53 +08:00
Haojun Liao	974b59c238	fix(query): fix bug in iterating the table list.	2023-05-26 10:10:10 +08:00
Haojun Liao	409656f7b6	fix(query): fix bug in iterating the table list.	2023-05-26 10:05:54 +08:00
Hongze Cheng	fa00d0df77	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-26 09:55:27 +08:00
Haojun Liao	cea8334427	Merge pull request #21449 from taosdata/refact/fillhistory ... refactor: remove the module dependency. TD-24279	2023-05-26 09:01:45 +08:00
liuyao	75eb724c37	fix tsdb read error version	2023-05-26 08:55:23 +08:00
Haojun Liao	e24ce2111f	fix: set function ptr.	2023-05-26 00:00:07 +08:00
Haojun Liao	1e22d875b3	fix: fix dead lock.	2023-05-25 20:00:26 +08:00
Haojun Liao	c3be7b14be	fix: set correct function ptr.	2023-05-25 17:51:03 +08:00
Minglei Jin	8ee1288611	fix(cache): remove deleted data	2023-05-25 17:47:55 +08:00
Haojun Liao	0966213847	fix(arch): set the correct module api dependency.	2023-05-25 14:21:40 +08:00
Haojun Liao	da9f33a483	fix: fix error in set function ptr.	2023-05-25 09:56:34 +08:00
wade zhang	511ff7130b	Merge pull request #21445 from taosdata/fix/TD-24373 ... fix(cache/read): associate tbname with primary ts column	2023-05-25 08:01:51 +08:00
Haojun Liao	4a42f6b983	fix: fix error in api call.	2023-05-25 00:50:03 +08:00
Haojun Liao	a9b18d203d	fix:fix error.	2023-05-24 23:49:26 +08:00
Haojun Liao	ab907e3344	fix(query): fix syntax error.	2023-05-24 21:53:40 +08:00
Hongze Cheng	5586c6d8fb	Merge branch 'fix/shared_link_rocksdb' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-24 19:05:30 +08:00
Hongze Cheng	4d526ed0cd	change more	2023-05-24 18:59:09 +08:00
Minglei Jin	fc5d06681e	cache/last_row: treat none as null with last_row	2023-05-24 18:55:51 +08:00
Hongze Cheng	3c2a54ab4b	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-24 18:28:56 +08:00
Hongze Cheng	7d7c8af852	more code	2023-05-24 18:28:44 +08:00
wangmm0220	8537e4e80e	feat:add tag filter for stable subscribe	2023-05-24 18:26:55 +08:00
Haojun Liao	fe09705855	fix: set the init function pointer.	2023-05-24 17:13:20 +08:00
Ganlin Zhao	89bea7100f	fix: fix count var type error	2023-05-24 00:31:05 -07:00
dapan1121	cbbbaca553	Merge pull request #21437 from taosdata/fix/TD-23955-3.0 ... fix: delete index filter for desc query	2023-05-24 14:05:07 +08:00
Hongze Cheng	ab7f6eb764	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-24 13:47:35 +08:00
Hongze Cheng	106f701ebb	more code	2023-05-24 13:47:28 +08:00
Haojun Liao	b2ce45b07b	refactor: do some internal refactor.	2023-05-24 13:39:20 +08:00
Haojun Liao	a2f29aa0f5	refactor: do some internal refactor.	2023-05-24 13:34:46 +08:00
Haojun Liao	1f7f326bed	refactor: do some internal refactor and set the api function ptr.	2023-05-24 13:22:05 +08:00
Hongze Cheng	4775b26e5e	more code	2023-05-24 11:52:38 +08:00
kailixu	ef899a0cc3	fix: delete index filter for desc query	2023-05-24 11:28:45 +08:00
Minglei Jin	26bfa4363d	fix(cache/read): associate tbname with primary ts column	2023-05-24 11:01:47 +08:00
Hongze Cheng	d6d0bf0e41	enh: add varchar sma	2023-05-24 10:47:26 +08:00
liuyao	180abf2229	set agg task status	2023-05-24 09:34:40 +08:00
Hongze Cheng	166a86db69	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-24 09:31:20 +08:00
Hongze Cheng	0c09d6f0d2	more code	2023-05-24 09:30:14 +08:00
liuyao	b5d01f9bab	set agg pause status	2023-05-24 09:19:28 +08:00
Haojun Liao	39a1fa8f78	refactor: do some internal refactor.	2023-05-23 19:20:25 +08:00
Haojun Liao	66477a28ca	refactor: do some internal refactor.	2023-05-23 19:10:50 +08:00
Haojun Liao	3d084adf1f	Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory ... # Conflicts: # source/dnode/vnode/inc/vnode.h # source/libs/executor/src/executil.c # source/libs/index/CMakeLists.txt # source/libs/index/src/indexFilter.c	2023-05-23 18:32:47 +08:00
Haojun Liao	e67b532d8a	refactor: refactor the module dependency.	2023-05-23 18:29:23 +08:00
kailixu	82b8c3c3d1	fix: delete index filter for desc query	2023-05-23 18:21:21 +08:00
kailixu	18e83173c8	fix: delete index filter for desc query	2023-05-23 17:21:45 +08:00
wade zhang	68a98d4d09	Merge pull request #21429 from taosdata/fix/TD-24306 ... fix(cache): sychronize commit, read and write threads with writebatch	2023-05-23 16:20:59 +08:00
Hongze Cheng	1c10694fde	more code	2023-05-23 16:20:19 +08:00
Hongze Cheng	36b2495cf6	more code	2023-05-23 15:07:42 +08:00
Minglei Jin	6d620a7d7c	fix(cache/read): set none to null instead of skipping column	2023-05-23 14:51:26 +08:00
Hongze Cheng	5d5add3f4b	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-23 14:31:47 +08:00
Hongze Cheng	cd39d129c2	more code	2023-05-23 14:25:47 +08:00
Hongze Cheng	85c4c61027	more code	2023-05-23 14:18:23 +08:00
Minglei Jin	81048f93b0	fix(cache): sychronize commit, read and write threads with writebatch	2023-05-23 13:44:33 +08:00
yihaoDeng	c15b1e3520	opt compile	2023-05-23 11:46:02 +08:00
Hongze Cheng	91a5e17b9b	more code	2023-05-23 11:45:33 +08:00
Hongze Cheng	57bde4f311	more code	2023-05-23 11:35:44 +08:00
Hongze Cheng	ca28c99f80	more code	2023-05-23 11:19:24 +08:00
wangmm0220	ed612088c0	fix:lost data because tsdbreader or task is killed	2023-05-23 10:32:13 +08:00
Hongze Cheng	89eafa18cb	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-23 09:58:53 +08:00
Hongze Cheng	46b72f340a	more fix	2023-05-23 09:58:40 +08:00
kailixu	a171c0c860	Merge branch '3.0' into fix/TD-21457-3.0	2023-05-23 09:27:31 +08:00
wade zhang	9e73a69316	Merge pull request #21389 from taosdata/fix/TD-24306 ... fix(cache/commit): skip batch write if empty	2023-05-23 08:22:33 +08:00
kailixu	a3bf49d22f	chore: revert	2023-05-22 20:35:52 +08:00
kailixu	c75aa54a3d	fix: tsdb read and append _wstart for tsma	2023-05-22 20:33:29 +08:00
wangmm0220	d8387b95ff	fix:set task status to 0 in inti	2023-05-22 20:14:43 +08:00
Hongze Cheng	c16126fa96	more code	2023-05-22 18:39:10 +08:00
Haojun Liao	f3491310a9	Merge pull request #21411 from taosdata/fix/TD-24144 ... fix:remove get schema from previous for taosx	2023-05-22 18:37:20 +08:00
Minglei Jin	75ccd024a2	cache/writebatch: separate read & write batches	2023-05-22 18:06:58 +08:00
dapan1121	08ff4f4540	fix: crash issue	2023-05-22 17:06:01 +08:00
Hongze Cheng	8b83c85b0c	more code	2023-05-22 16:28:31 +08:00
kailixu	f18fc19d76	fix: tsdb read and tsma _wstart append	2023-05-22 16:13:50 +08:00
Hui Li	0f4fb1c31d	Merge pull request #21407 from taosdata/mark/tmq ... fix:set task code success after kill	2023-05-22 16:10:18 +08:00
wangmm0220	ae515851c4	fix:remove get schema from previous for taosx	2023-05-22 15:32:30 +08:00
Minglei Jin	21adc23af4	cache/loading: skip partial loading tables	2023-05-22 15:21:19 +08:00
Hongze Cheng	e731a08f2d	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize	2023-05-22 14:07:49 +08:00
wangmm0220	591b51f624	fix:set task code success after kill	2023-05-22 12:42:21 +08:00
Haojun Liao	f520de0dab	refactor: adjust the module dependency.	2023-05-22 10:07:01 +08:00
Hui Li	3f824e2045	Merge pull request #21355 from taosdata/mark/tmq ... fix:error in pHandle lock	2023-05-22 08:57:45 +08:00
Haojun Liao	9423001fea	Merge pull request #21396 from taosdata/refact/fillhistory ... Refact/fillhistory	2023-05-21 01:12:00 +08:00