Commit graph

13185 commits

Author SHA1 Message Date
kailixu
3f65773222 enh: send grant to dnodes online and in async mode 2023-10-29 02:18:47 +08:00
Haojun Liao
3bf3d00d90 fix(stream): set the trans exec sequentially. 2023-10-27 23:45:50 +08:00
Haojun Liao
c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao
4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
Hongze Cheng
a7f3041ff3 more fix 2023-10-27 17:59:27 +08:00
Benguang Zhao
4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
Hongze Cheng
cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
dmchen
43e6dec6c2 TD-26971 2023-10-27 17:39:50 +08:00
dmchen
34c4ffde26 TD-26971 2023-10-27 09:30:30 +00:00
Minglei Jin
8c6f452f09 tsdb/write: make last tier writable to mem 2023-10-27 15:51:52 +08:00
kailixu
dc8cb7a99e fix: memory leak 2023-10-27 14:36:01 +08:00
Haojun Liao
dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
Haojun Liao
29b3a7a5e9 refactor: do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao
38eb5d2f89 refactor(stream): do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao
b4992a8506 other: add some logs. 2023-10-27 09:59:52 +08:00
Haojun Liao
9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
Haojun Liao
fa670a93f3 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-27 09:59:52 +08:00
Haojun Liao
454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao
33dc51cc86 fix(stream): add some logs. 2023-10-27 09:59:44 +08:00
Haojun Liao
1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao
2493c21ed3 fix(stream): fix the invalid write in sma 2023-10-27 09:58:52 +08:00
Haojun Liao
7cce53f7e5 fix(stream): ignore the check status when is ready. 2023-10-27 09:58:52 +08:00
Haojun Liao
c99f434706 fix(stream): set checkpoint failure when in pause status. 2023-10-27 09:58:52 +08:00
Haojun Liao
2c1af8dad8 refactor: do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao
1ad2c3029a refactor(stream): do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao
7311f9d2fe fix(sma): fix bugs in sma and do some internal refactor. 2023-10-27 09:58:51 +08:00
Haojun Liao
3bcffcf1da other: merge stream refactor from main. 2023-10-27 09:56:02 +08:00
Haojun Liao
47d4bac57a fix(stream): remove invalid assert. 2023-10-27 09:55:07 +08:00
Haojun Liao
4845474ea4 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao
5313543a9e refactor: do some internal refactor. 2023-10-27 09:55:05 +08:00
Haojun Liao
48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao
226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao
091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao
e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao
8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao
1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao
579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao
6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao
596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao
4badb445c4 refactor: do some internal refactor W.R.T. global configurations. 2023-10-27 09:54:07 +08:00
Haojun Liao
62c58ecd8b fix(stream):add more check for test cases. 2023-10-27 09:54:06 +08:00
Haojun Liao
a4f6042966 fix(stream): fix error in creating update node trans. 2023-10-27 09:52:14 +08:00
Haojun Liao
ffa798c4fa enh(stream): add some logs. 2023-10-27 09:52:14 +08:00
Haojun Liao
f549ce3578 refactor: do some internal refactor. 2023-10-27 09:49:16 +08:00
kailixu
9ae83455e2 chore: code format 2023-10-27 09:48:13 +08:00
liuyao
cf3bfe9310 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-27 09:39:00 +08:00
kailixu
96de7b0cf0 chore: update grant/dnode mgmt 2023-10-27 00:02:25 +08:00
facetosea
759a5d4bbf fix ctest 2023-10-26 21:06:08 +08:00
Hongze Cheng
b8c379a20d
Merge pull request #23413 from taosdata/fix/TD-26669
fix(tsdb/commmit): make ts big enough to skip row
2023-10-26 07:17:53 -05:00
wade zhang
d1e4e909c3
Merge pull request #23384 from taosdata/fix/TD-26884-3.0
Fix/td 26884 3.0
2023-10-26 17:00:00 +08:00
wade zhang
951442e3db
Merge pull request #23381 from taosdata/fix/TD-26884-main
TD-26884
2023-10-26 16:59:39 +08:00
Minglei Jin
b314758108 tsdb/commit: make ts big enough to skip row 2023-10-26 16:24:06 +08:00
yihaoDeng
4c03d372ef fix stream case error 2023-10-26 14:19:34 +08:00
kailixu
bb77015998 Merge branch '3.0' into enh/TD-26641-3.0 2023-10-26 10:40:54 +08:00
Hongze Cheng
209ebbde84
Merge pull request #23402 from taosdata/fix/TD-26189-libs3
cmake/xml2: use sha256 to verify distribution release
2023-10-25 20:27:29 -05:00
kailixu
64765579e9 enh: check interval and keep for retentions 2023-10-25 22:42:01 +08:00
yihaoDeng
db0f6258fe fix stream case error 2023-10-25 19:38:22 +08:00
Haojun Liao
c95cd8da8b refactor(stream): do some internal refactor. 2023-10-25 18:14:28 +08:00
liuyao
f51c985914 stream event window 2023-10-25 17:50:16 +08:00
Minglei Jin
d77ecbbb1b cmake/xml2: use sha256 to verify distribution release 2023-10-25 17:41:55 +08:00
dmchen
14be9c81e2 create table user and clusterid 2023-10-25 14:53:06 +08:00
Haojun Liao
9220731313 other: add some logs. 2023-10-25 14:51:59 +08:00
dmchen
7ef019d105 create table user and clusterid 2023-10-25 06:49:23 +00:00
Haojun Liao
f36b24ed24 fix(stream): disable follower nodes exec reset. 2023-10-25 14:16:36 +08:00
Haojun Liao
07e9d56e07 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-25 11:42:46 +08:00
Hongze Cheng
3ff331b8b7
Merge pull request #23391 from taosdata/fix/TD-26189-libs3
cmake: new option: BUILD_S3
2023-10-24 22:37:20 -05:00
Haojun Liao
03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
dapan1121
533711a7f2
Merge pull request #23387 from taosdata/fix/3.0/TS-4090
fix: disable life extending of conn cache obj when show queries/conns
2023-10-25 09:48:13 +08:00
dapan1121
ba43950bc6
Merge pull request #23294 from taosdata/fix/TD-26474-3.0
fix: add lock for trans
2023-10-25 08:46:19 +08:00
Haojun Liao
26aaa4a83c other: merge main. 2023-10-25 00:39:14 +08:00
Haojun Liao
13d979a2ee fix(stream): add some logs. 2023-10-25 00:03:46 +08:00
Haojun Liao
8cde39eebd fix(stream): fix dead lock when shutdown all tasks. 2023-10-24 19:11:24 +08:00
Minglei Jin
f9ca8fe962 cmake: new option: BUILD_S3 2023-10-24 16:10:46 +08:00
Haojun Liao
f1498f8929 fix(stream): fix the invalid write in sma 2023-10-24 15:24:34 +08:00
dmchen
162066235b create table 2023-10-24 14:31:27 +08:00
dmchen
956aa1742c TD-26884 2023-10-24 14:31:02 +08:00
Hongze Cheng
e7e7748e6d
Merge pull request #23366 from taosdata/fix/TD-26669
tsdb/commit: skip last tier ts data committing
2023-10-24 01:29:01 -05:00
dmchen
ae728ab412 create table 2023-10-24 06:17:13 +00:00
wangjiaming0909
be7791f9cd fix: disable life extending of conn cache obj when show queries/conns 2023-10-24 13:58:30 +08:00
yihaoDeng
95b0d4f083 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-24 13:40:47 +08:00
dmchen
ecd5f1084c TD-26884 2023-10-24 05:32:48 +00:00
yihaoDeng
d46cf878eb refactor stream backend 2023-10-24 11:53:52 +08:00
Haojun Liao
a6e706ba2d fix(stream): ignore the check status when is ready. 2023-10-24 11:38:14 +08:00
dapan1121
dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
Haojun Liao
e92b276e3e fix(stream): set checkpoint failure when in pause status. 2023-10-24 10:14:29 +08:00
Minglei Jin
e826532592 cmake/vnode: specify no default path for ssl & crypto 2023-10-24 10:10:43 +08:00
Haojun Liao
0dae8c3c76 refactor: do some internal refactor. 2023-10-24 09:49:14 +08:00
Haojun Liao
f446ff1c36 refactor(stream): do some internal refactor. 2023-10-24 09:48:10 +08:00
Haojun Liao
7a8b046a35 fix(sma): fix bugs in sma and do some internal refactor. 2023-10-24 09:40:38 +08:00
Minglei Jin
7fdf6cc696 cmake: use new dir for libs3 2023-10-24 09:04:24 +08:00
yihaoDeng
986a502019 refactor stream backend 2023-10-23 18:22:58 +08:00
yihaoDeng
ca1ffd584d refactor stream backend 2023-10-23 16:45:17 +08:00
Minglei Jin
80fb38f172 Merge branch '3.0' into fix/TD-26189-libs3 2023-10-23 16:31:21 +08:00
Minglei Jin
f630fc38f8 tsdb/commit: skip last tier ts data committing 2023-10-23 15:46:32 +08:00
yihaoDeng
9d210ec957 refactor stream backend 2023-10-23 14:06:25 +08:00
Haojun Liao
2ee3319611
Merge pull request #23360 from taosdata/fix/liaohj
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-23 12:45:42 +08:00
dapan1121
ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
Haojun Liao
a882c639be fix(stream): remove invalid assert. 2023-10-22 16:16:59 +08:00
Haojun Liao
825195b351 refactor: do some internal refactor. 2023-10-21 16:38:46 +08:00
Haojun Liao
74572dd6a7 refactor: do some internal refactor. 2023-10-21 15:21:02 +08:00
Haojun Liao
6dc8fc50bc
Merge pull request #23359 from taosdata/fix/3_liaohj
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-21 14:57:14 +08:00
Haojun Liao
49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
Haojun Liao
f667bf3866 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:19:45 +08:00
Haojun Liao
f1207d8d42 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:18:58 +08:00
Haojun Liao
c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
Haojun Liao
024bfa0fff
Merge pull request #23353 from taosdata/changeGenFirstTagName_3.0
gen first tag name
2023-10-20 15:38:32 +08:00
yihaoDeng
1a4cfd11a5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:28:10 +08:00
Minglei Jin
55647f9ce9 cos/put: make chunk small to not block other reqs 2023-10-20 15:15:03 +08:00
Haojun Liao
3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
yihaoDeng
1bc7e5eb85 enh gen first tag name 2023-10-20 14:02:13 +08:00
Minglei Jin
74d05c2771 vnode/cos: fix multipart uploading 2023-10-20 13:47:25 +08:00
yihaoDeng
e13fb887b8 enh gen first tag name 2023-10-20 10:47:27 +08:00
yihaoDeng
e89d1851c8 enh gen first tag name 2023-10-20 10:47:02 +08:00
yihaoDeng
6f21d542cd enh gen first tag name 2023-10-20 10:46:17 +08:00
yihaoDeng
f9a027bc7d enh gen first tag name 2023-10-20 10:45:57 +08:00
yihaoDeng
c0c6e206d2 enh gen first tag name 2023-10-20 10:44:33 +08:00
yihaoDeng
08fc4814cb enh gen first tag name 2023-10-20 10:43:44 +08:00
Haojun Liao
270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Haojun Liao
9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend
Opt/add status send
2023-10-20 09:52:12 +08:00
yihaoDeng
9f6dd2b405 change gen first tag name 2023-10-20 09:42:11 +08:00
yihaoDeng
8fbea08bba enh gen first tag name 2023-10-20 09:37:43 +08:00
dapan1121
42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121
969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
Benguang Zhao
959f8105ee enh: require command to trigger repairing vnodes on replaced disks 2023-10-19 18:55:12 +08:00
Haojun Liao
d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao
c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
yihaoDeng
67dc52d2d6 refactor stream checkpoint 2023-10-19 15:19:52 +08:00
Haojun Liao
402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
yihaoDeng
0188289308 statusClientRpc 2023-10-19 14:07:54 +08:00
yihaoDeng
b4b742b3fb add rpc sync read timeout 2023-10-19 11:35:29 +08:00
yihaoDeng
27b2d37bde add rpc sync read timeout 2023-10-19 11:27:31 +08:00
Benguang Zhao
a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao
a515f8a94f feat: use vnode config info if existing during vnodeCreate 2023-10-19 11:18:57 +08:00
Benguang Zhao
a95f6e6862 feat: support restore dnode with vnodes of replaced disks for primary dirs 2023-10-19 11:18:57 +08:00
Benguang Zhao
c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Benguang Zhao
5c85525fd0 enh: add tsdbFSCreateRefSnapshotWithoutLock 2023-10-19 11:18:57 +08:00
Benguang Zhao
f2bd43c07e fix: set field length properly in tsdbGetSnapDetails 2023-10-19 11:18:57 +08:00
Benguang Zhao
83013e0fe5 enh: return error in case of out of memory for tsdbGetSnapRangeHash 2023-10-19 11:18:57 +08:00
Benguang Zhao
59e8a2104c refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
eb8c4d3e8c enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
4e74533878 enh: avoid _Static_assert 2023-10-19 11:18:57 +08:00
Benguang Zhao
094cf408df enh: prepare vnode dir again in vnodeOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
c1f1709d59 fix: add rsmaSnapWriterPrepareClose 2023-10-19 11:18:57 +08:00
Benguang Zhao
74185b8b9c feat: exchange snapshot info for rsma tsdbs 2023-10-19 11:18:57 +08:00
Benguang Zhao
d5d713b1b4 enh: fill snapshot info for rsma tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao
b80f8201ce feat: detect fs incompleteness of RSMA tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao
29bbebc323 enh: refactor a func name as tsdbSnapGetDetails 2023-10-19 11:04:39 +08:00
Benguang Zhao
00aeb031d4 enh: replicate a fset if it is corrupted without valid minVer 2023-10-19 11:04:39 +08:00
Benguang Zhao
a6d5deb5d1 fixup: fix tsdbFSDoSanAndFix 2023-10-19 11:04:39 +08:00
Benguang Zhao
eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao
0c41fa56dc feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot 2023-10-19 11:00:44 +08:00
Benguang Zhao
e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao
410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao
f99795d027 enh: use tsdbSnapRangeArrayDestroy 2023-10-19 10:51:13 +08:00
Benguang Zhao
c1b2eedd3c feat: impl tsdbSnapGetInfo 2023-10-19 10:51:08 +08:00
yihaoDeng
b9b62a9a00 add rpc sync read timeout 2023-10-19 10:38:45 +08:00
Benguang Zhao
4d55488495 feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen 2023-10-19 10:37:34 +08:00
Benguang Zhao
083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Benguang Zhao
b23bcee690 fixup: about to revert this commit 2023-10-19 10:37:34 +08:00
Benguang Zhao
0ddbcd50d0 enh: maintain independent version range of tombs for SDataFileWriter 2023-10-19 10:37:34 +08:00
Benguang Zhao
4540bcb170 fixup: work-around a compiler bug 2023-10-19 10:37:34 +08:00
Benguang Zhao
44a7f5df47 feat: add tsdbSnapDiff 2023-10-19 10:37:34 +08:00
Benguang Zhao
6ae9bd0e9a feat: add tsdbFSToSnapRangeArray 2023-10-19 10:37:34 +08:00
Benguang Zhao
0a67cc8477 refact: use tsdbTFileUpdVerRange in tsdbSttFWriterCloseCommit 2023-10-19 10:37:34 +08:00
Benguang Zhao
54a10154a4 fixup: remove unused minVer and maxVer in ctx of SCommitter2 2023-10-19 10:37:34 +08:00
Benguang Zhao
6b753cc0cd refact: remove unused code is_same_file 2023-10-19 10:37:34 +08:00
Benguang Zhao
dc402e21e3 fix: merge old version range of head and tomb files in tsdbDataFileWriterCloseCommit 2023-10-19 10:37:34 +08:00
Benguang Zhao
f8c6e8744a refact: change field name of pExclude in SVSnapReader 2023-10-19 10:37:34 +08:00
Benguang Zhao
01d0c1247d enh: record ver range in writer ctx 2023-10-19 10:37:34 +08:00
Benguang Zhao
f207b3ddd5 refact: rename func names of tsdbDataWriterUpdVerRange and tsdbSttWriterUpdVerRange 2023-10-19 10:37:34 +08:00
Benguang Zhao
399afe1094 refact: tidy up declarations of funcs in tsdbUpgrade.c 2023-10-19 10:37:25 +08:00
Haojun Liao
f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
Benguang Zhao
ed6d7c4c4d refact: relocate declarations and defs of tsdbFileWriteTombBlock and tsdbFileWriteTombBlk 2023-10-19 10:17:34 +08:00
Benguang Zhao
823aad4a5e enh: record version range of STFile for data and stt files 2023-10-19 10:17:34 +08:00
Benguang Zhao
3cd458f5c9 enh: fill minVer and maxVer of nf in STFileObj during migration 2023-10-19 10:17:34 +08:00
Benguang Zhao
1446b44733 fixup: remove minVer and maxVer in FSetWriterConfig 2023-10-19 10:17:34 +08:00
Benguang Zhao
c8a46394f1 enh: set default values of minVer and maxVer while upgrading from CURRENT 2023-10-19 10:17:34 +08:00
Benguang Zhao
ab7a20c117 enh: write stt and data files with minVer and maxVer 2023-10-19 10:17:34 +08:00
Benguang Zhao
da28d490aa enh: filterByVersion with snap ranges 2023-10-19 10:17:34 +08:00
Benguang Zhao
7a13e4b2cf enh: add minVer and maxVer for entries in current.json 2023-10-19 10:17:34 +08:00
Benguang Zhao
1be2835fc1 enh: exclude a list of snap ranges in tsdbSnapReaderOpen 2023-10-19 10:17:34 +08:00
Benguang Zhao
573c28fd06 enh: iterate over a list of snap ranges for STsdbSnapReader 2023-10-19 10:17:28 +08:00
dapan1121
afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
Minglei Jin
52c8bc91f9 cos/delete: fix delete object cond and double free 2023-10-18 18:21:45 +08:00
Shungang Li
5b69b584c3 enh: add log for deploy mnode 2023-10-18 16:58:58 +08:00
yihaoDeng
ef27c87756 opt status send 2023-10-18 16:37:34 +08:00
yihaoDeng
e62f3fa86a opt status send 2023-10-18 16:03:55 +08:00
Haojun Liao
54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
Minglei Jin
f26ec41b8e vnode/cos: fix get callback buffer 2023-10-18 15:30:02 +08:00
Haojun Liao
c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
feat:add replay logic
2023-10-18 11:43:43 +08:00
yihaoDeng
e49b9b2276 fix transfer crash 2023-10-18 11:34:11 +08:00
Haojun Liao
df07443379
Merge pull request #23288 from taosdata/fix/liaohj
fix(stream):add more check for test cases.
2023-10-18 08:13:15 +08:00
yihaoDeng
d67fdb5e46 fix transfer crash 2023-10-17 21:08:31 +08:00
yihaoDeng
2004c1a346 fix transfer crash 2023-10-17 18:19:52 +08:00
Minglei Jin
11b65e2779 vnode/cos: make dependent lib public 2023-10-17 18:11:13 +08:00
Minglei Jin
dd21d8e3ad cos/multipart: first round multipart uploading 2023-10-17 17:24:50 +08:00
Minglei Jin
8fa8c40391 cos/put: simple object putting(< 5 gigabytes) 2023-10-17 14:59:03 +08:00
kailixu
29c6daaff5 fix: trans mutex init 2023-10-17 11:12:52 +08:00
kailixu
a30eedafec fix: trans mutex init 2023-10-17 11:06:06 +08:00
Haojun Liao
531f478ade refactor: do some internal refactor W.R.T. global configurations. 2023-10-17 08:17:49 +08:00
yihaoDeng
b793c92fed fix stream snap deadlock 2023-10-16 22:00:34 +08:00
kailixu
38c1f7d48d fix: add lock for trans 2023-10-16 20:20:04 +08:00
yihaoDeng
b133418d88 fix stream snap deadlock 2023-10-16 20:03:44 +08:00
dapan1121
cdda43cd67 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-16 19:54:21 +08:00
yihaoDeng
f1186be19a fix stream snap deadlock 2023-10-16 19:38:55 +08:00
yihaoDeng
0adefd5e59 fix stream snap deadlock 2023-10-16 19:26:33 +08:00
yihaoDeng
f5ea3649c5 fix stream snap deadlock 2023-10-16 19:26:08 +08:00
yihaoDeng
0a84d7a8b3 fix stream snap deadlock 2023-10-16 19:20:48 +08:00
yihaoDeng
252b90bfab fix stream snap deadlock 2023-10-16 19:20:09 +08:00
Haojun Liao
a1aa2c9e0c fix(stream):add more check for test cases. 2023-10-16 18:47:01 +08:00
Minglei Jin
2479bb343e prefix/delete: delete with prefix 2023-10-16 15:54:51 +08:00
Minglei Jin
4a77a49a3e prefix/list: list bucket with prefix 2023-10-16 15:25:48 +08:00
Haojun Liao
f98e454c5d
Merge pull request #23193 from taosdata/fix/3_liaohj
other: merge stream fix in main branch.
2023-10-16 15:17:04 +08:00
Haojun Liao
33018a0bdb fix(tsdb): fix syntax error. 2023-10-16 14:07:09 +08:00
Haojun Liao
fa6ba6faf8 fix(tdsb): adjust the log level. 2023-10-16 13:26:13 +08:00
Haojun Liao
6b86d050f2 fix(tsdb): record the pinned block iter. 2023-10-16 13:26:13 +08:00
Haojun Liao
5fe7c8de24 fix(stream): fix syntax error. 2023-10-16 13:26:12 +08:00
Haojun Liao
fb2172933a fix(tsdb): enable pin stt datablock. 2023-10-16 13:26:06 +08:00
Haojun Liao
8f2c1944c0 fix(tdsb): adjust the log level. 2023-10-16 11:55:57 +08:00
Haojun Liao
ccecf05ff8 fix(tsdb): record the pinned block iter. 2023-10-16 11:48:57 +08:00
wangmm0220
473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
Haojun Liao
18bb27cdff fix(stream): fix syntax error. 2023-10-16 10:16:39 +08:00
Haojun Liao
67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao
f751f2bb3d fix(tsdb): enable pin stt datablock. 2023-10-16 09:49:51 +08:00
Haojun Liao
f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
wade zhang
0f9da01c88
Merge pull request #23264 from taosdata/3.0_main_merge.2
3.0 main merge
2023-10-14 09:45:49 +08:00
Haojun Liao
6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
Minglei Jin
0a1ff3283e vnode/cos: first round size delte and get 2023-10-13 16:59:05 +08:00
dapan1121
a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
Haojun Liao
bd72d080a9
Merge pull request #23242 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-10-13 16:40:14 +08:00
dapan1121
c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
yihaoDeng
8392c99d36 refactor backend 2023-10-13 14:54:00 +08:00
dapan1121
a418307570
Merge pull request #23236 from taosdata/fix/TD-26658-3.0
enh: close stt before untake read snap
2023-10-13 14:16:47 +08:00
Haojun Liao
0240ae87c3
Merge pull request #23241 from taosdata/3.0_main_merge
3.0 branch to main merge
2023-10-13 10:22:48 +08:00
Haojun Liao
33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao
84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
Alex Duan
35fced8796
Merge pull request #23234 from taosdata/main_3_merge
other: merge main into 3.0
2023-10-12 07:48:20 -05:00
yihaoDeng
a56d831a14 refactor backend 2023-10-12 20:16:41 +08:00
dapan1121
7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
Haojun Liao
506c55001d fix(tsdb): fix race condition. 2023-10-12 17:57:03 +08:00
Haojun Liao
b782af2534 fix(stream): avoid double free. 2023-10-12 17:56:42 +08:00
Haojun Liao
90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-12 17:23:41 +08:00
kailixu
3d32d55ea5 enh: close stt before untake read snap 2023-10-12 16:44:55 +08:00
Haojun Liao
eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Hongze Cheng
11aa9326b9 fix more 2023-10-11 20:15:46 +08:00
yihaoDeng
031506aef8 refactor backend 2023-10-11 19:46:35 +08:00
dmchen
c1e22eff1a fix/pr-23223-ci-core 2023-10-11 10:25:28 +00:00
Hongze Cheng
38b036ff36 fix: possible race condition 2023-10-11 17:39:58 +08:00
Haojun Liao
ea6ffac403 refactor: do some internal refactor. 2023-10-11 16:51:27 +08:00
Minglei Jin
8253874398 enh(tsdb/cos): new sdk for s3 2023-10-11 14:47:26 +08:00
wangmm0220
f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
Haojun Liao
15debda7cd refactor: update some logs. 2023-10-11 11:04:57 +08:00
Haojun Liao
d58d663a36 refactor: update some logs. 2023-10-11 10:38:15 +08:00
Haojun Liao
a03f09c00f refactor: update some logs. 2023-10-11 10:32:31 +08:00
Shungang Li
2c66f44b31 fix(tsdb): ensure sst trigger array size for upgrade 2023-10-10 21:07:08 +08:00
Haojun Liao
b4d7e66f19 other: add some logs. 2023-10-10 19:57:17 +08:00
Haojun Liao
56147120b9 fix(tsdb): remove invalid assert, and do some internal refactor. 2023-10-10 17:04:12 +08:00
wangmm0220
440fa77282 fix:merge datablock if data in same wal version 2023-10-10 16:55:36 +08:00
Haojun Liao
05dfadd8f8 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 15:52:48 +08:00
Haojun Liao
5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
Haojun Liao
adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan
9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN
fix: add case for lost data after  split vgroup (main)
2023-10-10 00:54:34 -05:00
wangmm0220
9113c3c3b6 fix:rollback removed code 2023-10-10 11:53:54 +08:00
Hongze Cheng
1b559a0254
Merge pull request #23180 from taosdata/fix/TS-4121-main
fix(tsdb/cache reader): reset current fileset in cache reader
2023-10-09 20:46:33 -05:00
Hongze Cheng
4224f90661
Merge pull request #23184 from taosdata/enh/TS-4107
enh: clear files fset by fset
2023-10-09 20:05:12 -05:00
yihaoDeng
0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
Haojun Liao
af4618f958 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 20:10:27 +08:00
Haojun Liao
21fb502690 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 20:10:26 +08:00
Haojun Liao
c5ee299d01 fix(stream): fix error in fill-history process. 2023-10-09 20:10:26 +08:00
Haojun Liao
af2c0c95e9 refactor: do some internal refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao
59e284c332 fix(stream): quit from loop when input queue is full. 2023-10-09 20:10:21 +08:00
Haojun Liao
9d5a3b8d78 other: merge stream fix. 2023-10-09 20:10:13 +08:00
Haojun Liao
11d8c8da39 fix(stream): update the sink data. 2023-10-09 20:09:23 +08:00
Haojun Liao
f0c5b5a970 refactor(stream): revised the display info. 2023-10-09 20:09:22 +08:00
Haojun Liao
28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao
65daf38715 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-09 20:09:22 +08:00
Haojun Liao
cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao
d2160efa05 refactor: wait for 100ms before scan wal again. 2023-10-09 20:09:21 +08:00
Haojun Liao
932d93ab35 refactor: wait for more time for future data 2023-10-09 20:09:21 +08:00
Haojun Liao
0ab5d4b342 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
c295ec322a refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
d5abb21335 fix(stream): fix invalid check. 2023-10-09 20:09:20 +08:00
Haojun Liao
583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
19042cdea6 fix(stream): fix invalid param. 2023-10-09 20:09:19 +08:00
Haojun Liao
f9113ab7b0 fix(stream): fix invalid param. 2023-10-09 20:09:11 +08:00
Haojun Liao
b0a4ed3217 fix(stream): drop related fill-history task when dropping stream tasks. 2023-10-09 20:09:10 +08:00
Haojun Liao
83f84d92bc refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-10-09 20:09:10 +08:00
Haojun Liao
bb4ba54f28 fix(stream): enable new time range for stream task. 2023-10-09 20:09:09 +08:00
Haojun Liao
6fbcf4b3d7 fix(tsdb): replace destroy with reset. 2023-10-09 20:09:09 +08:00
Haojun Liao
c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao
db897fb03a fix(stream): opt perf. 2023-10-09 20:09:09 +08:00
Haojun Liao
dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao
a248f3d088 refactor: do some internal refactor. 2023-10-09 20:08:12 +08:00
Haojun Liao
0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao
3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00
Haojun Liao
feb09c8361 fix(stream): fix error in pause scan-history data. 2023-10-09 20:08:11 +08:00
Haojun Liao
6a98b11bef fix(stream): fix invalid read and memory leak. 2023-10-09 20:08:11 +08:00
Haojun Liao
65f66f0986 fix(stream): transfer state when all downstream rsp already. 2023-10-09 20:08:11 +08:00
Haojun Liao
4af7812f0b fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-10-09 20:08:10 +08:00
Haojun Liao
4fe1382cd9 fix(stream): adjust nodeUpdate check interval. 2023-10-09 20:08:09 +08:00
Haojun Liao
f4f55fcbce fix(stream): record the tasks started info, and do some internal refactor. 2023-10-09 20:08:09 +08:00
Haojun Liao
68b003c804 fix(stream): fix race condition. 2023-10-09 20:08:09 +08:00
Haojun Liao
52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao
012ddadf25 fix(stream): update logs. 2023-10-09 20:08:07 +08:00
Haojun Liao
c05a8de3e8 fix(stream): rsp when checkpoint source failed. 2023-10-09 20:08:06 +08:00
Haojun Liao
b4bc4fac98 fix(stream): disable auto rsp for checkpoint source. 2023-10-09 20:08:06 +08:00
Haojun Liao
e671e87234 fix(stream): fix invalid assert. 2023-10-09 20:08:06 +08:00
Haojun Liao
d1a6b8bd22 refactor: do some internal refactor. 2023-10-09 20:08:06 +08:00
Haojun Liao
46b17aa9f1 fix(stream): fix race condition. 2023-10-09 20:08:06 +08:00
Haojun Liao
5eee76df65 fix(stream): add msg identifier check. 2023-10-09 20:08:05 +08:00
Haojun Liao
2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao
498519c94d fix(stream): remove invalid node. 2023-10-09 20:08:02 +08:00
Haojun Liao
27e00b1f19 fix(stream): add some logs, and remove invalid assert. 2023-10-09 20:08:02 +08:00
Haojun Liao
124e1ed1ab enh(stream): add stage info for streamt tasks. 2023-10-09 20:08:02 +08:00
Haojun Liao
12687eb287 fix(stream): add check info detailed information. 2023-10-09 20:08:02 +08:00
Haojun Liao
ab7c18f604 refactor: do some internal refactor. 2023-10-09 20:08:01 +08:00
Haojun Liao
e5535fa1f5 fix(stream): handle dispatch checkpoint-trigger failure. 2023-10-09 20:08:01 +08:00
Haojun Liao
7f4d9b6e41 fix(stream): wait for the task checkpoint before stop. 2023-10-09 20:07:53 +08:00
Haojun Liao
04405b84c5 fix(stream): update logs. 2023-10-09 20:07:53 +08:00
Haojun Liao
118e078f4a log(stream): update log. 2023-10-09 20:07:53 +08:00
Haojun Liao
ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao
a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao
1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao
02610f5546 fix(stream): avoid invalid read. 2023-10-09 20:06:11 +08:00
Haojun Liao
f5da458c77 fix(stream): unlock when returning. 2023-10-09 20:06:11 +08:00
Haojun Liao
36dcdad1a5 fix(stream): return if failed. 2023-10-09 20:06:10 +08:00
Haojun Liao
d76e3ac718 fix(stream): add task status check. 2023-10-09 20:06:10 +08:00
Haojun Liao
29e1efb757 fix(stream): fix obj. 2023-10-09 20:06:10 +08:00
Haojun Liao
a997fa5552 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-10-09 20:06:09 +08:00
Haojun Liao
dff4bd3c8d log(tsdb): remove some logs. 2023-10-09 20:06:09 +08:00
Haojun Liao
53237c34d1 enh(stream): add info in log. 2023-10-09 20:06:09 +08:00
Haojun Liao
8af76d28c8 log(stream): remove logs. 2023-10-09 20:06:09 +08:00
Haojun Liao
e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao
927f2d896c fix(stream): limit the max scan times. 2023-10-09 20:06:08 +08:00
Haojun Liao
1a86ee6517 refactor: update the log level. 2023-10-09 20:06:06 +08:00
Haojun Liao
ff3ea366e2 fix(stream): keep the status entry in hash table, instead entry index. 2023-10-09 20:06:05 +08:00
Haojun Liao
b95ad74c7f fix(stream): not handle the check msg for follower tasks. 2023-10-09 20:06:04 +08:00
Haojun Liao
38bf2d24e7 fix(stream): remove stream in buf. 2023-10-09 20:05:39 +08:00
Haojun Liao
636eccc160 fix(stream): add null check 2023-10-09 20:05:37 +08:00
Haojun Liao
57bf1cadc4 fix(stream): fix error in decode stream task. 2023-10-09 20:05:37 +08:00
Haojun Liao
0459a4628c fix(stream): fix stream task id error. 2023-10-09 20:05:36 +08:00
Haojun Liao
7ccc273206 other: merge stream fix in main. 2023-10-09 20:05:29 +08:00
Haojun Liao
98ef566eb4 fix(stream): remove fill-history sink task. 2023-10-09 20:04:17 +08:00
Haojun Liao
e84eeee6b8 refactor: do some internal refactor. 2023-10-09 20:04:17 +08:00
Haojun Liao
fe7864b976 fix(stream): fix error in drop task. 2023-10-09 20:04:17 +08:00
Haojun Liao
c33e521aa1 fix(stream): update some logs. 2023-10-09 20:04:17 +08:00
Haojun Liao
5f1146d415 fix(stream): fix memory leak. 2023-10-09 20:04:17 +08:00
Haojun Liao
39e0c57323 fix(stream): set the correct guard flag. 2023-10-09 20:04:16 +08:00
Haojun Liao
3d1f29ff21 fix(stream): fix memory leak. 2023-10-09 20:04:16 +08:00
Haojun Liao
6fa54789cb fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-10-09 19:59:31 +08:00
Haojun Liao
1256eafddb other: merge stream fix. 2023-10-09 19:59:24 +08:00
Haojun Liao
c6355fcc2f fix(tsdb): check return code. 2023-10-09 19:56:18 +08:00
Haojun Liao
be09c173ab fix:fix coverity issue and remove unnecessary files. 2023-10-09 19:56:17 +08:00
Haojun Liao
aaa12ed4f8 refactor: do some internal refactor about the sched status set 2023-10-09 19:56:17 +08:00
kailixu
f180a6e6f3 chore: remove macro for grant notify 2023-10-09 19:26:16 +08:00
wangmm0220
3e2e924e98 feat:[TD-26056] add replay logic 2023-10-09 18:36:39 +08:00
dapan1121
d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
Hongze Cheng
cd61dd39fa
Merge pull request #23176 from taosdata/enh/TS-4103
enh: control number of stt files
2023-10-09 05:08:01 -05:00
wangmm0220
33045e63ae feat:[TD-26056] add replay logic 2023-10-09 17:35:40 +08:00
dapan1121
6c8db261f3 feat: support show views command 2023-10-09 17:19:36 +08:00
kailixu
5dd277248e fix: alter active code for different server 2023-10-09 17:16:56 +08:00
Hongze Cheng
e3525dba6e enh: clear files fset by fset 2023-10-09 17:11:50 +08:00
Hongze Cheng
258181e387 change block commit factor 2023-10-09 16:03:42 +08:00
yihaoDeng
2aa88dfe9b fix mem leak 2023-10-09 15:53:42 +08:00
wade zhang
7c738cbe0c
Merge pull request #23168 from taosdata/feat/TS-4036-main
feat: alter local/dnode asynclog
2023-10-09 15:44:39 +08:00
Haojun Liao
8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Minglei Jin
93438ed838 fix(tsdb/carch reader): reset current fileset in cache reader 2023-10-09 15:24:24 +08:00
yihaoDeng
addb1107d2 fix mem leak 2023-10-09 15:11:59 +08:00
Hongze Cheng
2c9a0dbcda enh: control stt max level 2023-10-09 14:00:11 +08:00
liuyao
1fbfdb5ab4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 11:40:27 +08:00
wade zhang
40ff071243
Merge pull request #23164 from taosdata/fix/TD-26587
fix(tsdb/retention): free fopArr & fs snapshot resources
2023-10-09 10:22:25 +08:00
Haojun Liao
74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao
ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao
0fda1793e7 fix(stream): fix error in fill-history process. 2023-10-09 10:08:48 +08:00
liuyao
731d4fff27 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 08:58:27 +08:00
wangmm0220
5f7b6f19ba feat:[TD-26056] add replay logic 2023-10-08 19:05:59 +08:00
Haojun Liao
167484ab3a
Merge pull request #23145 from taosdata/mark/tmq
opti:set default offset to latest in subscription
2023-10-08 18:56:37 +08:00
dapan1121
5b639a172d feat: support query from view 2023-10-08 18:36:06 +08:00
Hongze Cheng
880e8c1941 fix: block commit when there are too many stt file 2023-10-08 18:27:19 +08:00
Shungang Li
a7507d26b0 feat: alter local/dnode asynclog 2023-10-08 18:26:25 +08:00
yihaoDeng
bffa6387fe refact task backend 2023-10-08 18:16:45 +08:00
yihaoDeng
f49a2cbeb0 refact task backend 2023-10-08 18:14:17 +08:00
wangmm0220
b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220
3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
Minglei Jin
ca809924cd fix(tsdb/retention): free fopArr & fs snapshot resources 2023-10-08 15:10:54 +08:00
dapan1121
9b207b9b3e
Merge pull request #23133 from taosdata/fix/TD-26474-3.0
fix: mutex init for trans
2023-10-08 15:07:47 +08:00
Hongze Cheng
ba27cc0605 fix: fid overflow 2023-10-08 14:54:24 +08:00
liuyao
ed8cad22cb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 13:31:51 +08:00
wade zhang
a9db1ed8e0
Merge pull request #23116 from taosdata/fix/TD-26539
fix(keep0-duration): force keep0 at least thrice of duration
2023-10-08 13:07:05 +08:00
yihaoDeng
9d430c39ae fix mem leak 2023-10-08 11:47:06 +08:00
wangmm0220
fb3197ea89 fix:test case error for reset=latest 2023-10-08 10:55:35 +08:00
kailixu
a2e3109447 chore: add grant method for community 2023-10-08 09:47:57 +08:00
liuyao
c75506b271 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 09:02:51 +08:00
dapan1121
61382c0793
Merge pull request #23126 from taosdata/fix/TD-26426-3.0
fix: support check/merge active code
2023-10-07 19:31:36 +08:00
Haojun Liao
ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
liuyao
c088ee7f91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-07 19:13:07 +08:00
yihaoDeng
97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
kailixu
b9767707cb chore: code optimization for array size 2023-10-07 15:57:26 +08:00
wangmm0220
9c470e9297 opti:set default offset to latest in subscription & return error if use snapshot when consume column 2023-10-07 15:25:24 +08:00
Hongze Cheng
d1e59b9e0e enh: optimize merge strategy 2023-10-07 15:18:08 +08:00
Haojun Liao
7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
yihaoDeng
fa70221238 refact task backend 2023-10-07 12:17:55 +08:00
dapan1121
deb9a6875b feat: mnode processing view meta request 2023-10-07 10:40:00 +08:00
Haojun Liao
115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
kailixu
85226d05a3 chore: code refactor for time series 2023-10-07 09:30:32 +08:00
Haojun Liao
f542a8c786 fix(stream): update the sink data. 2023-10-07 09:22:25 +08:00
Haojun Liao
798f559b62 refactor(stream): revised the display info. 2023-10-07 09:04:38 +08:00
kailixu
6efe3845d4 chore: more logic 2023-10-07 07:02:16 +08:00
Haojun Liao
c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
kailixu
c70a1b77e6 chore: code optimization for time series 2023-10-07 00:17:21 +08:00
kailixu
c59498d90a chore: code refactor for time series statis 2023-10-06 07:37:18 +08:00
kailixu
e4a86aa70a chore: remove obsolete codes 2023-10-05 23:52:50 +08:00
kailixu
07f043f143 enh: exclude sys tbl for time series 2023-10-05 23:48:52 +08:00
kailixu
47e79ff5b7 enh: exclude sys tbl for time series 2023-10-05 23:45:54 +08:00
kailixu
d0a046c7a3 enh: exclude sys tbl for time series 2023-10-05 23:30:30 +08:00
kailixu
88fdeca5cf enh: dnode notify logic 2023-10-05 22:31:25 +08:00
kailixu
dbfd282b13 Merge branch 'enh/TD-26532-3.0' of github.com:taosdata/TDengine into enh/TD-26532-3.0 2023-10-05 21:36:18 +08:00
kailixu
086213a6c2 enh: dnode notify logic 2023-10-05 21:35:57 +08:00
kailixu
c339f3552a fix: mutex init for trans 2023-10-05 09:19:44 +08:00
Haojun Liao
5bf8d16ee1 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-04 23:33:03 +08:00
Haojun Liao
41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
kailixu
578c9ad57d Merge branch '3.0' into enh/TD-26532-3.0 2023-10-03 23:29:02 +08:00
Haojun Liao
45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao
132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao
58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao
a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao
5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
kailixu
53c4c56206 chore: code optimization 2023-10-02 09:23:51 +08:00
Haojun Liao
5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
kailixu
a19efd266e chore: more code 2023-10-01 21:55:17 +08:00
kailixu
5067eb8cc5 chore: more code for check active code 2023-09-30 16:00:14 +08:00
kailixu
e677e41573 fix: support check and merge activeCode 2023-09-30 12:29:44 +08:00
Haojun Liao
f3275f76e8 fix(stream): fix invalid param. 2023-09-28 23:31:07 +08:00
Haojun Liao
c14873401f fix(stream): fix invalid param. 2023-09-28 23:26:46 +08:00
Haojun Liao
ff44539468 fix(stream): drop related fill-history task when dropping stream tasks. 2023-09-28 23:00:29 +08:00
Haojun Liao
31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao
f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
yihaoDeng
bb265887e6 refact task backend 2023-09-28 17:07:19 +08:00
yihaoDeng
54e3ac2c1e refact task backend 2023-09-28 15:46:12 +08:00
Haojun Liao
0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
dapan1121
0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
Haojun Liao
0a8f4530f7 fix(tsdb): replace destroy with reset. 2023-09-28 11:42:19 +08:00
Haojun Liao
80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
kailixu
b1a0912a61 enh: exclude systables in log/audit db 2023-09-28 10:15:34 +08:00
wade zhang
10ad4600e4
Merge pull request #23104 from taosdata/fix/TD-26527
fix/TD-26527: alter database keep_time_offset can't changed
2023-09-28 09:33:00 +08:00
Haojun Liao
22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao
0f4e38faf7
Merge pull request #23094 from taosdata/fix/fixIpWhitelistAddUser
fix ip white for all users
2023-09-28 09:15:38 +08:00
Haojun Liao
cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
yihaoDeng
5a684f2a26 fix invalid read 2023-09-27 22:32:54 +08:00
Shungang Li
63ce2f6f2f fix: alter database keep_time_offset can't changed 2023-09-27 19:04:01 +08:00
yihaoDeng
28dbe36b91 fix ip white for all users 2023-09-27 16:41:29 +08:00
dapan1121
1088b80a46
Merge pull request #23062 from taosdata/enh/TD-25879-3.0x
enh: update dnode module
2023-09-27 16:18:38 +08:00
wade zhang
7b20090977
Merge pull request #23089 from taosdata/fix/TD-26489
fix(vnode/cos): use EIO as object put errno
2023-09-27 16:16:21 +08:00
yihaoDeng
62e1d4cb65 fix ip white for all users 2023-09-27 16:10:02 +08:00
yihaoDeng
d0e1aec270 fix ip white for all users 2023-09-27 16:08:09 +08:00
yihaoDeng
48be800639 fix ip white for all users 2023-09-27 15:46:25 +08:00
Minglei Jin
cd811577f3 fix(vnode/cos): use EIO as object put errno 2023-09-27 15:10:34 +08:00
yihaoDeng
d4f87378fd avoid first tag index conflict 2023-09-27 14:44:09 +08:00
Minglei Jin
5ce1dd6284 fix(tsdb/readerwriter): fix fd writing 2023-09-27 14:02:37 +08:00
Haojun Liao
e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
wade zhang
e6b0592629
Merge pull request #23081 from taosdata/fix/TD-26478-2
fix(tsdb/readerwriter): fix var shadowing
2023-09-27 08:37:17 +08:00
Haojun Liao
c50e9c7b35
Merge pull request #23073 from taosdata/fix/ipWhiteListfix
fix ip white list
2023-09-26 21:39:50 +08:00
Minglei Jin
e6287c1a89 fix(tsdb/readerwriter): fix var shadowing 2023-09-26 19:18:10 +08:00
dmchen
a4c1611755 TD-26432 2023-09-26 11:06:44 +00:00
liuyao
ebf4283e91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 17:19:41 +08:00
yihaoDeng
3b885f4faf fix ip white list 2023-09-26 17:04:25 +08:00
kailixu
e1cd54a1b3 fix: rwlock reentrant problem on windows 2023-09-26 15:44:35 +08:00
kailixu
c680180894 fix: rwlock reentrant problem on windows 2023-09-26 15:37:29 +08:00
kailixu
e523d3d6a4 chore: remove obsolete codes 2023-09-26 14:34:42 +08:00
wade zhang
f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao
890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao
525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj
fix(stream): fix several stability-related bugs in stream framework.
2023-09-26 14:10:58 +08:00
Haojun Liao
d5621b52d7
Merge pull request #23053 from taosdata/fix/26475
Fix/26475
2023-09-26 13:42:53 +08:00
kailixu
93bf7da254 chore: dm update 2023-09-26 13:22:38 +08:00
Haojun Liao
f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
Ping Xiao
4f23ea2a8c enh: dmodule logic 2023-09-26 11:47:53 +08:00
liuyao
ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
Haojun Liao
d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Hongze Cheng
03456ce443 fix: upgrade error when has tomb data 2023-09-26 09:23:22 +08:00
wade zhang
92f5803303
Merge pull request #23050 from taosdata/fix/TD-26478
fix(cos): use EIO as failed code
2023-09-26 09:02:59 +08:00
Haojun Liao
6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao
5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00
wade zhang
f2a7795cd6
Merge pull request #23037 from taosdata/enh/TS-3812-3.0
grant: enable update cluster info
2023-09-25 19:27:44 +08:00
yihaoDeng
b134365d08 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-09-25 18:40:10 +08:00
yihaoDeng
40a3c778f0 disable ip on community 2023-09-25 18:39:49 +08:00
Minglei Jin
7fd7902dda fix(cos): use EIO as failed code 2023-09-25 18:38:55 +08:00
Haojun Liao
c9576d7a85 fix(stream): transfer state when all downstream rsp already. 2023-09-25 17:31:38 +08:00
Benguang Zhao
5d588cb7d2 enh: trigger failover if tsdbMerge failure 2023-09-25 17:22:38 +08:00
kailixu
126a371170 chore: more code 2023-09-25 16:24:03 +08:00
kailixu
0632fb838a chore: code refactor 2023-09-25 16:17:57 +08:00
kailixu
68fb1b296f chore: code refactor 2023-09-25 16:16:12 +08:00
Haojun Liao
966ce4f30e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-09-25 16:00:02 +08:00
Haojun Liao
fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
kailixu
b0b4d782fc chore: code refactor 2023-09-25 15:57:54 +08:00
Alex Duan
c9af9eb15b
Merge pull request #22915 from lx1zhong/3.0
add TSZ and ADT-FSE algorithm
2023-09-25 15:48:30 +08:00
Shungang Li
8f0d700fe8 feat: rm dnode config item keepTimeOffset 2023-09-25 15:46:12 +08:00
Shungang Li
743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
kailixu
f689ef8fe4 chore: make jenkins happy 2023-09-25 15:41:23 +08:00
kailixu
4e0a5cb91a chore: macOS compile 2023-09-25 14:46:59 +08:00
kailixu
3083189f4d grant: enable update cluster info 2023-09-25 12:35:18 +08:00
Haojun Liao
dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao
1af95969b2 fix(stream): adjust nodeUpdate check interval. 2023-09-25 10:40:30 +08:00
Haojun Liao
eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao
c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
kailixu
7b4ef6df96 fix: memory leak 2023-09-24 13:50:20 +08:00
kailixu
c69b9e0197 chore: make jenkins happy 2023-09-24 09:45:19 +08:00
kailixu
986788d4fe enh: timeseries calculation 2023-09-24 09:14:52 +08:00
kailixu
e50b8a3a0d chore: make jenkins happy for community 2023-09-24 08:48:14 +08:00
kailixu
ff3e36e679 enh: timeseries calculation 2023-09-24 08:41:45 +08:00
kailixu
53a9459c20 enh: update timeseries 2023-09-24 07:52:27 +08:00
Haojun Liao
4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
kailixu
bc8ebf1562 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-23 18:19:08 +08:00
kailixu
a4b92760f0 enh: grant notify optimize 2023-09-23 18:10:08 +08:00
Haojun Liao
b58ec1ee57 fix(stream): update logs. 2023-09-23 15:22:48 +08:00
Haojun Liao
acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
Haojun Liao
7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao
5155519559 fix(stream): fix invalid assert. 2023-09-22 23:06:48 +08:00
Haojun Liao
cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
kailixu
8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
Haojun Liao
fcbd747afc fix(stream): fix race condition. 2023-09-22 19:35:12 +08:00
liuyao
0d983e28ef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 19:25:41 +08:00
Haojun Liao
5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
yihaoDeng
11da631bb5 add cvt state 2023-09-22 09:08:42 +00:00
wade zhang
849b05a09b
Merge pull request #22927 from taosdata/fix/TD-26189
s3/block_cache: new tsdb block cache
2023-09-22 16:15:07 +08:00
liuyao
4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
Haojun Liao
898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Minglei Jin
4c151f2031 tsdb/readerwriter: remove size with download 2023-09-22 14:06:06 +08:00
Haojun Liao
7e4410f094
Merge pull request #22992 from taosdata/feat/TD-26052
feat:support vnode split in tmq
2023-09-22 13:57:21 +08:00
Haojun Liao
7380151322 fix(stream): remove invalid node. 2023-09-22 11:45:46 +08:00
Haojun Liao
87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao
198e6bb023 enh(stream): add stage info for streamt tasks. 2023-09-22 10:36:15 +08:00
Haojun Liao
f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
wangmm0220
19806cbcab fix:memory leak 2023-09-22 10:12:11 +08:00
wangmm0220
5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
wangmm0220
86a4bfe28d fix:memory leak 2023-09-22 10:02:16 +08:00
liuyao
dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
wangmm0220
803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao
b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao
b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao
3c921ba66e
Merge pull request #23006 from taosdata/fix/3_liaohj
fix(tsdb): set the correct scaninfo to load the tomb data.
2023-09-21 22:13:16 +08:00
kailixu
3beb9c5c84 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 19:38:27 +08:00
dapan1121
a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
Cary Xu
1bbb812557
Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 17:32:51 +08:00
Haojun Liao
f93df639c1 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 17:32:21 +08:00
dapan1121
64da3f4ef9
Merge pull request #22978 from taosdata/szhou/show-db-table
enhance: show normal/child tables and show user/system databases
2023-09-21 16:55:26 +08:00
Minglei Jin
ce1f866416 tsdb/reader: use pTsdb handle instead of pgsz to open file 2023-09-21 16:36:17 +08:00
kailixu
7445b9ff50 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 16:25:06 +08:00
Haojun Liao
2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao
0f97a21163 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 15:21:01 +08:00
Haojun Liao
e4073bd9a8 fix(stream): update logs. 2023-09-21 14:03:14 +08:00
Haojun Liao
09accc71d2 log(stream): update log. 2023-09-21 14:01:41 +08:00
Haojun Liao
17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
kailixu
e7dd0caeb9 Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 10:21:45 +08:00
liuyao
3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
wangmm0220
ce2fc8b319 fix:memory leak 2023-09-21 10:05:52 +08:00
kailixu
2b25982495 enh: user dropped notification 2023-09-21 09:53:45 +08:00
wangmm0220
f9c5aa01af fix:enable split if there are topics & fix memory leak 2023-09-21 09:20:34 +08:00
dapan1121
cc08a5ee87 fix: add query sql 2023-09-20 19:30:40 +08:00
Haojun Liao
92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
wangmm0220
d3f54e678f feat:support vnode split in tmq 2023-09-20 18:27:43 +08:00
Haojun Liao
6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
Minglei Jin
f206fa07d0 s3/put: use put2 2023-09-20 15:59:58 +08:00
Haojun Liao
2418f509ea fix(stream): avoid invalid read. 2023-09-20 15:47:09 +08:00
Haojun Liao
1d1d9a1b0b fix(stream): unlock when returning. 2023-09-20 15:45:15 +08:00
Haojun Liao
c8ab761d2a fix(stream): return if failed. 2023-09-20 15:38:49 +08:00
Haojun Liao
2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
Minglei Jin
d155cfcf0f tsdb/readerwriter: use tsdb's s3 block cache to read file page 2023-09-20 15:24:54 +08:00
liuyao
1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
dapan1121
6b87d97989 feat: support view in mnode 2023-09-20 15:01:03 +08:00
Haojun Liao
af487c9048 fix(stream): fix obj. 2023-09-20 14:50:43 +08:00
Haojun Liao
361cde6497 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-09-20 14:49:09 +08:00
Haojun Liao
55d4a9686c log(tsdb): remove some logs. 2023-09-20 13:18:42 +08:00
Haojun Liao
5e3a268b6d enh(stream): add info in log. 2023-09-20 13:15:50 +08:00
dm chen
4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
Haojun Liao
392aaeb592 log(stream): remove logs. 2023-09-20 10:49:18 +08:00
Haojun Liao
b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
Haojun Liao
779c0c5f19
Merge pull request #22970 from taosdata/fix/liaohj
fix(stream): keep the status entry in hash table, instead entry index.
2023-09-20 10:33:05 +08:00
kailixu
a9d30f25d2 enh: rsma support delete raw data 2023-09-20 10:11:03 +08:00
slzhou
ef1e91a6be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-20 08:44:15 +08:00
wangmm0220
2881a2504c fix:conflicts from 3.0 2023-09-19 18:39:40 +08:00
dmchen
1a7bffb079 ci break 2023-09-19 18:01:38 +08:00
Haojun Liao
b99232fd7a fix(stream): limit the max scan times. 2023-09-19 17:45:28 +08:00
Haojun Liao
271e492188 refactor: update the log level. 2023-09-19 17:40:26 +08:00
wangmm0220
766652a88a fix:vnode tranform support in tmq 2023-09-19 17:27:19 +08:00
dmchen
dbde1a4491 ci break 2023-09-19 14:40:48 +08:00
dm chen
ee913cbfbc
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-19 14:39:20 +08:00
dapan1121
b9d554275c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-09-19 14:21:00 +08:00
dapan1121
14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
shenglian zhou
a072fb6a2c Merge branch '2.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-19 14:03:16 +08:00
dmchen
e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
wade zhang
7311e60f7f
Merge pull request #22963 from taosdata/fix/TS-4015
fix: set snapshot writer compression
2023-09-19 13:26:32 +08:00
wangmm0220
ad70dc178f fix:conflicts from 3.0 2023-09-19 11:56:52 +08:00
wangmm0220
edb42aa2aa fix:move from main to 3.0 2023-09-19 11:51:52 +08:00
Haojun Liao
1cfd34a6a9
Merge pull request #22955 from taosdata/fix/avoidConflictIdxNameMain
avoid first tag index conflict
2023-09-19 11:37:26 +08:00
slzhou
c882f4ba08 fix: fix address sanitizer error 2023-09-19 11:31:20 +08:00
Alex Duan
4a4e778a6a fix: remove depends from util to common 2023-09-19 10:46:52 +08:00
Haojun Liao
5a6e50d523 fix(stream): keep the status entry in hash table, instead entry index. 2023-09-19 10:33:58 +08:00
Haojun Liao
e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
slzhou
900aacd428 fix: fix sanitizer error 2023-09-19 09:40:00 +08:00
kailixu
6698861c8b chore: timeseries distribute 2023-09-19 08:29:51 +08:00
Hongze Cheng
b1797834c1 fix: set snapshot writer compression 2023-09-18 20:58:20 +08:00
Haojun Liao
1ca06e960f fix(stream): remove stream in buf. 2023-09-18 20:25:24 +08:00
wangmm0220
1e859084b7 fix:conflicts from 3.0 2023-09-18 19:57:33 +08:00
wangmm0220
4b74135350 fix:vnode tranform support in tmq 2023-09-18 19:47:28 +08:00
wangmm0220
59d8f7d10f fix:return in progress in drop consumer group 2023-09-18 17:55:00 +08:00
Haojun Liao
101161c52e
Merge pull request #22954 from taosdata/fix/TD-26323
fix:core in race condition for pTq->pExecStore & return if poll too l…
2023-09-18 17:41:01 +08:00
shenglian zhou
94a616fcc1 fix: save and continue 2023-09-18 16:59:07 +08:00
Haojun Liao
c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
wangmm0220
49a193b328 fix:send delete subscribe info to vnode if drop consumer 2023-09-18 14:46:39 +08:00
wangmm0220
c3498fbfe8 fix:core in race condition for pTq->pExecStore & return if poll too long & fix test cases if submit empty 2023-09-18 14:35:07 +08:00
Alex Duan
570ac79a79
Merge branch 'taosdata:3.0' into 3.0 2023-09-18 14:28:00 +08:00
yihaoDeng
2c10163634 avoid first tag index conflict 2023-09-18 14:19:58 +08:00
wangmm0220
7869b693f2 add test case for tmq in vnode transform & fix core in race condition for pTq->pExecStore 2023-09-18 14:09:28 +08:00
Haojun Liao
82d3deb423
Merge pull request #22949 from taosdata/enh/disableIpWhiteListOnCommunity
disable white list on community
2023-09-18 13:41:08 +08:00
dmchen
b473122dac break dependency 2023-09-18 12:29:08 +08:00
Haojun Liao
8aa34802f5
Merge pull request #22938 from taosdata/fix/TD-26323
fix:[TD-26323]add macro to control tmq assert & make subscribe transa…
2023-09-18 09:48:39 +08:00
Haojun Liao
de04090f04
Merge pull request #22940 from taosdata/fix/avoidConflictOfIdxName
reduce the confliction of first tag index name
2023-09-18 09:47:58 +08:00
dm chen
fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-18 09:41:47 +08:00
dmchen
c674e025e2 skip auto create tb 2023-09-18 09:29:51 +08:00
kailixu
8111c18cc4 chore: merge 3.0 2023-09-18 09:20:43 +08:00
Haojun Liao
8aa9960760
Merge pull request #22944 from taosdata/fix/liaohj
refactor: do some internal refactor, and fix some bugs.
2023-09-17 21:25:33 +08:00
Haojun Liao
3dfdda3283 fix(stream): fix error in decode stream task. 2023-09-17 18:07:26 +08:00
Haojun Liao
01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao
4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
Haojun Liao
caa7542cea
Merge pull request #22913 from taosdata/fix/liaohj
fix(stream): fix error in drop task.
2023-09-16 21:36:38 +08:00
yihaoDeng
d890ccbd3b disable white list on community 2023-09-15 20:27:41 +08:00
wangmm0220
8ebb6e202e fix:[TD-26323]add macro to control tmq assert & make subscribe transaction no conflicts 2023-09-15 19:26:55 +08:00
Haojun Liao
05e9f40834
Merge pull request #22828 from taosdata/enh/ipWhiteList
Enh/ip white list
2023-09-15 17:49:37 +08:00
Haojun Liao
91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
yihaoDeng
a66145a494 reduce the possible of first tag index name 2023-09-15 17:41:04 +08:00
Minglei Jin
0181bb24d3 tsdb/readerwriter: use PRId64 instead of lld 2023-09-15 16:40:04 +08:00
Alex Duan
47f2c38a56
Merge pull request #22910 from taosdata/fix/TS-3987
fix: delete data error
2023-09-15 16:19:29 +08:00
Minglei Jin
318281356b s3/block_cache: new tsdb block cache 2023-09-15 16:19:21 +08:00
kailixu
7f477b413a chore: more code 2023-09-15 14:35:57 +08:00
kailixu
03aea454d7 chore: more code 2023-09-15 14:33:35 +08:00
lx1zhong
6da4088012 add TSZ and ADT-FSE algorithm 2023-09-15 14:30:23 +08:00
wade zhang
b123dd7df3
Merge pull request #22904 from taosdata/FIX/TD-26292-main
enh: ignore compact req during restoring
2023-09-15 11:05:18 +08:00
kailixu
6b95013ba0 chore: code refactor for mndDnode 2023-09-15 10:28:07 +08:00
yihaoDeng
79fe29c848 fix compile error 2023-09-15 10:10:23 +08:00
Haojun Liao
2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
kailixu
8505fb2aea chore: code refactor for mndDnode 2023-09-15 08:49:45 +08:00
kailixu
1ddc935072 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-15 08:39:32 +08:00
Haojun Liao
117de7ab7d fix(stream): fix error in drop task. 2023-09-15 00:51:13 +08:00
Haojun Liao
500fcad36c
Merge pull request #22892 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-09-15 00:46:46 +08:00
Haojun Liao
73c2782d78 fix(stream): update some logs. 2023-09-14 23:17:23 +08:00
Haojun Liao
5f55f489d8 fix(stream): fix memory leak. 2023-09-14 22:59:11 +08:00
Haojun Liao
303e8caf0c fix(stream): set the correct guard flag. 2023-09-14 22:44:16 +08:00
kailixu
449092c5dc enh: timeseries update optimize 2023-09-14 20:16:02 +08:00
Haojun Liao
27f626769e fix(stream): fix memory leak. 2023-09-14 19:33:05 +08:00
yihaoDeng
167be7c519 rm dup ip 2023-09-14 19:09:56 +08:00
yihaoDeng
250fed499f Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 18:49:17 +08:00
yihaoDeng
0e496ab0c5 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 18:18:05 +08:00
yihaoDeng
2af180c763 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:56:44 +08:00
yihaoDeng
02f5f4f017 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:23:31 +08:00
Haojun Liao
f2c3e0a6e8 fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-09-14 17:22:31 +08:00
Hongze Cheng
925cc8f55f fix: delete data error 2023-09-14 17:20:10 +08:00
yihaoDeng
a7d4547a2d Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:01:06 +08:00
yihaoDeng
011aee7214 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:56:47 +08:00
yihaoDeng
2d1d74d4e8 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:52:23 +08:00
slzhou
972a6a133f Merge branch 'enh/ipWhiteList' of github.com:taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:34:30 +08:00
slzhou
59020ff52d fix: for community version, use 0.0.0.0/0 as whitelist 2023-09-14 16:34:03 +08:00
wangmm0220
908cf88414 Merge branch 'mark/tmq-3.0' of https://github.com/taosdata/TDengine into feat/TD-26052 2023-09-14 16:18:43 +08:00
Benguang Zhao
bbcbe460d4 enh: ignore compact req during restoring 2023-09-14 16:17:17 +08:00
Benguang Zhao
2886913fd8 enh: ignore compact req during restoring 2023-09-14 16:09:00 +08:00
yihaoDeng
e36dc50828 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 15:42:17 +08:00
yihaoDeng
2002ed8709 add more error code 2023-09-14 15:34:28 +08:00
slzhou
2a40113f13 fix: entprise version compilation 2023-09-14 14:44:09 +08:00
Haojun Liao
fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
slzhou
a15a41f396 Merge branch 'enh/ipWhiteList' of github.com:taosdata/TDengine into szhou/enh/ipWhiteList 2023-09-14 13:06:15 +08:00
slzhou
94236b8cee fix: pass some test 2023-09-14 13:05:58 +08:00
yihaoDeng
aa1cc01064 update test case 2023-09-14 12:18:43 +08:00
yihaoDeng
903c628067 update test case 2023-09-14 12:18:04 +08:00
Haojun Liao
fd6344b319 fix(tsdb): check return code. 2023-09-14 09:25:35 +08:00
yihaoDeng
da55d7e67e update test case 2023-09-14 09:25:23 +08:00
Haojun Liao
9b70c0c457 fix:fix coverity issue and remove unnecessary files. 2023-09-14 09:06:10 +08:00
yihaoDeng
7ec31029e6 update test case 2023-09-14 08:45:55 +08:00
yihaoDeng
e7815229ca update test case 2023-09-13 19:54:45 +08:00
wangmm0220
f729150497 fix:opti poll callbak logic & send epoch as -1 to get epset if vnode transformed 2023-09-13 18:32:45 +08:00
wangmm0220
39fb5f4334 fix:add vnode snaphot for tmq 2023-09-13 18:09:47 +08:00
dapan1121
270a7584f4 enh: prevent accessing ins_users&ins_user_privileges without sysinfo 2023-09-13 17:48:26 +08:00
yihaoDeng
c0a8f81176 update test case 2023-09-13 14:27:58 +08:00
Haojun Liao
7305c8dbe1 refactor: do some internal refactor about the sched status set 2023-09-13 14:00:34 +08:00
wangmm0220
1dbd322fa0 fix:remove useless code 2023-09-13 11:42:09 +08:00
kailixu
53ed71959b enh: fetch cluster info for grant periodically 2023-09-13 11:30:04 +08:00
Yihao Deng
fa302ac6b9
Merge branch '3.0' into enh/ipWhiteList 2023-09-13 10:14:08 +08:00
Haojun Liao
99477babca
Merge pull request #22872 from taosdata/fix/coverityScanDyh
fix coverity scan problem
2023-09-13 09:18:27 +08:00
Haojun Liao
09a15bf340 refactor: do some internal refactor. 2023-09-12 22:07:52 +08:00
Haojun Liao
60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao
f6a097d96f refactor: do some internal refactor. 2023-09-12 21:58:22 +08:00
Haojun Liao
4325a0a433
Merge pull request #22866 from taosdata/fix/3_liaohj
refactor: do  some internal refactor.
2023-09-12 21:56:44 +08:00
yihaoDeng
5468c717e9 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-12 21:03:42 +08:00
yihaoDeng
d6f4c40e54 fix mem leak 2023-09-12 21:03:35 +08:00
yihaoDeng
8fc33dd74d fix coverity scan problem 2023-09-12 18:52:16 +08:00
Haojun Liao
e457d94ac6 refactor: do some internal refactor. 2023-09-12 18:09:02 +08:00
yihaoDeng
8e064cdd03 fix merge error 2023-09-12 16:41:14 +08:00
slzhou
65fe665939 fix: get user whitelist version from user object 2023-09-12 16:27:07 +08:00
slzhou
a44d0bceb6 Merge branch 'szhou/enh/ipWhiteList' into enh/ipWhiteList 2023-09-12 16:21:29 +08:00
Haojun Liao
4d33387e80
Merge pull request #22814 from taosdata/fix/fixTransferCrash2
fix merge error
2023-09-12 16:10:07 +08:00
Haojun Liao
52931b530d
Merge pull request #22855 from taosdata/fix/3_liaohj
fix(stream):check error when vnode is closing.
2023-09-12 15:58:02 +08:00
dapan1121
ef7eb478e4
Merge pull request #22834 from taosdata/fix/TS-3945
fix: remove incorrect assert
2023-09-12 15:55:51 +08:00
yihaoDeng
7ce8f694dc Merge branch 'enh/dev3New' into enh/ipWhiteList 2023-09-12 15:54:06 +08:00
yihaoDeng
63c53b6a3a fix transfer crash 2023-09-12 15:03:13 +08:00
yihaoDeng
ccb75a9c11 fix transfer crash 2023-09-12 14:46:56 +08:00
yihaoDeng
3e48f3639c fix transfer crash 2023-09-12 14:46:32 +08:00
shenglian zhou
d5f1662bf5 enh: enterprise version and community version split 2023-09-12 14:35:01 +08:00
shenglian zhou
21dd7a82b0 Merge branch 'szhou/enh/ipWhiteList' of github.com:taosdata/TDengine into szhou/enh/ipWhiteList 2023-09-12 14:16:35 +08:00
shenglian zhou
53894f1182 enhance: add hb whitelist version and notify taosadapter 2023-09-12 14:15:03 +08:00
shenglian zhou
8db96a0085 enhance: update notification and get user whitelist api 2023-09-12 14:10:41 +08:00
shenglian zhou
64caae83fd enhance: add hb whitelist version and notify taosadapter 2023-09-12 14:10:41 +08:00
wade zhang
f4e785788a
Merge pull request #22833 from taosdata/fix/TS-3943-3.m
fix: neighbor block overlap judgement
2023-09-12 11:51:03 +08:00
Haojun Liao
93159729f6 fix(stream):check error when vnode is closing. 2023-09-12 11:45:51 +08:00
Haojun Liao
025a2a3b50
Merge pull request #22846 from taosdata/fix/3_liaohj
fix(tsdb): check the schema before merge rows in buffer
2023-09-12 11:43:27 +08:00
yihaoDeng
4d16cfac05 add rpc update interface 2023-09-12 11:36:44 +08:00
yihaoDeng
a902421f5b add user ip white ver 2023-09-12 11:33:32 +08:00
yihaoDeng
f29880fee3 add rpc update interface 2023-09-12 11:31:06 +08:00
wade zhang
a02f28640c
Merge pull request #22829 from taosdata/fix/TD-26210-main
fix/TD-26210
2023-09-12 11:01:12 +08:00
yihaoDeng
6ce85f5cae fix transfer crash 2023-09-12 10:44:56 +08:00
yihaoDeng
d9eed32167 add rpc update interface 2023-09-12 09:54:13 +08:00
Haojun Liao
f602aa965f fix(stream): fix coverity scan issues. 2023-09-12 09:16:18 +08:00
Haojun Liao
a5b93aaf97 fix(tsdb): fix invalid read. 2023-09-11 23:55:34 +08:00
Haojun Liao
e8f7146a2c fix(tsdb): check the schema before merge rows in buffer, and do some refactor. 2023-09-11 22:19:10 +08:00
Haojun Liao
cd1f0ea414
Merge pull request #22826 from taosdata/fix/3_liaohj
fix(stream): set the correct start version for the step 2 stage in fill history.
2023-09-11 21:43:58 +08:00
yihaoDeng
9efa9eeff4 add rpc update interface 2023-09-11 21:29:50 +08:00
yihaoDeng
0a8b1ebe46 add rpc update interface 2023-09-11 21:02:50 +08:00
yihaoDeng
39d04ed15b add rpc update interface 2023-09-11 20:48:24 +08:00
shenglian zhou
9da204e5ff enhance: update notification and get user whitelist api 2023-09-11 17:04:35 +08:00
Haojun Liao
5ab739ae46 fix(stream): fix memory leak. 2023-09-11 15:29:12 +08:00
yihaoDeng
d549a47cf5 add rpc update interface 2023-09-11 15:17:20 +08:00
dapan1121
5c21f1ca22 fix: remove incorrect assert 2023-09-11 15:16:22 +08:00
kailixu
78d136dffd fix: neighbor block overlap judgement 2023-09-11 15:10:39 +08:00
yihaoDeng
05727359ca add rpc update interface 2023-09-11 15:02:35 +08:00
dmchen
a8e538a563 fix/TD-26210 2023-09-11 14:38:36 +08:00
Haojun Liao
c729fc989f fix(stream): set the init start timestamp. 2023-09-11 13:49:43 +08:00
Haojun Liao
0980e021e5 fix(stream): set the correct start version for the step 2 stage in fill history. 2023-09-11 13:37:19 +08:00
yihaoDeng
2a30e12547 add rpc update interface 2023-09-11 10:45:45 +08:00
Haojun Liao
50ef500f51 refactor(stream): do sink module refactor. 2023-09-11 10:09:31 +08:00
shenglian zhou
569283f806 enhance: add hb whitelist version and notify taosadapter 2023-09-11 09:52:58 +08:00
yihaoDeng
30a60be214 add rpc update interface 2023-09-11 09:26:00 +08:00
Minglei Jin
443756c6ff fix(meta): null txn after abort 2023-09-11 08:55:30 +08:00
wade zhang
ddc8c93a9c
Merge pull request #22767 from taosdata/mark/tmq
fix:send delete subscribe info to vnode if drop consumer
2023-09-10 22:17:26 +08:00
wade zhang
635d405867
Merge pull request #22800 from taosdata/fix/TS-3922-main
fix:[TS-3922] make SStreamObj->->currentTick aligned by 8
2023-09-10 22:17:07 +08:00
Haojun Liao
372747cc23
Merge pull request #22818 from taosdata/fix/3_liaohj
fix(stream): fix error in fill history and check quit status of vnode.
2023-09-10 20:47:06 +08:00
yihaoDeng
9781766009 add rpc update interface 2023-09-10 17:02:38 +08:00
yihaoDeng
d121b564c0 add rpc update interface 2023-09-10 16:11:14 +08:00
yihaoDeng
25bc0b226b add rpc update interface 2023-09-10 14:09:36 +08:00
Haojun Liao
85a5c45098 fix(stream): limit the already processed data. 2023-09-10 00:01:25 +08:00
Haojun Liao
9a30573b8b fix(stream): disable scan wal when halt is set. 2023-09-09 16:12:08 +08:00
Haojun Liao
aa8909b267 other: add some logs. 2023-09-09 15:18:54 +08:00
Haojun Liao
6f5c855a4b fix(stream): fix msg lost bug. 2023-09-09 15:08:36 +08:00
Haojun Liao
47fd144447 other: add some logs. 2023-09-09 11:19:51 +08:00
yihaoDeng
af08289a06 Merge branch 'fix/mainNew' into fix/fixTransferCrash2 2023-09-08 19:58:21 +08:00
yihaoDeng
a0494695de fix merge error 2023-09-08 19:48:06 +08:00
Haojun Liao
b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
yihaoDeng
56706193eb add rpc update interface 2023-09-08 11:49:12 +08:00
yihaoDeng
27e3ee8f1d add rpc update interface 2023-09-07 21:10:05 +08:00
yihaoDeng
60d6a622e1 add rpc update interface 2023-09-07 20:47:10 +08:00
wangmm0220
842bb5742a fix:[TS-3922]rollback because cases failed & avoid atomic_store_64 core if parameters not aligned by 8 2023-09-07 19:26:33 +08:00
Benguang Zhao
55a9668908 fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord 2023-09-07 17:26:30 +08:00
Benguang Zhao
2d5b18039d fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord 2023-09-07 17:14:50 +08:00
wade zhang
3ea51721b9
Merge pull request #22797 from taosdata/fix/TD-25218-main
Fix/TD-25218: adjust the error code returned when db does not exist
2023-09-07 16:13:53 +08:00
wade zhang
d3f0c5ac3e
Merge pull request #22770 from taosdata/fix/TD-25445-main
fix/TD-25445: search memory in ttlMgrFindExpired
2023-09-07 16:13:32 +08:00
yihaoDeng
8c5fa3526a add rpc update interface 2023-09-07 16:10:07 +08:00
wangmm0220
c4898bffd8 fix:[TS-3922] make SStreamObj->->currentTick aligned by 8 2023-09-07 15:23:00 +08:00
Shungang Li
46af31539d fix: adjust the error code returned when db does not exist 2023-09-07 14:52:34 +08:00
yihaoDeng
f4f97a67f5 add rpc update interface 2023-09-07 14:24:26 +08:00
yihaoDeng
147de26eec add rpc update interface 2023-09-07 11:54:34 +08:00
Haojun Liao
55ac835294 Merge branch 'main' into fix/3_liaohj 2023-09-07 11:47:25 +08:00
Haojun Liao
b240e91c91 enh(stream): add token bucket to limit the rate of sink operation. 2023-09-07 09:58:48 +08:00
Shungang Li
a6ba7e678f fix: search memory in ttlMgrFindExpired 2023-09-07 09:33:26 +08:00
Haojun Liao
0f909285c4
Merge pull request #22684 from taosdata/mark/tmq-3.0
fix:use vgstatus before if rebalance
2023-09-07 09:20:27 +08:00
yihaoDeng
bc27d245b1 add rpc update interface 2023-09-06 21:54:31 +08:00
yihaoDeng
ad5639df89 add rpc update interface 2023-09-06 21:36:16 +08:00
Haojun Liao
2b84e0b02e refactor: check if the put data into queue is success or failed. 2023-09-06 19:39:00 +08:00
Haojun Liao
8edf86b3bb fix(stream): add some logs. 2023-09-06 19:08:09 +08:00
Haojun Liao
5ba6a68e7a fix(stream): fix syntax error. 2023-09-06 19:00:39 +08:00
Haojun Liao
a82027f492 enh(stream): pack multi-datablock into one submit message. 2023-09-06 18:58:47 +08:00
wade zhang
e493f983ed
Merge pull request #22735 from taosdata/fix/TD-26133
fix: coverity scan
2023-09-06 18:45:23 +08:00
Haojun Liao
f8a321695a
Merge pull request #22711 from taosdata/fix/TD-26069-1
fix rc
2023-09-06 17:58:33 +08:00
yihaoDeng
ac8220012c add rpc update interface 2023-09-06 17:22:30 +08:00
Hongze Cheng
1d343fa57e more fix 2023-09-06 17:10:36 +08:00
Haojun Liao
926cc01cff refactor: do some internal refactor. 2023-09-06 16:48:43 +08:00
yihaoDeng
b5d40d01bb add rpc update interface 2023-09-06 16:24:29 +08:00
dapan1121
ed9085281d
Merge pull request #22623 from taosdata/feat/TD-25964-3.0
feat: get cpu cores from quota
2023-09-06 16:03:33 +08:00
Hongze Cheng
cd88c8ec31 fix: little test 2023-09-06 14:45:53 +08:00
Haojun Liao
b382cba58c fix(stream): fix syntax error. 2023-09-06 14:37:58 +08:00
Haojun Liao
236b363996 fix(stream): fix syntax error. 2023-09-06 14:37:11 +08:00
Haojun Liao
8783ebcb02 enh(stream): add some logs and record the submit package performance. 2023-09-06 14:34:36 +08:00
Hongze Cheng
a6743a31b5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-26133 2023-09-06 14:12:21 +08:00
dapan1121
698b0b21f7
Merge pull request #22630 from taosdata/enh/TS-3812-3.0
enh: report time series by period and quantity
2023-09-06 13:38:24 +08:00
dapan1121
2bc8b3f7ee
Merge pull request #22625 from taosdata/enh/TD-23879-3.0
enh: allow altering options to the same value
2023-09-06 13:34:49 +08:00
Haojun Liao
e607a0a5cb fix(stream): add some logs. 2023-09-06 11:39:07 +08:00
wangmm0220
f209e31582 fix:send delete subscribe info to vnode if drop consumer 2023-09-06 11:16:03 +08:00
dmchen
231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
Haojun Liao
c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
yihaoDeng
393ef21348 add rpc update interface 2023-09-06 09:32:26 +08:00
yihaoDeng
6f6c517342 add rpc update interface 2023-09-05 21:00:01 +08:00
yihaoDeng
e539eebaa2 add rpc update interface 2023-09-05 18:50:11 +08:00
wangmm0220
ef87b9c571 fix:conflicts from 3.0 2023-09-05 16:19:04 +08:00
wangmm0220
4e46ce4c03 fix:wait pHandle idle if vnode receives subscribe msg 2023-09-05 16:04:44 +08:00
wade zhang
0517358a02
Merge pull request #22717 from taosdata/fix/TD-22062
fix/TD-22062
2023-09-05 16:04:12 +08:00
Haojun Liao
ac8f4f1558
Merge pull request #22736 from taosdata/fix/fixTransferCrash
fix invalid read
2023-09-05 15:42:03 +08:00
Haojun Liao
5dcbae3594
Merge pull request #22681 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-09-05 12:54:09 +08:00
yihaoDeng
d0503a8a3f fix invalid read 2023-09-05 12:11:58 +08:00
yihaoDeng
6257bf1e10 add rpc update interface 2023-09-05 12:03:23 +08:00
Hongze Cheng
8dbdeccc8f fix: coverity scan 2023-09-05 11:41:36 +08:00
Alex Duan
00c5760927
Merge pull request #22730 from taosdata/fix/test_1x
test: add stream cases to 3.0
2023-09-05 11:21:35 +08:00
dapan1121
4a5bcb5c80
Merge pull request #22650 from taosdata/szhou/ip-whitelist
enhance: ip whitelist syntax
2023-09-05 11:00:55 +08:00
wade zhang
8f27724f1f
Merge pull request #22701 from taosdata/fix/test_1x
test: add stream cases to main
2023-09-05 10:57:38 +08:00
Haojun Liao
0441c7a870 Merge branch 'fix/3_liaohj' of github.com:taosdata/tdengine into fix/3_liaohj 2023-09-05 10:40:48 +08:00
Haojun Liao
5b3cb8ec42 fix(stream): fix memory leak. 2023-09-05 09:27:16 +08:00
Haojun Liao
db8073dadd fix(stream): fix memory leak. 2023-09-04 23:13:57 +08:00
yihaoDeng
685bdea44a add rpc update interface 2023-09-04 21:15:46 +08:00
Haojun Liao
77eed06bcd
Merge branch '3.0' into fix/3_liaohj 2023-09-04 18:51:07 +08:00
dmchen
1a0480c834 fix/TD-22062 2023-09-04 17:14:29 +08:00
wangmm0220
90e938e48f fix:set vg status idle if reveive poll callback 2023-09-04 16:53:12 +08:00
Haojun Liao
aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao
ed22dd5f26 fix(stream): fix deadlock caused during merging branch. 2023-09-04 14:09:39 +08:00
Haojun Liao
375d0abea5 fix(stream): merge main. 2023-09-04 13:12:53 +08:00
Haojun Liao
21dab8ceab other: merge 3.0 2023-09-04 13:08:19 +08:00
yihaoDeng
03cddfa7ce fix rc 2023-09-04 10:33:01 +08:00
Haojun Liao
d73de8ba1e fix(stream): add null ptr check. 2023-09-02 16:44:21 +08:00
Haojun Liao
037a232bfa refactor: do some internal refactor. 2023-09-01 17:05:36 +08:00
wangmm0220
fd85d5885a fix:add limit time for consume in 1 seconds 2023-09-01 16:57:49 +08:00
wangmm0220
02ac3eac5a fix:logic error 2023-09-01 16:51:44 +08:00
yihaoDeng
5f78c27535 add enable white list 2023-09-01 15:11:25 +08:00
Haojun Liao
4fee5ba59a fix(stream): even in ck, start stream tasks. 2023-09-01 14:40:30 +08:00
yihaoDeng
832b78c0e8 Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 13:44:23 +08:00
dapan1121
cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
dapan1121
2141ac8460 Merge remote-tracking branch 'origin/main' into fix/m23.2 2023-09-01 11:21:38 +08:00
yihaoDeng
8b146f793d Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 10:51:24 +08:00
Hongze Cheng
113867081e enh: upgrade more efficiently 2023-09-01 10:16:10 +08:00
dapan1121
228e6c6acd Merge remote-tracking branch 'origin/main' into 3.0 2023-09-01 10:01:10 +08:00
Haojun Liao
3765fbbba2 fix(stream): fix memory leak. 2023-09-01 09:59:56 +08:00
Haojun Liao
e8294ed8dc fix(stream): fix bug in multi-replica vnode redistribute. 2023-09-01 03:10:12 +08:00
Haojun Liao
fecba5b097 fix(stream): check for meta 2023-08-31 20:54:02 +08:00
Haojun Liao
95da66e3e8 fix(stream): fix error. 2023-08-31 20:50:12 +08:00
Haojun Liao
e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069
fix invalid insert
2023-08-31 18:29:25 +08:00
wade zhang
fcd3c6f109
Merge pull request #22668 from taosdata/feat/audit-table-namee
Feat/audit table name
2023-08-31 17:48:19 +08:00
wangmm0220
a02ab4ccfb fix:coredump if saved epoch bigger than request epoch & modify test cases 2023-08-31 17:35:41 +08:00
dmchen
03de7ad5a6 stream name 2023-08-31 16:44:36 +08:00
dmchen
12ffc58b7e password and topic name 2023-08-31 16:37:24 +08:00
yihaoDeng
1833be028f fix invalid insert 2023-08-31 15:28:31 +08:00
yihaoDeng
9fd0bff673 fix invalid insert 2023-08-31 14:57:26 +08:00
dmchen
9b7bbe0168 audit table name 2023-08-31 14:42:25 +08:00
Haojun Liao
92e258617a refactor: do some internal refactor. 2023-08-31 14:31:45 +08:00
Haojun Liao
e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao
69f95f9324 other: merge 3.0 2023-08-31 13:56:34 +08:00
Haojun Liao
3fc3dafca6 refactor: do some internal refactor. 2023-08-31 13:46:48 +08:00
Haojun Liao
3ed78ddadd
Merge pull request #22662 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-08-31 13:46:14 +08:00
Haojun Liao
8645f763b5
Merge pull request #22661 from taosdata/enh/reserve
stream change ver
2023-08-31 13:35:23 +08:00
yihaoDeng
83a5e2be4c stream change ver 2023-08-31 11:42:12 +08:00
wade zhang
2978efafa6
Merge pull request #22660 from taosdata/feat/audit-dropnode-no-ipport
typo and remove ip port
2023-08-31 11:05:02 +08:00
Haojun Liao
e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
Haojun Liao
0facde6ddc
Merge pull request #22659 from taosdata/fix/TD-26035
fix(stream): do not restart the stream tasks when it is running.
2023-08-31 10:16:59 +08:00
Haojun Liao
0c599fa869
Merge pull request #22415 from taosdata/szhou/tsdb-neigh-block
tsdb neighbouring block search and set it to global block iterator
2023-08-31 09:46:37 +08:00
yihaoDeng
05ca71d5de stream change ver 2023-08-31 09:28:43 +08:00
dmchen
22f0778cca typo and remove ip port 2023-08-31 09:26:44 +08:00
wangmm0220
7f2a9a7262 fix:cancel the limit time for consume 2023-08-31 09:07:40 +08:00
kailixu
f4dd1895b2 Merge branch '3.0' into feat/TD-25964-3.0 2023-08-31 08:56:53 +08:00
wade zhang
68e4a72021
Merge pull request #22643 from taosdata/feat/audit-user-typestr
alter user type to str
2023-08-31 07:59:31 +08:00
wangmm0220
4f20359f43 fix:modify log level to trace 2023-08-30 23:57:48 +08:00
Haojun Liao
a2c6e4306a fix(stream): reset the counter. 2023-08-30 20:20:20 +08:00
Haojun Liao
fd2f988cdb fix(stream): reset the counter. 2023-08-30 20:19:51 +08:00
Haojun Liao
5d23df100c fix(stream): ignore the fill-history tasks. 2023-08-30 19:07:06 +08:00
Haojun Liao
65eaa9b15f fix(stream): add task release. 2023-08-30 19:06:12 +08:00
wangmm0220
23c4d7eb0a fix:dead lock 2023-08-30 18:10:19 +08:00
dmchen
3d9274d713 create table db name 2023-08-30 17:28:03 +08:00
Haojun Liao
d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
slzhou
82dc2de2f4 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-30 17:11:42 +08:00
dmchen
623660d012 enhance 2023-08-30 16:17:13 +08:00
dmchen
04a89b4a49 long fields 2023-08-30 16:03:57 +08:00
Haojun Liao
c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao
24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
dmchen
63e2926a60 topic 2023-08-30 15:26:54 +08:00
kailixu
eb7d2d495a chore: supports obtaining physical/virtual CPU cores 2023-08-30 15:21:03 +08:00
dapan1121
718f97e506
Merge pull request #22640 from taosdata/fix/m23.1
Fix/m23.1
2023-08-30 14:58:40 +08:00
liuyao
0a72e576bd op stream pause
pause data dispatch

opt stream pause
2023-08-30 14:53:49 +08:00
slzhou
1ab94d0992 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-30 14:42:26 +08:00
dmchen
7790afd85d fields 2023-08-30 13:13:05 +08:00
dmchen
b9f77798a2 alter user type to str 2023-08-30 12:06:11 +08:00
kailixu
1a34cd1020 chore: optimize of report time series by quantity 2023-08-30 11:45:07 +08:00
wade zhang
bec05f2677
Merge pull request #22638 from taosdata/feat/TD-26033
TD-26033
2023-08-30 11:40:44 +08:00
kailixu
8e20740622 enh: report time series by quantity 2023-08-30 11:39:21 +08:00
wade zhang
bbed968256
Merge pull request #22617 from taosdata/FIX/TD-25995-3.0
enh: adjust criteria of completion to retrieve SShowObj info from mnode in mndProcessSysTableReq
2023-08-30 11:33:13 +08:00
dapan1121
f6321d0c4f Merge remote-tracking branch 'origin/main' into fix/m23.1 2023-08-30 11:03:33 +08:00
Haojun Liao
dec4d69529 fix(stream): set correct user-define table name in sink table info cache. 2023-08-30 10:52:39 +08:00
dmchen
7bea92cbf9 TD-26033 2023-08-30 10:28:39 +08:00
Haojun Liao
3a7a220d43 fix(stream): fix error found by ci. 2023-08-30 10:14:01 +08:00
wade zhang
782c936ee8
Merge pull request #22635 from taosdata/feat/audit-dbname
audit-dbname
2023-08-30 09:55:48 +08:00
kailixu
9d1ac801ed Merge branch '3.0' into enh/TS-3812-3.0 2023-08-30 09:27:17 +08:00
Haojun Liao
610132e29a
Merge pull request #22633 from taosdata/fix/update_db_attr
fix(tsdb): add more check for block rows
2023-08-29 22:05:57 +08:00
wade zhang
701ac939c1
Merge pull request #22632 from taosdata/fix/ttl
fix/TD-26032: ttl cache entry record the original information for deletion
2023-08-29 18:27:50 +08:00
Haojun Liao
8dadae5d3a fix(stream): fix invalid read. 2023-08-29 18:24:32 +08:00
dmchen
bb33620f5c dbname 2023-08-29 18:12:08 +08:00
Haojun Liao
d6368798da fix(query): disable the set quit flag for tsdbreader. 2023-08-29 18:11:17 +08:00
Benguang Zhao
dbeafb508b fix: reset show obj iter on no more data to read in mndRetrieveIdx 2023-08-29 17:56:24 +08:00
Haojun Liao
b740ce8ad6 fix(tsdb): add more check for block rows to detect the duplicate rows in data block. 2023-08-29 17:49:43 +08:00
kailixu
3036b78910 Merge branch '3.0' into enh/TD-23879-3.0 2023-08-29 17:43:14 +08:00
shenglian zhou
33966cf856 enhance: continue coding 2023-08-29 17:35:03 +08:00
Haojun Liao
204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
Shungang Li
df2b2484df fix: ttl cache entry record the original information for deletion 2023-08-29 17:18:22 +08:00
Minglei Jin
82fc1f41fb fix(tsdb/cache read): remove all null row 2023-08-29 16:15:00 +08:00
kailixu
f00596868f fix: remove duplicated line 2023-08-29 16:12:49 +08:00
kailixu
db07511c93 enh: report time series by period and quantity 2023-08-29 16:08:51 +08:00
Benguang Zhao
a6455672c0 fix: check completeness of retrieval properly in mndProcessRetrieveSysTableReq 2023-08-29 15:47:11 +08:00
wade zhang
53a24e04f2
Merge pull request #22604 from taosdata/feat/audit-db-detail
audit db detail
2023-08-29 15:46:10 +08:00
kailixu
523994d93b enh: allow altering options to the same value 2023-08-29 15:15:07 +08:00
Haojun Liao
c3e9590740 fix(stream): fix error. 2023-08-29 15:11:01 +08:00
Benguang Zhao
5e5b7a3328 fix: reserve enough space of show Obj rows for vnodes of each vgroup in mndRetrieveVnodes 2023-08-29 12:07:52 +08:00
Haojun Liao
6e4acddd96
Merge pull request #22603 from taosdata/fix/TD-25962
fix:unregister push manager if delete subscribe to avoid tqProcessPol…
2023-08-29 10:58:49 +08:00
Minglei Jin
432eaf5110 Merge branch '3.0' into fix/TD-25963 2023-08-29 10:51:53 +08:00
Minglei Jin
b88d79d2ef fix(tsdb/open fs): fix retval 2023-08-29 10:33:20 +08:00
wade zhang
ff6de8ebe2
Merge pull request #22600 from taosdata/fix/TD-25010-10
enh(s3/evict): evict cache data files for other migrated head, stt, etc.
2023-08-28 18:12:40 +08:00
dmchen
1372cede48 init 2023-08-28 17:44:10 +08:00
dapan1121
778e50da79
Merge pull request #22592 from taosdata/fix/m23.0
Fix/m23.0
2023-08-28 17:35:35 +08:00
wangmm0220
2e04d513a4 fix:unregister push manager if delete subscribe to avoid tqProcessPollPush 2023-08-28 16:41:28 +08:00
Minglei Jin
9ef455a454 enh(s3/evict): evict cache data files for other migrated head, stt, etc. 2023-08-28 15:57:13 +08:00
Haojun Liao
05bb164675 fix(stream): release tasks. 2023-08-28 15:56:02 +08:00
Haojun Liao
391103bc5a fix(stream): do dome internal refactor. 2023-08-28 15:54:01 +08:00
Haojun Liao
33672f2f35 fix(stream): release stream tasks. 2023-08-28 15:52:54 +08:00
wade zhang
cd3702e91c
Merge pull request #22596 from taosdata/fix/TD-25963
fix(tsdb/s3): fix scan and fix with s3 files
2023-08-28 15:19:47 +08:00
Minglei Jin
f299ae9bc3 fix(tsdb/s3): fix scan and fix with s3 files 2023-08-28 12:22:53 +08:00
wade zhang
1797fe50e2
Merge pull request #22590 from taosdata/feat/TD-18801
init
2023-08-28 11:05:38 +08:00
Haojun Liao
da0b4e1f92 Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-28 10:55:38 +08:00
wade zhang
e95c9d5fdc
Merge pull request #22591 from taosdata/feat/TD-18572
feat/TD-18572: dynamic 'supportvnodes'
2023-08-28 10:46:44 +08:00
dapan1121
0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
Haojun Liao
b75ae217f6 fix(stream): notify close for snode. 2023-08-28 09:53:08 +08:00
Haojun Liao
88f6596965
Merge pull request #22464 from taosdata/feat/TD-18789
feat:support varbinary type
2023-08-28 09:45:57 +08:00
Haojun Liao
b11975f00c
Merge pull request #22534 from taosdata/mark/tmq
fix:[TD-258900]modify tmq trans conflict to db level
2023-08-28 09:45:47 +08:00
dapan1121
1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
Shungang Li
0c28c9aee8 feat: dynamic 'supportvnodes' 2023-08-28 09:17:35 +08:00
dmchen
06083e1eb9 init 2023-08-28 09:15:51 +08:00
dapan1121
cda08087b9
Merge pull request #22586 from taosdata/fix/TD-25936.3
fix: no explain response issue
2023-08-28 08:52:13 +08:00
Haojun Liao
6b327886e9 fix(stream): add null ptr check. 2023-08-27 00:27:04 +08:00
wangmm0220
8b745de397 fix:transaction error 2023-08-26 00:43:47 +08:00
Haojun Liao
d8a6ec024a Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 19:21:00 +08:00
Haojun Liao
7ceb8dc627 fix(stream): disable the follower to execute the stop/resume instruction. 2023-08-25 19:20:49 +08:00
yihaoDeng
22b8d90fbc fix invalid read 2023-08-25 18:34:11 +08:00
wangmm0220
047707fa17 fix:error in privilege 2023-08-25 17:56:17 +08:00
Haojun Liao
43a3f9f535 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 17:32:50 +08:00
Haojun Liao
e013ba6795 fix(stream): fix the counter. 2023-08-25 17:32:34 +08:00
Minglei Jin
f0fdbaa3f3 fix(tsdb/close): fix uaf with file closing 2023-08-25 17:27:32 +08:00
Haojun Liao
60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
wangmm0220
26e025d78d feat:[TD-18789]support varbinary type 2023-08-25 15:43:45 +08:00
Haojun Liao
f951635602 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 15:33:08 +08:00
Haojun Liao
ab2aad2b2c fix(stream): update the task status even it is in stop status. 2023-08-25 15:32:55 +08:00
dapan1121
e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
liuyao
7d44b7e4cb mem leak 2023-08-25 14:53:29 +08:00
Hongze Cheng
e1095e7d02 fix: improve upgrade speed 2023-08-25 14:40:29 +08:00
Haojun Liao
4c7ad54c9c fix(stream): not restart tasks when in restoring procedure. 2023-08-25 11:28:28 +08:00