Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
67094 commits 554 branches 514 tags 1.7 GiB
Commit graph

15104 commits

Author SHA1 Message Date
yihaoDeng
87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
Minglei Jin
e9cc54d87b cos_cp/load: load checkpoint from json 2023-12-05 16:37:28 +08:00
wangjiaming0909
a6c876bbc1 fix: last/last_row crash with dropped column 2023-12-05 14:16:01 +08:00
Minglei Jin
e0a14bd359 fix(tsdb/cache): remove debug log 2023-12-05 14:05:16 +08:00
Haojun Liao
9d451ab56e
Merge pull request #23934 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-05 12:58:18 +08:00
wangmm0220
79c8a1494d fix:disable snode unit test temporary 2023-12-05 11:26:12 +08:00
Haojun Liao
cb8dfae0cc refactor: do some internal refactor. 2023-12-05 10:47:19 +08:00
slzhou
e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
Haojun Liao
cc5890d56a
Merge pull request #23924 from taosdata/fix/3_liaohj 
enh(tsdb): extract rows for the given tables in all stt files.
 2023-12-04 19:21:19 +08:00
Hongze Cheng
26774f87c9
Merge pull request #23920 from taosdata/fix/TD-27619 
fix: bg task memory waste
 2023-12-04 18:10:30 +08:00
Haojun Liao
7145a7b8a1 fix(tsdb): calculate the rows in next fileset. 2023-12-04 18:03:32 +08:00
Haojun Liao
6d82900a32 fix(tsdb): fix error in block dist. 2023-12-04 18:00:41 +08:00
Hongze Cheng
ac2d9ebc27 fix: memory leak 2023-12-04 16:48:43 +08:00
slzhou
8c290587b7 fix: typo error 2023-12-04 16:19:07 +08:00
Haojun Liao
24d9337632 enh(tsdb): extract rows for the given tables in all stt files. 2023-12-04 15:38:24 +08:00
slzhou
a517271f39 Merge branch 'szhou/tms-duration-2' into szhou/tms-duration 2023-12-04 14:56:19 +08:00
slzhou
07e43fe56b fix: two intervals are intesected or not 2023-12-04 14:54:15 +08:00
Hongze Cheng
cea4be6f3c fix: bg task memory waste 2023-12-04 13:40:28 +08:00
kailixu
e623c9c3c8 feat: support machine id 2023-12-04 11:44:02 +08:00
54liuyao
38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao
48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455 
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
 2023-12-04 09:10:00 +08:00
Haojun Liao
5467bba86b fix(tsdb): do some internal refactor. 2023-12-04 09:03:40 +08:00
Haojun Liao
7b0cf47fd6 fix(tsdb): do some internal refactor. 2023-12-04 08:58:10 +08:00
Haojun Liao
29a1c6d518 fix(tsdb): do some internal refactor. 2023-12-04 08:55:53 +08:00
kailixu
042291c35b feat: support machine id 2023-12-01 18:15:47 +08:00
wangmm0220
f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
Haojun Liao
3194ff41aa
Merge pull request #23900 from taosdata/fix/3_liaohj 
fix(stream): merge fix from main to 3.0
 2023-12-01 16:39:38 +08:00
shenglian zhou
bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
Haojun Liao
4d9211dcf1
Merge pull request #23899 from taosdata/fix/liaohj 
other: merge the patch of stream from 3.0 branch.
 2023-12-01 15:49:54 +08:00
slzhou
82629c2658 fix: notify when there are no memory pre fileset 2023-12-01 15:11:43 +08:00
Haojun Liao
d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
Haojun Liao
7e63943c4e
Merge pull request #23860 from taosdata/fix/TD-27455 
fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode
 2023-12-01 14:18:58 +08:00
wade zhang
041add545c
Merge pull request #23844 from taosdata/FIX/TS-4306-3.0 
enh: limit size of snap replication msg by data length
 2023-12-01 14:06:36 +08:00
Haojun Liao
33ad05e2c8 fix(stream): fix syntax error. 2023-12-01 13:08:25 +08:00
slzhou
4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
Haojun Liao
12f32f0ae7 fix(stream): fix syntax error. 2023-12-01 11:57:16 +08:00
Haojun Liao
dba58f5e38 fix(stream): fix syntax error. 2023-12-01 11:54:13 +08:00
Haojun Liao
eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao
18273b8d1b fix(stream): ignore the in_progress code. 2023-12-01 10:20:45 +08:00
Haojun Liao
2972f5f420 fix(stream):return the error code if create stream failed. 2023-12-01 10:20:45 +08:00
Haojun Liao
e008d0f440 fix(tsdb): fix invalid read. 2023-12-01 10:20:45 +08:00
Haojun Liao
fbb604d1f5 fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-12-01 10:20:44 +08:00
Haojun Liao
1c9ff8030b fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-12-01 10:20:39 +08:00
Haojun Liao
86618ffd97 refactor: do some internal refactor. 2023-12-01 10:20:38 +08:00
Haojun Liao
31ae46925d fix(stream): fix invalid free. 2023-12-01 10:20:32 +08:00
Haojun Liao
17d4a22e47 fix(stream): add logs. 2023-12-01 10:19:54 +08:00
Haojun Liao
b9c727575d fix(stream): reset the scheduler status. 2023-12-01 10:19:54 +08:00
Haojun Liao
c937f42d88 fix(stream): fix deadlock. 2023-12-01 10:19:54 +08:00
Haojun Liao
8515a2f9b6 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-12-01 10:19:18 +08:00
Haojun Liao
9d735e7f8b fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-12-01 10:18:25 +08:00
Haojun Liao
523573844a fix(stream): fix syntax error. 2023-12-01 10:18:24 +08:00
Haojun Liao
eb2f5ad074 fix(stream): fix error. 2023-12-01 10:18:22 +08:00
Haojun Liao
2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao
60fa7cccbf fix(stream): fix memory leak. 2023-12-01 10:17:14 +08:00
dapan1121
32030ca130
Merge pull request #23886 from taosdata/revert-23730-enh/TD-26976-3.0 
Revert "enh:  grant and active codes"
 2023-11-30 19:04:50 +08:00
Minglei Jin
49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
wangmm0220
4fc19a6343 fix:snode can only be created 1 2023-11-30 15:49:31 +08:00
Haojun Liao
999afd97e5 other: merge 3.0 2023-11-30 14:36:18 +08:00
54liuyao
271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
Haojun Liao
de82aba2e5 fix(stream): ignore the in_progress code. 2023-11-30 14:32:14 +08:00
Haojun Liao
71860bfb46 fix(stream):return the error code if create stream failed. 2023-11-30 13:57:00 +08:00
Hongze Cheng
0bfa86f188
Merge pull request #23864 from taosdata/feat/TD-27461-3.0 
feat: backgroud task priority
 2023-11-30 13:51:57 +08:00
Haojun Liao
e9ead3bd28
Merge pull request #23341 from taosdata/enh/refactorBackend 
Enh/refactor backend
 2023-11-30 13:48:18 +08:00
Hongze Cheng
8ee4e2c1fe
Merge pull request #23862 from taosdata/fix/TD-27571 
fix(tsdb/cache): flush dirty lru entries before del
 2023-11-30 13:46:50 +08:00
Cary Xu
f96044e09f
Revert "enh: grant and active codes" 2023-11-30 13:39:54 +08:00
slzhou
80ee5bfb3e fix: the initial value of first fileset start / end key 2023-11-30 11:08:18 +08:00
yihaoDeng
5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
WANG MINGMING
9b72d890c8
Merge branch '3.0' into fix/TD-27455 2023-11-30 09:37:23 +08:00
Hongze Cheng
547e673955 fix: coredump caused by typo 2023-11-30 09:20:18 +08:00
Haojun Liao
130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj 
enh(stream/tsdb): do multiple optimization and fix some bugs.
 2023-11-30 09:20:15 +08:00
Minglei Jin
ab2c7abca1 tsdb/cache-del: commit before get from rocks 2023-11-30 09:15:58 +08:00
Haojun Liao
28e17a61b9 fix(tsdb): fix invalid read. 2023-11-29 19:28:53 +08:00
Haojun Liao
66f25712fd fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-11-29 18:07:15 +08:00
Hongze Cheng
65ccc4aa48 feat: backgroud task priority 2023-11-29 18:01:31 +08:00
Minglei Jin
2c9c117529 fix(tsdb/cache): flush dirty lru entries before del 2023-11-29 17:37:40 +08:00
wangmm0220
4f168b4b2d fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode 2023-11-29 17:22:43 +08:00
Benguang Zhao
e66a1d6c9a enh: limit snap replication msg by size of block data in tsdbSnapReadTimeSeriesData 2023-11-29 16:01:11 +08:00
slzhou
1a3e280ea8 fix: use imem maxKey/minKey 2023-11-29 13:50:53 +08:00
slzhou
09e314c3ae fix: pStatus->pTableIter is set to null when getting mem table time range 2023-11-29 12:26:32 +08:00
54liuyao
ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
shenglian zhou
4691a7767a restore buildBlockFromBufferSequentially back 2023-11-29 10:29:40 +08:00
shenglian zhou
8a79df1113 enhance: prepare duration for next fileset 2023-11-29 10:15:43 +08:00
shenglian zhou
765b8384c0 Merge branch 'szhou/tms-duration' of github.com:taosdata/TDengine into szhou/tms-duration-2 2023-11-29 08:18:27 +08:00
slzhou
b2fa6209d9 fix: descending traverse wrong endkey 2023-11-29 08:09:00 +08:00
Haojun Liao
a5c8eaacaa fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-11-28 23:52:19 +08:00
kailixu
b54f5b47ad fix: reserve enough buffer for user 2023-11-28 17:58:54 +08:00
shenglian zhou
5a75d74421 fix:mem table has data in the fileset duration 2023-11-28 15:58:33 +08:00
slzhou
4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
shenglian zhou
89cd2b6f17 enhance: tsdb output duration order 2023-11-28 14:39:08 +08:00
yihaoDeng
08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
yihaoDeng
786383118c fix drop stream case 2023-11-28 10:39:17 +08:00
shenglian zhou
cdb7eb462d Revert "Revert "fix: pass compilation"" 
This reverts commit 644dbad920.
 2023-11-28 10:31:18 +08:00
shenglian zhou
df4f7d6956 Revert "Revert "enhance: duration notification"" 
This reverts commit 3331e25aaf.
 2023-11-28 10:31:18 +08:00
Haojun Liao
6bb30822c2 refactor: do some internal refactor. 2023-11-28 10:04:22 +08:00
Haojun Liao
9649db9003 fix(stream): fix invalid free. 2023-11-28 10:04:14 +08:00
Haojun Liao
8b406c0a19
Merge pull request #23830 from taosdata/fix/liaohj 
fix(stream): fix invalid free.
 2023-11-28 09:52:28 +08:00
shenglian zhou
3331e25aaf Revert "enhance: duration notification" 
This reverts commit 9dd306e1ef.
 2023-11-28 08:29:05 +08:00
shenglian zhou
644dbad920 Revert "fix: pass compilation" 
This reverts commit 1a7ee3643e.
 2023-11-28 08:28:49 +08:00
yihaoDeng
a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
Haojun Liao
b419650116 refactor: do some internal refactor. 2023-11-27 18:51:30 +08:00
Haojun Liao
91eea02258 fix(stream): fix invalid free. 2023-11-27 18:49:22 +08:00
wangmm0220
02575e0f28 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-27455 2023-11-27 18:15:53 +08:00
wangmm0220
d007d31c4d fix:process snode when drop stream 2023-11-27 18:15:09 +08:00
wangmm0220
06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220
70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng
630f4f9d80 Merge branch '3.0' into enh/refactorBackend 2023-11-27 13:53:33 +08:00
yihaoDeng
e483570cd7 Merge branch '3.0' into enh/refactorBackend 2023-11-27 11:10:56 +08:00
Haojun Liao
e85c6349a4
Merge pull request #23818 from taosdata/fix/TD-27455 
fix:add O_CLOSEXEC for .running & process snode when drop stream
 2023-11-27 11:01:24 +08:00
yihaoDeng
e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
dapan1121
d3ac79aeb7
Merge pull request #23808 from taosdata/fix/PI-23-3.0 
fix: add check in mnode/vnode when alter table col/tag
 2023-11-26 17:31:38 +08:00
Haojun Liao
9194c0c0cd fix(stream): add logs. 2023-11-25 00:56:18 +08:00
Haojun Liao
30c776cc0a fix(stream): reset the scheduler status. 2023-11-25 00:54:32 +08:00
Haojun Liao
788194c748 fix(stream): fix deadlock. 2023-11-24 22:53:55 +08:00
wangmm0220
ff0828fcc2 fix:add O_CLOSEXEC for .running & process snode when drop stream 2023-11-24 18:30:58 +08:00
wangmm0220
f8477204e1 fix:[TD-27475] send msg to snode wher drop stream to avoid pVgObj is NULL 2023-11-24 18:00:19 +08:00
yihaoDeng
6416a6153a Merge branch '3.0' into enh/refactorBackend 2023-11-24 16:29:09 +08:00
Haojun Liao
f28cf740b0 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-11-24 14:44:00 +08:00
Haojun Liao
d51baab9c2
Merge pull request #23785 from taosdata/fix/liaohj 
other: merge fix from 3.0 to main.
 2023-11-24 14:43:02 +08:00
Haojun Liao
d5e123db78
Merge pull request #23791 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-11-24 14:42:43 +08:00
yihaoDeng
23ae62d268 Merge branch '3.0' into enh/refactorBackend 2023-11-24 11:10:39 +08:00
Hongze Cheng
24932d2d41
Merge pull request #23799 from taosdata/fix/TD-27423 
fix(tsdb/skip-row): remove s3 size condition
 2023-11-24 10:48:03 +08:00
dapan1121
26fe05bb30
Merge pull request #23805 from taosdata/fix/slowReport 
fix: slow down report when error occurs
 2023-11-24 09:18:27 +08:00
Minglei Jin
b1841ee97b tsdb/reader-writer: fix pgno iteration with cache setting 2023-11-24 09:06:43 +08:00
wade zhang
95b5fbbb1a
Merge pull request #23801 from taosdata/enh/PI-25-3.0 
enh: trigger vnode commit at exit if meta changed
 2023-11-24 08:59:24 +08:00
kailixu
ac47d3ea7d enh: more check for column bytes 2023-11-24 06:51:57 +08:00
kailixu
c4f1babdcf enh: naming optimize 2023-11-24 06:42:30 +08:00
kailixu
dc977ca200 fix: stash drop column 2023-11-23 23:09:49 +08:00
kailixu
9ce28483a0 fix: add check in mnode/vnode when alter table col/tag 2023-11-23 21:22:41 +08:00
wangmm0220
d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
wangmm0220
55a4181e5e fix:add O_CLOEXEC for .running lock file to prevent inherited by child processes(rsync) 2023-11-23 20:16:54 +08:00
dmchen
522c848489 clean code 2023-11-23 11:53:14 +00:00
dmchen
75810bbdbb audit 2023-11-23 11:26:14 +00:00
dmchen
682ad9dd96 msg epset 2023-11-23 10:16:18 +00:00
Haojun Liao
2e922fefc6 fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-11-23 18:04:09 +08:00
wade zhang
0e8130b195
Merge pull request #23787 from taosdata/FIX/TD-27473-3.0 
enh: skip request to restore a vnode of single replica in failed mode
 2023-11-23 17:54:08 +08:00
yihaoDeng
6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Minglei Jin
3c3763a774 tsdb/read-by-column: fix last column index 2023-11-23 17:30:49 +08:00
Minglei Jin
9334fbcb06 tsdb/read-by-column: zero hint size when i's nonzero 2023-11-23 17:14:26 +08:00
dapan1121
699c14e781 fix: slow down report when error occurs 2023-11-23 16:51:07 +08:00
kailixu
14f163a795 Merge branch '3.0' into fix/PI-23-3.0 2023-11-23 16:49:19 +08:00
Benguang Zhao
f7f9546d1e enh: trigger vnode commit at exit if meta changed, for dbs of single replica 2023-11-23 16:32:57 +08:00
Minglei Jin
3034ca2875 tsdb/open-file: log not exist file path 2023-11-23 16:25:39 +08:00
Haojun Liao
810eb8e0e3 fix(stream): fix syntax error. 2023-11-23 16:25:12 +08:00
Minglei Jin
f076bfdfca fix(tsdb/skip-row): remove s3 size condition 2023-11-23 16:19:26 +08:00
Minglei Jin
460638d294 enh(tsdb/open-file): new s3 failed to connect error code 2023-11-23 16:09:02 +08:00
Haojun Liao
de4cc2009d fix(stream): fix error. 2023-11-23 16:04:06 +08:00
dmchen
cf4b3ec49f clean code 2023-11-23 08:02:37 +00:00
Minglei Jin
c6721be112 fix stt read compilation 2023-11-23 15:49:42 +08:00
Haojun Liao
0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Minglei Jin
08e5525012 tsdb/read-file-page: new arg for hint size 2023-11-23 15:37:26 +08:00
dmchen
bbbdec5db7 update progress 2023-11-23 07:36:33 +00:00
Haojun Liao
421a154d2a
Merge pull request #23768 from taosdata/fix/fixChkpRespMemleak 
fix mem leak
 2023-11-23 15:29:30 +08:00
Minglei Jin
023821a80b enh(tsdb/read-by-column): calc hint size for preloading 2023-11-23 15:16:36 +08:00
wade zhang
45bbf89a19
Merge pull request #23786 from taosdata/FIX/TD-27456-3.0 
enh: not allow to acquire a vnode in failed mode from vmAcquireVnode
 2023-11-23 14:20:23 +08:00
kailixu
6e3a62803c fix: add check in mnd when alter table col/tag 2023-11-23 14:08:31 +08:00
yihaoDeng
6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Benguang Zhao
d35bf6186f enh: skip restoring a vnode of single replica in failed mode from vmProcessCreateVnodeReq 2023-11-23 13:16:37 +08:00
dmchen
4e1a355052 mnode for compact 2023-11-23 04:43:28 +00:00
Haojun Liao
0654b9299a fix(stream): fix memory leak. 2023-11-23 11:44:25 +08:00
Haojun Liao
8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Benguang Zhao
8d70d023b9 enh: adjust a logging msg in vmRestoreVnodeInThread 2023-11-23 10:12:58 +08:00
Benguang Zhao
917246e236 fix: allow to drop a vnode in failed mode 2023-11-23 10:09:41 +08:00
Benguang Zhao
0a4fac7704 enh: not allow to acquire a vnode in failed mode from vmAcquireVnode 2023-11-23 09:48:42 +08:00
Haojun Liao
630b259d7f fix(stream): fix error in stream. 2023-11-23 09:41:07 +08:00
Haojun Liao
ff9c0c0df4 fix(stream): fix error in check trans conflict. 2023-11-23 09:38:11 +08:00
Haojun Liao
f3355000a3 refactor: do some internal refactor. 2023-11-23 09:34:20 +08:00
Haojun Liao
6fca8c170c enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-23 09:33:44 +08:00
Haojun Liao
8204db13aa enh(stream): add sink_quota column for stream tasks. 2023-11-23 09:33:42 +08:00
Haojun Liao
3edb25a49e fix(stream): add check for assert. 2023-11-23 09:33:40 +08:00
Haojun Liao
41aa175099 fix(stream): add return. 2023-11-23 09:33:36 +08:00
Haojun Liao
7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj 
fix(stream): fix error in generating token in bucket.
 2023-11-23 09:32:14 +08:00
wangmm0220
15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Hongze Cheng
44866b7b12 fix: possible race condition coredump 2023-11-22 20:35:18 +08:00
wangmm0220
6dc91d12d5 fix:add msg type 2023-11-22 20:23:58 +08:00
wangmm0220
cfab06239b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-22 19:37:44 +08:00
Haojun Liao
a2a68ce256 fix(stream): fix memory leak. 2023-11-22 18:28:38 +08:00
Haojun Liao
d88b32e93d fix(stream): fix memory leak. 2023-11-22 18:18:43 +08:00
wangmm0220
9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao
9988720a1e fix(stream): fix the invalid check of trans conflict. 2023-11-22 16:39:29 +08:00
Haojun Liao
ebb1993900 fix(stream): fix error in check trans conflict. 2023-11-22 16:20:59 +08:00
Haojun Liao
91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao
c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
slzhou
1a7ee3643e fix: pass compilation 2023-11-22 14:09:09 +08:00
shenglian zhou
9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
Haojun Liao
9a4222e189
Merge pull request #23767 from taosdata/fix/TD-27414 
fix:test case for windows
 2023-11-22 11:02:08 +08:00
dapan1121
1b6a3c2069
Merge pull request #23771 from taosdata/enh/xsren/TD-27022/windows 
Enh/xsren/td 27022/windows
 2023-11-22 10:58:39 +08:00
yihaoDeng
0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng
0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao
b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao
3907268f40 fix(stream): register checkpoint trans. 2023-11-22 08:40:40 +08:00
Haojun Liao
d355b78884 fix(stream): fix invalid read. 2023-11-22 08:40:28 +08:00
Haojun Liao
7a0dfdb0cc fix(tsdb): fix invalid read. 2023-11-22 08:40:10 +08:00
Haojun Liao
0a2fb5fe9a refactor: do some internal refactor. 2023-11-22 08:38:39 +08:00
Haojun Liao
43e6722fd8 refactor: refactor the stream trans conflict check 2023-11-22 08:38:32 +08:00
yihaoDeng
947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
Haojun Liao
785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060 
fix: errors in snode in conditions like fill history/checkpoint/restart
 2023-11-21 19:02:38 +08:00
facetosea
845493294d osfile 2023-11-21 16:31:31 +08:00
wade zhang
c4a1398050
Merge pull request #23761 from taosdata/enh/TD-27426-3.0 
enh: create replica of the same vgroup one by one for alter db replica
 2023-11-21 15:58:58 +08:00
Haojun Liao
8c4558c5c2
Merge pull request #23763 from taosdata/fix/pause_stream 
fix(stream): fix error in generating token in bucket.
 2023-11-21 15:46:25 +08:00
yihaoDeng
a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
wangmm0220
b3ca673fe9 fix:test case for windows 2023-11-21 14:35:41 +08:00
wade zhang
4f5359f684
Merge pull request #23756 from taosdata/FIX/TD-27416-3.0 
TD-27416
 2023-11-21 12:00:18 +08:00
Haojun Liao
1077378d51 other: merge main. 2023-11-21 10:14:30 +08:00
Haojun Liao
4b3495cd4b refactor: do some internal refactor. 2023-11-21 10:11:02 +08:00
Haojun Liao
2b099b11dd refactor: do some internal refactor. 2023-11-21 10:09:59 +08:00
dapan1121
415d162358
Merge pull request #23730 from taosdata/enh/TD-26976-3.0 
enh:  grant and active codes
 2023-11-21 10:04:20 +08:00
Benguang Zhao
1343c3b274 enh: create replica of the same vgroup one by one for alter db replica 2023-11-21 09:17:34 +08:00
yihaoDeng
939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
dmchen
2d7c4890da TD-27416 2023-11-20 16:50:43 +08:00
dmchen
376f78788e TD-27416 2023-11-20 08:43:12 +00:00
Hongze Cheng
5f849320d1
Merge pull request #23751 from taosdata/fix/TD-27405 
fix(tsdb/merge): clear file set before return 0
 2023-11-20 16:10:38 +08:00
Minglei Jin
d12bc41236 tsdb/merge: clear file set before return 0 2023-11-20 14:30:25 +08:00
Haojun Liao
ec919415b8 enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 12:03:23 +08:00
Haojun Liao
56edf1b52c enh(stream): add sink_quota column for stream tasks. 2023-11-20 12:03:23 +08:00
Haojun Liao
7cfa45e95e enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 11:59:49 +08:00
Haojun Liao
3912e49309 enh(stream): add sink_quota column for stream tasks. 2023-11-20 11:46:11 +08:00
yihaoDeng
734bf07317 Merge branch '3.0' into enh/refactorBackend 2023-11-20 10:48:49 +08:00
Haojun Liao
1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream 
fix(stream): remove invalid assert
 2023-11-17 23:48:47 +08:00
Haojun Liao
709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
wangmm0220
3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00
yihaoDeng
20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
kailixu
3b62d555ab enh: code optimization for active code 2023-11-17 15:50:08 +08:00
Haojun Liao
0fac706fa6
Merge pull request #23732 from taosdata/fix/pause_stream 
fix(stream): add check for assert.
 2023-11-17 11:33:19 +08:00
Haojun Liao
2a1a7c82e2 Merge branch '3.0' into fix/3_liaohj 2023-11-17 10:17:14 +08:00
wade zhang
440a750d64
Merge pull request #23711 from taosdata/fix/TD-27336-main 
fix/TD-27336
 2023-11-17 09:00:06 +08:00
wade zhang
43a8a76719
Merge pull request #23713 from taosdata/FIX/TD-27336-3.0 
fix/TD-27336
 2023-11-17 08:59:50 +08:00
kailixu
14a2be8ed2 enh: adjust test case 2023-11-17 08:41:47 +08:00
Haojun Liao
8fe79685a2 fix(stream): add check for assert. 2023-11-16 23:45:38 +08:00
Haojun Liao
c070e79d36 fix(stream): add check for assert. 2023-11-16 23:18:07 +08:00
wangmm0220
a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
kailixu
63a17295a7 enh: support spread active codes 2023-11-16 20:09:56 +08:00
kailixu
9e12ad408e enh: support spread active codes 2023-11-16 20:01:54 +08:00
kailixu
50126e4425 enh: support spread active codes 2023-11-16 19:52:05 +08:00
Minglei Jin
65a27dd9c8 fix(tsdb/cos-merge): skip stt merging & not block commit 2023-11-16 18:58:58 +08:00
yihaoDeng
7905f22aae fix stream backend convert 2023-11-16 17:35:17 +08:00
yihaoDeng
8023f2bebd fix stream backend convert 2023-11-16 15:30:01 +08:00
dmchen
8dbb7ff2d4 copy sql before destroy 2023-11-16 10:28:11 +08:00
dmchen
1e2c9b03a1 copy sql before destroy 2023-11-16 02:22:01 +00:00
dm chen
b18aa087da Revert "create steam" 
This reverts commit cd6df48df5.
 2023-11-16 10:09:46 +08:00
dmchen
cd6df48df5 create steam 2023-11-16 01:49:31 +00:00
wade zhang
cd8f542143
Merge pull request #23696 from taosdata/fix/TD-27311 
TD-27311
 2023-11-16 08:59:27 +08:00
Haojun Liao
f45c3277c3
Merge pull request #23710 from taosdata/fix/3_liaohj 
fix(stream): check the status before pause
 2023-11-15 22:06:56 +08:00
dapan1121
dc71252096 Merge remote-tracking branch 'origin/3.0' into merge/32m 2023-11-15 19:43:19 +08:00
wade zhang
a405a981be
Merge pull request #23500 from taosdata/fix/transaction-retry-main 
fix/transaction-retry
 2023-11-15 19:19:02 +08:00
wade zhang
297fea94df
Merge pull request #23700 from taosdata/FIX/transaction-retry-3.0 
Fix/transaction retry 3.0
 2023-11-15 19:18:41 +08:00
wangmm0220
a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
dmchen
9e37fd8fc6 create stream 2023-11-15 18:48:41 +08:00
dmchen
82498a9b4e create stream 2023-11-15 10:44:53 +00:00
dmchen
54d235dad0 fix/TD-27336 2023-11-15 18:21:55 +08:00
wangmm0220
45782f278b fix:send update msg to vnodes if snode restart 2023-11-15 18:13:35 +08:00
dmchen
51abd736e0 fix/TD-27336 2023-11-15 10:13:00 +00:00
Haojun Liao
1b89d4f404 fix(stream): add return. 2023-11-15 18:06:16 +08:00
Haojun Liao
6529e56020 fix(stream): check the status before pause 2023-11-15 18:06:16 +08:00
Minglei Jin
3b7e92f7a2 enh(mnode/split): not support split with s3 2023-11-15 17:34:26 +08:00
Haojun Liao
974d0bbb48 fix(stream): add return. 2023-11-15 16:53:51 +08:00
Haojun Liao
115246c877 fix(stream): check the status before pause 2023-11-15 16:46:09 +08:00
kailixu
188a4ce6a5 enh: the latest active code take effect 2023-11-15 16:33:05 +08:00
Haojun Liao
9d2256ec9c refactor: do some internal refactor. 2023-11-15 16:03:23 +08:00
Haojun Liao
1b1ad3068d fix(stream): check node status before start pause trans. 2023-11-15 16:02:56 +08:00
Haojun Liao
f299bdb387 fix(stream): register checkpoint trans. 2023-11-15 14:29:01 +08:00
Haojun Liao
2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898 
stream event window
 2023-11-15 14:18:07 +08:00
dapan1121
9457cf0b46
Merge pull request #23702 from taosdata/merge/m23 
merge: from main to 3.0
 2023-11-15 13:54:21 +08:00
Hongze Cheng
082ddbddf6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-11-15 13:41:28 +08:00
Hongze Cheng
8050d73202 first version 2023-11-15 13:41:00 +08:00
Haojun Liao
86f2673849
Merge pull request #23703 from taosdata/fix/drop_stream 
fix(tsdb): fix invalid read.
 2023-11-15 13:35:46 +08:00
wangmm0220
8a9ded764d fix:add finish history msg to snode 2023-11-15 11:50:14 +08:00
dapan1121
dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
Haojun Liao
f1b1b8911b fix(tsdb): fix invalid read. 2023-11-15 11:26:43 +08:00
wade zhang
bef2991211
Merge pull request #23691 from taosdata/fix/TD-27303-main 
TD-27303
 2023-11-15 11:23:00 +08:00
wade zhang
d800d59bf0
Merge pull request #23693 from taosdata/FIX/TD-27303-3.0 
TD-27303
 2023-11-15 11:22:47 +08:00
Haojun Liao
51897a679f fix(stream): fix invalid read. 2023-11-15 11:21:31 +08:00
Haojun Liao
62c7877176 fix(tsdb): fix invalid read. 2023-11-15 11:13:06 +08:00
Hongze Cheng
ed6be3b8c5
Merge pull request #23695 from taosdata/fix/TD-27313 
fix(cos/list): free object array in exception
 2023-11-15 11:09:38 +08:00
dmchen
46b5f8631c partial retry 2023-11-15 10:26:01 +08:00
dmchen
85729babf8 retry in outside 2023-11-15 10:25:29 +08:00
dmchen
f93d569552 redo 2023-11-15 10:24:59 +08:00
dmchen
20e5702183 revert 2023-11-15 10:24:15 +08:00
dmchen
481c5981d6 fix/transaction-retry 2023-11-15 10:23:46 +08:00
dmchen
1e50b11374 TD-27311 2023-11-15 01:31:51 +00:00
Haojun Liao
3294395617
Merge pull request #23686 from taosdata/fix/3_liaohj 
fix(stream): send msg by using epset extract from mnode
 2023-11-14 22:11:46 +08:00
Minglei Jin
7f65e92b81 tsdb/retention: not allow migrate backward 2023-11-14 19:27:18 +08:00
dmchen
d8277d5505 TD-27303 2023-11-14 19:18:06 +08:00
dmchen
056993b519 TD-27303 2023-11-14 11:10:22 +00:00
yihaoDeng
f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
Haojun Liao
61552e30d9 fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 17:13:40 +08:00
Haojun Liao
b390ee859c fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 17:04:54 +08:00
Hongze Cheng
f7e63ad1ca
Merge pull request #23680 from taosdata/fix/TD-27273 
fix(tsdb/merge): skip merge if data file cannot be written
 2023-11-14 16:08:12 +08:00
Haojun Liao
18333d7347 fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 15:48:00 +08:00
Minglei Jin
cb3fe4d6de fix(tsdb/merge): skip merge if data file cannot be written 2023-11-14 14:15:02 +08:00
Haojun Liao
436c7871a3
Merge pull request #23673 from taosdata/fix/3_liaohj 
fix(stream): fix deadlock and do some internal refactor.
 2023-11-14 11:26:54 +08:00
wade zhang
9167a07e89
Merge pull request #23657 from taosdata/enh/TD-27210 
enh: add humanStr convert func
 2023-11-14 10:04:54 +08:00
wade zhang
2cbce6c442
Merge pull request #23578 from taosdata/FIX/TD-27171-3.0 
enh: improve user error of redistribute vgroup
 2023-11-14 10:04:33 +08:00
Haojun Liao
9f6b0d25c5 refactor: do some internal refactor. 2023-11-13 23:59:05 +08:00
Haojun Liao
f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
Haojun Liao
9a852b723d refactor: refactor the stream trans conflict check 2023-11-13 23:26:16 +08:00
Haojun Liao
cfa7c19dd5
Merge pull request #23667 from taosdata/fix/liaohj 
fix(stream): fix deadlock.
 2023-11-13 22:15:06 +08:00
wangmm0220
56381dea90 fix:conflict from 3.0 2023-11-13 18:42:59 +08:00
wangmm0220
1cbe568be7 fix:add logic when snode restart 2023-11-13 18:39:42 +08:00
Haojun Liao
aad8a2eb87 fix(stream): fix deadlock. 2023-11-13 18:20:30 +08:00
Minglei Jin
6e583de80c fix(config/block-size): remove invalid range (-1, 1024) 2023-11-13 17:46:09 +08:00
Minglei Jin
acd816a364 fix(tsdb/retention): move fset destruction out of for loop 2023-11-13 16:59:26 +08:00
Shungang Li
a96e21aabd enh: refactor dynamic config 2023-11-13 16:28:42 +08:00
Shungang Li
06c4aa431f enh: add humanStr convert func 2023-11-13 16:28:38 +08:00
liuyao
37c102a115 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-13 16:06:17 +08:00
yihaoDeng
de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
wade zhang
05d7274d98
Merge pull request #23639 from taosdata/fix/TS-4249-main 
TS-4249
 2023-11-13 10:03:18 +08:00
wade zhang
8e5de50050
Merge pull request #23641 from taosdata/FIX/TS-4249-3.0 
TS-4249
 2023-11-13 10:03:03 +08:00
wangmm0220
6a44bd54ac fix:load task in snode 2023-11-13 09:12:15 +08:00
dapan1121
a51df86e43
Merge pull request #23636 from taosdata/enh/TD-25601-3.0 
enh: support delete msg for rsma
 2023-11-13 08:47:42 +08:00
Haojun Liao
9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao
3bacd7516e fix(stream): extact stream nodes list if not initialized. 2023-11-11 15:40:35 +08:00
Haojun Liao
15430f4d50 refactor: 2023-11-11 15:40:33 +08:00
Haojun Liao
5fcef5bd89 refactor:add some logs. 2023-11-11 15:40:32 +08:00
Haojun Liao
8925c721e5 fix(stream): adjust critical section. 2023-11-11 15:40:16 +08:00
Haojun Liao
5937bdddf5 refactor:disable test. 2023-11-11 15:40:12 +08:00
Haojun Liao
cb0d244d5a fix(stream): release lock. 2023-11-11 15:40:11 +08:00
Haojun Liao
af08a189c1 fix(stream): disable concurrently restart stream tasks. 2023-11-11 15:40:10 +08:00
Haojun Liao
4d9b422874 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-11 15:40:10 +08:00
Haojun Liao
45ab92a02d fix(stream): remove invalid free. 2023-11-11 15:39:55 +08:00
Haojun Liao
77d6fd5394 refactor: do some internal refactor. 2023-11-11 15:39:09 +08:00
Haojun Liao
608c72e901 refactor(stream): create sim env for stream processing. 2023-11-11 15:39:08 +08:00
Cary Xu
1c2e9c18d5
Update tqSink.c 2023-11-10 22:01:28 +08:00
kailixu
3707857c12 chore: remove obsolete code 2023-11-10 18:43:23 +08:00
kailixu
42e4e2b7a4 fix: macro define 2023-11-10 18:27:42 +08:00
kailixu
9017e2ed68 chore: code optimization 2023-11-10 18:11:06 +08:00
kailixu
c04fb6d543 enh: logic optimization 2023-11-10 17:23:17 +08:00
kailixu
bc44659826 fix: buffer overflow 2023-11-10 17:14:57 +08:00
Haojun Liao
438c303b0d other: merge main. 2023-11-10 17:05:36 +08:00
dmchen
f69a98da9e login 2023-11-10 16:56:18 +08:00
dmchen
ae1347fe5a login 2023-11-10 08:53:29 +00:00
dmchen
7fec818194 password 2023-11-10 16:47:01 +08:00
dmchen
fc8b16a5f3 password 2023-11-10 08:43:24 +00:00
kailixu
11c0427b22 enh: test case to delete mutiple tables 2023-11-10 16:41:41 +08:00
dmchen
65870ae117 TS-4249 2023-11-10 16:29:59 +08:00
Haojun Liao
08a9244230 fix(stream): extact stream nodes list if not initialized. 2023-11-10 16:24:20 +08:00
dmchen
22d6204fa9 TS-4249 2023-11-10 08:23:09 +00:00
kailixu
d5d8568bad fix: skip delete msg affects 0 row 2023-11-10 15:30:49 +08:00
Haojun Liao
d0307e5876 refactor: 2023-11-10 15:30:21 +08:00
kailixu
b1bca4e1e2 fix: batch delete logic 2023-11-10 15:12:10 +08:00
kailixu
5fae10bc76 enh: error code when build delete req 2023-11-10 15:09:01 +08:00
kailixu
2a14a10d0d Merge branch '3.0' into enh/TD-25601-3.0 2023-11-10 14:45:45 +08:00
kailixu
674e878ffa enh: rsma support delete 2023-11-10 14:44:29 +08:00
Haojun Liao
0b36081158 refactor:add some logs. 2023-11-10 14:36:18 +08:00
wangmm0220
8a05bad899 fix:snode error 2023-11-10 14:14:22 +08:00
Haojun Liao
5824caa8f5
Merge pull request #23631 from taosdata/fix/liaohj 
multiple fix
 2023-11-10 13:09:40 +08:00
Minglei Jin
32528ab9cd fix(tsdb/reader-writer): fix pgnoEnd calc 2023-11-10 12:44:09 +08:00
wade zhang
6bea2fe36a
Merge pull request #23625 from taosdata/fix/TD-27243-main 
fix/TD-27243
 2023-11-10 11:06:00 +08:00
wade zhang
b5b15f36f2
Merge pull request #23627 from taosdata/FIX/TD-27243-3.0 
fix/TD-27243
 2023-11-10 11:05:33 +08:00
liuyao
6e9866b1ab Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 10:33:21 +08:00
Haojun Liao
233777b6ac fix(stream): adjust critical section. 2023-11-10 10:26:45 +08:00
wade zhang
bc866ed28f
Merge pull request #23623 from taosdata/FIX/TD-27230-3.0 
fix: remove vnode obj from hash at first when dropping an offline vnode
 2023-11-10 09:50:10 +08:00
Haojun Liao
d8ab8d2d03 refactor:disable test. 2023-11-10 09:46:20 +08:00
Haojun Liao
ed49294e9b fix(stream): release lock. 2023-11-10 09:35:41 +08:00
Haojun Liao
9978667c48 fix(stream): disable concurrently restart stream tasks. 2023-11-10 09:24:08 +08:00
liuyao
6d2d5823dc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 09:24:05 +08:00
yihaoDeng
3e2314b09b Merge branch '3.0' into enh/refactorBackend 2023-11-10 09:22:16 +08:00
kailixu
ee6e68a71e enh: rsma support delete 2023-11-10 07:02:46 +08:00
Haojun Liao
730434ed82 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-09 23:26:09 +08:00
kailixu
7288b0fc77 enh: rsma delete error code 2023-11-09 20:16:29 +08:00
kailixu
ff3621f382 enh: rsma delete logic 2023-11-09 20:09:39 +08:00
Hongze Cheng
ec3685db94
Merge pull request #23600 from taosdata/fix/TD-27206 
fix(vnode/cos): fix error printing to avoid buffer overflow
 2023-11-09 06:06:54 -06:00
kailixu
572eb691fb enh: support delete msg for rsma 2023-11-09 19:51:01 +08:00
Haojun Liao
e6f3d4edc7
Merge pull request #23611 from taosdata/fix/TD-27216-3 
change chkpid gen way
 2023-11-09 18:55:17 +08:00
dapan1121
4f67629ea1
Merge pull request #23621 from taosdata/fix/TS-4122 
correct colid in blockinfo
 2023-11-09 18:09:09 +08:00
dmchen
2fbf0a532d fix/TD-27243 2023-11-09 18:02:06 +08:00
yihaoDeng
757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
dmchen
65bebb0912 fix/TD-27243 2023-11-09 09:51:35 +00:00
Minglei Jin
d3cf6a4340 tsdb/file: new nlevel field for remove 2023-11-09 17:44:24 +08:00
Hongze Cheng
b1fbdfcdc9
Merge pull request #23617 from taosdata/fix/little_typo 
fix: code typo
 2023-11-09 03:35:31 -06:00
Benguang Zhao
73f1c55a47 fix: remove vnode obj from hash 2023-11-09 17:24:02 +08:00
Yihao Deng
0453991cdf
Merge branch '3.0' into fix/TD-27216-3 2023-11-09 17:12:56 +08:00
wade zhang
c0c665d785
Merge pull request #23614 from taosdata/FIX/TD-27230-3.0 
fix: close vnode in the failed mode properly in vmCloseVnode
 2023-11-09 16:32:20 +08:00
wangjiaming0909
a6600ab23a correct colid in blockinfo 2023-11-09 15:41:01 +08:00
Minglei Jin
386c25a99a tsdb/retention: remove file when ref's clear 2023-11-09 15:24:19 +08:00
kailixu
9cf154543f chore: merge 3.0 2023-11-09 15:09:30 +08:00
kailixu
aa3ba74f6e chore: code optimization 2023-11-09 15:03:14 +08:00
dapan1121
8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x 
enh: checkpoint for rsma
 2023-11-09 14:51:37 +08:00
kailixu
74cddda24b Merge branch '3.0' into enh/TD-25601-3.0 2023-11-09 14:37:13 +08:00
Hongze Cheng
e60f69a7ed fix: code typo 2023-11-09 14:20:27 +08:00
yihaoDeng
f74edc7618 Merge branch '3.0' into enh/refactorBackend 2023-11-09 06:14:08 +00:00
Minglei Jin
398771da5b Merge branch '3.0' into fix/TD-27206 2023-11-09 14:06:15 +08:00
liuyao
e56a3e8a1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-09 13:59:39 +08:00
yihaoDeng
15b73354f8 change chkpid gen way 2023-11-09 13:59:21 +08:00
yihaoDeng
ef726fee53 change chkpid gen way 2023-11-09 13:58:36 +08:00
Benguang Zhao
b80770dea8 fix: close vnode in the failed mode properly in vmCloseVnode 2023-11-09 13:05:52 +08:00
kailixu
1a950afdb8 enh: test case for rsma snapshot 2023-11-09 12:09:27 +08:00
Haojun Liao
257ab4f270
Merge pull request #23526 from taosdata/feat/TD-26060 
feat:checkpoint backup function
 2023-11-09 11:46:28 +08:00
kailixu
349e190120 enh: rsma result 2023-11-09 11:23:50 +08:00
kailixu
3495efaac7 enh: rsma exception process 2023-11-09 10:49:40 +08:00
Minglei Jin
5ac66679db config/s3blocksize: move range check from global to mnode 2023-11-09 10:17:46 +08:00
Haojun Liao
62f34c757e fix(stream): remove invalid free. 2023-11-09 10:10:37 +08:00
yihaoDeng
98a2ca6bfd change chkpid gen way 2023-11-09 10:07:24 +08:00
yihaoDeng
17ea6f39c1 change chkp gen way 2023-11-09 09:55:09 +08:00
Minglei Jin
1bb10bb862 vnode/cos: check get object block size optionally 2023-11-09 09:32:13 +08:00
yihaoDeng
06f196b71d change check out seq 2023-11-09 09:08:41 +08:00
kailixu
501d5a7acc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 20:47:15 +08:00
kailixu
72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
Minglei Jin
5ccdde4495 vnode/cos: error on incomplete fetching 2023-11-08 20:43:52 +08:00
yihaoDeng
0f98f4daa5 change check out seq 2023-11-08 20:29:37 +08:00
yihaoDeng
08e3448498 add seq 2023-11-08 19:54:57 +08:00
yihaoDeng
3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
liuyao
a8b415ed35 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 17:26:00 +08:00
Minglei Jin
128353a861 vnode/cos: fix get object handler mem 2023-11-08 16:04:24 +08:00
Minglei Jin
e5bbcf76f1 vnode/cos: fix get object block callback 2023-11-08 15:57:56 +08:00
Haojun Liao
99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
Minglei Jin
a1e692a796 fix(vnode/cos): fix error printing to avoid buffer overflow 2023-11-08 15:18:55 +08:00
wangjiaming0909
3e850df3c2 fix: last(ts2), ts2, ts caused data err 2023-11-08 14:43:11 +08:00
Minglei Jin
3f125bc6bf vnode/cos: make err msg buffer big enough for detailed msg 2023-11-08 14:30:30 +08:00
liuyao
340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
Haojun Liao
658fafd03c refactor: do some internal refactor. 2023-11-08 14:02:08 +08:00
Minglei Jin
15e1e4cd2c dnode/node_mgmt: cmake define for use_s3 2023-11-08 14:00:10 +08:00
wangjiaming0909
fc6c4fba90 feat: cache scan for select last(c), ts/c 2023-11-08 13:39:28 +08:00
Haojun Liao
809dd064a7 refactor(stream): create sim env for stream processing. 2023-11-08 11:04:16 +08:00
Minglei Jin
8bb65119a4 dnode: fix dnode s3 init 2023-11-08 10:52:23 +08:00
Haojun Liao
17bd6badec refactor(stream): do checkpoint for each task. 2023-11-08 10:47:54 +08:00
yihaoDeng
7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
kailixu
d1106c51dc enh: rsma code optimization 2023-11-08 09:54:03 +08:00
xinsheng Ren
96a3c373e0
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-08 09:28:27 +08:00
Minglei Jin
764f8d2e45 fix(vnode/s3): move init & cleanup to dnode 2023-11-08 09:03:19 +08:00
kailixu
b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu
f2d24306b1 enh: rsma tasks share one checkpoint and fix memory leak 2023-11-08 08:35:52 +08:00
Haojun Liao
666b8c531b
Merge pull request #23548 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-11-08 08:08:36 +08:00
Haojun Liao
e052d3cd62 fix(stream): check null. 2023-11-08 00:10:08 +08:00
Haojun Liao
9ba854d49d Merge branch '3.0' into fix/3_liaohj 2023-11-07 23:51:07 +08:00
Haojun Liao
7bfea5a82e fix(stream): fix syntax error. 2023-11-07 22:31:35 +08:00
kailixu
6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
wangmm0220
c0068abc9a fix:merge from 3.0 2023-11-07 18:55:46 +08:00
Haojun Liao
2674698b36 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-07 18:51:46 +08:00
yihaoDeng
95b14ee39b merge 3.0 2023-11-07 17:15:49 +08:00
Haojun Liao
1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao
8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao
7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao
e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
Haojun Liao
207b53f3f6 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:19:09 +08:00
wade zhang
4e70df5856
Merge pull request #23560 from taosdata/fix/TS-4187 
fix(cache/reader): use int64 max instead of uint
 2023-11-07 14:56:47 +08:00
kailixu
ac62714492 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-07 14:20:38 +08:00
Benguang Zhao
c851774a02 enh: improve user error of redistribute vgroup with TSDB_CODE_MND_REQ_REJECTED 2023-11-07 12:04:42 +08:00
wade zhang
9a342efd85
Merge pull request #23513 from taosdata/feat/TS-4094 
feat: add dynamic configuration
 2023-11-07 11:23:21 +08:00
Haojun Liao
4d8548e938 refactor: do some internal refactor. 2023-11-06 23:42:16 +08:00
kailixu
f5d796a081 chore: print stream state 2023-11-06 19:53:09 +08:00
Haojun Liao
d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
kailixu
dc5284a19c chore: add debug info 2023-11-06 17:27:36 +08:00
Haojun Liao
6b1889284b fix(stream): record the start failure tasks. 2023-11-06 15:45:44 +08:00
Minglei Jin
ec908fa4d0 fix(cache/reader): use int64 max instead of uint 2023-11-06 15:34:28 +08:00
wangmm0220
dffaac55ea fix:move cos from util to common 2023-11-06 14:57:32 +08:00
Minglei Jin
31ce6453c2 fix(cmake/s3): make cmake config portable 2023-11-06 14:17:27 +08:00
Haojun Liao
69863febe6 fix(stream):reset the starting flag for the followers. 2023-11-06 13:17:13 +08:00
Haojun Liao
bfd14076d7 fix(stream): fix dead-lock. 2023-11-06 12:05:47 +08:00
Haojun Liao
d41fd27189 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-06 11:57:21 +08:00
Haojun Liao
0e44950a37 enh(stream): execute scan history by using time slice 1s. 2023-11-06 09:21:33 +08:00
Haojun Liao
680eb5674e refactor: do some internal refactor. 2023-11-06 09:15:49 +08:00
kailixu
7e8c123fca chore: rsma code optimization 2023-11-06 08:46:04 +08:00
Haojun Liao
d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao
e13f003b90 refactor: do some internal refactor. 2023-11-05 01:23:23 +08:00
xinsheng Ren
da24384f0e
Merge branch '3.0' into fix/xsren/TD-22212/taosQueryParam3.0 2023-11-04 17:41:41 +08:00
kailixu
411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
yihaoDeng
f038f88c07 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-03 18:29:18 +08:00
Haojun Liao
3415ba5195
Merge pull request #23528 from taosdata/fix/liaohj 
enh(tsdb): on-demand open stt file reader.
 2023-11-03 17:29:55 +08:00
kailixu
77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
Haojun Liao
d3ddaaa9f3 other(tsdb): adjust some log info. 2023-11-03 15:08:25 +08:00
Haojun Liao
de5c4d8d5d other(tsdb): adjust some log info. 2023-11-03 15:07:40 +08:00
kailixu
c95fc014a8 enh: rsma checkpoint 2023-11-03 14:57:36 +08:00
kailixu
a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Shungang Li
c6f5e2a9bd enh: add dynamic configuration 2023-11-03 14:28:02 +08:00
Haojun Liao
34403534ed Merge branch '3.0' into fix/3_liaohj 2023-11-03 14:06:58 +08:00
liuyao
b1d1e2c778 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 14:02:59 +08:00
dm chen
dffc4d317f
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 13:57:08 +08:00
Haojun Liao
b4d14d3847 fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 13:51:18 +08:00
Haojun Liao
675c9ca613 enh(tsdb): on-demand open stt file reader. 2023-11-03 13:51:18 +08:00
dmchen
0e43b00194 partial retry 2023-11-03 04:07:18 +00:00
wangmm0220
0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
Haojun Liao
c980e2030c fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 11:04:32 +08:00
Haojun Liao
0acf4f1795 enh(tsdb): on-demand open stt file reader. 2023-11-03 10:35:05 +08:00
Hongze Cheng
1ff3f96b08
Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write 
enh(tsdb/retention): enable last tier write
 2023-11-02 21:21:38 -05:00
dm chen
0371064acc
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 10:20:54 +08:00
yihaoDeng
24e961976f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-03 09:31:57 +08:00
liuyao
31ad73f6d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 09:12:17 +08:00
Haojun Liao
ff5d69352f
Merge pull request #23493 from taosdata/fix/3_liaohj 
fix(stream): add unsupport trans.
 2023-11-03 09:07:33 +08:00
Haojun Liao
70388bafd2
Merge pull request #23523 from taosdata/fix/liaohj 
fix(stream): fix deadlock in transfer state.
 2023-11-03 09:07:23 +08:00
kailixu
d9ed63473c Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 08:37:41 +08:00
yihaoDeng
6ce878948f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 20:44:36 +08:00
kailixu
6c944bb192 enh: skip rsma_task during load stream tasks 2023-11-02 20:32:54 +08:00
wangmm0220
159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
liuyao
389117b806 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 20:07:12 +08:00
wade zhang
a3723b74ed
Merge pull request #23497 from taosdata/FIX/audit-db-resource-3.0 
db and resource
 2023-11-02 19:33:40 +08:00
wade zhang
dc581a83a1
Merge pull request #23495 from taosdata/fix/audit-db-resource-main 
db and resource
 2023-11-02 19:33:25 +08:00
Haojun Liao
b3d57e4a2d fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:31:35 +08:00
Haojun Liao
7a32b3a209 fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:12:36 +08:00
kailixu
fa5d896787 enh: rsma checkpoint 2023-11-02 18:56:36 +08:00
Haojun Liao
c4079332ff fix(stream):update the log level. 2023-11-02 18:18:04 +08:00
Haojun Liao
0a227e807f refactor: set different tq level. 2023-11-02 18:18:04 +08:00
Haojun Liao
48aff868b6 fix(stream):update the log level. 2023-11-02 18:16:47 +08:00
Hongze Cheng
4cf97ef6ae
Merge pull request #23520 from taosdata/fix/TD-27057 
fix: invalid read when file is deleted
 2023-11-02 04:49:49 -05:00
liuyao
f6ff356b81 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 17:45:50 +08:00
Haojun Liao
3aed8c29ae refactor: set different tq level. 2023-11-02 17:12:20 +08:00
Hongze Cheng
faea18c38f fix: invalid read when file is deleted 2023-11-02 16:59:11 +08:00
dmchen
abda605300 retry in outside 2023-11-02 08:20:03 +00:00
dmchen
55a5c3dd54 redo 2023-11-02 07:31:41 +00:00
kailixu
2d597659bc enh: rsma checkpoint 2023-11-02 15:20:54 +08:00
liuyao
330b04a8bc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 14:36:13 +08:00
dapan1121
e0f49f8000 fix: remove user table/view privilege issue 2023-11-02 14:14:26 +08:00
Haojun Liao
f5fa3edeba
Merge pull request #23503 from taosdata/fix/liaohj 
fix(stream): fix dead lock.
 2023-11-02 13:52:50 +08:00
dmchen
88da6e0879 revert 2023-11-02 05:42:17 +00:00
kailixu
722777f8c9 enh: rsma checkpoint 2023-11-02 13:15:31 +08:00
kailixu
96b5024347 enh: rsma checkpoint 2023-11-02 13:05:36 +08:00
kailixu
698fb804f9 enh: disable update tbUidList during reboot 2023-11-02 12:54:23 +08:00
kailixu
76536e1c82 enh: rsma logic 2023-11-02 11:03:18 +08:00
Haojun Liao
95efa07e92 fix(stream): add full unsupported event filtering. 2023-11-02 11:02:39 +08:00
Minglei Jin
46d3be1f08 config/page-cache-size: new parameter for pcache size 2023-11-02 10:10:03 +08:00
kailixu
9649e87cab fix: rsma checkpoint 2023-11-02 09:44:43 +08:00
Haojun Liao
351a31302f fix(stream): add full unsupported event filtering. 2023-11-02 09:43:48 +08:00
Minglei Jin
d0327e07b8 tsdb/pg-cache: use pgno for cache key instead of blkno 2023-11-02 09:42:19 +08:00
Hongze Cheng
a6ee7c4685 fix: possible coredump 2023-11-01 20:34:47 +08:00
kailixu
3803f952f9 chore: rsma checkpoint verify 2023-11-01 20:05:00 +08:00
Haojun Liao
7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao
00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao
9a9c1d689d fix(stream): add lock log. 2023-11-01 19:38:12 +08:00
Minglei Jin
52fd71ce13 config/block-size: default to -1 to enable page cache 2023-11-01 18:00:31 +08:00
yihaoDeng
1e96edcdd7 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 17:30:46 +08:00
Haojun Liao
246ed4e022 refactor: do some internal refactor. 2023-11-01 17:19:21 +08:00
dmchen
41749b7c52 fix/transaction-retry 2023-11-01 09:03:13 +00:00
liuyao
505c44d9aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-01 16:50:46 +08:00
dm chen
14eb345c8c
Update mndUser.c 2023-11-01 16:37:45 +08:00
kailixu
c32e60d199 chore: more code for rsma checkpoint 2023-11-01 16:27:41 +08:00
Haojun Liao
12bc4f32cf refactor: add some logs. 2023-11-01 16:12:15 +08:00
yihaoDeng
4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
kailixu
59be62c96e chore: set stream input checkpoint 2023-11-01 15:34:17 +08:00
Haojun Liao
034546a490
Merge pull request #23445 from taosdata/fix/TD-26685-new 
fix:print log if assert & check epoch when update epoch
 2023-11-01 15:32:40 +08:00
Haojun Liao
f76417535c
Merge pull request #23451 from taosdata/fix/TD-26685-3.0 
fix:print log if assert & check epoch when update epoch
 2023-11-01 15:32:25 +08:00
dmchen
0ab4e809c5 db and resource 2023-11-01 15:12:45 +08:00
Minglei Jin
f10d1ebdc5 Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 15:06:22 +08:00
dmchen
bbfecb7383 db and resource 2023-11-01 07:04:20 +00:00
Minglei Jin
6f0fa5d47e tsdb/retention: remove incorrect right brace 2023-11-01 14:56:57 +08:00
Haojun Liao
5ff89bc098 fix(stream): add lock log. 2023-11-01 13:19:53 +08:00
kailixu
ab266c712f chore: checkpoint for rsma stream state 2023-11-01 12:29:54 +08:00
Haojun Liao
0cf0ff3bbf
Merge pull request #23455 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-11-01 12:01:54 +08:00
Haojun Liao
3e6c89d8eb fix(stream): add unsupport trans. 2023-11-01 11:43:02 +08:00
Minglei Jin
0f5a124cb1 config/block-size: enable dynamic config for debugging 2023-11-01 11:08:39 +08:00
Minglei Jin
221afff9ee vnode/write: remove keep modify code block 2023-11-01 11:00:47 +08:00
Minglei Jin
64644d673b
Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 10:53:55 +08:00
Minglei Jin
a61502411d tsdb/pg-cache: new page cache for tsdb s3 read file page 2023-11-01 10:49:05 +08:00
dapan1121
6305353290 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-11-01 10:38:50 +08:00
kailixu
1530fe0c49 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-01 09:52:16 +08:00
kailixu
ad1e6accd4 chore: build checkpoint for rsma 2023-11-01 09:45:58 +08:00
Haojun Liao
7359f98eca
Merge pull request #23428 from taosdata/fix/3_liaohj 
other: merge refactor into 3.0
 2023-11-01 09:44:31 +08:00
yihaoDeng
6cab686e82 fix mem leak 2023-11-01 09:37:54 +08:00
Haojun Liao
639d5cde47 fix(stream): add unsupport trans. 2023-10-31 23:14:02 +08:00
yihaoDeng
bb8252df16 fix mem leak 2023-10-31 20:59:24 +08:00
kailixu
e6684fa5de enh: rsma retetion and stream state 2023-10-31 20:26:42 +08:00
wade zhang
b7ea04bdf4
Merge pull request #23475 from taosdata/enh/TD-26910 
enh: new errcode TSDB_CODE_MND_NO_ENOUGH_VNODES
 2023-10-31 20:05:34 +08:00
Shungang Li
c98228eff9 enh: new errcode TSDB_CODE_MND_NO_ENOUGH_VNODES 2023-10-31 20:03:52 +08:00
dapan1121
91df56fcf0 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-31 18:44:54 +08:00
dapan1121
d40cc27abc
Merge pull request #23464 from taosdata/enh/TD-26638-3.0 
enh: use placeholder '-' for interval of 1st retention level
 2023-10-31 18:36:43 +08:00
Haojun Liao
a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao
0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
Haojun Liao
4c0242a58d fix(stream): fix error in finishing event handling. 2023-10-31 16:39:14 +08:00
liuyao
696294c208 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-31 15:41:04 +08:00
wangmm0220
17a58697fa fix:print log if assert & check epoch when update epoch 2023-10-31 15:37:59 +08:00
wangmm0220
fc228d65f2 fix:print log if assert & check epoch when update epoch 2023-10-31 15:36:40 +08:00
wade zhang
76c9b9afc5
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0 
feat: support pipelining of snap replication
 2023-10-31 15:19:07 +08:00
wade zhang
25b09b467f
Merge pull request #23439 from taosdata/feat/TD-26971-3.0 
TD-26971
 2023-10-31 13:53:49 +08:00
wade zhang
9cea0e60de
Merge pull request #23437 from taosdata/feat/TD-26971-main 
TD-26971
 2023-10-31 13:53:32 +08:00
Haojun Liao
0ca85a4c03
Merge pull request #23424 from taosdata/refact/streamsm 
refactor: do some internal refactor.
 2023-10-31 12:48:22 +08:00
kailixu
28cd8f4915 enh: file duration for rsma 2023-10-31 11:38:33 +08:00
Hongze Cheng
ac3df85d8a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684 2023-10-31 11:23:23 +08:00
Haojun Liao
fc70fa053c fix(tsdb): fix syntax error. 2023-10-31 10:45:14 +08:00
Haojun Liao
6a7ba0f5f5 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 10:45:14 +08:00
Haojun Liao
00626de6e4 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-31 10:45:13 +08:00
Haojun Liao
cb43299faa fix(tsdb): avoid to read duplicated rows in buf. 2023-10-31 10:45:13 +08:00
Haojun Liao
635243f01a refactor: do some internal refactor. 2023-10-31 10:45:12 +08:00
Haojun Liao
6e2240a3d1 fix(stream): fix the deadlock. 2023-10-31 10:45:12 +08:00
Haojun Liao
0c982093cd fix(stream): enable the set of fill-history task to be un-init. 2023-10-31 10:45:12 +08:00
Haojun Liao
8b9bc988f1 fix(tsdb): fix syntax error. 2023-10-31 10:42:34 +08:00
Haojun Liao
eaf76854f6 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 09:29:24 +08:00
dmchen
ffb1e1e8c3 end point 2023-10-30 12:05:20 +00:00
kailixu
b03baaed2c chore: revert the code change 2023-10-30 19:49:50 +08:00
kailixu
89651626e3 chore: reopen rsma stream commit 2023-10-30 19:45:18 +08:00
dmchen
fe044051c8 memory leak 2023-10-30 19:36:27 +08:00
dmchen
5120d25297 memory leak 2023-10-30 11:34:34 +00:00
Minglei Jin
867ce92dcc tsdb/file-rw: fix log msg 2023-10-30 19:28:18 +08:00
kailixu
4a5b4b51e2 chore: remove obsolete codes 2023-10-30 17:51:42 +08:00
Minglei Jin
800cbfbb05 tsdb/file: new s3flag in mem 2023-10-30 17:36:49 +08:00
Haojun Liao
6e118c7963 fix(stream): fix memory leak. 2023-10-30 17:28:57 +08:00
dmchen
0f40e1dbb9 memory leak 2023-10-30 16:59:12 +08:00
dmchen
40c9622df5 memory leak 2023-10-30 08:57:07 +00:00
Haojun Liao
ed07486405 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-30 16:40:09 +08:00
Haojun Liao
bc1c2a879a fix(tsdb): avoid to read duplicated rows in buf. 2023-10-30 16:12:08 +08:00
dmchen
be0a85a0ff memory leak 2023-10-30 15:22:54 +08:00
Minglei Jin
84d2f9c379 tsdb/upload: delay data file uploading 2023-10-30 15:22:34 +08:00
dmchen
6172b820ac memory leak 2023-10-30 07:19:08 +00:00
Haojun Liao
fdf3f210ac refactor: do some internal refactor. 2023-10-30 14:39:24 +08:00
Haojun Liao
3275452bce fix(stream): fix the deadlock. 2023-10-30 14:38:51 +08:00
kailixu
c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
Haojun Liao
15d217fc3e fix(stream): fix memory leak. 2023-10-30 13:29:35 +08:00
Haojun Liao
b0700d6095 Merge branch '3.0' into fix/3_liaohj 2023-10-30 11:57:54 +08:00
Haojun Liao
93232a0e14 fix(stream): enable the set of fill-history task to be un-init. 2023-10-30 11:48:51 +08:00
liuyao
1a37f19c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 11:43:23 +08:00
dapan1121
6f0b634f95 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 10:24:16 +08:00
dapan1121
53e9c483c9
Merge pull request #23422 from taosdata/enh/TD-25879-3.0x 
enh: dmodule API dependence and grant process
 2023-10-30 10:13:28 +08:00
dapan1121
1b7a6bccdf
Merge pull request #23430 from taosdata/enh/TD-26641-3.0 
enh: only float/double allowed for sum/avg of rsma
 2023-10-30 10:08:55 +08:00
Minglei Jin
4fede02da4 tsdb/retention: remove s3 evict cache hook 2023-10-30 10:06:42 +08:00
Haojun Liao
1bbad532a7 fix(stream): add more check. 2023-10-30 09:32:40 +08:00
Haojun Liao
91121974d7 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-30 09:32:40 +08:00
Haojun Liao
48202a1e45 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
Haojun Liao
1a1b9f5ea3 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
dapan1121
972e10a238 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 08:45:29 +08:00
Haojun Liao
790d869494 fix(stream): add more check. 2023-10-29 22:57:33 +08:00
kailixu
22d6b95585 enh: dm init API 2023-10-29 21:13:18 +08:00
Haojun Liao
da6e3cb293 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-29 17:37:10 +08:00
Haojun Liao
1e696287d8 fix(stream): set the trans exec sequentially. 2023-10-29 02:45:47 +08:00
kailixu
3f65773222 enh: send grant to dnodes online and in async mode 2023-10-29 02:18:47 +08:00
Haojun Liao
3bf3d00d90 fix(stream): set the trans exec sequentially. 2023-10-27 23:45:50 +08:00
Haojun Liao
c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao
4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
Hongze Cheng
a7f3041ff3 more fix 2023-10-27 17:59:27 +08:00
Benguang Zhao
4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
Hongze Cheng
cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
dmchen
43e6dec6c2 TD-26971 2023-10-27 17:39:50 +08:00
dmchen
34c4ffde26 TD-26971 2023-10-27 09:30:30 +00:00
Minglei Jin
8c6f452f09 tsdb/write: make last tier writable to mem 2023-10-27 15:51:52 +08:00
kailixu
dc8cb7a99e fix: memory leak 2023-10-27 14:36:01 +08:00
Haojun Liao
dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
Haojun Liao
29b3a7a5e9 refactor: do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao
38eb5d2f89 refactor(stream): do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao
b4992a8506 other: add some logs. 2023-10-27 09:59:52 +08:00
Haojun Liao
9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
Haojun Liao
fa670a93f3 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-27 09:59:52 +08:00
Haojun Liao
454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao
33dc51cc86 fix(stream): add some logs. 2023-10-27 09:59:44 +08:00
Haojun Liao
1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao
2493c21ed3 fix(stream): fix the invalid write in sma 2023-10-27 09:58:52 +08:00
Haojun Liao
7cce53f7e5 fix(stream): ignore the check status when is ready. 2023-10-27 09:58:52 +08:00
Haojun Liao
c99f434706 fix(stream): set checkpoint failure when in pause status. 2023-10-27 09:58:52 +08:00
Haojun Liao
2c1af8dad8 refactor: do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao
1ad2c3029a refactor(stream): do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao
7311f9d2fe fix(sma): fix bugs in sma and do some internal refactor. 2023-10-27 09:58:51 +08:00
Haojun Liao
3bcffcf1da other: merge stream refactor from main. 2023-10-27 09:56:02 +08:00
Haojun Liao
47d4bac57a fix(stream): remove invalid assert. 2023-10-27 09:55:07 +08:00
Haojun Liao
4845474ea4 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao
5313543a9e refactor: do some internal refactor. 2023-10-27 09:55:05 +08:00
Haojun Liao
48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao
226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao
091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao
e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao
8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao
1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao
579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao
6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao
596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao
4badb445c4 refactor: do some internal refactor W.R.T. global configurations. 2023-10-27 09:54:07 +08:00
Haojun Liao
62c58ecd8b fix(stream):add more check for test cases. 2023-10-27 09:54:06 +08:00
Haojun Liao
a4f6042966 fix(stream): fix error in creating update node trans. 2023-10-27 09:52:14 +08:00
Haojun Liao
ffa798c4fa enh(stream): add some logs. 2023-10-27 09:52:14 +08:00
Haojun Liao
f549ce3578 refactor: do some internal refactor. 2023-10-27 09:49:16 +08:00
kailixu
9ae83455e2 chore: code format 2023-10-27 09:48:13 +08:00
liuyao
cf3bfe9310 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-27 09:39:00 +08:00
dmchen
ca5e252c0c atomic init 2023-10-27 01:20:33 +00:00
dmchen
21dd6f70a9 atomic init 2023-10-27 01:16:53 +00:00
kailixu
96de7b0cf0 chore: update grant/dnode mgmt 2023-10-27 00:02:25 +08:00
facetosea
759a5d4bbf fix ctest 2023-10-26 21:06:08 +08:00
Hongze Cheng
b8c379a20d
Merge pull request #23413 from taosdata/fix/TD-26669 
fix(tsdb/commmit): make ts big enough to skip row
 2023-10-26 07:17:53 -05:00
dmchen
9af7b7b178 init error 2023-10-26 11:50:34 +00:00
wade zhang
d1e4e909c3
Merge pull request #23384 from taosdata/fix/TD-26884-3.0 
Fix/td 26884 3.0
 2023-10-26 17:00:00 +08:00
wade zhang
951442e3db
Merge pull request #23381 from taosdata/fix/TD-26884-main 
TD-26884
 2023-10-26 16:59:39 +08:00
Minglei Jin
b314758108 tsdb/commit: make ts big enough to skip row 2023-10-26 16:24:06 +08:00
yihaoDeng
4c03d372ef fix stream case error 2023-10-26 14:19:34 +08:00
kailixu
bb77015998 Merge branch '3.0' into enh/TD-26641-3.0 2023-10-26 10:40:54 +08:00
Hongze Cheng
209ebbde84
Merge pull request #23402 from taosdata/fix/TD-26189-libs3 
cmake/xml2: use sha256 to verify distribution release
 2023-10-25 20:27:29 -05:00
kailixu
64765579e9 enh: check interval and keep for retentions 2023-10-25 22:42:01 +08:00
yihaoDeng
db0f6258fe fix stream case error 2023-10-25 19:38:22 +08:00
Haojun Liao
c95cd8da8b refactor(stream): do some internal refactor. 2023-10-25 18:14:28 +08:00
liuyao
f51c985914 stream event window 2023-10-25 17:50:16 +08:00
Minglei Jin
d77ecbbb1b cmake/xml2: use sha256 to verify distribution release 2023-10-25 17:41:55 +08:00
dmchen
14be9c81e2 create table user and clusterid 2023-10-25 14:53:06 +08:00
Haojun Liao
9220731313 other: add some logs. 2023-10-25 14:51:59 +08:00
dmchen
7ef019d105 create table user and clusterid 2023-10-25 06:49:23 +00:00
Haojun Liao
f36b24ed24 fix(stream): disable follower nodes exec reset. 2023-10-25 14:16:36 +08:00
Haojun Liao
07e9d56e07 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-25 11:42:46 +08:00
Hongze Cheng
3ff331b8b7
Merge pull request #23391 from taosdata/fix/TD-26189-libs3 
cmake: new option: BUILD_S3
 2023-10-24 22:37:20 -05:00
Haojun Liao
03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
dapan1121
533711a7f2
Merge pull request #23387 from taosdata/fix/3.0/TS-4090 
fix: disable life extending of conn cache obj when show queries/conns
 2023-10-25 09:48:13 +08:00
dapan1121
ba43950bc6
Merge pull request #23294 from taosdata/fix/TD-26474-3.0 
fix: add lock for trans
 2023-10-25 08:46:19 +08:00
Haojun Liao
26aaa4a83c other: merge main. 2023-10-25 00:39:14 +08:00
Haojun Liao
13d979a2ee fix(stream): add some logs. 2023-10-25 00:03:46 +08:00
dmchen
8e007f199b format 2023-10-24 11:31:50 +00:00
Haojun Liao
8cde39eebd fix(stream): fix dead lock when shutdown all tasks. 2023-10-24 19:11:24 +08:00
dmchen
4c401c39fb atomic 2023-10-24 09:52:34 +00:00
Minglei Jin
f9ca8fe962 cmake: new option: BUILD_S3 2023-10-24 16:10:46 +08:00
Haojun Liao
f1498f8929 fix(stream): fix the invalid write in sma 2023-10-24 15:24:34 +08:00
dmchen
ff46bdb17a ci memory leak test 2023-10-24 06:51:00 +00:00
dmchen
162066235b create table 2023-10-24 14:31:27 +08:00
dmchen
956aa1742c TD-26884 2023-10-24 14:31:02 +08:00
Hongze Cheng
e7e7748e6d
Merge pull request #23366 from taosdata/fix/TD-26669 
tsdb/commit: skip last tier ts data committing
 2023-10-24 01:29:01 -05:00
dmchen
ae728ab412 create table 2023-10-24 06:17:13 +00:00
wangjiaming0909
be7791f9cd fix: disable life extending of conn cache obj when show queries/conns 2023-10-24 13:58:30 +08:00
yihaoDeng
95b0d4f083 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-24 13:40:47 +08:00
dmchen
ecd5f1084c TD-26884 2023-10-24 05:32:48 +00:00
dmchen
b82cd97b80 memory leak and enable 2023-10-24 04:10:56 +00:00
yihaoDeng
d46cf878eb refactor stream backend 2023-10-24 11:53:52 +08:00
Haojun Liao
a6e706ba2d fix(stream): ignore the check status when is ready. 2023-10-24 11:38:14 +08:00
dapan1121
dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
Haojun Liao
e92b276e3e fix(stream): set checkpoint failure when in pause status. 2023-10-24 10:14:29 +08:00
Minglei Jin
e826532592 cmake/vnode: specify no default path for ssl & crypto 2023-10-24 10:10:43 +08:00
Haojun Liao
0dae8c3c76 refactor: do some internal refactor. 2023-10-24 09:49:14 +08:00
Haojun Liao
f446ff1c36 refactor(stream): do some internal refactor. 2023-10-24 09:48:10 +08:00
Haojun Liao
7a8b046a35 fix(sma): fix bugs in sma and do some internal refactor. 2023-10-24 09:40:38 +08:00
Minglei Jin
7fdf6cc696 cmake: use new dir for libs3 2023-10-24 09:04:24 +08:00
dmchen
43cd604911 remove reference 2023-10-23 11:19:53 +00:00
yihaoDeng
986a502019 refactor stream backend 2023-10-23 18:22:58 +08:00
dmchen
dec257ff59 TD-26529 2023-10-23 08:59:54 +00:00
yihaoDeng
ca1ffd584d refactor stream backend 2023-10-23 16:45:17 +08:00
Minglei Jin
80fb38f172 Merge branch '3.0' into fix/TD-26189-libs3 2023-10-23 16:31:21 +08:00
Minglei Jin
f630fc38f8 tsdb/commit: skip last tier ts data committing 2023-10-23 15:46:32 +08:00
yihaoDeng
9d210ec957 refactor stream backend 2023-10-23 14:06:25 +08:00
Haojun Liao
2ee3319611
Merge pull request #23360 from taosdata/fix/liaohj 
fix(tsdb): apply the window range when building blocks from stt files.
 2023-10-23 12:45:42 +08:00
dapan1121
ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
Haojun Liao
a882c639be fix(stream): remove invalid assert. 2023-10-22 16:16:59 +08:00
Haojun Liao
825195b351 refactor: do some internal refactor. 2023-10-21 16:38:46 +08:00
Haojun Liao
74572dd6a7 refactor: do some internal refactor. 2023-10-21 15:21:02 +08:00
Haojun Liao
6dc8fc50bc
Merge pull request #23359 from taosdata/fix/3_liaohj 
fix(tsdb): apply the window range when building blocks from stt files.
 2023-10-21 14:57:14 +08:00
Haojun Liao
49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
Haojun Liao
f667bf3866 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:19:45 +08:00
Haojun Liao
f1207d8d42 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:18:58 +08:00
Haojun Liao
c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
Haojun Liao
024bfa0fff
Merge pull request #23353 from taosdata/changeGenFirstTagName_3.0 
gen first tag name
 2023-10-20 15:38:32 +08:00
yihaoDeng
1a4cfd11a5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:28:10 +08:00
Minglei Jin
55647f9ce9 cos/put: make chunk small to not block other reqs 2023-10-20 15:15:03 +08:00
Haojun Liao
3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
yihaoDeng
1bc7e5eb85 enh gen first tag name 2023-10-20 14:02:13 +08:00
Minglei Jin
74d05c2771 vnode/cos: fix multipart uploading 2023-10-20 13:47:25 +08:00
yihaoDeng
e13fb887b8 enh gen first tag name 2023-10-20 10:47:27 +08:00
yihaoDeng
e89d1851c8 enh gen first tag name 2023-10-20 10:47:02 +08:00
yihaoDeng
6f21d542cd enh gen first tag name 2023-10-20 10:46:17 +08:00
yihaoDeng
f9a027bc7d enh gen first tag name 2023-10-20 10:45:57 +08:00
yihaoDeng
c0c6e206d2 enh gen first tag name 2023-10-20 10:44:33 +08:00
yihaoDeng
08fc4814cb enh gen first tag name 2023-10-20 10:43:44 +08:00
Haojun Liao
270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Haojun Liao
9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend 
Opt/add status send
 2023-10-20 09:52:12 +08:00
yihaoDeng
9f6dd2b405 change gen first tag name 2023-10-20 09:42:11 +08:00
yihaoDeng
8fbea08bba enh gen first tag name 2023-10-20 09:37:43 +08:00
dapan1121
42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121
969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
Benguang Zhao
959f8105ee enh: require command to trigger repairing vnodes on replaced disks 2023-10-19 18:55:12 +08:00
Haojun Liao
d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao
c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
yihaoDeng
67dc52d2d6 refactor stream checkpoint 2023-10-19 15:19:52 +08:00
Haojun Liao
402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
yihaoDeng
0188289308 statusClientRpc 2023-10-19 14:07:54 +08:00
yihaoDeng
b4b742b3fb add rpc sync read timeout 2023-10-19 11:35:29 +08:00
yihaoDeng
27b2d37bde add rpc sync read timeout 2023-10-19 11:27:31 +08:00
Benguang Zhao
a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao
a515f8a94f feat: use vnode config info if existing during vnodeCreate 2023-10-19 11:18:57 +08:00
Benguang Zhao
a95f6e6862 feat: support restore dnode with vnodes of replaced disks for primary dirs 2023-10-19 11:18:57 +08:00
Benguang Zhao
c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Benguang Zhao
5c85525fd0 enh: add tsdbFSCreateRefSnapshotWithoutLock 2023-10-19 11:18:57 +08:00
Benguang Zhao
f2bd43c07e fix: set field length properly in tsdbGetSnapDetails 2023-10-19 11:18:57 +08:00
Benguang Zhao
83013e0fe5 enh: return error in case of out of memory for tsdbGetSnapRangeHash 2023-10-19 11:18:57 +08:00
Benguang Zhao
59e8a2104c refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
eb8c4d3e8c enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
4e74533878 enh: avoid _Static_assert 2023-10-19 11:18:57 +08:00
Benguang Zhao
094cf408df enh: prepare vnode dir again in vnodeOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
c1f1709d59 fix: add rsmaSnapWriterPrepareClose 2023-10-19 11:18:57 +08:00
Benguang Zhao
74185b8b9c feat: exchange snapshot info for rsma tsdbs 2023-10-19 11:18:57 +08:00
Benguang Zhao
d5d713b1b4 enh: fill snapshot info for rsma tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao
b80f8201ce feat: detect fs incompleteness of RSMA tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao
29bbebc323 enh: refactor a func name as tsdbSnapGetDetails 2023-10-19 11:04:39 +08:00
Benguang Zhao
00aeb031d4 enh: replicate a fset if it is corrupted without valid minVer 2023-10-19 11:04:39 +08:00
Benguang Zhao
a6d5deb5d1 fixup: fix tsdbFSDoSanAndFix 2023-10-19 11:04:39 +08:00
Benguang Zhao
eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao
0c41fa56dc feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot 2023-10-19 11:00:44 +08:00
Benguang Zhao
e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao
410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao
f99795d027 enh: use tsdbSnapRangeArrayDestroy 2023-10-19 10:51:13 +08:00
Benguang Zhao
c1b2eedd3c feat: impl tsdbSnapGetInfo 2023-10-19 10:51:08 +08:00
yihaoDeng
b9b62a9a00 add rpc sync read timeout 2023-10-19 10:38:45 +08:00
Benguang Zhao
4d55488495 feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen 2023-10-19 10:37:34 +08:00
Benguang Zhao
083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Benguang Zhao
b23bcee690 fixup: about to revert this commit 2023-10-19 10:37:34 +08:00
Benguang Zhao
0ddbcd50d0 enh: maintain independent version range of tombs for SDataFileWriter 2023-10-19 10:37:34 +08:00
Benguang Zhao
4540bcb170 fixup: work-around a compiler bug 2023-10-19 10:37:34 +08:00
Benguang Zhao
44a7f5df47 feat: add tsdbSnapDiff 2023-10-19 10:37:34 +08:00
Benguang Zhao
6ae9bd0e9a feat: add tsdbFSToSnapRangeArray 2023-10-19 10:37:34 +08:00
Benguang Zhao
0a67cc8477 refact: use tsdbTFileUpdVerRange in tsdbSttFWriterCloseCommit 2023-10-19 10:37:34 +08:00
Benguang Zhao
54a10154a4 fixup: remove unused minVer and maxVer in ctx of SCommitter2 2023-10-19 10:37:34 +08:00
Benguang Zhao
6b753cc0cd refact: remove unused code is_same_file 2023-10-19 10:37:34 +08:00
Benguang Zhao
dc402e21e3 fix: merge old version range of head and tomb files in tsdbDataFileWriterCloseCommit 2023-10-19 10:37:34 +08:00
Benguang Zhao
f8c6e8744a refact: change field name of pExclude in SVSnapReader 2023-10-19 10:37:34 +08:00
Benguang Zhao
01d0c1247d enh: record ver range in writer ctx 2023-10-19 10:37:34 +08:00
Benguang Zhao
f207b3ddd5 refact: rename func names of tsdbDataWriterUpdVerRange and tsdbSttWriterUpdVerRange 2023-10-19 10:37:34 +08:00
Benguang Zhao
399afe1094 refact: tidy up declarations of funcs in tsdbUpgrade.c 2023-10-19 10:37:25 +08:00
Haojun Liao
f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
Benguang Zhao
ed6d7c4c4d refact: relocate declarations and defs of tsdbFileWriteTombBlock and tsdbFileWriteTombBlk 2023-10-19 10:17:34 +08:00
Benguang Zhao
823aad4a5e enh: record version range of STFile for data and stt files 2023-10-19 10:17:34 +08:00
Benguang Zhao
3cd458f5c9 enh: fill minVer and maxVer of nf in STFileObj during migration 2023-10-19 10:17:34 +08:00
Benguang Zhao
1446b44733 fixup: remove minVer and maxVer in FSetWriterConfig 2023-10-19 10:17:34 +08:00
Benguang Zhao
c8a46394f1 enh: set default values of minVer and maxVer while upgrading from CURRENT 2023-10-19 10:17:34 +08:00
Benguang Zhao
ab7a20c117 enh: write stt and data files with minVer and maxVer 2023-10-19 10:17:34 +08:00
Benguang Zhao
da28d490aa enh: filterByVersion with snap ranges 2023-10-19 10:17:34 +08:00
Benguang Zhao
7a13e4b2cf enh: add minVer and maxVer for entries in current.json 2023-10-19 10:17:34 +08:00
Benguang Zhao
1be2835fc1 enh: exclude a list of snap ranges in tsdbSnapReaderOpen 2023-10-19 10:17:34 +08:00
Benguang Zhao
573c28fd06 enh: iterate over a list of snap ranges for STsdbSnapReader 2023-10-19 10:17:28 +08:00
dapan1121
afe963a9d1 enh: support view privilege 2023-10-19 08:31:31 +08:00
Minglei Jin
52c8bc91f9 cos/delete: fix delete object cond and double free 2023-10-18 18:21:45 +08:00
Shungang Li
5b69b584c3 enh: add log for deploy mnode 2023-10-18 16:58:58 +08:00
yihaoDeng
ef27c87756 opt status send 2023-10-18 16:37:34 +08:00
yihaoDeng
e62f3fa86a opt status send 2023-10-18 16:03:55 +08:00
Haojun Liao
54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
Minglei Jin
f26ec41b8e vnode/cos: fix get callback buffer 2023-10-18 15:30:02 +08:00
Haojun Liao
c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056 
feat:add replay logic
 2023-10-18 11:43:43 +08:00
yihaoDeng
e49b9b2276 fix transfer crash 2023-10-18 11:34:11 +08:00
Haojun Liao
df07443379
Merge pull request #23288 from taosdata/fix/liaohj 
fix(stream):add more check for test cases.
 2023-10-18 08:13:15 +08:00
yihaoDeng
d67fdb5e46 fix transfer crash 2023-10-17 21:08:31 +08:00
yihaoDeng
2004c1a346 fix transfer crash 2023-10-17 18:19:52 +08:00
Minglei Jin
11b65e2779 vnode/cos: make dependent lib public 2023-10-17 18:11:13 +08:00
Minglei Jin
dd21d8e3ad cos/multipart: first round multipart uploading 2023-10-17 17:24:50 +08:00
Minglei Jin
8fa8c40391 cos/put: simple object putting(< 5 gigabytes) 2023-10-17 14:59:03 +08:00
kailixu
29c6daaff5 fix: trans mutex init 2023-10-17 11:12:52 +08:00
kailixu
a30eedafec fix: trans mutex init 2023-10-17 11:06:06 +08:00
Haojun Liao
531f478ade refactor: do some internal refactor W.R.T. global configurations. 2023-10-17 08:17:49 +08:00
yihaoDeng
b793c92fed fix stream snap deadlock 2023-10-16 22:00:34 +08:00
kailixu
38c1f7d48d fix: add lock for trans 2023-10-16 20:20:04 +08:00
yihaoDeng
b133418d88 fix stream snap deadlock 2023-10-16 20:03:44 +08:00
dapan1121
cdda43cd67 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-16 19:54:21 +08:00
yihaoDeng
f1186be19a fix stream snap deadlock 2023-10-16 19:38:55 +08:00
yihaoDeng
0adefd5e59 fix stream snap deadlock 2023-10-16 19:26:33 +08:00
yihaoDeng
f5ea3649c5 fix stream snap deadlock 2023-10-16 19:26:08 +08:00
yihaoDeng
0a84d7a8b3 fix stream snap deadlock 2023-10-16 19:20:48 +08:00
yihaoDeng
252b90bfab fix stream snap deadlock 2023-10-16 19:20:09 +08:00
Haojun Liao
a1aa2c9e0c fix(stream):add more check for test cases. 2023-10-16 18:47:01 +08:00
Minglei Jin
2479bb343e prefix/delete: delete with prefix 2023-10-16 15:54:51 +08:00
Minglei Jin
4a77a49a3e prefix/list: list bucket with prefix 2023-10-16 15:25:48 +08:00
Haojun Liao
f98e454c5d
Merge pull request #23193 from taosdata/fix/3_liaohj 
other: merge stream fix in main branch.
 2023-10-16 15:17:04 +08:00
Haojun Liao
33018a0bdb fix(tsdb): fix syntax error. 2023-10-16 14:07:09 +08:00
Haojun Liao
fa6ba6faf8 fix(tdsb): adjust the log level. 2023-10-16 13:26:13 +08:00
Haojun Liao
6b86d050f2 fix(tsdb): record the pinned block iter. 2023-10-16 13:26:13 +08:00
Haojun Liao
5fe7c8de24 fix(stream): fix syntax error. 2023-10-16 13:26:12 +08:00
Haojun Liao
fb2172933a fix(tsdb): enable pin stt datablock. 2023-10-16 13:26:06 +08:00
Haojun Liao
8f2c1944c0 fix(tdsb): adjust the log level. 2023-10-16 11:55:57 +08:00
Haojun Liao
ccecf05ff8 fix(tsdb): record the pinned block iter. 2023-10-16 11:48:57 +08:00
wangmm0220
473142fab7 fix:conflicts from 3.0 2023-10-16 11:35:56 +08:00
Haojun Liao
18bb27cdff fix(stream): fix syntax error. 2023-10-16 10:16:39 +08:00
Haojun Liao
67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao
f751f2bb3d fix(tsdb): enable pin stt datablock. 2023-10-16 09:49:51 +08:00
Haojun Liao
f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
wade zhang
0f9da01c88
Merge pull request #23264 from taosdata/3.0_main_merge.2 
3.0 main merge
 2023-10-14 09:45:49 +08:00
Haojun Liao
6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
Minglei Jin
0a1ff3283e vnode/cos: first round size delte and get 2023-10-13 16:59:05 +08:00
dapan1121
a0699d758c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-13 16:51:38 +08:00
Haojun Liao
bd72d080a9
Merge pull request #23242 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-10-13 16:40:14 +08:00
dapan1121
c0a4328803 feat: support view meta updating 2023-10-13 16:29:34 +08:00
yihaoDeng
8392c99d36 refactor backend 2023-10-13 14:54:00 +08:00
dapan1121
a418307570
Merge pull request #23236 from taosdata/fix/TD-26658-3.0 
enh: close stt before untake read snap
 2023-10-13 14:16:47 +08:00
Haojun Liao
0240ae87c3
Merge pull request #23241 from taosdata/3.0_main_merge 
3.0 branch to main merge
 2023-10-13 10:22:48 +08:00
Haojun Liao
33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao
84c5359d5b other: merge 3.0 2023-10-13 08:58:26 +08:00
Alex Duan
35fced8796
Merge pull request #23234 from taosdata/main_3_merge 
other: merge main into 3.0
 2023-10-12 07:48:20 -05:00
yihaoDeng
a56d831a14 refactor backend 2023-10-12 20:16:41 +08:00
dapan1121
7c67f23469 feat: update view meta 2023-10-12 19:56:17 +08:00
Haojun Liao
506c55001d fix(tsdb): fix race condition. 2023-10-12 17:57:03 +08:00
Haojun Liao
b782af2534 fix(stream): avoid double free. 2023-10-12 17:56:42 +08:00
Haojun Liao
90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052 
fix:[TD-26671] judge if pointer is null to avoid core dump
 2023-10-12 17:23:41 +08:00
kailixu
3d32d55ea5 enh: close stt before untake read snap 2023-10-12 16:44:55 +08:00
Haojun Liao
eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
Hongze Cheng
11aa9326b9 fix more 2023-10-11 20:15:46 +08:00
yihaoDeng
031506aef8 refactor backend 2023-10-11 19:46:35 +08:00
dmchen
c1e22eff1a fix/pr-23223-ci-core 2023-10-11 10:25:28 +00:00
Hongze Cheng
38b036ff36 fix: possible race condition 2023-10-11 17:39:58 +08:00
Haojun Liao
ea6ffac403 refactor: do some internal refactor. 2023-10-11 16:51:27 +08:00
Minglei Jin
8253874398 enh(tsdb/cos): new sdk for s3 2023-10-11 14:47:26 +08:00
wangmm0220
f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
Haojun Liao
15debda7cd refactor: update some logs. 2023-10-11 11:04:57 +08:00
Haojun Liao
d58d663a36 refactor: update some logs. 2023-10-11 10:38:15 +08:00
Haojun Liao
a03f09c00f refactor: update some logs. 2023-10-11 10:32:31 +08:00
Shungang Li
2c66f44b31 fix(tsdb): ensure sst trigger array size for upgrade 2023-10-10 21:07:08 +08:00
Haojun Liao
b4d7e66f19 other: add some logs. 2023-10-10 19:57:17 +08:00
Haojun Liao
56147120b9 fix(tsdb): remove invalid assert, and do some internal refactor. 2023-10-10 17:04:12 +08:00
wangmm0220
440fa77282 fix:merge datablock if data in same wal version 2023-10-10 16:55:36 +08:00
Haojun Liao
05dfadd8f8 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 15:52:48 +08:00
Haojun Liao
5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
Haojun Liao
adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan
9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN 
fix: add case for lost data after  split vgroup (main)
 2023-10-10 00:54:34 -05:00
wangmm0220
9113c3c3b6 fix:rollback removed code 2023-10-10 11:53:54 +08:00
Hongze Cheng
1b559a0254
Merge pull request #23180 from taosdata/fix/TS-4121-main 
fix(tsdb/cache reader): reset current fileset in cache reader
 2023-10-09 20:46:33 -05:00
Hongze Cheng
4224f90661
Merge pull request #23184 from taosdata/enh/TS-4107 
enh: clear files fset by fset
 2023-10-09 20:05:12 -05:00
yihaoDeng
0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
Haojun Liao
af4618f958 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 20:10:27 +08:00
Haojun Liao
21fb502690 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 20:10:26 +08:00
Haojun Liao
c5ee299d01 fix(stream): fix error in fill-history process. 2023-10-09 20:10:26 +08:00
Haojun Liao
af2c0c95e9 refactor: do some internal refactor. 2023-10-09 20:10:22 +08:00
Haojun Liao
59e284c332 fix(stream): quit from loop when input queue is full. 2023-10-09 20:10:21 +08:00
Haojun Liao
9d5a3b8d78 other: merge stream fix. 2023-10-09 20:10:13 +08:00
Haojun Liao
11d8c8da39 fix(stream): update the sink data. 2023-10-09 20:09:23 +08:00
Haojun Liao
f0c5b5a970 refactor(stream): revised the display info. 2023-10-09 20:09:22 +08:00
Haojun Liao
28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao
65daf38715 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-09 20:09:22 +08:00
Haojun Liao
cf14772dd9 enh(stream): optimize the scan wal perf 2023-10-09 20:09:21 +08:00
Haojun Liao
d2160efa05 refactor: wait for 100ms before scan wal again. 2023-10-09 20:09:21 +08:00
Haojun Liao
932d93ab35 refactor: wait for more time for future data 2023-10-09 20:09:21 +08:00
Haojun Liao
0ab5d4b342 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
c295ec322a refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
d5abb21335 fix(stream): fix invalid check. 2023-10-09 20:09:20 +08:00
Haojun Liao
583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao
19042cdea6 fix(stream): fix invalid param. 2023-10-09 20:09:19 +08:00
Haojun Liao
f9113ab7b0 fix(stream): fix invalid param. 2023-10-09 20:09:11 +08:00
Haojun Liao
b0a4ed3217 fix(stream): drop related fill-history task when dropping stream tasks. 2023-10-09 20:09:10 +08:00
Haojun Liao
83f84d92bc refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-10-09 20:09:10 +08:00
Haojun Liao
bb4ba54f28 fix(stream): enable new time range for stream task. 2023-10-09 20:09:09 +08:00
Haojun Liao
6fbcf4b3d7 fix(tsdb): replace destroy with reset. 2023-10-09 20:09:09 +08:00
Haojun Liao
c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao
db897fb03a fix(stream): opt perf. 2023-10-09 20:09:09 +08:00
Haojun Liao
dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao
a248f3d088 refactor: do some internal refactor. 2023-10-09 20:08:12 +08:00
Haojun Liao
0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao
3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00
Haojun Liao
feb09c8361 fix(stream): fix error in pause scan-history data. 2023-10-09 20:08:11 +08:00
Haojun Liao
6a98b11bef fix(stream): fix invalid read and memory leak. 2023-10-09 20:08:11 +08:00
Haojun Liao
65f66f0986 fix(stream): transfer state when all downstream rsp already. 2023-10-09 20:08:11 +08:00
Haojun Liao
4af7812f0b fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-10-09 20:08:10 +08:00
Haojun Liao
4fe1382cd9 fix(stream): adjust nodeUpdate check interval. 2023-10-09 20:08:09 +08:00
Haojun Liao
f4f55fcbce fix(stream): record the tasks started info, and do some internal refactor. 2023-10-09 20:08:09 +08:00
Haojun Liao
68b003c804 fix(stream): fix race condition. 2023-10-09 20:08:09 +08:00
Haojun Liao
52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao
012ddadf25 fix(stream): update logs. 2023-10-09 20:08:07 +08:00
Haojun Liao
c05a8de3e8 fix(stream): rsp when checkpoint source failed. 2023-10-09 20:08:06 +08:00
Haojun Liao
b4bc4fac98 fix(stream): disable auto rsp for checkpoint source. 2023-10-09 20:08:06 +08:00
Haojun Liao
e671e87234 fix(stream): fix invalid assert. 2023-10-09 20:08:06 +08:00
Haojun Liao
d1a6b8bd22 refactor: do some internal refactor. 2023-10-09 20:08:06 +08:00
Haojun Liao
46b17aa9f1 fix(stream): fix race condition. 2023-10-09 20:08:06 +08:00
Haojun Liao
5eee76df65 fix(stream): add msg identifier check. 2023-10-09 20:08:05 +08:00
Haojun Liao
2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao
498519c94d fix(stream): remove invalid node. 2023-10-09 20:08:02 +08:00
Haojun Liao
27e00b1f19 fix(stream): add some logs, and remove invalid assert. 2023-10-09 20:08:02 +08:00
Haojun Liao
124e1ed1ab enh(stream): add stage info for streamt tasks. 2023-10-09 20:08:02 +08:00
Haojun Liao
12687eb287 fix(stream): add check info detailed information. 2023-10-09 20:08:02 +08:00
Haojun Liao
ab7c18f604 refactor: do some internal refactor. 2023-10-09 20:08:01 +08:00
Haojun Liao
e5535fa1f5 fix(stream): handle dispatch checkpoint-trigger failure. 2023-10-09 20:08:01 +08:00
Haojun Liao
7f4d9b6e41 fix(stream): wait for the task checkpoint before stop. 2023-10-09 20:07:53 +08:00
Haojun Liao
04405b84c5 fix(stream): update logs. 2023-10-09 20:07:53 +08:00
Haojun Liao
118e078f4a log(stream): update log. 2023-10-09 20:07:53 +08:00
Haojun Liao
ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao
a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao
1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao
02610f5546 fix(stream): avoid invalid read. 2023-10-09 20:06:11 +08:00
Haojun Liao
f5da458c77 fix(stream): unlock when returning. 2023-10-09 20:06:11 +08:00
Haojun Liao
36dcdad1a5 fix(stream): return if failed. 2023-10-09 20:06:10 +08:00
Haojun Liao
d76e3ac718 fix(stream): add task status check. 2023-10-09 20:06:10 +08:00
Haojun Liao
29e1efb757 fix(stream): fix obj. 2023-10-09 20:06:10 +08:00
Haojun Liao
a997fa5552 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-10-09 20:06:09 +08:00
Haojun Liao
dff4bd3c8d log(tsdb): remove some logs. 2023-10-09 20:06:09 +08:00
Haojun Liao
53237c34d1 enh(stream): add info in log. 2023-10-09 20:06:09 +08:00
Haojun Liao
8af76d28c8 log(stream): remove logs. 2023-10-09 20:06:09 +08:00
Haojun Liao
e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao
927f2d896c fix(stream): limit the max scan times. 2023-10-09 20:06:08 +08:00
Haojun Liao
1a86ee6517 refactor: update the log level. 2023-10-09 20:06:06 +08:00
Haojun Liao
ff3ea366e2 fix(stream): keep the status entry in hash table, instead entry index. 2023-10-09 20:06:05 +08:00
Haojun Liao
b95ad74c7f fix(stream): not handle the check msg for follower tasks. 2023-10-09 20:06:04 +08:00
Haojun Liao
38bf2d24e7 fix(stream): remove stream in buf. 2023-10-09 20:05:39 +08:00
Haojun Liao
636eccc160 fix(stream): add null check 2023-10-09 20:05:37 +08:00
Haojun Liao
57bf1cadc4 fix(stream): fix error in decode stream task. 2023-10-09 20:05:37 +08:00
Haojun Liao
0459a4628c fix(stream): fix stream task id error. 2023-10-09 20:05:36 +08:00
Haojun Liao
7ccc273206 other: merge stream fix in main. 2023-10-09 20:05:29 +08:00
Haojun Liao
98ef566eb4 fix(stream): remove fill-history sink task. 2023-10-09 20:04:17 +08:00
Haojun Liao
e84eeee6b8 refactor: do some internal refactor. 2023-10-09 20:04:17 +08:00
Haojun Liao
fe7864b976 fix(stream): fix error in drop task. 2023-10-09 20:04:17 +08:00
Haojun Liao
c33e521aa1 fix(stream): update some logs. 2023-10-09 20:04:17 +08:00
Haojun Liao
5f1146d415 fix(stream): fix memory leak. 2023-10-09 20:04:17 +08:00
Haojun Liao
39e0c57323 fix(stream): set the correct guard flag. 2023-10-09 20:04:16 +08:00
Haojun Liao
3d1f29ff21 fix(stream): fix memory leak. 2023-10-09 20:04:16 +08:00
Haojun Liao
6fa54789cb fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-10-09 19:59:31 +08:00
Haojun Liao
1256eafddb other: merge stream fix. 2023-10-09 19:59:24 +08:00
Haojun Liao
c6355fcc2f fix(tsdb): check return code. 2023-10-09 19:56:18 +08:00
Haojun Liao
be09c173ab fix:fix coverity issue and remove unnecessary files. 2023-10-09 19:56:17 +08:00
Haojun Liao
aaa12ed4f8 refactor: do some internal refactor about the sched status set 2023-10-09 19:56:17 +08:00
kailixu
f180a6e6f3 chore: remove macro for grant notify 2023-10-09 19:26:16 +08:00
wangmm0220
3e2e924e98 feat:[TD-26056] add replay logic 2023-10-09 18:36:39 +08:00
dapan1121
d229492616 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-09 18:34:08 +08:00
Hongze Cheng
cd61dd39fa
Merge pull request #23176 from taosdata/enh/TS-4103 
enh: control number of stt files
 2023-10-09 05:08:01 -05:00
wangmm0220
33045e63ae feat:[TD-26056] add replay logic 2023-10-09 17:35:40 +08:00
dapan1121
6c8db261f3 feat: support show views command 2023-10-09 17:19:36 +08:00
kailixu
5dd277248e fix: alter active code for different server 2023-10-09 17:16:56 +08:00
Hongze Cheng
e3525dba6e enh: clear files fset by fset 2023-10-09 17:11:50 +08:00
Hongze Cheng
258181e387 change block commit factor 2023-10-09 16:03:42 +08:00
yihaoDeng
2aa88dfe9b fix mem leak 2023-10-09 15:53:42 +08:00
wade zhang
7c738cbe0c
Merge pull request #23168 from taosdata/feat/TS-4036-main 
feat: alter local/dnode asynclog
 2023-10-09 15:44:39 +08:00
Haojun Liao
8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Minglei Jin
93438ed838 fix(tsdb/carch reader): reset current fileset in cache reader 2023-10-09 15:24:24 +08:00
yihaoDeng
addb1107d2 fix mem leak 2023-10-09 15:11:59 +08:00
Hongze Cheng
2c9a0dbcda enh: control stt max level 2023-10-09 14:00:11 +08:00
liuyao
1fbfdb5ab4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 11:40:27 +08:00
wade zhang
40ff071243
Merge pull request #23164 from taosdata/fix/TD-26587 
fix(tsdb/retention): free fopArr & fs snapshot resources
 2023-10-09 10:22:25 +08:00
Haojun Liao
74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao
ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao
0fda1793e7 fix(stream): fix error in fill-history process. 2023-10-09 10:08:48 +08:00
liuyao
731d4fff27 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 08:58:27 +08:00
wangmm0220
5f7b6f19ba feat:[TD-26056] add replay logic 2023-10-08 19:05:59 +08:00
Haojun Liao
167484ab3a
Merge pull request #23145 from taosdata/mark/tmq 
opti:set default offset to latest in subscription
 2023-10-08 18:56:37 +08:00
dapan1121
5b639a172d feat: support query from view 2023-10-08 18:36:06 +08:00
Hongze Cheng
880e8c1941 fix: block commit when there are too many stt file 2023-10-08 18:27:19 +08:00
Shungang Li
a7507d26b0 feat: alter local/dnode asynclog 2023-10-08 18:26:25 +08:00
yihaoDeng
bffa6387fe refact task backend 2023-10-08 18:16:45 +08:00
yihaoDeng
f49a2cbeb0 refact task backend 2023-10-08 18:14:17 +08:00
wangmm0220
b04d57fcc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056 2023-10-08 16:15:19 +08:00
wangmm0220
3f2d890560 feat:[TD-26056] add replay logic 2023-10-08 16:06:15 +08:00
Minglei Jin
ca809924cd fix(tsdb/retention): free fopArr & fs snapshot resources 2023-10-08 15:10:54 +08:00
dapan1121
9b207b9b3e
Merge pull request #23133 from taosdata/fix/TD-26474-3.0 
fix: mutex init for trans
 2023-10-08 15:07:47 +08:00
Hongze Cheng
ba27cc0605 fix: fid overflow 2023-10-08 14:54:24 +08:00
liuyao
ed8cad22cb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 13:31:51 +08:00
wade zhang
a9db1ed8e0
Merge pull request #23116 from taosdata/fix/TD-26539 
fix(keep0-duration): force keep0 at least thrice of duration
 2023-10-08 13:07:05 +08:00
yihaoDeng
9d430c39ae fix mem leak 2023-10-08 11:47:06 +08:00
wangmm0220
fb3197ea89 fix:test case error for reset=latest 2023-10-08 10:55:35 +08:00
kailixu
a2e3109447 chore: add grant method for community 2023-10-08 09:47:57 +08:00
liuyao
c75506b271 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 09:02:51 +08:00
dapan1121
61382c0793
Merge pull request #23126 from taosdata/fix/TD-26426-3.0 
fix: support check/merge active code
 2023-10-07 19:31:36 +08:00
Haojun Liao
ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
liuyao
c088ee7f91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-07 19:13:07 +08:00
yihaoDeng
97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
kailixu
b9767707cb chore: code optimization for array size 2023-10-07 15:57:26 +08:00
wangmm0220
9c470e9297 opti:set default offset to latest in subscription & return error if use snapshot when consume column 2023-10-07 15:25:24 +08:00
Hongze Cheng
d1e59b9e0e enh: optimize merge strategy 2023-10-07 15:18:08 +08:00
Haojun Liao
7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
yihaoDeng
fa70221238 refact task backend 2023-10-07 12:17:55 +08:00
dapan1121
deb9a6875b feat: mnode processing view meta request 2023-10-07 10:40:00 +08:00
Haojun Liao
115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
kailixu
85226d05a3 chore: code refactor for time series 2023-10-07 09:30:32 +08:00
Haojun Liao
f542a8c786 fix(stream): update the sink data. 2023-10-07 09:22:25 +08:00
Haojun Liao
798f559b62 refactor(stream): revised the display info. 2023-10-07 09:04:38 +08:00
kailixu
6efe3845d4 chore: more logic 2023-10-07 07:02:16 +08:00
Haojun Liao
c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
kailixu
c70a1b77e6 chore: code optimization for time series 2023-10-07 00:17:21 +08:00
kailixu
c59498d90a chore: code refactor for time series statis 2023-10-06 07:37:18 +08:00
kailixu
e4a86aa70a chore: remove obsolete codes 2023-10-05 23:52:50 +08:00
kailixu
07f043f143 enh: exclude sys tbl for time series 2023-10-05 23:48:52 +08:00
kailixu
47e79ff5b7 enh: exclude sys tbl for time series 2023-10-05 23:45:54 +08:00
kailixu
d0a046c7a3 enh: exclude sys tbl for time series 2023-10-05 23:30:30 +08:00
kailixu
88fdeca5cf enh: dnode notify logic 2023-10-05 22:31:25 +08:00
kailixu
dbfd282b13 Merge branch 'enh/TD-26532-3.0' of github.com:taosdata/TDengine into enh/TD-26532-3.0 2023-10-05 21:36:18 +08:00
kailixu
086213a6c2 enh: dnode notify logic 2023-10-05 21:35:57 +08:00
kailixu
c339f3552a fix: mutex init for trans 2023-10-05 09:19:44 +08:00
Haojun Liao
5bf8d16ee1 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-04 23:33:03 +08:00
Haojun Liao
41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
kailixu
578c9ad57d Merge branch '3.0' into enh/TD-26532-3.0 2023-10-03 23:29:02 +08:00
Haojun Liao
45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao
132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao
58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao
a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao
5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
kailixu
53c4c56206 chore: code optimization 2023-10-02 09:23:51 +08:00
Haojun Liao
5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
kailixu
a19efd266e chore: more code 2023-10-01 21:55:17 +08:00
kailixu
5067eb8cc5 chore: more code for check active code 2023-09-30 16:00:14 +08:00
kailixu
e677e41573 fix: support check and merge activeCode 2023-09-30 12:29:44 +08:00
Haojun Liao
f3275f76e8 fix(stream): fix invalid param. 2023-09-28 23:31:07 +08:00
Haojun Liao
c14873401f fix(stream): fix invalid param. 2023-09-28 23:26:46 +08:00
Haojun Liao
ff44539468 fix(stream): drop related fill-history task when dropping stream tasks. 2023-09-28 23:00:29 +08:00
Haojun Liao
31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao
f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
yihaoDeng
bb265887e6 refact task backend 2023-09-28 17:07:19 +08:00
yihaoDeng
54e3ac2c1e refact task backend 2023-09-28 15:46:12 +08:00
Haojun Liao
0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
dapan1121
0a0f512023 feat: add view meta processing 2023-09-28 11:44:38 +08:00
Haojun Liao
0a8f4530f7 fix(tsdb): replace destroy with reset. 2023-09-28 11:42:19 +08:00
Haojun Liao
80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
kailixu
b1a0912a61 enh: exclude systables in log/audit db 2023-09-28 10:15:34 +08:00
wade zhang
10ad4600e4
Merge pull request #23104 from taosdata/fix/TD-26527 
fix/TD-26527: alter database keep_time_offset can't changed
 2023-09-28 09:33:00 +08:00
Haojun Liao
22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao
0f4e38faf7
Merge pull request #23094 from taosdata/fix/fixIpWhitelistAddUser 
fix ip white for all users
 2023-09-28 09:15:38 +08:00
Haojun Liao
cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj 
fix(stream): fix several bugs and do some internal refactor for stream processing.
 2023-09-28 09:12:39 +08:00
yihaoDeng
5a684f2a26 fix invalid read 2023-09-27 22:32:54 +08:00
Shungang Li
63ce2f6f2f fix: alter database keep_time_offset can't changed 2023-09-27 19:04:01 +08:00
yihaoDeng
28dbe36b91 fix ip white for all users 2023-09-27 16:41:29 +08:00
dapan1121
1088b80a46
Merge pull request #23062 from taosdata/enh/TD-25879-3.0x 
enh: update dnode module
 2023-09-27 16:18:38 +08:00
wade zhang
7b20090977
Merge pull request #23089 from taosdata/fix/TD-26489 
fix(vnode/cos): use EIO as object put errno
 2023-09-27 16:16:21 +08:00
yihaoDeng
62e1d4cb65 fix ip white for all users 2023-09-27 16:10:02 +08:00
yihaoDeng
d0e1aec270 fix ip white for all users 2023-09-27 16:08:09 +08:00
yihaoDeng
48be800639 fix ip white for all users 2023-09-27 15:46:25 +08:00
Minglei Jin
cd811577f3 fix(vnode/cos): use EIO as object put errno 2023-09-27 15:10:34 +08:00
yihaoDeng
d4f87378fd avoid first tag index conflict 2023-09-27 14:44:09 +08:00
Minglei Jin
5ce1dd6284 fix(tsdb/readerwriter): fix fd writing 2023-09-27 14:02:37 +08:00
Haojun Liao
e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
wade zhang
e6b0592629
Merge pull request #23081 from taosdata/fix/TD-26478-2 
fix(tsdb/readerwriter): fix var shadowing
 2023-09-27 08:37:17 +08:00
Haojun Liao
c50e9c7b35
Merge pull request #23073 from taosdata/fix/ipWhiteListfix 
fix ip white list
 2023-09-26 21:39:50 +08:00
Minglei Jin
e6287c1a89 fix(tsdb/readerwriter): fix var shadowing 2023-09-26 19:18:10 +08:00
dmchen
a4c1611755 TD-26432 2023-09-26 11:06:44 +00:00
liuyao
ebf4283e91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 17:19:41 +08:00
yihaoDeng
3b885f4faf fix ip white list 2023-09-26 17:04:25 +08:00
kailixu
e1cd54a1b3 fix: rwlock reentrant problem on windows 2023-09-26 15:44:35 +08:00
kailixu
c680180894 fix: rwlock reentrant problem on windows 2023-09-26 15:37:29 +08:00
kailixu
e523d3d6a4 chore: remove obsolete codes 2023-09-26 14:34:42 +08:00
wade zhang
f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0 
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
 2023-09-26 14:25:54 +08:00
Haojun Liao
890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao
525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj 
fix(stream): fix several stability-related bugs in stream framework.
 2023-09-26 14:10:58 +08:00
Haojun Liao
d5621b52d7
Merge pull request #23053 from taosdata/fix/26475 
Fix/26475
 2023-09-26 13:42:53 +08:00
kailixu
93bf7da254 chore: dm update 2023-09-26 13:22:38 +08:00
Haojun Liao
f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
Ping Xiao
4f23ea2a8c enh: dmodule logic 2023-09-26 11:47:53 +08:00
liuyao
ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
Haojun Liao
d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Hongze Cheng
03456ce443 fix: upgrade error when has tomb data 2023-09-26 09:23:22 +08:00
wade zhang
92f5803303
Merge pull request #23050 from taosdata/fix/TD-26478 
fix(cos): use EIO as failed code
 2023-09-26 09:02:59 +08:00
Haojun Liao
6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao
5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00
wade zhang
f2a7795cd6
Merge pull request #23037 from taosdata/enh/TS-3812-3.0 
grant: enable update cluster info
 2023-09-25 19:27:44 +08:00
yihaoDeng
b134365d08 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-09-25 18:40:10 +08:00
yihaoDeng
40a3c778f0 disable ip on community 2023-09-25 18:39:49 +08:00
Minglei Jin
7fd7902dda fix(cos): use EIO as failed code 2023-09-25 18:38:55 +08:00
Haojun Liao
c9576d7a85 fix(stream): transfer state when all downstream rsp already. 2023-09-25 17:31:38 +08:00
Benguang Zhao
5d588cb7d2 enh: trigger failover if tsdbMerge failure 2023-09-25 17:22:38 +08:00
kailixu
126a371170 chore: more code 2023-09-25 16:24:03 +08:00
kailixu
0632fb838a chore: code refactor 2023-09-25 16:17:57 +08:00
kailixu
68fb1b296f chore: code refactor 2023-09-25 16:16:12 +08:00
Haojun Liao
966ce4f30e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-09-25 16:00:02 +08:00
Haojun Liao
fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
kailixu
b0b4d782fc chore: code refactor 2023-09-25 15:57:54 +08:00
Alex Duan
c9af9eb15b
Merge pull request #22915 from lx1zhong/3.0 
add TSZ and ADT-FSE algorithm
 2023-09-25 15:48:30 +08:00
Shungang Li
8f0d700fe8 feat: rm dnode config item keepTimeOffset 2023-09-25 15:46:12 +08:00
Shungang Li
743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
kailixu
f689ef8fe4 chore: make jenkins happy 2023-09-25 15:41:23 +08:00
kailixu
4e0a5cb91a chore: macOS compile 2023-09-25 14:46:59 +08:00
kailixu
3083189f4d grant: enable update cluster info 2023-09-25 12:35:18 +08:00
Haojun Liao
dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao
1af95969b2 fix(stream): adjust nodeUpdate check interval. 2023-09-25 10:40:30 +08:00
Haojun Liao
eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao
c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
kailixu
7b4ef6df96 fix: memory leak 2023-09-24 13:50:20 +08:00
kailixu
c69b9e0197 chore: make jenkins happy 2023-09-24 09:45:19 +08:00
kailixu
986788d4fe enh: timeseries calculation 2023-09-24 09:14:52 +08:00
kailixu
e50b8a3a0d chore: make jenkins happy for community 2023-09-24 08:48:14 +08:00
kailixu
ff3e36e679 enh: timeseries calculation 2023-09-24 08:41:45 +08:00
kailixu
53a9459c20 enh: update timeseries 2023-09-24 07:52:27 +08:00
Haojun Liao
4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
kailixu
bc8ebf1562 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-23 18:19:08 +08:00
kailixu
a4b92760f0 enh: grant notify optimize 2023-09-23 18:10:08 +08:00
Haojun Liao
b58ec1ee57 fix(stream): update logs. 2023-09-23 15:22:48 +08:00
Haojun Liao
acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
Haojun Liao
7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao
5155519559 fix(stream): fix invalid assert. 2023-09-22 23:06:48 +08:00
Haojun Liao
cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
kailixu
8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
Haojun Liao
fcbd747afc fix(stream): fix race condition. 2023-09-22 19:35:12 +08:00
liuyao
0d983e28ef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 19:25:41 +08:00
Haojun Liao
5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
yihaoDeng
11da631bb5 add cvt state 2023-09-22 09:08:42 +00:00
wade zhang
849b05a09b
Merge pull request #22927 from taosdata/fix/TD-26189 
s3/block_cache: new tsdb block cache
 2023-09-22 16:15:07 +08:00
liuyao
4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
Haojun Liao
898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Minglei Jin
4c151f2031 tsdb/readerwriter: remove size with download 2023-09-22 14:06:06 +08:00
Haojun Liao
7e4410f094
Merge pull request #22992 from taosdata/feat/TD-26052 
feat:support vnode split in tmq
 2023-09-22 13:57:21 +08:00
Haojun Liao
7380151322 fix(stream): remove invalid node. 2023-09-22 11:45:46 +08:00
Haojun Liao
87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao
198e6bb023 enh(stream): add stage info for streamt tasks. 2023-09-22 10:36:15 +08:00
Haojun Liao
f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
wangmm0220
19806cbcab fix:memory leak 2023-09-22 10:12:11 +08:00
wangmm0220
5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
wangmm0220
86a4bfe28d fix:memory leak 2023-09-22 10:02:16 +08:00
liuyao
dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
wangmm0220
803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao
b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao
b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao
3c921ba66e
Merge pull request #23006 from taosdata/fix/3_liaohj 
fix(tsdb): set the correct scaninfo to load the tomb data.
 2023-09-21 22:13:16 +08:00
kailixu
3beb9c5c84 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 19:38:27 +08:00
dapan1121
a67b0c99fc feat: support create/drop view 2023-09-21 19:28:07 +08:00
Cary Xu
1bbb812557
Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 17:32:51 +08:00
Haojun Liao
f93df639c1 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 17:32:21 +08:00
dapan1121
64da3f4ef9
Merge pull request #22978 from taosdata/szhou/show-db-table 
enhance: show normal/child tables and show user/system databases
 2023-09-21 16:55:26 +08:00
Minglei Jin
ce1f866416 tsdb/reader: use pTsdb handle instead of pgsz to open file 2023-09-21 16:36:17 +08:00
kailixu
7445b9ff50 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 16:25:06 +08:00
Haojun Liao
2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao
0f97a21163 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 15:21:01 +08:00
Haojun Liao
e4073bd9a8 fix(stream): update logs. 2023-09-21 14:03:14 +08:00
Haojun Liao
09accc71d2 log(stream): update log. 2023-09-21 14:01:41 +08:00
Haojun Liao
17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
kailixu
e7dd0caeb9 Merge branch '3.0' into enh/TS-3934-3.0 2023-09-21 10:21:45 +08:00
liuyao
3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
wangmm0220
ce2fc8b319 fix:memory leak 2023-09-21 10:05:52 +08:00
kailixu
2b25982495 enh: user dropped notification 2023-09-21 09:53:45 +08:00
wangmm0220
f9c5aa01af fix:enable split if there are topics & fix memory leak 2023-09-21 09:20:34 +08:00
dapan1121
cc08a5ee87 fix: add query sql 2023-09-20 19:30:40 +08:00
Haojun Liao
92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
wangmm0220
d3f54e678f feat:support vnode split in tmq 2023-09-20 18:27:43 +08:00
Haojun Liao
6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
Minglei Jin
f206fa07d0 s3/put: use put2 2023-09-20 15:59:58 +08:00
Haojun Liao
2418f509ea fix(stream): avoid invalid read. 2023-09-20 15:47:09 +08:00
Haojun Liao
1d1d9a1b0b fix(stream): unlock when returning. 2023-09-20 15:45:15 +08:00
Haojun Liao
c8ab761d2a fix(stream): return if failed. 2023-09-20 15:38:49 +08:00
Haojun Liao
2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
Minglei Jin
d155cfcf0f tsdb/readerwriter: use tsdb's s3 block cache to read file page 2023-09-20 15:24:54 +08:00
liuyao
1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
dapan1121
6b87d97989 feat: support view in mnode 2023-09-20 15:01:03 +08:00
Haojun Liao
af487c9048 fix(stream): fix obj. 2023-09-20 14:50:43 +08:00
Haojun Liao
361cde6497 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-09-20 14:49:09 +08:00
Haojun Liao
55d4a9686c log(tsdb): remove some logs. 2023-09-20 13:18:42 +08:00
Haojun Liao
5e3a268b6d enh(stream): add info in log. 2023-09-20 13:15:50 +08:00
dm chen
4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
Haojun Liao
392aaeb592 log(stream): remove logs. 2023-09-20 10:49:18 +08:00
Haojun Liao
b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
Haojun Liao
779c0c5f19
Merge pull request #22970 from taosdata/fix/liaohj 
fix(stream): keep the status entry in hash table, instead entry index.
 2023-09-20 10:33:05 +08:00
kailixu
a9d30f25d2 enh: rsma support delete raw data 2023-09-20 10:11:03 +08:00
slzhou
ef1e91a6be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-20 08:44:15 +08:00
wangmm0220
2881a2504c fix:conflicts from 3.0 2023-09-19 18:39:40 +08:00
dmchen
1a7bffb079 ci break 2023-09-19 18:01:38 +08:00
Haojun Liao
b99232fd7a fix(stream): limit the max scan times. 2023-09-19 17:45:28 +08:00
Haojun Liao
271e492188 refactor: update the log level. 2023-09-19 17:40:26 +08:00
wangmm0220
766652a88a fix:vnode tranform support in tmq 2023-09-19 17:27:19 +08:00
dmchen
dbde1a4491 ci break 2023-09-19 14:40:48 +08:00
dm chen
ee913cbfbc
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-19 14:39:20 +08:00
dapan1121
b9d554275c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-09-19 14:21:00 +08:00
dapan1121
14e8db289d feat: support view 2023-09-19 14:19:54 +08:00
shenglian zhou
a072fb6a2c Merge branch '2.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-09-19 14:03:16 +08:00
dmchen
e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
wade zhang
7311e60f7f
Merge pull request #22963 from taosdata/fix/TS-4015 
fix: set snapshot writer compression
 2023-09-19 13:26:32 +08:00
wangmm0220
ad70dc178f fix:conflicts from 3.0 2023-09-19 11:56:52 +08:00
wangmm0220
edb42aa2aa fix:move from main to 3.0 2023-09-19 11:51:52 +08:00
Haojun Liao
1cfd34a6a9
Merge pull request #22955 from taosdata/fix/avoidConflictIdxNameMain 
avoid first tag index conflict
 2023-09-19 11:37:26 +08:00
slzhou
c882f4ba08 fix: fix address sanitizer error 2023-09-19 11:31:20 +08:00
Alex Duan
4a4e778a6a fix: remove depends from util to common 2023-09-19 10:46:52 +08:00
Haojun Liao
5a6e50d523 fix(stream): keep the status entry in hash table, instead entry index. 2023-09-19 10:33:58 +08:00
Haojun Liao
e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
slzhou
900aacd428 fix: fix sanitizer error 2023-09-19 09:40:00 +08:00
kailixu
6698861c8b chore: timeseries distribute 2023-09-19 08:29:51 +08:00
Hongze Cheng
b1797834c1 fix: set snapshot writer compression 2023-09-18 20:58:20 +08:00
Haojun Liao
1ca06e960f fix(stream): remove stream in buf. 2023-09-18 20:25:24 +08:00
wangmm0220
1e859084b7 fix:conflicts from 3.0 2023-09-18 19:57:33 +08:00
wangmm0220
4b74135350 fix:vnode tranform support in tmq 2023-09-18 19:47:28 +08:00
wangmm0220
59d8f7d10f fix:return in progress in drop consumer group 2023-09-18 17:55:00 +08:00
Haojun Liao
101161c52e
Merge pull request #22954 from taosdata/fix/TD-26323 
fix:core in race condition for pTq->pExecStore & return if poll too l…
 2023-09-18 17:41:01 +08:00
shenglian zhou
94a616fcc1 fix: save and continue 2023-09-18 16:59:07 +08:00
Haojun Liao
c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
wangmm0220
49a193b328 fix:send delete subscribe info to vnode if drop consumer 2023-09-18 14:46:39 +08:00
wangmm0220
c3498fbfe8 fix:core in race condition for pTq->pExecStore & return if poll too long & fix test cases if submit empty 2023-09-18 14:35:07 +08:00
Alex Duan
570ac79a79
Merge branch 'taosdata:3.0' into 3.0 2023-09-18 14:28:00 +08:00
yihaoDeng
2c10163634 avoid first tag index conflict 2023-09-18 14:19:58 +08:00
wangmm0220
7869b693f2 add test case for tmq in vnode transform & fix core in race condition for pTq->pExecStore 2023-09-18 14:09:28 +08:00
Haojun Liao
82d3deb423
Merge pull request #22949 from taosdata/enh/disableIpWhiteListOnCommunity 
disable white list on community
 2023-09-18 13:41:08 +08:00
dmchen
b473122dac break dependency 2023-09-18 12:29:08 +08:00
Haojun Liao
8aa34802f5
Merge pull request #22938 from taosdata/fix/TD-26323 
fix:[TD-26323]add macro to control tmq assert & make subscribe transa…
 2023-09-18 09:48:39 +08:00
Haojun Liao
de04090f04
Merge pull request #22940 from taosdata/fix/avoidConflictOfIdxName 
reduce the confliction of first tag index name
 2023-09-18 09:47:58 +08:00
dm chen
fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-18 09:41:47 +08:00
dmchen
c674e025e2 skip auto create tb 2023-09-18 09:29:51 +08:00
kailixu
8111c18cc4 chore: merge 3.0 2023-09-18 09:20:43 +08:00
Haojun Liao
8aa9960760
Merge pull request #22944 from taosdata/fix/liaohj 
refactor: do some internal refactor, and fix some bugs.
 2023-09-17 21:25:33 +08:00
Haojun Liao
3dfdda3283 fix(stream): fix error in decode stream task. 2023-09-17 18:07:26 +08:00
Haojun Liao
01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao
4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
Haojun Liao
caa7542cea
Merge pull request #22913 from taosdata/fix/liaohj 
fix(stream): fix error in drop task.
 2023-09-16 21:36:38 +08:00
yihaoDeng
d890ccbd3b disable white list on community 2023-09-15 20:27:41 +08:00
wangmm0220
8ebb6e202e fix:[TD-26323]add macro to control tmq assert & make subscribe transaction no conflicts 2023-09-15 19:26:55 +08:00
Haojun Liao
05e9f40834
Merge pull request #22828 from taosdata/enh/ipWhiteList 
Enh/ip white list
 2023-09-15 17:49:37 +08:00
Haojun Liao
91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
yihaoDeng
a66145a494 reduce the possible of first tag index name 2023-09-15 17:41:04 +08:00
Minglei Jin
0181bb24d3 tsdb/readerwriter: use PRId64 instead of lld 2023-09-15 16:40:04 +08:00
Alex Duan
47f2c38a56
Merge pull request #22910 from taosdata/fix/TS-3987 
fix: delete data error
 2023-09-15 16:19:29 +08:00
Minglei Jin
318281356b s3/block_cache: new tsdb block cache 2023-09-15 16:19:21 +08:00
kailixu
7f477b413a chore: more code 2023-09-15 14:35:57 +08:00
kailixu
03aea454d7 chore: more code 2023-09-15 14:33:35 +08:00
lx1zhong
6da4088012 add TSZ and ADT-FSE algorithm 2023-09-15 14:30:23 +08:00
wade zhang
b123dd7df3
Merge pull request #22904 from taosdata/FIX/TD-26292-main 
enh: ignore compact req during restoring
 2023-09-15 11:05:18 +08:00
kailixu
6b95013ba0 chore: code refactor for mndDnode 2023-09-15 10:28:07 +08:00
yihaoDeng
79fe29c848 fix compile error 2023-09-15 10:10:23 +08:00
Haojun Liao
2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
kailixu
8505fb2aea chore: code refactor for mndDnode 2023-09-15 08:49:45 +08:00
kailixu
1ddc935072 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-15 08:39:32 +08:00
Haojun Liao
117de7ab7d fix(stream): fix error in drop task. 2023-09-15 00:51:13 +08:00
Haojun Liao
500fcad36c
Merge pull request #22892 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-09-15 00:46:46 +08:00
Haojun Liao
73c2782d78 fix(stream): update some logs. 2023-09-14 23:17:23 +08:00
Haojun Liao
5f55f489d8 fix(stream): fix memory leak. 2023-09-14 22:59:11 +08:00
Haojun Liao
303e8caf0c fix(stream): set the correct guard flag. 2023-09-14 22:44:16 +08:00
kailixu
449092c5dc enh: timeseries update optimize 2023-09-14 20:16:02 +08:00
Haojun Liao
27f626769e fix(stream): fix memory leak. 2023-09-14 19:33:05 +08:00
yihaoDeng
167be7c519 rm dup ip 2023-09-14 19:09:56 +08:00
yihaoDeng
250fed499f Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 18:49:17 +08:00
yihaoDeng
0e496ab0c5 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 18:18:05 +08:00
yihaoDeng
2af180c763 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:56:44 +08:00
yihaoDeng
02f5f4f017 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:23:31 +08:00
Haojun Liao
f2c3e0a6e8 fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-09-14 17:22:31 +08:00
Hongze Cheng
925cc8f55f fix: delete data error 2023-09-14 17:20:10 +08:00
yihaoDeng
a7d4547a2d Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 17:01:06 +08:00
yihaoDeng
011aee7214 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:56:47 +08:00
yihaoDeng
2d1d74d4e8 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:52:23 +08:00
slzhou
972a6a133f Merge branch 'enh/ipWhiteList' of github.com:taosdata/TDengine into enh/ipWhiteList 2023-09-14 16:34:30 +08:00
slzhou
59020ff52d fix: for community version, use 0.0.0.0/0 as whitelist 2023-09-14 16:34:03 +08:00
wangmm0220
908cf88414 Merge branch 'mark/tmq-3.0' of https://github.com/taosdata/TDengine into feat/TD-26052 2023-09-14 16:18:43 +08:00
Benguang Zhao
bbcbe460d4 enh: ignore compact req during restoring 2023-09-14 16:17:17 +08:00
Benguang Zhao
2886913fd8 enh: ignore compact req during restoring 2023-09-14 16:09:00 +08:00
yihaoDeng
e36dc50828 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-14 15:42:17 +08:00
yihaoDeng
2002ed8709 add more error code 2023-09-14 15:34:28 +08:00
slzhou
2a40113f13 fix: entprise version compilation 2023-09-14 14:44:09 +08:00
Haojun Liao
fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
slzhou
a15a41f396 Merge branch 'enh/ipWhiteList' of github.com:taosdata/TDengine into szhou/enh/ipWhiteList 2023-09-14 13:06:15 +08:00
slzhou
94236b8cee fix: pass some test 2023-09-14 13:05:58 +08:00
yihaoDeng
aa1cc01064 update test case 2023-09-14 12:18:43 +08:00
yihaoDeng
903c628067 update test case 2023-09-14 12:18:04 +08:00
Haojun Liao
fd6344b319 fix(tsdb): check return code. 2023-09-14 09:25:35 +08:00
yihaoDeng
da55d7e67e update test case 2023-09-14 09:25:23 +08:00
Haojun Liao
9b70c0c457 fix:fix coverity issue and remove unnecessary files. 2023-09-14 09:06:10 +08:00
yihaoDeng
7ec31029e6 update test case 2023-09-14 08:45:55 +08:00
yihaoDeng
e7815229ca update test case 2023-09-13 19:54:45 +08:00
wangmm0220
f729150497 fix:opti poll callbak logic & send epoch as -1 to get epset if vnode transformed 2023-09-13 18:32:45 +08:00
wangmm0220
39fb5f4334 fix:add vnode snaphot for tmq 2023-09-13 18:09:47 +08:00
dapan1121
270a7584f4 enh: prevent accessing ins_users&ins_user_privileges without sysinfo 2023-09-13 17:48:26 +08:00
yihaoDeng
c0a8f81176 update test case 2023-09-13 14:27:58 +08:00
Haojun Liao
7305c8dbe1 refactor: do some internal refactor about the sched status set 2023-09-13 14:00:34 +08:00
wangmm0220
1dbd322fa0 fix:remove useless code 2023-09-13 11:42:09 +08:00
kailixu
53ed71959b enh: fetch cluster info for grant periodically 2023-09-13 11:30:04 +08:00
Yihao Deng
fa302ac6b9
Merge branch '3.0' into enh/ipWhiteList 2023-09-13 10:14:08 +08:00
Haojun Liao
99477babca
Merge pull request #22872 from taosdata/fix/coverityScanDyh 
fix coverity scan problem
 2023-09-13 09:18:27 +08:00
Haojun Liao
09a15bf340 refactor: do some internal refactor. 2023-09-12 22:07:52 +08:00
Haojun Liao
60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao
f6a097d96f refactor: do some internal refactor. 2023-09-12 21:58:22 +08:00
Haojun Liao
4325a0a433
Merge pull request #22866 from taosdata/fix/3_liaohj 
refactor: do  some internal refactor.
 2023-09-12 21:56:44 +08:00
yihaoDeng
5468c717e9 Merge branch 'enh/ipWhiteList' of https://github.com/taosdata/TDengine into enh/ipWhiteList 2023-09-12 21:03:42 +08:00
yihaoDeng
d6f4c40e54 fix mem leak 2023-09-12 21:03:35 +08:00
yihaoDeng
8fc33dd74d fix coverity scan problem 2023-09-12 18:52:16 +08:00
Haojun Liao
e457d94ac6 refactor: do some internal refactor. 2023-09-12 18:09:02 +08:00
yihaoDeng
8e064cdd03 fix merge error 2023-09-12 16:41:14 +08:00
slzhou
65fe665939 fix: get user whitelist version from user object 2023-09-12 16:27:07 +08:00
slzhou
a44d0bceb6 Merge branch 'szhou/enh/ipWhiteList' into enh/ipWhiteList 2023-09-12 16:21:29 +08:00
Haojun Liao
4d33387e80
Merge pull request #22814 from taosdata/fix/fixTransferCrash2 
fix merge error
 2023-09-12 16:10:07 +08:00
Haojun Liao
52931b530d
Merge pull request #22855 from taosdata/fix/3_liaohj 
fix(stream):check error when vnode is closing.
 2023-09-12 15:58:02 +08:00
dapan1121
ef7eb478e4
Merge pull request #22834 from taosdata/fix/TS-3945 
fix: remove incorrect assert
 2023-09-12 15:55:51 +08:00
yihaoDeng
7ce8f694dc Merge branch 'enh/dev3New' into enh/ipWhiteList 2023-09-12 15:54:06 +08:00
yihaoDeng
63c53b6a3a fix transfer crash 2023-09-12 15:03:13 +08:00
yihaoDeng
ccb75a9c11 fix transfer crash 2023-09-12 14:46:56 +08:00
yihaoDeng
3e48f3639c fix transfer crash 2023-09-12 14:46:32 +08:00
shenglian zhou
d5f1662bf5 enh: enterprise version and community version split 2023-09-12 14:35:01 +08:00
shenglian zhou
21dd7a82b0 Merge branch 'szhou/enh/ipWhiteList' of github.com:taosdata/TDengine into szhou/enh/ipWhiteList 2023-09-12 14:16:35 +08:00
shenglian zhou
53894f1182 enhance: add hb whitelist version and notify taosadapter 2023-09-12 14:15:03 +08:00
shenglian zhou
8db96a0085 enhance: update notification and get user whitelist api 2023-09-12 14:10:41 +08:00
shenglian zhou
64caae83fd enhance: add hb whitelist version and notify taosadapter 2023-09-12 14:10:41 +08:00
wade zhang
f4e785788a
Merge pull request #22833 from taosdata/fix/TS-3943-3.m 
fix: neighbor block overlap judgement
 2023-09-12 11:51:03 +08:00
Haojun Liao
93159729f6 fix(stream):check error when vnode is closing. 2023-09-12 11:45:51 +08:00
Haojun Liao
025a2a3b50
Merge pull request #22846 from taosdata/fix/3_liaohj 
fix(tsdb): check the schema before merge rows in buffer
 2023-09-12 11:43:27 +08:00
yihaoDeng
4d16cfac05 add rpc update interface 2023-09-12 11:36:44 +08:00
yihaoDeng
a902421f5b add user ip white ver 2023-09-12 11:33:32 +08:00
yihaoDeng
f29880fee3 add rpc update interface 2023-09-12 11:31:06 +08:00
wade zhang
a02f28640c
Merge pull request #22829 from taosdata/fix/TD-26210-main 
fix/TD-26210
 2023-09-12 11:01:12 +08:00
yihaoDeng
6ce85f5cae fix transfer crash 2023-09-12 10:44:56 +08:00
yihaoDeng
d9eed32167 add rpc update interface 2023-09-12 09:54:13 +08:00
Haojun Liao
f602aa965f fix(stream): fix coverity scan issues. 2023-09-12 09:16:18 +08:00
Haojun Liao
a5b93aaf97 fix(tsdb): fix invalid read. 2023-09-11 23:55:34 +08:00
Haojun Liao
e8f7146a2c fix(tsdb): check the schema before merge rows in buffer, and do some refactor. 2023-09-11 22:19:10 +08:00
Haojun Liao
cd1f0ea414
Merge pull request #22826 from taosdata/fix/3_liaohj 
fix(stream): set the correct start version for the step 2 stage in fill history.
 2023-09-11 21:43:58 +08:00
yihaoDeng
9efa9eeff4 add rpc update interface 2023-09-11 21:29:50 +08:00
yihaoDeng
0a8b1ebe46 add rpc update interface 2023-09-11 21:02:50 +08:00
yihaoDeng
39d04ed15b add rpc update interface 2023-09-11 20:48:24 +08:00
shenglian zhou
9da204e5ff enhance: update notification and get user whitelist api 2023-09-11 17:04:35 +08:00
Haojun Liao
5ab739ae46 fix(stream): fix memory leak. 2023-09-11 15:29:12 +08:00
yihaoDeng
d549a47cf5 add rpc update interface 2023-09-11 15:17:20 +08:00
dapan1121
5c21f1ca22 fix: remove incorrect assert 2023-09-11 15:16:22 +08:00
kailixu
78d136dffd fix: neighbor block overlap judgement 2023-09-11 15:10:39 +08:00
yihaoDeng
05727359ca add rpc update interface 2023-09-11 15:02:35 +08:00
dmchen
a8e538a563 fix/TD-26210 2023-09-11 14:38:36 +08:00
Haojun Liao
c729fc989f fix(stream): set the init start timestamp. 2023-09-11 13:49:43 +08:00
Haojun Liao
0980e021e5 fix(stream): set the correct start version for the step 2 stage in fill history. 2023-09-11 13:37:19 +08:00
yihaoDeng
2a30e12547 add rpc update interface 2023-09-11 10:45:45 +08:00
Haojun Liao
50ef500f51 refactor(stream): do sink module refactor. 2023-09-11 10:09:31 +08:00
shenglian zhou
569283f806 enhance: add hb whitelist version and notify taosadapter 2023-09-11 09:52:58 +08:00
yihaoDeng
30a60be214 add rpc update interface 2023-09-11 09:26:00 +08:00
Minglei Jin
443756c6ff fix(meta): null txn after abort 2023-09-11 08:55:30 +08:00
wade zhang
ddc8c93a9c
Merge pull request #22767 from taosdata/mark/tmq 
fix:send delete subscribe info to vnode if drop consumer
 2023-09-10 22:17:26 +08:00
wade zhang
635d405867
Merge pull request #22800 from taosdata/fix/TS-3922-main 
fix:[TS-3922] make SStreamObj->->currentTick aligned by 8
 2023-09-10 22:17:07 +08:00
Haojun Liao
372747cc23
Merge pull request #22818 from taosdata/fix/3_liaohj 
fix(stream): fix error in fill history and check quit status of vnode.
 2023-09-10 20:47:06 +08:00
yihaoDeng
9781766009 add rpc update interface 2023-09-10 17:02:38 +08:00
yihaoDeng
d121b564c0 add rpc update interface 2023-09-10 16:11:14 +08:00
yihaoDeng
25bc0b226b add rpc update interface 2023-09-10 14:09:36 +08:00
Haojun Liao
85a5c45098 fix(stream): limit the already processed data. 2023-09-10 00:01:25 +08:00
Haojun Liao
9a30573b8b fix(stream): disable scan wal when halt is set. 2023-09-09 16:12:08 +08:00
Haojun Liao
aa8909b267 other: add some logs. 2023-09-09 15:18:54 +08:00
Haojun Liao
6f5c855a4b fix(stream): fix msg lost bug. 2023-09-09 15:08:36 +08:00
Haojun Liao
47fd144447 other: add some logs. 2023-09-09 11:19:51 +08:00
yihaoDeng
af08289a06 Merge branch 'fix/mainNew' into fix/fixTransferCrash2 2023-09-08 19:58:21 +08:00
yihaoDeng
a0494695de fix merge error 2023-09-08 19:48:06 +08:00
Haojun Liao
b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
yihaoDeng
56706193eb add rpc update interface 2023-09-08 11:49:12 +08:00
yihaoDeng
27e3ee8f1d add rpc update interface 2023-09-07 21:10:05 +08:00
yihaoDeng
60d6a622e1 add rpc update interface 2023-09-07 20:47:10 +08:00
wangmm0220
842bb5742a fix:[TS-3922]rollback because cases failed & avoid atomic_store_64 core if parameters not aligned by 8 2023-09-07 19:26:33 +08:00
Benguang Zhao
55a9668908 fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord 2023-09-07 17:26:30 +08:00
Benguang Zhao
2d5b18039d fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord 2023-09-07 17:14:50 +08:00
wade zhang
3ea51721b9
Merge pull request #22797 from taosdata/fix/TD-25218-main 
Fix/TD-25218: adjust the error code returned when db does not exist
 2023-09-07 16:13:53 +08:00
wade zhang
d3f0c5ac3e
Merge pull request #22770 from taosdata/fix/TD-25445-main 
fix/TD-25445: search memory in ttlMgrFindExpired
 2023-09-07 16:13:32 +08:00
yihaoDeng
8c5fa3526a add rpc update interface 2023-09-07 16:10:07 +08:00
wangmm0220
c4898bffd8 fix:[TS-3922] make SStreamObj->->currentTick aligned by 8 2023-09-07 15:23:00 +08:00
Shungang Li
46af31539d fix: adjust the error code returned when db does not exist 2023-09-07 14:52:34 +08:00
yihaoDeng
f4f97a67f5 add rpc update interface 2023-09-07 14:24:26 +08:00
yihaoDeng
147de26eec add rpc update interface 2023-09-07 11:54:34 +08:00
Haojun Liao
55ac835294 Merge branch 'main' into fix/3_liaohj 2023-09-07 11:47:25 +08:00
Haojun Liao
b240e91c91 enh(stream): add token bucket to limit the rate of sink operation. 2023-09-07 09:58:48 +08:00
Shungang Li
a6ba7e678f fix: search memory in ttlMgrFindExpired 2023-09-07 09:33:26 +08:00
Haojun Liao
0f909285c4
Merge pull request #22684 from taosdata/mark/tmq-3.0 
fix:use vgstatus before if rebalance
 2023-09-07 09:20:27 +08:00
yihaoDeng
bc27d245b1 add rpc update interface 2023-09-06 21:54:31 +08:00
yihaoDeng
ad5639df89 add rpc update interface 2023-09-06 21:36:16 +08:00
Haojun Liao
2b84e0b02e refactor: check if the put data into queue is success or failed. 2023-09-06 19:39:00 +08:00
Haojun Liao
8edf86b3bb fix(stream): add some logs. 2023-09-06 19:08:09 +08:00
Haojun Liao
5ba6a68e7a fix(stream): fix syntax error. 2023-09-06 19:00:39 +08:00
Haojun Liao
a82027f492 enh(stream): pack multi-datablock into one submit message. 2023-09-06 18:58:47 +08:00
wade zhang
e493f983ed
Merge pull request #22735 from taosdata/fix/TD-26133 
fix: coverity scan
 2023-09-06 18:45:23 +08:00
Haojun Liao
f8a321695a
Merge pull request #22711 from taosdata/fix/TD-26069-1 
fix rc
 2023-09-06 17:58:33 +08:00
yihaoDeng
ac8220012c add rpc update interface 2023-09-06 17:22:30 +08:00
Hongze Cheng
1d343fa57e more fix 2023-09-06 17:10:36 +08:00
Haojun Liao
926cc01cff refactor: do some internal refactor. 2023-09-06 16:48:43 +08:00
yihaoDeng
b5d40d01bb add rpc update interface 2023-09-06 16:24:29 +08:00
dapan1121
ed9085281d
Merge pull request #22623 from taosdata/feat/TD-25964-3.0 
feat: get cpu cores from quota
 2023-09-06 16:03:33 +08:00
Hongze Cheng
cd88c8ec31 fix: little test 2023-09-06 14:45:53 +08:00
Haojun Liao
b382cba58c fix(stream): fix syntax error. 2023-09-06 14:37:58 +08:00
Haojun Liao
236b363996 fix(stream): fix syntax error. 2023-09-06 14:37:11 +08:00
Haojun Liao
8783ebcb02 enh(stream): add some logs and record the submit package performance. 2023-09-06 14:34:36 +08:00
Hongze Cheng
a6743a31b5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-26133 2023-09-06 14:12:21 +08:00
dapan1121
698b0b21f7
Merge pull request #22630 from taosdata/enh/TS-3812-3.0 
enh: report time series by period and quantity
 2023-09-06 13:38:24 +08:00
dapan1121
2bc8b3f7ee
Merge pull request #22625 from taosdata/enh/TD-23879-3.0 
enh: allow altering options to the same value
 2023-09-06 13:34:49 +08:00
Haojun Liao
e607a0a5cb fix(stream): add some logs. 2023-09-06 11:39:07 +08:00
wangmm0220
f209e31582 fix:send delete subscribe info to vnode if drop consumer 2023-09-06 11:16:03 +08:00
dmchen
231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
Haojun Liao
c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
yihaoDeng
393ef21348 add rpc update interface 2023-09-06 09:32:26 +08:00
yihaoDeng
6f6c517342 add rpc update interface 2023-09-05 21:00:01 +08:00
yihaoDeng
e539eebaa2 add rpc update interface 2023-09-05 18:50:11 +08:00
wangmm0220
ef87b9c571 fix:conflicts from 3.0 2023-09-05 16:19:04 +08:00
wangmm0220
4e46ce4c03 fix:wait pHandle idle if vnode receives subscribe msg 2023-09-05 16:04:44 +08:00
wade zhang
0517358a02
Merge pull request #22717 from taosdata/fix/TD-22062 
fix/TD-22062
 2023-09-05 16:04:12 +08:00
Haojun Liao
ac8f4f1558
Merge pull request #22736 from taosdata/fix/fixTransferCrash 
fix invalid read
 2023-09-05 15:42:03 +08:00
Haojun Liao
5dcbae3594
Merge pull request #22681 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-09-05 12:54:09 +08:00
yihaoDeng
d0503a8a3f fix invalid read 2023-09-05 12:11:58 +08:00
yihaoDeng
6257bf1e10 add rpc update interface 2023-09-05 12:03:23 +08:00
Hongze Cheng
8dbdeccc8f fix: coverity scan 2023-09-05 11:41:36 +08:00
Alex Duan
00c5760927
Merge pull request #22730 from taosdata/fix/test_1x 
test: add stream cases to 3.0
 2023-09-05 11:21:35 +08:00
dapan1121
4a5bcb5c80
Merge pull request #22650 from taosdata/szhou/ip-whitelist 
enhance: ip whitelist syntax
 2023-09-05 11:00:55 +08:00
wade zhang
8f27724f1f
Merge pull request #22701 from taosdata/fix/test_1x 
test: add stream cases to main
 2023-09-05 10:57:38 +08:00
Haojun Liao
0441c7a870 Merge branch 'fix/3_liaohj' of github.com:taosdata/tdengine into fix/3_liaohj 2023-09-05 10:40:48 +08:00
Haojun Liao
5b3cb8ec42 fix(stream): fix memory leak. 2023-09-05 09:27:16 +08:00
Haojun Liao
db8073dadd fix(stream): fix memory leak. 2023-09-04 23:13:57 +08:00
yihaoDeng
685bdea44a add rpc update interface 2023-09-04 21:15:46 +08:00
Haojun Liao
77eed06bcd
Merge branch '3.0' into fix/3_liaohj 2023-09-04 18:51:07 +08:00
dmchen
1a0480c834 fix/TD-22062 2023-09-04 17:14:29 +08:00
wangmm0220
90e938e48f fix:set vg status idle if reveive poll callback 2023-09-04 16:53:12 +08:00
Haojun Liao
aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao
ed22dd5f26 fix(stream): fix deadlock caused during merging branch. 2023-09-04 14:09:39 +08:00
Haojun Liao
375d0abea5 fix(stream): merge main. 2023-09-04 13:12:53 +08:00
Haojun Liao
21dab8ceab other: merge 3.0 2023-09-04 13:08:19 +08:00
yihaoDeng
03cddfa7ce fix rc 2023-09-04 10:33:01 +08:00
Haojun Liao
d73de8ba1e fix(stream): add null ptr check. 2023-09-02 16:44:21 +08:00
Haojun Liao
037a232bfa refactor: do some internal refactor. 2023-09-01 17:05:36 +08:00
wangmm0220
fd85d5885a fix:add limit time for consume in 1 seconds 2023-09-01 16:57:49 +08:00
wangmm0220
02ac3eac5a fix:logic error 2023-09-01 16:51:44 +08:00
yihaoDeng
5f78c27535 add enable white list 2023-09-01 15:11:25 +08:00
Haojun Liao
4fee5ba59a fix(stream): even in ck, start stream tasks. 2023-09-01 14:40:30 +08:00
yihaoDeng
832b78c0e8 Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 13:44:23 +08:00
dapan1121
cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
dapan1121
2141ac8460 Merge remote-tracking branch 'origin/main' into fix/m23.2 2023-09-01 11:21:38 +08:00
yihaoDeng
8b146f793d Merge branch '3.0' into szhou/ip-whitelist 2023-09-01 10:51:24 +08:00
Hongze Cheng
113867081e enh: upgrade more efficiently 2023-09-01 10:16:10 +08:00
dapan1121
228e6c6acd Merge remote-tracking branch 'origin/main' into 3.0 2023-09-01 10:01:10 +08:00
Haojun Liao
3765fbbba2 fix(stream): fix memory leak. 2023-09-01 09:59:56 +08:00
Haojun Liao
e8294ed8dc fix(stream): fix bug in multi-replica vnode redistribute. 2023-09-01 03:10:12 +08:00
Haojun Liao
fecba5b097 fix(stream): check for meta 2023-08-31 20:54:02 +08:00
Haojun Liao
95da66e3e8 fix(stream): fix error. 2023-08-31 20:50:12 +08:00
Haojun Liao
e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069 
fix invalid insert
 2023-08-31 18:29:25 +08:00
wade zhang
fcd3c6f109
Merge pull request #22668 from taosdata/feat/audit-table-namee 
Feat/audit table name
 2023-08-31 17:48:19 +08:00
wangmm0220
a02ab4ccfb fix:coredump if saved epoch bigger than request epoch & modify test cases 2023-08-31 17:35:41 +08:00
dmchen
03de7ad5a6 stream name 2023-08-31 16:44:36 +08:00
dmchen
12ffc58b7e password and topic name 2023-08-31 16:37:24 +08:00
yihaoDeng
1833be028f fix invalid insert 2023-08-31 15:28:31 +08:00
yihaoDeng
9fd0bff673 fix invalid insert 2023-08-31 14:57:26 +08:00
dmchen
9b7bbe0168 audit table name 2023-08-31 14:42:25 +08:00
Haojun Liao
92e258617a refactor: do some internal refactor. 2023-08-31 14:31:45 +08:00
Haojun Liao
e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao
69f95f9324 other: merge 3.0 2023-08-31 13:56:34 +08:00
Haojun Liao
3fc3dafca6 refactor: do some internal refactor. 2023-08-31 13:46:48 +08:00
Haojun Liao
3ed78ddadd
Merge pull request #22662 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-08-31 13:46:14 +08:00
Haojun Liao
8645f763b5
Merge pull request #22661 from taosdata/enh/reserve 
stream change ver
 2023-08-31 13:35:23 +08:00
yihaoDeng
83a5e2be4c stream change ver 2023-08-31 11:42:12 +08:00
wade zhang
2978efafa6
Merge pull request #22660 from taosdata/feat/audit-dropnode-no-ipport 
typo and remove ip port
 2023-08-31 11:05:02 +08:00
Haojun Liao
e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
Haojun Liao
0facde6ddc
Merge pull request #22659 from taosdata/fix/TD-26035 
fix(stream): do not restart the stream tasks when it is running.
 2023-08-31 10:16:59 +08:00
Haojun Liao
0c599fa869
Merge pull request #22415 from taosdata/szhou/tsdb-neigh-block 
tsdb neighbouring block search and set it to global block iterator
 2023-08-31 09:46:37 +08:00
yihaoDeng
05ca71d5de stream change ver 2023-08-31 09:28:43 +08:00
dmchen
22f0778cca typo and remove ip port 2023-08-31 09:26:44 +08:00
wangmm0220
7f2a9a7262 fix:cancel the limit time for consume 2023-08-31 09:07:40 +08:00
kailixu
f4dd1895b2 Merge branch '3.0' into feat/TD-25964-3.0 2023-08-31 08:56:53 +08:00
wade zhang
68e4a72021
Merge pull request #22643 from taosdata/feat/audit-user-typestr 
alter user type to str
 2023-08-31 07:59:31 +08:00
wangmm0220
4f20359f43 fix:modify log level to trace 2023-08-30 23:57:48 +08:00
Haojun Liao
a2c6e4306a fix(stream): reset the counter. 2023-08-30 20:20:20 +08:00
Haojun Liao
fd2f988cdb fix(stream): reset the counter. 2023-08-30 20:19:51 +08:00
Haojun Liao
5d23df100c fix(stream): ignore the fill-history tasks. 2023-08-30 19:07:06 +08:00
Haojun Liao
65eaa9b15f fix(stream): add task release. 2023-08-30 19:06:12 +08:00
wangmm0220
23c4d7eb0a fix:dead lock 2023-08-30 18:10:19 +08:00
dmchen
3d9274d713 create table db name 2023-08-30 17:28:03 +08:00
Haojun Liao
d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
slzhou
82dc2de2f4 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-30 17:11:42 +08:00
dmchen
623660d012 enhance 2023-08-30 16:17:13 +08:00
dmchen
04a89b4a49 long fields 2023-08-30 16:03:57 +08:00
Haojun Liao
c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao
24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
dmchen
63e2926a60 topic 2023-08-30 15:26:54 +08:00
kailixu
eb7d2d495a chore: supports obtaining physical/virtual CPU cores 2023-08-30 15:21:03 +08:00
dapan1121
718f97e506
Merge pull request #22640 from taosdata/fix/m23.1 
Fix/m23.1
 2023-08-30 14:58:40 +08:00
liuyao
0a72e576bd op stream pause 
pause data dispatch

opt stream pause
 2023-08-30 14:53:49 +08:00
slzhou
1ab94d0992 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ip-whitelist 2023-08-30 14:42:26 +08:00
dmchen
7790afd85d fields 2023-08-30 13:13:05 +08:00
dmchen
b9f77798a2 alter user type to str 2023-08-30 12:06:11 +08:00
kailixu
1a34cd1020 chore: optimize of report time series by quantity 2023-08-30 11:45:07 +08:00
wade zhang
bec05f2677
Merge pull request #22638 from taosdata/feat/TD-26033 
TD-26033
 2023-08-30 11:40:44 +08:00
kailixu
8e20740622 enh: report time series by quantity 2023-08-30 11:39:21 +08:00
wade zhang
bbed968256
Merge pull request #22617 from taosdata/FIX/TD-25995-3.0 
enh: adjust criteria of completion to retrieve SShowObj info from mnode in mndProcessSysTableReq
 2023-08-30 11:33:13 +08:00
dapan1121
f6321d0c4f Merge remote-tracking branch 'origin/main' into fix/m23.1 2023-08-30 11:03:33 +08:00
Haojun Liao
dec4d69529 fix(stream): set correct user-define table name in sink table info cache. 2023-08-30 10:52:39 +08:00
dmchen
7bea92cbf9 TD-26033 2023-08-30 10:28:39 +08:00
Haojun Liao
3a7a220d43 fix(stream): fix error found by ci. 2023-08-30 10:14:01 +08:00
wade zhang
782c936ee8
Merge pull request #22635 from taosdata/feat/audit-dbname 
audit-dbname
 2023-08-30 09:55:48 +08:00
kailixu
9d1ac801ed Merge branch '3.0' into enh/TS-3812-3.0 2023-08-30 09:27:17 +08:00
Haojun Liao
610132e29a
Merge pull request #22633 from taosdata/fix/update_db_attr 
fix(tsdb): add more check for block rows
 2023-08-29 22:05:57 +08:00
wade zhang
701ac939c1
Merge pull request #22632 from taosdata/fix/ttl 
fix/TD-26032: ttl cache entry record the original information for deletion
 2023-08-29 18:27:50 +08:00
Haojun Liao
8dadae5d3a fix(stream): fix invalid read. 2023-08-29 18:24:32 +08:00
dmchen
bb33620f5c dbname 2023-08-29 18:12:08 +08:00
Haojun Liao
d6368798da fix(query): disable the set quit flag for tsdbreader. 2023-08-29 18:11:17 +08:00
Benguang Zhao
dbeafb508b fix: reset show obj iter on no more data to read in mndRetrieveIdx 2023-08-29 17:56:24 +08:00
Haojun Liao
b740ce8ad6 fix(tsdb): add more check for block rows to detect the duplicate rows in data block. 2023-08-29 17:49:43 +08:00
kailixu
3036b78910 Merge branch '3.0' into enh/TD-23879-3.0 2023-08-29 17:43:14 +08:00
shenglian zhou
33966cf856 enhance: continue coding 2023-08-29 17:35:03 +08:00
Haojun Liao
204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
Shungang Li
df2b2484df fix: ttl cache entry record the original information for deletion 2023-08-29 17:18:22 +08:00
Minglei Jin
82fc1f41fb fix(tsdb/cache read): remove all null row 2023-08-29 16:15:00 +08:00
kailixu
f00596868f fix: remove duplicated line 2023-08-29 16:12:49 +08:00
kailixu
db07511c93 enh: report time series by period and quantity 2023-08-29 16:08:51 +08:00
Benguang Zhao
a6455672c0 fix: check completeness of retrieval properly in mndProcessRetrieveSysTableReq 2023-08-29 15:47:11 +08:00
wade zhang
53a24e04f2
Merge pull request #22604 from taosdata/feat/audit-db-detail 
audit db detail
 2023-08-29 15:46:10 +08:00
kailixu
523994d93b enh: allow altering options to the same value 2023-08-29 15:15:07 +08:00
Haojun Liao
c3e9590740 fix(stream): fix error. 2023-08-29 15:11:01 +08:00
Benguang Zhao
5e5b7a3328 fix: reserve enough space of show Obj rows for vnodes of each vgroup in mndRetrieveVnodes 2023-08-29 12:07:52 +08:00
Haojun Liao
6e4acddd96
Merge pull request #22603 from taosdata/fix/TD-25962 
fix:unregister push manager if delete subscribe to avoid tqProcessPol…
 2023-08-29 10:58:49 +08:00
Minglei Jin
432eaf5110 Merge branch '3.0' into fix/TD-25963 2023-08-29 10:51:53 +08:00
Minglei Jin
b88d79d2ef fix(tsdb/open fs): fix retval 2023-08-29 10:33:20 +08:00
wade zhang
ff6de8ebe2
Merge pull request #22600 from taosdata/fix/TD-25010-10 
enh(s3/evict): evict cache data files for other migrated head, stt, etc.
 2023-08-28 18:12:40 +08:00
dmchen
1372cede48 init 2023-08-28 17:44:10 +08:00
dapan1121
778e50da79
Merge pull request #22592 from taosdata/fix/m23.0 
Fix/m23.0
 2023-08-28 17:35:35 +08:00
wangmm0220
2e04d513a4 fix:unregister push manager if delete subscribe to avoid tqProcessPollPush 2023-08-28 16:41:28 +08:00
Minglei Jin
9ef455a454 enh(s3/evict): evict cache data files for other migrated head, stt, etc. 2023-08-28 15:57:13 +08:00
Haojun Liao
05bb164675 fix(stream): release tasks. 2023-08-28 15:56:02 +08:00
Haojun Liao
391103bc5a fix(stream): do dome internal refactor. 2023-08-28 15:54:01 +08:00
Haojun Liao
33672f2f35 fix(stream): release stream tasks. 2023-08-28 15:52:54 +08:00
wade zhang
cd3702e91c
Merge pull request #22596 from taosdata/fix/TD-25963 
fix(tsdb/s3): fix scan and fix with s3 files
 2023-08-28 15:19:47 +08:00
Minglei Jin
f299ae9bc3 fix(tsdb/s3): fix scan and fix with s3 files 2023-08-28 12:22:53 +08:00
wade zhang
1797fe50e2
Merge pull request #22590 from taosdata/feat/TD-18801 
init
 2023-08-28 11:05:38 +08:00
Haojun Liao
da0b4e1f92 Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-28 10:55:38 +08:00
wade zhang
e95c9d5fdc
Merge pull request #22591 from taosdata/feat/TD-18572 
feat/TD-18572: dynamic 'supportvnodes'
 2023-08-28 10:46:44 +08:00
dapan1121
0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
Haojun Liao
b75ae217f6 fix(stream): notify close for snode. 2023-08-28 09:53:08 +08:00
Haojun Liao
88f6596965
Merge pull request #22464 from taosdata/feat/TD-18789 
feat:support varbinary type
 2023-08-28 09:45:57 +08:00
Haojun Liao
b11975f00c
Merge pull request #22534 from taosdata/mark/tmq 
fix:[TD-258900]modify tmq trans conflict to db level
 2023-08-28 09:45:47 +08:00
dapan1121
1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
Shungang Li
0c28c9aee8 feat: dynamic 'supportvnodes' 2023-08-28 09:17:35 +08:00
dmchen
06083e1eb9 init 2023-08-28 09:15:51 +08:00
dapan1121
cda08087b9
Merge pull request #22586 from taosdata/fix/TD-25936.3 
fix: no explain response issue
 2023-08-28 08:52:13 +08:00
Haojun Liao
6b327886e9 fix(stream): add null ptr check. 2023-08-27 00:27:04 +08:00
wangmm0220
8b745de397 fix:transaction error 2023-08-26 00:43:47 +08:00
Haojun Liao
d8a6ec024a Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 19:21:00 +08:00
Haojun Liao
7ceb8dc627 fix(stream): disable the follower to execute the stop/resume instruction. 2023-08-25 19:20:49 +08:00
yihaoDeng
22b8d90fbc fix invalid read 2023-08-25 18:34:11 +08:00
wangmm0220
047707fa17 fix:error in privilege 2023-08-25 17:56:17 +08:00
Haojun Liao
43a3f9f535 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 17:32:50 +08:00
Haojun Liao
e013ba6795 fix(stream): fix the counter. 2023-08-25 17:32:34 +08:00
Minglei Jin
f0fdbaa3f3 fix(tsdb/close): fix uaf with file closing 2023-08-25 17:27:32 +08:00
Haojun Liao
60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
wangmm0220
26e025d78d feat:[TD-18789]support varbinary type 2023-08-25 15:43:45 +08:00
Haojun Liao
f951635602 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 15:33:08 +08:00
Haojun Liao
ab2aad2b2c fix(stream): update the task status even it is in stop status. 2023-08-25 15:32:55 +08:00
dapan1121
e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
liuyao
7d44b7e4cb mem leak 2023-08-25 14:53:29 +08:00
Hongze Cheng
e1095e7d02 fix: improve upgrade speed 2023-08-25 14:40:29 +08:00
Haojun Liao
4c7ad54c9c fix(stream): not restart tasks when in restoring procedure. 2023-08-25 11:28:28 +08:00
Haojun Liao
38bb123701 fix(stream): release task. 2023-08-25 10:33:15 +08:00
Haojun Liao
ce1a3a379c fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived. 2023-08-25 10:12:12 +08:00
Haojun Liao
f805a49df2
Merge pull request #22555 from taosdata/fix/TD-25948 
mem leak
 2023-08-25 09:28:18 +08:00
Haojun Liao
6f514b2bee
Merge pull request #22561 from taosdata/fix/TD-25651 
fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no…
 2023-08-25 09:09:41 +08:00
wade zhang
abe97e1e21
Merge pull request #22566 from taosdata/fix/TD-25952 
enh(tsdb/openfile): lazy file open to read/write
 2023-08-25 07:57:52 +08:00
Haojun Liao
f7ea875af1 fix(stream): add some logs. 2023-08-24 23:27:48 +08:00
Haojun Liao
f7dada53b9
Merge pull request #22559 from taosdata/fix/liaohj 
other: merge main.
 2023-08-24 19:01:18 +08:00
wangmm0220
cca00406a5 fix:drop topic error if topic not exist 2023-08-24 18:16:57 +08:00
Haojun Liao
82e356a9b5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/vnode/src/tq/tq.c
 2023-08-24 18:04:44 +08:00
Haojun Liao
70396aa5a5 fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure. 2023-08-24 17:54:50 +08:00
yihaoDeng
286ac3e3fc fix merge error 2023-08-24 17:35:53 +08:00
yihaoDeng
9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
yihaoDeng
8883d66227 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-24 17:20:12 +08:00
yihaoDeng
090515c684 refactor code 2023-08-24 17:20:04 +08:00
Haojun Liao
caf20d7b5d fix(stream): release the stream task. 2023-08-24 17:16:34 +08:00
Minglei Jin
70871139bf enh(tsdb/openfile): lazy file open to read/write 2023-08-24 17:16:28 +08:00
wangmm0220
b83cc11043 fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no data 2023-08-24 16:38:53 +08:00
wangmm0220
89884e1c49 fix:transaction in tmq 2023-08-24 16:34:52 +08:00
liuyao
a72e6fd219 mem leak 2023-08-24 16:32:34 +08:00
wangmm0220
49216ffa54 fix:transaction in tmq 2023-08-24 16:32:15 +08:00
Haojun Liao
7d9d4ae850 fix(stream): fix the ptr ref. 2023-08-24 16:26:30 +08:00
Haojun Liao
5344efe181 fix(stream): adjust the ptr. 2023-08-24 16:22:24 +08:00
Haojun Liao
4c6bc4d2c3 fix(stream): continue check wal when meeting empty delete block msg. 2023-08-24 16:10:03 +08:00
Haojun Liao
523bad3951 fix(stream): continue check wal when meeting empty delete block msg. 2023-08-24 15:45:43 +08:00
Haojun Liao
2c9f28d97f Merge branch 'main' into fix/liaohj 2023-08-24 14:12:15 +08:00
wangjiaming0909
366a9cc009 Revert "feat: support column comment" 
This reverts commit dcbef83dea.
 2023-08-24 13:54:27 +08:00
wangjiaming0909
7fad1de841 Revert "feat: show create table, desc table with col comments" 
This reverts commit 16754b5ac1.
 2023-08-24 13:38:41 +08:00
wade zhang
0860670d37
Merge pull request #22526 from taosdata/enh/TD-25445-new 
enh/TD-25445: ttl split flush and drop table
 2023-08-24 13:57:07 +08:00
shenglian-zhou
e76e6bbb84
Update tsdbReadUtil.c 2023-08-24 11:34:56 +08:00
shenglian-zhou
1965703d53
Merge branch '3.0' into szhou/tsdb-neigh-block 2023-08-24 10:58:23 +08:00
yihaoDeng
3afea998ac refactor log 2023-08-24 10:15:15 +08:00
wangmm0220
be74370e98 fix:memory leak 2023-08-24 09:25:26 +08:00
wangmm0220
775f0668c5 fix:[TD-258900]modify tmq trans conflict to db level 2023-08-24 09:25:26 +08:00
wangmm0220
8f3956cc67 fix:[TD-258900]modify tmq trans conflict to db level 2023-08-24 09:25:26 +08:00
wangmm0220
4591f24746 fix:memory leak 2023-08-23 19:41:02 +08:00
Haojun Liao
809d3087ff Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
 2023-08-23 17:53:50 +08:00
Haojun Liao
230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
wangmm0220
f19c1ea3fe fix:[TD-258900]modify tmq trans conflict to db level 2023-08-23 16:46:33 +08:00
wangmm0220
8fc8aad1b5 fix:[TD-258900]modify tmq trans conflict to db level 2023-08-23 16:44:29 +08:00
yihaoDeng
5b621fc0c5 fix mem leak 2023-08-23 16:32:32 +08:00
yihaoDeng
ccb675fe2b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-23 14:27:35 +08:00
yihaoDeng
faa4bbcaca fix mem leak 2023-08-23 14:26:45 +08:00
Haojun Liao
b0c5fa8290 fix(stream): reset the task status. 2023-08-23 14:10:41 +08:00
Hongze Cheng
a601cd21bd fix: alter stt_trigger bug 2023-08-23 13:31:19 +08:00
Shungang Li
458fd07976 enh: ttl split flush and drop table 
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
 2023-08-23 11:13:34 +08:00
wade zhang
8c4062c1b0
Merge pull request #22515 from taosdata/fix/TD-25819-2 
fix(tsdb/file): save errno for shell reporting
 2023-08-23 10:49:48 +08:00
wade zhang
e069d72229
Merge pull request #22513 from taosdata/FIX/TD-25864-3.0 
enh: adjust the order of pre-close actions in vnodePreClose
 2023-08-22 17:27:17 +08:00
Haojun Liao
000e39aa18 fix(stream): add one more check. 2023-08-22 15:52:29 +08:00
Haojun Liao
af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Minglei Jin
345743aba5 fix(tsdb/file): save errno for shell reporting 2023-08-22 14:44:32 +08:00
Haojun Liao
cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Benguang Zhao
8be670aee8 enh: place vnodeSyncPreStop ahead of vnodeQueryPreStop in vnodePreClose 2023-08-22 11:30:40 +08:00
dmchen
9f004c209a keep version change 2023-08-22 11:28:50 +08:00
Haojun Liao
64556c9f1d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 10:47:02 +08:00
Haojun Liao
def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen
b899a8b7df
Merge branch '3.0' into feat/TD-22970 2023-08-22 10:12:30 +08:00
yihaoDeng
1531e2d7d3 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 09:51:38 +08:00
Haojun Liao
873c22abb1 fix(stream): reset update stream tasks. 2023-08-21 19:32:27 +08:00
wade zhang
1a0ebb7ed9
Merge pull request #22502 from taosdata/feat/clean_useless_file 
feat: clean useless file
 2023-08-21 19:20:04 +08:00
Haojun Liao
8b27f98ee4 refactor: do some internal refactor. 2023-08-21 19:08:27 +08:00
yihaoDeng
387b4d365e refactor checkpoint 2023-08-21 19:07:15 +08:00
Hongze Cheng
b8d62a86ed feat: clean useless file 2023-08-21 16:29:48 +08:00
wade zhang
501c86f858
Merge pull request #22488 from taosdata/FIX/TD-25762-3.0 
enh: ensure transactional atomicity of db names in create database
 2023-08-21 16:04:58 +08:00
Haojun Liao
fbd67ce977 fix(stream): fix memory leak. 2023-08-21 11:50:53 +08:00
Haojun Liao
99024e9d78 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-21 11:49:08 +08:00
Haojun Liao
29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
Benguang Zhao
d3ce0c1f80 fix: ensure creating status of create-db before completion 2023-08-21 11:46:25 +08:00
dm chen
dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
yihaoDeng
d934d91fb1 refactor checkpoint 2023-08-21 10:34:08 +08:00
dapan1121
fb80d6d36c
Merge pull request #22471 from taosdata/fix/m/TD-24871 
fix: get systable cols error
 2023-08-21 10:03:10 +08:00
wade zhang
54e1f69db4
Merge pull request #22481 from taosdata/fix/TD-25822 
enh(tsdb/write): timestamp out of range with s3's last tier storage
 2023-08-21 09:33:06 +08:00
yihaoDeng
6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao
b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Benguang Zhao
f30d1ebacd enh: refactor func name as mndTransAppendPrepareLog 2023-08-18 18:35:44 +08:00
Benguang Zhao
9f1c8cc7b8 enh: unify validation of prepare actions with cb validateFp 2023-08-18 18:21:30 +08:00
Minglei Jin
c4a3a5da35 vnode: fix write to s3 last tier 2023-08-18 18:02:53 +08:00
wade zhang
a7e11c2520
Merge pull request #22482 from taosdata/fix/TD-25818 
fix(vnode/destroy): delete objects
 2023-08-18 17:49:22 +08:00
Benguang Zhao
e7411183d9 enh: create SDB_DB entry in prepareAction 2023-08-18 17:08:24 +08:00
Haojun Liao
41fe441dad fix(stream): update the conflict scope. 2023-08-18 17:00:35 +08:00
wade zhang
87a8fe34ef
Merge pull request #22480 from taosdata/fix/TD-25819 
fix(tsdb/reader): use ENOENT for not found objects
 2023-08-18 16:49:54 +08:00
Minglei Jin
7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
Minglei Jin
0242d4ce33 enh(tsdb/write): timestamp out of range with s3's last tier storage 2023-08-18 16:07:15 +08:00
Haojun Liao
c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
Minglei Jin
73ae493fa7 tsdb/reader: use ENOENT for not found objects 2023-08-18 15:43:08 +08:00
liuyao
9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao
87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121
9b953707b8 Merge remote-tracking branch 'origin/main' into fix/mainto3.0 2023-08-18 14:42:43 +08:00
Benguang Zhao
f01a26f68a enh: refactor func names of new Vg prepare actions 2023-08-18 14:26:58 +08:00
Haojun Liao
edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
dm chen
e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
Haojun Liao
f68650fef9 other: add logs. 2023-08-18 10:53:58 +08:00
Haojun Liao
a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao
633ecf66e5 other: add logs. 2023-08-18 10:39:32 +08:00
Haojun Liao
9ad8cf48dc other: add logs. 2023-08-18 10:38:24 +08:00
Haojun Liao
2a9668da67 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
 2023-08-18 10:30:30 +08:00
Haojun Liao
87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
wangjiaming0909
4dcdb549c9 fix: get systable cols error 2023-08-18 10:19:12 +08:00
Haojun Liao
fbf80fb4c3
Merge pull request #22459 from taosdata/mark/tmq 
fix:set terrno = 0 to avoid affect next fetch msg
 2023-08-18 09:11:35 +08:00
slzhou
4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
yihaoDeng
80f6d092a1 add trace log 2023-08-18 08:43:37 +08:00
yihaoDeng
ebd4cac36b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-17 18:58:18 +08:00
yihaoDeng
46574c385f fix mem leak 2023-08-17 18:52:33 +08:00
Haojun Liao
a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
Hongze Cheng
8582e0c71a fix: important fix for compact file corruption 2023-08-17 18:13:37 +08:00
dmchen
5f138941f8 tsdb snap core 2023-08-17 17:58:35 +08:00
slzhou
85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
Benguang Zhao
7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou
4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121
0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685 
feat: support column comment
 2023-08-17 14:23:54 +08:00
Benguang Zhao
9b089d6446 enh: wrap state updating of vnodes and mnodes in mndProcessStatusReq 2023-08-17 11:59:53 +08:00
dmchen
4448e7d159 revert drop vnode 2023-08-17 11:57:17 +08:00
kailixu
49efb4ae72 fix: modify column length for super table 2023-08-17 11:43:07 +08:00
wangjiaming0909
16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
liuyao
5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
wade zhang
e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug 
fix: tsdb snapshot bug
 2023-08-17 08:25:32 +08:00
Haojun Liao
6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
 2023-08-17 00:08:44 +08:00
Haojun Liao
ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao
f8f8e7a8f0
Merge pull request #22465 from taosdata/fix/3_liaohj 
fix(stream): add the back pressure for sink node.
 2023-08-16 22:59:36 +08:00
Benguang Zhao
a94b8aeea6 feat: update vnodesSchema and mndRetrieveVnodes for show vnodes 2023-08-16 20:17:11 +08:00
yihaoDeng
114df7c349 fix transfer error 2023-08-16 11:37:15 +00:00
wangmm0220
b3f945c4c5 fix:conflict 2023-08-16 19:35:05 +08:00
Haojun Liao
80506b564b
Merge pull request #22461 from taosdata/fix/liaohj 
refactor: do some internal refactcor
 2023-08-16 19:26:39 +08:00
Haojun Liao
9a76ae72d6 fix(stream): add the back pressure for sink node. 2023-08-16 19:11:43 +08:00
dmchen
d85d698074 drop vnode 2023-08-16 18:48:12 +08:00
Hongze Cheng
32c5b6a947 fix: tsdb snapshot bug 2023-08-16 18:21:02 +08:00
Haojun Liao
cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
dmchen
fee4b875d1 error code 2023-08-16 17:49:17 +08:00
wangmm0220
5c5721571f fix:set terrno = 0 to avoid affect next fetch msg 2023-08-16 17:45:18 +08:00
Hongze Cheng
cedc7bf1b6 fix: memory leak when commit 2023-08-16 17:21:51 +08:00
yihaoDeng
ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen
e020c4e8c5
Merge pull request #22456 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-16 16:49:43 +08:00
Haojun Liao
f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-16 16:48:33 +08:00
Haojun Liao
d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
yihaoDeng
993ae84398 close backend 2023-08-16 07:17:15 +00:00
dapan1121
39ae880597
Merge pull request #22445 from taosdata/enh/TD-25708-3.0 
enh: disable stream/udf on windows
 2023-08-16 13:20:01 +08:00
Haojun Liao
4ea58e5682 refactor: do some internal refactor. 2023-08-16 11:44:05 +08:00
Haojun Liao
6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
dmchen
de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
liuyao
919ffbaf72 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 10:04:07 +08:00
Benguang Zhao
33cb9dce78 enh: set roleTimeMs default as statusReq.rebootTime for both of vnodes and mnodes 2023-08-16 09:57:26 +08:00
kailixu
777ece27ae chore: code format 2023-08-16 09:56:25 +08:00
kailixu
b54d6e2982 chore: set default value of tsStartUdfd false on windows 2023-08-16 09:55:30 +08:00
Haojun Liao
63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0 
rebuild index at tag0
 2023-08-16 09:47:43 +08:00
liuyao
fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
Haojun Liao
ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao
7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
dapan1121
df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt 
enhance: tag scan optimization
 2023-08-16 08:58:17 +08:00
wade zhang
1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3 
feat(tsdb/cos): s3 migration
 2023-08-16 08:02:20 +08:00
Benguang Zhao
94e0d97aa2 enh: update pDb stateTs on stateChanged 2023-08-15 19:48:15 +08:00
Benguang Zhao
dbdfee4c41 enh: update SVnodeGid of vnode info in mndProcessStatusReq 2023-08-15 19:25:08 +08:00
slzhou
4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
dmchen
18ef0f7d82 vgroup version 2023-08-15 17:13:58 +08:00
Benguang Zhao
239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
kailixu
ccce04ceb9 enh: disable udf on windows 2023-08-15 17:01:45 +08:00
Minglei Jin
1792bf306e vnode: fix cos cache evicting 2023-08-15 16:54:26 +08:00
wangjiaming0909
dcbef83dea feat: support column comment 2023-08-15 16:30:02 +08:00
kailixu
242bf77f4c chore: code optimization 2023-08-15 16:13:51 +08:00
kailixu
8a84dce641 enh: disable udf/stream/rsma/tsma for windows 2023-08-15 16:04:30 +08:00
Haojun Liao
39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Minglei Jin
c4e5cfd2fb retention: return code from copy 2023-08-15 15:40:40 +08:00
yihaoDeng
0f0d0953cd rebuild index at tag0 2023-08-15 07:26:53 +00:00
Minglei Jin
bd758e0269 retention: remove old files last 2023-08-15 15:14:34 +08:00
Minglei Jin
8639c22cc0 vnode, common: USE_COS def 2023-08-15 14:53:58 +08:00
dmchen
f0090cf799 vgroup version 2023-08-15 14:46:54 +08:00
kailixu
27db6cfd67 enh: disable udf/stream for mnd on windows 2023-08-15 14:25:31 +08:00
liuyao
1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
wangmm0220
7441801e9d feat:support varbinary type 2023-08-15 13:57:05 +08:00
kailixu
f7a5bef17d enh: disable stream/udf on windows 2023-08-15 13:02:32 +08:00
yihaoDeng
9ec64b9201 rebuild index at tag0 2023-08-15 02:01:13 +00:00
Haojun Liao
b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao
ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq 
opti:wal logic
 2023-08-15 09:16:29 +08:00
dapan1121
f9f74eaaf4
Merge pull request #22406 from taosdata/fix/TD-24684 
fix: remove ins_modules table
 2023-08-15 08:42:08 +08:00
yihaoDeng
ef7f762c62 rebuild index at tag0 2023-08-15 00:41:48 +00:00
yihaoDeng
1447d1d55c rebuild index at tag0 2023-08-15 00:40:12 +00:00
Haojun Liao
9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559 
feat:[TD-24559]support geomety type in schemaless
 2023-08-14 22:06:41 +08:00
yihaoDeng
3067417ea3 rebuild index at tag0 2023-08-14 12:01:17 +00:00
yihaoDeng
a48d137d32 rebuild index at tag0 2023-08-14 11:56:47 +00:00
yihaoDeng
1d33a8d4c0 rebuild index at tag0 2023-08-14 10:06:33 +00:00
liuyao
9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
Haojun Liao
2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
yihaoDeng
cf9f9ab471 rebuild index at tag0 2023-08-14 08:01:20 +00:00
dmchen
8fd6b122d3 mnode ver 2023-08-14 15:26:59 +08:00
Haojun Liao
a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Minglei Jin
989abc2bf6 vnode/cos: move includes into USE_COS 2023-08-14 15:03:17 +08:00
Haojun Liao
91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Minglei Jin
c97b9249fc cos: only for linux 2023-08-14 14:38:28 +08:00
slzhou
692d436d68 fix: fix ci error 2023-08-14 14:14:16 +08:00
Haojun Liao
5ec6b64aab fix(stream): add logs. 2023-08-14 13:12:41 +08:00
Haojun Liao
ead04964fd Merge branch 'main' into fix/liaohj 2023-08-14 12:11:15 +08:00
dapan1121
c2417eb5cd
Merge pull request #22404 from taosdata/fix/TD-25621-3.0 
fix: dup read lock on windows
 2023-08-14 11:37:05 +08:00
Haojun Liao
2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
Haojun Liao
1f792f09c4 fix(stream): remove invalid code. 2023-08-14 10:39:47 +08:00
slzhou
646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
yihaoDeng
246efd83c6 refactor chpt transfer 2023-08-14 02:03:41 +00:00
wangmm0220
dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
wade zhang
1b51f53c15
Merge pull request #22407 from taosdata/fix/TD-25671 
fix: infinite tomb data sync loop
 2023-08-14 09:25:47 +08:00
shenglian zhou
46f92d222d fix: typo error 2023-08-14 08:52:25 +08:00
shenglian zhou
db25f6c01b Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block 2023-08-14 08:49:25 +08:00
shenglian zhou
c5a6cac34f fix: fix compilation error 2023-08-14 08:49:10 +08:00
Haojun Liao
01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj 
refactor: refactor the transfer state procedure.
 2023-08-13 23:28:18 +08:00
Haojun Liao
98f40325e9 fix(stream): fix memory leak. 2023-08-13 20:02:15 +08:00
slzhou
8e7fc91095 enhance: set file data block iter 2023-08-13 18:30:30 +08:00
Haojun Liao
0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao
ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
wangmm0220
efb472d54a fix:heap use after free 2023-08-12 10:15:40 +08:00
Haojun Liao
f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
wangmm0220
767563752a opti:wal logic 2023-08-11 20:21:13 +08:00
wangmm0220
deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
Hongze Cheng
847bc0da08 fix: infinite tomb data sync loop 2023-08-11 18:10:16 +08:00
slzhou
47d2f9ad6d fix: first run without tag cond 2023-08-11 17:52:52 +08:00
wangmm0220
7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou
42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
Minglei Jin
84452c8dee cos: use static sdk 2023-08-11 16:36:53 +08:00
shenglian zhou
eb9d77d639 ehance: destroy blocklist of table scan info, add block global index list to table scan info 2023-08-11 16:33:49 +08:00
Haojun Liao
87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng
6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao
e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
dapan1121
8987553d9c fix: remove ins_modules 2023-08-11 15:56:38 +08:00
wangmm0220
25e32bbf7c fix:offset error in tmq & add test cases 2023-08-11 14:25:12 +08:00
Haojun Liao
ba7825141f fix(stream): enable the checkpoint . 2023-08-11 13:33:14 +08:00
Haojun Liao
9322f80343 fix(stream): register the rsp callback. 2023-08-11 13:31:50 +08:00
kailixu
64a1636dd2 chore: trigger CI 2023-08-11 12:54:45 +08:00
kailixu
1d089fe085 fix: dup read lock on windows 2023-08-11 11:34:57 +08:00
yihaoDeng
99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao
1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao
6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng
ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
Haojun Liao
d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq 
fix:offset error in tmq & add test cases
 2023-08-11 10:00:08 +08:00
Minglei Jin
4513acfee9 cos: use static libs for mxml, apr, apu, curl 2023-08-11 09:54:54 +08:00
yihaoDeng
32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
shenglian zhou
b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
wangmm0220
78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
Minglei Jin
c04ada3573 cos: link with static libs 2023-08-10 15:28:22 +08:00
Minglei Jin
cd63e81450 cos: separate building phase for apr & apr-util 2023-08-10 14:18:12 +08:00
dm chen
dd271bca6d
Merge pull request #22394 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-10 14:14:22 +08:00
Haojun Liao
a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
Haojun Liao
161fd6902a fix(stream): fix the acquire task. 2023-08-10 12:45:20 +08:00
Minglei Jin
33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao
f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao
b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-10 11:43:02 +08:00
yihaoDeng
ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao
c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao
4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao
0757e88ced fix(stream): set the correct hash keys. 2023-08-09 23:52:14 +08:00
Haojun Liao
7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
wangmm0220
1f5532fd67 fix:offset error in tmq & add test cases 2023-08-09 19:41:22 +08:00
Haojun Liao
d34b9af054 enh(stream): create update stream trans. 2023-08-09 19:38:13 +08:00
Hui Li
10f5d223bb
Merge pull request #22370 from taosdata/FIX/TD-25605-3.0 
enh: check if disk space sufficient at primary dir with tfs
 2023-08-09 18:32:07 +08:00
Minglei Jin
a853d9d40c mxml: use ~/local/include 2023-08-09 18:21:55 +08:00
Haojun Liao
1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao
4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao
1d649bccb6
Merge pull request #22372 from taosdata/fix/TD-25626 
fix taosd cannot quit
 2023-08-09 15:46:14 +08:00
Hui Li
584427dd44
Merge pull request #22374 from taosdata/szhou/restore-minglei-main 
fix: restore stt/block merge back
 2023-08-09 14:40:03 +08:00
Minglei Jin
b08d5b4d42 mxml: add include dir to vnode 2023-08-09 14:02:10 +08:00
Minglei Jin
7e2859ed43 apr: use tarball to avoid ./buildconf 2023-08-09 13:03:37 +08:00
Haojun Liao
3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
Minglei Jin
2e0519b960 apr: fix apr & apr-util project names 2023-08-09 11:01:42 +08:00
Minglei Jin
7114ad63e5 apr：makefile for apr & apr-util 2023-08-09 10:54:17 +08:00
Minglei Jin
4d1155a5cf curl: makefile for curl 2023-08-09 10:43:27 +08:00
shenglian zhou
e9e06d1eae fix: restore stt block/data block merge back 2023-08-09 10:36:54 +08:00
shenglian zhou
2b1478f46e Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-09 10:36:26 +08:00
Haojun Liao
f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
Minglei Jin
16e015253b s3/mxml: remove os external dependency 2023-08-09 10:10:25 +08:00
yihaoDeng
fb7dec00e1 support reopen stream state 2023-08-09 01:50:49 +00:00
Haojun Liao
bb39d94f9c
Merge pull request #22357 from taosdata/fix/liaohj 
other: merge fix from 3.0 to main.
 2023-08-09 09:05:54 +08:00
yihaoDeng
cfb5247e30 change var name 2023-08-09 00:46:18 +00:00
Hui Li
8d7e8f5734
Merge pull request #22336 from taosdata/fix/TD-25445 
fix/TD-25445: alter ttlChangeOnWrite note info
 2023-08-08 18:19:02 +08:00
Benguang Zhao
e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
wangmm0220
d322cfce50 fix:add hashIteratorCancel for hash iterator 2023-08-08 16:28:51 +08:00
Haojun Liao
17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Hongze Cheng
c8f106106a fix: update assert issue 2023-08-08 14:49:05 +08:00
Hui Li
4f03ae2c65
Merge pull request #22335 from taosdata/temp/open_case 
open split vgroup case
 2023-08-08 11:49:28 +08:00
Haojun Liao
a0dcec5890 enh(stream): add function handler for hb message. 2023-08-08 11:23:19 +08:00
dm chen
70a598f072
Merge pull request #22355 from taosdata/3.0 
merge 3.0 to TD-22970
 2023-08-08 09:53:07 +08:00
dapan1121
44717ddbea
Merge pull request #22288 from taosdata/fix/3.0/TD-25499 
fix: memory leak when drop db which acquired by user with grant/revoke
 2023-08-08 09:29:55 +08:00
Hui Li
05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612 
fix: snapshot invalid read
 2023-08-08 09:19:55 +08:00
Haojun Liao
af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
Haojun Liao
458143c8b7
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei 
fix: restore stt block and data block merge back
 2023-08-08 08:58:02 +08:00
Haojun Liao
f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao
ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj 
other: merge main and fix bugs in stop stream tasks.
 2023-08-07 22:57:13 +08:00
wangmm0220
864d07e1bc feat:[TD-24559]support geomety type in schemaless 2023-08-07 19:39:06 +08:00
dapan1121
11f6f203ed
Merge pull request #22331 from taosdata/fix/TD-25515 
fix: ins_indexes vgroup_id using null value instead of -1 for invalid
 2023-08-07 19:03:01 +08:00
Haojun Liao
aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
shenglian zhou
ec1270f75c fix: restore stt block/data block merge back 2023-08-07 17:17:12 +08:00
Minglei Jin
9e4da6c089 s3/config: parsing s3 configuration 2023-08-07 17:14:58 +08:00
shenglian zhou
9ddab11d98 Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-07 17:13:49 +08:00
yihaoDeng
b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng
eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao
e6b80e6c52 Merge branch '3.0' into fix/3_liaohj 2023-08-07 16:26:31 +08:00
Haojun Liao
225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Hongze Cheng
a545d45b5e fix: snapshot invalid read 2023-08-07 16:12:03 +08:00
Minglei Jin
fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
Hongze Cheng
661f2aca98 fix: memory leak 2023-08-07 14:13:44 +08:00
wangmm0220
5daf38c0d5 fix:ref is not there 2023-08-07 11:29:54 +08:00
Benguang Zhao
0e4f1942f1 fix: resolve Vgroup refcount leak in drop topic 2023-08-07 11:13:52 +08:00
Haojun Liao
76288f311f
Merge pull request #22311 from taosdata/fix/TD-25543 
delete atomic_exchange_64
 2023-08-07 10:34:50 +08:00
wangmm0220
9ecabb30f5 fix:ref is not there 2023-08-07 10:27:44 +08:00
wangmm0220
5f02e2ddfb fix:ref is not there 2023-08-07 09:31:29 +08:00
Haojun Liao
8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
wangmm0220
d9a1695257 fix:add log 2023-08-04 18:07:44 +08:00
Hui Li
f19826fa9d
Merge pull request #22313 from taosdata/fix/addStreamVer 
add stream verion
 2023-08-04 17:36:21 +08:00
Shungang Li
5154d0e1a3 fix: alter ttlChangeOnWrite note info 2023-08-04 17:24:35 +08:00
liuyao
944c1f68d2 delete atomic_exchange_64 2023-08-04 16:49:02 +08:00
Minglei Jin
65d8af19ed s3: new api s3Size 2023-08-04 16:35:35 +08:00
Minglei Jin
87783a9650 s3query/get: pull object to local 2023-08-04 15:37:52 +08:00
Ganlin Zhao
f7a2e0cdab fix: ins_indexes vgroup_id using null value instead of -1 for invalid 
value
 2023-08-04 15:21:23 +08:00
yihaoDeng
56ed422f88 add stream ver 2023-08-04 14:09:00 +08:00
yihaoDeng
6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
Minglei Jin
ebd09ca532 tsdb/write: use keep1 as minKey instead of keep2 2023-08-04 13:44:17 +08:00
Minglei Jin
88d755be76 feat(tsdb/cos): s3 migration 2023-08-04 13:31:00 +08:00
wade zhang
abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main 
fix: keep stt iterator valid in the list
 2023-08-04 08:02:16 +08:00
slzhou
fef091b13d fix: keep the stt iterator valid 2023-08-03 21:50:50 +08:00
shenglian zhou
b85c1ae8a1 fix: remove the core 2023-08-03 21:50:50 +08:00
shenglian zhou
5322e38dfe fix: add init add check it 2023-08-03 21:50:50 +08:00
shenglian zhou
97b15ed718 fix: delete SLDataItem if stt level files num is smaller 2023-08-03 21:50:50 +08:00
yihaoDeng
f7dc9497ef add stream verion 2023-08-03 20:28:34 +08:00
slzhou
1cb1451e41 fix: set nextIndex when get neighbouring index 2023-08-03 18:26:29 +08:00
dm chen
5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng
f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
wade zhang
68f2018246
Merge pull request #22289 from taosdata/szhou/fix-25385 
fix: keep stt iterator valid
 2023-08-02 20:22:54 +08:00
wade zhang
13c713d33b
Merge pull request #22290 from taosdata/3.0_main 
merge 3.0 into branch main
 2023-08-02 16:04:08 +08:00
Hongze Cheng
f90f0b7047 disable infinite count loop 2023-08-02 15:51:51 +08:00
Minglei Jin
cff85550f9 Merge branch '3.0' into 3.0_main 2023-08-02 14:10:45 +08:00
wade zhang
c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400 
enh(tsdb/cache/read): lazy init table map hash and entries
 2023-08-02 14:08:43 +08:00
Haojun Liao
0feffc687b fix(tsdb): check uid in multiple stt statistics blocks. 2023-08-02 12:44:45 +08:00
Minglei Jin
0e51277521 cache/reader: cleanup contiue nex row 2023-08-02 12:43:57 +08:00
Haojun Liao
2c357f1958 fix(stream): enable filter table based on table statistics. 2023-08-02 11:18:35 +08:00
yihaoDeng
4aef18733f fix state mem leak 2023-08-02 03:16:24 +00:00
Minglei Jin
7fca057a81 cache/reader: move pLastCols into single block 2023-08-02 11:10:12 +08:00
slzhou
dd8e893508 fix: keep the stt iterator valid 2023-08-02 11:02:27 +08:00
Minglei Jin
95cc540d9b cache/reader: clean uid in all loop 2023-08-02 10:48:55 +08:00
shenglian zhou
38e797b4ff fix: remove the core 2023-08-02 10:43:26 +08:00
shenglian zhou
d5ca51e94d fix: add init add check it 2023-08-02 10:43:26 +08:00
shenglian zhou
6bf95c0c4d fix: delete SLDataItem if stt level files num is smaller 2023-08-02 10:43:26 +08:00
Haojun Liao
13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Minglei Jin
ed76525c4f cache/reader: cleanup uid in signle loop 2023-08-02 10:28:13 +08:00
wangjiaming0909
72dc46600e fix: memory leak when drop db which acquired by user with grant/revoke 2023-08-02 10:09:50 +08:00
Minglei Jin
29b2f32821 cache reader: cleanup stt init 2023-08-02 09:49:41 +08:00
Haojun Liao
53aefa531f Merge branch '3.0' into fix/3_liaohj 2023-08-02 09:45:21 +08:00
Haojun Liao
e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Hongze Cheng
4ba4e83b5b fix: retention file corruption 2023-08-01 20:19:13 +08:00
Haojun Liao
c016a58623 enh(stream): do some internal refactor. 2023-08-01 19:22:59 +08:00
Minglei Jin
7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin
a593e887fa cache: remove nFileset from fs state 2023-08-01 18:37:23 +08:00
Haojun Liao
ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Minglei Jin
7ad628417a fix mem issue: stack-use-after-scope 2023-08-01 17:57:38 +08:00
Minglei Jin
4716fc6400 cache/fs: remove fs state's tsdb handle 2023-08-01 17:49:05 +08:00
Minglei Jin
1d5532019f tsdb/merge-tree: cleanup comment 2023-08-01 17:25:15 +08:00
Minglei Jin
f72f129d41 cache/skyline: cleanup del array 2023-08-01 17:23:53 +08:00
Minglei Jin
c997662ba0 tsdb/cache: build skyline only if there's del data 2023-08-01 16:50:00 +08:00
Minglei Jin
94b9599f95 fix null pointer dereference 2023-08-01 16:39:14 +08:00
Haojun Liao
637f09359a other: merge main. 2023-08-01 16:15:34 +08:00
Haojun Liao
164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
Minglei Jin
72ac5a4e3b tsdb/cache: use read util's uid compare functor 2023-08-01 16:08:20 +08:00
Minglei Jin
c0a0e07597 cache/read: lazy init uidList when laoding from tsdb 2023-08-01 16:02:09 +08:00
Minglei Jin
b3fae65d90 enh(tsdb/cache/read): lazy init table map hash and entries 2023-08-01 15:53:42 +08:00
Hongze Cheng
78c23f407e fix compile issue 2023-08-01 15:04:14 +08:00
Hongze Cheng
07c40943a4 fix: TD-25408 2023-08-01 15:01:06 +08:00
wade zhang
347e78ecb5
Merge pull request #22272 from taosdata/fix/TD-25466 
Fix/td 25466
 2023-08-01 14:22:24 +08:00
Haojun Liao
75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Hongze Cheng
1b39147496 more refact 2023-08-01 11:36:37 +08:00
Hongze Cheng
0e46041c1a fix: tsdbRetention memory leak 2023-08-01 11:21:40 +08:00
wade zhang
6da5276259
Merge pull request #22264 from taosdata/szhou/fix-ts3749 
fix: restore user privilege processing if the rows generated by the u…
 2023-08-01 11:21:11 +08:00
Haojun Liao
ae9745ecf2
Merge pull request #22258 from taosdata/mark/tmq-3.0 
fix:add committed & seek process logic
 2023-08-01 09:52:09 +08:00
slzhou
785326c494 fix: dedicated max privileges rows to 2048 2023-08-01 09:46:08 +08:00
Haojun Liao
ea875c58f2
Merge pull request #22263 from taosdata/mark/tmq-main 
fix:add committed & seek process logic
 2023-08-01 09:43:23 +08:00
slzhou
411b5d4cf4 fix: increase privileges max block row number to 4096 2023-08-01 09:41:59 +08:00
slzhou
65e028ea5a enhance: add log 2023-07-31 23:27:35 +08:00
Haojun Liao
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457 
check update data
 2023-07-31 22:56:05 +08:00
Haojun Liao
2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj 
fix(stream): set the correct end key of delete block.
 2023-07-31 22:55:50 +08:00
Haojun Liao
7e8ecceada
Merge pull request #22260 from taosdata/fix/3_liaohj 
fix(stream): kill task when pause the stream execution.
 2023-07-31 22:55:36 +08:00
slzhou
215e358ce3 fix: restore user privilege processing if the rows generated by the user exceeds max block rows 2023-07-31 19:20:54 +08:00
wangmm0220
68ae64cdb2 fix:add committed & seek process logic 2023-07-31 18:53:25 +08:00
wangmm0220
cddf27e8b4 fix:add committed & seek process logic 2023-07-31 18:48:50 +08:00
Haojun Liao
d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
Haojun Liao
0b732e512a
Merge pull request #22251 from taosdata/fix/3_liaohj 
fix(stream): set the correct end key of delete block.
 2023-07-31 18:06:48 +08:00
wangmm0220
6179618b17 fix:add committed & seek process logic 2023-07-31 17:56:04 +08:00
wade zhang
9675384b05
Merge pull request #22252 from taosdata/fix/TD-25391 
fix(tsdb/read2): reset stt reader when suspended
 2023-07-31 17:36:43 +08:00
liuyao
32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
wade zhang
64d63b0584
Merge pull request #22212 from taosdata/fix/TD-24809-3.0 
fix: taos print version
 2023-07-31 16:31:03 +08:00
wangmm0220
8093ef2dc8 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-31 16:14:25 +08:00
Haojun Liao
9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Minglei Jin
079d7ff69e fix(tsdb/read2): reset stt reader when suspended 2023-07-31 15:21:47 +08:00
wade zhang
79646fff10
Merge pull request #22246 from taosdata/szhou/fix-ts3744 
fix: increase condition size
 2023-07-31 14:48:06 +08:00
Haojun Liao
e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
slzhou
6151b790d9 fix: increase the condition size of user privileges to 48k 2023-07-31 13:25:56 +08:00
wade zhang
c7fa5ed6ef
Merge pull request #22247 from taosdata/fix/TD-25436 
fix(tsdb/cache): check stt data with empty brin index
 2023-07-31 11:24:37 +08:00
Minglei Jin
135beebc0a fix(tsdb/cache): check stt data with empty brin index 2023-07-31 09:15:08 +08:00
wade zhang
bae028d65c
Merge pull request #22230 from taosdata/mark/tmq 
fix:semaphore always wait in tmq commit logic
 2023-07-31 09:10:13 +08:00
kailixu
ff39aadb34 fix: mac OS for community 2023-07-31 08:42:17 +08:00
Haojun Liao
cc5ff44604 enh(stream): handle the stream hb. 2023-07-30 19:25:00 +08:00
wade zhang
c26165975d
Merge pull request #22227 from taosdata/fix/TS-3728 
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
 2023-07-30 14:28:56 +08:00
Haojun Liao
8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao
c3c9e32ddd
Merge pull request #22244 from taosdata/fix/3_liaohj 
other: merge 3.0
 2023-07-29 22:38:51 +08:00
Haojun Liao
0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
kailixu
2deeed87ae fix: community for mac os 2023-07-29 13:18:17 +08:00
Haojun Liao
f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
wade zhang
c19feb2fa1
Merge pull request #22236 from taosdata/fix/TD-25416 
fix(tsdb/cache/del): use lru mutex to fix race with committing
 2023-07-28 23:17:45 +08:00
Haojun Liao
936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao
d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
Minglei Jin
1fcbf3432c tsdb/cache/del: remove duplicate lruMutex lock 2023-07-28 17:20:20 +08:00
wangmm0220
d982a7cb80 fix:heap use after free for wal 2023-07-28 16:59:35 +08:00
Minglei Jin
b0f65dfa62 fix(tsdb/cache/del): use lru mutex to fix race with committing 2023-07-28 16:32:07 +08:00
wangmm0220
ce7db7bf90 fix:subscribe time & return -1 if wal not exist 2023-07-28 15:07:15 +08:00
wangmm0220
6e673072cd fix:conflicts 2023-07-28 14:57:13 +08:00
Haojun Liao
9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao
74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao
2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj 
other: merge main.
 2023-07-28 13:06:17 +08:00
wangmm0220
2f6c565392 fix:pHandle not load if taosd restart 2023-07-28 11:48:53 +08:00
wade zhang
b3e5b5bd24
Merge pull request #22217 from taosdata/fix/TD-25386 
fix(tsdb/cache): move to stt next row if data file exausted
 2023-07-28 08:56:29 +08:00
Haojun Liao
ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj 
fix(stream): scan wal in step2
 2023-07-28 00:42:15 +08:00
Haojun Liao
7f3d1dc464 fix(stream): fix memory leak. 2023-07-27 23:06:53 +08:00
wangmm0220
77d43ef5fd fix:tmq ci error 2023-07-27 20:28:45 +08:00
Haojun Liao
fbb33be85d other: add some comments. 2023-07-27 18:59:38 +08:00
Haojun Liao
22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
Minglei Jin
cc9b9bd0b9 fix(tsdb/cache): move to stt next row if data file exausted 2023-07-27 17:19:42 +08:00
Shungang Li
fb226c2cdb enh: check cluster ttlChangeOnWrite consistency 2023-07-27 16:49:56 +08:00
Haojun Liao
b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao
3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao
6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
wangmm0220
75eacd56f1 fix:add log 2023-07-27 15:58:32 +08:00
wade zhang
a72c11c8de
Merge pull request #22205 from taosdata/fix/TD-25315 
fix(tsdb/commit2): new maxDelKey for commit context
 2023-07-27 15:48:46 +08:00
wade zhang
cc3cc73cfc
Merge pull request #22199 from taosdata/fix/TS-3708 
fix/TS-3708: check term for role time
 2023-07-27 15:43:23 +08:00
wangmm0220
2d41a42976 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728 2023-07-27 15:31:16 +08:00
Haojun Liao
40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Shungang Li
167ecea705 fix: check term for role time 
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
 2023-07-27 14:16:54 +08:00
Minglei Jin
fe495f7013 tsdb/commit2: fix commit minKey for del 2023-07-27 13:54:48 +08:00
Haojun Liao
e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
Minglei Jin
8a2764c698 tsdb/commit2: use max fileset's maxKey as initial maxDelKey 2023-07-27 10:51:17 +08:00
Haojun Liao
2ef67b326a
Merge pull request #22207 from taosdata/fix/3_liaohj 
fix(stream): set the value of ratio of vnode stream thread factor to be 4.0 by default.
 2023-07-27 10:36:37 +08:00
Minglei Jin
dd32f12f92 tsdb/commit2: reset nextKey to max to stop commit 2023-07-27 09:50:32 +08:00
Minglei Jin
992d623ae5 fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN 2023-07-27 09:34:47 +08:00
Minglei Jin
580b7124cf fix(tsdb/commit2): new maxDelKey for commit context 2023-07-27 09:16:28 +08:00
Haojun Liao
b1596f8e3e refactor: do some internal refactor. 2023-07-27 01:55:42 +08:00
Haojun Liao
087d54a807
Merge pull request #22198 from taosdata/fix/3_liaohj 
fix(stream): do filter before the update check.
 2023-07-26 18:57:48 +08:00
yihaoDeng
287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
Haojun Liao
c57defa1c9
Merge pull request #22195 from taosdata/szhou/fix-td25369 
fix: stt and data block merge
 2023-07-26 17:11:18 +08:00
Haojun Liao
6a6830761d fix(tsdb): check for null ptr of pScanInfo 2023-07-26 17:08:29 +08:00
Haojun Liao
3c387f6e91 fix(stream): fix syntax error. 2023-07-26 17:00:41 +08:00
Haojun Liao
432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao
610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj 
fix(stream): set the correct step2 scan time window range.
 2023-07-26 16:34:10 +08:00
shenglian zhou
1357e623d0 fix: fix compilation error 2023-07-26 15:43:50 +08:00
shenglian zhou
79020ea4a4 fix: stt and data block merge 2023-07-26 15:01:20 +08:00
Haojun Liao
df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Haojun Liao
cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Haojun Liao
728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
wade zhang
d8fd5b9394
Merge pull request #22190 from taosdata/fix/TD-25315 
fix(tsdb/del): reset next key to del record's ekey
 2023-07-26 10:23:01 +08:00
yihaoDeng
c61393a7a1 fix stream state transfer 2023-07-26 01:33:41 +00:00
Haojun Liao
b6eb739ae0 fix(tsdb): fix the 2023-07-26 09:14:19 +08:00
Minglei Jin
fb860726de fix(tsdb/del): reset next key to del record's ekey 2023-07-26 08:40:44 +08:00
Haojun Liao
1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
wade zhang
02bc1b2a8f
Merge pull request #22186 from taosdata/fix/TD-25315 
fix(tsdb/del): continue committing fileset if more del left
 2023-07-25 17:41:30 +08:00
Haojun Liao
0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Minglei Jin
7bfb4e0f88 fix(tsdb/del): continue committing fileset if more del left 2023-07-25 16:42:45 +08:00
wangmm0220
a3614ca5d2 fix:add assert if exception occurs 2023-07-25 16:18:11 +08:00
wangmm0220
be4e47e9a7 fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version 2023-07-25 16:15:33 +08:00
Haojun Liao
d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
Haojun Liao
c2588d71c3
Merge pull request #22173 from taosdata/fix/TS-3728 
fix:avoid request offset type is 0
 2023-07-25 14:59:30 +08:00
wade zhang
2bf84c2676
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0 
enh: compatibility between getFileNamePrefix and tsdbTFileName
 2023-07-25 14:26:14 +08:00
Benguang Zhao
01f45b2a99 enh: compatibility between getFileNamePrefix and tsdbTFileName 2023-07-25 11:35:35 +08:00
Minglei Jin
1bce96ea27 fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's) 2023-07-25 10:46:03 +08:00
wade zhang
7ea9cf1ddc
Merge pull request #22166 from taosdata/fix/TD-24422 
fix(tsdb/cache): reuse data file reader
 2023-07-25 10:28:59 +08:00
Haojun Liao
96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj 
fix(stream): fix the invalid check of step2 .
 2023-07-25 00:30:06 +08:00
Haojun Liao
a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
Haojun Liao
c0e35df927
Merge pull request #22131 from taosdata/mark/tmq 
fix:optimize log & change return value for async interface
 2023-07-24 19:40:01 +08:00
wangmm0220
6a0e994169 fix:avoid request offset type is 0 2023-07-24 19:24:05 +08:00
Haojun Liao
d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj 
fix(stream): add some logs, and remove the invalid loop.
 2023-07-24 16:29:51 +08:00
dapan1121
dce1f579ea
Merge pull request #22143 from taosdata/enh/TD-24987-3.0 
enh: expire time optimize
 2023-07-24 16:18:59 +08:00
wangmm0220
9628a9f74e fix:open info log in tmq & ignore wal apply ver when read wal 2023-07-24 15:53:02 +08:00
Haojun Liao
01f11bf5a6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/common/src/tglobal.c
#	source/libs/executor/src/timewindowoperator.c
 2023-07-24 15:25:43 +08:00
Haojun Liao
1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
kailixu
7946ce4994 chore: code optimization 2023-07-24 14:46:59 +08:00
Minglei Jin
424dd40078 tsdb/cache: reuse pDataFileReader for same fileset 2023-07-24 14:45:35 +08:00
kailixu
cf59a6cff0 chore: set user for dm transport 2023-07-24 14:24:47 +08:00
Haojun Liao
9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
Haojun Liao
13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj 
fix(stream): refactor the halt status to check more status.
 2023-07-24 11:04:08 +08:00
Minglei Jin
968cfd9e65 tsdb/cache: pLastIter null pointer check 2023-07-24 11:03:07 +08:00
wade zhang
5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize 
fix(tsdb/cache): new next stt row state for fs tranverse
 2023-07-24 10:47:51 +08:00
Haojun Liao
1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao
6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj 
fix(stream): set the correct flag of pause/resume.
 2023-07-24 09:07:49 +08:00
Minglei Jin
13491fab95 tsdb/cache: new next stt row state for fs tranverse 2023-07-24 08:51:20 +08:00
Haojun Liao
0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao
e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao
4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao
321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-07-22 15:06:28 +08:00
Haojun Liao
bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao
1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
wangmm0220
8f15795cc1 fix:judge if pTopic is NULL 2023-07-21 19:47:31 +08:00
Haojun Liao
16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wade zhang
7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize 
for test purpose
 2023-07-21 14:18:32 +08:00
wangmm0220
bb86f5c580 fix:commit offset should not plus 1 2023-07-21 11:13:05 +08:00
wangmm0220
10ebf1f438 fix:subscribeStb.py maybe failed 2023-07-21 11:07:34 +08:00
dmchen
7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
liuyao
d45563684b
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-21 10:23:41 +08:00
Haojun Liao
d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
Haojun Liao
39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
dapan1121
d81727afa9
Merge pull request #22130 from taosdata/fix/TD-25270 
enh: support show create table for system tables
 2023-07-21 09:26:11 +08:00
Haojun Liao
c9d75eab5a refactor: do some internal refactor. 2023-07-21 09:16:13 +08:00
Haojun Liao
db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng
519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Ganlin Zhao
076a425d53 fix: fix show create table issue for system tables 2023-07-20 17:21:24 +08:00
Haojun Liao
9353f7c8cf refactor: do some internal refactor. 2023-07-20 16:35:02 +08:00
Haojun Liao
c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao
45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao
87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao
aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng
6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
Minglei Jin
48222f5dc3 tsdb/cache: move data file reader for fs iter to cache reader 2023-07-20 09:11:26 +08:00
Minglei Jin
6dd4ec41ae tsdb/cache cleanup: remove unused fs methods 2023-07-20 08:51:03 +08:00
Minglei Jin
7f0ea10573 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-20 08:42:12 +08:00
Minglei Jin
46d6dcda3e tsdb/cache: reset skyline when clearing fileset 2023-07-20 08:41:32 +08:00
Haojun Liao
bfcc538205 fix(tsdb):disable stt statistics. 2023-07-20 00:01:30 +08:00
wangmm0220
9378a0ef83 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-19 23:42:23 +08:00
yihaoDeng
733db123ad refactor code 2023-07-19 13:24:59 +00:00
Haojun Liao
97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
wangmm0220
d7d81d82a0 feat:add committed & position & commite_offset interface 2023-07-19 18:27:19 +08:00
Yihao Deng
91a15fd7bd
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 18:14:08 +08:00
Minglei Jin
ce71b8bbe7 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-19 18:11:14 +08:00
Minglei Jin
4eaecd11de tsdb/cache: merge fs & stt row 2023-07-19 18:10:36 +08:00
dapan1121
cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288 
enh: add scope for show xx variables
 2023-07-19 18:01:11 +08:00
wangmm0220
5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
Haojun Liao
37ae80d135 fix(tsdb): fix memory leak. 2023-07-19 16:42:51 +08:00
dmchen
8062d603b7 restore old change replica 2023-07-19 15:35:37 +08:00
tangfangzhi
69fae62003 error message 2023-07-19 15:04:39 +08:00
Haojun Liao
d82fb45a4f Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-19 15:01:37 +08:00
Haojun Liao
a84efab2c8 enh(tsdb): add table filter according to stt block statistics data. 2023-07-19 15:01:25 +08:00
Minglei Jin
913cfe43e8 tsdb/cache: remove input[3] 2023-07-19 12:20:54 +08:00
Minglei Jin
7a716d452e tsdb/fs2: fix vnode get primary dir args 2023-07-19 11:36:26 +08:00
Minglei Jin
4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
Shungang Li
1d88a6a7c6 enh: ttlMgrFlush adjust log level 2023-07-19 11:15:54 +08:00
Minglei Jin
185081a948 tsdb/fsreader: clear last fileset's resources 2023-07-19 11:04:28 +08:00
dm chen
141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
tangfangzhi
4cdfd0e1e8 conflict 2023-07-19 10:50:46 +08:00
yihaoDeng
b1f3dfe88f Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2 2023-07-19 02:17:42 +00:00
yihaoDeng
34c2e6a180 forbidden streamsnapshot reader 2023-07-19 02:15:12 +00:00
Haojun Liao
a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao
2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao
fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang
c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0 
feat: distribute vnode primary dirs among disks of level 0
 2023-07-19 09:44:43 +08:00
wangmm0220
5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
dmchen
93766f8c96 memory leak 2023-07-19 08:32:16 +08:00
Haojun Liao
9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
wade zhang
5f6afc6661
Merge pull request #22107 from taosdata/fix/TD-25232 
fix/TD-25232: alter keeptimeoffset by 'k v' or 'k' 'v'
 2023-07-18 18:30:30 +08:00
Minglei Jin
a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
Benguang Zhao
224f90761e fix: set wrapperCfg.diskPrimary in vmProcessAlterVnodeTypeReq 2023-07-18 16:57:52 +08:00
dmchen
3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Shungang Li
dfaf9134c6 fix: alter keeptimeoffset by 'k v' or 'k' 'v' 2023-07-18 16:04:38 +08:00
Benguang Zhao
02f4613154 enh: report VND_INIT_FAILED on vnodes open failure in vmOpenVnodes 2023-07-18 15:44:51 +08:00
Benguang Zhao
2faa3d2e7b enh: check validity of diskPrimary during vnodeOpen 2023-07-18 15:39:29 +08:00
Minglei Jin
9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
wangmm0220
08c50dfbb4 fix:add sdbFetchCancel to release hash node 2023-07-18 15:21:35 +08:00
Haojun Liao
901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
wangmm0220
2c80d7e621 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3672 2023-07-18 14:59:06 +08:00
Benguang Zhao
24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
Benguang Zhao
5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao
6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
dmchen
97a81bd8ed fix/TD-25179 2023-07-18 11:27:01 +08:00
Haojun Liao
0c64e67fda fix(stream): fix set upstream info for history task. 2023-07-18 10:19:13 +08:00
wangmm0220
6c35081507 fix:add sdbFetchCancel to release hash node 2023-07-18 09:54:35 +08:00
Haojun Liao
92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
yihaoDeng
8ab545ac77 fillhistory task not trigger checkpoint 2023-07-18 01:16:48 +00:00
wade zhang
7e89622149
Merge pull request #22092 from taosdata/fix/TD-25232 
fix/TD-25232: alter dnode keeptimeoffset err
 2023-07-18 09:10:40 +08:00
dapan1121
73c6666e62
Merge pull request #22096 from taosdata/fix/TD-25210-3.0 
fix: add sma option when show create table for stb/ntb
 2023-07-18 09:09:49 +08:00
Haojun Liao
2f24f776fb fix(stream): fix error in generating checkpoint for state_window. 2023-07-18 09:04:28 +08:00
kailixu
cf39fcdd12 fix: add sma option when show create table for stb/ntb 2023-07-17 22:24:27 +08:00
wangmm0220
da9e30434a fix:add sdbFetchCancel to release hash node 2023-07-17 20:21:23 +08:00
wangmm0220
8d8e12ee0d fix:add sdbFetchCancel to release hash node 2023-07-17 20:20:34 +08:00
yihaoDeng
b56e442478 Merge branch 'enh/dev33' into enh/triggerCheckPoint2 2023-07-17 11:41:38 +00:00
Minglei Jin
998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
yihaoDeng
40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
Shungang Li
1d0c73feb6 fix: alter dnode keeptimeoffset err 2023-07-17 18:37:00 +08:00
Minglei Jin
463b5b608b tsdb/read2: fix null pointer runtime error 2023-07-17 18:35:56 +08:00
Minglei Jin
62cfda1a88 tsdb/read2: fix UAF 2023-07-17 17:35:08 +08:00
dapan1121
3c7924ed8d
Merge pull request #22081 from taosdata/enh/TD-24920-3.0 
enh: dm monitor refactor
 2023-07-17 17:12:50 +08:00
Ganlin Zhao
929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
Ganlin Zhao
13e6a04e8f fix scope 2023-07-17 15:56:21 +08:00
Minglei Jin
832b68e17d tsdb/cache: load mem del data 2023-07-17 15:48:08 +08:00
Minglei Jin
a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin
27b8671f97 tsdb/cache: new cacheReader field for tsdb & cache reader 2023-07-17 14:27:27 +08:00
Minglei Jin
9b0b4061e0 tsdb/cache: relayout cache row reader 2023-07-17 14:16:54 +08:00
Haojun Liao
eaaf306c81 fix(stream): fix syntax error 2023-07-17 12:54:05 +08:00
Haojun Liao
d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Benguang Zhao
b21e603481 enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json 2023-07-17 11:48:48 +08:00
kailixu
0e6b982682 chore: more code 2023-07-17 09:19:24 +08:00
Minglei Jin
8263c49c17 tsdb/cache: fix compilation 2023-07-17 09:00:17 +08:00
Minglei Jin
2b21c5e0f6 tsdb2: adapt cache with tsdb2 API 2023-07-17 08:50:54 +08:00
Haojun Liao
a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao
c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
kailixu
3ab2ad20b4 chore: more check 2023-07-16 10:23:39 +08:00
kailixu
0bfc1cc920 chore: windows check 2023-07-16 10:13:17 +08:00
kailixu
918d3cca0c chore: more check 2023-07-16 07:13:53 +08:00
yihaoDeng
e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
kailixu
9117888853 chore: more code 2023-07-14 19:19:46 +08:00
yihaoDeng
3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
wade zhang
c2b3c2db52
Merge pull request #22066 from taosdata/fix/TD-25215-main 
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main
 2023-07-14 17:53:25 +08:00
wade zhang
021fcf2a59
Merge pull request #22059 from taosdata/fix/TD-25215 
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables
 2023-07-14 17:53:06 +08:00
Haojun Liao
b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao
eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
Haojun Liao
da0bd2a681
Merge pull request #22067 from taosdata/fix/coverity_scan 
fix coverity scan problem
 2023-07-14 16:54:17 +08:00
wangmm0220
6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220
bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
Hongze Cheng
145c43e346 little fix 2023-07-14 16:38:35 +08:00
Ganlin Zhao
b402782784 add scope for information_schema.ins_dnode_variables 2023-07-14 15:56:29 +08:00
Haojun Liao
572d9d25d9
Merge pull request #22063 from taosdata/fix/TD-25201 
sma not support multiple replicas
 2023-07-14 15:21:34 +08:00
yihaoDeng
0bf74d096c Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-14 14:47:18 +08:00
yihaoDeng
15f5fd19eb fix recover error 2023-07-14 14:47:06 +08:00
yihaoDeng
e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
Shungang Li
a48d359f8b fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-14 14:37:17 +08:00
Ganlin Zhao
7935d824b6 enhance show variables output 2023-07-14 13:57:02 +08:00
Hongze Cheng
25120cede4 fix sma merge error 2023-07-14 13:46:01 +08:00
Markus Mayer
55ee9d6c25
Correct some typos in string literals (#22062) 2023-07-14 13:39:03 +08:00
kailixu
163adf1908 chore: dm monitor refactor 2023-07-14 13:27:19 +08:00
yihaoDeng
dd4740e5a4 add checkpoint 2023-07-14 03:45:30 +00:00
liuyao
52f749f8cc sma not support multiple replicas 2023-07-14 10:36:32 +08:00
yihaoDeng
44170b9b16 fix recover error 2023-07-14 10:36:27 +08:00
Hongze Cheng
5a89b96e91 make compile 2023-07-14 10:21:06 +08:00
Hongze Cheng
1fad69df3b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-14 10:13:15 +08:00
yihaoDeng
17b7e3cc82 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-13 20:47:18 +08:00
yihaoDeng
e588640e02 fix recover error 2023-07-13 20:46:58 +08:00
dapan1121
9bf7180074
Merge pull request #21969 from taosdata/enh/TD-23769-3.0 
enh: rsma stream state adaption
 2023-07-13 19:19:37 +08:00
Haojun Liao
e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj 
other: merge main
 2023-07-13 17:55:28 +08:00
Shungang Li
a39a9428af fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-13 17:43:32 +08:00
Benguang Zhao
81a2cd16e7 enh: unify handling of vnode primary dir in current_fname 2023-07-13 17:37:53 +08:00
kailixu
6ee135cb52 chore: more code 2023-07-13 17:37:31 +08:00
kailixu
67461d92a7 chore: merge 3.0 and solve conflict 2023-07-13 17:35:55 +08:00
Hongze Cheng
d81d2790ea Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-13 17:20:45 +08:00
Haojun Liao
e2ae868377
Merge pull request #22032 from taosdata/mark/tmq 
fix:set firset version to reqOffset of response
 2023-07-13 16:35:21 +08:00
Haojun Liao
813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
wade zhang
ec86a68b6f
Merge pull request #22045 from taosdata/FEAT/TS-2699-3.0 
enh: unify handling of vnode primary dir for vnd, tsdb and sma
 2023-07-13 13:55:46 +08:00
Benguang Zhao
dc75f7ce21 enh: use VNODE_RSMA_DIR in tdRSmaGetCurrentFName 2023-07-13 11:27:31 +08:00
Haojun Liao
f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Benguang Zhao
e209b487c6 enh: rename func name vnodeGetPrimaryDir 2023-07-13 10:38:05 +08:00
Haojun Liao
2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
dapan1121
c5e41bffea
Merge pull request #22051 from taosdata/fix/TD-25197-M 
fix: skip primary key for block sma
 2023-07-13 09:55:29 +08:00
Haojun Liao
08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
kailixu
466f1037b4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 18:50:16 +08:00
Haojun Liao
c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj 
fix(stream): fix concurrent bug in save task meta.
 2023-07-12 18:17:27 +08:00
kailixu
8f58f9aa5b fix: skip primary key for block sma 2023-07-12 18:07:01 +08:00
Benguang Zhao
b7e134af20 enh: remove unused code in vmProcessCreateVnodeReq 2023-07-12 17:58:30 +08:00
Benguang Zhao
05e8af4837 enh: unify handling of vnode primary dir for vnd and tsdb 2023-07-12 17:58:18 +08:00
Benguang Zhao
4c3bf41178 enh: unify handling of vnode primary dir for sma 2023-07-12 17:56:21 +08:00
Benguang Zhao
bbf58d2d9d enh: unify handling of vnode primary dir in vnodeCreate and metaOpen 2023-07-12 17:56:21 +08:00
wangmm0220
cf64d4c9c5 fix:set get_assignment offset to first version of response block 2023-07-12 17:22:23 +08:00
Hongze Cheng
3fc282f035 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-12 11:57:19 +08:00
Haojun Liao
3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao
d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
kailixu
8cb6356b99 chore: more code 2023-07-12 10:47:02 +08:00
Haojun Liao
9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
kailixu
f282acbc4c chore: rsma refactor 2023-07-12 10:13:50 +08:00
kailixu
8c8bcabdd4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 09:11:34 +08:00
wade zhang
2cfdd234b3
Merge pull request #22034 from taosdata/feat/TS-3239 
feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0
 2023-07-12 08:18:38 +08:00
Haojun Liao
fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
kailixu
ba0bce8092 chore: code revert 2023-07-11 18:52:51 +08:00
kailixu
30f8c9c79e chore: more check 2023-07-11 18:08:48 +08:00
Shungang Li
4886cb4674 feat: port 'keepTimeOffset' from 2.6 to 3.0 2023-07-11 17:40:35 +08:00
kailixu
7c85f7701d chore: more check 2023-07-11 16:32:29 +08:00
wangmm0220
8dd7f36993 fix:set firset version to reqOffset of response 2023-07-11 16:19:38 +08:00
dapan1121
e7e923a396
Merge pull request #22017 from taosdata/enh/TD-25083-3.0 
enh: exclude tk_log from timeseries check
 2023-07-11 16:12:30 +08:00
wangmm0220
7bc19df0ef fix:set firset version to reqOffset of response 2023-07-11 15:48:19 +08:00
Haojun Liao
2e386a6fdf fix(stream): check if stream task is in normal state. 2023-07-11 15:23:49 +08:00
wangmm0220
cb62d4cb97 fix:set firset version to reqOffset of response 2023-07-11 14:49:53 +08:00
Haojun Liao
6d78816d22 fix(stream): fix syntax error. 2023-07-11 14:06:25 +08:00
kailixu
314123ef34 chore: add check 2023-07-11 14:05:09 +08:00
Haojun Liao
09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
kailixu
d5435926c2 chore: more code 2023-07-11 12:37:01 +08:00
Haojun Liao
3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao
04f5bcd23a fix(stream): remove invalid set of task status . 2023-07-11 08:51:13 +08:00
kailixu
14b438ec64 chore: bug fix 2023-07-11 07:02:36 +08:00
kailixu
f391462e34 chore: more code 2023-07-10 20:01:50 +08:00
kailixu
57ceaed535 chore: code revert 2023-07-10 19:55:01 +08:00
kailixu
f16fa6d000 enh: exclude tk log from time series check 2023-07-10 19:48:50 +08:00
Haojun Liao
87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao
ab5b2fe0a8 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-10 18:21:02 +08:00
Haojun Liao
385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
Hongze Cheng
7014f790a0 optmize table statistic info 2023-07-10 17:35:26 +08:00
yihaoDeng
e263d5f55f add checkpoint 2023-07-10 17:33:48 +08:00
Ganlin Zhao
b9c3ee387e remove wal_roll_period/wal_retention_size from 
information_schema.ins_databases
 2023-07-10 16:16:27 +08:00
yihaoDeng
4d838d3dff add checkpoint 2023-07-10 15:51:35 +08:00
dmchen
0a86523bcb fix/TS-3589 2023-07-10 14:58:28 +08:00
Haojun Liao
17debe6a28 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-10 13:58:04 +08:00