Commit graph

8445 commits

Author SHA1 Message Date
Minglei Jin
49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
wangmm0220
4fc19a6343 fix:snode can only be created 1 2023-11-30 15:49:31 +08:00
54liuyao
271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
Hongze Cheng
0bfa86f188
Merge pull request #23864 from taosdata/feat/TD-27461-3.0
feat: backgroud task priority
2023-11-30 13:51:57 +08:00
Haojun Liao
e9ead3bd28
Merge pull request #23341 from taosdata/enh/refactorBackend
Enh/refactor backend
2023-11-30 13:48:18 +08:00
Hongze Cheng
8ee4e2c1fe
Merge pull request #23862 from taosdata/fix/TD-27571
fix(tsdb/cache): flush dirty lru entries before del
2023-11-30 13:46:50 +08:00
slzhou
80ee5bfb3e fix: the initial value of first fileset start / end key 2023-11-30 11:08:18 +08:00
yihaoDeng
5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
WANG MINGMING
9b72d890c8
Merge branch '3.0' into fix/TD-27455 2023-11-30 09:37:23 +08:00
Hongze Cheng
547e673955 fix: coredump caused by typo 2023-11-30 09:20:18 +08:00
Haojun Liao
130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj
enh(stream/tsdb): do multiple optimization and fix some bugs.
2023-11-30 09:20:15 +08:00
Minglei Jin
ab2c7abca1 tsdb/cache-del: commit before get from rocks 2023-11-30 09:15:58 +08:00
Haojun Liao
28e17a61b9 fix(tsdb): fix invalid read. 2023-11-29 19:28:53 +08:00
Haojun Liao
66f25712fd fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-11-29 18:07:15 +08:00
Hongze Cheng
65ccc4aa48 feat: backgroud task priority 2023-11-29 18:01:31 +08:00
Minglei Jin
2c9c117529 fix(tsdb/cache): flush dirty lru entries before del 2023-11-29 17:37:40 +08:00
wangmm0220
4f168b4b2d fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode 2023-11-29 17:22:43 +08:00
Benguang Zhao
e66a1d6c9a enh: limit snap replication msg by size of block data in tsdbSnapReadTimeSeriesData 2023-11-29 16:01:11 +08:00
slzhou
1a3e280ea8 fix: use imem maxKey/minKey 2023-11-29 13:50:53 +08:00
slzhou
09e314c3ae fix: pStatus->pTableIter is set to null when getting mem table time range 2023-11-29 12:26:32 +08:00
54liuyao
ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
shenglian zhou
4691a7767a restore buildBlockFromBufferSequentially back 2023-11-29 10:29:40 +08:00
shenglian zhou
8a79df1113 enhance: prepare duration for next fileset 2023-11-29 10:15:43 +08:00
shenglian zhou
765b8384c0 Merge branch 'szhou/tms-duration' of github.com:taosdata/TDengine into szhou/tms-duration-2 2023-11-29 08:18:27 +08:00
slzhou
b2fa6209d9 fix: descending traverse wrong endkey 2023-11-29 08:09:00 +08:00
Haojun Liao
a5c8eaacaa fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-11-28 23:52:19 +08:00
shenglian zhou
5a75d74421 fix:mem table has data in the fileset duration 2023-11-28 15:58:33 +08:00
slzhou
4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
shenglian zhou
89cd2b6f17 enhance: tsdb output duration order 2023-11-28 14:39:08 +08:00
yihaoDeng
08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
shenglian zhou
cdb7eb462d Revert "Revert "fix: pass compilation""
This reverts commit 644dbad920.
2023-11-28 10:31:18 +08:00
shenglian zhou
df4f7d6956 Revert "Revert "enhance: duration notification""
This reverts commit 3331e25aaf.
2023-11-28 10:31:18 +08:00
shenglian zhou
3331e25aaf Revert "enhance: duration notification"
This reverts commit 9dd306e1ef.
2023-11-28 08:29:05 +08:00
shenglian zhou
644dbad920 Revert "fix: pass compilation"
This reverts commit 1a7ee3643e.
2023-11-28 08:28:49 +08:00
yihaoDeng
a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
wangmm0220
06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220
70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng
e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
dapan1121
d3ac79aeb7
Merge pull request #23808 from taosdata/fix/PI-23-3.0
fix: add check in mnode/vnode when alter table col/tag
2023-11-26 17:31:38 +08:00
Haojun Liao
9194c0c0cd fix(stream): add logs. 2023-11-25 00:56:18 +08:00
Haojun Liao
30c776cc0a fix(stream): reset the scheduler status. 2023-11-25 00:54:32 +08:00
Haojun Liao
d5e123db78
Merge pull request #23791 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-11-24 14:42:43 +08:00
Hongze Cheng
24932d2d41
Merge pull request #23799 from taosdata/fix/TD-27423
fix(tsdb/skip-row): remove s3 size condition
2023-11-24 10:48:03 +08:00
Minglei Jin
b1841ee97b tsdb/reader-writer: fix pgno iteration with cache setting 2023-11-24 09:06:43 +08:00
kailixu
ac47d3ea7d enh: more check for column bytes 2023-11-24 06:51:57 +08:00
kailixu
c4f1babdcf enh: naming optimize 2023-11-24 06:42:30 +08:00
kailixu
dc977ca200 fix: stash drop column 2023-11-23 23:09:49 +08:00
kailixu
9ce28483a0 fix: add check in mnode/vnode when alter table col/tag 2023-11-23 21:22:41 +08:00
wangmm0220
d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
yihaoDeng
6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Minglei Jin
3c3763a774 tsdb/read-by-column: fix last column index 2023-11-23 17:30:49 +08:00
Minglei Jin
9334fbcb06 tsdb/read-by-column: zero hint size when i's nonzero 2023-11-23 17:14:26 +08:00
Benguang Zhao
f7f9546d1e enh: trigger vnode commit at exit if meta changed, for dbs of single replica 2023-11-23 16:32:57 +08:00
Minglei Jin
3034ca2875 tsdb/open-file: log not exist file path 2023-11-23 16:25:39 +08:00
Minglei Jin
f076bfdfca fix(tsdb/skip-row): remove s3 size condition 2023-11-23 16:19:26 +08:00
Minglei Jin
460638d294 enh(tsdb/open-file): new s3 failed to connect error code 2023-11-23 16:09:02 +08:00
Minglei Jin
c6721be112 fix stt read compilation 2023-11-23 15:49:42 +08:00
Haojun Liao
0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Minglei Jin
08e5525012 tsdb/read-file-page: new arg for hint size 2023-11-23 15:37:26 +08:00
Minglei Jin
023821a80b enh(tsdb/read-by-column): calc hint size for preloading 2023-11-23 15:16:36 +08:00
yihaoDeng
6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao
8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao
f3355000a3 refactor: do some internal refactor. 2023-11-23 09:34:20 +08:00
Haojun Liao
3edb25a49e fix(stream): add check for assert. 2023-11-23 09:33:40 +08:00
Haojun Liao
7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj
fix(stream): fix error in generating token in bucket.
2023-11-23 09:32:14 +08:00
wangmm0220
15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Hongze Cheng
44866b7b12 fix: possible race condition coredump 2023-11-22 20:35:18 +08:00
wangmm0220
cfab06239b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-22 19:37:44 +08:00
wangmm0220
9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao
91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao
c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
slzhou
1a7ee3643e fix: pass compilation 2023-11-22 14:09:09 +08:00
shenglian zhou
9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
dapan1121
1b6a3c2069
Merge pull request #23771 from taosdata/enh/xsren/TD-27022/windows
Enh/xsren/td 27022/windows
2023-11-22 10:58:39 +08:00
yihaoDeng
0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng
0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao
b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao
7a0dfdb0cc fix(tsdb): fix invalid read. 2023-11-22 08:40:10 +08:00
yihaoDeng
947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
Haojun Liao
785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060
fix: errors in snode in conditions like fill history/checkpoint/restart
2023-11-21 19:02:38 +08:00
facetosea
845493294d osfile 2023-11-21 16:31:31 +08:00
yihaoDeng
a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Haojun Liao
2b099b11dd refactor: do some internal refactor. 2023-11-21 10:09:59 +08:00
yihaoDeng
939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
Minglei Jin
d12bc41236 tsdb/merge: clear file set before return 0 2023-11-20 14:30:25 +08:00
Haojun Liao
1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream
fix(stream): remove invalid assert
2023-11-17 23:48:47 +08:00
Haojun Liao
709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
wangmm0220
3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00
yihaoDeng
20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
Haojun Liao
0fac706fa6
Merge pull request #23732 from taosdata/fix/pause_stream
fix(stream): add check for assert.
2023-11-17 11:33:19 +08:00
Haojun Liao
2a1a7c82e2 Merge branch '3.0' into fix/3_liaohj 2023-11-17 10:17:14 +08:00
Haojun Liao
8fe79685a2 fix(stream): add check for assert. 2023-11-16 23:45:38 +08:00
Haojun Liao
c070e79d36 fix(stream): add check for assert. 2023-11-16 23:18:07 +08:00
wangmm0220
a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
Minglei Jin
65a27dd9c8 fix(tsdb/cos-merge): skip stt merging & not block commit 2023-11-16 18:58:58 +08:00
dapan1121
dc71252096 Merge remote-tracking branch 'origin/3.0' into merge/32m 2023-11-15 19:43:19 +08:00
wangmm0220
a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
wangmm0220
45782f278b fix:send update msg to vnodes if snode restart 2023-11-15 18:13:35 +08:00
Haojun Liao
9d2256ec9c refactor: do some internal refactor. 2023-11-15 16:03:23 +08:00
Haojun Liao
2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898
stream event window
2023-11-15 14:18:07 +08:00
dapan1121
9457cf0b46
Merge pull request #23702 from taosdata/merge/m23
merge: from main to 3.0
2023-11-15 13:54:21 +08:00
Hongze Cheng
082ddbddf6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-11-15 13:41:28 +08:00
Hongze Cheng
8050d73202 first version 2023-11-15 13:41:00 +08:00
Haojun Liao
86f2673849
Merge pull request #23703 from taosdata/fix/drop_stream
fix(tsdb): fix invalid read.
2023-11-15 13:35:46 +08:00
dapan1121
dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
Haojun Liao
f1b1b8911b fix(tsdb): fix invalid read. 2023-11-15 11:26:43 +08:00
wade zhang
d800d59bf0
Merge pull request #23693 from taosdata/FIX/TD-27303-3.0
TD-27303
2023-11-15 11:22:47 +08:00
Haojun Liao
62c7877176 fix(tsdb): fix invalid read. 2023-11-15 11:13:06 +08:00
Hongze Cheng
ed6be3b8c5
Merge pull request #23695 from taosdata/fix/TD-27313
fix(cos/list): free object array in exception
2023-11-15 11:09:38 +08:00
Minglei Jin
7f65e92b81 tsdb/retention: not allow migrate backward 2023-11-14 19:27:18 +08:00
dmchen
d8277d5505 TD-27303 2023-11-14 19:18:06 +08:00
dmchen
056993b519 TD-27303 2023-11-14 11:10:22 +00:00
yihaoDeng
f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
Hongze Cheng
f7e63ad1ca
Merge pull request #23680 from taosdata/fix/TD-27273
fix(tsdb/merge): skip merge if data file cannot be written
2023-11-14 16:08:12 +08:00
Minglei Jin
cb3fe4d6de fix(tsdb/merge): skip merge if data file cannot be written 2023-11-14 14:15:02 +08:00
Haojun Liao
436c7871a3
Merge pull request #23673 from taosdata/fix/3_liaohj
fix(stream): fix deadlock and do some internal refactor.
2023-11-14 11:26:54 +08:00
Haojun Liao
f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
Haojun Liao
cfa7c19dd5
Merge pull request #23667 from taosdata/fix/liaohj
fix(stream): fix deadlock.
2023-11-13 22:15:06 +08:00
Haojun Liao
aad8a2eb87 fix(stream): fix deadlock. 2023-11-13 18:20:30 +08:00
Minglei Jin
acd816a364 fix(tsdb/retention): move fset destruction out of for loop 2023-11-13 16:59:26 +08:00
liuyao
37c102a115 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-13 16:06:17 +08:00
yihaoDeng
de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
wade zhang
8e5de50050
Merge pull request #23641 from taosdata/FIX/TS-4249-3.0
TS-4249
2023-11-13 10:03:03 +08:00
dapan1121
a51df86e43
Merge pull request #23636 from taosdata/enh/TD-25601-3.0
enh: support delete msg for rsma
2023-11-13 08:47:42 +08:00
Haojun Liao
9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao
8925c721e5 fix(stream): adjust critical section. 2023-11-11 15:40:16 +08:00
Haojun Liao
5937bdddf5 refactor:disable test. 2023-11-11 15:40:12 +08:00
Haojun Liao
cb0d244d5a fix(stream): release lock. 2023-11-11 15:40:11 +08:00
Haojun Liao
af08a189c1 fix(stream): disable concurrently restart stream tasks. 2023-11-11 15:40:10 +08:00
Haojun Liao
4d9b422874 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-11 15:40:10 +08:00
Haojun Liao
45ab92a02d fix(stream): remove invalid free. 2023-11-11 15:39:55 +08:00
Haojun Liao
77d6fd5394 refactor: do some internal refactor. 2023-11-11 15:39:09 +08:00
Haojun Liao
608c72e901 refactor(stream): create sim env for stream processing. 2023-11-11 15:39:08 +08:00
Cary Xu
1c2e9c18d5
Update tqSink.c 2023-11-10 22:01:28 +08:00
kailixu
3707857c12 chore: remove obsolete code 2023-11-10 18:43:23 +08:00
kailixu
42e4e2b7a4 fix: macro define 2023-11-10 18:27:42 +08:00
kailixu
9017e2ed68 chore: code optimization 2023-11-10 18:11:06 +08:00
kailixu
c04fb6d543 enh: logic optimization 2023-11-10 17:23:17 +08:00
kailixu
bc44659826 fix: buffer overflow 2023-11-10 17:14:57 +08:00
kailixu
11c0427b22 enh: test case to delete mutiple tables 2023-11-10 16:41:41 +08:00
dmchen
65870ae117 TS-4249 2023-11-10 16:29:59 +08:00
dmchen
22d6204fa9 TS-4249 2023-11-10 08:23:09 +00:00
kailixu
d5d8568bad fix: skip delete msg affects 0 row 2023-11-10 15:30:49 +08:00
kailixu
b1bca4e1e2 fix: batch delete logic 2023-11-10 15:12:10 +08:00
kailixu
5fae10bc76 enh: error code when build delete req 2023-11-10 15:09:01 +08:00
kailixu
2a14a10d0d Merge branch '3.0' into enh/TD-25601-3.0 2023-11-10 14:45:45 +08:00
kailixu
674e878ffa enh: rsma support delete 2023-11-10 14:44:29 +08:00
Haojun Liao
5824caa8f5
Merge pull request #23631 from taosdata/fix/liaohj
multiple fix
2023-11-10 13:09:40 +08:00
Minglei Jin
32528ab9cd fix(tsdb/reader-writer): fix pgnoEnd calc 2023-11-10 12:44:09 +08:00
wade zhang
b5b15f36f2
Merge pull request #23627 from taosdata/FIX/TD-27243-3.0
fix/TD-27243
2023-11-10 11:05:33 +08:00
Haojun Liao
233777b6ac fix(stream): adjust critical section. 2023-11-10 10:26:45 +08:00
Haojun Liao
d8ab8d2d03 refactor:disable test. 2023-11-10 09:46:20 +08:00
Haojun Liao
ed49294e9b fix(stream): release lock. 2023-11-10 09:35:41 +08:00
Haojun Liao
9978667c48 fix(stream): disable concurrently restart stream tasks. 2023-11-10 09:24:08 +08:00
liuyao
6d2d5823dc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 09:24:05 +08:00
yihaoDeng
3e2314b09b Merge branch '3.0' into enh/refactorBackend 2023-11-10 09:22:16 +08:00
kailixu
ee6e68a71e enh: rsma support delete 2023-11-10 07:02:46 +08:00
Haojun Liao
730434ed82 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-09 23:26:09 +08:00
kailixu
7288b0fc77 enh: rsma delete error code 2023-11-09 20:16:29 +08:00
kailixu
ff3621f382 enh: rsma delete logic 2023-11-09 20:09:39 +08:00
Hongze Cheng
ec3685db94
Merge pull request #23600 from taosdata/fix/TD-27206
fix(vnode/cos): fix error printing to avoid buffer overflow
2023-11-09 06:06:54 -06:00
kailixu
572eb691fb enh: support delete msg for rsma 2023-11-09 19:51:01 +08:00
dapan1121
4f67629ea1
Merge pull request #23621 from taosdata/fix/TS-4122
correct colid in blockinfo
2023-11-09 18:09:09 +08:00
dmchen
2fbf0a532d fix/TD-27243 2023-11-09 18:02:06 +08:00
yihaoDeng
757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
dmchen
65bebb0912 fix/TD-27243 2023-11-09 09:51:35 +00:00
Minglei Jin
d3cf6a4340 tsdb/file: new nlevel field for remove 2023-11-09 17:44:24 +08:00
Hongze Cheng
b1fbdfcdc9
Merge pull request #23617 from taosdata/fix/little_typo
fix: code typo
2023-11-09 03:35:31 -06:00
wade zhang
c0c665d785
Merge pull request #23614 from taosdata/FIX/TD-27230-3.0
fix: close vnode in the failed mode properly in vmCloseVnode
2023-11-09 16:32:20 +08:00
wangjiaming0909
a6600ab23a correct colid in blockinfo 2023-11-09 15:41:01 +08:00
Minglei Jin
386c25a99a tsdb/retention: remove file when ref's clear 2023-11-09 15:24:19 +08:00
kailixu
9cf154543f chore: merge 3.0 2023-11-09 15:09:30 +08:00
kailixu
aa3ba74f6e chore: code optimization 2023-11-09 15:03:14 +08:00
dapan1121
8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x
enh: checkpoint for rsma
2023-11-09 14:51:37 +08:00
kailixu
74cddda24b Merge branch '3.0' into enh/TD-25601-3.0 2023-11-09 14:37:13 +08:00
Hongze Cheng
e60f69a7ed fix: code typo 2023-11-09 14:20:27 +08:00
yihaoDeng
f74edc7618 Merge branch '3.0' into enh/refactorBackend 2023-11-09 06:14:08 +00:00
Minglei Jin
398771da5b Merge branch '3.0' into fix/TD-27206 2023-11-09 14:06:15 +08:00
liuyao
e56a3e8a1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-09 13:59:39 +08:00
Benguang Zhao
b80770dea8 fix: close vnode in the failed mode properly in vmCloseVnode 2023-11-09 13:05:52 +08:00
kailixu
1a950afdb8 enh: test case for rsma snapshot 2023-11-09 12:09:27 +08:00
Haojun Liao
257ab4f270
Merge pull request #23526 from taosdata/feat/TD-26060
feat:checkpoint backup function
2023-11-09 11:46:28 +08:00
kailixu
349e190120 enh: rsma result 2023-11-09 11:23:50 +08:00
kailixu
3495efaac7 enh: rsma exception process 2023-11-09 10:49:40 +08:00
Haojun Liao
62f34c757e fix(stream): remove invalid free. 2023-11-09 10:10:37 +08:00
Minglei Jin
1bb10bb862 vnode/cos: check get object block size optionally 2023-11-09 09:32:13 +08:00
kailixu
501d5a7acc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 20:47:15 +08:00
kailixu
72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
Minglei Jin
5ccdde4495 vnode/cos: error on incomplete fetching 2023-11-08 20:43:52 +08:00
yihaoDeng
3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
liuyao
a8b415ed35 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 17:26:00 +08:00
Minglei Jin
128353a861 vnode/cos: fix get object handler mem 2023-11-08 16:04:24 +08:00
Minglei Jin
e5bbcf76f1 vnode/cos: fix get object block callback 2023-11-08 15:57:56 +08:00
Haojun Liao
99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
Minglei Jin
a1e692a796 fix(vnode/cos): fix error printing to avoid buffer overflow 2023-11-08 15:18:55 +08:00
wangjiaming0909
3e850df3c2 fix: last(ts2), ts2, ts caused data err 2023-11-08 14:43:11 +08:00
Minglei Jin
3f125bc6bf vnode/cos: make err msg buffer big enough for detailed msg 2023-11-08 14:30:30 +08:00
liuyao
340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
Haojun Liao
658fafd03c refactor: do some internal refactor. 2023-11-08 14:02:08 +08:00
wangjiaming0909
fc6c4fba90 feat: cache scan for select last(c), ts/c 2023-11-08 13:39:28 +08:00
Haojun Liao
809dd064a7 refactor(stream): create sim env for stream processing. 2023-11-08 11:04:16 +08:00
Haojun Liao
17bd6badec refactor(stream): do checkpoint for each task. 2023-11-08 10:47:54 +08:00
yihaoDeng
7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
kailixu
d1106c51dc enh: rsma code optimization 2023-11-08 09:54:03 +08:00
Minglei Jin
764f8d2e45 fix(vnode/s3): move init & cleanup to dnode 2023-11-08 09:03:19 +08:00
kailixu
b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu
f2d24306b1 enh: rsma tasks share one checkpoint and fix memory leak 2023-11-08 08:35:52 +08:00
Haojun Liao
666b8c531b
Merge pull request #23548 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-11-08 08:08:36 +08:00
Haojun Liao
e052d3cd62 fix(stream): check null. 2023-11-08 00:10:08 +08:00
Haojun Liao
9ba854d49d Merge branch '3.0' into fix/3_liaohj 2023-11-07 23:51:07 +08:00
Haojun Liao
7bfea5a82e fix(stream): fix syntax error. 2023-11-07 22:31:35 +08:00
kailixu
6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
wangmm0220
c0068abc9a fix:merge from 3.0 2023-11-07 18:55:46 +08:00
Haojun Liao
2674698b36 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-07 18:51:46 +08:00
yihaoDeng
95b14ee39b merge 3.0 2023-11-07 17:15:49 +08:00
Haojun Liao
1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao
8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao
7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao
e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
Haojun Liao
207b53f3f6 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:19:09 +08:00
kailixu
ac62714492 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-07 14:20:38 +08:00
Haojun Liao
4d8548e938 refactor: do some internal refactor. 2023-11-06 23:42:16 +08:00
kailixu
f5d796a081 chore: print stream state 2023-11-06 19:53:09 +08:00
Haojun Liao
d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
kailixu
dc5284a19c chore: add debug info 2023-11-06 17:27:36 +08:00
Haojun Liao
6b1889284b fix(stream): record the start failure tasks. 2023-11-06 15:45:44 +08:00
Minglei Jin
ec908fa4d0 fix(cache/reader): use int64 max instead of uint 2023-11-06 15:34:28 +08:00
wangmm0220
dffaac55ea fix:move cos from util to common 2023-11-06 14:57:32 +08:00
Minglei Jin
31ce6453c2 fix(cmake/s3): make cmake config portable 2023-11-06 14:17:27 +08:00
Haojun Liao
69863febe6 fix(stream):reset the starting flag for the followers. 2023-11-06 13:17:13 +08:00
Haojun Liao
bfd14076d7 fix(stream): fix dead-lock. 2023-11-06 12:05:47 +08:00
Haojun Liao
d41fd27189 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-06 11:57:21 +08:00
Haojun Liao
0e44950a37 enh(stream): execute scan history by using time slice 1s. 2023-11-06 09:21:33 +08:00
Haojun Liao
680eb5674e refactor: do some internal refactor. 2023-11-06 09:15:49 +08:00
kailixu
7e8c123fca chore: rsma code optimization 2023-11-06 08:46:04 +08:00
Haojun Liao
d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao
e13f003b90 refactor: do some internal refactor. 2023-11-05 01:23:23 +08:00
kailixu
411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
yihaoDeng
f038f88c07 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-03 18:29:18 +08:00
Haojun Liao
3415ba5195
Merge pull request #23528 from taosdata/fix/liaohj
enh(tsdb): on-demand open stt file reader.
2023-11-03 17:29:55 +08:00
kailixu
77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
Haojun Liao
d3ddaaa9f3 other(tsdb): adjust some log info. 2023-11-03 15:08:25 +08:00
Haojun Liao
de5c4d8d5d other(tsdb): adjust some log info. 2023-11-03 15:07:40 +08:00
kailixu
c95fc014a8 enh: rsma checkpoint 2023-11-03 14:57:36 +08:00
kailixu
a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Haojun Liao
34403534ed Merge branch '3.0' into fix/3_liaohj 2023-11-03 14:06:58 +08:00
liuyao
b1d1e2c778 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 14:02:59 +08:00
Haojun Liao
b4d14d3847 fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 13:51:18 +08:00
Haojun Liao
675c9ca613 enh(tsdb): on-demand open stt file reader. 2023-11-03 13:51:18 +08:00
wangmm0220
0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
Haojun Liao
c980e2030c fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 11:04:32 +08:00
Haojun Liao
0acf4f1795 enh(tsdb): on-demand open stt file reader. 2023-11-03 10:35:05 +08:00
Hongze Cheng
1ff3f96b08
Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write
enh(tsdb/retention): enable last tier write
2023-11-02 21:21:38 -05:00
yihaoDeng
24e961976f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-03 09:31:57 +08:00
liuyao
31ad73f6d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 09:12:17 +08:00
Haojun Liao
ff5d69352f
Merge pull request #23493 from taosdata/fix/3_liaohj
fix(stream): add unsupport trans.
2023-11-03 09:07:33 +08:00
Haojun Liao
70388bafd2
Merge pull request #23523 from taosdata/fix/liaohj
fix(stream): fix deadlock in transfer state.
2023-11-03 09:07:23 +08:00
kailixu
d9ed63473c Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 08:37:41 +08:00
yihaoDeng
6ce878948f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 20:44:36 +08:00
kailixu
6c944bb192 enh: skip rsma_task during load stream tasks 2023-11-02 20:32:54 +08:00
wangmm0220
159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
liuyao
389117b806 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 20:07:12 +08:00
Haojun Liao
b3d57e4a2d fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:31:35 +08:00
Haojun Liao
7a32b3a209 fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:12:36 +08:00
kailixu
fa5d896787 enh: rsma checkpoint 2023-11-02 18:56:36 +08:00
Haojun Liao
c4079332ff fix(stream):update the log level. 2023-11-02 18:18:04 +08:00
Haojun Liao
0a227e807f refactor: set different tq level. 2023-11-02 18:18:04 +08:00
Haojun Liao
48aff868b6 fix(stream):update the log level. 2023-11-02 18:16:47 +08:00
Haojun Liao
3aed8c29ae refactor: set different tq level. 2023-11-02 17:12:20 +08:00
Hongze Cheng
faea18c38f fix: invalid read when file is deleted 2023-11-02 16:59:11 +08:00
kailixu
2d597659bc enh: rsma checkpoint 2023-11-02 15:20:54 +08:00
liuyao
330b04a8bc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 14:36:13 +08:00
Haojun Liao
f5fa3edeba
Merge pull request #23503 from taosdata/fix/liaohj
fix(stream): fix dead lock.
2023-11-02 13:52:50 +08:00
kailixu
722777f8c9 enh: rsma checkpoint 2023-11-02 13:15:31 +08:00
kailixu
96b5024347 enh: rsma checkpoint 2023-11-02 13:05:36 +08:00
kailixu
698fb804f9 enh: disable update tbUidList during reboot 2023-11-02 12:54:23 +08:00
kailixu
76536e1c82 enh: rsma logic 2023-11-02 11:03:18 +08:00
Haojun Liao
95efa07e92 fix(stream): add full unsupported event filtering. 2023-11-02 11:02:39 +08:00
Minglei Jin
46d3be1f08 config/page-cache-size: new parameter for pcache size 2023-11-02 10:10:03 +08:00
kailixu
9649e87cab fix: rsma checkpoint 2023-11-02 09:44:43 +08:00
Haojun Liao
351a31302f fix(stream): add full unsupported event filtering. 2023-11-02 09:43:48 +08:00
Minglei Jin
d0327e07b8 tsdb/pg-cache: use pgno for cache key instead of blkno 2023-11-02 09:42:19 +08:00
Hongze Cheng
a6ee7c4685 fix: possible coredump 2023-11-01 20:34:47 +08:00
kailixu
3803f952f9 chore: rsma checkpoint verify 2023-11-01 20:05:00 +08:00
Haojun Liao
7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao
00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao
9a9c1d689d fix(stream): add lock log. 2023-11-01 19:38:12 +08:00
Haojun Liao
246ed4e022 refactor: do some internal refactor. 2023-11-01 17:19:21 +08:00
liuyao
505c44d9aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-01 16:50:46 +08:00
kailixu
c32e60d199 chore: more code for rsma checkpoint 2023-11-01 16:27:41 +08:00
Haojun Liao
12bc4f32cf refactor: add some logs. 2023-11-01 16:12:15 +08:00
yihaoDeng
4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
kailixu
59be62c96e chore: set stream input checkpoint 2023-11-01 15:34:17 +08:00
Minglei Jin
6f0fa5d47e tsdb/retention: remove incorrect right brace 2023-11-01 14:56:57 +08:00
Haojun Liao
5ff89bc098 fix(stream): add lock log. 2023-11-01 13:19:53 +08:00
kailixu
ab266c712f chore: checkpoint for rsma stream state 2023-11-01 12:29:54 +08:00
Haojun Liao
0cf0ff3bbf
Merge pull request #23455 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-11-01 12:01:54 +08:00
Haojun Liao
3e6c89d8eb fix(stream): add unsupport trans. 2023-11-01 11:43:02 +08:00
Minglei Jin
221afff9ee vnode/write: remove keep modify code block 2023-11-01 11:00:47 +08:00
Minglei Jin
64644d673b
Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 10:53:55 +08:00