Commit graph

6027 commits

Author SHA1 Message Date
Haojun Liao
b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
dapan1121
4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Minglei Jin
020678391c fix(tsdb/cache): refine del locks 2023-06-26 11:19:31 +08:00
Minglei Jin
5eb57f2e6e enh(tsdb/cache): writebatch with rcache locked 2023-06-26 08:41:14 +08:00
Haojun Liao
402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
liuyao
e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
wangmm0220
7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
Haojun Liao
7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
liuyao
c950c7379d Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory 2023-06-25 10:58:43 +08:00
liuyao
e9d3198e05 mem leak 2023-06-25 10:57:10 +08:00
Haojun Liao
6ac179501a fix: fix syntax error. 2023-06-25 10:46:21 +08:00
Haojun Liao
6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Haojun Liao
7c23630fe4 fix(stream): set correct stream error code. 2023-06-25 09:26:37 +08:00
wade zhang
254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao
a8de3694fa Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-06-24 18:55:03 +08:00
Haojun Liao
ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
wade zhang
e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Haojun Liao
ea7b8e91d3 fix(stream): fix memory leak. 2023-06-21 12:03:26 +08:00
liuyao
74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
Benguang Zhao
424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
liuyao
aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
liuyao
870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
Shungang Li
aa3dd2bbe8 fix for compile 2023-06-20 09:06:23 +08:00
Shungang Li
b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
liuyao
41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
Benguang Zhao
090a1a1595 enh: rename dir at the end in vnodeRenameVgroupId 2023-06-19 15:48:32 +08:00
kailixu
b40069c0e1 chore: log optimization 2023-06-17 05:05:43 +08:00
wangmm0220
c5dfe169a6 fix:error 2023-06-16 19:33:03 +08:00
kailixu
4097b860d3 enh: support delete tsma interval 2023-06-16 19:04:12 +08:00
dapan1121
1329dce320
Merge pull request #21712 from taosdata/fix/TS-3484
fix: fix order by ts desc error
2023-06-16 18:01:16 +08:00
Haojun Liao
64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
wade zhang
01b1cfe965
Merge pull request #21676 from taosdata/fix/TD-24715
enh(vnd/svr): convert msyType to string
2023-06-16 12:06:47 +08:00
wade zhang
d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
Minglei Jin
968e3cf1ea lru/applyF: fix ret value 2023-06-16 10:00:17 +08:00
Haojun Liao
4c82558eab Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 2023-06-16 09:55:24 +08:00
Haojun Liao
933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
liuyao
0aa141ec77 use stream task state 2023-06-15 18:24:40 +08:00
Haojun Liao
a3e1882fb2 fix: fix dead lock. 2023-06-15 18:17:38 +08:00
Minglei Jin
2cb6c7af16 cache/commit: use outter lock 2023-06-15 17:16:14 +08:00
Minglei Jin
9d6a22e35e cache/apply: use tsdb's flushState as ud 2023-06-15 17:07:56 +08:00
Minglei Jin
c56f29c031 cache/flushState: init flush state when open cache 2023-06-15 17:01:27 +08:00
Minglei Jin
158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
Haojun Liao
74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
wangmm0220
22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
liuyao
693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao
5fdfe98696 fix: fix syntax error. 2023-06-15 13:31:30 +08:00
Haojun Liao
1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao
13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Minglei Jin
6d23ea93ea cache/update: fix memory leak 2023-06-15 08:40:36 +08:00
Haojun Liao
53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Benguang Zhao
b86fc3a697 fix: vnodeRenameVgroupId correctly 2023-06-14 21:38:25 +08:00
liuyao
9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Minglei Jin
d04a33f349 fix(tsdb/cache): rewrite cache update to fix cpu usage 2023-06-14 15:35:21 +08:00
Haojun Liao
7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Haojun Liao
b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao
844a23225a
Merge pull request #21600 from taosdata/mark/tmq
fix:check wal not exist again before register to push & move push log…
2023-06-14 10:18:39 +08:00
Ganlin Zhao
4bd1ae90fa fix: fix order by ts desc error 2023-06-14 09:52:41 +08:00
wangmm0220
8070223aba fix:lock error 2023-06-13 18:27:06 +08:00
Ganlin Zhao
647ddaad97 fix: fix order by ts desc error 2023-06-13 17:28:31 +08:00
Haojun Liao
97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
wangmm0220
d8d6b6dd21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749 2023-06-13 15:15:05 +08:00
wangmm0220
8a81278024 fix:load pHandle if necessary wher tq restore 2023-06-13 15:14:11 +08:00
Haojun Liao
933d08b489
Merge pull request #21690 from taosdata/feature/TS-3495
feat:add parameters for consumer & add offset rows for subscription
2023-06-13 14:59:15 +08:00
wangmm0220
fb123d8761 fix:conflict from 3.0 2023-06-13 09:47:08 +08:00
Haojun Liao
fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
Benguang Zhao
16fbcbb67a fix: filter by tbFName in metaFilterTableByHash 2023-06-12 14:19:50 +08:00
Haojun Liao
78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
wangmm0220
1903b815d4 fix:modify offset description to string 2023-06-12 09:45:06 +08:00
wangmm0220
6657b8d849 fix:modify offset description to string 2023-06-12 09:44:00 +08:00
Benguang Zhao
3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
Minglei Jin
4884d0af53 vnd/svr: convert msyType to string 2023-06-09 18:00:04 +08:00
Haojun Liao
69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao
63ef04593d fix: fix syntax error. 2023-06-09 09:48:18 +08:00
Haojun Liao
53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Minglei Jin
cab07b2736 vnode/svr: fix missing colon post vgId 2023-06-09 08:21:45 +08:00
wangmm0220
3f46a9bbc9 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 18:14:02 +08:00
Haojun Liao
6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
Haojun Liao
2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
Minglei Jin
a6968485a8 enh(vnd/sync): refine invalid message log 2023-06-08 14:45:02 +08:00
Haojun Liao
06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
liuyao
1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
Haojun Liao
6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Minglei Jin
57b0cb84eb fix(cache/binary): fix crash in freeItem 2023-06-06 10:23:50 +08:00
yihaoDeng
ae09d1d031 fix:wal error 2023-06-05 19:49:54 +08:00
Minglei Jin
c4418046e1
Merge branch '3.0' into fix/TS-3247 2023-06-05 18:17:18 +08:00
Haojun Liao
0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
wade zhang
11321aa279
Merge pull request #21386 from taosdata/fix/TD-23549
fix(meta): split meta
2023-06-05 17:47:19 +08:00
wangmm0220
1b9387b683 fix:remove tq lock in write thread 2023-06-05 17:45:46 +08:00
wangmm0220
f2ee657b62 fix:check wal not exist again before register to push & move push logic from write thread to query thread 2023-06-05 17:21:47 +08:00
Haojun Liao
fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Minglei Jin
d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
Haojun Liao
077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Haojun Liao
044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao
4bb6429249 fix(query): fix syntax error. 2023-06-03 00:20:59 +08:00
Haojun Liao
becacbc84b fix(query): fix syntax error. 2023-06-02 23:36:47 +08:00
Haojun Liao
b5b4cd2a05 fix(query): load del info with upper version limitation. 2023-06-02 23:15:27 +08:00
Haojun Liao
cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
wangmm0220
56f7a137ee fix:conflict 2023-06-02 15:47:53 +08:00
wangmm0220
b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
yihaoDeng
f4bde33dc3 avoid mem leak 2023-06-02 06:06:05 +00:00
Haojun Liao
cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao
709e3f5079
Merge pull request #21566 from taosdata/fix/TD-24570
reset ud table name
2023-06-02 13:26:49 +08:00
Haojun Liao
d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
Haojun Liao
f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
Haojun Liao
27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
liuyao
27f791ac7f reset ud table name 2023-06-02 11:05:39 +08:00
yihaoDeng
4d0ce625c4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-06-01 22:55:30 +08:00
wangmm0220
a7418d439b Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-06-01 22:50:51 +08:00
wangmm0220
56782a5d41 fix:open task case & modify mqRebVgReq encode/decode style 2023-06-01 18:29:16 +08:00
Haojun Liao
ee8a9856cb
Merge pull request #21557 from taosdata/feature/TD-19042
fix:make version compatible
2023-06-01 18:25:37 +08:00
wangmm0220
69499b9582 fix:make version compatible 2023-06-01 16:09:17 +08:00
wangmm0220
d20e0a06f6 fix:make version compatible 2023-06-01 16:04:45 +08:00
wangmm0220
21920721f3 fix:make version compatible 2023-06-01 15:10:08 +08:00
Minglei Jin
9b9bf2de68 meta/tbc: key cannot be null 2023-06-01 10:41:01 +08:00
Haojun Liao
5d98a319c7
Merge pull request #21515 from taosdata/feature/TD-19042
feat: support create topic as stable with conditions
2023-06-01 09:56:55 +08:00
Haojun Liao
5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
Minglei Jin
fb2f367aac meta/split: trim invalidated uids 2023-06-01 08:13:32 +08:00
Haojun Liao
6d04c4e2fd refactor: do some internal refactor. 2023-05-31 19:05:40 +08:00
Haojun Liao
9e021087a9 refactor: do some internal refactor. 2023-05-31 19:04:53 +08:00
Haojun Liao
a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
Haojun Liao
fa5c024b3e refactor: do some internal refactor. 2023-05-31 17:22:59 +08:00
Haojun Liao
18b971c666 fix(query): check the version range when dump partial rows of file block to sdata block directly. 2023-05-31 17:06:38 +08:00
Haojun Liao
bbb6359ea2 fix(query): add check for version range when dumping partial rows of file block to data block 2023-05-31 17:03:39 +08:00
Minglei Jin
99d6c5cfa0 Merge branch '3.0' into fix/TD-23549 2023-05-31 15:31:20 +08:00
Benguang Zhao
28efd7dcd7 enh: check trans conflicts in mndTransValidate 2023-05-31 10:53:36 +08:00
Haojun Liao
e237b4ac39 refactor: do some internal refactor. 2023-05-31 09:19:05 +08:00
Haojun Liao
eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
wangmm0220
689ee05527 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 15:45:46 +08:00
Haojun Liao
d122a398b3
Merge pull request #21516 from taosdata/fix/TD-24447
set sched status
2023-05-30 10:59:28 +08:00
wangmm0220
d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
Haojun Liao
65b1574fbe
Merge pull request #21499 from taosdata/mark/tmq
fix:put poll to push manager if wal not exist when offset is latest
2023-05-30 09:36:53 +08:00
dapan1121
2d6859d5d6
Merge pull request #21510 from taosdata/szhou/fix-ts3461
fix: if block row num is less than definit min rows, set the bucket index to 0
2023-05-30 08:51:24 +08:00
wade zhang
3a2831a3f4
Merge pull request #21517 from taosdata/fix/TD-24472
fix(rocks/log): set info log level to warn_level
2023-05-30 08:35:00 +08:00
wangmm0220
41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220
07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
wangmm0220
9eb15e41ef fix:put poll to push manager if wal not exist when offset is latest 2023-05-29 16:44:03 +08:00
Minglei Jin
3a9d55ca35 fix(rocks/log): set info log level to warn_level 2023-05-29 15:56:28 +08:00
wangmm0220
5eb1c559e5 fix:save offset if latest 2023-05-29 15:51:00 +08:00
liuyao
b541a0a053 set sched status 2023-05-29 15:42:47 +08:00
wangmm0220
78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
wangmm0220
a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao
8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
shenglian zhou
43c0656df2 fix: if block row num is less than definit min rows, set the bucket index to 0 2023-05-29 10:45:26 +08:00
Haojun Liao
953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Haojun Liao
1e786624b2
Merge pull request #21501 from taosdata/refact/fillhistory
fix(stream): set the skip offset when resume stream task.
2023-05-27 22:45:54 +08:00
Haojun Liao
d9de1813da Merge branch '3.0' into refact/fillhistory 2023-05-27 16:31:11 +08:00
Haojun Liao
b38e253019 fix(stream): set the skip offset when resume stream task. 2023-05-26 22:51:58 +08:00
wangmm0220
a3e214b9e8 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:17:04 +08:00
wangmm0220
50487255b3 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:02:40 +08:00
wade zhang
66b7d90849
Merge pull request #21479 from taosdata/fix/TD-24405
fix(cache): fix deleted data
2023-05-26 17:02:33 +08:00