Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
67094 commits 554 branches 514 tags 1.7 GiB
Commit graph

9491 commits

Author SHA1 Message Date
yihaoDeng
090515c684 refactor code 2023-08-24 17:20:04 +08:00
Haojun Liao
caf20d7b5d fix(stream): release the stream task. 2023-08-24 17:16:34 +08:00
Minglei Jin
70871139bf enh(tsdb/openfile): lazy file open to read/write 2023-08-24 17:16:28 +08:00
wangmm0220
b83cc11043 fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no data 2023-08-24 16:38:53 +08:00
wangmm0220
49216ffa54 fix:transaction in tmq 2023-08-24 16:32:15 +08:00
Haojun Liao
7d9d4ae850 fix(stream): fix the ptr ref. 2023-08-24 16:26:30 +08:00
Haojun Liao
5344efe181 fix(stream): adjust the ptr. 2023-08-24 16:22:24 +08:00
Haojun Liao
4c6bc4d2c3 fix(stream): continue check wal when meeting empty delete block msg. 2023-08-24 16:10:03 +08:00
Haojun Liao
523bad3951 fix(stream): continue check wal when meeting empty delete block msg. 2023-08-24 15:45:43 +08:00
Haojun Liao
2c9f28d97f Merge branch 'main' into fix/liaohj 2023-08-24 14:12:15 +08:00
wangjiaming0909
7fad1de841 Revert "feat: show create table, desc table with col comments" 
This reverts commit 16754b5ac1.
 2023-08-24 13:38:41 +08:00
wade zhang
0860670d37
Merge pull request #22526 from taosdata/enh/TD-25445-new 
enh/TD-25445: ttl split flush and drop table
 2023-08-24 13:57:07 +08:00
shenglian-zhou
e76e6bbb84
Update tsdbReadUtil.c 2023-08-24 11:34:56 +08:00
shenglian-zhou
1965703d53
Merge branch '3.0' into szhou/tsdb-neigh-block 2023-08-24 10:58:23 +08:00
yihaoDeng
3afea998ac refactor log 2023-08-24 10:15:15 +08:00
Haojun Liao
230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
Haojun Liao
b0c5fa8290 fix(stream): reset the task status. 2023-08-23 14:10:41 +08:00
Hongze Cheng
a601cd21bd fix: alter stt_trigger bug 2023-08-23 13:31:19 +08:00
Shungang Li
458fd07976 enh: ttl split flush and drop table 
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
 2023-08-23 11:13:34 +08:00
wade zhang
8c4062c1b0
Merge pull request #22515 from taosdata/fix/TD-25819-2 
fix(tsdb/file): save errno for shell reporting
 2023-08-23 10:49:48 +08:00
wade zhang
e069d72229
Merge pull request #22513 from taosdata/FIX/TD-25864-3.0 
enh: adjust the order of pre-close actions in vnodePreClose
 2023-08-22 17:27:17 +08:00
Haojun Liao
af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Minglei Jin
345743aba5 fix(tsdb/file): save errno for shell reporting 2023-08-22 14:44:32 +08:00
Haojun Liao
cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Benguang Zhao
8be670aee8 enh: place vnodeSyncPreStop ahead of vnodeQueryPreStop in vnodePreClose 2023-08-22 11:30:40 +08:00
Haojun Liao
64556c9f1d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 10:47:02 +08:00
Haojun Liao
def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen
b899a8b7df
Merge branch '3.0' into feat/TD-22970 2023-08-22 10:12:30 +08:00
yihaoDeng
1531e2d7d3 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 09:51:38 +08:00
Haojun Liao
873c22abb1 fix(stream): reset update stream tasks. 2023-08-21 19:32:27 +08:00
Haojun Liao
8b27f98ee4 refactor: do some internal refactor. 2023-08-21 19:08:27 +08:00
yihaoDeng
387b4d365e refactor checkpoint 2023-08-21 19:07:15 +08:00
Hongze Cheng
b8d62a86ed feat: clean useless file 2023-08-21 16:29:48 +08:00
Haojun Liao
29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
dm chen
dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
wade zhang
54e1f69db4
Merge pull request #22481 from taosdata/fix/TD-25822 
enh(tsdb/write): timestamp out of range with s3's last tier storage
 2023-08-21 09:33:06 +08:00
yihaoDeng
6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao
b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Minglei Jin
c4a3a5da35 vnode: fix write to s3 last tier 2023-08-18 18:02:53 +08:00
wade zhang
a7e11c2520
Merge pull request #22482 from taosdata/fix/TD-25818 
fix(vnode/destroy): delete objects
 2023-08-18 17:49:22 +08:00
wade zhang
87a8fe34ef
Merge pull request #22480 from taosdata/fix/TD-25819 
fix(tsdb/reader): use ENOENT for not found objects
 2023-08-18 16:49:54 +08:00
Minglei Jin
7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
Minglei Jin
0242d4ce33 enh(tsdb/write): timestamp out of range with s3's last tier storage 2023-08-18 16:07:15 +08:00
Haojun Liao
c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
Minglei Jin
73ae493fa7 tsdb/reader: use ENOENT for not found objects 2023-08-18 15:43:08 +08:00
liuyao
9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao
87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121
9b953707b8 Merge remote-tracking branch 'origin/main' into fix/mainto3.0 2023-08-18 14:42:43 +08:00
Haojun Liao
edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
dm chen
e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
Haojun Liao
a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao
633ecf66e5 other: add logs. 2023-08-18 10:39:32 +08:00
Haojun Liao
9ad8cf48dc other: add logs. 2023-08-18 10:38:24 +08:00
Haojun Liao
87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
slzhou
4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
Hongze Cheng
8582e0c71a fix: important fix for compact file corruption 2023-08-17 18:13:37 +08:00
dmchen
5f138941f8 tsdb snap core 2023-08-17 17:58:35 +08:00
slzhou
85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
Benguang Zhao
7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou
4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121
0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685 
feat: support column comment
 2023-08-17 14:23:54 +08:00
wangjiaming0909
16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
liuyao
5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
wade zhang
e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug 
fix: tsdb snapshot bug
 2023-08-17 08:25:32 +08:00
Haojun Liao
6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
 2023-08-17 00:08:44 +08:00
Haojun Liao
ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao
f8f8e7a8f0
Merge pull request #22465 from taosdata/fix/3_liaohj 
fix(stream): add the back pressure for sink node.
 2023-08-16 22:59:36 +08:00
yihaoDeng
114df7c349 fix transfer error 2023-08-16 11:37:15 +00:00
Haojun Liao
80506b564b
Merge pull request #22461 from taosdata/fix/liaohj 
refactor: do some internal refactcor
 2023-08-16 19:26:39 +08:00
Haojun Liao
9a76ae72d6 fix(stream): add the back pressure for sink node. 2023-08-16 19:11:43 +08:00
Hongze Cheng
32c5b6a947 fix: tsdb snapshot bug 2023-08-16 18:21:02 +08:00
Haojun Liao
cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
dmchen
fee4b875d1 error code 2023-08-16 17:49:17 +08:00
Hongze Cheng
cedc7bf1b6 fix: memory leak when commit 2023-08-16 17:21:51 +08:00
yihaoDeng
ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen
e020c4e8c5
Merge pull request #22456 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-16 16:49:43 +08:00
Haojun Liao
f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-16 16:48:33 +08:00
Haojun Liao
d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
yihaoDeng
993ae84398 close backend 2023-08-16 07:17:15 +00:00
Haojun Liao
4ea58e5682 refactor: do some internal refactor. 2023-08-16 11:44:05 +08:00
Haojun Liao
6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
dmchen
de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
liuyao
919ffbaf72 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 10:04:07 +08:00
Haojun Liao
63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0 
rebuild index at tag0
 2023-08-16 09:47:43 +08:00
liuyao
fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
Haojun Liao
ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao
7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
dapan1121
df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt 
enhance: tag scan optimization
 2023-08-16 08:58:17 +08:00
wade zhang
1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3 
feat(tsdb/cos): s3 migration
 2023-08-16 08:02:20 +08:00
slzhou
4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
Benguang Zhao
239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
Minglei Jin
1792bf306e vnode: fix cos cache evicting 2023-08-15 16:54:26 +08:00
Haojun Liao
39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Minglei Jin
c4e5cfd2fb retention: return code from copy 2023-08-15 15:40:40 +08:00
Minglei Jin
bd758e0269 retention: remove old files last 2023-08-15 15:14:34 +08:00
Minglei Jin
8639c22cc0 vnode, common: USE_COS def 2023-08-15 14:53:58 +08:00
liuyao
1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
Haojun Liao
b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao
ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq 
opti:wal logic
 2023-08-15 09:16:29 +08:00
Haojun Liao
9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559 
feat:[TD-24559]support geomety type in schemaless
 2023-08-14 22:06:41 +08:00
liuyao
9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
Haojun Liao
2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
yihaoDeng
cf9f9ab471 rebuild index at tag0 2023-08-14 08:01:20 +00:00
Haojun Liao
a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Minglei Jin
989abc2bf6 vnode/cos: move includes into USE_COS 2023-08-14 15:03:17 +08:00
Haojun Liao
91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Minglei Jin
c97b9249fc cos: only for linux 2023-08-14 14:38:28 +08:00
slzhou
692d436d68 fix: fix ci error 2023-08-14 14:14:16 +08:00
Haojun Liao
5ec6b64aab fix(stream): add logs. 2023-08-14 13:12:41 +08:00
Haojun Liao
ead04964fd Merge branch 'main' into fix/liaohj 2023-08-14 12:11:15 +08:00
dapan1121
c2417eb5cd
Merge pull request #22404 from taosdata/fix/TD-25621-3.0 
fix: dup read lock on windows
 2023-08-14 11:37:05 +08:00
Haojun Liao
2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
slzhou
646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
yihaoDeng
246efd83c6 refactor chpt transfer 2023-08-14 02:03:41 +00:00
wangmm0220
dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
wade zhang
1b51f53c15
Merge pull request #22407 from taosdata/fix/TD-25671 
fix: infinite tomb data sync loop
 2023-08-14 09:25:47 +08:00
shenglian zhou
46f92d222d fix: typo error 2023-08-14 08:52:25 +08:00
shenglian zhou
db25f6c01b Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block 2023-08-14 08:49:25 +08:00
shenglian zhou
c5a6cac34f fix: fix compilation error 2023-08-14 08:49:10 +08:00
Haojun Liao
01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj 
refactor: refactor the transfer state procedure.
 2023-08-13 23:28:18 +08:00
slzhou
8e7fc91095 enhance: set file data block iter 2023-08-13 18:30:30 +08:00
Haojun Liao
0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao
ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
wangmm0220
efb472d54a fix:heap use after free 2023-08-12 10:15:40 +08:00
Haojun Liao
f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
wangmm0220
767563752a opti:wal logic 2023-08-11 20:21:13 +08:00
wangmm0220
deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
Hongze Cheng
847bc0da08 fix: infinite tomb data sync loop 2023-08-11 18:10:16 +08:00
slzhou
47d2f9ad6d fix: first run without tag cond 2023-08-11 17:52:52 +08:00
wangmm0220
7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou
42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
Minglei Jin
84452c8dee cos: use static sdk 2023-08-11 16:36:53 +08:00
shenglian zhou
eb9d77d639 ehance: destroy blocklist of table scan info, add block global index list to table scan info 2023-08-11 16:33:49 +08:00
Haojun Liao
87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng
6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao
e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
wangmm0220
25e32bbf7c fix:offset error in tmq & add test cases 2023-08-11 14:25:12 +08:00
Haojun Liao
9322f80343 fix(stream): register the rsp callback. 2023-08-11 13:31:50 +08:00
kailixu
64a1636dd2 chore: trigger CI 2023-08-11 12:54:45 +08:00
kailixu
1d089fe085 fix: dup read lock on windows 2023-08-11 11:34:57 +08:00
yihaoDeng
99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao
1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao
6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng
ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
Haojun Liao
d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq 
fix:offset error in tmq & add test cases
 2023-08-11 10:00:08 +08:00
Minglei Jin
4513acfee9 cos: use static libs for mxml, apr, apu, curl 2023-08-11 09:54:54 +08:00
yihaoDeng
32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
shenglian zhou
b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
wangmm0220
78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
Minglei Jin
c04ada3573 cos: link with static libs 2023-08-10 15:28:22 +08:00
Minglei Jin
cd63e81450 cos: separate building phase for apr & apr-util 2023-08-10 14:18:12 +08:00
dm chen
dd271bca6d
Merge pull request #22394 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-10 14:14:22 +08:00
Haojun Liao
a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
Haojun Liao
161fd6902a fix(stream): fix the acquire task. 2023-08-10 12:45:20 +08:00
Minglei Jin
33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao
f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao
b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-10 11:43:02 +08:00
yihaoDeng
ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao
c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao
4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao
0757e88ced fix(stream): set the correct hash keys. 2023-08-09 23:52:14 +08:00
Haojun Liao
7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
wangmm0220
1f5532fd67 fix:offset error in tmq & add test cases 2023-08-09 19:41:22 +08:00
Minglei Jin
a853d9d40c mxml: use ~/local/include 2023-08-09 18:21:55 +08:00
Haojun Liao
1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao
4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Hui Li
584427dd44
Merge pull request #22374 from taosdata/szhou/restore-minglei-main 
fix: restore stt/block merge back
 2023-08-09 14:40:03 +08:00
Minglei Jin
b08d5b4d42 mxml: add include dir to vnode 2023-08-09 14:02:10 +08:00
Minglei Jin
7e2859ed43 apr: use tarball to avoid ./buildconf 2023-08-09 13:03:37 +08:00
Haojun Liao
3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
Minglei Jin
2e0519b960 apr: fix apr & apr-util project names 2023-08-09 11:01:42 +08:00
Minglei Jin
7114ad63e5 apr：makefile for apr & apr-util 2023-08-09 10:54:17 +08:00
Minglei Jin
4d1155a5cf curl: makefile for curl 2023-08-09 10:43:27 +08:00
shenglian zhou
e9e06d1eae fix: restore stt block/data block merge back 2023-08-09 10:36:54 +08:00
shenglian zhou
2b1478f46e Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-09 10:36:26 +08:00
Haojun Liao
f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
Minglei Jin
16e015253b s3/mxml: remove os external dependency 2023-08-09 10:10:25 +08:00
Haojun Liao
bb39d94f9c
Merge pull request #22357 from taosdata/fix/liaohj 
other: merge fix from 3.0 to main.
 2023-08-09 09:05:54 +08:00
wangmm0220
d322cfce50 fix:add hashIteratorCancel for hash iterator 2023-08-08 16:28:51 +08:00
Haojun Liao
17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Hongze Cheng
c8f106106a fix: update assert issue 2023-08-08 14:49:05 +08:00
dm chen
70a598f072
Merge pull request #22355 from taosdata/3.0 
merge 3.0 to TD-22970
 2023-08-08 09:53:07 +08:00
Hui Li
05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612 
fix: snapshot invalid read
 2023-08-08 09:19:55 +08:00
Haojun Liao
458143c8b7
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei 
fix: restore stt block and data block merge back
 2023-08-08 08:58:02 +08:00
Haojun Liao
f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao
ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj 
other: merge main and fix bugs in stop stream tasks.
 2023-08-07 22:57:13 +08:00
Haojun Liao
aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
shenglian zhou
ec1270f75c fix: restore stt block/data block merge back 2023-08-07 17:17:12 +08:00
Minglei Jin
9e4da6c089 s3/config: parsing s3 configuration 2023-08-07 17:14:58 +08:00
shenglian zhou
9ddab11d98 Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-07 17:13:49 +08:00
yihaoDeng
b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng
eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao
e6b80e6c52 Merge branch '3.0' into fix/3_liaohj 2023-08-07 16:26:31 +08:00
Haojun Liao
225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Hongze Cheng
a545d45b5e fix: snapshot invalid read 2023-08-07 16:12:03 +08:00
Minglei Jin
fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
Hongze Cheng
661f2aca98 fix: memory leak 2023-08-07 14:13:44 +08:00
wangmm0220
9ecabb30f5 fix:ref is not there 2023-08-07 10:27:44 +08:00
wangmm0220
5f02e2ddfb fix:ref is not there 2023-08-07 09:31:29 +08:00
Haojun Liao
8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
wangmm0220
d9a1695257 fix:add log 2023-08-04 18:07:44 +08:00
Minglei Jin
65d8af19ed s3: new api s3Size 2023-08-04 16:35:35 +08:00
Minglei Jin
87783a9650 s3query/get: pull object to local 2023-08-04 15:37:52 +08:00
Minglei Jin
ebd09ca532 tsdb/write: use keep1 as minKey instead of keep2 2023-08-04 13:44:17 +08:00
Minglei Jin
88d755be76 feat(tsdb/cos): s3 migration 2023-08-04 13:31:00 +08:00
wade zhang
abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main 
fix: keep stt iterator valid in the list
 2023-08-04 08:02:16 +08:00
slzhou
fef091b13d fix: keep the stt iterator valid 2023-08-03 21:50:50 +08:00
shenglian zhou
b85c1ae8a1 fix: remove the core 2023-08-03 21:50:50 +08:00
shenglian zhou
5322e38dfe fix: add init add check it 2023-08-03 21:50:50 +08:00
shenglian zhou
97b15ed718 fix: delete SLDataItem if stt level files num is smaller 2023-08-03 21:50:50 +08:00
slzhou
1cb1451e41 fix: set nextIndex when get neighbouring index 2023-08-03 18:26:29 +08:00
dm chen
5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng
f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
wade zhang
68f2018246
Merge pull request #22289 from taosdata/szhou/fix-25385 
fix: keep stt iterator valid
 2023-08-02 20:22:54 +08:00
wade zhang
13c713d33b
Merge pull request #22290 from taosdata/3.0_main 
merge 3.0 into branch main
 2023-08-02 16:04:08 +08:00
Hongze Cheng
f90f0b7047 disable infinite count loop 2023-08-02 15:51:51 +08:00
Minglei Jin
cff85550f9 Merge branch '3.0' into 3.0_main 2023-08-02 14:10:45 +08:00
wade zhang
c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400 
enh(tsdb/cache/read): lazy init table map hash and entries
 2023-08-02 14:08:43 +08:00
Haojun Liao
0feffc687b fix(tsdb): check uid in multiple stt statistics blocks. 2023-08-02 12:44:45 +08:00
Minglei Jin
0e51277521 cache/reader: cleanup contiue nex row 2023-08-02 12:43:57 +08:00
Haojun Liao
2c357f1958 fix(stream): enable filter table based on table statistics. 2023-08-02 11:18:35 +08:00
Minglei Jin
7fca057a81 cache/reader: move pLastCols into single block 2023-08-02 11:10:12 +08:00
slzhou
dd8e893508 fix: keep the stt iterator valid 2023-08-02 11:02:27 +08:00
Minglei Jin
95cc540d9b cache/reader: clean uid in all loop 2023-08-02 10:48:55 +08:00
shenglian zhou
38e797b4ff fix: remove the core 2023-08-02 10:43:26 +08:00
shenglian zhou
d5ca51e94d fix: add init add check it 2023-08-02 10:43:26 +08:00
shenglian zhou
6bf95c0c4d fix: delete SLDataItem if stt level files num is smaller 2023-08-02 10:43:26 +08:00
Haojun Liao
13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Minglei Jin
ed76525c4f cache/reader: cleanup uid in signle loop 2023-08-02 10:28:13 +08:00
Minglei Jin
29b2f32821 cache reader: cleanup stt init 2023-08-02 09:49:41 +08:00
Haojun Liao
53aefa531f Merge branch '3.0' into fix/3_liaohj 2023-08-02 09:45:21 +08:00
Haojun Liao
e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Hongze Cheng
4ba4e83b5b fix: retention file corruption 2023-08-01 20:19:13 +08:00
Minglei Jin
7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin
a593e887fa cache: remove nFileset from fs state 2023-08-01 18:37:23 +08:00
Minglei Jin
7ad628417a fix mem issue: stack-use-after-scope 2023-08-01 17:57:38 +08:00
Minglei Jin
4716fc6400 cache/fs: remove fs state's tsdb handle 2023-08-01 17:49:05 +08:00
Minglei Jin
1d5532019f tsdb/merge-tree: cleanup comment 2023-08-01 17:25:15 +08:00
Minglei Jin
f72f129d41 cache/skyline: cleanup del array 2023-08-01 17:23:53 +08:00
Minglei Jin
c997662ba0 tsdb/cache: build skyline only if there's del data 2023-08-01 16:50:00 +08:00
Minglei Jin
94b9599f95 fix null pointer dereference 2023-08-01 16:39:14 +08:00
Haojun Liao
637f09359a other: merge main. 2023-08-01 16:15:34 +08:00
Minglei Jin
72ac5a4e3b tsdb/cache: use read util's uid compare functor 2023-08-01 16:08:20 +08:00
Minglei Jin
c0a0e07597 cache/read: lazy init uidList when laoding from tsdb 2023-08-01 16:02:09 +08:00
Minglei Jin
b3fae65d90 enh(tsdb/cache/read): lazy init table map hash and entries 2023-08-01 15:53:42 +08:00
Hongze Cheng
78c23f407e fix compile issue 2023-08-01 15:04:14 +08:00
Hongze Cheng
07c40943a4 fix: TD-25408 2023-08-01 15:01:06 +08:00
wade zhang
347e78ecb5
Merge pull request #22272 from taosdata/fix/TD-25466 
Fix/td 25466
 2023-08-01 14:22:24 +08:00
Hongze Cheng
1b39147496 more refact 2023-08-01 11:36:37 +08:00
Hongze Cheng
0e46041c1a fix: tsdbRetention memory leak 2023-08-01 11:21:40 +08:00
Haojun Liao
ae9745ecf2
Merge pull request #22258 from taosdata/mark/tmq-3.0 
fix:add committed & seek process logic
 2023-08-01 09:52:09 +08:00
Haojun Liao
ea875c58f2
Merge pull request #22263 from taosdata/mark/tmq-main 
fix:add committed & seek process logic
 2023-08-01 09:43:23 +08:00
Haojun Liao
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457 
check update data
 2023-07-31 22:56:05 +08:00
Haojun Liao
2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj 
fix(stream): set the correct end key of delete block.
 2023-07-31 22:55:50 +08:00
wangmm0220
68ae64cdb2 fix:add committed & seek process logic 2023-07-31 18:53:25 +08:00
wangmm0220
cddf27e8b4 fix:add committed & seek process logic 2023-07-31 18:48:50 +08:00
Haojun Liao
d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
wangmm0220
6179618b17 fix:add committed & seek process logic 2023-07-31 17:56:04 +08:00
liuyao
32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
wangmm0220
8093ef2dc8 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-31 16:14:25 +08:00
Haojun Liao
9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Minglei Jin
079d7ff69e fix(tsdb/read2): reset stt reader when suspended 2023-07-31 15:21:47 +08:00
wade zhang
c7fa5ed6ef
Merge pull request #22247 from taosdata/fix/TD-25436 
fix(tsdb/cache): check stt data with empty brin index
 2023-07-31 11:24:37 +08:00
Minglei Jin
135beebc0a fix(tsdb/cache): check stt data with empty brin index 2023-07-31 09:15:08 +08:00
wade zhang
bae028d65c
Merge pull request #22230 from taosdata/mark/tmq 
fix:semaphore always wait in tmq commit logic
 2023-07-31 09:10:13 +08:00
wade zhang
c26165975d
Merge pull request #22227 from taosdata/fix/TS-3728 
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
 2023-07-30 14:28:56 +08:00
Haojun Liao
8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao
0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
Haojun Liao
f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
wade zhang
c19feb2fa1
Merge pull request #22236 from taosdata/fix/TD-25416 
fix(tsdb/cache/del): use lru mutex to fix race with committing
 2023-07-28 23:17:45 +08:00
Haojun Liao
936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao
d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
Minglei Jin
1fcbf3432c tsdb/cache/del: remove duplicate lruMutex lock 2023-07-28 17:20:20 +08:00
wangmm0220
d982a7cb80 fix:heap use after free for wal 2023-07-28 16:59:35 +08:00
Minglei Jin
b0f65dfa62 fix(tsdb/cache/del): use lru mutex to fix race with committing 2023-07-28 16:32:07 +08:00
wangmm0220
6e673072cd fix:conflicts 2023-07-28 14:57:13 +08:00
Haojun Liao
9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao
74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao
2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj 
other: merge main.
 2023-07-28 13:06:17 +08:00
wangmm0220
2f6c565392 fix:pHandle not load if taosd restart 2023-07-28 11:48:53 +08:00
wade zhang
b3e5b5bd24
Merge pull request #22217 from taosdata/fix/TD-25386 
fix(tsdb/cache): move to stt next row if data file exausted
 2023-07-28 08:56:29 +08:00
Haojun Liao
ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj 
fix(stream): scan wal in step2
 2023-07-28 00:42:15 +08:00
Haojun Liao
7f3d1dc464 fix(stream): fix memory leak. 2023-07-27 23:06:53 +08:00
wangmm0220
77d43ef5fd fix:tmq ci error 2023-07-27 20:28:45 +08:00
Haojun Liao
fbb33be85d other: add some comments. 2023-07-27 18:59:38 +08:00
Haojun Liao
22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
Minglei Jin
cc9b9bd0b9 fix(tsdb/cache): move to stt next row if data file exausted 2023-07-27 17:19:42 +08:00
Haojun Liao
b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao
3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao
6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
wangmm0220
75eacd56f1 fix:add log 2023-07-27 15:58:32 +08:00
wade zhang
a72c11c8de
Merge pull request #22205 from taosdata/fix/TD-25315 
fix(tsdb/commit2): new maxDelKey for commit context
 2023-07-27 15:48:46 +08:00
wangmm0220
2d41a42976 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728 2023-07-27 15:31:16 +08:00
Haojun Liao
40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Minglei Jin
fe495f7013 tsdb/commit2: fix commit minKey for del 2023-07-27 13:54:48 +08:00
Haojun Liao
e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
Minglei Jin
8a2764c698 tsdb/commit2: use max fileset's maxKey as initial maxDelKey 2023-07-27 10:51:17 +08:00
Minglei Jin
dd32f12f92 tsdb/commit2: reset nextKey to max to stop commit 2023-07-27 09:50:32 +08:00
Minglei Jin
992d623ae5 fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN 2023-07-27 09:34:47 +08:00
Minglei Jin
580b7124cf fix(tsdb/commit2): new maxDelKey for commit context 2023-07-27 09:16:28 +08:00
Haojun Liao
087d54a807
Merge pull request #22198 from taosdata/fix/3_liaohj 
fix(stream): do filter before the update check.
 2023-07-26 18:57:48 +08:00
yihaoDeng
287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
Haojun Liao
c57defa1c9
Merge pull request #22195 from taosdata/szhou/fix-td25369 
fix: stt and data block merge
 2023-07-26 17:11:18 +08:00
Haojun Liao
6a6830761d fix(tsdb): check for null ptr of pScanInfo 2023-07-26 17:08:29 +08:00
Haojun Liao
3c387f6e91 fix(stream): fix syntax error. 2023-07-26 17:00:41 +08:00
Haojun Liao
432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao
610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj 
fix(stream): set the correct step2 scan time window range.
 2023-07-26 16:34:10 +08:00
shenglian zhou
1357e623d0 fix: fix compilation error 2023-07-26 15:43:50 +08:00
shenglian zhou
79020ea4a4 fix: stt and data block merge 2023-07-26 15:01:20 +08:00
Haojun Liao
df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Haojun Liao
cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Haojun Liao
728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
wade zhang
d8fd5b9394
Merge pull request #22190 from taosdata/fix/TD-25315 
fix(tsdb/del): reset next key to del record's ekey
 2023-07-26 10:23:01 +08:00
yihaoDeng
c61393a7a1 fix stream state transfer 2023-07-26 01:33:41 +00:00
Haojun Liao
b6eb739ae0 fix(tsdb): fix the 2023-07-26 09:14:19 +08:00
Minglei Jin
fb860726de fix(tsdb/del): reset next key to del record's ekey 2023-07-26 08:40:44 +08:00
Haojun Liao
1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
wade zhang
02bc1b2a8f
Merge pull request #22186 from taosdata/fix/TD-25315 
fix(tsdb/del): continue committing fileset if more del left
 2023-07-25 17:41:30 +08:00
Haojun Liao
0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Minglei Jin
7bfb4e0f88 fix(tsdb/del): continue committing fileset if more del left 2023-07-25 16:42:45 +08:00
wangmm0220
be4e47e9a7 fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version 2023-07-25 16:15:33 +08:00
Haojun Liao
d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
Haojun Liao
c2588d71c3
Merge pull request #22173 from taosdata/fix/TS-3728 
fix:avoid request offset type is 0
 2023-07-25 14:59:30 +08:00
wade zhang
2bf84c2676
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0 
enh: compatibility between getFileNamePrefix and tsdbTFileName
 2023-07-25 14:26:14 +08:00
Benguang Zhao
01f45b2a99 enh: compatibility between getFileNamePrefix and tsdbTFileName 2023-07-25 11:35:35 +08:00
Minglei Jin
1bce96ea27 fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's) 2023-07-25 10:46:03 +08:00
wade zhang
7ea9cf1ddc
Merge pull request #22166 from taosdata/fix/TD-24422 
fix(tsdb/cache): reuse data file reader
 2023-07-25 10:28:59 +08:00
Haojun Liao
96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj 
fix(stream): fix the invalid check of step2 .
 2023-07-25 00:30:06 +08:00
Haojun Liao
a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
wangmm0220
6a0e994169 fix:avoid request offset type is 0 2023-07-24 19:24:05 +08:00
Haojun Liao
d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj 
fix(stream): add some logs, and remove the invalid loop.
 2023-07-24 16:29:51 +08:00
wangmm0220
9628a9f74e fix:open info log in tmq & ignore wal apply ver when read wal 2023-07-24 15:53:02 +08:00
Haojun Liao
01f11bf5a6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/common/src/tglobal.c
#	source/libs/executor/src/timewindowoperator.c
 2023-07-24 15:25:43 +08:00
Haojun Liao
1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Minglei Jin
424dd40078 tsdb/cache: reuse pDataFileReader for same fileset 2023-07-24 14:45:35 +08:00
Haojun Liao
9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
Haojun Liao
13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj 
fix(stream): refactor the halt status to check more status.
 2023-07-24 11:04:08 +08:00
Minglei Jin
968cfd9e65 tsdb/cache: pLastIter null pointer check 2023-07-24 11:03:07 +08:00
wade zhang
5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize 
fix(tsdb/cache): new next stt row state for fs tranverse
 2023-07-24 10:47:51 +08:00
Haojun Liao
1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao
6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj 
fix(stream): set the correct flag of pause/resume.
 2023-07-24 09:07:49 +08:00
Minglei Jin
13491fab95 tsdb/cache: new next stt row state for fs tranverse 2023-07-24 08:51:20 +08:00
Haojun Liao
0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao
e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao
4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao
321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-07-22 15:06:28 +08:00
Haojun Liao
bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao
1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao
16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wade zhang
7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize 
for test purpose
 2023-07-21 14:18:32 +08:00
wangmm0220
bb86f5c580 fix:commit offset should not plus 1 2023-07-21 11:13:05 +08:00
wangmm0220
10ebf1f438 fix:subscribeStb.py maybe failed 2023-07-21 11:07:34 +08:00
dmchen
7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
Haojun Liao
39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
Haojun Liao
c9d75eab5a refactor: do some internal refactor. 2023-07-21 09:16:13 +08:00
Haojun Liao
db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng
519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Haojun Liao
9353f7c8cf refactor: do some internal refactor. 2023-07-20 16:35:02 +08:00
Haojun Liao
c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao
45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao
87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao
aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng
6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
Minglei Jin
48222f5dc3 tsdb/cache: move data file reader for fs iter to cache reader 2023-07-20 09:11:26 +08:00
Minglei Jin
6dd4ec41ae tsdb/cache cleanup: remove unused fs methods 2023-07-20 08:51:03 +08:00
Minglei Jin
7f0ea10573 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-20 08:42:12 +08:00
Minglei Jin
46d6dcda3e tsdb/cache: reset skyline when clearing fileset 2023-07-20 08:41:32 +08:00
Haojun Liao
bfcc538205 fix(tsdb):disable stt statistics. 2023-07-20 00:01:30 +08:00
yihaoDeng
733db123ad refactor code 2023-07-19 13:24:59 +00:00
Haojun Liao
97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
wangmm0220
d7d81d82a0 feat:add committed & position & commite_offset interface 2023-07-19 18:27:19 +08:00
Yihao Deng
91a15fd7bd
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 18:14:08 +08:00
Minglei Jin
ce71b8bbe7 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-19 18:11:14 +08:00
Minglei Jin
4eaecd11de tsdb/cache: merge fs & stt row 2023-07-19 18:10:36 +08:00
wangmm0220
5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
Haojun Liao
37ae80d135 fix(tsdb): fix memory leak. 2023-07-19 16:42:51 +08:00
Haojun Liao
d82fb45a4f Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-19 15:01:37 +08:00
Haojun Liao
a84efab2c8 enh(tsdb): add table filter according to stt block statistics data. 2023-07-19 15:01:25 +08:00
Minglei Jin
913cfe43e8 tsdb/cache: remove input[3] 2023-07-19 12:20:54 +08:00
Minglei Jin
7a716d452e tsdb/fs2: fix vnode get primary dir args 2023-07-19 11:36:26 +08:00
Minglei Jin
4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
Shungang Li
1d88a6a7c6 enh: ttlMgrFlush adjust log level 2023-07-19 11:15:54 +08:00
Minglei Jin
185081a948 tsdb/fsreader: clear last fileset's resources 2023-07-19 11:04:28 +08:00
dm chen
141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
yihaoDeng
b1f3dfe88f Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2 2023-07-19 02:17:42 +00:00
yihaoDeng
34c2e6a180 forbidden streamsnapshot reader 2023-07-19 02:15:12 +00:00
Haojun Liao
a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao
2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao
fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang
c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0 
feat: distribute vnode primary dirs among disks of level 0
 2023-07-19 09:44:43 +08:00
wangmm0220
5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
Haojun Liao
9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
Minglei Jin
a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
dmchen
3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Benguang Zhao
2faa3d2e7b enh: check validity of diskPrimary during vnodeOpen 2023-07-18 15:39:29 +08:00
Minglei Jin
9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
Haojun Liao
901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
Benguang Zhao
24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
Benguang Zhao
5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao
6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
Haojun Liao
92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
Minglei Jin
998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
yihaoDeng
40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
Minglei Jin
463b5b608b tsdb/read2: fix null pointer runtime error 2023-07-17 18:35:56 +08:00
Minglei Jin
62cfda1a88 tsdb/read2: fix UAF 2023-07-17 17:35:08 +08:00
Minglei Jin
832b68e17d tsdb/cache: load mem del data 2023-07-17 15:48:08 +08:00
Minglei Jin
a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin
27b8671f97 tsdb/cache: new cacheReader field for tsdb & cache reader 2023-07-17 14:27:27 +08:00
Minglei Jin
9b0b4061e0 tsdb/cache: relayout cache row reader 2023-07-17 14:16:54 +08:00
Haojun Liao
eaaf306c81 fix(stream): fix syntax error 2023-07-17 12:54:05 +08:00
Haojun Liao
d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Benguang Zhao
b21e603481 enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json 2023-07-17 11:48:48 +08:00
Minglei Jin
8263c49c17 tsdb/cache: fix compilation 2023-07-17 09:00:17 +08:00
Minglei Jin
2b21c5e0f6 tsdb2: adapt cache with tsdb2 API 2023-07-17 08:50:54 +08:00
Haojun Liao
a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao
c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng
e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
yihaoDeng
3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
wade zhang
c2b3c2db52
Merge pull request #22066 from taosdata/fix/TD-25215-main 
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main
 2023-07-14 17:53:25 +08:00
wade zhang
021fcf2a59
Merge pull request #22059 from taosdata/fix/TD-25215 
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables
 2023-07-14 17:53:06 +08:00
Haojun Liao
b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao
eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
wangmm0220
6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220
bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
Hongze Cheng
145c43e346 little fix 2023-07-14 16:38:35 +08:00
yihaoDeng
15f5fd19eb fix recover error 2023-07-14 14:47:06 +08:00
yihaoDeng
e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
Shungang Li
a48d359f8b fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-14 14:37:17 +08:00
Hongze Cheng
25120cede4 fix sma merge error 2023-07-14 13:46:01 +08:00
Hongze Cheng
5a89b96e91 make compile 2023-07-14 10:21:06 +08:00
Hongze Cheng
1fad69df3b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-14 10:13:15 +08:00
dapan1121
9bf7180074
Merge pull request #21969 from taosdata/enh/TD-23769-3.0 
enh: rsma stream state adaption
 2023-07-13 19:19:37 +08:00
Haojun Liao
e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj 
other: merge main
 2023-07-13 17:55:28 +08:00
Shungang Li
a39a9428af fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-13 17:43:32 +08:00
Benguang Zhao
81a2cd16e7 enh: unify handling of vnode primary dir in current_fname 2023-07-13 17:37:53 +08:00
kailixu
6ee135cb52 chore: more code 2023-07-13 17:37:31 +08:00
kailixu
67461d92a7 chore: merge 3.0 and solve conflict 2023-07-13 17:35:55 +08:00
Hongze Cheng
d81d2790ea Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-13 17:20:45 +08:00
Haojun Liao
e2ae868377
Merge pull request #22032 from taosdata/mark/tmq 
fix:set firset version to reqOffset of response
 2023-07-13 16:35:21 +08:00
Haojun Liao
813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
wade zhang
ec86a68b6f
Merge pull request #22045 from taosdata/FEAT/TS-2699-3.0 
enh: unify handling of vnode primary dir for vnd, tsdb and sma
 2023-07-13 13:55:46 +08:00
Benguang Zhao
dc75f7ce21 enh: use VNODE_RSMA_DIR in tdRSmaGetCurrentFName 2023-07-13 11:27:31 +08:00
Haojun Liao
f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Benguang Zhao
e209b487c6 enh: rename func name vnodeGetPrimaryDir 2023-07-13 10:38:05 +08:00
Haojun Liao
2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
Haojun Liao
08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
kailixu
466f1037b4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 18:50:16 +08:00
Haojun Liao
c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj 
fix(stream): fix concurrent bug in save task meta.
 2023-07-12 18:17:27 +08:00
kailixu
8f58f9aa5b fix: skip primary key for block sma 2023-07-12 18:07:01 +08:00
Benguang Zhao
05e8af4837 enh: unify handling of vnode primary dir for vnd and tsdb 2023-07-12 17:58:18 +08:00
Benguang Zhao
4c3bf41178 enh: unify handling of vnode primary dir for sma 2023-07-12 17:56:21 +08:00
Benguang Zhao
bbf58d2d9d enh: unify handling of vnode primary dir in vnodeCreate and metaOpen 2023-07-12 17:56:21 +08:00
wangmm0220
cf64d4c9c5 fix:set get_assignment offset to first version of response block 2023-07-12 17:22:23 +08:00
Hongze Cheng
3fc282f035 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-12 11:57:19 +08:00
Haojun Liao
3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao
d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
kailixu
8cb6356b99 chore: more code 2023-07-12 10:47:02 +08:00
Haojun Liao
9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
kailixu
f282acbc4c chore: rsma refactor 2023-07-12 10:13:50 +08:00
kailixu
8c8bcabdd4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 09:11:34 +08:00
wade zhang
2cfdd234b3
Merge pull request #22034 from taosdata/feat/TS-3239 
feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0
 2023-07-12 08:18:38 +08:00
Haojun Liao
fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
kailixu
ba0bce8092 chore: code revert 2023-07-11 18:52:51 +08:00
kailixu
30f8c9c79e chore: more check 2023-07-11 18:08:48 +08:00
Shungang Li
4886cb4674 feat: port 'keepTimeOffset' from 2.6 to 3.0 2023-07-11 17:40:35 +08:00
kailixu
7c85f7701d chore: more check 2023-07-11 16:32:29 +08:00
wangmm0220
8dd7f36993 fix:set firset version to reqOffset of response 2023-07-11 16:19:38 +08:00
wangmm0220
7bc19df0ef fix:set firset version to reqOffset of response 2023-07-11 15:48:19 +08:00
Haojun Liao
2e386a6fdf fix(stream): check if stream task is in normal state. 2023-07-11 15:23:49 +08:00
wangmm0220
cb62d4cb97 fix:set firset version to reqOffset of response 2023-07-11 14:49:53 +08:00
Haojun Liao
6d78816d22 fix(stream): fix syntax error. 2023-07-11 14:06:25 +08:00
kailixu
314123ef34 chore: add check 2023-07-11 14:05:09 +08:00
Haojun Liao
09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
kailixu
d5435926c2 chore: more code 2023-07-11 12:37:01 +08:00
Haojun Liao
3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao
04f5bcd23a fix(stream): remove invalid set of task status . 2023-07-11 08:51:13 +08:00
kailixu
14b438ec64 chore: bug fix 2023-07-11 07:02:36 +08:00
kailixu
f391462e34 chore: more code 2023-07-10 20:01:50 +08:00
kailixu
57ceaed535 chore: code revert 2023-07-10 19:55:01 +08:00
kailixu
f16fa6d000 enh: exclude tk log from time series check 2023-07-10 19:48:50 +08:00
Haojun Liao
87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao
385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
Hongze Cheng
7014f790a0 optmize table statistic info 2023-07-10 17:35:26 +08:00
liuyao
84f0dfd6d4 stream operator checkpoint 2023-07-10 11:07:08 +08:00
kailixu
802112c00a chore: more code 2023-07-09 21:49:37 +08:00
Haojun Liao
98349a4265 refactor(tsdb): do some internal refactor. 2023-07-09 18:05:24 +08:00
kailixu
a7253fc390 Merge branch '3.0' into enh/TD-25083-3.0 2023-07-09 16:04:38 +08:00
wangmm0220
35ba132a29 fix:conflicts from main 2023-07-09 12:52:18 +08:00
wangmm0220
a5363e6e03 fix:test case in tmq 2023-07-09 12:49:50 +08:00
Haojun Liao
ba4d726af6 fix(tsdb): fix error in tsdbread. 2023-07-09 01:31:02 +08:00
Haojun Liao
b39198a53a refactor: do some internal refactor. 2023-07-08 21:44:58 +08:00
Haojun Liao
1470e51dc1 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-08 21:25:24 +08:00
Haojun Liao
14844c7b4b refactor(tsdb): opt tsdb read perf 2023-07-08 21:25:11 +08:00
wangmm0220
f9f656b21a fix:return offset stored if get assignment in init mode 2023-07-08 13:25:39 +08:00
Haojun Liao
4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao
a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao
9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
wangmm0220
4436eb7e0f fix:set commitOffset is send msg success & optimize log & add test cases for TD-25129 2023-07-07 19:12:18 +08:00
kailixu
a746d288a1 chore: add debug info 2023-07-07 18:53:01 +08:00
Haojun Liao
128f67784a fix(stream): fix error in parsing checkpoint msg. 2023-07-07 18:17:50 +08:00
Haojun Liao
8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
wangmm0220
106e273157 fix:bugs in get_assignment 2023-07-07 16:12:15 +08:00
Haojun Liao
47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
wade zhang
0865b1a828
Merge pull request #21973 from luckeverda/fix/TD-25074-main 
fix/TD-25074 for main
 2023-07-07 11:24:33 +08:00
Hongze Cheng
090ca39132 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-07 10:38:04 +08:00
kailixu
cb8b10f6a2 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:19:43 +08:00
kailixu
64ef48e0dd Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:17:25 +08:00
kailixu
06c52af2c2 enh: exclude tk_log from timeseries check 2023-07-07 10:14:37 +08:00
wade zhang
47a7a45d1d
Merge pull request #21978 from taosdata/fix/TD-24962 
fix(coverity): fix coverity scan issues
 2023-07-07 08:20:07 +08:00
wangmm0220
0928bd5510 fix:send rsp offset to client if unregister push mgr 2023-07-06 19:35:48 +08:00
wangmm0220
b2d41ce907 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-25071 2023-07-06 19:34:22 +08:00
Haojun Liao
aad906f2b0 fix(stream): fix syntax error. 2023-07-06 18:26:44 +08:00
Haojun Liao
d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
Minglei Jin
09222801c4 fix(coverity): fix coverity scan issues 2023-07-06 17:52:48 +08:00
wangmm0220
f1ce91f600 fix:race condition for pTq->pStore->pHash 2023-07-06 16:49:59 +08:00
wangmm0220
9e6e59adc2 fix:race condition for pTq->pStore->pHash 2023-07-06 16:47:48 +08:00
Shungang Li
a31e054146 fix: ttlmgr convert in metaUpgrade 2023-07-06 15:47:32 +08:00
Shungang Li
a1a2b8331f fix: ttl fill cache only in initialization 2023-07-06 15:47:32 +08:00
wade zhang
84740e96ee
Merge pull request #21939 from luckeverda/fix/TD-25074 
fix/TD-25074
 2023-07-06 15:44:22 +08:00
Haojun Liao
a94ace4cc8 refactor:do some internal refactor. 2023-07-06 15:10:45 +08:00
wangmm0220
47ae92af93 fix:conflicts from main 2023-07-06 13:40:04 +08:00
wangmm0220
11e6856d3e fix:init char array 2023-07-06 13:37:58 +08:00
kailixu
c1393fb2e2 chore: invoke streamStateCommit for rsma 2023-07-06 13:26:25 +08:00
Haojun Liao
5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
kailixu
e8cdf132fb chore: rsma code refactor 2023-07-06 11:32:20 +08:00
Haojun Liao
f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
kailixu
61380b7822 chore: test case adaption 2023-07-06 11:09:44 +08:00
Haojun Liao
851f6df094 enh(tsdb): opt perf. 2023-07-06 09:58:15 +08:00
wangmm0220
34a62c3f38 fix:vginfo assigment not in same time,we should get vginfo by vg,not all vg 2023-07-05 22:55:41 +08:00
kailixu
3f6768d8cf chore: rsma rocksdb adaption 2023-07-05 19:43:29 +08:00
Haojun Liao
aeb9473382 enh(tsdb): add some logs. 2023-07-05 19:41:34 +08:00
Haojun Liao
a0a116b674 fix(tsdb): fix error in sma extracting and do NOT clear fileDelData when extracting data from stt files. 2023-07-05 19:11:14 +08:00
kailixu
df7866e9f6 chore: refactor 2023-07-05 19:08:43 +08:00
kailixu
59e83fca5d chore: build fix 2023-07-05 18:33:09 +08:00
Benguang Zhao
9b477eed81 enh: terminate on failure to recover WAL from writing errors, or to commit vnode 2023-07-05 17:54:56 +08:00
Haojun Liao
74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory 
refactor: do some internal refactor.
 2023-07-05 17:47:00 +08:00
Shungang Li
e6e52c3641 fix: ttlmgr convert in metaUpgrade 2023-07-05 17:44:17 +08:00
Haojun Liao
8f8dfc593b Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-05 17:43:56 +08:00
Haojun Liao
a738b6eba6 fix(tsdb): add empty del skyline check. 2023-07-05 17:43:41 +08:00
Hongze Cheng
21d972938f more fix 2023-07-05 17:43:15 +08:00
Haojun Liao
f35db3ba6c fix(tsdb): add none check. 2023-07-05 17:36:55 +08:00
Haojun Liao
f0cec22d4f fix(tsdb): fix some error. 2023-07-05 17:20:17 +08:00
kailixu
d093b0e20f chore: merge 3.0 2023-07-05 16:45:12 +08:00
Haojun Liao
8c8aa5cd57 fix(tsdb): fix error in extract brinblock. 2023-07-05 16:39:04 +08:00
wangmm0220
bdfeb32923 fix:bugs in tmq_get_topic_assignment 2023-07-05 16:04:34 +08:00
Haojun Liao
03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao
7d7e12a5e7 fix(tsdb): fix syntax error. 2023-07-05 11:22:58 +08:00
Hongze Cheng
1304c08cdd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-05 10:57:55 +08:00
Haojun Liao
9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory 
refactor: refactor the fill history operation
 2023-07-05 10:48:51 +08:00
Haojun Liao
6e15478c43 fix(tsdb): do some internal refactor. 2023-07-05 10:31:38 +08:00
Haojun Liao
6fb1e716c0 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-05 10:31:09 +08:00
Haojun Liao
8ab10a8da1 fix(tsdb): fix error in check tomb record. #TD-25117 2023-07-05 10:30:55 +08:00
Hongze Cheng
23a743fd66 fix snapshot coredump 2023-07-05 10:01:00 +08:00
Haojun Liao
37ff3a419a fix(tsdb): fix error in load tomb from stt files. 2023-07-04 23:35:52 +08:00
wade zhang
bc8efd7014
Merge pull request #21949 from taosdata/FIX/TD-25103-3.0 
enh: tfsRename in the reverse order of levels with tiered storages
 2023-07-04 17:34:49 +08:00
Benguang Zhao
1ca4256927 enh: use var prefixLen instead in vnodeRenameVgroupId 2023-07-04 15:36:42 +08:00
Haojun Liao
ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
wade zhang
35a35ad4f9
Merge pull request #21930 from taosdata/fix/TD-24966 
fix: coverity scan
 2023-07-04 14:55:54 +08:00
Hongze Cheng
acde8586e0 ignore file check 2023-07-04 14:16:09 +08:00
Hongze Cheng
2e88ad2c14 fix: upgrade bug 2023-07-04 14:00:44 +08:00
Haojun Liao
82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678 
feat:subscribe only meta info
 2023-07-04 11:28:27 +08:00
Shungang Li
dbf47f5fc1 fix: ttl fill cache only in initialization 2023-07-03 21:30:53 -04:00
wangmm0220
dbcd33a402 fix:memory leak 2023-07-03 18:43:12 +08:00
Benguang Zhao
ddaba463c0 enh: check failure of tfsMkdirRecurAt 2023-07-03 16:16:27 +08:00
Haojun Liao
200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao
20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj 
fix: fix coverity issue.
 2023-07-03 15:15:21 +08:00
Hongze Cheng
8384b6ce29 fix CI case 2023-07-03 15:01:05 +08:00
Hongze Cheng
5390732f42 fix: coverity scan 2023-07-03 14:13:01 +08:00
Hongze Cheng
214c92264c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-03 11:27:26 +08:00
wangmm0220
136bc379d1 feat:ignore delete info 2023-07-03 11:02:08 +08:00
Haojun Liao
9e98c64b1e fix(tsdb): set correct stt load info. update the test case. 2023-06-30 22:57:49 +08:00
Haojun Liao
450a9f3ca1 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-30 18:22:35 +08:00
Haojun Liao
c2a7c37b00 fix(tsdb): opt perf for reading data from stt files. 2023-06-30 18:22:20 +08:00
wade zhang
84c20463f3
Merge pull request #21907 from luckeverda/fix/ttlpresubmit 
fix: ttl compatibility for main
 2023-06-30 16:47:25 +08:00
wade zhang
617115ba85
Merge pull request #21906 from luckeverda/fix/ttlpresubmit 
fix: ttl compatibility for 3.0
 2023-06-30 16:45:58 +08:00
Hongze Cheng
9fd453d78a more code 2023-06-30 16:13:48 +08:00
yihaoDeng
93391f73e5 vnode snapshot read 2023-06-30 07:46:56 +00:00
Hongze Cheng
2f57c8439b more fix 2023-06-30 15:04:18 +08:00
Hongze Cheng
e79fe91ba0 more code 2023-06-30 14:57:57 +08:00
Shungang Li
8f164a7922 fix: ttl compatibility 2023-06-30 14:57:34 +08:00
Hongze Cheng
c714138e9e fix snapshot problem 2023-06-30 14:37:26 +08:00
Hongze Cheng
55840709ed skip dropped table tomb data commit 2023-06-30 13:54:49 +08:00
wangmm0220
58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
yihaoDeng
e25df41536 vnode snapshot read 2023-06-30 03:11:55 +00:00
Haojun Liao
ee5e3b7cc0 fix(tsdb): fix error in tsdb2 2023-06-30 00:38:53 +08:00
Haojun Liao
9740d1353c fix(tsdb): opt perf for read data in stt files. 2023-06-29 23:16:07 +08:00
Haojun Liao
15487c9c8f fix(tsdb): fix memory leak. 2023-06-29 22:52:07 +08:00
yihaoDeng
60a0b1e1bd vnode snapshot read 2023-06-29 11:52:34 +00:00
Haojun Liao
17c6b9f81b fix(tsdb): fix error in set file reader. 2023-06-29 18:40:14 +08:00
Hongze Cheng
eee8007736 fix bug 2023-06-29 17:48:36 +08:00
yihaoDeng
9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Haojun Liao
622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
Haojun Liao
63834713b2 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-29 15:09:14 +08:00
Haojun Liao
81eb8523f1 fix(tsdb): fix invalid ptr. 2023-06-29 15:09:01 +08:00
Hongze Cheng
1e5fef9dbe fix retention CI cases 2023-06-29 15:01:54 +08:00
yihaoDeng
5cebd36c1c add checkpoint 2023-06-29 06:56:14 +00:00
dapan1121
c8435de64a
Merge branch '3.0' into fix/m23.0 2023-06-29 14:03:56 +08:00
Hongze Cheng
1556dedb85 fix file remove by edit 2023-06-29 14:03:01 +08:00
Haojun Liao
ba38a625cf fix(stream): remove the shared ptr between reader ptr. 2023-06-29 13:42:23 +08:00
dapan1121
3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
Haojun Liao
c4a6b85bdf fix(tsdb): support stt and file block overlap. 2023-06-28 22:38:51 +08:00
yihaoDeng
3d532a54a8 add checkpoint 2023-06-28 12:22:27 +00:00
yihaoDeng
6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
liuyao
2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Hongze Cheng
9be13427f6 fix tomb record loss bug 2023-06-28 17:01:08 +08:00
yihaoDeng
871f66565d add checkpoint 2023-06-28 07:02:20 +00:00
Haojun Liao
8867a57262 fix(stream): fix syntax error. 2023-06-28 14:48:59 +08:00
Haojun Liao
57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
wangmm0220
1fc664693e fix:continue consume if wal is dropped 2023-06-28 11:54:48 +08:00
yihaoDeng
f6d5d0c8ca add checkpoint 2023-06-28 02:39:01 +00:00
Haojun Liao
3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Hongze Cheng
c3a34f5012 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-28 09:16:48 +08:00
Hongze Cheng
b13010c490 fix retention infinit loop 2023-06-28 09:16:43 +08:00
Haojun Liao
9116a4092a fix(tsdb):fix memory leak. 2023-06-28 01:04:58 +08:00
Haojun Liao
15c55508ac fix(stream): fix error in read tombblock in stt files. 2023-06-27 23:37:11 +08:00
Haojun Liao
a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
yihaoDeng
9adccf5715 add checkpoint 2023-06-27 14:31:50 +00:00
yihaoDeng
977d6b7803 add checkpoint 2023-06-27 12:52:27 +00:00
yihaoDeng
74764108fd add checkpoint 2023-06-27 12:46:08 +00:00
yihaoDeng
f2b96fb4b3 add checkpoint 2023-06-27 12:28:28 +00:00
yihaoDeng
9d69b284db add checkpoint 2023-06-27 12:03:29 +00:00
Yihao Deng
4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
yihaoDeng
0a0410cd09 add checkpoint 2023-06-27 09:56:14 +00:00
Haojun Liao
4bb78df27c fix(stream): reduce the sleep time. 2023-06-27 16:44:35 +08:00
Haojun Liao
32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
yihaoDeng
a824db4fd5 add checkpoint 2023-06-27 07:46:30 +00:00
Hongze Cheng
d23902877e make it compile on win 2023-06-27 14:33:55 +08:00
Haojun Liao
1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
Haojun Liao
3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao
1073b5e4c2 fix(tsdb): support to read multi-level of stt files. 2023-06-27 11:15:53 +08:00
liuyao
71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao
b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
Hongze Cheng
3edee3fe9f fix memory leak 2023-06-26 22:04:29 +08:00
dapan1121
4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Hongze Cheng
3172306f65 more fix 2023-06-26 16:38:26 +08:00
Hongze Cheng
5a0218d1ca fix memory leak 2023-06-26 16:34:58 +08:00
Hongze Cheng
58ce6a3f26 fix vnode close 2023-06-26 16:28:33 +08:00
Haojun Liao
6a29bce44e Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-26 15:56:11 +08:00
Haojun Liao
9f664cbf14 fix(tsdb): fix error in extracting block distribution. 2023-06-26 15:54:44 +08:00
Hongze Cheng
5ad9bd938f change default stt trigger as 2 2023-06-26 15:47:36 +08:00
Hongze Cheng
e79683a684 fix more 2023-06-26 13:57:18 +08:00
Minglei Jin
020678391c fix(tsdb/cache): refine del locks 2023-06-26 11:19:31 +08:00
Hongze Cheng
27e17048ac fix: retention coredump 2023-06-26 09:06:59 +08:00
Minglei Jin
5eb57f2e6e enh(tsdb/cache): writebatch with rcache locked 2023-06-26 08:41:14 +08:00
yihaoDeng
04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao
402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
Hongze Cheng
b881b87218 more code 2023-06-25 18:02:31 +08:00
liuyao
e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
Hongze Cheng
cc0727aee3 more code 2023-06-25 17:13:12 +08:00
Hongze Cheng
014bfc4ad4 more code 2023-06-25 16:27:14 +08:00
Hongze Cheng
5b1492cb4b refact code 2023-06-25 15:09:15 +08:00
wangmm0220
7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
Haojun Liao
7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
liuyao
c950c7379d Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory 2023-06-25 10:58:43 +08:00
liuyao
e9d3198e05 mem leak 2023-06-25 10:57:10 +08:00
Haojun Liao
6ac179501a fix: fix syntax error. 2023-06-25 10:46:21 +08:00
Haojun Liao
6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Hongze Cheng
c161943fe0 fix snapshot problem 2023-06-25 10:01:30 +08:00
Hongze Cheng
3582046129 fix coredump 2023-06-25 09:45:58 +08:00
Haojun Liao
3099ec31cb fix(tsdb): fix syntax error. 2023-06-25 09:36:43 +08:00
Haojun Liao
dad1854cbb other: merge 3.0 2023-06-25 09:33:37 +08:00
Haojun Liao
7c23630fe4 fix(stream): set correct stream error code. 2023-06-25 09:26:37 +08:00
wade zhang
254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739 
feat/TD-23739: enhance ttl, deletetime modified by writing-op
 2023-06-25 09:06:57 +08:00
Haojun Liao
a8de3694fa Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-06-24 18:55:03 +08:00
Haojun Liao
ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
Haojun Liao
4a7698d4ab fix(tsdb): add null ptr check. 2023-06-24 00:41:05 +08:00
Haojun Liao
4ce1614045 fix(tsdb): fix error in retrieve sma. 2023-06-24 00:33:47 +08:00
Haojun Liao
5cac7c7a02 fix(tsdb): fix error in query super table. 2023-06-23 02:06:50 +08:00
yihaoDeng
c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
Hongze Cheng
a5049b4861 fix bug 2023-06-21 20:26:52 +08:00
Haojun Liao
0c2273daf2 fix(tsdb): fix memory leak. 2023-06-21 19:38:25 +08:00
Haojun Liao
3ca3dc54ae Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 19:22:58 +08:00
Haojun Liao
cf02ac7229 fix(tsdb): extract tomb data in stt files. 2023-06-21 18:57:14 +08:00
Haojun Liao
92249d892a
Merge pull request #21717 from taosdata/enh/staticLibMain 
Enh/static lib main
 2023-06-21 17:46:30 +08:00
Hongze Cheng
feda122fdc more code 2023-06-21 17:29:41 +08:00
Haojun Liao
f49f96049e Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:56:11 +08:00
Hongze Cheng
32a256bfee fix commit bug 2023-06-21 16:55:31 +08:00
Haojun Liao
e76ae4ffc5 fix(tsdb) : fix memory leak. 2023-06-21 16:53:47 +08:00
Hongze Cheng
1160f53062 more code 2023-06-21 16:35:06 +08:00
Haojun Liao
84bd2fb7a1 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:15:04 +08:00
Hongze Cheng
5e9d263e19 fix: infinite loop 2023-06-21 15:08:16 +08:00
Hongze Cheng
0e97340e50 more code 2023-06-21 14:53:36 +08:00
Haojun Liao
6261359efe fix(tsdb): reset the stt reader for new files. 2023-06-21 14:46:35 +08:00
yihaoDeng
ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
Hongze Cheng
4a1010cdec more 2023-06-21 13:39:29 +08:00
wade zhang
e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0 
enh: make alter-hashrange atomic and idempotent
 2023-06-21 13:29:04 +08:00
Haojun Liao
ea7b8e91d3 fix(stream): fix memory leak. 2023-06-21 12:03:26 +08:00
Haojun Liao
f6e3ad27f0 fix(tsdb): fix memory leak. 2023-06-21 11:38:35 +08:00
Haojun Liao
a92d16a508 fix(tsdb): adjust invalid assert. 2023-06-21 00:12:08 +08:00
Hongze Cheng
413d00db9e fix memory leak 2023-06-20 20:10:57 +08:00
yihaoDeng
daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
Haojun Liao
f8437789f9 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-20 18:38:59 +08:00
Haojun Liao
a16dce1873 fix(tsdb): set correct callback fp. 2023-06-20 18:38:45 +08:00
Hongze Cheng
a3f784a5bc more code 2023-06-20 18:25:24 +08:00
Hongze Cheng
ccc8faf3ee Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-20 18:24:02 +08:00
Hongze Cheng
8855659534 more code 2023-06-20 18:23:58 +08:00
liuyao
74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
Haojun Liao
2d4eed4234 other: merge other branch. 2023-06-20 17:12:31 +08:00
Hongze Cheng
fbc4cc9053 fix commit issue 2023-06-20 16:48:54 +08:00
Haojun Liao
7627035629 fix(tsdb): set the hasVal initial value. 2023-06-20 15:58:22 +08:00
Benguang Zhao
424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
Haojun Liao
a87c3cfd24 fix(tsdb):check null ptr. 2023-06-20 15:39:53 +08:00
liuyao
aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
Haojun Liao
a1f2ce389b fix(tsdb): fix memory leak. 2023-06-20 14:46:32 +08:00
Hongze Cheng
09f2858927 fix some coredump 2023-06-20 14:34:52 +08:00
Haojun Liao
976dc322db enh(tsdb): support delete data read. 2023-06-20 14:26:15 +08:00
Hongze Cheng
a33ce92e5d more code 2023-06-20 13:33:31 +08:00
liuyao
870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
Hongze Cheng
927f6861be more code 2023-06-20 10:41:24 +08:00
Hongze Cheng
a4ca770449 refact code 2023-06-20 09:33:22 +08:00
Shungang Li
aa3dd2bbe8 fix for compile 2023-06-20 09:06:23 +08:00
yihaoDeng
548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
Shungang Li
b93f653d7e feat: enhance ttl, deletetime modified by writing-ops 
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
 2023-06-19 19:03:35 +08:00
Haojun Liao
77af819708 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-19 17:57:00 +08:00
Haojun Liao
524ef6edda fix(tsdb): read data from new storage format. 2023-06-19 17:51:05 +08:00
liuyao
41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
Benguang Zhao
090a1a1595 enh: rename dir at the end in vnodeRenameVgroupId 2023-06-19 15:48:32 +08:00
Hongze Cheng
6d2ce5cd39 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-19 14:13:08 +08:00
Hongze Cheng
3074ab6541 more code 2023-06-19 14:12:48 +08:00
Hongze Cheng
de60e688f6 more fix 2023-06-19 12:52:09 +08:00
Hongze Cheng
9ce58a2d80 refact more code 2023-06-19 11:32:19 +08:00
Hongze Cheng
073a2b8dd3 refact more code 2023-06-19 09:32:29 +08:00
yihaoDeng
fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
kailixu
b40069c0e1 chore: log optimization 2023-06-17 05:05:43 +08:00
Hongze Cheng
aba73614df more code 2023-06-17 00:12:11 +08:00
wangmm0220
c5dfe169a6 fix:error 2023-06-16 19:33:03 +08:00
kailixu
4097b860d3 enh: support delete tsma interval 2023-06-16 19:04:12 +08:00
dapan1121
1329dce320
Merge pull request #21712 from taosdata/fix/TS-3484 
fix: fix order by ts desc error
 2023-06-16 18:01:16 +08:00
Hongze Cheng
a9fcebbdaf more code 2023-06-16 17:12:05 +08:00
Haojun Liao
64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Hongze Cheng
d97f34931d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-16 13:54:59 +08:00
Hongze Cheng
ec288ade15 change stt from multi seg to one seg 2023-06-16 12:16:53 +08:00
wade zhang
01b1cfe965
Merge pull request #21676 from taosdata/fix/TD-24715 
enh(vnd/svr): convert msyType to string
 2023-06-16 12:06:47 +08:00
wade zhang
d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761 
fix(tsdb/cache): rewrite cache update to fix cpu usage
 2023-06-16 11:52:02 +08:00
Minglei Jin
968e3cf1ea lru/applyF: fix ret value 2023-06-16 10:00:17 +08:00
Haojun Liao
4c82558eab Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 2023-06-16 09:55:24 +08:00
Haojun Liao
933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
Yihao Deng
97fa74ae2e
Merge branch 'main' into enh/staticLibMain 2023-06-15 21:37:01 +08:00
liuyao
0aa141ec77 use stream task state 2023-06-15 18:24:40 +08:00
Haojun Liao
a3e1882fb2 fix: fix dead lock. 2023-06-15 18:17:38 +08:00
Haojun Liao
2ad30e2946 other: add files. 2023-06-15 17:31:59 +08:00
Minglei Jin
2cb6c7af16 cache/commit: use outter lock 2023-06-15 17:16:14 +08:00
Minglei Jin
9d6a22e35e cache/apply: use tsdb's flushState as ud 2023-06-15 17:07:56 +08:00
Minglei Jin
c56f29c031 cache/flushState: init flush state when open cache 2023-06-15 17:01:27 +08:00
Minglei Jin
158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
Haojun Liao
74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
wangmm0220
22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
Hongze Cheng
b6a567f92e more code 2023-06-15 14:43:14 +08:00
Hongze Cheng
eacd2ac234 more code 2023-06-15 14:23:12 +08:00
liuyao
693942b821 trans state 2023-06-15 14:13:17 +08:00
Hongze Cheng
e34ff2a894 more code 2023-06-15 14:10:35 +08:00
Haojun Liao
5fdfe98696 fix: fix syntax error. 2023-06-15 13:31:30 +08:00
Hongze Cheng
56dfeadd50 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-15 13:17:44 +08:00
Haojun Liao
1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao
13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Minglei Jin
6d23ea93ea cache/update: fix memory leak 2023-06-15 08:40:36 +08:00
Haojun Liao
53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Benguang Zhao
b86fc3a697 fix: vnodeRenameVgroupId correctly 2023-06-14 21:38:25 +08:00
Yihao Deng
7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
Hongze Cheng
33eaeb743c more code 2023-06-14 16:15:40 +08:00
liuyao
9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Minglei Jin
d04a33f349 fix(tsdb/cache): rewrite cache update to fix cpu usage 2023-06-14 15:35:21 +08:00
Haojun Liao
7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Hongze Cheng
4138361839 refact code 2023-06-14 14:05:41 +08:00
Hongze Cheng
5bacfb4f94 refact code 2023-06-14 13:38:51 +08:00
Hongze Cheng
48ea3963e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 13:12:31 +08:00
yihaoDeng
30ea3aa419 add static lib 2023-06-14 12:15:02 +08:00
yihaoDeng
ee3017ed3a add static lib 2023-06-14 12:14:49 +08:00
Haojun Liao
b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao
844a23225a
Merge pull request #21600 from taosdata/mark/tmq 
fix:check wal not exist again before register to push & move push log…
 2023-06-14 10:18:39 +08:00
Ganlin Zhao
4bd1ae90fa fix: fix order by ts desc error 2023-06-14 09:52:41 +08:00
Hongze Cheng
c85c032158 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 09:14:16 +08:00
wangmm0220
8070223aba fix:lock error 2023-06-13 18:27:06 +08:00
Ganlin Zhao
647ddaad97 fix: fix order by ts desc error 2023-06-13 17:28:31 +08:00
Hongze Cheng
e01d598da9 more code 2023-06-13 17:16:06 +08:00
Haojun Liao
97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
wangmm0220
d8d6b6dd21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749 2023-06-13 15:15:05 +08:00
wangmm0220
8a81278024 fix:load pHandle if necessary wher tq restore 2023-06-13 15:14:11 +08:00
Haojun Liao
933d08b489
Merge pull request #21690 from taosdata/feature/TS-3495 
feat:add parameters for consumer & add offset rows for subscription
 2023-06-13 14:59:15 +08:00
Hongze Cheng
42a09cc9df more code 2023-06-13 14:30:24 +08:00
Hongze Cheng
7baeabc6b9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-13 13:21:12 +08:00
wangmm0220
fb123d8761 fix:conflict from 3.0 2023-06-13 09:47:08 +08:00
Haojun Liao
fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
yihaoDeng
83dde6a212 add trigger checkpoint 2023-06-12 14:33:08 +00:00
Hongze Cheng
e4840cb5ab fix 2023-06-12 17:48:49 +08:00
Hongze Cheng
bd01d08b05 mroe code 2023-06-12 17:19:31 +08:00
Hongze Cheng
71df0a00be more code 2023-06-12 17:17:00 +08:00
Hongze Cheng
438d0caef7 mroe code 2023-06-12 16:55:20 +08:00
Hongze Cheng
9a4f6abe54 more code 2023-06-12 16:12:29 +08:00
Benguang Zhao
16fbcbb67a fix: filter by tbFName in metaFilterTableByHash 2023-06-12 14:19:50 +08:00
Hongze Cheng
5405a967fb refact code 2023-06-12 13:39:25 +08:00
Hongze Cheng
4813af0867 refact code 2023-06-12 13:27:02 +08:00
Haojun Liao
78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
Hongze Cheng
22b80c55bf refact code 2023-06-12 10:27:22 +08:00
Hongze Cheng
e6039839f1 refact code 2023-06-12 10:26:18 +08:00
Hongze Cheng
b8fb34e6c6 refact 2023-06-12 10:13:15 +08:00
Hongze Cheng
8be0e1710e refact code 2023-06-12 10:08:35 +08:00
wangmm0220
1903b815d4 fix:modify offset description to string 2023-06-12 09:45:06 +08:00
wangmm0220
6657b8d849 fix:modify offset description to string 2023-06-12 09:44:00 +08:00
Benguang Zhao
3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
Hongze Cheng
0c6acda102 refact code 2023-06-10 17:16:01 +08:00
yihaoDeng
a2030dc378 add trigger checkpoint 2023-06-09 12:12:51 +00:00
Minglei Jin
4884d0af53 vnd/svr: convert msyType to string 2023-06-09 18:00:04 +08:00
Hongze Cheng
9cdaf24113 more code 2023-06-09 17:52:57 +08:00
Hongze Cheng
2c5b5289d0 fix more code 2023-06-09 16:43:09 +08:00
Hongze Cheng
cbd5da5dee more code 2023-06-09 16:07:06 +08:00
Hongze Cheng
1ee9f80e1f more code 2023-06-09 15:10:54 +08:00
Haojun Liao
69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao
63ef04593d fix: fix syntax error. 2023-06-09 09:48:18 +08:00
Haojun Liao
53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Hongze Cheng
3753c7d602 refact more 2023-06-09 09:23:56 +08:00
Minglei Jin
cab07b2736 vnode/svr: fix missing colon post vgId 2023-06-09 08:21:45 +08:00
wangmm0220
3f46a9bbc9 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 18:14:02 +08:00
Haojun Liao
6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
Hongze Cheng
cb52b7a747 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 17:39:01 +08:00
Hongze Cheng
e9a0210ea6 more code 2023-06-08 17:31:35 +08:00
Haojun Liao
2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
Hongze Cheng
ef524f6965 more code 2023-06-08 15:35:43 +08:00
yihaoDeng
8b91617145 Merge branch 'enh/dv3' into enh/triggerCheckpoint 2023-06-08 07:20:41 +00:00
yihaoDeng
77f287d9be add trigger checkpoint 2023-06-08 07:19:59 +00:00
Minglei Jin
a6968485a8 enh(vnd/sync): refine invalid message log 2023-06-08 14:45:02 +08:00
Haojun Liao
30eba472c3
Merge pull request #21602 from taosdata/fix/TD-24600-dv3 
fix/td-24600-dv3
 2023-06-08 13:42:02 +08:00
Hongze Cheng
13229b0ee1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 13:38:32 +08:00
Hongze Cheng
9d4a626f42 more code 2023-06-08 13:28:13 +08:00
Hongze Cheng
685c0e5593 more code 2023-06-08 11:41:01 +08:00
Hongze Cheng
0c9b66b574 more code 2023-06-08 10:51:43 +08:00
yihaoDeng
9b749b8faa change link op t 2023-06-08 02:43:44 +00:00
Hongze Cheng
2f5f0b75df refact code 2023-06-08 10:31:19 +08:00
Hongze Cheng
91c8391bff Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 09:53:57 +08:00
yihaoDeng
1f1f37312d add trigger checkpoint 2023-06-07 14:32:48 +00:00
Haojun Liao
06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
yihaoDeng
4fa1cc6dd3 change link opt 2023-06-07 05:26:07 +00:00
liuyao
1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
Haojun Liao
6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Hongze Cheng
e6fb46c072 more code 2023-06-06 16:42:51 +08:00
Hongze Cheng
89a9e01375 more code 2023-06-06 16:17:29 +08:00
Hongze Cheng
96d29bc93b more code 2023-06-06 11:07:45 +08:00
Minglei Jin
57b0cb84eb fix(cache/binary): fix crash in freeItem 2023-06-06 10:23:50 +08:00
Hongze Cheng
d3bf34e92a more code 2023-06-05 22:55:00 +08:00
Hongze Cheng
aad386e795 more code 2023-06-05 22:35:06 +08:00
yihaoDeng
ae09d1d031 fix:wal error 2023-06-05 19:49:54 +08:00
Hongze Cheng
5d1783f4d4 more code 2023-06-05 18:31:59 +08:00
Hongze Cheng
9caf359ee1 more code 2023-06-05 18:29:05 +08:00
Minglei Jin
c4418046e1
Merge branch '3.0' into fix/TS-3247 2023-06-05 18:17:18 +08:00
Haojun Liao
0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
wade zhang
11321aa279
Merge pull request #21386 from taosdata/fix/TD-23549 
fix(meta): split meta
 2023-06-05 17:47:19 +08:00
wangmm0220
1b9387b683 fix:remove tq lock in write thread 2023-06-05 17:45:46 +08:00
wangmm0220
f2ee657b62 fix:check wal not exist again before register to push & move push logic from write thread to query thread 2023-06-05 17:21:47 +08:00
Hongze Cheng
46aa6d4896 refact code 2023-06-05 16:22:06 +08:00
Hongze Cheng
37ae918114 more code 2023-06-05 16:08:02 +08:00
Hongze Cheng
934a170e64 more code 2023-06-05 16:02:53 +08:00
Haojun Liao
fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Hongze Cheng
ac62592140 more code 2023-06-05 15:46:35 +08:00
Minglei Jin
d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
Haojun Liao
077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Hongze Cheng
efff4e77f0 more code 2023-06-05 09:36:26 +08:00
Hongze Cheng
5649401a65 more code 2023-06-05 09:22:20 +08:00
Hongze Cheng
3df9620450 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-05 09:10:16 +08:00
Haojun Liao
044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao
4bb6429249 fix(query): fix syntax error. 2023-06-03 00:20:59 +08:00
Haojun Liao
becacbc84b fix(query): fix syntax error. 2023-06-02 23:36:47 +08:00
Haojun Liao
b5b4cd2a05 fix(query): load del info with upper version limitation. 2023-06-02 23:15:27 +08:00
Hongze Cheng
53ff6edad7 fix bug 2023-06-02 19:03:34 +08:00
Hongze Cheng
632c6fb4dd more code 2023-06-02 18:42:15 +08:00
Haojun Liao
cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
Hongze Cheng
a2dafefe03 more code 2023-06-02 17:36:14 +08:00
wangmm0220
56f7a137ee fix:conflict 2023-06-02 15:47:53 +08:00
wangmm0220
b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
Hongze Cheng
33afb08e5c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-02 14:40:01 +08:00
Hongze Cheng
da31d92b7e more code 2023-06-02 14:39:54 +08:00
yihaoDeng
f4bde33dc3 avoid mem leak 2023-06-02 06:06:05 +00:00
Haojun Liao
cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao
709e3f5079
Merge pull request #21566 from taosdata/fix/TD-24570 
reset ud table name
 2023-06-02 13:26:49 +08:00
Haojun Liao
d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main 
other: merge main into 3.0.
 2023-06-02 13:11:12 +08:00
Haojun Liao
f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
Haojun Liao
27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
liuyao
27f791ac7f reset ud table name 2023-06-02 11:05:39 +08:00
Hongze Cheng
884d2cc834 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-02 09:31:54 +08:00
yihaoDeng
4d0ce625c4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-06-01 22:55:30 +08:00
wangmm0220
a7418d439b Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-06-01 22:50:51 +08:00
Hongze Cheng
5e75fe006c more code 2023-06-01 18:56:40 +08:00
wangmm0220
56782a5d41 fix:open task case & modify mqRebVgReq encode/decode style 2023-06-01 18:29:16 +08:00
Haojun Liao
ee8a9856cb
Merge pull request #21557 from taosdata/feature/TD-19042 
fix:make version compatible
 2023-06-01 18:25:37 +08:00
Hongze Cheng
9d1e90f914 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-01 17:20:37 +08:00
Hongze Cheng
65720b80fa more code 2023-06-01 17:12:26 +08:00
Hongze Cheng
a3cacfe68b more code 2023-06-01 17:08:46 +08:00
Hongze Cheng
e07afeeeaf more code 2023-06-01 17:05:20 +08:00
wangmm0220
69499b9582 fix:make version compatible 2023-06-01 16:09:17 +08:00
wangmm0220
d20e0a06f6 fix:make version compatible 2023-06-01 16:04:45 +08:00
wangmm0220
21920721f3 fix:make version compatible 2023-06-01 15:10:08 +08:00
Hongze Cheng
e99b33ede5 more code 2023-06-01 15:08:45 +08:00
Hongze Cheng
bdc9fc473c more code 2023-06-01 11:11:02 +08:00
Minglei Jin
9b9bf2de68 meta/tbc: key cannot be null 2023-06-01 10:41:01 +08:00
Hongze Cheng
fbc4d649de more code 2023-06-01 10:36:12 +08:00
Haojun Liao
5d98a319c7
Merge pull request #21515 from taosdata/feature/TD-19042 
feat: support create topic as stable with conditions
 2023-06-01 09:56:55 +08:00
Haojun Liao
5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
Minglei Jin
fb2f367aac meta/split: trim invalidated uids 2023-06-01 08:13:32 +08:00
Haojun Liao
6d04c4e2fd refactor: do some internal refactor. 2023-05-31 19:05:40 +08:00
Haojun Liao
9e021087a9 refactor: do some internal refactor. 2023-05-31 19:04:53 +08:00
Haojun Liao
a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
Hongze Cheng
d4f4ac1d89 more code 2023-05-31 17:49:08 +08:00
Haojun Liao
fa5c024b3e refactor: do some internal refactor. 2023-05-31 17:22:59 +08:00
Haojun Liao
18b971c666 fix(query): check the version range when dump partial rows of file block to sdata block directly. 2023-05-31 17:06:38 +08:00
Haojun Liao
bbb6359ea2 fix(query): add check for version range when dumping partial rows of file block to data block 2023-05-31 17:03:39 +08:00
Hongze Cheng
dc8901268e fix code 2023-05-31 16:34:50 +08:00
Hongze Cheng
cf0228f87e more code 2023-05-31 15:57:51 +08:00
Minglei Jin
99d6c5cfa0 Merge branch '3.0' into fix/TD-23549 2023-05-31 15:31:20 +08:00
Hongze Cheng
10e6e52670 more code 2023-05-31 15:19:28 +08:00
Hongze Cheng
616a675682 more code 2023-05-31 10:59:47 +08:00
Benguang Zhao
28efd7dcd7 enh: check trans conflicts in mndTransValidate 2023-05-31 10:53:36 +08:00
Haojun Liao
e237b4ac39 refactor: do some internal refactor. 2023-05-31 09:19:05 +08:00
Hongze Cheng
938d87f601 more code 2023-05-31 09:02:50 +08:00
Hongze Cheng
838a47cb45 more code 2023-05-30 18:08:32 +08:00
Hongze Cheng
03f7c6533e more code 2023-05-30 18:06:28 +08:00
Haojun Liao
eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
wangmm0220
689ee05527 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 15:45:46 +08:00
Hongze Cheng
e0889b404d more code 2023-05-30 15:31:11 +08:00
Hongze Cheng
9222d9651e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-30 14:21:19 +08:00
Hongze Cheng
29c29871d2 more code 2023-05-30 14:20:15 +08:00
Haojun Liao
d122a398b3
Merge pull request #21516 from taosdata/fix/TD-24447 
set sched status
 2023-05-30 10:59:28 +08:00
Hongze Cheng
8626d3e691 more code 2023-05-30 10:43:44 +08:00
wangmm0220
d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
Haojun Liao
65b1574fbe
Merge pull request #21499 from taosdata/mark/tmq 
fix:put poll to push manager if wal not exist when offset is latest
 2023-05-30 09:36:53 +08:00
Haojun Liao
20a0054c4a
Merge pull request #21472 from taosdata/enh/addCompileError 
change parameter
 2023-05-30 09:36:36 +08:00
dapan1121
2d6859d5d6
Merge pull request #21510 from taosdata/szhou/fix-ts3461 
fix: if block row num is less than definit min rows, set the bucket index to 0
 2023-05-30 08:51:24 +08:00
wade zhang
3a2831a3f4
Merge pull request #21517 from taosdata/fix/TD-24472 
fix(rocks/log): set info log level to warn_level
 2023-05-30 08:35:00 +08:00
Hongze Cheng
b479a0a06b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-29 21:46:26 +08:00
Hongze Cheng
41459a92c0 more code 2023-05-29 18:42:31 +08:00
wangmm0220
41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220
07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
wangmm0220
9eb15e41ef fix:put poll to push manager if wal not exist when offset is latest 2023-05-29 16:44:03 +08:00
Hongze Cheng
6aac0e0c49 more code 2023-05-29 15:58:54 +08:00
Minglei Jin
3a9d55ca35 fix(rocks/log): set info log level to warn_level 2023-05-29 15:56:28 +08:00
wangmm0220
5eb1c559e5 fix:save offset if latest 2023-05-29 15:51:00 +08:00
liuyao
b541a0a053 set sched status 2023-05-29 15:42:47 +08:00
wangmm0220
78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
wangmm0220
a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao
8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
shenglian zhou
43c0656df2 fix: if block row num is less than definit min rows, set the bucket index to 0 2023-05-29 10:45:26 +08:00
yihaoDeng
342ce14c7d Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:37:47 +00:00
yihaoDeng
58cc631c22 Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:29:56 +00:00
Haojun Liao
953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Hongze Cheng
9d6a264e4d more code 2023-05-28 23:33:03 +08:00
Hongze Cheng
9d031f4d7b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-28 11:08:39 +08:00
Hongze Cheng
5bcc9c540a more code 2023-05-27 23:08:08 +08:00
Haojun Liao
1e786624b2
Merge pull request #21501 from taosdata/refact/fillhistory 
fix(stream): set the skip offset when resume stream task.
 2023-05-27 22:45:54 +08:00
Hongze Cheng
6668da43f8 more code 2023-05-27 20:13:07 +08:00
Hongze Cheng
e4b7318ced more code 2023-05-27 19:54:07 +08:00
Hongze Cheng
442586692b more code 2023-05-27 19:01:52 +08:00
Haojun Liao
d9de1813da Merge branch '3.0' into refact/fillhistory 2023-05-27 16:31:11 +08:00
Hongze Cheng
2cf70ab0cc more code 2023-05-27 15:29:22 +08:00
Hongze Cheng
880359ddb3 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-27 11:50:25 +08:00
Hongze Cheng
62a3c27176 more code 2023-05-27 11:49:59 +08:00
Hongze Cheng
b4b0db9a3d more code 2023-05-26 23:51:18 +08:00
Hongze Cheng
0090d02226 more code 2023-05-26 23:42:47 +08:00
Haojun Liao
b38e253019 fix(stream): set the skip offset when resume stream task. 2023-05-26 22:51:58 +08:00
Hongze Cheng
9abfe52c4d more code 2023-05-26 19:41:27 +08:00
Hongze Cheng
4cb4c6388c more code 2023-05-26 19:32:02 +08:00
wangmm0220
a3e214b9e8 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:17:04 +08:00
wangmm0220
50487255b3 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:02:40 +08:00
wade zhang
66b7d90849
Merge pull request #21479 from taosdata/fix/TD-24405 
fix(cache): fix deleted data
 2023-05-26 17:02:33 +08:00
Haojun Liao
87957e2bb0
Merge pull request #21478 from taosdata/fix/TD-23423 
fix tsdb read error version
 2023-05-26 16:56:09 +08:00
Hongze Cheng
f5286359fa more code 2023-05-26 15:57:31 +08:00
Hongze Cheng
7acc124dfc more code 2023-05-26 15:25:29 +08:00
Minglei Jin
34b9b322cd cache/var-data: realloc for cache reading 2023-05-26 15:01:57 +08:00
Hongze Cheng
b07ad168c3 more code 2023-05-26 14:49:50 +08:00
Haojun Liao
f61f37c936 fix(tmq): set the correct offset rsp when no poll occuring. 2023-05-26 14:20:01 +08:00
Minglei Jin
6e29d7879f cache/var-data: realloc var data 2023-05-26 14:13:01 +08:00
Hongze Cheng
9156b297ae more code 2023-05-26 11:51:08 +08:00
Haojun Liao
1e845acabe fix(tmq): allow seek before get assignment 2023-05-26 11:34:12 +08:00
Minglei Jin
bb481c52b6 cache/skyline: fix skyline false condition 2023-05-26 11:26:55 +08:00
Haojun Liao
ccbea13012 Merge branch '3.0' into refact/fillhistory 2023-05-26 10:40:53 +08:00
Haojun Liao
974b59c238 fix(query): fix bug in iterating the table list. 2023-05-26 10:10:10 +08:00
Haojun Liao
409656f7b6 fix(query): fix bug in iterating the table list. 2023-05-26 10:05:54 +08:00
Hongze Cheng
fa00d0df77 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-26 09:55:27 +08:00
Haojun Liao
cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory 
refactor: remove the module dependency.  TD-24279
 2023-05-26 09:01:45 +08:00
liuyao
75eb724c37 fix tsdb read error version 2023-05-26 08:55:23 +08:00
Haojun Liao
e24ce2111f fix: set function ptr. 2023-05-26 00:00:07 +08:00
Haojun Liao
1e22d875b3 fix: fix dead lock. 2023-05-25 20:00:26 +08:00
Haojun Liao
c3be7b14be fix: set correct function ptr. 2023-05-25 17:51:03 +08:00
Minglei Jin
8ee1288611 fix(cache): remove deleted data 2023-05-25 17:47:55 +08:00
Haojun Liao
0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao
da9f33a483 fix: fix error in set function ptr. 2023-05-25 09:56:34 +08:00
wade zhang
511ff7130b
Merge pull request #21445 from taosdata/fix/TD-24373 
fix(cache/read): associate tbname with primary ts column
 2023-05-25 08:01:51 +08:00
Haojun Liao
4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
Haojun Liao
a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao
ab907e3344 fix(query): fix syntax error. 2023-05-24 21:53:40 +08:00
Hongze Cheng
5586c6d8fb Merge branch 'fix/shared_link_rocksdb' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 19:05:30 +08:00
Hongze Cheng
4d526ed0cd change more 2023-05-24 18:59:09 +08:00
Minglei Jin
fc5d06681e cache/last_row: treat none as null with last_row 2023-05-24 18:55:51 +08:00
Hongze Cheng
3c2a54ab4b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 18:28:56 +08:00
Hongze Cheng
7d7c8af852 more code 2023-05-24 18:28:44 +08:00
wangmm0220
8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Haojun Liao
fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Ganlin Zhao
89bea7100f fix: fix count var type error 2023-05-24 00:31:05 -07:00
dapan1121
cbbbaca553
Merge pull request #21437 from taosdata/fix/TD-23955-3.0 
fix: delete index filter for desc query
 2023-05-24 14:05:07 +08:00
Hongze Cheng
ab7f6eb764 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 13:47:35 +08:00
Hongze Cheng
106f701ebb more code 2023-05-24 13:47:28 +08:00
Haojun Liao
b2ce45b07b refactor: do some internal refactor. 2023-05-24 13:39:20 +08:00
Haojun Liao
a2f29aa0f5 refactor: do some internal refactor. 2023-05-24 13:34:46 +08:00
Haojun Liao
1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
Hongze Cheng
4775b26e5e more code 2023-05-24 11:52:38 +08:00
kailixu
ef899a0cc3 fix: delete index filter for desc query 2023-05-24 11:28:45 +08:00
Minglei Jin
26bfa4363d fix(cache/read): associate tbname with primary ts column 2023-05-24 11:01:47 +08:00
Hongze Cheng
d6d0bf0e41 enh: add varchar sma 2023-05-24 10:47:26 +08:00
liuyao
180abf2229 set agg task status 2023-05-24 09:34:40 +08:00
Hongze Cheng
166a86db69 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 09:31:20 +08:00
Hongze Cheng
0c09d6f0d2 more code 2023-05-24 09:30:14 +08:00
liuyao
b5d01f9bab set agg pause status 2023-05-24 09:19:28 +08:00
Haojun Liao
39a1fa8f78 refactor: do some internal refactor. 2023-05-23 19:20:25 +08:00
Haojun Liao
66477a28ca refactor: do some internal refactor. 2023-05-23 19:10:50 +08:00
Haojun Liao
3d084adf1f Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 
# Conflicts:
#	source/dnode/vnode/inc/vnode.h
#	source/libs/executor/src/executil.c
#	source/libs/index/CMakeLists.txt
#	source/libs/index/src/indexFilter.c
 2023-05-23 18:32:47 +08:00
Haojun Liao
e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
kailixu
82b8c3c3d1 fix: delete index filter for desc query 2023-05-23 18:21:21 +08:00
kailixu
18e83173c8 fix: delete index filter for desc query 2023-05-23 17:21:45 +08:00
wade zhang
68a98d4d09
Merge pull request #21429 from taosdata/fix/TD-24306 
fix(cache): sychronize commit, read and write threads with writebatch
 2023-05-23 16:20:59 +08:00
Hongze Cheng
1c10694fde more code 2023-05-23 16:20:19 +08:00
Hongze Cheng
36b2495cf6 more code 2023-05-23 15:07:42 +08:00
Minglei Jin
6d620a7d7c fix(cache/read): set none to null instead of skipping column 2023-05-23 14:51:26 +08:00
Hongze Cheng
5d5add3f4b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-23 14:31:47 +08:00
Hongze Cheng
cd39d129c2 more code 2023-05-23 14:25:47 +08:00
Hongze Cheng
85c4c61027 more code 2023-05-23 14:18:23 +08:00
Minglei Jin
81048f93b0 fix(cache): sychronize commit, read and write threads with writebatch 2023-05-23 13:44:33 +08:00
yihaoDeng
c15b1e3520 opt compile 2023-05-23 11:46:02 +08:00
Hongze Cheng
91a5e17b9b more code 2023-05-23 11:45:33 +08:00
Hongze Cheng
57bde4f311 more code 2023-05-23 11:35:44 +08:00
Hongze Cheng
ca28c99f80 more code 2023-05-23 11:19:24 +08:00
wangmm0220
ed612088c0 fix:lost data because tsdbreader or task is killed 2023-05-23 10:32:13 +08:00
Hongze Cheng
89eafa18cb Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-23 09:58:53 +08:00
Hongze Cheng
46b72f340a more fix 2023-05-23 09:58:40 +08:00
kailixu
a171c0c860 Merge branch '3.0' into fix/TD-21457-3.0 2023-05-23 09:27:31 +08:00
wade zhang
9e73a69316
Merge pull request #21389 from taosdata/fix/TD-24306 
fix(cache/commit): skip batch write if empty
 2023-05-23 08:22:33 +08:00
kailixu
a3bf49d22f chore: revert 2023-05-22 20:35:52 +08:00
kailixu
c75aa54a3d fix: tsdb read and append _wstart for tsma 2023-05-22 20:33:29 +08:00
wangmm0220
d8387b95ff fix:set task status to 0 in inti 2023-05-22 20:14:43 +08:00
Hongze Cheng
c16126fa96 more code 2023-05-22 18:39:10 +08:00
Haojun Liao
f3491310a9
Merge pull request #21411 from taosdata/fix/TD-24144 
fix:remove get schema from previous for taosx
 2023-05-22 18:37:20 +08:00
Minglei Jin
75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
dapan1121
08ff4f4540 fix: crash issue 2023-05-22 17:06:01 +08:00
Hongze Cheng
8b83c85b0c more code 2023-05-22 16:28:31 +08:00
kailixu
f18fc19d76 fix: tsdb read and tsma _wstart append 2023-05-22 16:13:50 +08:00
Hui Li
0f4fb1c31d
Merge pull request #21407 from taosdata/mark/tmq 
fix:set task code success after kill
 2023-05-22 16:10:18 +08:00
wangmm0220
ae515851c4 fix:remove get schema from previous for taosx 2023-05-22 15:32:30 +08:00
Minglei Jin
21adc23af4 cache/loading: skip partial loading tables 2023-05-22 15:21:19 +08:00
Hongze Cheng
e731a08f2d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-22 14:07:49 +08:00
wangmm0220
591b51f624 fix:set task code success after kill 2023-05-22 12:42:21 +08:00
Haojun Liao
f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Hui Li
3f824e2045
Merge pull request #21355 from taosdata/mark/tmq 
fix:error in pHandle lock
 2023-05-22 08:57:45 +08:00
Haojun Liao
9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory 
Refact/fillhistory
 2023-05-21 01:12:00 +08:00
Haojun Liao
899e4d3350 refactor: do some internal refactor. 2023-05-20 18:13:58 +08:00
Haojun Liao
de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
wangmm0220
7b735c67d0 fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:36:25 +08:00
wangmm0220
8183be4aff fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:13:52 +08:00
wangmm0220
04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
wangmm0220
1ddbdad33c fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 21:40:33 +08:00
wangmm0220
33d6df8717 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 19:11:49 +08:00
Haojun Liao
e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
wangmm0220
c7c255e967 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 18:06:05 +08:00
Hongze Cheng
545d7a6ad6 more code 2023-05-19 17:56:21 +08:00
Haojun Liao
bcaa44e290
Merge pull request #21385 from taosdata/fix/liaohj_main 
fix(query): add null check.
 2023-05-19 17:55:02 +08:00
Hongze Cheng
de1bdf97f9 more code 2023-05-19 17:20:53 +08:00
wangmm0220
ff2b545b27 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 17:16:47 +08:00
Minglei Jin
a5c1b9a054 cache/commit: skip batch write if empty 2023-05-19 17:10:24 +08:00
Hongze Cheng
b75aca7538 more code 2023-05-19 16:44:32 +08:00
Minglei Jin
962db65775 Merge branch '3.0' into fix/TD-23549 2023-05-19 16:19:57 +08:00
Haojun Liao
be35194d16 fix(query): add null check. 2023-05-19 15:54:46 +08:00
Hongze Cheng
1c4abc62c3 more code 2023-05-19 15:16:01 +08:00
wangmm0220
f7ab8dabf0 fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-19 15:14:39 +08:00
wangmm0220
238254e49e fix:add task status check in doQueueScan & checkout consumer in tqProcessPollReq 2023-05-19 14:06:43 +08:00
Hongze Cheng
e247870548 more code 2023-05-19 13:35:32 +08:00
Haojun Liao
d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
Hongze Cheng
66ea10755e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 10:58:12 +08:00
Hongze Cheng
944d6a9c74 more code 2023-05-19 10:24:07 +08:00
wade zhang
208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097 
enh(cache/batchread): load columns in one trip
 2023-05-19 10:20:47 +08:00
dapan1121
e882601b67 fix: last table scan issue 2023-05-19 09:15:48 +08:00
wangmm0220
bca1af3f5d fix:change tmq subscribe try time to 60mins 2023-05-18 21:18:44 +08:00
Minglei Jin
35f74ce2e8 cache/schema: not cache schema 2023-05-18 18:35:06 +08:00
Haojun Liao
c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao
dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate 
state merge into 3.0
 2023-05-18 17:25:44 +08:00
Hongze Cheng
a622a1065a more code 2023-05-18 17:08:46 +08:00
liuyao
da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
Hongze Cheng
c7d1c88fbc more code 2023-05-18 15:06:21 +08:00
Minglei Jin
f95867d255 cache/del: fix lru key length 2023-05-18 14:48:08 +08:00
Minglei Jin
3b316051bf cache/schema: fix schema double free 2023-05-18 13:51:07 +08:00
yihaoDeng
9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Minglei Jin
0f8b7c87f7 cache/delete: fix rocks key length 2023-05-18 13:15:25 +08:00
Haojun Liao
5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
Haojun Liao
ce61b2ab00 fix: fix syntax error in tqRead 2023-05-18 11:35:45 +08:00
Haojun Liao
c3491dae16 refactor: do some interal refactor. 2023-05-18 10:56:40 +08:00
Haojun Liao
81f821a6fc refactor: do some internal refactor. 2023-05-18 10:51:43 +08:00
Hongze Cheng
c8ba83cb31 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-18 10:38:50 +08:00
wangmm0220
54f4860139 fix:rollback [TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-17 19:44:56 +08:00
Haojun Liao
b9bda9b30f fix(stream): set the correct start offset for resumed stream task. 2023-05-17 19:36:42 +08:00
wangmm0220
405cdfa7bc fix:error in pHandle lock 2023-05-17 19:02:16 +08:00
wangmm0220
1d9dd153ea fix:error in pHandle lock 2023-05-17 18:57:45 +08:00
Minglei Jin
765cc72618 cache/memtable: update cache when flag is on 2023-05-17 18:56:03 +08:00
Haojun Liao
73b1a4bddf fix(stream): fix syntax error. 2023-05-17 18:29:52 +08:00
Haojun Liao
92feb89a09 refactor: do some internal refactor. 2023-05-17 18:08:04 +08:00
Hongze Cheng
d4ab729c10 more code 2023-05-17 17:14:11 +08:00
Hongze Cheng
4b5ea55d1a more code 2023-05-17 16:46:10 +08:00
Haojun Liao
a4d9210b07 fix(tmq): add filter for taosX poll rsp. 2023-05-17 16:40:44 +08:00
Minglei Jin
f428a68ec1 cache/update: update lru when deleting or updating 2023-05-17 16:08:48 +08:00
wangmm0220
4bb25c280f fix:add log 2023-05-17 15:54:36 +08:00
Haojun Liao
041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Minglei Jin
b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Haojun Liao
f55f8d245c fix(tmq): avoid the offset is revised by pool rsp which is issued before invoking tmq_offset_seek function. 2023-05-17 15:19:51 +08:00
Hongze Cheng
ccbc7c5ba0 more code 2023-05-17 15:18:08 +08:00
Haojun Liao
366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main 
fix(stream):extract delete msg from wal.
 2023-05-17 14:52:49 +08:00
Minglei Jin
e95613ec10 cache/commit: update & commit cache if cache not off 2023-05-17 14:32:02 +08:00
Minglei Jin
86e3c1d20d cache/stt: remove ts from merge tree loading 2023-05-17 14:05:28 +08:00
Haojun Liao
3896e148fd log(tmq): add some logs. 2023-05-17 11:37:38 +08:00
dapan1121
fb7a06e06e
Merge pull request #21271 from taosdata/enh/tsbsPerf.4 
Enh/tsbs perf.4
 2023-05-17 11:00:14 +08:00
Haojun Liao
f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Haojun Liao
d457b84aba
Merge pull request #21311 from taosdata/mark/tmq 
fix:add lock to pHandle for safety
 2023-05-17 09:11:39 +08:00
wangmm0220
c52a4ea4f0 fix:merge from 3.0 2023-05-17 01:11:55 +08:00
Minglei Jin
756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
wangmm0220
90099ea1c0 fix:compile error in windows 2023-05-16 18:41:35 +08:00
wangmm0220
e6860cada8 fix:compile error in windows 2023-05-16 18:35:10 +08:00
wangmm0220
a52939127f fix:dead lock 2023-05-16 17:58:31 +08:00
Hongze Cheng
0e466a97f0 more code 2023-05-16 15:48:17 +08:00
Hongze Cheng
f39b8a0652 more code 2023-05-16 15:31:38 +08:00
Hongze Cheng
ec7cb5f217 more code 2023-05-16 15:19:13 +08:00
kailixu
9faefb7498 Merge branch 'main' into enh/TD-22404-M 2023-05-16 15:17:42 +08:00
Hongze Cheng
0b17e3fe1c more code 2023-05-16 14:35:57 +08:00
wangmm0220
e6e0ac7603 fix:alwalys in exec if consumer Id mismatch & check result for wal seek ver 2023-05-16 14:01:38 +08:00
Haojun Liao
e35d145734 fix(stream): fix memory leak. 2023-05-16 13:59:13 +08:00
Hongze Cheng
d273d10ff0 more code 2023-05-16 11:39:53 +08:00
Haojun Liao
cbb02458ed fix(stream): fix the seek condition. 2023-05-16 11:19:11 +08:00
Hongze Cheng
7cc7d35be4 more code 2023-05-16 11:09:15 +08:00
Haojun Liao
30e7cb5860 fix(tmq): avoid return delete msg for table subscription. 2023-05-16 10:42:02 +08:00
Hongze Cheng
f40986408c more code 2023-05-16 10:34:02 +08:00
Hongze Cheng
96bfbbe784 refact more code 2023-05-16 10:07:46 +08:00
Hongze Cheng
e783609ebd more code 2023-05-16 09:36:32 +08:00
Haojun Liao
5e16db4e19 fix(stream):extract delete msg from wal. 2023-05-16 08:54:03 +08:00
wangmm0220
62520af2e5 fix:core dump 2023-05-16 00:32:21 +08:00
Haojun Liao
d585f34ea9 fix(tmq): avoid seek to previous position. 2023-05-15 18:48:50 +08:00
wangmm0220
36454c73ed fix:add lock to pHandle for safety 2023-05-15 18:38:14 +08:00
Hongze Cheng
f8220e8b90 more code 2023-05-15 17:26:00 +08:00
Haojun Liao
04c8c933c8 fix(stream): add initial offset check. 2023-05-15 17:15:03 +08:00
Hongze Cheng
68f07c4bec more code 2023-05-15 17:14:45 +08:00
Hongze Cheng
23ad540035 more code 2023-05-15 15:56:13 +08:00
Hongze Cheng
066786e681 more code 2023-05-15 15:47:06 +08:00
Hongze Cheng
c31b1034cd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-15 14:26:40 +08:00
Haojun Liao
17592ea294 refactor: do some internal refactor. 2023-05-15 13:49:26 +08:00
Haojun Liao
9feb0a86d6 fix(tmq): assert after the assignment of value. 2023-05-15 12:46:00 +08:00
Hongze Cheng
33b8ff9bce more code 2023-05-15 11:39:00 +08:00
Haojun Liao
6aa197123e refactor: do some internal refactor. 2023-05-15 11:29:23 +08:00
Haojun Liao
6f7add8870 refactor: do some internal refactor. 2023-05-15 10:48:03 +08:00
Haojun Liao
6cbedc5d4a refactor: do some internal refactor. 2023-05-15 10:45:01 +08:00
Haojun Liao
ac287572ef fix: free table sink info 2023-05-15 00:03:53 +08:00
Haojun Liao
3d00f6ce54 refactor: do some internal refactor. 2023-05-14 22:08:17 +08:00
Haojun Liao
8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao
170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao
99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao
236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao
1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
Haojun Liao
40ffe0cd83 fix(tmq): check handle status before close sub. 2023-05-13 16:45:21 +08:00
Haojun Liao
b383651d8b fix(tmq): fix the invalid write and set the flag when closing taosx sub. 2023-05-13 16:17:26 +08:00
Haojun Liao
5b2ef2a675 other: merge main and remove invalid return data for poll. 2023-05-13 02:31:39 +08:00
dapan1121
3ca5559b37 fix: invalid read issue 2023-05-12 19:27:11 +08:00
dapan1121
1a52b3d519 fix: taosd crash issue 2023-05-12 18:13:16 +08:00
Hongze Cheng
e7ebb5c2db more code 2023-05-12 16:23:07 +08:00
Haojun Liao
99422c87c3 fix(tq): set the offset to be the consume offset, instead of the committed offset. And update the table sim. 2023-05-12 16:14:56 +08:00
kailixu
a39ff5f3bc chore: more code 2023-05-12 14:26:15 +08:00
Hongze Cheng
a15a1ab806 Merge branches 'enh/tsdb_optimize' and '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-12 14:14:45 +08:00
kailixu
0c9aa5bf3f merge main 2023-05-12 13:55:22 +08:00
kailixu
00f15c19aa merge main 2023-05-12 13:52:47 +08:00
dapan1121
69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
dapan1121
0dd0b16842 enh: optimize table scan for last query 2023-05-12 13:30:17 +08:00
Haojun Liao
7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
wangmm0220
cd105381a9 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 11:41:59 +08:00
wangmm0220
d85f0f56d5 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 10:51:13 +08:00
Hongze Cheng
a792bcad68 more code 2023-05-12 09:07:50 +08:00
Haojun Liao
26f94ecd60
Merge pull request #21260 from taosdata/feature/3_liaohj 
fix(tmq): update the local offset when retrieving offset from vnode.
 2023-05-11 23:12:33 +08:00
liuyao
8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
Hongze Cheng
2a754394bf more code 2023-05-11 18:16:55 +08:00
Haojun Liao
26bea33ccc fix(tmq): add null check for print log. 2023-05-11 17:56:19 +08:00
Haojun Liao
a76e47ef54 refactor: add some logs. 2023-05-11 14:19:27 +08:00
Haojun Liao
f0f90888ab refactor: update some logs. 2023-05-11 13:48:50 +08:00
Haojun Liao
2b736ffd60 fix(stream): avoid duplicated task id in task id list. 2023-05-11 11:47:57 +08:00
Haojun Liao
8a1b0ed052 refactor: do some internal refactor. 2023-05-11 10:35:09 +08:00
Haojun Liao
b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
Minglei Jin
7d23b176e5 meta/table: new api metaTrimTables for vnode split 2023-05-11 09:09:32 +08:00
Minglei Jin
81d4673153 cache/get: clear writebatch after writing 2023-05-10 17:52:26 +08:00
Minglei Jin
74c9a4b80b Merge branch '3.0' into fix/TS-3181 2023-05-10 17:42:46 +08:00
Minglei Jin
10cee51d32 fix(cache/get): move rocks wring out of column iterating 2023-05-10 17:32:51 +08:00
yihaoDeng
5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Hongze Cheng
3f4b4b5235 more code 2023-05-10 14:54:13 +08:00
Minglei Jin
9bbf36d35d cache/serialize: keep original col value untouched 2023-05-10 14:39:51 +08:00
Minglei Jin
84987c494a cache/fs: fix primary ts column loading 2023-05-10 12:25:36 +08:00
Hui Li
b1b85c3d95
Merge pull request #21227 from taosdata/fix/TD-24058 
fix:[TD-24058]send poll result to client if no data 5 times to avoid …
 2023-05-10 11:12:20 +08:00
Minglei Jin
0958fe5635 cache/binary: memcpy binary pData if pLastCol is from rocks lookup 2023-05-10 10:15:48 +08:00
Yihao Deng
c6e5879f44
Merge branch 'main' into enh/rocksdbSstate 2023-05-10 10:04:28 +08:00
yihaoDeng
8356533eb1 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-09 12:13:16 +00:00
dapan1121
d0e26d2efc
Merge pull request #21216 from taosdata/fix/TS-3358 
fix:after restarting taosd, stream does not work.
 2023-05-09 19:01:43 +08:00
dapan1121
39adac8537
Merge pull request #21224 from taosdata/fix/TS-3376 
fix: fix crash caused by tsdbReaderResume error not handled
 2023-05-09 18:56:36 +08:00
wangmm0220
587f750c94 fix:[TD-24058]send poll result to client if no data 5 times to avoid lost data 2023-05-09 17:42:11 +08:00
liuyao
8224d49702 fix:after restarting taosd, stream does not work. 2023-05-09 17:24:11 +08:00
Ganlin Zhao
76dd5a962a fix: fix crash caused by tsdbReaderResume error not handled 2023-05-09 17:19:45 +08:00
dapan1121
52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
yihaoDeng
55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
Hongze Cheng
c748e4af25 more code 2023-05-09 16:46:23 +08:00
Hongze Cheng
61eb991eca more code 2023-05-09 16:24:18 +08:00
Hongze Cheng
023281ae32 more code 2023-05-09 14:50:37 +08:00
Hongze Cheng
faadf5d3a2 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-09 13:32:16 +08:00
Minglei Jin
412fc9b0bc cache/memory: fix double free issue with tsim/parser/last_cache.sim 2023-05-09 11:09:53 +08:00
Minglei Jin
064c46bc7b cache/dclp: double check to load from tsdb 2023-05-09 09:17:26 +08:00
dapan1121
1f973123c4
Merge pull request #21177 from taosdata/fix/TD-23972 
fix:[TD-23972] push subscribe msg to vnode even though consumer not c…
 2023-05-08 20:29:31 +08:00
Hongze Cheng
f45d10bb28 more code 2023-05-08 18:15:31 +08:00
Minglei Jin
9b275f7421 cache/last_row cid: first round implementation for last_row with cid 2023-05-08 17:33:35 +08:00
Hongze Cheng
ebfd8b03a3 more code 2023-05-08 16:16:45 +08:00
Minglei Jin
e0f0536d2d cache/serialize: nullize pData if zero-length 2023-05-08 15:56:54 +08:00
Hongze Cheng
198fe28967 more code 2023-05-08 13:20:15 +08:00
Minglei Jin
5349fac910 cache/last: use rowTs instead of lastRowTs 2023-05-08 11:33:01 +08:00
Minglei Jin
2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
Minglei Jin
198ce399d2 cache/get: store recalced column value back into rocks 2023-05-08 10:59:56 +08:00
Hongze Cheng
592c4393dd more code 2023-05-08 10:53:39 +08:00
Hongze Cheng
c9dc9b3170 more code 2023-05-08 10:27:55 +08:00
Yihao Deng
cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
yihaoDeng
08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
dapan1121
c83367e455 enh: add table group cache 2023-05-06 19:24:47 +08:00
Haojun Liao
9392c03b7f fix(stream): add some logs. 2023-05-06 19:05:55 +08:00
Haojun Liao
c6007d53e8
Merge pull request #21190 from taosdata/fix/TS-3347 
fix:[TS-3347]set ver to first version if version stored is smaller th…
 2023-05-06 18:51:49 +08:00
Minglei Jin
dca985214c cache/last: new api: merge last with cid 2023-05-06 18:44:15 +08:00
wangmm0220
279fe0803f fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 18:35:24 +08:00
wangmm0220
ee32620808 fix:[TS-3347]set ver to first version if version stored is smaller than first version in wal when subscribe db 2023-05-06 16:22:30 +08:00
Minglei Jin
596bee8028 Merge branch '3.0' into fix/TD-23623 2023-05-06 16:07:26 +08:00
Haojun Liao
f1a638c196 refactor: do some internal refactor. 2023-05-06 13:36:42 +08:00
Haojun Liao
6b305bf745 refactor: do some internal refactor. 2023-05-06 13:35:18 +08:00
Hongze Cheng
8f058c8571 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-06 13:22:49 +08:00
Haojun Liao
7dfa4c2105 fix(query): fix syntax error. 2023-05-06 13:13:28 +08:00
Haojun Liao
da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
wangmm0220
446097434e fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 11:06:41 +08:00
wangmm0220
55eddbfb5e fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 10:54:05 +08:00
Haojun Liao
1fa4327f6c Merge branch 'main' into fix/liaohj_main 2023-05-06 10:15:23 +08:00
Haojun Liao
29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao
5d4a3116d5
Merge pull request #21139 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-05-06 09:49:26 +08:00
Haojun Liao
50ba55561b fix(stream): set correct group id and table id. 2023-05-05 22:11:59 +08:00
Haojun Liao
8958aabe4b fix(stream): opt task scan performance. 2023-05-05 19:33:30 +08:00
Haojun Liao
08ce790cda fix(query): fix memory leak. 2023-05-05 18:20:27 +08:00
Hongze Cheng
2fd7974113 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-05 15:39:29 +08:00
Haojun Liao
8b12d4d3da fix(stream): secure the delete task operation. TD-1198 2023-05-05 15:02:03 +08:00
Benguang Zhao
c949fee06b enh: commit vnode after consolidating alter hash range 2023-05-05 13:48:04 +08:00
Haojun Liao
38cbe0b768 fix(query): fix the invalid copmarison. 2023-05-05 12:52:10 +08:00
Haojun Liao
42b23e6471 fix(query): stop tsdb reader asap. 2023-05-05 10:40:55 +08:00
Minglei Jin
992480eb00 cache/read: fix ltype calc 2023-05-05 10:22:59 +08:00
Haojun Liao
32b4642dac fix(tmq): fix invalid free. 2023-05-05 00:57:43 +08:00
Haojun Liao
25f451ba81 fix(tmq): fix result data block info. 2023-05-04 23:34:35 +08:00
Benguang Zhao
5d63f438b5 enh: confirm alter hash range 2023-05-04 19:43:11 +08:00
Minglei Jin
90be20a662 cache/lstring: use ltype with cache/get 2023-05-04 18:08:03 +08:00
Haojun Liao
1a8a834a2c fix(tmq): fix memory leak. 2023-05-04 17:03:53 +08:00
Haojun Liao
23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
Haojun Liao
09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Hongze Cheng
80511b334d more code 2023-05-04 13:28:16 +08:00
Haojun Liao
11dccf12de
Merge pull request #21131 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-05-04 11:26:00 +08:00
Haojun Liao
851193a033
Merge pull request #21060 from taosdata/fix/TS-3222 
opti:change push mgr to consume msg for subscribe
 2023-05-04 10:16:41 +08:00
liuyao
d8a1f15d10 fix resum bug 2023-05-04 09:28:06 +08:00
kailixu
94d945a889 Merge branch 'main' into enh/TD-22404-M 2023-05-02 18:34:41 +08:00
Haojun Liao
3b814f2478 fix(stream): do some internal refactor. 2023-05-01 23:21:29 +08:00
Haojun Liao
3c61932ecc refactor: do some internal refactor. 2023-05-01 19:28:54 +08:00
Haojun Liao
563fca5c54 fix(tmq): remove unnecessary error log. 2023-05-01 14:47:01 +08:00
Haojun Liao
465c595c3a Merge branch 'main' into fix/liaohj_main 2023-04-30 18:19:35 +08:00
Haojun Liao
9cc4721e2a refactor: do some internal refactor. 2023-04-30 16:37:09 +08:00
Haojun Liao
d8e0d02e6e refactor: do some internal refactor. 2023-04-30 16:32:51 +08:00
Haojun Liao
2fe494c2c7 fix(query):add more check. 2023-04-30 02:42:26 +08:00
Haojun Liao
f645454f6c fix(query): add check. 2023-04-30 01:58:08 +08:00
Haojun Liao
a88a4f5db0 fix(query): add more check for stopping tsdb reader 2023-04-30 01:03:13 +08:00
Haojun Liao
ace193ca9b fix(stream): set the seek version if the reader's version is earlier than the first version in wal. 2023-04-29 23:34:49 +08:00
Haojun Liao
777ed1761f refactor: update logs. 2023-04-29 18:24:46 +08:00
Haojun Liao
bbb8aaa0dc refactor: add some logs. 2023-04-29 02:37:10 +08:00
Haojun Liao
8b57184a9a
Merge pull request #21123 from taosdata/fix/liaohj_main 
refactor: remove assert.
 2023-04-29 00:44:24 +08:00
Haojun Liao
b69137df44 refactor(log): add some logs. 2023-04-29 00:00:25 +08:00
Haojun Liao
05d416f3b9 fix(stream): fix invalid access when handling error, not start stream if tsDisablestream is set. 2023-04-28 23:53:53 +08:00
wangmm0220
3b66e63444 fix:[TD-23788] client wait if task status error in taosx transform data 2023-04-28 20:07:54 +08:00
Haojun Liao
c647ded0da fix(stream): add some logs. 2023-04-28 19:47:49 +08:00
wangmm0220
8d84e8f8a5 fix:[TD-23788] client wait if task status error in taosx transform data 2023-04-28 19:29:17 +08:00
yihaoDeng
dda1c8803c Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-04-28 09:17:22 +00:00
wangmm0220
18d05ff69f fix:memory leak 2023-04-28 15:53:56 +08:00
Haojun Liao
ad059db91b
Merge pull request #21120 from taosdata/fix/liaohj_main 
other: add some logs.
 2023-04-28 14:12:04 +08:00
Haojun Liao
b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao
f9a64cbcd6 other: add some logs. 2023-04-28 12:58:03 +08:00
Haojun Liao
a0c2b34788
Merge pull request #21119 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-04-28 12:53:31 +08:00
Haojun Liao
da0d9c78ef refactor: do some internal refactor. 2023-04-28 11:42:34 +08:00
liuyao
2984c5a758 merge main 2023-04-28 10:34:46 +08:00
wangmm0220
cce868d140 fix:offset encode assert error 2023-04-28 09:45:16 +08:00
wangmm0220
1ee1b0422c fix:change push mgr from SArray to Hash 2023-04-27 23:44:27 +08:00
yihaoDeng
36a4413bf1 merge rocksdb inst 2023-04-27 14:38:33 +00:00
wangmm0220
db5b5c828e fix:add log for msg push 2023-04-27 18:35:10 +08:00
Haojun Liao
ad7c3218f7
Merge pull request #21111 from taosdata/fix/liaohj_main 
enh(query): stop tsdb reader ASAP.  TD-23249
 2023-04-27 17:45:38 +08:00
Haojun Liao
802c05150a enh(query): stop tsdb reader ASAP. 2023-04-27 16:18:28 +08:00
Haojun Liao
e822dc2025 enh(query): add reader status. 2023-04-27 16:10:36 +08:00
Haojun Liao
7762e0ea47 refactor: do some internal refactor. 2023-04-27 16:10:06 +08:00
Haojun Liao
91f9b58f9a refactor: do some internal refactor. 2023-04-27 16:06:06 +08:00
wangmm0220
8677b56a4f fix:assert error in tqProcessSubmitReqForSubscribe if put pHandle to array twice 2023-04-27 15:44:44 +08:00
Haojun Liao
b7040ed15e enh(stream): support resume from the latest data, and do some internal refactor. 2023-04-27 15:07:54 +08:00
Haojun Liao
e1bd65ec0a
Merge pull request #21105 from taosdata/fix/liaohj_main 
fix(query): check the init status for pReader->status.merger  TD-23903
 2023-04-27 12:40:13 +08:00
Haojun Liao
3093726c5a fix(query): init row merger for tsdbread. 2023-04-27 11:49:00 +08:00
Haojun Liao
fe3f3f478a fix(query): check the init status for pReader->status.merger 2023-04-27 10:15:52 +08:00
wangmm0220
6a889ae80e Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-27 09:48:04 +08:00
Haojun Liao
db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
liuyao
863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
wangmm0220
224d87b131 fix:cosume null if rebalance 2023-04-26 17:58:14 +08:00
Haojun Liao
9a35d4e950
Merge pull request #21087 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-04-26 17:57:37 +08:00
Minglei Jin
a1fba2df65 Merge branch '3.0' into fix/TD-23623 2023-04-26 17:38:47 +08:00
Hongze Cheng
98384b1a4e more code 2023-04-26 17:17:32 +08:00
Haojun Liao
ca4df761f1 fix(query): fix syntax error. 2023-04-26 17:14:54 +08:00
Haojun Liao
627429d490 fix(query): fix the comparion error. 2023-04-26 16:05:57 +08:00
Hongze Cheng
e2df5f772e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-26 15:36:30 +08:00
Hongze Cheng
a3877153bb more code 2023-04-26 15:35:16 +08:00
Haojun Liao
3e80f57fc7 refactor: do some internal refactor. 2023-04-26 12:09:05 +08:00
Haojun Liao
59725d1d87 refactor: do some internal refactor. 2023-04-26 12:02:43 +08:00
Haojun Liao
8d0a4772a5
Merge pull request #21070 from taosdata/fix/liaohj_main 
enh(query): opt last row read performance. TD-23313
 2023-04-26 11:54:48 +08:00
Hongze Cheng
37fb13fa9d more code 2023-04-26 11:16:49 +08:00
Hui Li
133327140f
Merge pull request #21078 from taosdata/fix/TS-3267 
fix: more fix
 2023-04-26 10:42:09 +08:00
Minglei Jin
6835e75903 cache/get: malloc zero-length binary to unify frees 2023-04-26 10:07:15 +08:00
Haojun Liao
8e2edd6ebf fix(query): fix null ptr access. 2023-04-26 10:00:00 +08:00
Minglei Jin
5758aa4d80 cache/read: fix pRow, pLastCols memory issues 2023-04-26 08:17:08 +08:00
Haojun Liao
2a45ef88b0 fix(query): fix memory leak. 2023-04-26 00:40:33 +08:00
Haojun Liao
7b7a483afc fix(query): add tmp variable to hold the TSDBROW value. 2023-04-25 18:43:48 +08:00
Minglei Jin
c8cbabe419 cache/none column: move to outter scope 2023-04-25 18:13:33 +08:00
Hongze Cheng
49728a235e fix: more fix 2023-04-25 17:32:45 +08:00
54liuyao
b79313ecd7 pause&resume 2023-04-25 16:59:09 +08:00
wangmm0220
4321012ac4 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-25 16:24:28 +08:00
wangmm0220
d1e5d6e0f9 fix:pHandle->msg is not null if rebalance 2023-04-25 16:23:58 +08:00
slzhou
aede1090ff fix: the latest schema may delete columns 2023-04-25 16:23:30 +08:00
Minglei Jin
2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Haojun Liao
16fe48f770 fix(query): fix memory leak. 2023-04-25 16:09:58 +08:00
Haojun Liao
bca5fc7893 fix(query): fix memory leak. 2023-04-25 15:28:54 +08:00
cadem
2fd9640a39 change learner config format 2023-04-25 15:15:28 +08:00
Haojun Liao
8dbc3b3457 refactor: do some internal refactor. 2023-04-25 15:07:37 +08:00
Haojun Liao
0b6e531dd3 refactor: do some internal refactor. 2023-04-25 14:56:20 +08:00
Haojun Liao
81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Haojun Liao
05d1692073 refactor: do some internal refactor. 2023-04-25 13:50:05 +08:00
Haojun Liao
d8762b9bc9 refactor: do some internal refactor. 2023-04-25 10:48:21 +08:00
Haojun Liao
6467b99a52 refactor: do some internal refactor. 2023-04-25 10:23:21 +08:00
Haojun Liao
4c4e148635 refactor: do some internal refactor. 2023-04-25 10:19:37 +08:00
wangmm0220
41bec8560a opti:change push mgr to consume msg for subscribe 2023-04-25 09:58:28 +08:00
Haojun Liao
e724bc15e0 refactor: do some internal refactor. 2023-04-25 09:54:00 +08:00
Hongze Cheng
d57676c924 fix: delete table error 2023-04-25 09:52:16 +08:00
Minglei Jin
33fba6f99a cache/read: fix transferBuf index 2023-04-25 09:48:56 +08:00
Haojun Liao
ae8a9d25c0 refactor: do some internal refactor. 2023-04-25 09:41:49 +08:00
Haojun Liao
a73957aaba fix(query): fix error in add row into merger. 2023-04-25 09:24:15 +08:00
Haojun Liao
37d042a338 fix(query): fix error in add row into merger. 2023-04-25 00:33:24 +08:00
Haojun Liao
9a14e0db47 fix(query): fix error in add row into merger. 2023-04-25 00:30:43 +08:00
Haojun Liao
c6daa68e54 enh(query): opt merge life cycle. 2023-04-25 00:17:37 +08:00
wangmm0220
8572f4a32f opti:change push mgr to consume msg for subscribe 2023-04-24 19:41:30 +08:00
Minglei Jin
4adc95f9db cache/deserialize: fix binary pData calc 2023-04-24 18:21:25 +08:00
Minglei Jin
3b88efbd5f cache/delete: fix null column values 2023-04-24 17:07:20 +08:00
Haojun Liao
7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
Haojun Liao
d73306f616 enh(query): opt last row read performance. 2023-04-24 16:08:49 +08:00
Haojun Liao
5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
Minglei Jin
c7d5b48920 cache/read: fix pRes buffer index 2023-04-24 15:42:53 +08:00
Xiaoyu Wang
f5a974489e
Merge pull request #21045 from taosdata/fix/block-check-to-async-check 
fix/block-check-to-async-check
 2023-04-24 15:41:17 +08:00
Haojun Liao
48c36a8c35 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 14:44:13 +08:00
Minglei Jin
f8bf98f6dc Merge branch '3.0' into fix/TD-23623 2023-04-24 14:28:49 +08:00
Haojun Liao
fa46165227 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 12:59:24 +08:00
Haojun Liao
057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj 
fix(stream): set the correct start offset for stream task.
 2023-04-24 12:02:20 +08:00
Minglei Jin
8f21090343 cache/delete: just remove affected cache entries 2023-04-24 10:47:28 +08:00
cadem
a781d43577 fix/block-check-to-async-check 2023-04-24 10:23:43 +08:00
wangmm0220
9bd74ec5b2 Merge branch 'fix/TS-3222' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-24 10:14:32 +08:00
Haojun Liao
134c0528ae Merge branch 'main' into fix/liaohj_main 2023-04-24 01:43:00 +08:00
wangmm0220
77e03bfd78 opti:change push mgr to consume msg for subscribe 2023-04-23 20:14:49 +08:00
Hongze Cheng
50319f2630 more code 2023-04-23 18:00:02 +08:00
Hongze Cheng
651ca6aca2 more code 2023-04-23 17:37:12 +08:00
liuyao
641c707b37 pause&resume 2023-04-23 17:37:10 +08:00
Hongze Cheng
59e543e18d more code 2023-04-23 16:31:11 +08:00
Hongze Cheng
81efe36d30 more code 2023-04-23 16:18:18 +08:00
Hongze Cheng
172eeee609 refact more code 2023-04-23 15:45:57 +08:00
Hongze Cheng
eba557effe more code 2023-04-23 15:31:23 +08:00
wangmm0220
4bc319c6dd Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-23 15:15:33 +08:00
Xiaoyu Wang
35f02cdbad
Merge pull request #21013 from taosdata/FIX/TD-23768-main 
fix: change tdbTbInsert to tdbTbUpsert for meta update in tdb
 2023-04-23 15:15:17 +08:00
liuyao
5bd8fe5441 feat:add pause&resume 2023-04-23 15:09:01 +08:00
54liuyao
5089528a02 feat:stream pause&resume 2023-04-23 15:08:51 +08:00
kailixu
df40699a50 Merge branch 'main' into enh/TD-22404-M 2023-04-23 15:01:31 +08:00
Hongze Cheng
7cf2911c23 more code 2023-04-23 14:57:49 +08:00
Hongze Cheng
85a36d625e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-23 14:03:59 +08:00
Hongze Cheng
c336ec749a more code 2023-04-23 14:02:43 +08:00
Haojun Liao
6fc364db19 fix(query): add null ptr check. 2023-04-23 13:53:55 +08:00
Haojun Liao
9cf89c6b6f enh(tmq): add check for consumer Id; 2023-04-23 11:51:43 +08:00
Xiaoyu Wang
206887166c fix: vnode errcode setting error 2023-04-23 10:53:28 +08:00
yihaoDeng
917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao
3dbe208712 enh(tmq): fix memory error and add retrieve wal info as required. 2023-04-22 15:34:46 +08:00
Benguang Zhao
3c53516299 fix: use tdbTbUpsert for metaUpdate functions 2023-04-21 19:24:09 +08:00
Minglei Jin
9918d326cc Merge branch '3.0' into fix/TD-23623 2023-04-21 18:39:07 +08:00
Minglei Jin
a75d43a259 cache/read: remove unused extract function 2023-04-21 18:38:20 +08:00
Minglei Jin
12fc21ae84 cache/get: use pRow from reader 2023-04-21 18:34:58 +08:00
wangmm0220
6efbcfec4b Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-21 17:46:35 +08:00
Minglei Jin
09c62e6ca2 fix values_list index when freeing 2023-04-21 16:30:00 +08:00
Minglei Jin
8e87b21a59 rocks/multi_get value: free rocks allocated memory 2023-04-21 16:23:40 +08:00
chenhaoran
7d7a0769b3 Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.1 2023-04-21 16:20:37 +08:00
Minglei Jin
01d95b5e95 cache/read: use new interface with signle query 2023-04-21 16:07:22 +08:00
kailixu
6292fb766f Merge branch 'main' into enh/TD-22404-M 2023-04-21 16:04:11 +08:00
Minglei Jin
0394c6a50c free rocks errs array 2023-04-21 15:24:42 +08:00
Minglei Jin
c9959b5bf6 dst slot for last_row 2023-04-21 14:18:04 +08:00
Haojun Liao
b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Hongze Cheng
2f91256a09 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-21 10:45:41 +08:00
Hongze Cheng
bf8b9e744f more code 2023-04-21 10:45:27 +08:00
Haojun Liao
8fac91e265 refactor: do some internal refactor. 2023-04-21 09:38:51 +08:00
Haojun Liao
6c641cff39 fix(stream): fix error in start stream tasks. 2023-04-21 09:37:16 +08:00
Haojun Liao
471abd9160 log: update the log. 2023-04-20 23:39:13 +08:00
Haojun Liao
5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
dm chen
d594e4963f
Merge branch '3.0' into feat/learner 2023-04-20 19:11:06 +08:00
Haojun Liao
65fded4a28 fix(stream): set the correct number of tasks. 2023-04-20 19:03:43 +08:00
Haojun Liao
f9801ba9c5 enh(stream): stop stream asap. 2023-04-20 18:58:07 +08:00
Haojun Liao
6f595fb5fd other: add some logs. 2023-04-20 18:50:44 +08:00
wangmm0220
5df7906a62 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-20 18:33:37 +08:00
Minglei Jin
7d896bbc85 last/empty_table: continue if table's empty 2023-04-20 17:36:46 +08:00
Haojun Liao
c7e42d5422 other: do some internal refactor. 2023-04-20 17:30:02 +08:00
Haojun Liao
8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Minglei Jin
1e51b2d781
Merge branch '3.0' into fix/TD-23623 2023-04-20 16:32:43 +08:00
Minglei Jin
642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
Benguang Zhao
1b2fe38f75 enh: improve logging msg in metaSnapWrite 2023-04-20 16:22:16 +08:00
Haojun Liao
b60b1796f7 fix(stream): add lock during check wal to create new stream task. 2023-04-20 15:53:41 +08:00
Benguang Zhao
a21e0fe75e enh: propose vnode commit synchronously 2023-04-20 14:28:56 +08:00
Haojun Liao
742b5ee08c other: update wal logs level. 2023-04-20 13:42:16 +08:00
Haojun Liao
c654f1145d enh(stream): add new msg for seek, and do some internal refactor. 2023-04-20 10:59:16 +08:00
cadem
8b16f4b118 config compitible 2023-04-19 18:02:04 +08:00
yihaoDeng
5402a6061f Merge branch 'dev' into enh/rocksRevert 2023-04-19 17:37:07 +08:00
cadem
c22bd63ed4 vnode config compitible 2023-04-19 15:11:16 +08:00
Hongze Cheng
b81f1c7be1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-19 14:38:24 +08:00
Xiaoyu Wang
7cf9919ab0
Merge pull request #20964 from taosdata/enh/3.0_planner_optimize 
feat: last queries with tags output can be read from cache
 2023-04-19 14:34:32 +08:00
Haojun Liao
3f12156c53 enh(tmq): support seek in tmq. 2023-04-19 13:56:42 +08:00
Xiaoyu Wang
586b3945d1 feat: last queries with tags output can be read from cache 2023-04-19 13:09:11 +08:00
wangmm0220
594d68b8a4 fix:remove lock for consume handler 2023-04-19 11:46:59 +08:00
wangmm0220
14fd2e7904 fix:remove lock for consume handler 2023-04-19 11:44:52 +08:00
wangmm0220
1061eef144 fix:move consumer msg from fetch thread to query thread 2023-04-19 10:49:18 +08:00
wangmm0220
25542c26c7 fix:remove tmPushMsg in consumer 2023-04-19 10:43:13 +08:00
Minglei Jin
76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
cadem
3b78d4382b add learner 2023-04-18 19:03:45 +08:00
kailixu
b93c85fbf5 Merge branch 'main' into enh/TD-22404-M 2023-04-18 18:49:25 +08:00
Haojun Liao
fb32ffd960 fix(stream): update the reference count value to be int32, insead of int8 2023-04-18 18:06:03 +08:00
dapan1121
2af63992ea
Merge pull request #20952 from taosdata/fix/TD-23639 
fix: fix double free caused crash
 2023-04-18 17:50:45 +08:00
Xiaoyu Wang
6669c3a5ad feat: last queries with tags output can be read from cache 2023-04-18 17:13:14 +08:00
Haojun Liao
cc67b631f6 refactor: do some internal refactor. 2023-04-18 17:01:09 +08:00
Haojun Liao
9f16802451 fix(stream): set the initial value. 2023-04-18 16:42:40 +08:00
Ganlin Zhao
e58bf86c33 fix local variable 2023-04-18 16:34:06 +08:00
Haojun Liao
abfc2455e6 fix(stream): update the atomic variables. 2023-04-18 16:21:30 +08:00
Haojun Liao
7da998ecfb other: merge main. 2023-04-18 16:15:08 +08:00
Minglei Jin
dee2ca3476 tsdb/cache: inplace_update are commented out 2023-04-18 16:09:42 +08:00
Haojun Liao
7a8dd0db45 refactor: update the log. 2023-04-18 16:08:51 +08:00
Minglei Jin
dd42db0077 tsdb/mem table: remove unused codes 2023-04-18 15:09:13 +08:00
Minglei Jin
e159c4ead9 first round rocks batch write implementation 2023-04-18 14:25:35 +08:00
Haojun Liao
76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj 
fix(stream): set the correct initial checkpoint versions.
 2023-04-18 11:26:48 +08:00
Haojun Liao
97da34050b fix(query): fix invalid free. 2023-04-18 10:40:53 +08:00
Haojun Liao
7d3e5aa3d3 fix(query): set the table schema correctly when the table is dropped. 2023-04-18 09:03:30 +08:00
Haojun Liao
2ae05b8cf6 fix(stream): set the correct initial offset value. 2023-04-18 08:56:31 +08:00
liuyao
27d14f742d fix:stream memory leak 2023-04-17 17:27:02 +08:00
Ganlin Zhao
d21628b2c9 fix: fix double free caused crash 2023-04-17 16:57:29 +08:00
kailixu
751a821e5d Merge branch 'main' into enh/TD-22404-M 2023-04-17 13:57:53 +08:00
kailixu
fcb587b456 Merge branch 'main' into enh/TD-22404-M 2023-04-17 11:42:48 +08:00
Hongze Cheng
a2bf1e2c7a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-17 10:59:41 +08:00
Haojun Liao
be90d2c511 fix(stream): disable stream task when no tasks exist. 2023-04-16 23:07:54 +08:00
Haojun Liao
1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao
04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao
efb9ebe875
Merge pull request #20873 from taosdata/feature/3_liaohj 
enh(stream): the stream will start after vnode restore being completed.
 2023-04-15 09:34:34 +08:00
Hongze Cheng
edf9fdbecc make it compile 2023-04-14 23:19:36 +08:00
Hongze Cheng
bd1c8e1902 fix more code 2023-04-14 21:59:08 +08:00
Hongze Cheng
01bacc10ef fix: an important fix 2023-04-14 21:43:40 +08:00
Haojun Liao
1cd2268a99 Merge branch 'main' into feature/3_liaohj 2023-04-14 18:30:55 +08:00
Minglei Jin
ec4ea9cf5d enh(cache/rocks): base for rocks put/get 2023-04-14 18:28:15 +08:00
Haojun Liao
ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
Haojun Liao
e0cb8aa534 fix(stream): don't the initial task status and do some internal refactor. 2023-04-14 17:43:37 +08:00
dapan1121
423ec923ca enh: reuse tsdb cache reader 2023-04-14 14:30:20 +08:00
Hongze Cheng
d1289d4c21 more code 2023-04-14 13:39:42 +08:00
Haojun Liao
eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao
b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Xiaoyu Wang
96d2c5b9e3
Merge pull request #20927 from taosdata/FIX/TD-23552-main 
enh: try to propose vnode commit at vnode closing
 2023-04-14 09:14:10 +08:00
Haojun Liao
f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao
4d83118ff7 fix(stream): fix memory leak. 2023-04-13 23:49:14 +08:00
Haojun Liao
70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
Benguang Zhao
d8386754ee enh: try to propose vnode commit at vnode closing 2023-04-13 19:45:24 +08:00
Xiaoyu Wang
7e51190bc8
Merge pull request #20914 from taosdata/fix/TD-22941-1 
fix(tsdb/read): release bi cache entry before returning
 2023-04-13 19:24:06 +08:00
Hongze Cheng
ac0bb0cf44 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-13 15:13:42 +08:00
Hongze Cheng
e60672d019 more code 2023-04-13 15:13:27 +08:00
Minglei Jin
ab372d501a fix(tsdb/read): release bi cache entry before returning 2023-04-13 14:33:37 +08:00
Xiaoyu Wang
a44d455e56 merge 3.0 2023-04-13 14:32:05 +08:00
Xiaoyu Wang
3d962cd950
Merge pull request #20905 from taosdata/fix/TD-22941 
fix(tsdb/cache): fix block index ref releasing
 2023-04-13 13:37:20 +08:00
Minglei Jin
589ed9d0ce fix(tsdb/cache): fix block index ref releasing 2023-04-13 12:09:44 +08:00
Minglei Jin
ef219095cf fix(tsdb/read): remove duplicat schema fetching 2023-04-13 10:06:49 +08:00
kailixu
85e11d8cbf Merge branch 'main' into enh/TD-22404-M 2023-04-12 18:30:43 +08:00
Hongze Cheng
58ed42b063 more code 2023-04-12 15:18:12 +08:00
Xiaoyu Wang
933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Hongze Cheng
3f8f7bb451 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-12 11:28:30 +08:00
Hongze Cheng
d24fed6ffa more code 2023-04-12 11:14:52 +08:00
Xiaoyu Wang
813591f993
Merge pull request #20872 from taosdata/fix/TD-23474 
fix(tsdb/cache): skip schema updating for non ts row
 2023-04-12 10:47:02 +08:00
Xiaoyu Wang
8b8ac0cd77 merge main 2023-04-12 10:43:28 +08:00
Haojun Liao
f6315af0c9 other: merge main. 2023-04-11 19:41:17 +08:00
Haojun Liao
5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
Haojun Liao
f083697dba refactor(tq): do some internal refactor. 2023-04-11 19:04:33 +08:00
Haojun Liao
24c9495772
Merge pull request #20857 from taosdata/fix/TS-3081 
fix:optimize log & change the length of tag if tag is null in schemaless
 2023-04-11 19:01:07 +08:00
yihaoDeng
b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Minglei Jin
3ac5b35f4b fix(tsdb/cache): skip schema updating for non ts row 2023-04-11 18:57:11 +08:00
Hongze Cheng
8d7055b123 more code 2023-04-11 17:04:52 +08:00
Haojun Liao
aae2758863 fix(stream): disable the deploy msg when restart taosd. 2023-04-11 16:58:51 +08:00
Xiaoyu Wang
4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Haojun Liao
18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
Hongze Cheng
1df5680e9e more code 2023-04-11 15:34:40 +08:00
Hongze Cheng
2f51c609f4 more code 2023-04-11 15:01:42 +08:00
Hongze Cheng
a72633d715 more code 2023-04-11 14:22:36 +08:00
wangmm0220
c40c695ea7 fix:optimize log & change the length of tag if tag is null in schemaless 2023-04-11 13:49:18 +08:00
Haojun Liao
15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00
Hongze Cheng
47b961018c more code 2023-04-11 11:00:35 +08:00
Haojun Liao
a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
liuyao
524bb214e7 delete invalid code 2023-04-10 19:18:56 +08:00
Haojun Liao
497c9ea9c8 Merge branch 'main' into feature/3_liaohj 2023-04-10 17:57:26 +08:00
Hongze Cheng
6bc0d17605 more code 2023-04-10 17:52:51 +08:00
Haojun Liao
7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
Hongze Cheng
a0039fe271 more code 2023-04-10 15:00:01 +08:00
Hongze Cheng
90a13bf451 more code 2023-04-10 14:50:50 +08:00
Hongze Cheng
fe4dca9b1e more code 2023-04-10 14:09:39 +08:00
Xiaoyu Wang
4dff8950c2
Merge pull request #20812 from taosdata/fix/TS-3025 
fix(tsdb/read): use the correct schema with multilevel merging
 2023-04-10 10:30:37 +08:00
kailixu
7f6fdd4b6b Merge branch 'main' into enh/TD-22404-M 2023-04-09 13:26:56 +08:00
Haojun Liao
f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
kailixu
3530ae0307 Merge branch 'main' into enh/TD-22404-M 2023-04-07 17:51:40 +08:00
Hongze Cheng
f100a328b4 more code 2023-04-07 16:52:30 +08:00
Haojun Liao
5de76e4b72
Merge pull request #20809 from taosdata/fix/TD-23517 
fix:[TD-23517] set offset type to wal if only meta & check if tag is …
 2023-04-07 16:35:08 +08:00
Minglei Jin
8ae43fe6cb fix(tsdb/read): use the correct schema for mem/imem rows 2023-04-07 15:28:23 +08:00
Hongze Cheng
afbaeb0d2d more code 2023-04-07 15:12:31 +08:00
Minglei Jin
f262ac8230 fix(tsdb/read): use irow's schema instead of NULL 2023-04-07 14:37:56 +08:00
wangmm0220
05ec2b0928 fix:[TD-23517] set offset type to wal if only meta & check if tag is the same type in schemaless 2023-04-07 14:24:29 +08:00
Hongze Cheng
d370d6a662 more code 2023-04-07 14:23:42 +08:00
Minglei Jin
1ff8511eb3 tsdb/row merger: comment init out 2023-04-07 13:43:07 +08:00
Minglei Jin
55f7e41f3b tsdb/row merger: remove tsdbRowMerge 2023-04-07 13:31:33 +08:00
Minglei Jin
360113115f fix(tsdb/row merger): remove unused code 2023-04-07 09:49:48 +08:00
Hongze Cheng
4e8e3854a7 more code 2023-04-06 16:26:41 +08:00
Hongze Cheng
e8e0e4976e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-06 15:51:20 +08:00
Hongze Cheng
fd16a6b3b7 more code 2023-04-06 14:27:18 +08:00
Haojun Liao
871cfb4760
Merge pull request #20775 from taosdata/fix/TD-23450 
fix:tq memory leak
 2023-04-06 11:48:45 +08:00
Haojun Liao
2b2059ef18
Merge pull request #20534 from taosdata/fix/TD-22671 
fix:error in TD-23218 & remove useless logic
 2023-04-06 11:47:24 +08:00
yihaoDeng
5aff5aa93b add backpressure 2023-04-04 12:38:56 +00:00
54liuyao
519e2f1cfd fix:tq memory leak 2023-04-04 18:21:37 +08:00
yihaoDeng
628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Haojun Liao
c91d8a5901 Merge branch 'main' into feature/3_liaohj 2023-04-04 15:18:24 +08:00
Xiaoyu Wang
e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Hongze Cheng
6e6100f254 more code 2023-04-04 14:38:17 +08:00
Xiaoyu Wang
0e53e578a7
Merge pull request #20748 from taosdata/fix/TD-23473 
ehn(plan/optimizer): remove tbname fetching with cached groupby
 2023-04-04 09:36:56 +08:00
dapan1121
ec3c706c3b
Merge pull request #20739 from taosdata/fix/TS-3063 
fix(query): fix interp tsdbReader external range not setting properly
 2023-04-04 09:23:47 +08:00
wangmm0220
d651ba02ae fix:lose consume data because of exec close if consume while insert data 2023-04-03 19:54:52 +08:00
Haojun Liao
d48be5c0ce refactor: do some internal refactor. 2023-04-03 18:23:35 +08:00
Haojun Liao
a3ac8b647c refactor: do some internal refactor. 2023-04-03 18:20:35 +08:00
Haojun Liao
482c319bee refactor: do some internal refactor. 2023-04-03 18:07:28 +08:00
Haojun Liao
3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
Ganlin Zhao
aa6a4efd5b fix(query): fix interp tsdbReader external range not setting properly 2023-04-03 16:18:16 +08:00
Hongze Cheng
2bab385071 more code 2023-04-03 16:15:21 +08:00
Hongze Cheng
7e48fc3ca5 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-03 15:25:04 +08:00
Hongze Cheng
ffb655bae6 more code 2023-04-03 13:59:37 +08:00
wangmm0220
2d6436c57d fix:modify log & sleep 500ms if data is inserting while consume 2023-04-03 11:24:22 +08:00
wangmm0220
858144145f fix:memory leak 2023-04-02 23:39:59 +08:00
wangmm0220
b029c8f157 fix:remove useless setmsg 2023-04-02 22:34:51 +08:00
wangmm0220
afcc3d2064 opti:code for tmq 2023-03-31 19:02:38 +08:00
wangmm0220
97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
Hongze Cheng
171d360cac
Revert "current from binary to json" 2023-03-31 15:25:00 +08:00
Hongze Cheng
552ea09690 more code 2023-03-30 17:43:54 +08:00
Hongze Cheng
88907b1996 more code 2023-03-30 17:05:58 +08:00
Hongze Cheng
8afa2c5354 more code 2023-03-30 16:06:07 +08:00
dapan1121
15578cf980
Merge branch 'main' into fix/cencVer 2023-03-30 15:36:30 +08:00
kailixu
9552ac2800 enh: coverity scan for sma 2023-03-30 15:11:35 +08:00
Haojun Liao
5f4cb41e28 fix(tmq): set correct start offset value. 2023-03-29 23:45:41 +08:00
Haojun Liao
c8ad465a0d refactor: do some internal refactor. 2023-03-29 19:40:34 +08:00
Haojun Liao
56c98d7768 refactor: do some internal refactor. 2023-03-29 19:35:04 +08:00
kailixu
9ee43c271d enh: coverity scan for sma 2023-03-29 18:38:35 +08:00
wangmm0220
2243184a4d fix:conflicts 2023-03-29 17:53:05 +08:00
Hongze Cheng
0404810252 more code 2023-03-29 17:34:36 +08:00
dapan1121
6a1150301e fix: column rows size 2023-03-29 17:30:20 +08:00
wangmm0220
9d9ae749d1 opti:tmq logic & fix CI cases 2023-03-29 17:27:04 +08:00
Haojun Liao
25245b9005 Merge branch 'main' into feature/3_liaohj 2023-03-29 16:40:12 +08:00
Haojun Liao
152fc5daab fix(stream):fix the race condition when creating new tsables. 2023-03-29 16:36:35 +08:00
kailixu
fabd96deef enh: coverity scan for sma 2023-03-29 15:56:44 +08:00
dapan1121
a90354cd92 fix: restore debug code 2023-03-29 15:56:08 +08:00
dapan1121
9952be43f6 Merge remote-tracking branch 'origin/main' into fix/cencVer 2023-03-29 15:50:14 +08:00
dapan1121
4f06728c17 fix: restore sl level 2023-03-29 15:48:11 +08:00
dapan1121
84eef542d5 fix: memory rows count issue 2023-03-29 15:45:18 +08:00
Xiaoyu Wang
b9d905c2d3
Merge pull request #20686 from taosdata/fix/liaohj 
fix(tsdb/read): use correct scheme for mem & imem merging
 2023-03-29 15:38:21 +08:00
Minglei Jin
91c16f0344 tsdb/read: remove dup mem schema fetching 2023-03-29 15:34:55 +08:00
Minglei Jin
7eb8a63944 Merge branch 'fix/liaohj' of https://github.com/taosdata/TDengine into fix/liaohj 2023-03-29 14:21:05 +08:00
Minglei Jin
8cf8ac84d7 fix(tsdb/read): use correct scheme for mem & imem merging 2023-03-29 14:19:15 +08:00
Hongze Cheng
d2185b7e68 more code 2023-03-29 13:27:36 +08:00
dapan1121
2714ce2af8 fix: rows count issue 2023-03-29 13:22:12 +08:00
kailixu
eb301a1d61 enh: coverage for sma 2023-03-29 12:16:12 +08:00
dapan1121
0659814d16
Merge pull request #20674 from taosdata/fix/TS-3010 
fix: query schema is old issue
 2023-03-29 11:41:07 +08:00
Xiaoyu Wang
eaf56916fe
Merge pull request #20678 from taosdata/FIX/TD-22975-main 
enh: separate sync read and write
 2023-03-29 11:09:31 +08:00
dapan1121
0327a8eaa3 fix: block rows number type 2023-03-29 10:46:56 +08:00
Haojun Liao
7a050d64bd fix(query): set ptr to be NULL. 2023-03-29 10:27:05 +08:00
dapan1121
702202d4af fix: fix block scan issue 2023-03-29 10:14:53 +08:00
Haojun Liao
f1ff5dcec4 fix(query): use hashmap to keep the multiple schema. 2023-03-28 22:53:57 +08:00
dapan1121
a0c8dd52b1 fix: memory count issue 2023-03-28 19:42:09 +08:00
dapan1121
c5f37d284e fix: memory row count issue 2023-03-28 19:27:49 +08:00
dapan1121
e0f951e668 fix: memory rows issue 2023-03-28 19:15:38 +08:00
wangmm0220
d0c55ef572 fix:conflicts 2023-03-28 18:12:13 +08:00
Benguang Zhao
ae8d87643f Merge branch 'main' into FIX/TD-22975-main 2023-03-28 18:00:51 +08:00
dapan1121
def8c9044e Merge remote-tracking branch 'origin/enh/TS-2967' into fix/cencVer 2023-03-28 17:47:41 +08:00
dapan1121
a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00
Hongze Cheng
8233a5bc31 more code 2023-03-28 16:43:22 +08:00
Haojun Liao
0ae2034ebb fix: fix syntax error. 2023-03-28 16:05:05 +08:00
Haojun Liao
7342aeb750 fix(tmq): fix the syntax error. 2023-03-28 15:42:53 +08:00
Hongze Cheng
dc10b0196e more code 2023-03-28 15:38:55 +08:00
dapan1121
22ad3129b9 fix: query schema is old issue 2023-03-28 15:21:47 +08:00
Haojun Liao
a883e57cf2 Merge branch 'main' into fix/liaohj 2023-03-28 15:07:32 +08:00
Haojun Liao
68f310dd48 refactor: do some internal refactor. 2023-03-28 15:05:10 +08:00
Haojun Liao
4fd3064fd9 refactor: do some internal refactor. 2023-03-28 14:43:37 +08:00
Haojun Liao
ac9773b5df
Merge pull request #20670 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-03-28 14:32:10 +08:00
Haojun Liao
c36c5253c5 refactor: do some internal refactor. 2023-03-28 13:31:40 +08:00
Haojun Liao
fca79dbc53 Merge branch 'fix/liaohj' into main 2023-03-28 11:20:01 +08:00
Haojun Liao
c158087d66 fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers. 2023-03-28 09:53:49 +08:00
Haojun Liao
5c128e2292 refactor: do some internal refactor. 2023-03-28 09:27:48 +08:00
dapan1121
61571d9296 enh: optimize count performance 2023-03-27 19:40:29 +08:00
Hongze Cheng
23e78dd908 more code 2023-03-27 19:12:25 +08:00
Xiaoyu Wang
77f27bb9df
Merge pull request #20613 from taosdata/FIX/TD-23308-main 
enh: disable timely vnodeCommit
 2023-03-27 17:58:20 +08:00
Hongze Cheng
8f84e88616 more code 2023-03-27 17:07:59 +08:00
Hongze Cheng
7b82bd5ebb Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-27 16:30:40 +08:00
Hongze Cheng
978c73fb48 more code 2023-03-27 16:30:22 +08:00
kailixu
11bf7511e5 Merge branch 'main' into enh/TD-22404-M 2023-03-27 11:16:11 +08:00
Hongze Cheng
69a2f7129c more code 2023-03-27 09:42:08 +08:00
wangmm0220
f1d67b6059 fix:conflict 2023-03-25 19:03:23 +08:00
wangmm0220
750cd8c5a4 fix:ci error 2023-03-25 16:33:47 +08:00
dapan1121
8a89550f16 fix: skiplist level 2023-03-25 13:10:14 +08:00
wangmm0220
9f5e435140 fix:conflict from main 2023-03-25 11:49:37 +08:00
dapan1121
dd12e41227
Merge pull request #20618 from taosdata/fix/TS-2974 
fix: change float display mode
 2023-03-25 09:19:04 +08:00
dapan1121
481091bae6 fix: sma load issue 2023-03-24 19:01:19 +08:00
Hongze Cheng
0a13fc497d more code 2023-03-24 18:07:16 +08:00
Hongze Cheng
052d9c6e4b more code 2023-03-24 17:57:37 +08:00
dapan1121
8bf49fdbd2 fix: skiplist level 2023-03-24 17:16:06 +08:00
Haojun Liao
b22cc82270 others: merge main. 2023-03-24 15:43:13 +08:00
Haojun Liao
8f6ac6d771 fix(tmq): wait for 2mins when subscribe topics. 2023-03-24 15:36:42 +08:00
dapan1121
4167e4c00c fix: some columns sma are not set issue 2023-03-24 15:20:27 +08:00
wangmm0220
57331cd71d Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD023101 2023-03-24 14:51:11 +08:00
wangmm0220
5d06474f2e fix:send data batch if consume wal where subscribe db 2023-03-24 14:43:29 +08:00
Hongze Cheng
873c9705fe more code 2023-03-24 14:24:34 +08:00
wangmm0220
1a2513d212 Merge branch 'fix/TD023101' of https://github.com/taosdata/TDengine into fix/TD023101 2023-03-24 10:12:12 +08:00
wangmm0220
bf78f63e22 fix:send data batch if consume wal where subscribe db 2023-03-24 10:10:52 +08:00
cadem
86ca5ce210 fix/trigger election by sync msg 2023-03-24 09:13:20 +08:00
Benguang Zhao
9be09492f0 enh: disable timely vnodeCommit 2023-03-24 09:05:06 +08:00
Xiaoyu Wang
bddba107be
Merge pull request #20608 from taosdata/fix/TS-2960 
fix(tdb/restore): rollback journal files backward
 2023-03-23 19:47:31 +08:00
Hongze Cheng
62231ef14c more code 2023-03-23 18:40:44 +08:00
Hongze Cheng
8fa2f08711 more code 2023-03-23 17:15:51 +08:00
Hongze Cheng
d596f3be4a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-23 16:29:03 +08:00
Hongze Cheng
5173d85c8c more code 2023-03-23 16:28:13 +08:00
dapan1121
7f50b463bb
Merge pull request #20599 from taosdata/fix/mainT3.0 
fix: merge main to 3.0
 2023-03-23 16:17:01 +08:00
Hongze Cheng
7bc38466bf more code 2023-03-23 16:10:08 +08:00
Hongze Cheng
2b7fa84e24 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-23 13:27:07 +08:00
Hongze Cheng
54da9e6ec5 more code 2023-03-23 13:26:57 +08:00
Hongze Cheng
71c967d603 more code 2023-03-23 13:15:14 +08:00
Xiaoyu Wang
a5d8549cb1
Merge pull request #20593 from taosdata/FEAT/TD-23258-3.0 
feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database
 2023-03-23 11:43:01 +08:00
Xiaoyu Wang
323d8ee0b4
Merge pull request #20598 from taosdata/FIX/TD-23187-main 
fix: set pWriter->info.state.committed as ever in vnodeSnapWriterClose
 2023-03-23 11:42:48 +08:00
wangmm0220
5f9c7e9a7d fix:[TS-2961] consume error change from snapshot to wal for taosx 2023-03-22 20:14:19 +08:00
wangmm0220
6fae38619d fix:error in TD-23218 & remove useless logic 2023-03-22 19:36:12 +08:00
Hongze Cheng
9490bf2a5e more code 2023-03-22 19:24:40 +08:00
dapan1121
e58afd12e1 fix: merge main to 3.0 2023-03-22 17:42:09 +08:00
wangmm0220
dd4cf0597b fix:error in optimize consume logic 2023-03-22 17:04:02 +08:00
dapan1121
5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Benguang Zhao
24af249f55 fix: set pWriter->info.state.committed as ever in vnodeSnapWriterClose 2023-03-22 16:05:57 +08:00
Hongze Cheng
4f0833e1a0 more code 2023-03-22 14:41:16 +08:00
Hongze Cheng
275f195c50 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-22 14:12:17 +08:00
Benguang Zhao
0b101e4952 feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database 2023-03-22 11:40:24 +08:00
Minglei Jin
0bf98096c9 fix(tsdb/cache): init isLast once for each fileset 2023-03-22 10:57:27 +08:00
Minglei Jin
cb93ac2613 enh(tsdb/cache): make merge tree next one less 2023-03-22 10:50:34 +08:00
wangmm0220
c07e563ecd fix:error in optimize consume logic 2023-03-22 10:43:11 +08:00
Minglei Jin
0b31aac2c5 enh(tsdb/cache): skip data block with merge tree 2023-03-22 10:19:58 +08:00
cadem
ea35f0ae11 feat/balance vgroup leader 2023-03-22 09:36:59 +08:00
yihaoDeng
914d391845 fix tag filter 2023-03-21 12:28:16 +00:00
Haojun Liao
69ca2b2f7b fix(tmq): do some internal refactor. 2023-03-21 19:40:36 +08:00
Haojun Liao
c3acab2070 fix(tmq): do some internal refactor. 2023-03-21 19:38:34 +08:00
dapan1121
3ab55496c1
Merge pull request #20561 from taosdata/fix/TS-2891-M 
fix: select ins_columns from stb/tb
 2023-03-21 16:24:46 +08:00
Haojun Liao
ca29dd344f other: merge main. 2023-03-21 14:04:52 +08:00
Hongze Cheng
e2de2d1286 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-21 14:04:47 +08:00
Haojun Liao
d5a386a563 fix(client): fix coverity issues. 2023-03-21 14:03:36 +08:00
Haojun Liao
18b121c69c fix(tmq): fix the invalid write and do some internal refactor. 2023-03-21 13:45:43 +08:00
Haojun Liao
ea0cc2c584
Merge pull request #20554 from taosdata/fix/TS-2828 
fix: add retry if insert error with meta change
 2023-03-21 09:01:22 +08:00
kailixu
179579f204 chore: more code 2023-03-20 17:41:22 +08:00
wangmm0220
f7b7320f5f fix:set offset if read wal none 2023-03-20 16:57:45 +08:00
wangmm0220
506c192bff fix:error in TD-23218 & remove useless logic 2023-03-20 16:26:15 +08:00
Haojun Liao
ca1dffff45
Merge pull request #20508 from taosdata/fix/liaohj 
fix(client): fix potential memory leak.
 2023-03-20 16:11:22 +08:00
wangmm0220
f80078030c fix:error in TD-23218 & remove useless logic 2023-03-20 15:40:01 +08:00
Haojun Liao
625b2dc901
Merge pull request #20513 from taosdata/fix/TD-23136 
fix:converity scan defects
 2023-03-20 15:37:59 +08:00
Haojun Liao
2517f9bb83 fix(tmq): add some logs. 2023-03-20 15:27:16 +08:00
wangmm0220
c0b41ea0b3 fix:error in TD-23218 & remove useless logic 2023-03-20 14:09:13 +08:00
Haojun Liao
a24d537d9e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-03-20 13:28:13 +08:00
Haojun Liao
4cb1c51d4e fix(tmq): update some logs. 2023-03-20 13:27:58 +08:00
yihaoDeng
192570ce77 fix tag filter 2023-03-20 04:14:57 +00:00
Hongze Cheng
664133c945 prepare optimization 2023-03-20 10:59:16 +08:00
wangmm0220
a5144f0ba2 fix:set offset if read wal none 2023-03-20 10:10:07 +08:00
Haojun Liao
a5e9fad0f9 fix(query): set correct lastkeyInstt. 2023-03-19 23:58:17 +08:00
Haojun Liao
c678740968 refactor: do some internal refactor. 2023-03-19 19:22:43 +08:00
Haojun Liao
7e712a14b6 fix(tmq): adjust log. 2023-03-19 19:06:28 +08:00
Xiaoyu Wang
f86c8d0d6e enh: optimize last pruning logic 2023-03-19 14:40:16 +08:00
Xiaoyu Wang
6277b2564b enh: optimize last pruning logic 2023-03-19 13:41:32 +08:00
Xiaoyu Wang
9affd11eb7
Merge pull request #20542 from taosdata/fix/main_bugfix_wxy 
enh: optimize last pruning logic
 2023-03-19 12:00:18 +08:00
Xiaoyu Wang
5a4fe943dc enh: optimize last pruning logic 2023-03-19 11:01:39 +08:00
Haojun Liao
ae5155edcf fix(tmq): do some internal refactor. 2023-03-19 10:49:30 +08:00
Minglei Jin
3a5542bbbc fix(tsdb/cache): update nCols of merge tree to avoid assert failed 2023-03-19 10:19:49 +08:00
wangmm0220
ccba1d07c6 fix:error in TD-23218 & remove useless logic 2023-03-18 18:42:49 +08:00
wangmm0220
7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
yihaoDeng
afaa77cc3e fix tag filter 2023-03-18 10:01:45 +00:00
yihaoDeng
f24e06f36b fix tag filter 2023-03-18 08:58:26 +00:00
kailixu
4317564d5f Merge branch 'main' into enh/TD-22404-M 2023-03-18 14:25:34 +08:00
dapan1121
859f2594ed fix: add sma load time 2023-03-17 15:21:43 +08:00
wangmm0220
0a54d00cd2 fix:converity scan defects 2023-03-17 14:54:27 +08:00
Shengliang Guan
aa656c9c29
Merge pull request #20505 from taosdata/fix/TD-23196 
ehn(tsdb/cache): skip invalid row or data block directly with merge tree
 2023-03-17 13:19:06 +08:00
Haojun Liao
d5a8a4aefe
Merge pull request #20502 from taosdata/fix/liaohj 
fix(client): set the initial value for num_of_rows.
 2023-03-17 12:50:04 +08:00
Minglei Jin
ca115b1c87 fix(tsdb/cache): break loop to return current row 2023-03-17 11:41:17 +08:00
wangmm0220
4fdef7421c fix:add log for taosCreateLog error 2023-03-17 10:50:54 +08:00
Minglei Jin
a8d146c512 ehn(tsdb/cache): skip invalid row or data block directly with merge tree 2023-03-17 10:22:36 +08:00
Haojun Liao
970155a845 fix(query): fix coverity issues. 2023-03-16 21:53:34 +08:00
wangmm0220
6323a6e801 fix:conflicts 2023-03-16 19:18:07 +08:00
wangmm0220
14970478dc fix:conflicts 2023-03-16 19:15:08 +08:00
wangmm0220
fa2e7b234c fix:add log for schemaless & sleep longer if modify schema error 2023-03-16 19:13:15 +08:00
Shengliang Guan
925693c8a9
Merge pull request #20493 from taosdata/fix/TD-23172 
ehn(tsdb/cache): load necessary columns only
 2023-03-16 15:49:04 +08:00
yihaoDeng
3ac11ce87a enh: change log 2023-03-16 06:17:45 +00:00
Minglei Jin
b1949b5584 fix(tsdb/cache): skip remaining rows in current data block 2023-03-16 14:11:34 +08:00
Haojun Liao
345b46769c
Merge pull request #20490 from taosdata/fix/liaohj 
fix(tmq): disable non-leader vnode responsing the poll request.
 2023-03-16 14:00:42 +08:00
Minglei Jin
6e0343fc08 enh(tsdb/cache): load necessary columns only 2023-03-16 11:18:36 +08:00
Haojun Liao
a1682664f2 fix(tmq): disable non-leader vnode responsing the poll request. 2023-03-16 10:12:34 +08:00
yihaoDeng
ef092c1cce enh: add queue limit 2023-03-15 11:54:36 +00:00
Shengliang Guan
af4532dc63
Merge pull request #20476 from taosdata/fix/TD-23163 
enh(tsdb/cache): skip invalid datablock directly when traversing fs with last
 2023-03-15 19:03:48 +08:00
Minglei Jin
04d501d64a fix: destroy aColArray anyway 2023-03-15 17:41:29 +08:00
Minglei Jin
f1414355e3 tsdb/cache: skip invalid datablock directly when traversing fs with last 2023-03-15 16:24:36 +08:00
Haojun Liao
36cec7894b
Merge pull request #20472 from taosdata/fix/liaohj 
fix(query): set the correct cached tags list key length, and update s…
 2023-03-15 15:56:50 +08:00
Haojun Liao
52576071ae refactor: do some internal refactor. 2023-03-15 14:37:48 +08:00
Haojun Liao
253a760810 fix(query): set the correct cached tags list key length, and update some logs. 2023-03-15 14:30:12 +08:00
Shengliang Guan
09ca41b3f7
Merge pull request #20467 from taosdata/fix/TS-2893 
fix:create same sub table
 2023-03-15 14:07:47 +08:00
kailixu
43a029e3c4 enh: coverity scan for sma 2023-03-15 12:30:44 +08:00
54liuyao
d5defa3def fix:create same sub table 2023-03-15 11:10:55 +08:00
Hongze Cheng
e43b606917 current from binary to json 2023-03-15 10:48:51 +08:00
Benguang Zhao
cc76d78673 enh: separate sync read and write events 2023-03-14 20:35:39 +08:00
Haojun Liao
32ddecc347 other: merge main. 2023-03-14 12:13:09 +08:00
Shengliang Guan
e98b32a69f
Merge pull request #20427 from taosdata/fix/main_bugfix_wxy 
fix: last redundant read stt file
 2023-03-14 09:41:19 +08:00
Shengliang Guan
214c595491
Merge pull request #20412 from taosdata/fix/TD-23095 
fix:auto fill null column
 2023-03-14 09:36:57 +08:00
Shengliang Guan
bf03965931
Merge pull request #20413 from taosdata/FIX/TD-22564-main 
enh: not allow to propose if fsm applying progress lagging behind too far
 2023-03-14 09:36:04 +08:00
Shengliang Guan
6989f1be61
Merge pull request #20418 from taosdata/fix/TD-22671 
fix:deal with ASSERT in tmq
 2023-03-14 09:34:52 +08:00
Xiaoyu Wang
ca39dfcf2d feat: show vgroup display num of cache tables 2023-03-13 17:21:32 +08:00
Haojun Liao
731a2138df fix(tmq): fix error in tmq. 2023-03-13 17:08:17 +08:00
Xiaoyu Wang
62377619ba enh: optimizing stt file reading in last query 2023-03-13 15:05:24 +08:00
Haojun Liao
7f2aae69d4 fix(tmq): fix error in taosx 2023-03-13 01:54:29 +08:00
Xiaoyu Wang
25778754e2 fix: last redundant read stt file 2023-03-12 22:36:26 +08:00
Xiaoyu Wang
45e38d258c fix: last redundant read stt file 2023-03-12 20:40:17 +08:00
Haojun Liao
564e9bb833 Merge branch 'main' into fix/liaohj 2023-03-12 14:38:38 +08:00
wangmm0220
0e2cf0ed73 fix:deal with ASSERT in tmq 2023-03-11 16:51:34 +08:00
Xiaoyu Wang
a846c26ef9 merge main 2023-03-11 16:14:27 +08:00
wangmm0220
9cc7a9f504 fix:deal with ASSERT in tmq 2023-03-11 16:12:11 +08:00
Shengliang Guan
584f213739
Merge pull request #20401 from taosdata/fix/main_bugfix_wxy 
fix: error in last cache handle deleted data
 2023-03-11 15:43:55 +08:00
54liuyao
84ef1c78d4 fix:auto fill null column 2023-03-11 11:33:50 +08:00
Xiaoyu Wang
38a6d02ca9 Merge remote-tracking branch 'origin/main' into fix/main_bugfix_wxy 2023-03-11 10:58:47 +08:00
Benguang Zhao
d679eaf648 enh: update pMnode->applied only when pMsg->code as zero 2023-03-10 18:10:34 +08:00
Xiaoyu Wang
11e55f028b fix: error in last cache handle deleted data 2023-03-10 17:49:27 +08:00
Hongze Cheng
7e071ff458 enh: optimize snapshot transfer 2023-03-10 16:01:40 +08:00
Shengliang Guan
cf1bf07bbb
Merge pull request #20387 from taosdata/fix/main_bugfix_wxy 
enh: optimize last/last_row cost when the cache was first loaded
 2023-03-10 14:51:45 +08:00
Haojun Liao
05ddf68247 fix(tmq): fix invalid free. 2023-03-10 14:27:34 +08:00
Haojun Liao
d8807d3d5a fix(tmq): fix memory leak. 2023-03-10 14:23:16 +08:00
Xiaoyu Wang
4e4f7de0ab enh: optimize last/last_row cost when the cache was first loaded 2023-03-10 12:00:17 +08:00
Haojun Liao
0d1b2e4b5a fix(tmq): use before remove hash item. 2023-03-10 10:31:53 +08:00
Shengliang Guan
c70c9546f2
Merge pull request #20372 from taosdata/fix/main_bugfix_wxy 
enh: optimize last/last_row cost when the cache was first loaded
 2023-03-10 10:07:22 +08:00
Shengliang Guan
37bc466f59
Merge pull request #20373 from taosdata/fix/TS-2853 
fix:get dest table version
 2023-03-10 10:05:01 +08:00
Haojun Liao
691cb08e88 refactor: remove some unused attributes. 2023-03-10 09:23:03 +08:00
Haojun Liao
09e84884be refactor: remove invalid assert 2023-03-09 23:31:29 +08:00
Haojun Liao
03aa391859 fix(tmq): add lock before close the tsdbreader. 2023-03-09 23:03:51 +08:00
Benguang Zhao
96e70c2795 enh: update logging msg in vnodeRestoreFinish 2023-03-09 20:05:19 +08:00
54liuyao
5acf665b7e fix:get dest table version 2023-03-09 19:36:10 +08:00
Benguang Zhao
5e53b1225b enh: finish restore with commit and applied indexes instead of num of items in apply queue 2023-03-09 19:35:42 +08:00
Xiaoyu Wang
47417e003e enh: optimize last/last_row cost when the cache was first loaded 2023-03-09 18:54:15 +08:00
Benguang Zhao
1392711e66 enh: add fsm FpAppliedIndexCb to get the current applied index 2023-03-09 18:14:04 +08:00
Benguang Zhao
9d10739908 enh: send rsp of negotiation failure ahead of apply queue 2023-03-09 16:18:44 +08:00
Hongze Cheng
afd01bb9b6 Merge branch 'main' of https://github.com/taosdata/TDengine into feat/TS-2846 2023-03-09 15:26:04 +08:00
Hongze Cheng
16262512b2 feat: alter stt_trigger and minrows 2023-03-09 15:25:47 +08:00
Shengliang Guan
00854f677c
Merge pull request #20335 from taosdata/fix/TD-22753 
fix: unit  sma and tag index error msg
 2023-03-09 15:20:47 +08:00
Xiaoyu Wang
66bb55187d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-03-08 18:30:24 +08:00
yihaoDeng
01a5d5d219 unit sma and tag index error msg 2023-03-08 18:16:29 +08:00
yihaoDeng
d8d74b3514 unit sma and tag index error msg 2023-03-08 16:02:46 +08:00
Hongze Cheng
05688386a0 little fix 2023-03-08 15:19:55 +08:00
Hongze Cheng
a56c99daac fix: add more msg check 2023-03-08 14:45:04 +08:00
Hongze Cheng
b5b6f31023 Merge branch 'main' of https://github.com/taosdata/TDengine into feat/compact_with_time_range 2023-03-08 13:47:40 +08:00
Xiaoyu Wang
4c8bab7e58 merge main 2023-03-08 10:59:33 +08:00
Xiaoyu Wang
0dc34018b6 fix: insert data crash after empty table last cache 2023-03-08 10:06:48 +08:00
Hongze Cheng
dc0d7c26ea Merge branch 'main' of https://github.com/taosdata/TDengine into feat/compact_with_time_range 2023-03-08 08:53:56 +08:00
Hongze Cheng
89281ee488 compact with time range 2023-03-07 21:46:34 +08:00
Shengliang Guan
fe729a4756
Merge pull request #20305 from taosdata/fix/main_bugfix_wxy 
fix: taosd crash when modify the schema and query last_row
 2023-03-07 20:31:18 +08:00
Xiaoyu Wang
163224f4e2 fix: taosd crash when modify the schema and query last_row 2023-03-07 19:42:05 +08:00
Xiaoyu Wang
ab86f6abee fix: taosd crash when modify the schema and query last_row 2023-03-07 18:15:17 +08:00
Shengliang Guan
4ea87deef7
Merge pull request #20301 from taosdata/fix/main_bugfix_wxy 
fix: insert data crash after empty table last_row cache
 2023-03-07 18:08:23 +08:00
Haojun Liao
d54ae0c840 fix(tmq): free reader after check the reader status. 2023-03-07 17:49:20 +08:00
Xiaoyu Wang
ab5cce806c fix: fix: after the last_row cache is created, modify the schema and query again, resulting in taosd crash 2023-03-07 16:25:46 +08:00
Xiaoyu Wang
8e6534d9f3 fix: insert data crash after empty table last_row cache 2023-03-07 16:06:56 +08:00
Shengliang Guan
325b3439df
Merge pull request #20290 from taosdata/fix/main_bugfix_wxy 
fix: after the last cache is created, modify the schema and query again, resulting in taosd crash
 2023-03-07 11:07:07 +08:00
Hongze Cheng
424a37fd3a some code 2023-03-07 10:20:48 +08:00
Xiaoyu Wang
bc9eb47e04 fix: after the last cache is created, modify the schema and query again, resulting in taosd crash 2023-03-07 10:14:39 +08:00
Haojun Liao
2790368a03
Merge pull request #20269 from taosdata/feature/3_liaohj 
fix(qurey): fix som errors and add some logs.
 2023-03-06 20:38:22 +08:00
Xiaoyu Wang
b2247a10cb fix: last cache invalid write 2023-03-06 18:00:53 +08:00
wangmm0220
86ef6522ae fix:wal curVersion error if switch to wal 2023-03-06 17:40:02 +08:00
Shengliang Guan
7edcbfd58b Merge branch 'fix/stopFunc' into feature/3_liaohj 2023-03-06 09:43:00 +08:00
Haojun Liao
22a85734c6 fix(mq): add more chek for balance couner to avoid the negative value emerges. 2023-03-05 13:23:50 +08:00
wangmm0220
e54e12eff0 fix:give error if col is same in schemless & fix json parse error in TD-22903 2023-03-04 11:57:27 +08:00
Haojun Liao
24bb33f24a refactor: add some logs. 2023-03-03 18:34:38 +08:00
Shengliang Guan
25e0ed8cb5 Merge branch 'fix/TD-22951' into feature/3_liaohj 2023-03-03 18:21:55 +08:00
Hongze Cheng
7f62507e4a Merge branch 'main' of https://github.com/taosdata/TDengine into 3.0.3.00302 2023-03-03 16:41:35 +08:00
Shengliang Guan
658bd47315 Merge remote-tracking branch 'origin/main' into feature/3_liaohj 2023-03-03 10:56:09 +08:00
Haojun Liao
e8c11c58f0 fix(tq): add some logs. 2023-03-03 10:20:52 +08:00
Xiaoyu Wang
ed5a58fbb6
Merge pull request #20243 from taosdata/fix/main_bugfix_wxy 
fix: last cache read problem after schema change
 2023-03-02 20:52:22 +08:00
Hongze Cheng
ed48296acd Merge branch 'main' of https://github.com/taosdata/TDengine into 3.0.3.00302 2023-03-02 19:47:22 +08:00
Xiaoyu Wang
7649ede074 fix: last cache read problem after schema change 2023-03-02 19:45:21 +08:00
Xiaoyu Wang
b09bb40e2d
Merge pull request #20242 from taosdata/fix/auto_retention 
fix: auto retention
 2023-03-02 19:32:25 +08:00
Xiaoyu Wang
7deee1c4c7 fix: last cache read problem after schema change 2023-03-02 18:22:42 +08:00
Hongze Cheng
dfaf26dfc5 add data scan 2023-03-02 18:10:02 +08:00
Shengliang Guan
5840e2f770
Merge pull request #20152 from taosdata/fix/TD-22764 
fix:core dump if data block size is 0
 2023-03-02 17:29:03 +08:00
Haojun Liao
37281ae17f
Merge pull request #20228 from taosdata/feature/3_liaohj 
fix(query): record the correct last accessed key in the stt file.
 2023-03-02 17:13:31 +08:00
Hongze Cheng
e0819db5de fix: auto retention 2023-03-02 15:06:11 +08:00
dapan1121
341f813a61 Merge remote-tracking branch 'origin/main' into fix/TS-2770 2023-03-02 08:29:37 +08:00
Haojun Liao
8d32d256ad fix(query): set correct lastkeyinstt. 2023-03-02 00:48:17 +08:00
Haojun Liao
c5102c9ea5 Merge branch 'main' into feature/3_liaohj 2023-03-01 23:31:57 +08:00
Haojun Liao
443852cc3f fix(query): set correct last key. 2023-03-01 21:46:25 +08:00
Xiaoyu Wang
0fe9b5ca19
Merge pull request #20222 from taosdata/feat/compact 
more compact to enterprise
 2023-03-01 20:19:42 +08:00
Haojun Liao
3327beba1e fix(query): record the correct last accessed key in the stt file. 2023-03-01 14:56:51 +08:00
Xiaoyu Wang
74a4051881 move compact to enterprise 2023-03-01 14:48:31 +08:00
dapan1121
ee70606f19 fix: projection query in descending order result error issue 2023-03-01 14:48:15 +08:00
Haojun Liao
10a119e3fb
Merge pull request #20106 from taosdata/fix/TD-22667-3.0 
fix:error by coverity scan
 2023-03-01 13:31:59 +08:00
Haojun Liao
a3ffddba2d
Merge pull request #20204 from taosdata/fix/3_coverity 
fix(query): fix coverity issue.
 2023-03-01 09:28:36 +08:00
Hongze Cheng
d319d6fe00 more compact to enterprise 2023-02-28 19:52:03 +08:00
Xiaoyu Wang
e36d9a4c25 merge main 2023-02-28 16:13:28 +08:00
cyang
2164acce88 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-22764 2023-02-28 16:10:09 +08:00
Haojun Liao
f1f9e570e6 Merge branch '3.0' into fix/3_coverity 2023-02-28 16:03:28 +08:00
Haojun Liao
dc45ec2660 fix(query): set the correct bucket index. 2023-02-28 15:17:32 +08:00
wangmm0220
986ae9c4d0 fix:conflicts 2023-02-28 15:11:16 +08:00
Haojun Liao
22e52ebb38 fix(query): fix block distribution error. 2023-02-28 14:25:19 +08:00
Haojun Liao
4172041ec8 fix(query): fix error in displaying block distribution. 2023-02-28 14:20:14 +08:00
Haojun Liao
60188e82a6 fix(query): fix coverity issue. 2023-02-28 13:42:19 +08:00
Haojun Liao
1ac30b7710
Merge pull request #20169 from taosdata/feature/3_liaohj 
refactor: do some internal refactor and add some logs for tmq.
 2023-02-28 12:01:22 +08:00
WANG MINGMING
5dfc9ed4d0
Merge branch '3.0' into fix/TD-22667-3.0 2023-02-28 09:52:34 +08:00
Haojun Liao
52a8912969
Merge pull request #20183 from taosdata/fix/TD-22797 
fix: avoid filter slow when not exist target value
 2023-02-28 09:18:46 +08:00
Haojun Liao
d18dd3067b other: merge main. 2023-02-28 00:38:37 +08:00
Haojun Liao
5e9f53560d
Merge branch 'main' into feature/3_liaohj 2023-02-27 18:23:35 +08:00
Hongze Cheng
1fa5d02b94 more code 2023-02-27 18:20:09 +08:00
Hongze Cheng
d963a4f20c Merge branch 'main' of https://github.com/taosdata/TDengine into feat/auto_retention 2023-02-27 18:11:12 +08:00
Hongze Cheng
ee36cf8aca mroe code 2023-02-27 18:11:04 +08:00
Hongze Cheng
8e3084ecc0 feat: auto retention 2023-02-27 18:09:51 +08:00
Xiaoyu Wang
6a5934983c
Merge pull request #20181 from taosdata/fix/3.0_merge_main 
merge main
 2023-02-27 17:08:35 +08:00
yihaoDeng
c13cea4f44 fix: avoid filter slow when filter not exist value 2023-02-27 14:34:38 +08:00
Xiaoyu Wang
efa56d5352 merge main 2023-02-27 14:18:03 +08:00
Xiaoyu Wang
f97a140a3c merge 3.0 2023-02-27 14:16:33 +08:00
cyang
6a15c36fc1 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-22764 2023-02-27 10:05:05 +08:00
54liuyao
f2dfe5ab74 fix:create same sub table 2023-02-27 09:55:34 +08:00
wangmm0220
c638564179 fix:confilcts from main 2023-02-26 23:09:57 +08:00
Haojun Liao
b46098793d refactor: do some internal refactor and add some logs for tmq. 2023-02-26 12:16:45 +08:00
dapan1121
77295df8ec
Merge pull request #20161 from taosdata/fix/TS-2729 
fix: table scan crash issue
 2023-02-26 07:45:17 +08:00
dapan1121
50ee40308b fix: realloc uid list 2023-02-25 16:10:48 +08:00
Haojun Liao
0369ff2231 other: merge main. 2023-02-25 15:42:32 +08:00
dapan1121
10e35f1ed0 fix: free pointer issue 2023-02-25 14:15:24 +08:00
Haojun Liao
514369c611 other: merge main 2023-02-25 11:06:13 +08:00
Haojun Liao
d6fca036e5 refactor: do some internal refactor. 2023-02-25 11:02:42 +08:00
Haojun Liao
90c6641cff
Merge pull request #20131 from taosdata/fix/coverity_yihao 
fix: fix asan problem
 2023-02-25 10:42:39 +08:00
Xiaoyu Wang
d6dd087f84 merge main 2023-02-25 10:29:20 +08:00
Xiaoyu Wang
320ad8d1f2
Merge pull request #20150 from taosdata/fix/TD-22710 
fix: compact wrong data count
 2023-02-25 10:02:56 +08:00
Xiaoyu Wang
5856a39827
Merge pull request #20123 from taosdata/fix/3.0_merge_main 
merge main
 2023-02-25 10:01:26 +08:00
dapan1121
05bd600ef8 fix: table scan crash issue 2023-02-25 09:34:37 +08:00
Yihao Deng
22b1bc1049
Merge branch '3.0' into fix/coverity_yihao 2023-02-24 21:22:58 +08:00
wangmm0220
54a546931c fix:optimize version logic in tmq and remove useless code 2023-02-24 19:22:08 +08:00
Haojun Liao
097723f446
Merge pull request #20151 from taosdata/feature/3_liaohj 
fix(query): expand output buffer.
 2023-02-24 18:56:51 +08:00
Hui Li
965d91572a
Merge pull request #20148 from taosdata/fix/3_coverity 
fix(query): fix syntax errors on centos.
 2023-02-24 17:39:12 +08:00
cyang
21234a33dc fix:converity scan error 2023-02-24 17:02:30 +08:00
Xiaoyu Wang
961107d1ca merge main 2023-02-24 16:55:50 +08:00
Haojun Liao
6120c73aaa
Merge pull request #20122 from taosdata/enh/TD-22715 
fix: fix distributed table error
 2023-02-24 16:44:43 +08:00
wangmm0220
181d588f85 fix:core dump if data block size is 0 2023-02-24 16:04:35 +08:00
Hongze Cheng
2a8f7e121a Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-22710 2023-02-24 14:41:42 +08:00
Hongze Cheng
765ff98f6a fix: compact wrong data count 2023-02-24 14:41:23 +08:00
Haojun Liao
80babb19f0 fix(query): fix syntax errors on centos. 2023-02-24 14:34:53 +08:00
Haojun Liao
993ae9e7e9 Merge branch '3.0' into fix/3_coverity 2023-02-24 14:34:01 +08:00
Haojun Liao
26ab5e011b fix(query): fix syntax errors on centos. 2023-02-24 14:05:52 +08:00
Xiaoyu Wang
58fc265b80 merge main 2023-02-24 13:26:45 +08:00
Haojun Liao
22aa03307c fix(query): fix syntax errors on centos. 2023-02-24 11:38:54 +08:00
Haojun Liao
645c3e672f
Merge pull request #20144 from taosdata/fix/3_coverity 
fix(query): fix coverity issue.
 2023-02-24 11:31:36 +08:00
Xiaoyu Wang
d06dedd5cc
Merge pull request #20103 from taosdata/fix/TD-22668 
fix: coverity scan issues
 2023-02-24 10:53:49 +08:00
Haojun Liao
7821bbe0d0 refactor: add some logs. 2023-02-24 10:08:25 +08:00
Haojun Liao
cc393f3939
Merge pull request #20143 from taosdata/feature/3_liaohj 
refactor: do some internal refactor.
 2023-02-24 09:58:44 +08:00
Haojun Liao
97024f1468 fix(query): fix coverity issue. 2023-02-24 09:48:34 +08:00
Haojun Liao
bbb571a383 refactor: do some internal refactor. 2023-02-24 00:06:18 +08:00
Haojun Liao
dbb1e9bd59 refactor: do some internal refactor. 2023-02-23 21:59:55 +08:00
yihaoDeng
2013ba0d8f fix: fix asan problem 2023-02-23 17:54:51 +08:00
54liuyao
e42d5ba3dc fix:table name is null 2023-02-23 17:31:47 +08:00
Haojun Liao
6e39bec448
Merge pull request #20089 from taosdata/fix/TD-22671 
fix:remove useless logic in tmq
 2023-02-23 17:27:00 +08:00
Xiaoyu Wang
1ab144609e merge main 2023-02-23 14:58:22 +08:00
yihaoDeng
7d75939fae fix: fix invalid dist count 2023-02-23 14:35:05 +08:00
54liuyao
72e7f617e2 fix:disable stream 2023-02-23 14:24:45 +08:00
Haojun Liao
c16bbfadbb
Merge pull request #20115 from taosdata/feature/3_liaohj 
refactor: add some logs.
 2023-02-23 11:23:48 +08:00
dapan1121
29f84355eb
Merge pull request #20107 from taosdata/fix/TD-22689 
fix: taosd crash issue caused of out of fd
 2023-02-23 10:48:21 +08:00
Xiaoyu Wang
ebcd7415c1
Merge pull request #20086 from taosdata/fix/TD-22670 
fix(tsdb/cache): use state's tsdb instead of readers
 2023-02-23 10:39:26 +08:00
Xiaoyu Wang
7dc3c6b4e8
Merge pull request #20056 from taosdata/FIX/TD-22595-main 
fix: synchronize access to pVnode->inUse
 2023-02-23 10:39:00 +08:00
Haojun Liao
b203107922
Merge branch 'main' into feature/3_liaohj 2023-02-23 10:22:17 +08:00
Haojun Liao
6015729560 refactor: add some logs. 2023-02-23 09:21:32 +08:00
Haojun Liao
4432ae51e6
Merge branch 'main' into fix/liaohj 2023-02-23 09:04:32 +08:00
Haojun Liao
5b1c2fc314
Merge pull request #20094 from taosdata/feature/3_liaohj 
fix(tmq): update the epset when the leader of vnode changed.
 2023-02-23 08:58:40 +08:00
dapan1121
532fb08309 fix: rsma invalid read issue 2023-02-22 18:13:24 +08:00
dapan1121
5a587d15f3 fix: taosd crash issue 2023-02-22 17:12:08 +08:00
wangmm0220
91d5df423f fix:error by coverity scan 2023-02-22 15:48:39 +08:00
Minglei Jin
8db525667f fix(meta/query): remove incorrect file & line args 2023-02-22 14:49:54 +08:00
Minglei Jin
6929f74559 fix(tsdb/cache): check the return result of data block creating 2023-02-22 14:48:57 +08:00
Haojun Liao
8532de31cf refactor: remove assert. 2023-02-22 14:32:39 +08:00
Hongze Cheng
81ee050a0f fix: coverity scan problem 2023-02-22 14:29:14 +08:00
Haojun Liao
82067f3bd2 fix(query): fix coverity issues. 2023-02-22 13:38:13 +08:00
Haojun Liao
61a7001274 fix(query): fix coverity issues. 2023-02-22 10:50:42 +08:00
wangmm0220
b28c0ad952 fix:remove useless logic in tmq 2023-02-21 18:49:39 +08:00
Minglei Jin
724e7bc3a1 fix(tsdb/cache): use state's tsdb instead of readers 2023-02-21 18:23:18 +08:00
Benguang Zhao
a78556a3e6 fix: synchronize access to pVnode->inUse 2023-02-21 16:52:24 +08:00
dapan1121
0b0af5240d
Merge pull request #20002 from taosdata/fix/forceStopTask 
fix: add force stop task and rename conflict structer name
 2023-02-21 16:30:18 +08:00
Xiaoyu Wang
7337f5ff7d
Merge pull request #20052 from taosdata/fix/3.0_merge_main 
merge main
 2023-02-21 16:27:19 +08:00
Xiaoyu Wang
b304456fef fix: rsma error 2023-02-21 11:17:59 +08:00
Xiaoyu Wang
9370d67e43 fix: tsdb reader resume 2023-02-21 09:43:56 +08:00
Xiaoyu Wang
319dfd8f06 merge 3.0 2023-02-20 17:21:37 +08:00
Xiaoyu Wang
9aa8b07a74
Merge pull request #20054 from taosdata/enh/3.0_planner_optimize 
fix: wal compatibility of normal tables
 2023-02-20 16:40:45 +08:00
Haojun Liao
ad0be66a78
Merge pull request #19935 from taosdata/enh/dynamicIdx 
feat:  change  index dynamicly
 2023-02-20 15:48:49 +08:00
Xiaoyu Wang
c79b63ab13 fix: wal compatibility of normal tables 2023-02-20 15:44:36 +08:00
Xiaoyu Wang
c597de099f merge main 2023-02-20 13:41:27 +08:00
Haojun Liao
7fe250412f refactor:do some internal refactor. 2023-02-20 10:13:11 +08:00
Haojun Liao
8d187efc18 refactor:do some internal refactor. 2023-02-20 10:04:08 +08:00
Xiaoyu Wang
6ecd5b2971
Merge pull request #20019 from taosdata/enh/3.0_planner_optimize 
feat: compatible with older versions of wal
 2023-02-18 19:34:28 +08:00
Xiaoyu Wang
a8630c0aa3
Merge pull request #20031 from taosdata/FIX/TD-22224-main 
fix: not allow to read if sync is restoring
 2023-02-18 18:31:46 +08:00
yihaoDeng
51755e9783 fix: fix drop error 2023-02-18 16:44:29 +08:00
yihaoDeng
db7dec0347 fix filter error 2023-02-18 11:21:10 +08:00
yihaoDeng
1acb4dd676 opt filter 2023-02-18 09:38:54 +08:00
Benguang Zhao
d51c3c36fb fix: not allow to read if sync is restoring 2023-02-17 19:47:52 +08:00
Xiaoyu Wang
0f4de9daec feat: compatible with older versions of wal 2023-02-17 18:06:57 +08:00
Xiaoyu Wang
d5cd2d36af feat: compatible with older versions of wal 2023-02-17 15:55:55 +08:00
Xiaoyu Wang
a7dad151f3
Merge pull request #20004 from taosdata/fix/TS-2625 
fix(tsdb/cache): use block index cache with last/last_row
 2023-02-17 15:27:49 +08:00
Hongze Cheng
aefdf9160a fix: auto trim database 2023-02-17 10:38:55 +08:00
Xiaoyu Wang
b7f4b93d22 merge 3.0 2023-02-17 09:23:41 +08:00
Xiaoyu Wang
dc984d92f7 feat: compatible with older versions of wal 2023-02-17 09:21:07 +08:00
Hongze Cheng
1640ccc4b2 fix: another error 2023-02-16 17:50:45 +08:00
Liu Jicong
2a4708d82a fix: save fill history state 2023-02-16 17:01:09 +08:00
Hongze Cheng
3c37ad11e6 fix: other problems 2023-02-16 15:55:59 +08:00
Minglei Jin
de9cafb04e fix(tsdb/cache): disable sharding for block index cache 2023-02-16 15:50:19 +08:00
Haojun Liao
f8b59fc5bf
Merge pull request #19999 from taosdata/feat/TS-2633 
feat:add disable stream option
 2023-02-16 13:23:08 +08:00
Minglei Jin
4959e8fa7c
Merge branch 'main' into fix/TS-2625 2023-02-16 12:33:59 +08:00
Haojun Liao
f34bc0344c
Merge pull request #20001 from taosdata/fix/nodisk 
fix(query): fix memory leak and invalid free for tag filter cache.
 2023-02-16 10:46:50 +08:00
Minglei Jin
56f1afb19c fix(tsdb/cache): use block index cache with last/last_row 2023-02-16 09:28:35 +08:00
Haojun Liao
fd379310f6
Merge pull request #19979 from taosdata/fix/tq_oom 
fix: handle insufficient resource
 2023-02-16 09:17:52 +08:00
dapan1121
ed4e8313e0 fix: add force stop task and rename conflict structer name 2023-02-16 08:55:13 +08:00
Haojun Liao
c7a9ed34d0 fix(query): fix memory leak and invalid free for tag filter cache. 2023-02-15 23:24:43 +08:00
Haojun Liao
717392782a fix(query): remove the invalid free. 2023-02-15 19:50:56 +08:00
54liuyao
43966abbc6 feat:add disable stream option 2023-02-15 18:39:05 +08:00
Hongze Cheng
3289f79ab2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-2504 2023-02-15 18:00:22 +08:00
Hongze Cheng
c1a3a0855b finish code 2023-02-15 17:59:54 +08:00
Haojun Liao
cb35b453d4
Merge pull request #19870 from taosdata/feature/3_liaohj 
other: merge opt to main.
 2023-02-15 12:55:04 +08:00
54liuyao
88970c88a9 fix:dispatch create sub table 2023-02-15 11:04:49 +08:00
yihaoDeng
df296c15f7 opt: opt tag index 2023-02-14 17:31:10 +08:00
yihaoDeng
dabcf00ade fix RC 2023-02-14 16:54:20 +08:00
Liu Jicong
b147ba2812 fix: handle insufficient resource 2023-02-14 16:18:40 +08:00
Xiaoyu Wang
9fb5c8f3a1
Merge pull request #19961 from taosdata/fix/TD-22432 
fix(tsdb/cache): invalidate cache entry if schema changed
 2023-02-14 14:53:02 +08:00
Minglei Jin
ea81fc0b30 fix(vnd): zero meta in vnode when closing 2023-02-14 10:56:00 +08:00
Minglei Jin
8ec5df8d7d fix(tsdb/cache): Not free zero length var data 2023-02-14 10:20:55 +08:00
Minglei Jin
ee9c59dc77 fix(tsdb/cache): invalidate cache entry if schema changed 2023-02-13 19:30:48 +08:00
Haojun Liao
c1e7b3be66 fix(query): 1. reset the pointer, when initialize the reader failed. 2. add check for null pointer when extracting cached rows. 2023-02-13 19:10:31 +08:00
Haojun Liao
c9ce01c878 Merge branch 'main' into feature/3_liaohj 2023-02-13 17:09:27 +08:00
yihaoDeng
e4906283cb fix json_tag crash 2023-02-13 15:47:19 +08:00
Haojun Liao
c597a1e4ce refactor: do some internal refactor. 2023-02-13 15:46:47 +08:00
wangmm0220
b054ef9a9f fix:conflict from 3.0 2023-02-13 14:04:36 +08:00
yihaoDeng
16da9d78a9 fix: fix filter error result 2023-02-13 13:47:22 +08:00
wangmm0220
0e630b8f81 fix:remove id in execReader & enable task case 2023-02-13 13:38:05 +08:00
Yihao Deng
5af1faf916
Merge branch '3.0' into enh/dynamicIdx 2023-02-13 13:36:06 +08:00
yihaoDeng
0fd0c64157 fix: fix filter error result 2023-02-13 13:28:52 +08:00
yihaoDeng
0f803fca10 fix: fix filter error result 2023-02-13 11:40:40 +08:00
Hongze Cheng
454e56fd09 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-2504 2023-02-13 10:37:32 +08:00
Haojun Liao
27a53a0c64 fix(query): set the correct table iter. 2023-02-13 10:05:26 +08:00
Xiaoyu Wang
6483b92f0c
Merge pull request #19923 from taosdata/fix/3.0_merge_main 
merge main
 2023-02-13 09:48:45 +08:00
Liu Jicong
0cd6bd3d86 Merge branch 'main' into enh/stream_buffer_param 2023-02-13 09:48:02 +08:00
Hongze Cheng
10167a90cd refact code 2023-02-13 09:39:21 +08:00
Hongze Cheng
cce25bbcd8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-2504 2023-02-13 09:14:24 +08:00
Haojun Liao
34036b932f fix(query): fix error in windows. 2023-02-13 01:05:40 +08:00
Haojun Liao
f85cf08f87 fix(query): set the initial iterator table before check data in buffer. 2023-02-12 22:09:46 +08:00
yihaoDeng
a929aa22d8 merge 3.0 2023-02-12 10:48:18 +08:00
Haojun Liao
f6a262eeb1 fix(query): fix invalid write. 2023-02-11 01:56:28 +08:00
Haojun Liao
1b53f4b0bd
Merge pull request #19919 from taosdata/fix/liaohj 
fix(query): add check for table/super table dropped
 2023-02-10 23:00:55 +08:00
Haojun Liao
a7fdc4bae3 other: merge 3.0 2023-02-10 19:20:24 +08:00
Haojun Liao
5dfa0e69a9 fix(query): set correct schema info for normal table. 2023-02-10 19:06:23 +08:00
yihaoDeng
9d8e3e0c8f fix mem leak 2023-02-10 18:29:03 +08:00
Haojun Liao
6839ed22f2 fix(query): fix bug in tag filter. 2023-02-10 18:28:35 +08:00
Xiaoyu Wang
3382a24a69 merge main 2023-02-10 18:03:11 +08:00
Hongze Cheng
039a0d2270 fix: compile issue 2023-02-10 18:01:22 +08:00
Haojun Liao
e378668571
Merge pull request #19915 from taosdata/fix/nodisk 
ehn(query): dynamic set the initial buffer size for data block from d…
 2023-02-10 17:49:46 +08:00
Haojun Liao
f6b2da8c06 fix(query): add check for table/super table dropped, when retrieving cache rows. 2023-02-10 16:53:11 +08:00
Hongze Cheng
9694933ec8 fix: compact issue 2023-02-10 16:24:29 +08:00
Haojun Liao
c8f1c3b6e4 fix(query): set the max rows as the default block buffer rows. 2023-02-10 16:18:30 +08:00
Haojun Liao
72287a3b5f fix(query): set correct tag value during tag filter and do some internal refactor. 2023-02-10 16:03:11 +08:00
Haojun Liao
17f05c0020 refactor: disable the limitation of maximum buffer size. 2023-02-10 14:40:37 +08:00
Haojun Liao
4908c563cc ehn(query): dynamic set the initial buffer size for data block from disk. 2023-02-10 14:35:18 +08:00
Haojun Liao
440122e010
Merge pull request #19900 from taosdata/fix/nodisk 
fix(query): set lastkey during check of valid ts.
 2023-02-10 13:45:08 +08:00
Hongze Cheng
f523a96c2d fix compact problem 2023-02-10 13:38:21 +08:00
Haojun Liao
4f4d39a16b fix(query): set correct last key. 2023-02-10 11:32:18 +08:00
yihaoDeng
cf129cacb9 add mutex 2023-02-10 10:51:25 +08:00
Xiaoyu Wang
b2e60da1cf merge main 2023-02-10 10:34:55 +08:00
Haojun Liao
0fbaf4eab0 fix(query): set lastkey during check of valid ts. 2023-02-09 23:01:44 +08:00
yihaoDeng
d4cfeb1f6c add more test case 2023-02-09 21:04:11 +08:00
Xiaoyu Wang
86d231ce50
Merge pull request #19872 from taosdata/feat/vnode_compact 
feat: data compaction
 2023-02-09 16:24:50 +08:00
yihaoDeng
5315500287 fix filter error 2023-02-09 16:09:46 +08:00
Haojun Liao
6cf363600b
Merge pull request #19785 from taosdata/fix/TD-21899 
fix:auto create table & NULL NONE problem for taosx
 2023-02-09 15:31:13 +08:00
Xiaoyu Wang
9bc225ffda merge 3.0 2023-02-09 09:44:29 +08:00
Xiaoyu Wang
79440f7a26
Merge pull request #19860 from taosdata/fix/3.0_merge_main 
merge main
 2023-02-09 09:22:19 +08:00
yihaoDeng
a8d2375bd8 fix filter error 2023-02-08 23:30:12 +08:00
yihaoDeng
9ba5381b5a fix filter error 2023-02-08 23:04:49 +08:00
yihaoDeng
4b6c073623 fix filter error 2023-02-08 23:01:20 +08:00
yihaoDeng
5881bdb6ff add test case 2023-02-08 22:13:29 +08:00
Hongze Cheng
8d6e6d2fe0 more code 2023-02-08 17:46:11 +08:00
Xiaoyu Wang
277469083f
Merge pull request #19848 from taosdata/FIX/TD-22121-main 
enh: set terrno as Invalid table ID while tdbTbGet suid failure in metaUpdateTagIdx
 2023-02-08 16:29:23 +08:00
Xiaoyu Wang
50819c46ec
Merge pull request #19852 from taosdata/FIX/TD-22184-main 
enh: return error on unexpected snapshot msg
 2023-02-08 16:29:10 +08:00
Hongze Cheng
c398f9d299 more code 2023-02-08 16:11:47 +08:00
Liu Jicong
ae4ad7d851 Merge branch 'main' into enh/stream_buffer_param 2023-02-08 16:09:35 +08:00
Hongze Cheng
0f70a61253 more code 2023-02-08 14:28:54 +08:00
Haojun Liao
9dc8946143
Merge pull request #19859 from taosdata/fix/nodisk 
fix(query): reset the data load flag when build clean file  block.
 2023-02-08 14:24:35 +08:00
Hongze Cheng
e22e4f626a more code 2023-02-08 11:30:38 +08:00
Hongze Cheng
5a56e39613 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-02-08 11:15:51 +08:00
Hongze Cheng
108ce09c85 more code 2023-02-08 11:15:36 +08:00
Hongze Cheng
d9e8b3c047 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-02-08 10:20:22 +08:00
Xiaoyu Wang
09925437e3 merge main 2023-02-08 09:51:52 +08:00
Xiaoyu Wang
44a5e0070b
Merge pull request #19840 from taosdata/fix/TD-22245-batch-delete 
fix(vnd): no rlock on writing thread's path
 2023-02-08 09:17:33 +08:00
Haojun Liao
e199f96d94 fix(query): reset the data load flag when build clean file block. 2023-02-08 09:14:38 +08:00
Hongze Cheng
9b338ae095 more code 2023-02-07 22:05:36 +08:00
Shengliang Guan
7fdeaf19be Merge remote-tracking branch 'origin/3.0' into enh/TD-18702 2023-02-07 20:29:14 +08:00
Benguang Zhao
9b522cec3a enh: return error on unexpected snapshot msg 2023-02-07 19:16:39 +08:00
Haojun Liao
445c3bd250 fix(query): remove sleep. 2023-02-07 18:27:32 +08:00
Haojun Liao
5dfdb91135 fix(query): check if table exists or not during build data block in tsdbread. 2023-02-07 17:16:20 +08:00
Hongze Cheng
c7267c7c9f more code 2023-02-07 16:49:29 +08:00
Benguang Zhao
2330bf5b49 enh: set terrno as TSDB_CODE_TDB_INVALID_TABLE_ID while tdbTbGet suid failure 2023-02-07 16:20:06 +08:00
Minglei Jin
2f0e5eae32 fix(vnd): no wlock on writing thread's path 2023-02-07 15:15:56 +08:00
kailixu
8df67a9a3c fix: rsma close and commit 2023-02-07 15:10:11 +08:00
Hongze Cheng
a885d6e3d2 more code 2023-02-07 14:08:20 +08:00
kailixu
9598fe684e Merge branch '3.0' into fix/TD-22047-3.0 2023-02-07 10:42:16 +08:00
Haojun Liao
5e2bb75275 fix(query):set correct initial key value for mem/imem data. 2023-02-06 17:56:45 +08:00
Haojun Liao
3822225231 other: merge main. 2023-02-06 16:24:15 +08:00
Haojun Liao
08b3ce7cc0 fix(query): remove timing code. 2023-02-06 16:08:41 +08:00
Haojun Liao
b53d2669da other: merge main 2023-02-06 16:02:54 +08:00
Haojun Liao
e7b97cc086 fix(query): set the correct timestamp value in case that only imem has data. 2023-02-06 15:59:47 +08:00
Xiaoyu Wang
0b6852d7eb
Merge pull request #19813 from taosdata/enh/TD-22139 
enh(tsdb/cache): new block index cache for querying
 2023-02-06 15:42:42 +08:00
Hongze Cheng
09628401f8 refact code 2023-02-06 14:49:50 +08:00
Minglei Jin
b83f93d564 fix(query): release lru handle before returning from block idx loading 2023-02-06 14:41:17 +08:00
Minglei Jin
a6d52aed4f fix(tsdb/cache): use 5M cache for block index instead of 1M 2023-02-06 14:18:49 +08:00
Xiaoyu Wang
f2ff17dace merge 3.0 2023-02-06 14:18:13 +08:00
Minglei Jin
023b8377fb enh(tsdb/cache): new block index cache for querying 2023-02-06 14:12:57 +08:00
Haojun Liao
882451df0b
Merge pull request #19809 from taosdata/fix/nodisk 
fix(query): add null ptr check when retrieving the block info.
 2023-02-06 12:57:23 +08:00
Haojun Liao
89b1843382 fix(query): add null ptr check when retrieving the block info. 2023-02-06 10:59:45 +08:00
wangmm0220
762f6466f3 fix:conflicts from 3.0 2023-02-06 09:23:29 +08:00
wangmm0220
33de4e2aba fix:memory leak 2023-02-06 09:21:46 +08:00
yihaoDeng
0dd4433e58 opt index 2023-02-05 11:49:45 +08:00
yihaoDeng
9b7d935682 opt index 2023-02-04 21:02:06 +08:00
Haojun Liao
8dcd73abf0
Merge pull request #19790 from taosdata/fix/nodisk 
fix(query): set the correct number of rows when calculating using sma
 2023-02-04 00:58:59 +08:00
dapan1121
225bf28536
Merge pull request #19744 from taosdata/fix/TD-22009 
enhance: optimize building table delete skyline performance
 2023-02-03 19:00:47 +08:00
Haojun Liao
845530e125 other: add some logs. 2023-02-03 17:33:35 +08:00
Xiaoyu Wang
5d499e52f9 merge main 2023-02-03 17:13:11 +08:00
Haojun Liao
f803fa44b5 fix(query): set the correct number of rows when calculating using sma for min/max function. 2023-02-03 16:50:13 +08:00
wangmm0220
51760c10ec fix:conflicts from 3.0 2023-02-03 15:40:20 +08:00
wangmm0220
c576d1fa91 fix:error for subscribe stable 2023-02-03 14:54:25 +08:00
Hongze Cheng
f982428e46 mroe code 2023-02-03 14:46:45 +08:00
Shengliang Guan
3b475d4c0d fix: adjust some log while split 2023-02-03 14:40:19 +08:00
Hongze Cheng
49631f6e96 fix: snapshot coredump caused by type 2023-02-03 14:34:55 +08:00
Haojun Liao
e29ca4f5d8 refactor(query): use real number of stt instead of default value. 2023-02-03 10:04:15 +08:00
Liu Jicong
6248804b28 fix log 2023-02-03 09:14:52 +08:00
Haojun Liao
baaa57567e refactor: do some internal refactor. 2023-02-03 09:13:13 +08:00
Haojun Liao
9c32ebc011
Merge pull request #19745 from taosdata/fix/tq 
fix: tq open
 2023-02-03 09:11:51 +08:00
Haojun Liao
7168f90c51 refactor(query): disable file size check when reading data files. 2023-02-02 17:49:07 +08:00
Haojun Liao
40b7718078 refactor(query): disable file size check when reading data files. 2023-02-02 17:45:21 +08:00
Haojun Liao
e9490a3235 refactor(query): disable tag filter cache by default. 2023-02-02 17:38:21 +08:00
wangmm0220
c8d49b603d fix:roll back htol length for block raw data 2023-02-02 17:23:01 +08:00
Liu Jicong
8cd362c8d0 fix log 2023-02-02 16:15:12 +08:00
Haojun Liao
edca89b731 refactor: opt query perf. 2023-02-02 15:15:46 +08:00
Haojun Liao
fd6ea6ba2f other: merge main. 2023-02-02 14:12:24 +08:00
Haojun Liao
ab8c977417 other: merge main. 2023-02-02 14:00:36 +08:00
Liu Jicong
924e5bfe6c add debug log 2023-02-02 13:34:11 +08:00
Haojun Liao
97ca4dfd0b
Merge pull request #19732 from taosdata/feat/ly_stream_stable 
Feat/ly stream stable
 2023-02-02 10:57:09 +08:00
Minglei Jin
69d6fb5bfe fix(meta): use metaAbort instead of tdbAbort with metaClose 2023-02-02 10:20:34 +08:00
Haojun Liao
3897a91a95 refactor: do some internal refactor. 2023-02-02 10:17:39 +08:00
Haojun Liao
6a5ce7d663 refactor: opt tag filter perf. 2023-02-02 10:11:36 +08:00
Xiaoyu Wang
7e3b987e65
Merge pull request #19727 from taosdata/fix/TD-22143 
fix(query): protect read snap with reader mutex when closing reader
 2023-02-02 09:13:58 +08:00
Haojun Liao
423e04d5a1
Merge pull request #19740 from taosdata/fix/nodisk 
refactor: add some logs.
 2023-02-02 09:12:16 +08:00
Liu Jicong
041d0d817a fix: tq open 2023-02-02 09:11:17 +08:00
dapan1121
9a261ab2d7 improvement: optimize build table delete skyline performance 2023-02-02 08:45:38 +08:00
Haojun Liao
9fe1512c55 refactor: add some logs. 2023-02-01 22:41:39 +08:00
Haojun Liao
5215a218d4
Merge pull request #19735 from taosdata/fix/nodisk 
fix(query): move the reset to other place.
 2023-02-01 22:07:29 +08:00
Hongze Cheng
e13499b542 add some log 2023-02-01 18:42:39 +08:00
Haojun Liao
8e4c6ccbb3 fix(query): move the reset to other place. 2023-02-01 18:15:35 +08:00
54liuyao
c4414ec646 feat(stream):exists stable bug&ci 2023-02-01 17:27:04 +08:00
Haojun Liao
04b6576a51
Merge pull request #19728 from taosdata/fix/nodisk 
fix(query): reset the del file index when beginning last file check.
 2023-02-01 17:16:17 +08:00
Shengliang Guan
fa3356d3c8
Merge pull request #19698 from taosdata/enh/TD-18702 
enh: split vgroup
 2023-02-01 17:03:06 +08:00
wangmm0220
8a21d7f307 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-21899 2023-02-01 16:13:06 +08:00
wangmm0220
2bf0916bcf fix:split block data if there are none value in block for taosx 2023-02-01 16:12:59 +08:00
Minglei Jin
dca720fc7d fix(query): protect read snap with reader mutex when closing reader 2023-02-01 15:09:21 +08:00
yihaoDeng
3a1ce7c517 fix filter error 2023-02-01 11:02:28 +08:00
Hongze Cheng
03fa4578da Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-02-01 09:14:00 +08:00
yihaoDeng
5e455b6aef opt table filter 2023-01-31 23:18:35 +08:00
yihaoDeng
fa0b70b156 opt tag filter 2023-01-31 22:43:59 +08:00
yihaoDeng
6100a0d51f fix invalid ver 2023-01-31 21:03:35 +08:00
Xiaoyu Wang
fc829aec52
Merge pull request #19689 from taosdata/fix/TD-22030 
fix(query): reset snap to null after untaking mem snap
 2023-01-31 16:51:07 +08:00
Shengliang Guan
fb0ef25dbd test: adjust split case 2023-01-31 16:40:53 +08:00
dapan1121
c8394cbf6e fix: add get tb from mem time info 2023-01-31 16:38:29 +08:00
Shengliang Guan
2a8d791e39 Merge remote-tracking branch 'origin/3.0' into enh/TD-18702 2023-01-31 16:31:26 +08:00
Shengliang Guan
9f2078ae0d enh: rename tsdb file 2023-01-31 16:28:37 +08:00
Shengliang Guan
5d8f05749c fix: coredump while tdbAbort 2023-01-31 15:49:56 +08:00
Hongze Cheng
579f65115d add debug info 2023-01-31 15:23:21 +08:00
Minglei Jin
0257c4a90b fix(query): release reader's lock if not composed block 2023-01-31 15:04:48 +08:00
Shengliang Guan
fbc4513ee3 enh: call vnodeBegin after vnodeSyncCommit 2023-01-31 15:01:10 +08:00
Hongze Cheng
db9a6b119d fix 2023-01-31 14:58:50 +08:00
Hongze Cheng
11bc53bbd7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/vnode_compact 2023-01-31 14:07:58 +08:00
Hongze Cheng
cabf3e8683 fix: invalid read 2023-01-31 11:22:06 +08:00
Shengliang Guan
53ac9c7229 enh: commit tsdb after split 2023-01-31 10:59:34 +08:00
Minglei Jin
251fdd35ba fix(tsdb/read): wrap tsdb reader's lock with acquire/release 2023-01-30 19:26:36 +08:00
yihaoDeng
0dea988c84 fix deadlock 2023-01-30 18:26:42 +08:00
Hongze Cheng
2d03fb6041 fix memory leak 2023-01-30 18:16:55 +08:00
Shengliang Guan
141fcdd49b enh: alter vnode hashrange in cfg file 2023-01-30 17:54:54 +08:00
wangmm0220
4128c5653c fix:error in tmq for taosx 2023-01-30 17:23:04 +08:00
Shengliang Guan
8bc0d4ba74 enh: add alter vnode hashrange request 2023-01-30 16:33:17 +08:00
Hongze Cheng
c04810e8d5 fix: more code 2023-01-30 15:51:54 +08:00
Hongze Cheng
5904f967f5 fix: snapshot problem 2023-01-30 15:38:19 +08:00
Hongze Cheng
90ff718c57 Merge branch 'fix/TD-22070' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-30 11:41:26 +08:00
Hongze Cheng
9502fb3633 fix memory leak 2023-01-30 11:40:41 +08:00
Hongze Cheng
0f00862d8b Merge branch 'fix/TD-22070' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-30 10:17:59 +08:00
Haojun Liao
1741e98a4e fix(query): reset the del file index when beginning last file check. 2023-01-30 10:13:54 +08:00
Hongze Cheng
3deedfb5c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-30 10:11:45 +08:00
wangmm0220
94a3fa4ff3 fix:htol(length) & set vgId,uid correct for auto create table in taosx 2023-01-30 09:55:22 +08:00
kailixu
a558e49999 fix: tsdb snapshot reader type 2023-01-29 22:13:14 +08:00
kailixu
57885eae5a Merge branch '3.0' into fix/TD-22047-3.0 2023-01-29 22:01:16 +08:00
Liu Jicong
98906bb272 remove assert 2023-01-29 15:24:31 +08:00
Benguang Zhao
2f9218b79c fix: tqOffsetSnapRead success on tq/offset-ver not existing 2023-01-29 15:14:26 +08:00
Hongze Cheng
27f3b02196 more code fix 2023-01-29 15:09:13 +08:00
Hongze Cheng
f6335a795b fix: assert coredump 2023-01-29 14:47:45 +08:00
Hongze Cheng
5e7b6602c5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/3.0_merge_main 2023-01-29 14:05:15 +08:00
Minglei Jin
101772fe1b fix(query): reset snap to null after untaking mem snap 2023-01-29 13:43:37 +08:00
Xiaoyu Wang
6e247e8911
Merge pull request #19679 from taosdata/fix/TD-22030 
fix(query): reset iter, iiter's hasVal to false when suspending reader
 2023-01-29 11:04:41 +08:00
Hongze Cheng
e0b0ce2395 refact more code 2023-01-29 10:21:39 +08:00
Minglei Jin
ac3e6323e2 fix(query): reset all block scan info when suspending reader 2023-01-29 09:33:32 +08:00
Hongze Cheng
ded3d6e7c9 more code 2023-01-29 09:08:02 +08:00
Hongze Cheng
f3e199dda2 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-21761 2023-01-28 19:34:08 +08:00
wangmm0220
d96cdff8f3 fix:add logic for auto create table while inserting data for taosx 2023-01-28 18:25:43 +08:00
Xiaoyu Wang
eb86f5ae71 merge main 2023-01-28 18:10:08 +08:00
Hongze Cheng
b996618e65 more code 2023-01-28 18:03:13 +08:00
Xiaoyu Wang
24157e78d6 merge main 2023-01-28 17:52:58 +08:00
Liu Jicong
f5c4ca3380 fix: wal ref 2023-01-28 17:17:55 +08:00
kailixu
1fb2df0385 fix: rsma close and commit refactor 2023-01-28 17:00:53 +08:00
Hongze Cheng
fb2b42f968 refact more code 2023-01-28 16:51:22 +08:00
Liu Jicong
2a71d47668 fix: wal ref 2023-01-28 16:11:17 +08:00
Minglei Jin
b4807d9aa9 fix(query): reset iter, iiter's hasVal to false when suspending reader 2023-01-28 14:06:37 +08:00
Hongze Cheng
545e4d7f02 make it compile 2023-01-28 13:30:15 +08:00
Hongze Cheng
8d56306517 more code 2023-01-28 11:31:32 +08:00
Xiaoyu Wang
f487c4e63f
Merge pull request #19524 from taosdata/fix/long_query 
fix(query): switch buffer pool recycle on
 2023-01-28 08:51:51 +08:00
Hongze Cheng
2f5eeb8000 make it compile 2023-01-26 21:57:22 +08:00
Hongze Cheng
ec886154a4 more code 2023-01-26 21:48:54 +08:00
Hongze Cheng
a902d412eb more code 2023-01-26 20:20:39 +08:00
Hongze Cheng
b8578e242e Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-21761 2023-01-26 17:14:57 +08:00
Hongze Cheng
4f0a605cc0 more code 2023-01-22 17:20:26 +08:00
kailixu
1e06fb1783 chore: code optimization 2023-01-21 16:15:12 +08:00
kailixu
08a5ed4a07 chore: revert the code 2023-01-21 16:11:33 +08:00
kailixu
338a2a74cb chore: revert the code 2023-01-21 16:08:33 +08:00
kailixu
2416d34a80 fix: memory leak for row merge 2023-01-21 16:07:27 +08:00
kailixu
39b69ba39e fix: row schema version for row merger 2023-01-21 13:44:25 +08:00
Hongze Cheng
fff4a96bdf more code 2023-01-19 22:18:39 +08:00
Hongze Cheng
7203819888 more code 2023-01-19 21:46:27 +08:00
Hongze Cheng
b88327d737 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-21761 2023-01-18 23:32:52 +08:00
yihaoDeng
bfd711c08f Merge remote-tracking branch 'origin/3.0' into dynamicIdx 2023-01-18 22:01:49 +08:00
Hongze Cheng
516306b598 more code 2023-01-18 17:28:18 +08:00
dapan1121
2d42608813
Merge pull request #19632 from taosdata/fix/TS-2461 
fix: rows number exceeds block capacity issue
 2023-01-18 16:56:05 +08:00
dapan1121
17bfb8228a fix: rows number exceeds block capacity issue 2023-01-18 15:55:24 +08:00
Hongze Cheng
d6028bdde1 some code 2023-01-18 14:59:02 +08:00
kailixu
d9ae5a755c fix: tsdb fs head/data/sma nRef 2023-01-18 11:05:39 +08:00
kailixu
70fb18e611 fix: tsdb ReadSnap take/untake 2023-01-17 15:11:11 +08:00
Haojun Liao
49dedc3c3f fix(query): opt perf. 2023-01-17 10:24:19 +08:00
Shengliang Guan
01647debb9
Merge pull request #19581 from taosdata/enh/TD-20047 
fix: update epset on dnode info changed
 2023-01-17 08:53:43 +08:00
Haojun Liao
7425820c21 refactor: do some internal refactor. 2023-01-16 23:58:45 +08:00
Shengliang Guan
d476b6db13 enh: update epset on dnode info changed 2023-01-16 15:41:50 +08:00
kailixu
b562b25b75 Merge branch '3.0' into fix/TD-21873-3.0 2023-01-16 13:39:30 +08:00
dapan1121
62b64631dc
Merge pull request #19547 from taosdata/fix/TD-21648 
fix:add interface for odbc
 2023-01-16 13:29:15 +08:00
Haojun Liao
94e8aafcf6
Merge pull request #19543 from taosdata/feat/ly_stream 
create stream and use existing super table
 2023-01-14 23:30:25 +08:00
Haojun Liao
82f4db302e refactor: do some internal refactor. 2023-01-14 23:17:57 +08:00
Haojun Liao
7aee35c457 fix(query): init the value. 2023-01-13 15:54:23 +08:00
kailixu
8f0f060410 Merge branch '3.0' into fix/TD-21873-3.0 2023-01-13 15:14:11 +08:00
Haojun Liao
5386fe7cc4 fix(query): init the value. 2023-01-13 14:57:09 +08:00
Haojun Liao
cd6532ca7e enh(query): prepare the buffer on the stack, instead of heap. 2023-01-13 14:49:07 +08:00
yihaoDeng
3c97e3fc1a add execute plan 2023-01-13 14:39:50 +08:00
Haojun Liao
6332c982b5 fix(query): fix invalid read 2023-01-13 14:16:59 +08:00
Xiaoyu Wang
9a0c2805f4 merge main 2023-01-13 13:54:04 +08:00
Haojun Liao
bb5fb42c2f refactor: do some internal refactor. 2023-01-13 13:48:20 +08:00
Haojun Liao
7dcad62775 refactor: do some internal refactor. 2023-01-13 10:56:47 +08:00
Haojun Liao
5ff84757fe refactor: do some internal refactor. 2023-01-13 10:53:36 +08:00
Haojun Liao
71ca1d84ef refactor: do some internal refactor. 2023-01-13 10:53:19 +08:00
Haojun Liao
6bffcfaad8 refactor: do some internal refactor. 2023-01-13 10:45:07 +08:00
Haojun Liao
28baef1051 refactor: do some internal refactor. 2023-01-13 10:40:12 +08:00
Haojun Liao
a71f029eec refactor: do some internal refactor. 2023-01-13 10:36:05 +08:00
54liuyao
3ec1560faa create stream and use existing super table 2023-01-13 10:26:49 +08:00
kailixu
6851a7db04 fix: memory leak 2023-01-13 02:12:04 +08:00
Haojun Liao
8bed2612a6 refactor: do some internal refactor. 2023-01-12 23:24:41 +08:00
Haojun Liao
a96de23363 fix(query): add the check of item when putting in cache. 2023-01-12 22:50:02 +08:00
kailixu
e571ddf37e fix: tsma transaction refactor 2023-01-12 21:13:15 +08:00
Haojun Liao
d36e68bd9b fix(query): add the check of item when putting in cache. 2023-01-12 19:25:28 +08:00
Haojun Liao
96feaaadbe fix(query): add the check of item when putting in cache. 2023-01-12 19:24:23 +08:00
Shengliang Guan
cd0404bc25 refact: adjust return value of tmsgUpdateDnodeInfo 2023-01-12 17:08:33 +08:00
yihaoDeng
72b43d240d add/delete tag idx 2023-01-12 16:31:55 +08:00
Haojun Liao
effcfc057d fix(query): fix compare error. 2023-01-12 15:00:07 +08:00
Minglei Jin
beb637554c bp/proactive: remove incorrect proactive assert 2023-01-12 10:54:58 +08:00
Minglei Jin
086253b413 Revert "vnode: disable buffer pool recycling for 3.0 merging" 
This reverts commit ba68d5d7b3.
 2023-01-12 09:52:03 +08:00
Hongze Cheng
e3498d61b4 refact code 2023-01-12 09:27:18 +08:00
yihaoDeng
69f0fe9792 add/delete tag idx 2023-01-11 17:03:23 +08:00
yihaoDeng
a7eee2c178 add/delete tag idx 2023-01-11 16:28:59 +08:00
Shengliang Guan
45ec75a5f3
Merge pull request #19472 from taosdata/fix/long_query 
Fix/long_query
 2023-01-11 15:58:26 +08:00
Haojun Liao
53f27901a5 Merge branch 'main' into feature/3_liaohj 2023-01-11 15:42:34 +08:00
Minglei Jin
ba68d5d7b3 vnode: disable buffer pool recycling for 3.0 merging 2023-01-11 14:03:51 +08:00
yihaoDeng
3e738363aa add/delete tag index 2023-01-11 13:36:07 +08:00
wangmm0220
3b4ff4d094 fix:add logic for scan ins_columns 2023-01-10 20:32:31 +08:00
Haojun Liao
2d73a50469 enh(query): opt filter check. 2023-01-10 19:31:30 +08:00
Minglei Jin
5024fc1e9f tsdb/suspend: fix table block scan info 2023-01-10 18:40:15 +08:00
dapan1121
c3cb4a52fc
Merge pull request #19425 from taosdata/fix/TD-21778 
fix: tsdb read invalid memory read issue
 2023-01-10 17:10:19 +08:00
Hongze Cheng
020b79a094 little fix 2023-01-10 17:04:23 +08:00
Hongze Cheng
38b9eb8179 Merge branch 'fix/long_query' of https://github.com/taosdata/TDengine into fix/long_query 2023-01-10 17:00:31 +08:00
Hongze Cheng
1154f90aa0 fix: cond wait EINVAL 2023-01-10 17:00:25 +08:00
Minglei Jin
4032340e92 tsdb/reader: reset reader status with lock protected 2023-01-10 16:45:58 +08:00
Minglei Jin
086ec24688 tsdb/reader: reset reader status with lock protected 2023-01-10 16:07:37 +08:00
dapan1121
fd0d4bb830
Update tsdb.h 
fix: remove tmp field
 2023-01-10 15:39:16 +08:00
dapan1121
459d2932b1 fix: memcpy empty value issue 2023-01-10 13:44:24 +08:00
Hui Li
8545bf06e3
Merge pull request #19467 from taosdata/fix/liaohj 
fix(query): fix error for retrieve data only in last files.
 2023-01-10 13:40:30 +08:00
Haojun Liao
08321f3c6d enh(query): update the log. 2023-01-10 13:35:25 +08:00
Haojun Liao
b2a70c0a34 enh(query): jump out of loop once queried tables are all found. 2023-01-10 13:33:27 +08:00
Haojun Liao
1354eac985 Merge branch 'main' into feature/3_liaohj 2023-01-10 13:21:49 +08:00
Hongze Cheng
141f294a3a Merge branch 'fix/long_query' of https://github.com/taosdata/TDengine into fix/long_query 2023-01-10 11:56:17 +08:00
Hongze Cheng
2e161729b6 refact code 2023-01-10 11:56:09 +08:00
Minglei Jin
e48bdbfd0f tsdb/log-query: new proactive flag for mem table unref 2023-01-10 11:52:40 +08:00
Hongze Cheng
bff8c216cc more code 2023-01-10 11:36:40 +08:00
dapan1121
bfc483aa30 fix: row merge flag issue 2023-01-10 11:32:13 +08:00
Hongze Cheng
bb2ed08afc Merge branch 'fix/long_query' of https://github.com/taosdata/TDengine into fix/long_query 2023-01-10 11:01:50 +08:00
Hongze Cheng
f26f661f47 more code 2023-01-10 11:01:41 +08:00
Haojun Liao
e244a484f8 fix(query): add additional check for imem/mem 2023-01-10 10:49:35 +08:00
Minglei Jin
d69ec98723 tsdb/read: reseek with try lock mutex 2023-01-10 10:38:44 +08:00
54liuyao
d5ade95b31 feat(stream):user define tag 2023-01-10 10:13:56 +08:00
Minglei Jin
f0e9656b62 Merge branch 'fix/long_query' of https://github.com/taosdata/TDengine into fix/long_query 2023-01-10 10:12:30 +08:00
Minglei Jin
3178843b72 tsdb/cache: reseek with busy always 2023-01-10 10:11:17 +08:00
Hongze Cheng
851dba5166 refact code 2023-01-10 09:56:38 +08:00
Hongze Cheng
1dfeaf8b18 refact code 2023-01-10 09:53:38 +08:00
Hongze Cheng
f848324d54 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/long_query 2023-01-10 09:42:45 +08:00
Shengliang Guan
b9b8a7ed35
Merge pull request #19429 from taosdata/merge/mainto3.0_0108 
merge from main to 3.0
 2023-01-10 09:31:55 +08:00
Haojun Liao
6a6d53b896
fix(query): fix error for retrieve data only in last files. (#19457) 
* fix: add test cases;

* fix(query): fix error for retrieve data only in last files.
 2023-01-09 20:55:34 +08:00
dapan1121
df2175087b fix: memory leak and invalid read issue 2023-01-09 19:47:17 +08:00
Haojun Liao
16f0900fe9 fix(query): fix error for retrieve data only in last files. 2023-01-09 19:26:39 +08:00
Hongze Cheng
933bd7b78c Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/long_query 2023-01-09 19:03:19 +08:00
Hongze Cheng
ad9e8a9aa3 more code 2023-01-09 19:03:09 +08:00
dapan1121
54558b438c
Merge pull request #19448 from taosdata/refact/submit_req_marks 
fix:table name error in schemaless
 2023-01-09 18:36:57 +08:00
Hongze Cheng
f8c9ae50b8 more code 2023-01-09 16:06:07 +08:00
Hongze Cheng
2e443c395e more code 2023-01-09 15:51:30 +08:00
wangmm0220
a462f518e3 fix:table name error in schemaless 2023-01-09 15:14:20 +08:00
Hongze Cheng
15995e7631 more code 2023-01-09 14:54:49 +08:00
dapan1121
80586ad997 fix: invalid free issue 2023-01-09 11:33:26 +08:00
Hongze Cheng
375545435c adjust more code 2023-01-09 10:09:31 +08:00
Benguang Zhao
a2085703bf Merge branch main into FIX/TD-21812-main 2023-01-09 10:08:28 +08:00
Shengliang Guan
398161eb5f Merge branch 'main' into merge/mainto3.0_0108 2023-01-09 10:00:53 +08:00
Shengliang Guan
f2d6ed8635
Merge pull request #19125 from taosdata/FIX/TD-21043-main 
enh: vnodeCommit on consensus only
 2023-01-09 09:41:34 +08:00
Shengliang Guan
35893eb9b1
Merge pull request #19435 from taosdata/fix/liaohj 
fix(query): do not merge rows in last file when no data blocks exist.
 2023-01-09 09:41:12 +08:00
Hongze Cheng
fda6fccac8 more code 2023-01-09 09:24:26 +08:00
Benguang Zhao
90830e5410 fix: use pInfo->info.state.committed instead of the current one for async vnodeCommit 2023-01-09 09:08:59 +08:00
Haojun Liao
95a6720b2a fix(query): do not merge rows in last file when no data blocks exist. 2023-01-08 23:02:16 +08:00
Haojun Liao
f90fa07ea9 refactor: add avx support zigzag decode. 2023-01-08 12:34:18 +08:00
Shengliang Guan
d90eef6656 Merge branch '3.0' into merge/mainto3.0_0108 2023-01-08 09:54:21 +08:00