Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
56976 commits 554 branches 514 tags 1.7 GiB
Commit graph

7482 commits

Author SHA1 Message Date
Haojun Liao
2c9f28d97f Merge branch 'main' into fix/liaohj 2023-08-24 14:12:15 +08:00
wangjiaming0909
7fad1de841 Revert "feat: show create table, desc table with col comments" 
This reverts commit 16754b5ac1.
 2023-08-24 13:38:41 +08:00
wade zhang
0860670d37
Merge pull request #22526 from taosdata/enh/TD-25445-new 
enh/TD-25445: ttl split flush and drop table
 2023-08-24 13:57:07 +08:00
shenglian-zhou
e76e6bbb84
Update tsdbReadUtil.c 2023-08-24 11:34:56 +08:00
shenglian-zhou
1965703d53
Merge branch '3.0' into szhou/tsdb-neigh-block 2023-08-24 10:58:23 +08:00
yihaoDeng
3afea998ac refactor log 2023-08-24 10:15:15 +08:00
Haojun Liao
230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
Haojun Liao
b0c5fa8290 fix(stream): reset the task status. 2023-08-23 14:10:41 +08:00
Hongze Cheng
a601cd21bd fix: alter stt_trigger bug 2023-08-23 13:31:19 +08:00
Shungang Li
458fd07976 enh: ttl split flush and drop table 
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
 2023-08-23 11:13:34 +08:00
wade zhang
8c4062c1b0
Merge pull request #22515 from taosdata/fix/TD-25819-2 
fix(tsdb/file): save errno for shell reporting
 2023-08-23 10:49:48 +08:00
wade zhang
e069d72229
Merge pull request #22513 from taosdata/FIX/TD-25864-3.0 
enh: adjust the order of pre-close actions in vnodePreClose
 2023-08-22 17:27:17 +08:00
Haojun Liao
af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Minglei Jin
345743aba5 fix(tsdb/file): save errno for shell reporting 2023-08-22 14:44:32 +08:00
Haojun Liao
cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Benguang Zhao
8be670aee8 enh: place vnodeSyncPreStop ahead of vnodeQueryPreStop in vnodePreClose 2023-08-22 11:30:40 +08:00
Haojun Liao
64556c9f1d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 10:47:02 +08:00
Haojun Liao
def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen
b899a8b7df
Merge branch '3.0' into feat/TD-22970 2023-08-22 10:12:30 +08:00
yihaoDeng
1531e2d7d3 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 09:51:38 +08:00
Haojun Liao
873c22abb1 fix(stream): reset update stream tasks. 2023-08-21 19:32:27 +08:00
Haojun Liao
8b27f98ee4 refactor: do some internal refactor. 2023-08-21 19:08:27 +08:00
yihaoDeng
387b4d365e refactor checkpoint 2023-08-21 19:07:15 +08:00
Hongze Cheng
b8d62a86ed feat: clean useless file 2023-08-21 16:29:48 +08:00
Haojun Liao
29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
dm chen
dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
wade zhang
54e1f69db4
Merge pull request #22481 from taosdata/fix/TD-25822 
enh(tsdb/write): timestamp out of range with s3's last tier storage
 2023-08-21 09:33:06 +08:00
yihaoDeng
6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao
b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Minglei Jin
c4a3a5da35 vnode: fix write to s3 last tier 2023-08-18 18:02:53 +08:00
wade zhang
a7e11c2520
Merge pull request #22482 from taosdata/fix/TD-25818 
fix(vnode/destroy): delete objects
 2023-08-18 17:49:22 +08:00
wade zhang
87a8fe34ef
Merge pull request #22480 from taosdata/fix/TD-25819 
fix(tsdb/reader): use ENOENT for not found objects
 2023-08-18 16:49:54 +08:00
Minglei Jin
7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
Minglei Jin
0242d4ce33 enh(tsdb/write): timestamp out of range with s3's last tier storage 2023-08-18 16:07:15 +08:00
Haojun Liao
c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
Minglei Jin
73ae493fa7 tsdb/reader: use ENOENT for not found objects 2023-08-18 15:43:08 +08:00
liuyao
9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao
87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121
9b953707b8 Merge remote-tracking branch 'origin/main' into fix/mainto3.0 2023-08-18 14:42:43 +08:00
Haojun Liao
edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
dm chen
e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
Haojun Liao
a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao
633ecf66e5 other: add logs. 2023-08-18 10:39:32 +08:00
Haojun Liao
9ad8cf48dc other: add logs. 2023-08-18 10:38:24 +08:00
Haojun Liao
87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
slzhou
4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
Hongze Cheng
8582e0c71a fix: important fix for compact file corruption 2023-08-17 18:13:37 +08:00
dmchen
5f138941f8 tsdb snap core 2023-08-17 17:58:35 +08:00
slzhou
85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
Benguang Zhao
7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou
4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121
0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685 
feat: support column comment
 2023-08-17 14:23:54 +08:00
wangjiaming0909
16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
liuyao
5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
wade zhang
e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug 
fix: tsdb snapshot bug
 2023-08-17 08:25:32 +08:00
Haojun Liao
6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
 2023-08-17 00:08:44 +08:00
Haojun Liao
ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao
f8f8e7a8f0
Merge pull request #22465 from taosdata/fix/3_liaohj 
fix(stream): add the back pressure for sink node.
 2023-08-16 22:59:36 +08:00
yihaoDeng
114df7c349 fix transfer error 2023-08-16 11:37:15 +00:00
Haojun Liao
80506b564b
Merge pull request #22461 from taosdata/fix/liaohj 
refactor: do some internal refactcor
 2023-08-16 19:26:39 +08:00
Haojun Liao
9a76ae72d6 fix(stream): add the back pressure for sink node. 2023-08-16 19:11:43 +08:00
Hongze Cheng
32c5b6a947 fix: tsdb snapshot bug 2023-08-16 18:21:02 +08:00
Haojun Liao
cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
dmchen
fee4b875d1 error code 2023-08-16 17:49:17 +08:00
Hongze Cheng
cedc7bf1b6 fix: memory leak when commit 2023-08-16 17:21:51 +08:00
yihaoDeng
ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen
e020c4e8c5
Merge pull request #22456 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-16 16:49:43 +08:00
Haojun Liao
f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-16 16:48:33 +08:00
Haojun Liao
d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
yihaoDeng
993ae84398 close backend 2023-08-16 07:17:15 +00:00
Haojun Liao
4ea58e5682 refactor: do some internal refactor. 2023-08-16 11:44:05 +08:00
Haojun Liao
6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
dmchen
de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
liuyao
919ffbaf72 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 10:04:07 +08:00
Haojun Liao
63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0 
rebuild index at tag0
 2023-08-16 09:47:43 +08:00
liuyao
fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
Haojun Liao
ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao
7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
dapan1121
df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt 
enhance: tag scan optimization
 2023-08-16 08:58:17 +08:00
wade zhang
1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3 
feat(tsdb/cos): s3 migration
 2023-08-16 08:02:20 +08:00
slzhou
4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
Benguang Zhao
239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
Minglei Jin
1792bf306e vnode: fix cos cache evicting 2023-08-15 16:54:26 +08:00
Haojun Liao
39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Minglei Jin
c4e5cfd2fb retention: return code from copy 2023-08-15 15:40:40 +08:00
Minglei Jin
bd758e0269 retention: remove old files last 2023-08-15 15:14:34 +08:00
Minglei Jin
8639c22cc0 vnode, common: USE_COS def 2023-08-15 14:53:58 +08:00
liuyao
1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
Haojun Liao
b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao
ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq 
opti:wal logic
 2023-08-15 09:16:29 +08:00
Haojun Liao
9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559 
feat:[TD-24559]support geomety type in schemaless
 2023-08-14 22:06:41 +08:00
liuyao
9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
Haojun Liao
2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
yihaoDeng
cf9f9ab471 rebuild index at tag0 2023-08-14 08:01:20 +00:00
Haojun Liao
a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Minglei Jin
989abc2bf6 vnode/cos: move includes into USE_COS 2023-08-14 15:03:17 +08:00
Haojun Liao
91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Minglei Jin
c97b9249fc cos: only for linux 2023-08-14 14:38:28 +08:00
slzhou
692d436d68 fix: fix ci error 2023-08-14 14:14:16 +08:00
Haojun Liao
5ec6b64aab fix(stream): add logs. 2023-08-14 13:12:41 +08:00
Haojun Liao
ead04964fd Merge branch 'main' into fix/liaohj 2023-08-14 12:11:15 +08:00
dapan1121
c2417eb5cd
Merge pull request #22404 from taosdata/fix/TD-25621-3.0 
fix: dup read lock on windows
 2023-08-14 11:37:05 +08:00
Haojun Liao
2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
slzhou
646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
yihaoDeng
246efd83c6 refactor chpt transfer 2023-08-14 02:03:41 +00:00
wangmm0220
dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
wade zhang
1b51f53c15
Merge pull request #22407 from taosdata/fix/TD-25671 
fix: infinite tomb data sync loop
 2023-08-14 09:25:47 +08:00
shenglian zhou
46f92d222d fix: typo error 2023-08-14 08:52:25 +08:00
shenglian zhou
db25f6c01b Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block 2023-08-14 08:49:25 +08:00
shenglian zhou
c5a6cac34f fix: fix compilation error 2023-08-14 08:49:10 +08:00
Haojun Liao
01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj 
refactor: refactor the transfer state procedure.
 2023-08-13 23:28:18 +08:00
slzhou
8e7fc91095 enhance: set file data block iter 2023-08-13 18:30:30 +08:00
Haojun Liao
0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao
ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
wangmm0220
efb472d54a fix:heap use after free 2023-08-12 10:15:40 +08:00
Haojun Liao
f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
wangmm0220
767563752a opti:wal logic 2023-08-11 20:21:13 +08:00
wangmm0220
deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
Hongze Cheng
847bc0da08 fix: infinite tomb data sync loop 2023-08-11 18:10:16 +08:00
slzhou
47d2f9ad6d fix: first run without tag cond 2023-08-11 17:52:52 +08:00
wangmm0220
7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou
42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
Minglei Jin
84452c8dee cos: use static sdk 2023-08-11 16:36:53 +08:00
shenglian zhou
eb9d77d639 ehance: destroy blocklist of table scan info, add block global index list to table scan info 2023-08-11 16:33:49 +08:00
Haojun Liao
87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng
6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao
e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
wangmm0220
25e32bbf7c fix:offset error in tmq & add test cases 2023-08-11 14:25:12 +08:00
Haojun Liao
9322f80343 fix(stream): register the rsp callback. 2023-08-11 13:31:50 +08:00
kailixu
64a1636dd2 chore: trigger CI 2023-08-11 12:54:45 +08:00
kailixu
1d089fe085 fix: dup read lock on windows 2023-08-11 11:34:57 +08:00
yihaoDeng
99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao
1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao
6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng
ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
Haojun Liao
d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq 
fix:offset error in tmq & add test cases
 2023-08-11 10:00:08 +08:00
Minglei Jin
4513acfee9 cos: use static libs for mxml, apr, apu, curl 2023-08-11 09:54:54 +08:00
yihaoDeng
32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
shenglian zhou
b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
wangmm0220
78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
Minglei Jin
c04ada3573 cos: link with static libs 2023-08-10 15:28:22 +08:00
Minglei Jin
cd63e81450 cos: separate building phase for apr & apr-util 2023-08-10 14:18:12 +08:00
dm chen
dd271bca6d
Merge pull request #22394 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-10 14:14:22 +08:00
Haojun Liao
a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
Haojun Liao
161fd6902a fix(stream): fix the acquire task. 2023-08-10 12:45:20 +08:00
Minglei Jin
33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao
f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao
b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-10 11:43:02 +08:00
yihaoDeng
ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao
c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao
4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao
0757e88ced fix(stream): set the correct hash keys. 2023-08-09 23:52:14 +08:00
Haojun Liao
7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
wangmm0220
1f5532fd67 fix:offset error in tmq & add test cases 2023-08-09 19:41:22 +08:00
Minglei Jin
a853d9d40c mxml: use ~/local/include 2023-08-09 18:21:55 +08:00
Haojun Liao
1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao
4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Hui Li
584427dd44
Merge pull request #22374 from taosdata/szhou/restore-minglei-main 
fix: restore stt/block merge back
 2023-08-09 14:40:03 +08:00
Minglei Jin
b08d5b4d42 mxml: add include dir to vnode 2023-08-09 14:02:10 +08:00
Minglei Jin
7e2859ed43 apr: use tarball to avoid ./buildconf 2023-08-09 13:03:37 +08:00
Haojun Liao
3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
Minglei Jin
2e0519b960 apr: fix apr & apr-util project names 2023-08-09 11:01:42 +08:00
Minglei Jin
7114ad63e5 apr：makefile for apr & apr-util 2023-08-09 10:54:17 +08:00
Minglei Jin
4d1155a5cf curl: makefile for curl 2023-08-09 10:43:27 +08:00
shenglian zhou
e9e06d1eae fix: restore stt block/data block merge back 2023-08-09 10:36:54 +08:00
shenglian zhou
2b1478f46e Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-09 10:36:26 +08:00
Haojun Liao
f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
Minglei Jin
16e015253b s3/mxml: remove os external dependency 2023-08-09 10:10:25 +08:00
Haojun Liao
bb39d94f9c
Merge pull request #22357 from taosdata/fix/liaohj 
other: merge fix from 3.0 to main.
 2023-08-09 09:05:54 +08:00
wangmm0220
d322cfce50 fix:add hashIteratorCancel for hash iterator 2023-08-08 16:28:51 +08:00
Haojun Liao
17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Hongze Cheng
c8f106106a fix: update assert issue 2023-08-08 14:49:05 +08:00
dm chen
70a598f072
Merge pull request #22355 from taosdata/3.0 
merge 3.0 to TD-22970
 2023-08-08 09:53:07 +08:00
Hui Li
05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612 
fix: snapshot invalid read
 2023-08-08 09:19:55 +08:00
Haojun Liao
458143c8b7
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei 
fix: restore stt block and data block merge back
 2023-08-08 08:58:02 +08:00
Haojun Liao
f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao
ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj 
other: merge main and fix bugs in stop stream tasks.
 2023-08-07 22:57:13 +08:00
Haojun Liao
aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
shenglian zhou
ec1270f75c fix: restore stt block/data block merge back 2023-08-07 17:17:12 +08:00
Minglei Jin
9e4da6c089 s3/config: parsing s3 configuration 2023-08-07 17:14:58 +08:00
shenglian zhou
9ddab11d98 Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-07 17:13:49 +08:00
yihaoDeng
b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng
eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao
e6b80e6c52 Merge branch '3.0' into fix/3_liaohj 2023-08-07 16:26:31 +08:00
Haojun Liao
225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Hongze Cheng
a545d45b5e fix: snapshot invalid read 2023-08-07 16:12:03 +08:00
Minglei Jin
fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
Hongze Cheng
661f2aca98 fix: memory leak 2023-08-07 14:13:44 +08:00
wangmm0220
9ecabb30f5 fix:ref is not there 2023-08-07 10:27:44 +08:00
wangmm0220
5f02e2ddfb fix:ref is not there 2023-08-07 09:31:29 +08:00
Haojun Liao
8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
wangmm0220
d9a1695257 fix:add log 2023-08-04 18:07:44 +08:00
Minglei Jin
65d8af19ed s3: new api s3Size 2023-08-04 16:35:35 +08:00
Minglei Jin
87783a9650 s3query/get: pull object to local 2023-08-04 15:37:52 +08:00
Minglei Jin
ebd09ca532 tsdb/write: use keep1 as minKey instead of keep2 2023-08-04 13:44:17 +08:00
Minglei Jin
88d755be76 feat(tsdb/cos): s3 migration 2023-08-04 13:31:00 +08:00
wade zhang
abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main 
fix: keep stt iterator valid in the list
 2023-08-04 08:02:16 +08:00
slzhou
fef091b13d fix: keep the stt iterator valid 2023-08-03 21:50:50 +08:00
shenglian zhou
b85c1ae8a1 fix: remove the core 2023-08-03 21:50:50 +08:00
shenglian zhou
5322e38dfe fix: add init add check it 2023-08-03 21:50:50 +08:00
shenglian zhou
97b15ed718 fix: delete SLDataItem if stt level files num is smaller 2023-08-03 21:50:50 +08:00
slzhou
1cb1451e41 fix: set nextIndex when get neighbouring index 2023-08-03 18:26:29 +08:00
dm chen
5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng
f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
wade zhang
68f2018246
Merge pull request #22289 from taosdata/szhou/fix-25385 
fix: keep stt iterator valid
 2023-08-02 20:22:54 +08:00
wade zhang
13c713d33b
Merge pull request #22290 from taosdata/3.0_main 
merge 3.0 into branch main
 2023-08-02 16:04:08 +08:00
Hongze Cheng
f90f0b7047 disable infinite count loop 2023-08-02 15:51:51 +08:00
Minglei Jin
cff85550f9 Merge branch '3.0' into 3.0_main 2023-08-02 14:10:45 +08:00
wade zhang
c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400 
enh(tsdb/cache/read): lazy init table map hash and entries
 2023-08-02 14:08:43 +08:00
Haojun Liao
0feffc687b fix(tsdb): check uid in multiple stt statistics blocks. 2023-08-02 12:44:45 +08:00
Minglei Jin
0e51277521 cache/reader: cleanup contiue nex row 2023-08-02 12:43:57 +08:00
Haojun Liao
2c357f1958 fix(stream): enable filter table based on table statistics. 2023-08-02 11:18:35 +08:00
Minglei Jin
7fca057a81 cache/reader: move pLastCols into single block 2023-08-02 11:10:12 +08:00
slzhou
dd8e893508 fix: keep the stt iterator valid 2023-08-02 11:02:27 +08:00
Minglei Jin
95cc540d9b cache/reader: clean uid in all loop 2023-08-02 10:48:55 +08:00
shenglian zhou
38e797b4ff fix: remove the core 2023-08-02 10:43:26 +08:00
shenglian zhou
d5ca51e94d fix: add init add check it 2023-08-02 10:43:26 +08:00
shenglian zhou
6bf95c0c4d fix: delete SLDataItem if stt level files num is smaller 2023-08-02 10:43:26 +08:00
Haojun Liao
13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Minglei Jin
ed76525c4f cache/reader: cleanup uid in signle loop 2023-08-02 10:28:13 +08:00
Minglei Jin
29b2f32821 cache reader: cleanup stt init 2023-08-02 09:49:41 +08:00
Haojun Liao
53aefa531f Merge branch '3.0' into fix/3_liaohj 2023-08-02 09:45:21 +08:00
Haojun Liao
e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Hongze Cheng
4ba4e83b5b fix: retention file corruption 2023-08-01 20:19:13 +08:00
Minglei Jin
7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin
a593e887fa cache: remove nFileset from fs state 2023-08-01 18:37:23 +08:00
Minglei Jin
7ad628417a fix mem issue: stack-use-after-scope 2023-08-01 17:57:38 +08:00
Minglei Jin
4716fc6400 cache/fs: remove fs state's tsdb handle 2023-08-01 17:49:05 +08:00
Minglei Jin
1d5532019f tsdb/merge-tree: cleanup comment 2023-08-01 17:25:15 +08:00
Minglei Jin
f72f129d41 cache/skyline: cleanup del array 2023-08-01 17:23:53 +08:00
Minglei Jin
c997662ba0 tsdb/cache: build skyline only if there's del data 2023-08-01 16:50:00 +08:00
Minglei Jin
94b9599f95 fix null pointer dereference 2023-08-01 16:39:14 +08:00
Haojun Liao
637f09359a other: merge main. 2023-08-01 16:15:34 +08:00
Minglei Jin
72ac5a4e3b tsdb/cache: use read util's uid compare functor 2023-08-01 16:08:20 +08:00
Minglei Jin
c0a0e07597 cache/read: lazy init uidList when laoding from tsdb 2023-08-01 16:02:09 +08:00
Minglei Jin
b3fae65d90 enh(tsdb/cache/read): lazy init table map hash and entries 2023-08-01 15:53:42 +08:00
Hongze Cheng
78c23f407e fix compile issue 2023-08-01 15:04:14 +08:00
Hongze Cheng
07c40943a4 fix: TD-25408 2023-08-01 15:01:06 +08:00
wade zhang
347e78ecb5
Merge pull request #22272 from taosdata/fix/TD-25466 
Fix/td 25466
 2023-08-01 14:22:24 +08:00
Hongze Cheng
1b39147496 more refact 2023-08-01 11:36:37 +08:00
Hongze Cheng
0e46041c1a fix: tsdbRetention memory leak 2023-08-01 11:21:40 +08:00
Haojun Liao
ae9745ecf2
Merge pull request #22258 from taosdata/mark/tmq-3.0 
fix:add committed & seek process logic
 2023-08-01 09:52:09 +08:00
Haojun Liao
ea875c58f2
Merge pull request #22263 from taosdata/mark/tmq-main 
fix:add committed & seek process logic
 2023-08-01 09:43:23 +08:00
Haojun Liao
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457 
check update data
 2023-07-31 22:56:05 +08:00
Haojun Liao
2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj 
fix(stream): set the correct end key of delete block.
 2023-07-31 22:55:50 +08:00
wangmm0220
68ae64cdb2 fix:add committed & seek process logic 2023-07-31 18:53:25 +08:00
wangmm0220
cddf27e8b4 fix:add committed & seek process logic 2023-07-31 18:48:50 +08:00
Haojun Liao
d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
wangmm0220
6179618b17 fix:add committed & seek process logic 2023-07-31 17:56:04 +08:00
liuyao
32b59af4b1 check update data 2023-07-31 17:32:24 +08:00