Commit graph

2440 commits

Author SHA1 Message Date
Hongze Cheng
004a6571b0 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-05 09:31:54 +00:00
Hongze Cheng
08a7d9d38f fix ci coredump 2022-07-05 09:31:51 +00:00
Haojun Liao
c9ffc42ddb fix(query): set initial value for neighbor block check. 2022-07-05 17:02:21 +08:00
Cary Xu
8b1506b6ec Merge branch 'feat/tsdb_refact' of github.com:taosdata/TDengine into feat/tsdb_refact 2022-07-05 14:57:16 +08:00
Cary Xu
6ef9f0c9e9 fix: rsma version adjust 2022-07-05 14:57:01 +08:00
Haojun Liao
5b20f00383 refactor: do some internal refactor. 2022-07-05 14:38:45 +08:00
Haojun Liao
3bae30412c refactor: do some internal refactor. 2022-07-05 13:57:07 +08:00
Hongze Cheng
1145aabb94 adjust some apis 2022-07-05 03:20:25 +00:00
Hongze Cheng
b8899c82fe add some read del data code 2022-07-05 03:08:10 +00:00
Minglei Jin
de85dea5e2 tsdbUtil: fix cmpr functions 2022-07-05 10:58:43 +08:00
Haojun Liao
6bfe5df94a other: merge 3.0 2022-07-05 09:47:39 +08:00
Haojun Liao
c7559a81ca refactor: do some internal refactor. 2022-07-04 23:28:27 +08:00
Cary Xu
b6613b5cf2 test: add rsma persistence and recovery case 2022-07-04 20:26:31 +08:00
yihaoDeng
b1ef7071f0 fix: invalid read/write 2022-07-04 20:03:20 +08:00
Hongze Cheng
27b719febd refact some code 2022-07-04 11:24:54 +00:00
Minglei Jin
a4cfb51b99 tsdbReaderWriter: fix windows compiling issue 2022-07-04 17:03:53 +08:00
Minglei Jin
244dcbed5d Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 16:58:59 +08:00
Minglei Jin
9aa5ee6ccf tsdbCache: fix row duplication 2022-07-04 16:58:42 +08:00
yihaoDeng
ba72ce2b8e Merge branch 'dev' into idx 2022-07-04 16:39:28 +08:00
wangmm0220
a558672622 fix:merge from 3.0 2022-07-04 16:36:18 +08:00
wangmm0220
36b49b5028 fix:<TD-16840> meta ttl index core if insert with benchmark 2022-07-04 16:33:54 +08:00
Hongze Cheng
de60ec37b6 fix CI bug 2022-07-04 08:26:16 +00:00
yihaoDeng
bd77e5b107 refactor index 2022-07-04 16:01:45 +08:00
Minghao Li
6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li
0c1a46c26e refactor(sync): add sync strategy 2022-07-04 15:29:55 +08:00
Hongze Cheng
40d34bf894 fix a bug 2022-07-04 07:01:54 +00:00
Minghao Li
7a3e9c9a57 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-07-04 14:55:46 +08:00
Minghao Li
ded4616074 refactor(sync): add sync strategy 2022-07-04 14:55:26 +08:00
Minglei Jin
8d00f1139a tsdbRead: fix None display to NULL instead of 0 2022-07-04 14:46:00 +08:00
Minghao Li
a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Haojun Liao
16d18b8046 refactor: do some internal refactor. 2022-07-04 14:10:29 +08:00
Cary Xu
ac62159bd2 enh: code and test case optimization 2022-07-04 14:01:58 +08:00
Hongze Cheng
af1b6f997f Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 05:21:08 +00:00
Hongze Cheng
38ca993452 make merge compile 2022-07-04 05:21:02 +00:00
Minglei Jin
a1da4ebb0b Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 11:45:19 +08:00
Minglei Jin
253291a146 tsdbCache: destroy del index array 2022-07-04 11:43:23 +08:00
Hongze Cheng
ddb198de23 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 03:42:50 +00:00
Hongze Cheng
169a66642d Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 03:01:24 +00:00
Hongze Cheng
b1466ad79c make sma work 2022-07-04 03:01:19 +00:00
Minglei Jin
f34e43d7b8 tsdbCache: new clearNextRowFS to cleanup fs iter 2022-07-04 11:00:11 +08:00
Haojun Liao
a7cbb93a38 refactor: do some internal refactor. 2022-07-03 23:00:12 +08:00
Cary Xu
daaf9d90f2 fix: no iterate hash if has no elements 2022-07-03 22:51:56 +08:00
Cary Xu
e926b914d1 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-03 20:39:13 +08:00
Cary Xu
c41364d5cd refactor: rsma commit and recovery 2022-07-03 20:38:54 +08:00
Haojun Liao
ba8ab92632 refactor: do some internal refactor. 2022-07-02 23:37:31 +08:00
Haojun Liao
42d635a73d refactor: do some internal refactor. 2022-07-02 20:39:23 +08:00
Liu Jicong
31bbef82d1 fix(tmq): seek snapshot offset 2022-07-02 20:18:40 +08:00
Cary Xu
5b1f3dc5ab enh: revert the gForceCommit 2022-07-02 18:59:02 +08:00
Cary Xu
8b8d454eb5 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-02 18:52:33 +08:00
Cary Xu
0e9a22ffc8 refactor: rsma commit and recovery 2022-07-02 18:52:15 +08:00
Hongze Cheng
529394a011 more work 2022-07-02 10:04:51 +00:00
Hongze Cheng
62519ae4bd more work 2022-07-02 09:52:21 +00:00
afwerar
b9a1c6744c os: add Mac compile support 2022-07-02 17:40:23 +08:00
Cary Xu
6f11d625b0 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-02 16:05:24 +08:00
Hongze Cheng
279b59f868 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-02 07:25:10 +00:00
Hongze Cheng
1acbb50f24 finish read block sma api 2022-07-02 07:25:07 +00:00
Haojun Liao
a0e38fc703 refactor: do some internal refactor. 2022-07-02 15:22:49 +08:00
Cary Xu
a8a0aa9223 refactor: rsma commit and restore 2022-07-02 15:17:41 +08:00
Haojun Liao
42d0af5cf7 refactor: do some internal refactor. 2022-07-02 14:17:27 +08:00
Shengliang Guan
f249bae82d Merge remote-tracking branch 'origin/3.0' into fix/tsim 2022-07-02 14:14:01 +08:00
Liu Jicong
06514e13df
Merge pull request #14454 from taosdata/feature/stream
feat(stream): support ignore expired flag
2022-07-02 13:20:58 +08:00
Haojun Liao
99fb3c678c refactor: do some internal refactor. 2022-07-02 12:05:03 +08:00
Shengliang Guan
0c510fcc8c fix: drop db has stream exist 2022-07-02 11:55:59 +08:00
Hongze Cheng
98ed6ce33f Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-02 03:43:06 +00:00
Hongze Cheng
f1804a86cf fix some problem 2022-07-02 03:43:03 +00:00
Minglei Jin
47f31a09a6 tsdbCache/last: fix block data clear 2022-07-02 11:40:42 +08:00
Hongze Cheng
ac91127b03 fix coredump 2022-07-02 03:06:58 +00:00
Liu Jicong
4a2b266612 feat(stream): support ignore expired flag 2022-07-02 10:59:29 +08:00
Hongze Cheng
7d50bfcb0d more code 2022-07-01 15:10:46 +00:00
Cary Xu
0467c0db93 Merge branch '3.0' of github.com:taosdata/TDengine into 3.0 2022-07-01 20:55:10 +08:00
Cary Xu
1aa45f73f4 feat: rsma recovery 2022-07-01 20:54:57 +08:00
Minglei Jin
36fbf6d7cb tsdbCache: free tmp ppRow 2022-07-01 17:19:01 +08:00
Li Minghao
e7729ee3a3
Merge pull request #14430 from taosdata/feature/3.0_mhli
refactor(sync): add snapshot2 interface
2022-07-01 16:22:16 +08:00
Minglei Jin
dd537af153 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-01 16:16:13 +08:00
Minglei Jin
ae2514efca tsdbCache/last: fix last loading crash issues 2022-07-01 16:15:29 +08:00
Haojun Liao
34e4980a51 refactor(query): do some internal refactor. 2022-07-01 15:19:02 +08:00
Minghao Li
0ffc6c46f3 refactor(sync): add snapshot2 interface 2022-07-01 14:47:12 +08:00
Liu Jicong
269b33c02d Merge branch '3.0' into feature/stream 2022-07-01 14:39:52 +08:00
Liu Jicong
52d09b4173 refactor(wal) 2022-07-01 14:39:21 +08:00
Minglei Jin
e3bb10218a tsdbCache/insert: fix row merging from mem 2022-07-01 11:15:22 +08:00
Liu Jicong
98d2f42640
Merge pull request #14415 from taosdata/feature/stream
feat(wal): add api to check log existance
2022-07-01 11:00:26 +08:00
Minglei Jin
e5944b08fb tsdbCache: new dup parameter to insert last row 2022-07-01 10:23:32 +08:00
Liu Jicong
7a65589525 feat(wal): add api to check log existance 2022-07-01 10:15:05 +08:00
Haojun Liao
deb81301e8 Merge remote-tracking branch 'origin/feat/tsdb_refact' into feat/tsdb_refact 2022-06-30 23:38:56 +08:00
Haojun Liao
0db8d77a70 refactor: do some internal refactor. 2022-06-30 23:38:18 +08:00
Minglei Jin
208dee8edc tsdb/cache: add insert last interface 2022-06-30 21:07:09 +08:00
Minglei Jin
110e02c44e tsdbCache: fix insert last 2022-06-30 21:02:09 +08:00
Minglei Jin
107e871cb5 tsdbCache/cleanup: remove commented code block 2022-06-30 20:47:03 +08:00
Minglei Jin
caf6e8439f tsdbCache: remove deprecated & bugged get last row implementation 2022-06-30 20:44:52 +08:00
Liu Jicong
c40c22c386
Merge pull request #14401 from taosdata/feature/stream
fix(tmq): reset window
2022-06-30 20:21:26 +08:00
Liu Jicong
4f107908db fix(tmq): reset window 2022-06-30 19:51:48 +08:00
Cary Xu
8cf9f9c71a
Merge pull request #14390 from taosdata/feature/TD-11274-3.0
refactor: assign the committed version
2022-06-30 18:52:14 +08:00
dapan1121
068924cc62
Merge pull request #14385 from taosdata/feature/queryredirect
feat: support query redirect
2022-06-30 18:03:17 +08:00
Hongze Cheng
0d77d034e5 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-30 09:56:36 +00:00
Hongze Cheng
cc181e0bc2 refact 2022-06-30 09:56:34 +00:00
Liu Jicong
d8da0c0e70
Merge pull request #14386 from taosdata/feature/stream
feat(tmq): add snapshot test
2022-06-30 17:51:02 +08:00
Liu Jicong
94f07836d6 fix(tmq): set scan rsp offset correctly 2022-06-30 17:25:19 +08:00
Liu Jicong
ca1c961f9c fix(tmq): set last scan status 2022-06-30 16:40:17 +08:00
Minglei Jin
7a08c16592 tsdbCache/cleanup: remove unused code 2022-06-30 16:24:35 +08:00
Cary Xu
7c3f43d6d5 refactor: tsma logic optimization 2022-06-30 16:20:43 +08:00
Minglei Jin
afaf65b0b7 tsdbCache: remove non-H version of tsdbCacheGetLast 2022-06-30 16:16:01 +08:00
Minglei Jin
1b4cfa64c3 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-30 16:11:08 +08:00
Minglei Jin
a730764ad1 tsdbCache: fix insert last row refs 2022-06-30 16:10:30 +08:00
Hongze Cheng
1abc591137 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-30 08:01:50 +00:00
Hongze Cheng
dd5f82524a more work 2022-06-30 08:01:48 +00:00
Liu Jicong
8dece648e3 feat(tmq): enable withTbName config for snapshot 2022-06-30 15:38:27 +08:00
Cary Xu
3a159de7e2 refactor: assign the committed version 2022-06-30 15:28:03 +08:00
Haojun Liao
d377a89afd refactor: do some internal rafactor. 2022-06-30 15:17:04 +08:00
Hongze Cheng
25ce3a951f fix file corrupted 2022-06-30 07:00:24 +00:00
Haojun Liao
0758751b0c refactor: do some internal refactor. 2022-06-30 14:50:59 +08:00
Hongze Cheng
0e6760702e fix file corrupt 2022-06-30 06:47:47 +00:00
Hongze Cheng
13d3657269 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-30 06:44:47 +00:00
Hongze Cheng
bcced160d3 refact more 2022-06-30 06:44:44 +00:00
Liu Jicong
4695dc2dae feat(tmq): add snapshot test 2022-06-30 14:41:50 +08:00
Minglei Jin
669c985572 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-30 14:40:39 +08:00
Minglei Jin
1c868f7b2a tsdbCache: update tsdbReadBlockIdx interface usings 2022-06-30 14:39:50 +08:00
Hongze Cheng
60693e031f refact code 2022-06-30 06:35:50 +00:00
dapan1121
c28c77a099 Merge branch '3.0' into feature/queryredirect 2022-06-30 14:35:15 +08:00
Minglei Jin
ceaa37e430 tsdbCache: comment tsdbReadBlockIdx out for compiling 2022-06-30 14:12:20 +08:00
Hongze Cheng
319e745dd5 more work 2022-06-30 06:02:47 +00:00
Cary Xu
7e3753d6ac Merge branch '3.0' into feature/TD-11274-3.0 2022-06-30 11:18:31 +08:00
Cary Xu
d53e1982ad refactor: tref used for rsma fetch task 2022-06-30 11:18:21 +08:00
yihaoDeng
e389dcedc8 add query epset 2022-06-30 10:30:36 +08:00
Liu Jicong
8ac13a1234
Merge pull request #14374 from taosdata/feature/stream
feat(tmq): offset support snapshot
2022-06-29 23:54:22 +08:00
Liu Jicong
94c3eb29d2 fix(tmq): rsp error offset 2022-06-29 23:25:04 +08:00
Liu Jicong
e74187248b fix(tmq): offset 2022-06-29 22:29:02 +08:00
Cary Xu
6600c4725e refactor: code optimization 2022-06-29 21:35:04 +08:00
Liu Jicong
0f0fe6276a merge from 3.0 2022-06-29 21:33:10 +08:00
Cary Xu
79def727b5 Merge branch '3.0' into feature/TD-11274-3.0 2022-06-29 21:33:10 +08:00
Cary Xu
efb2cd27c7 refactor: add tref to solve the timer not stopped problem 2022-06-29 21:32:06 +08:00
Liu Jicong
c2955a807b feat(tmq): offset support snapshot 2022-06-29 21:04:51 +08:00
Hongze Cheng
1d88e84d10 add an API 2022-06-29 12:37:16 +00:00
Haojun Liao
f610e2c213 Merge remote-tracking branch 'origin/feat/tsdb_refact' into feat/tsdb_refact 2022-06-29 20:25:17 +08:00
Haojun Liao
c5951374d4 refactor: do internal refactor. 2022-06-29 20:25:03 +08:00
Minglei Jin
703e876b4c tsdbCache: remove deprecated last row API 2022-06-29 20:03:27 +08:00
Hongze Cheng
64460a95b0 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-29 10:37:39 +00:00
Hongze Cheng
aefc151c03 fix some code 2022-06-29 10:37:35 +00:00
Minglei Jin
5e793c2f3f tsdbCacheRead: use new H version api of last_row 2022-06-29 18:10:25 +08:00
Hongze Cheng
ac7f5190aa Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-29 10:05:25 +00:00
Hongze Cheng
ed69d8ee9f more work 2022-06-29 10:05:21 +00:00
Minglei Jin
ffbe35d67d Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-29 17:42:19 +08:00
Minglei Jin
8cd3bffb36 tsdbCache/delete: refine tsdbCacheDelete API 2022-06-29 17:41:06 +08:00
Hongze Cheng
2a6be2bc8a do commit 2022-06-29 09:40:33 +00:00
Hongze Cheng
ddb6745bd9 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-29 09:34:08 +00:00
Hongze Cheng
843ef87574 fix file corrput 2022-06-29 09:34:04 +00:00
Minglei Jin
8f223eec91 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-06-29 17:30:28 +08:00
Minglei Jin
847016aa21 tsdbCache: new H version api for last/last_row getting 2022-06-29 17:29:49 +08:00
Yihao Deng
2001be5996
Merge branch '3.0' into enh/stopquery 2022-06-29 17:24:52 +08:00
dapan1121
914e06e8cb feat: query redirect 2022-06-29 17:15:08 +08:00
Haojun Liao
3a566d5e5e refactor(query): do some internal refactor. 2022-06-29 17:14:00 +08:00