Commit graph

1735 commits

Author SHA1 Message Date
Haojun Liao
2c896012df fix(query): check status before add table uid in hash map. and do some other refactor. 2022-10-28 10:43:25 +08:00
Haojun Liao
f25387018d
Merge pull request #17724 from taosdata/fix/liao_cov
fix(query): handle the case of the single block in last files.
2022-10-28 10:25:38 +08:00
Haojun Liao
70c3825ee5 fix(query): remove invalid check. 2022-10-28 09:12:40 +08:00
Haojun Liao
4774baa635 fix(query): handle the case of the single block in last files. 2022-10-27 22:43:42 +08:00
Haojun Liao
e7b59ae56d fix(query): handle the case of the single block in last files. 2022-10-27 21:51:54 +08:00
yihaoDeng
9de0afc8ea opt mem 2022-10-27 21:22:36 +08:00
yihaoDeng
6a978be730 opt mem 2022-10-27 20:38:57 +08:00
Haojun Liao
d8102fc8d8 fix(query): fix invalid number of tables check. 2022-10-27 18:58:10 +08:00
Haojun Liao
a7ca29c627 other: merge 3.0 2022-10-27 18:04:28 +08:00
Haojun Liao
5a971dd03a fix(query): handle partition by in table scan operator with limit/offset value. 2022-10-27 16:58:32 +08:00
Shengliang Guan
8b31cd87d1
Merge pull request #17706 from taosdata/feature/stream_ly
fix(stream): read preversion data with delete many times
2022-10-27 15:05:23 +08:00
54liuyao
012dd30baa fix(stream): read preversion data with delete many times 2022-10-27 14:18:48 +08:00
Shengliang Guan
a0c5cece12
Merge pull request #17697 from taosdata/feature/stream_ly
fix(stream): read preversion data for delete
2022-10-27 14:01:08 +08:00
54liuyao
442f89783f fix(stream): read preversion data for delete 2022-10-27 10:55:32 +08:00
Minglei Jin
cb0a3ec042 fix: continue to fetch next row if deleted 2022-10-26 18:39:04 +08:00
Hongze Cheng
2afcda198b
Merge pull request #17657 from taosdata/fix/TD-19865
fix: malloc and copy binary data when inserting last & last_row
2022-10-26 11:54:41 +08:00
Minglei Jin
89d74e5016 fix: malloc and copy binary data when inserting last & last_row 2022-10-26 10:52:35 +08:00
Haojun Liao
339c93021f
Merge pull request #17654 from taosdata/fix/liao_cov
refactor: fix typo and do  some internal  refactor.
2022-10-26 10:41:00 +08:00
Haojun Liao
d06bcb2219 refactor: fix typo and do some internal refactor. 2022-10-26 09:47:11 +08:00
Minglei Jin
b52ad0f740 tsdb/cache: new separate dataf reader for last file reading 2022-10-26 08:58:38 +08:00
Minglei Jin
c84618ea3f
Merge branch '3.0' into fix/TD-19468-2 2022-10-25 17:36:56 +08:00
Haojun Liao
6acdfdd9ab refactor: do some internal refactor. 2022-10-25 16:20:51 +08:00
Haojun Liao
a87f915ebf fix(query):set correct column match info size. 2022-10-25 15:30:41 +08:00
Minglei Jin
441fe8119c Merge branch '3.0' into fix/TD-19468-2 2022-10-25 10:51:35 +08:00
Minglei Jin
89f7ad2920 fix: optimize tsdb cache loading speed 2022-10-25 10:36:30 +08:00
Haojun Liao
319cd8af85 fix(query): refactor and fix some coverity issues. 2022-10-24 15:02:17 +08:00
Haojun Liao
b06870f70f Merge branch '3.0' into fix/liao_cov 2022-10-24 14:07:59 +08:00
Haojun Liao
2f5ed16cb8 fix(query): remove redundant ts cols in cache scan. 2022-10-24 13:26:54 +08:00
Hongze Cheng
2772749e07 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/td_19618 2022-10-24 09:19:30 +08:00
Shengliang Guan
9903bbc527
Merge pull request #17577 from taosdata/fix/liao_cov
fix(query): fix coverity issues.
2022-10-23 23:12:36 +08:00
Haojun Liao
6ebf6b29bd fix(query): fix coverity issues. 2022-10-23 15:20:29 +08:00
Shengliang Guan
ed33fcb406 fix: invalid read problem 2022-10-23 08:38:03 +08:00
Minglei Jin
214df56e39 fix: return 0 usage when pTsdb is null 2022-10-23 06:54:24 +08:00
Shengliang Guan
c58a77b516 Merge remote-tracking branch 'origin/3.0' into fix/td_19618 2022-10-22 09:03:43 +08:00
Shengliang Guan
5d293869a9
Merge pull request #17553 from taosdata/fix/liao_cov
fix(query): fix coverity issues.
2022-10-22 08:14:44 +08:00
Hongze Cheng
08a7cbe22a Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/td_19618 2022-10-21 17:08:20 +08:00
wade zhang
88c52d567b
Merge pull request #17548 from taosdata/szhou/fixbugs
fix: get next row from rb tree from last files when backward scaning
2022-10-21 15:04:42 +08:00
Haojun Liao
b53cc7f3dd fix(query): fix coverity issues. 2022-10-21 14:00:46 +08:00
Shengliang Guan
05d04dcd2d Merge remote-tracking branch 'origin/3.0' into enh/TD-19461 2022-10-21 11:07:48 +08:00
slzhou
416b257b5e fix: get next row from rb tree from last files when backward scaning 2022-10-21 10:54:11 +08:00
Shengliang Guan
6c3cd3e19e test: adjust log 2022-10-21 10:39:29 +08:00
Haojun Liao
abff4fb1f2
Merge pull request #17336 from taosdata/feature/3_liaohj
other:merge 3.0, and support last query cache
2022-10-20 18:15:38 +08:00
Hongze Cheng
5714868c8c Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/td_19618 2022-10-20 13:16:33 +08:00
Haojun Liao
c41713cf21
Merge pull request #17495 from taosdata/fix/liao_cov
refactor: remove redundant codes and do some internal refactor.
2022-10-20 13:16:02 +08:00
Haojun Liao
12e81869bc fix(query): remove invalid free. 2022-10-20 11:52:30 +08:00
Haojun Liao
70adc0ea33 fix(query): fix coverity issues. 2022-10-20 11:27:33 +08:00
Hongze Cheng
d9daf76710 fix: invalid read problem 2022-10-20 10:18:28 +08:00
Hongze Cheng
446e8c5d6d fix: coverity scan problem 2022-10-20 09:36:15 +08:00
Shengliang Guan
228640af3b fix: compile error 2022-10-19 20:51:25 +08:00
Shengliang Guan
097a047b61 Merge remote-tracking branch 'origin/3.0' into FIX/TD-19593-3.0 2022-10-19 20:08:49 +08:00
Shengliang Guan
308dd56537
Merge pull request #17486 from taosdata/fix/liao_cov
refactor: remove redundant codes.
2022-10-19 19:51:59 +08:00
Minglei Jin
60b85028af fix: do not copy binary when nData is 0 2022-10-19 18:53:51 +08:00
Haojun Liao
b20e2ed5af fix(query): set correct last value. 2022-10-19 17:43:23 +08:00
Benguang Zhao
2aa7afe7fa Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 16:31:13 +08:00
Minglei Jin
6dea891571 fix: release data file reader 2022-10-19 16:07:53 +08:00
Haojun Liao
116d1451e4 fix(query): do some internal refactor. 2022-10-19 15:43:58 +08:00
Minglei Jin
640338893d tsdb/cache: handle OOM exceptions 2022-10-19 15:01:49 +08:00
Minglei Jin
ceec953498 fix: copy binary type column data out 2022-10-19 14:50:36 +08:00
Minglei Jin
60d889a0fc Merge branch 'feature/3_liaohj' of https://github.com/taosdata/TDengine into feature/3_liaohj 2022-10-19 13:59:42 +08:00
Minglei Jin
a1c18bba33 fix: cache load calculation 2022-10-19 13:58:59 +08:00
Hongze Cheng
cc455b9903 fix: coverity scan problem 2022-10-19 13:40:16 +08:00
Haojun Liao
74305814f0 fix(query): fix coverity issues. 2022-10-19 13:38:01 +08:00
Haojun Liao
f7fdeecc44
Merge branch '3.0' into feature/3_liaohj 2022-10-19 11:23:55 +08:00
Minglei Jin
467c6386ed fix: last_row array element type 2022-10-19 11:06:08 +08:00
Hongze Cheng
7aa16f8e98 more fix 2022-10-19 10:43:06 +08:00
Hongze Cheng
cebb964e31 fix more code 2022-10-19 10:33:07 +08:00
Haojun Liao
5dcd319d3b fix(query): update last_row callback function. 2022-10-19 10:07:20 +08:00
Haojun Liao
c7c99ae346 fix(query): update last_row callback function. 2022-10-19 09:33:54 +08:00
Benguang Zhao
3b0968d7f9 enh: enable the -Wformat=2 compiler option 2022-10-19 09:24:15 +08:00
Haojun Liao
d7e01b30c7 fix(query): update last_row callback function. 2022-10-18 19:13:42 +08:00
Haojun Liao
60e7f2800b fix(query): fix bug in cached last query. 2022-10-18 17:39:28 +08:00
Hongze Cheng
0706f2dea2 more code 2022-10-18 16:54:53 +08:00
Hongze Cheng
1779c17375 more code 2022-10-18 16:22:06 +08:00
Hongze Cheng
40c7fed80d more code 2022-10-18 14:00:12 +08:00
Hongze Cheng
5d51fdc663 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-18 13:50:55 +08:00
Hongze Cheng
6c1149f086 more code 2022-10-18 13:50:32 +08:00
Hongze Cheng
b7342525c7 more code 2022-10-18 13:38:26 +08:00
Haojun Liao
95dd30be57 fix(query): fix coverity issues. 2022-10-18 11:43:58 +08:00
Haojun Liao
7e1521ba0a
Merge pull request #17401 from taosdata/fix/liao_cov
fix(query): fix coverity  issues.
2022-10-17 22:45:02 +08:00
Haojun Liao
c8b180b129 fix(query): update the cached last query. 2022-10-17 19:14:06 +08:00
Minglei Jin
109d50a4cc fix: last row array form bug 2022-10-17 18:13:38 +08:00
Haojun Liao
da9df99461 fix(query): opt last query. 2022-10-17 17:59:43 +08:00
Haojun Liao
2c656a2cdc Merge branch 'feature/3_liaohj' of github.com:taosdata/tdengine into feature/3_liaohj 2022-10-17 17:22:04 +08:00
Minglei Jin
b62fa20b53 tsdb/cache: return last row as array of SLastCol 2022-10-17 17:20:32 +08:00
Haojun Liao
4639051e68 fix(query): fix coverity issues. 2022-10-17 16:03:45 +08:00
Haojun Liao
08397dc698
Merge pull request #17389 from taosdata/fix/liao_cov
fix(query): fix bug in group by tag.
2022-10-17 15:06:26 +08:00
Haojun Liao
ed9ec795eb fix(query): fix coverity issues. 2022-10-17 14:05:40 +08:00
Haojun Liao
87516ea332 fix(query): fix bug in group by tag. 2022-10-17 13:00:31 +08:00
Hongze Cheng
ef06a9d265 fix more coverity scan problem 2022-10-17 09:58:34 +08:00
Shengliang Guan
4223b43a3a
Merge pull request #17322 from taosdata/FIX/TD-19239-3.0
fix: enhance subroutines to resolve WAL inconsistency after crashing or disk full
2022-10-17 09:06:16 +08:00
Haojun Liao
bcb3d41d08 fix(query): fix coverity issues. 2022-10-16 13:46:21 +08:00
Haojun Liao
aa9c99fa53 Merge branch '3.0' into feature/3_liaohj 2022-10-16 12:50:05 +08:00
Benguang Zhao
616eb5f903 Merge branch '3.0' into FIX/TD-19239-3.0 2022-10-16 00:29:01 +08:00
Benguang Zhao
8f6a81a18c enh: indicate intentionally restarting taosd on tsdbCommit failure 2022-10-15 23:57:37 +08:00
Shengliang Guan
31e712c16b
Merge pull request #17369 from taosdata/fix/TD-19559
fix(tsdb): checksum checking shall skip page 1 when loading
2022-10-15 21:55:27 +08:00
Shengliang Guan
513db327e8
Merge pull request #17366 from taosdata/fix/TD-19250
fix: dismiss some coverity scan issues
2022-10-15 21:54:58 +08:00
Hongze Cheng
85276450a3
Merge pull request #17370 from taosdata/fix/hzcheng_coverity_scan
fix: more cv issue
2022-10-15 20:45:13 +08:00
Hongze Cheng
7e174e347e fix more issue 2022-10-15 11:20:37 +08:00
Benguang Zhao
3af05070cf fix: assert on availability of inUse SVBufPool for vnode 2022-10-14 22:58:56 +08:00
dapan1121
0df311a78f
Merge pull request #17264 from taosdata/refact/query_opt
refactor:do some internal refactor to optimize the query performance.
2022-10-14 19:51:46 +08:00
Minglei Jin
b8dfe8707f fix(tsdb): checksum checking shall skip page 1 when loading 2022-10-14 18:58:07 +08:00
Minglei Jin
3f46bd64b9 fix: dismiss some coverity scan issues 2022-10-14 17:47:21 +08:00
Minglei Jin
977fc4b15c fix(tsdb/cache): release lock when table's empty 2022-10-14 15:28:19 +08:00
Hongze Cheng
2268a1e94e fix some converity scan problem 2022-10-14 13:34:25 +08:00
Minglei Jin
3a0ea21342 fix: get SLastCol from array instead of SColVal 2022-10-13 19:54:25 +08:00
Shengliang Guan
5a5cdb318c
Merge pull request #17342 from taosdata/fix/TD-19468
fix: close merge tree for each file set
2022-10-13 19:12:33 +08:00
Minglei Jin
66962bdddc fix: close merge tree for each file set 2022-10-13 18:12:26 +08:00
Hongze Cheng
5f010843a6 more code format 2022-10-13 16:58:43 +08:00
Haojun Liao
18740e7b48 other:merge 3.0, and support last query cache 2022-10-13 15:35:51 +08:00
Haojun Liao
f5f0a7026f other: merge 3.0 2022-10-13 14:20:51 +08:00
Haojun Liao
ab5bff4f37
Merge branch '3.0' into feature/3_liaohj 2022-10-13 14:06:26 +08:00
Haojun Liao
3d9e284913 other:merge 3.0 2022-10-13 12:01:47 +08:00
Haojun Liao
fbd3aac007 fix(query):set the correct active block index and add some logs. 2022-10-13 11:59:14 +08:00
Hongze Cheng
6ed0634fb7 format more code 2022-10-13 11:56:16 +08:00
Haojun Liao
d3b37ef294 other:merge 3.0 2022-10-11 22:56:54 +08:00
Haojun Liao
cee7185450 fix(query): update the copy function. 2022-10-11 18:02:46 +08:00
Hongze Cheng
dfc91a38b0 more code 2022-10-10 21:29:36 +08:00
Shengliang Guan
f0a7430238
Merge pull request #17263 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-10-10 16:13:27 +08:00
Haojun Liao
7c3ddc4920 other:merge 3.0 2022-10-10 15:35:38 +08:00
Haojun Liao
68842b9c64 refactor: do some internal refactor. 2022-10-10 14:55:58 +08:00
Minglei Jin
997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Haojun Liao
a356b4eb7c fix(query): fix the last block search error for ordinary table. 2022-10-09 18:55:01 +08:00
Haojun Liao
5402f6bc26 enh(query): opt query perf when handling the query of last files. 2022-10-09 15:25:42 +08:00
Haojun Liao
c5e094efd0 enh(query): optimize the perf for ordinary table query with data in last file. 2022-10-09 14:34:10 +08:00
Haojun Liao
fac464792d other:merge 3.0 2022-09-30 17:54:03 +08:00
Haojun Liao
7674fa972c
Merge pull request #17184 from taosdata/feature/3_liaohj
fix(query): fix memory leak in last_row query
2022-09-30 17:51:45 +08:00
Haojun Liao
877c707ce6 fix(query): fix memory leak in last_row query 2022-09-30 17:10:55 +08:00
Shengliang Guan
b77a62dcd8
Merge pull request #17183 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 16:46:07 +08:00
Hongze Cheng
856c990fbc
Merge pull request #17102 from taosdata/feat/stream_compression
feat: stream compression
2022-09-30 16:17:19 +08:00
Haojun Liao
4b1e8e0cec fix(query): fix memory leak. 2022-09-30 16:02:28 +08:00
Haojun Liao
6faf1af5f5 fix(query): handle the block read case. 2022-09-30 14:44:42 +08:00
Hongze Cheng
7754471aaa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-30 13:50:01 +08:00
Haojun Liao
f8a84a1d19 other:merge 3.0 2022-09-30 13:47:21 +08:00
Haojun Liao
1f57a5a1cc
Merge pull request #17172 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 13:45:01 +08:00
Haojun Liao
c9286fed25 fix(query): fix memory leak. 2022-09-30 13:03:25 +08:00
Hongze Cheng
145abcb17f more 2022-09-30 10:52:17 +08:00
Hongze Cheng
bdeb1ebcc5 compare 2022-09-29 17:06:18 +08:00
Hongze Cheng
cb554920aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 13:23:20 +08:00
Hongze Cheng
768ec8942a fix code 2022-09-29 13:23:12 +08:00
dapan1121
95b6d3f67f
Merge pull request #17132 from taosdata/fix/TD-19310
fix: fix rows missed in query result issue
2022-09-29 11:41:52 +08:00
Hongze Cheng
f12449b1b8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-29 10:20:36 +08:00
Shengliang Guan
44b8d659ba
Merge pull request #17130 from taosdata/FIX/TD-19260-3.0
enh: improve error handling in syncNodeOpen instead of using assert, with allocated resources cleaned up properly
2022-09-29 09:23:28 +08:00
dapan1121
45fb658cec fix: fix rows missed in query result issue 2022-09-28 19:06:43 +08:00
Haojun Liao
5a2c583c32 other:merge 3.0 2022-09-28 18:00:04 +08:00
Hongze Cheng
12371d344b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-28 17:49:16 +08:00
Shengliang Guan
53bfdf7bbb
Merge pull request #17117 from taosdata/revert-17106-feature/TD-18581-D
Revert "enh(tsdb): data migrate should not block data r/w and commit"
2022-09-28 17:43:21 +08:00
Benguang Zhao
4b4f7a44f4 fix: resolve memory leak in vnodeOpen when vnodeSyncOpen failure 2022-09-28 17:40:10 +08:00
Haojun Liao
71e3993185
Merge pull request #17114 from taosdata/feature/3_liaohj
refactor(query): do some internal refactor.
2022-09-28 17:36:01 +08:00
Cary Xu
1fe66cb846
Revert "enh(tsdb): data migrate should not block data r/w and commit" 2022-09-28 15:50:29 +08:00
Hongze Cheng
a4d426aa13 more fix 2022-09-28 13:39:48 +08:00