Commit graph

219 commits

Author SHA1 Message Date
Xiaoyu Wang
933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Minglei Jin
3ac5b35f4b fix(tsdb/cache): skip schema updating for non ts row 2023-04-11 18:57:11 +08:00
Xiaoyu Wang
e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
dapan1121
5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Minglei Jin
0bf98096c9 fix(tsdb/cache): init isLast once for each fileset 2023-03-22 10:57:27 +08:00
Minglei Jin
cb93ac2613 enh(tsdb/cache): make merge tree next one less 2023-03-22 10:50:34 +08:00
Minglei Jin
0b31aac2c5 enh(tsdb/cache): skip data block with merge tree 2023-03-22 10:19:58 +08:00
Minglei Jin
3a5542bbbc fix(tsdb/cache): update nCols of merge tree to avoid assert failed 2023-03-19 10:19:49 +08:00
Minglei Jin
ca115b1c87 fix(tsdb/cache): break loop to return current row 2023-03-17 11:41:17 +08:00
Minglei Jin
a8d146c512 ehn(tsdb/cache): skip invalid row or data block directly with merge tree 2023-03-17 10:22:36 +08:00
Minglei Jin
b1949b5584 fix(tsdb/cache): skip remaining rows in current data block 2023-03-16 14:11:34 +08:00
Minglei Jin
6e0343fc08 enh(tsdb/cache): load necessary columns only 2023-03-16 11:18:36 +08:00
Minglei Jin
04d501d64a fix: destroy aColArray anyway 2023-03-15 17:41:29 +08:00
Minglei Jin
f1414355e3 tsdb/cache: skip invalid datablock directly when traversing fs with last 2023-03-15 16:24:36 +08:00
Xiaoyu Wang
ca39dfcf2d feat: show vgroup display num of cache tables 2023-03-13 17:21:32 +08:00
Xiaoyu Wang
62377619ba enh: optimizing stt file reading in last query 2023-03-13 15:05:24 +08:00
Xiaoyu Wang
25778754e2 fix: last redundant read stt file 2023-03-12 22:36:26 +08:00
Xiaoyu Wang
45e38d258c fix: last redundant read stt file 2023-03-12 20:40:17 +08:00
Xiaoyu Wang
11e55f028b fix: error in last cache handle deleted data 2023-03-10 17:49:27 +08:00
Xiaoyu Wang
4e4f7de0ab enh: optimize last/last_row cost when the cache was first loaded 2023-03-10 12:00:17 +08:00
Xiaoyu Wang
47417e003e enh: optimize last/last_row cost when the cache was first loaded 2023-03-09 18:54:15 +08:00
Xiaoyu Wang
0dc34018b6 fix: insert data crash after empty table last cache 2023-03-08 10:06:48 +08:00
Xiaoyu Wang
163224f4e2 fix: taosd crash when modify the schema and query last_row 2023-03-07 19:42:05 +08:00
Xiaoyu Wang
ab86f6abee fix: taosd crash when modify the schema and query last_row 2023-03-07 18:15:17 +08:00
Xiaoyu Wang
8e6534d9f3 fix: insert data crash after empty table last_row cache 2023-03-07 16:06:56 +08:00
Xiaoyu Wang
7649ede074 fix: last cache read problem after schema change 2023-03-02 19:45:21 +08:00
Xiaoyu Wang
7deee1c4c7 fix: last cache read problem after schema change 2023-03-02 18:22:42 +08:00
Xiaoyu Wang
d06dedd5cc
Merge pull request #20103 from taosdata/fix/TD-22668
fix: coverity scan issues
2023-02-24 10:53:49 +08:00
Minglei Jin
6929f74559 fix(tsdb/cache): check the return result of data block creating 2023-02-22 14:48:57 +08:00
Minglei Jin
724e7bc3a1 fix(tsdb/cache): use state's tsdb instead of readers 2023-02-21 18:23:18 +08:00
Xiaoyu Wang
c597de099f merge main 2023-02-20 13:41:27 +08:00
Minglei Jin
de9cafb04e fix(tsdb/cache): disable sharding for block index cache 2023-02-16 15:50:19 +08:00
Minglei Jin
56f1afb19c fix(tsdb/cache): use block index cache with last/last_row 2023-02-16 09:28:35 +08:00
Minglei Jin
8ec5df8d7d fix(tsdb/cache): Not free zero length var data 2023-02-14 10:20:55 +08:00
Minglei Jin
ee9c59dc77 fix(tsdb/cache): invalidate cache entry if schema changed 2023-02-13 19:30:48 +08:00
Xiaoyu Wang
09925437e3 merge main 2023-02-08 09:51:52 +08:00
Minglei Jin
a6d52aed4f fix(tsdb/cache): use 5M cache for block index instead of 1M 2023-02-06 14:18:49 +08:00
Minglei Jin
023b8377fb enh(tsdb/cache): new block index cache for querying 2023-02-06 14:12:57 +08:00
Shengliang Guan
398161eb5f Merge branch 'main' into merge/mainto3.0_0108 2023-01-09 10:00:53 +08:00
Benguang Zhao
137e7d009d fix: update nextRowIterGet of tsdbCache 2022-12-26 20:52:42 +08:00
Haojun Liao
723efba79b
Merge branch '3.0' into refact/submit_req 2022-12-26 13:25:25 +08:00
Haojun Liao
224f5a72c2 refactor: do some internal refactor. 2022-12-23 17:45:12 +08:00
Haojun Liao
48f7fc5c3d
Merge branch '3.0' into refact/submit_req 2022-12-12 18:11:17 +08:00
Minglei Jin
c22fa53bc4 fix: release lock and memory in exceptional cases 2022-12-09 10:22:43 +08:00
Haojun Liao
27ebafdbaa other: merge 3.0 2022-12-09 10:19:05 +08:00
Minglei Jin
1a066d19f7 fix: dismiss coverity issues 2022-12-08 10:55:08 +08:00
Shengliang Guan
6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan
f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Minglei Jin
1e23f80597 tsdb/cache: use empty array as negative entry to empty table's last/lr 2022-12-07 14:34:38 +08:00
Hongze Cheng
899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
Minglei Jin
55fb892e70 fix(tsdb/cache): use lru erase to invalidate cache entries 2022-12-02 17:53:16 +08:00
Hongze Cheng
6dcdafa486 more code 2022-12-01 17:00:33 +08:00
Hongze Cheng
73f8dc6a5b more code 2022-12-01 14:24:10 +08:00
Hongze Cheng
f5270f6a0c adjust api 2022-11-30 10:30:03 +08:00
Hongze Cheng
0f8016995c more code 2022-11-28 13:41:06 +08:00
Haojun Liao
0948216ca9 fix(query): fix dead lock. 2022-11-26 21:13:34 +08:00
stephenkgu
8d6f129154 fix: skip empty data in delete file 2022-11-10 08:14:21 +08:00
Minglei Jin
a5052eb2d5 fix: remove last stt load info resetting from fs iterator 2022-11-01 17:29:18 +08:00
Minglei Jin
cb0a3ec042 fix: continue to fetch next row if deleted 2022-10-26 18:39:04 +08:00
Minglei Jin
89d74e5016 fix: malloc and copy binary data when inserting last & last_row 2022-10-26 10:52:35 +08:00
Minglei Jin
b52ad0f740 tsdb/cache: new separate dataf reader for last file reading 2022-10-26 08:58:38 +08:00
Minglei Jin
441fe8119c Merge branch '3.0' into fix/TD-19468-2 2022-10-25 10:51:35 +08:00
Minglei Jin
89f7ad2920 fix: optimize tsdb cache loading speed 2022-10-25 10:36:30 +08:00
Minglei Jin
214df56e39 fix: return 0 usage when pTsdb is null 2022-10-23 06:54:24 +08:00
Minglei Jin
60b85028af fix: do not copy binary when nData is 0 2022-10-19 18:53:51 +08:00
Minglei Jin
6dea891571 fix: release data file reader 2022-10-19 16:07:53 +08:00
Minglei Jin
640338893d tsdb/cache: handle OOM exceptions 2022-10-19 15:01:49 +08:00
Minglei Jin
ceec953498 fix: copy binary type column data out 2022-10-19 14:50:36 +08:00
Minglei Jin
a1c18bba33 fix: cache load calculation 2022-10-19 13:58:59 +08:00
Minglei Jin
467c6386ed fix: last_row array element type 2022-10-19 11:06:08 +08:00
Minglei Jin
109d50a4cc fix: last row array form bug 2022-10-17 18:13:38 +08:00
Haojun Liao
da9df99461 fix(query): opt last query. 2022-10-17 17:59:43 +08:00
Haojun Liao
2c656a2cdc Merge branch 'feature/3_liaohj' of github.com:taosdata/tdengine into feature/3_liaohj 2022-10-17 17:22:04 +08:00
Minglei Jin
b62fa20b53 tsdb/cache: return last row as array of SLastCol 2022-10-17 17:20:32 +08:00
Haojun Liao
aa9c99fa53 Merge branch '3.0' into feature/3_liaohj 2022-10-16 12:50:05 +08:00
Minglei Jin
3f46bd64b9 fix: dismiss some coverity scan issues 2022-10-14 17:47:21 +08:00
Minglei Jin
977fc4b15c fix(tsdb/cache): release lock when table's empty 2022-10-14 15:28:19 +08:00
Minglei Jin
3a0ea21342 fix: get SLastCol from array instead of SColVal 2022-10-13 19:54:25 +08:00
Minglei Jin
66962bdddc fix: close merge tree for each file set 2022-10-13 18:12:26 +08:00
Minglei Jin
997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Haojun Liao
7674fa972c
Merge pull request #17184 from taosdata/feature/3_liaohj
fix(query): fix memory leak in last_row query
2022-09-30 17:51:45 +08:00
Haojun Liao
877c707ce6 fix(query): fix memory leak in last_row query 2022-09-30 17:10:55 +08:00
Shengliang Guan
b77a62dcd8
Merge pull request #17183 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-09-30 16:46:07 +08:00
Haojun Liao
4b1e8e0cec fix(query): fix memory leak. 2022-09-30 16:02:28 +08:00
Hongze Cheng
12371d344b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-28 17:49:16 +08:00
Haojun Liao
14412f2811 refactor(query): do some internal refactor. 2022-09-28 11:16:52 +08:00
Hongze Cheng
e17c65fd82 Merge branch 'enh/load_by_column' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-27 16:22:42 +08:00
Haojun Liao
cbe91fd4c3 fix(query): initialize the blockdata before load last block. 2022-09-27 13:48:53 +08:00
Hongze Cheng
4bfdfe89a5 adjust api 2022-09-27 11:02:04 +08:00
Hongze Cheng
1a0dcddd62 Merge branch 'enh/cv_optimize' of https://github.com/taosdata/TDengine into feat/stream_compression 2022-09-23 18:59:13 +08:00
Hongze Cheng
f0fea204f2 enh: col value optimize 2022-09-23 18:55:27 +08:00
Hongze Cheng
f8619dfbe8 refact code for further refact 2022-09-21 15:28:04 +08:00
Haojun Liao
5ba41111b4 refactor: add some logs. 2022-09-15 16:17:39 +08:00
Hongze Cheng
bb0b1fda91 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_new_snapshot 2022-09-08 15:16:22 +08:00
Haojun Liao
0b6070e518 refactor(query): add some logs. 2022-09-08 09:45:11 +08:00
Hongze Cheng
0e4b0459bd more code 2022-09-07 17:06:42 +08:00
Haojun Liao
a5933fc682 fix(query): optimize last block read performance. 2022-09-06 15:25:54 +08:00
Haojun Liao
a6cece10df fix(query): fix the invalid the check of last file blocks. 2022-09-05 18:57:46 +08:00
Hongze Cheng
0eb29455ae refact code 2022-09-02 11:19:34 +08:00
Hongze Cheng
aec4297eb4 refact code 2022-09-02 11:16:23 +08:00