Commit graph

10243 commits

Author SHA1 Message Date
Jinqing Kuang
513ccaaad8 fix(query)[TD-33008]. fix error handling in tsdbCacheRead
Fix an issue that a freed null pointer was accessed during error
handling in tsdbCacheRead, which would cause a crash.
2024-11-25 15:11:53 +08:00
Jinqing Kuang
7bbda0c92a fix(query)[TD-33008]. fix error handling in tsdbCacheRead
Fix an issue that a freed null pointer was accessed during error
handling in tsdbCacheRead, which would cause a crash.
2024-11-25 15:09:11 +08:00
Jinqing Kuang
ab7badb0c0 fix(query)[TD-33006]. resolve wild pointer release issue in tsdbCreateReader
Initialize pointer member variables in tsdbCreateReader to prevent
random memory errors. It addresses a bug where uninitialized pointers
are freed during error cleanup.
2024-11-25 15:01:49 +08:00
Jinqing Kuang
fbc77d1e71 fix(query)[TD-33006]. resolve wild pointer release issue in tsdbCreateReader
Initialize pointer member variables in tsdbCreateReader to prevent
random memory errors. It addresses a bug where uninitialized pointers
are freed during error cleanup.
2024-11-25 14:58:42 +08:00
yihaoDeng
97e08abe8c support update multi tag 2024-11-25 10:55:28 +08:00
yihaoDeng
3027e377fa support update multi tag 2024-11-23 22:18:30 +08:00
Haojun Liao
d397c9a9b7 fix(stream): remove failed task in hash table and array list. 2024-11-22 19:22:37 +08:00
yihaoDeng
407eeb6620 Unable to 2024-11-22 14:43:11 +08:00
Shengliang Guan
ba15fb0644 Merge branch '3.0' into merge/mainto3.0 2024-11-21 11:04:36 +08:00
Shengliang Guan
cfa7d275f2 Merge branch 'main' into merge/mainto3.0 2024-11-21 11:00:00 +08:00
Shengliang Guan
e8d663809d
Merge pull request #28756 from taosdata/fix/main/tsbs_perf_optimization
fix tsbs perf issue
2024-11-21 10:40:47 +08:00
dapan1121
2738d5dd9c fix: code merge issue 2024-11-21 10:30:16 +08:00
dapan1121
164fa67db5 Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-11-21 10:23:57 +08:00
Minglei Jin
4113921448 Merge branch '3.0' into fix/TS-4937-2 2024-11-20 18:41:24 +08:00
Minglei Jin
7947b94b03 tsdb/commit: update lru from imem 2024-11-20 18:40:49 +08:00
dmchen
a7fdabb6d7 ehn/vnode-open-log 2024-11-20 17:27:35 +08:00
wangjiaming0909
9314dfb80c fix not setting step in tsdbread 2024-11-20 14:29:27 +08:00
Minglei Jin
ffab4e8886 tsdb/cache: get first row from imem 2024-11-19 14:36:16 +08:00
Shengliang Guan
a4b6d9dee0
Merge pull request #28797 from taosdata/enh/TD-32907-3.0
enh: add bypassFlag to facilitate performance testing
2024-11-19 14:24:09 +08:00
Shengliang Guan
99bebacd8e
Merge pull request #28784 from taosdata/fix/TD-32861-main
fix(query)[TD-32861]. fix that WHERE condition not work in statements with INTERP function
2024-11-19 09:40:28 +08:00
Shengliang Guan
6044bb06f1
Merge pull request #28793 from taosdata/fix/main/TD-32883
remove duplicate group by cols
2024-11-18 19:32:16 +08:00
kailixu
3ebb664953 enh: add bypassFlag to facilitate performance testing 2024-11-18 18:12:39 +08:00
Jinqing Kuang
f5c66cec19 fix(query)[TD-32861]. fix that WHERE condition not work with INTERP function
Previously, a statement with INTERP would force underlying TABLE SCAN
operator to scan all data within the RANGE clause, causing the time
range constraint in the WHERE condition to be ignored. This fix ensures
that the TABLE SCAN respects both the RANGE clause and WHERE condition,
improving query accuracy and performance.
2024-11-18 16:08:27 +08:00
kailixu
3225c381e2 enh: add bypassFlag to facilitate performance testing 2024-11-18 15:41:08 +08:00
wangjiaming0909
6c18289de0 fix tsbs perf issue 2024-11-18 14:11:21 +08:00
kailixu
748c7f9cf2 enh: add bypassFlag to facilitate performance testing 2024-11-15 19:26:12 +08:00
wangjiaming0909
2be0ca15d8 fix group_partition test 2024-11-15 18:10:44 +08:00
Minglei Jin
66535adb70 tsdb/cache: update lru when committing 2024-11-15 17:04:22 +08:00
Hongze Cheng
0c45c80d71 enh: add dangle child table filter in recovery mode 2024-11-15 14:26:53 +08:00
Haojun Liao
b74a1bc726 refactor: update logs, and set correct vgId. 2024-11-15 13:48:42 +08:00
Haojun Liao
fd1996a1d1 fix(stream): fix error in build msg. 2024-11-15 01:27:31 +08:00
Haojun Liao
f65651f6ef fix(stream): update the msg encoder. 2024-11-15 00:19:35 +08:00
yihaoDeng
42065bf2e8 Merge remote-tracking branch 'origin/3.0' into enh/addDiskUsage 2024-11-14 17:44:29 +08:00
Haojun Liao
c9a120e1d0 Merge branch '3.0' into fix/3_liaohj 2024-11-14 17:42:04 +08:00
Haojun Liao
b2b5a14d9d fix(stream): reset task add the failed chkptId info. 2024-11-14 17:38:40 +08:00
Shengliang Guan
b88088792e
Merge pull request #28752 from taosdata/fix/liaohj
fix(stream): always return success for resume req.
2024-11-14 15:58:03 +08:00
Shengliang Guan
a1f3b0a1ed
Merge pull request #28758 from taosdata/fix/3_liaohj
refactor: return the error code and do some refactor.
2024-11-14 15:57:51 +08:00
Minglei Jin
e3f57a1678 tsdb/cache: reuse update ctx array 2024-11-14 10:34:19 +08:00
Shengliang Guan
80b7cbdb84 Merge branch '3.0' into merge/mainto3.0 2024-11-13 23:11:05 +08:00
Haojun Liao
3b129f7e36 fix(stream): alwasy return success for resume req. 2024-11-13 19:35:01 +08:00
Haojun Liao
67a547f65a fix(stream): alwasy return success for resume req. 2024-11-13 13:46:23 +08:00
yihaoDeng
11064d43e6 support disk usage 2024-11-11 18:16:41 +08:00
Jinqing Kuang
b4e0f9a922 enh(query)[TD-32127]: improve code quality of tsdbRead module
- Add parameter validation for functions to ensure robustness
- Nullify pointers when freeing memory to prevent dangling pointers
- Initialize local variables to avoid undefined behavior
- Add error handling and logging for better debugging
2024-11-11 11:53:28 +08:00
dapan1121
a8561fba4f Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-11-11 11:01:22 +08:00
dapan1121
411d61504f fix: remove taosMem calling 2024-11-11 09:09:40 +08:00
dapan1121
371094cc13 Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-11-08 10:13:20 +08:00
wangjiaming0909
274a7fd876 refine unused codes 2024-11-08 09:50:32 +08:00
wangjiaming0909
2ddd07142a remove logs 2024-11-08 09:50:32 +08:00
wangjiaming0909
a70b4e28c8 fix tests 2024-11-08 09:50:30 +08:00
wangjiaming0909
9a92c136ce fix drop child table with tsma 2024-11-08 09:47:47 +08:00
wangjiaming0909
65dffbda0c fix tsma drop ctb 2024-11-08 09:47:04 +08:00
wangjiaming0909
413cf3e504 sink submit data one-by-one 2024-11-08 09:42:59 +08:00
54liuyao
f452ca47fe delete window state when drop table 2024-11-08 09:42:56 +08:00
wangjiaming0909
a5a3d1d8ad fix same timestamp written into same tsma res ctb 2024-11-08 09:40:06 +08:00
yihaoDeng
4f9c9a15db support disk usage 2024-11-07 20:20:44 +08:00
Hongze Cheng
6c487c3f48
Merge pull request #28472 from taosdata/enh/TD-31867-main
enh: add more log for last cache retrieve
2024-11-07 19:46:46 +08:00
yihaoDeng
8c56a75f4f support disk usage 2024-11-07 17:09:57 +08:00
yihaoDeng
12beff2a0a support disk usage 2024-11-06 21:22:26 +08:00
yihaoDeng
a6436882a2 support disk usage 2024-11-06 15:25:50 +08:00
54liuyao
719a3faa12 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-11-06 11:13:15 +08:00
54liuyao
ba31bf2c52 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-11-06 09:42:50 +08:00
Shengliang Guan
0be118c0aa
Merge pull request #28408 from taosdata/enh/TD-32181/client
Enh/td 32181/client
2024-11-06 09:42:05 +08:00
yihaoDeng
af80d0a6bf opt disk 2024-11-05 20:05:54 +08:00
yihaoDeng
dc576905f0 support disk usage 2024-11-05 19:57:13 +08:00
Shungang Li
e3beccbde1 enh: add more log for last cache retrieve 2024-11-05 13:49:38 +08:00
Haojun Liao
8148f26d30
Merge branch '3.0' into fix/ref 2024-11-05 10:50:28 +08:00
54liuyao
158eda13f9 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-31 17:49:58 +08:00
Shungang Li
2879fafc1c fix: typo issue 2024-10-31 14:54:01 +08:00
Haojun Liao
b1ad121bae fix(stream): release task before returning. 2024-10-31 14:49:16 +08:00
Shungang Li
fde2a56076 enh: tsdbCacheRowFormatUpdate check for memory funcs 2024-10-31 11:47:32 +08:00
xsren
73be7ddbc6 fix: set tablefield of stream block to NULL 2024-10-30 19:38:08 +08:00
Shungang Li
84b17a144b Merge branch 'fix/TS-4937' into fix/TD-32338-3.0 2024-10-30 16:33:09 +08:00
Shungang Li
6da22e6483 enh: tsdb cache schema 2024-10-30 16:13:27 +08:00
54liuyao
b6d16eccdb Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-30 14:54:42 +08:00
Shengliang Guan
ea9ed2e538
Merge pull request #28300 from taosdata/enh/TS-5441-3.0
enh:[TS-5441] cost too long in tmq write meta data by cache meta and vg info
2024-10-30 13:43:41 +08:00
Minglei Jin
d8df6db06a fix schema update with sver param 2024-10-30 10:23:32 +08:00
54liuyao
d065d71821 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-30 10:09:48 +08:00
Shengliang Guan
c026f26289
Merge pull request #28546 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2024-10-30 08:57:21 +08:00
Haojun Liao
9bae0adba6 fix(stream): start scheduler task after set the refId. 2024-10-29 19:14:37 +08:00
Minglei Jin
6b67c2ebf0 uncomment tsdb cache commit 2024-10-29 15:07:13 +08:00
Minglei Jin
e364d5aa66 tsdb/cache: invalidate cached schema 2024-10-29 14:41:14 +08:00
Minglei Jin
cf3e84e79d tsdb/cache: cache schema to reuse 2024-10-29 12:25:25 +08:00
yihaoDeng
b523cf8802 fix:conflicts from 3.0 2024-10-28 17:34:20 +08:00
Shungang Li
d34fc78a22 fix: (last) eliminate redundant logs caused by incorrect return results 2024-10-28 11:18:06 +08:00
Haojun Liao
51f3f29d5b fix(stream): fix syntax check failure. 2024-10-27 21:52:46 +08:00
Haojun Liao
4802f59dfe fix(stream): use the refId in stream meta list, in order to avoid access already freed stream tasks. 2024-10-27 15:49:40 +08:00
xinsheng Ren
412c10ed94
Merge branch '3.0' into enh/TD-32181/client 2024-10-25 22:54:04 +08:00
54liuyao
f79dcffc8c Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-25 14:14:43 +08:00
Minglei Jin
3795f9cd13 fix(vnode/commit): fix sync commit log output 2024-10-25 10:26:15 +08:00
54liuyao
cea454b002 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-24 19:24:55 +08:00
dapan1121
4f3484b823 Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-10-24 16:49:38 +08:00
Shengliang Guan
f59f3901c0 Merge remote-tracking branch 'origin/main' into merge/3340 2024-10-24 10:16:26 +08:00
Shengliang Guan
81c30ab7c0 fix: format cmake file 2024-10-24 10:10:07 +08:00
xsren
f35d2847b9 enh: blockencode 2024-10-23 13:51:46 +08:00
xsren
d01a3481bc block buf len check 2024-10-23 13:51:46 +08:00
dmchen
bf2261bcff fix/TD-32621-add-log 2024-10-23 03:40:40 +00:00
Shungang Li
0c4e863b56 fix: (last) iterator of nextRowIterGet 2024-10-22 14:37:56 +08:00
Minglei Jin
4401b5e568 Merge branch '3.0' into feat/TS-5215-2 2024-10-21 10:48:37 +08:00
54liuyao
6a2a5b80a1 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-18 09:28:18 +08:00
wangmm0220
bc05289192 enh:[TS-5441] cost too long in tmq write meta data by cache meta and vg info 2024-10-18 09:28:16 +08:00
Haojun Liao
d715e50d68
Merge pull request #28403 from taosdata/fix/syntax
refactor: do some internal refactor.
2024-10-17 17:19:34 +08:00
54liuyao
e825d74213 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-17 17:12:00 +08:00
54liuyao
a62b5a3efd fix issue 2024-10-17 14:55:07 +08:00
Haojun Liao
c8e8cb0697 refactor: do some internal refactor. 2024-10-17 11:48:00 +08:00
Haojun Liao
6d3370d611
Merge pull request #28388 from taosdata/fix/syntax
fix(stream): only keep the latest pause operation status.
2024-10-17 09:55:14 +08:00
Hongze Cheng
1febe0b400
Merge pull request #28385 from taosdata/fix/TS-5529-3.0
fix: remove invalid error code check and add meta data recover and compact function
2024-10-17 08:37:30 +08:00
Haojun Liao
dd05353b74 refactor: do some internal refactor. 2024-10-16 22:07:37 +08:00
Hongze Cheng
71a762db75 add more error handle 2024-10-16 19:32:41 +08:00
Haojun Liao
f83993757f other: merge 3.0 2024-10-16 18:38:55 +08:00
Haojun Liao
27c087e9ae refactor: do some internal refactor. 2024-10-16 18:36:49 +08:00
wangmm0220
4f39974938 enh:[TS-5441] cost too long in tmq write meta data by cache meta and vg info 2024-10-16 17:17:44 +08:00
Hongze Cheng
0c305a0678
Merge pull request #28372 from taosdata/fix/3.0/TD-32551
fix invaild snapshotVer while repair wal meta file
2024-10-16 16:49:49 +08:00
Hongze Cheng
b56701e05c fix: remove invalid error code check and add meta data recover and compact function 2024-10-16 16:31:30 +08:00
54liuyao
3e49f40c74 stream twa 2024-10-16 12:16:59 +08:00
54liuyao
944457d7a6 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-16 12:09:17 +08:00
Jinqing Kuang
de70067436 fix(query)[TD-32564]. Fix memory leak in exceptional cases
In function tsdbTFileSetInitRef, clear all FileObj stored in
the variable lvl when an error occurs, and release the memory
allocated for lvl itself.
2024-10-16 10:48:41 +08:00
xiao-77
ca7f490e6d fix invaild snapshotVer while repair wal meta file 2024-10-15 16:53:15 +08:00
Minglei Jin
96cc55a164
Merge branch '3.0' into feat/TS-5215-2 2024-10-15 13:58:29 +08:00
Hongze Cheng
2fdcc525e5
Merge pull request #28327 from taosdata/fix/TD-32435-3.0
fix: (last) add lock for writebatch
2024-10-14 15:49:58 +08:00
wangmm0220
61531e7339 enh:[TS-5441] cost too long in tmq write meta data by cache meta and vg info 2024-10-14 13:55:45 +08:00
54liuyao
9377450199 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-10-14 13:55:05 +08:00
Pan Wei
80e2e426f0
Merge pull request #28277 from taosdata/enh/TD-32413/snprintf
Enh/td 32413/snprintf
2024-10-14 10:59:03 +08:00
wangmm0220
2e3bebe405 fix:[TD-32526] conflicts from 3.0 2024-10-13 12:59:50 +08:00
wangmm0220
fbed901add fix:[TD-32526] conflicts from 3.0 2024-10-12 18:41:48 +08:00
wangmm0220
db97e26d32 fix:[TD-32526] consumer null if add column because of pDataBlock not clear 2024-10-12 18:31:29 +08:00
Jing Sima
6231d46cc5 enh:[TD-32189] Add validation to prevent changes to resultinfo structure. 2024-10-12 15:14:59 +08:00
54liuyao
10810d48de Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/syntax 2024-10-12 15:02:55 +08:00
Minglei Jin
d525270261 Merge branch '3.0' into feat/TS-5215-2 2024-10-12 11:24:19 +08:00
Hongze Cheng
8ad0bb2d3d
Merge pull request #28325 from taosdata/fix/TD-32508
fix(tsdb/scan): ignore lcn file only
2024-10-12 10:07:43 +08:00
Shungang Li
41f2653f0a fix: (last) add lock for writebatch 2024-10-12 09:52:46 +08:00
Pan Wei
e16af33fa3
Merge pull request #28311 from taosdata/enh/TD-32412
fix:[TD-32412] unsafe function
2024-10-12 09:42:26 +08:00
Hongze Cheng
f568d63ad0
Merge pull request #28309 from taosdata/fix/TD-32460
fix invalid free or mem leak
2024-10-12 09:08:59 +08:00
xinsheng Ren
d003cfaffb
Merge branch '3.0' into enh/TD-32413/snprintf 2024-10-11 19:50:48 +08:00
Minglei Jin
795c272ac9 fix(tsdb/scan): ignore lcn file only 2024-10-11 18:34:08 +08:00
WANG MINGMING
473a9f3b45
Merge branch '3.0' into enh/TD-32412 2024-10-11 17:11:07 +08:00
Pan Wei
bc0d958f58
Merge pull request #28232 from taosdata/enh/TD-32415-3.0
fix(query)[TD-32415]. Replace memory-unsafe functions
2024-10-11 17:04:29 +08:00
xinsheng Ren
9f645a0879
Merge branch '3.0' into enh/TD-32413/snprintf 2024-10-11 16:07:25 +08:00
Minglei Jin
3a58699a12
Merge branch '3.0' into feat/TS-5215-2 2024-10-11 15:03:03 +08:00
Hongze Cheng
f9b121e3db
Merge pull request #28298 from taosdata/fix/TD-32451-3.0
fix: (last) tsdbCacheGetBatch memleak issue
2024-10-11 14:41:39 +08:00
Jinqing Kuang
0199c8dddf fix(query)[TD-32415]. Replace memory-unsafe functions
- Replace memory unsafe functions with secure alternatives
- Fix automatical generation of subtable names
2024-10-11 14:34:19 +08:00
Haojun Liao
fb0d0b60a5 Merge branch '3.0' into fix/syntax 2024-10-11 13:53:05 +08:00
wangmm0220
f537832664 fix:[TD-32412] unsafe function 2024-10-11 10:53:32 +08:00
yihaoDeng
8028fa9710 fix invalid free or mem leak 2024-10-11 09:31:35 +08:00
Shungang Li
9f644cd2b2 fix: (last) tsdbCacheGetBatch memleak issue 2024-10-11 09:14:51 +08:00
wangmm0220
a9f393aa56 fix:[TS-5441] conflicts from 3.0 2024-10-10 18:32:25 +08:00
wangmm0220
42b7520d34 enh:[TS-5441] cost too long in tmq write meta data by cache meta and vg info 2024-10-10 18:27:42 +08:00
Pan Wei
67bf944413
Merge pull request #28292 from taosdata/fix/buildRelease
fix: ret error
2024-10-10 18:18:25 +08:00
Minglei Jin
3905c94f03 vnode/tcs: use tcs instead of s3 interface 2024-10-10 16:34:37 +08:00
Haojun Liao
5c1cffed69 fix(stream): add some logs. 2024-10-10 15:54:15 +08:00
Haojun Liao
5e94ed5e25 Merge branch '3.0' into fix/syntax 2024-10-10 14:53:37 +08:00