Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
83363 commits 554 branches 514 tags 1.7 GiB
Commit graph

10991 commits

Author SHA1 Message Date
kailixu
2fd3bf87fc Merge branch '3.0' into enh/TD-30988-3.0 2024-07-24 16:08:34 +08:00
Haojun Liao
a09ad7a81e
Merge pull request #26743 from taosdata/fix/syntax 
fix(stream): check return value, and do some internal refactor.
 2024-07-24 15:47:45 +08:00
kailixu
acb1d0a9cc Merge branch '3.0' into enh/TD-30988-3.0 2024-07-24 14:47:47 +08:00
Minglei Jin
e0cd502afe remove unused code 2024-07-24 14:43:31 +08:00
Minglei Jin
45b1bbf0ed use new macros from bcache & pgcache opening 2024-07-24 14:34:27 +08:00
Hongze Cheng
e732580cd9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-15 2024-07-24 14:28:28 +08:00
Minglei Jin
45e00afad1 tsdb/cache: remove unused block index cache 2024-07-24 14:20:59 +08:00
Hongze Cheng
31dbb1a48f
Merge pull request #26629 from taosdata/fix/TD-30990 
terrno/wal: remove walWrite which is only used in unit testing
 2024-07-24 14:11:30 +08:00
Hongze Cheng
69fa2a187a enh: refactor return code 2024-07-24 13:58:17 +08:00
kailixu
50c2fc567c chore: merge 3.0 2024-07-24 12:05:01 +08:00
kailixu
7b49327463 enh: refactor return code 2024-07-24 10:09:24 +08:00
Yihao Deng
ae999184ef Merge remote-tracking branch 'origin/3.0' into fix/refactorTqBackend 2024-07-24 02:05:57 +00:00
Haojun Liao
d34ed134b3 fix(tsdb): set the correct tsdbReader 2024-07-24 00:44:52 +08:00
Haojun Liao
cd000ba981 fix(stream): set correct check return value. 2024-07-24 00:08:39 +08:00
Haojun Liao
923c791201 other: update test cases. 2024-07-23 19:53:32 +08:00
kailixu
8da3fefcbd Merge branch '3.0' into enh/TD-30988-3.0 2024-07-23 19:31:22 +08:00
kailixu
994a08ad41 enh: refactor return code 2024-07-23 19:30:55 +08:00
Haojun Liao
4d8064c950 fix(tsdb):fix invalid return code. 2024-07-23 19:16:06 +08:00
Hongze Cheng
2cdc8cc1c3 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-29367-8 2024-07-23 18:52:13 +08:00
kailixu
66dda35f75 Merge branch '3.0' into enh/TD-30988-3.0 2024-07-23 18:06:44 +08:00
dapan1121
2220a93b41
Merge pull request #26714 from taosdata/enh/TD-31063 
enh:[TD-31063] Handling return value in qnode
 2024-07-23 18:06:10 +08:00
Hongze Cheng
799d89a3be Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-29367-8 2024-07-23 17:45:55 +08:00
Hongze Cheng
0740eb88b6
Merge pull request #26737 from taosdata/enh/TD-30987-13 
enh: refactor return code
 2024-07-23 17:34:58 +08:00
Haojun Liao
3bddd051ca other: merge 3.0 2024-07-23 17:18:55 +08:00
Yihao Deng
533e3f0da6 refactor tq backend 2024-07-23 07:40:00 +00:00
Hongze Cheng
83746f52e2 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-29367-8 2024-07-23 15:14:16 +08:00
Hongze Cheng
43d7532006 fix: a little bug 2024-07-23 15:12:21 +08:00
Hongze Cheng
4139dc6663
Merge pull request #26726 from taosdata/fix/TD-31068-3.0 
fix: (last cache) compare pk when merging ctb data
 2024-07-23 15:07:57 +08:00
sima
6255a7ba10 enh:[TD-31063] use properer errcode. 2024-07-23 15:03:15 +08:00
sima
32faa6fccc enh:[TD-31063] Handling return value in qnode.c 2024-07-23 15:02:54 +08:00
Hongze Cheng
391a31c5a2 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-13 2024-07-23 15:02:33 +08:00
Haojun Liao
7497f193c7 fix(stream): check return value, and do some internal refactor. 2024-07-23 14:47:29 +08:00
Minglei Jin
8b9cb2d7fe Merge branch 'fix/TD-30990' of https://github.com/taosdata/TDengine into fix/TD-30990 2024-07-23 14:10:23 +08:00
Minglei Jin
56691f2e0b Merge branch '3.0' into fix/TD-30990 2024-07-23 14:04:48 +08:00
kailixu
0a8be1fd3d enh: return error code 2024-07-23 13:55:26 +08:00
Haojun Liao
c08ee33dca other: merge 3.0 2024-07-23 13:45:31 +08:00
Haojun Liao
93cc7aa9ad fix(stream): set correct return code. 2024-07-23 12:25:57 +08:00
Hongze Cheng
3f79e5b7e3
Merge pull request #26676 from taosdata/feat/TD-30991-3.0 
feat: (errcode) ttime.c geomFunc.c geosWrapper.c
 2024-07-23 11:09:20 +08:00
Hongze Cheng
10263b6b4e enh: refactor return code 2024-07-23 11:01:22 +08:00
Shungang Li
50e802d1d8 fix: tsdbRetrieveCacheRows free memory issue 2024-07-23 10:13:24 +08:00
Shungang Li
f5f84c3cc6 feat: (errcode) ttime.c 2024-07-23 09:13:42 +08:00
kailixu
723c3415c5 Merge branch '3.0' into enh/TD-30988-3.0 2024-07-22 22:59:52 +08:00
Hongze Cheng
c4d31e7737 enh: refactor error code 2024-07-22 19:40:07 +08:00
dapan1121
adfd7b4504 Merge remote-tracking branch 'origin/3.0' into feat/TD-30268 2024-07-22 19:24:56 +08:00
Shungang Li
44fa1636f2 fix: (last cache) compare pk when merging ctb data 2024-07-22 16:58:13 +08:00
kailixu
cdc85d9588 enh: return error code 2024-07-22 15:53:20 +08:00
Minglei Jin
c9ab734b16
Merge branch '3.0' into fix/TD-30990 2024-07-22 15:29:57 +08:00
Minglei Jin
38689df0b9 use new return macros for wal read 2024-07-22 15:28:04 +08:00
Haojun Liao
46400b2dd7 fix(stream): check return value. 2024-07-22 14:46:11 +08:00
Haojun Liao
06ca010059 fix(stream): fix syntax error. 2024-07-22 10:03:05 +08:00
Haojun Liao
12015fe414 other: merge 3.0 2024-07-22 09:41:19 +08:00
Haojun Liao
5acd35bf71 fix(stream): check return value. 2024-07-22 09:37:48 +08:00
Haojun Liao
68ecda7b07 fix(stream): check return value. 2024-07-22 09:37:12 +08:00
Haojun Liao
7201526674 fix(stream): check return value. 2024-07-22 09:13:39 +08:00
dapan1121
963b3d1b3e
Merge pull request #26690 from taosdata/opti/TS-4593-3.0 
opti:[TS-4593] transform offset from file to tdb in tmq
 2024-07-22 09:06:54 +08:00
Minglei Jin
ecc4b50a28 Merge branch '3.0' into fix/TD-30990 2024-07-22 08:53:15 +08:00
Minglei Jin
b0b9dd7d5f set terrno with taos_return 2024-07-22 08:51:30 +08:00
kailixu
98a1145091 enh: return error code 2024-07-21 23:45:59 +08:00
wangmm0220
af42d4fa59 opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-21 22:22:26 +08:00
kailixu
cd8a54cbf7 enh: return error code 2024-07-21 11:43:39 +08:00
Haojun Liao
2f0768e12d
Merge pull request #26700 from taosdata/fix/create_tb 
fix(stream): fix race condition when starting check downstream status
 2024-07-21 10:03:43 +08:00
Haojun Liao
6cc0096534 fix(stream): fix memory leak. 2024-07-21 03:10:21 +08:00
Hongze Cheng
f0b2557ec1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-29367-8 2024-07-20 12:26:41 +08:00
wangmm0220
21c30fe6ff opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-19 16:19:12 +08:00
Hongze Cheng
c7a0d4c727 enh: refact morecode 2024-07-19 16:12:38 +08:00
Hongze Cheng
5734fe8778 fix compile error 2024-07-19 16:07:09 +08:00
Hongze Cheng
5e79c2afea Merge branch '3.0' into enh/TD-29367-8 2024-07-19 16:06:53 +08:00
Hongze Cheng
99a628cd15
Merge pull request #26661 from taosdata/enh/TD-30987-7 
enh: refact errno
 2024-07-19 14:32:59 +08:00
Haojun Liao
2e0b829004
Merge pull request #26669 from taosdata/fix/syntax 
refactor: check return value for each function.
 2024-07-19 14:31:21 +08:00
Minglei Jin
4701a92f26
Merge branch '3.0' into fix/TD-30990 2024-07-19 14:24:07 +08:00
Minglei Jin
f43ce95777 use return macro with oom 2024-07-19 14:18:52 +08:00
Hongze Cheng
ffe2973ade refactor return code 2024-07-19 13:19:01 +08:00
Hongze Cheng
acfced4b47 fix issue 2024-07-19 13:02:34 +08:00
Hongze Cheng
d2d60990ab Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-7 2024-07-19 12:51:52 +08:00
dapan1121
1a58926f14
Merge pull request #26567 from taosdata/opti/TS-4593-3.0 
opti:[TS-4593] transform offset from file to tdb in tmq
 2024-07-19 10:58:07 +08:00
Hongze Cheng
78e0762714
Merge pull request #26646 from taosdata/enh/TD-30987-5 
refact more code
 2024-07-19 10:14:37 +08:00
Hongze Cheng
6f4fc0a41b
Merge pull request #26652 from taosdata/enc/TD-30987-6 
enh: check return code
 2024-07-19 08:51:14 +08:00
Haojun Liao
852dd833d0 fix(stream): fix syntax error. 2024-07-19 00:09:28 +08:00
wangmm0220
61b46b2e98 fix:conflicts from 3.0 2024-07-18 22:56:16 +08:00
Haojun Liao
d18f3a6a46
Merge pull request #26618 from taosdata/fix/syntax 
fix(stream): return after get value.
 2024-07-18 22:29:08 +08:00
dapan1121
44406c3fd3
Merge pull request #26640 from taosdata/fix/hashPut 
fix: taoshash put
 2024-07-18 19:12:35 +08:00
wangmm0220
5eb3251a27 opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-18 18:38:09 +08:00
Hongze Cheng
3e262250d7 enh: refact errno 2024-07-18 17:17:02 +08:00
Hongze Cheng
3de0b18d8e make CI pass 2024-07-18 16:12:19 +08:00
Minglei Jin
6ce5320750 wal/mgmg: use new return macros for wal mgmt 2024-07-18 14:40:49 +08:00
Hongze Cheng
cbb1234c7b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-5 2024-07-18 14:34:04 +08:00
wangmm0220
1d8791a106 opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-18 14:32:04 +08:00
Hongze Cheng
927300c924 fix: compile error 2024-07-18 14:07:26 +08:00
Hongze Cheng
69e79966b6 enh: check return code 2024-07-18 11:32:13 +08:00
Hongze Cheng
f56ab1ee27
Merge pull request #26630 from taosdata/fix/TD-30816-3.0 
fix: (pk) load last cache from tsdb
 2024-07-18 10:51:59 +08:00
Hongze Cheng
2327319c14 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-5 2024-07-18 10:37:22 +08:00
Minglei Jin
964397ea63 move log macros into internal header 2024-07-18 10:29:25 +08:00
Haojun Liao
80a7b7da5f fix(tsdb): fix invalid return value. 2024-07-18 08:58:39 +08:00
Haojun Liao
a8433ec6eb fix(tsdb):set the initialized value. 2024-07-18 00:31:28 +08:00
Hongze Cheng
decd68f811 refact more code 2024-07-17 22:09:09 +08:00
Hongze Cheng
3bada98670 revert some change to make CI pass 2024-07-17 21:58:23 +08:00
Hongze Cheng
c1b5a80e20 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-4 2024-07-17 21:19:03 +08:00
wangmm0220
18ed8e2904 Merge branch '3.0' of https://github.com/taosdata/TDengine into opti/TS-4593-3.0 2024-07-17 19:56:14 +08:00
wangmm0220
c7e37a3a00 opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-17 19:44:41 +08:00
factosea
aee48971de fix: taoshash put 2024-07-17 17:52:29 +08:00
Haojun Liao
0100bb51b9 other: merge 3.0 2024-07-17 17:36:49 +08:00
Haojun Liao
30186f466b refactor: check return value for each function. 2024-07-17 16:47:56 +08:00
wangmm0220
f078be357d opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-17 16:25:51 +08:00
Hongze Cheng
cb055eca80 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-4 2024-07-17 16:16:15 +08:00
Hongze Cheng
931749dca6 refactor tsdb code 2024-07-17 16:15:19 +08:00
wangmm0220
646731b5dd opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-17 15:58:37 +08:00
Haojun Liao
552e59f42b refactor: check return value for each function. 2024-07-17 15:40:00 +08:00
Shungang Li
394da5d8bf fix: (pk) load last cache from tsdb 2024-07-17 14:27:06 +08:00
Hongze Cheng
fdd866737d fix more 2024-07-17 13:17:40 +08:00
Hongze Cheng
35606a5658 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-3 2024-07-17 13:07:07 +08:00
Haojun Liao
14f149cdd3 refactor: check return value for each function. 2024-07-17 11:47:05 +08:00
wangmm0220
a61d5fa827 opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-17 11:26:22 +08:00
Haojun Liao
53ed030967 Merge branch '3.0' into fix/3_liaohj 2024-07-17 11:25:19 +08:00
Haojun Liao
1ed620e702 fix(stream): return after get value. 2024-07-17 11:17:27 +08:00
Haojun Liao
395b437fec Merge branch '3.0' into fix/create_tb 2024-07-17 10:24:20 +08:00
Haojun Liao
103e9194b0
Merge pull request #26592 from taosdata/fix/syntax 
fix(tsdb): check return value.
 2024-07-17 09:08:22 +08:00
Hongze Cheng
d8e3279ca6 fix: little fix 2024-07-17 08:58:59 +08:00
Haojun Liao
872cae1386 refactor: do some refactor. 2024-07-17 01:08:39 +08:00
Haojun Liao
749e7d6cf7 fix(stream): return after get value. 2024-07-17 00:49:53 +08:00
Haojun Liao
f3cfd297b8 fix(stream): return after get value. 2024-07-16 19:42:29 +08:00
Haojun Liao
b29e1c2b0d fix(stream):fix syntax error. 2024-07-16 19:13:14 +08:00
wangmm0220
0704dcf45d fix:[TS-4593] check info error 2024-07-16 18:56:20 +08:00
Haojun Liao
94f596c4ce refactor: remove the invalid return value. 2024-07-16 18:52:01 +08:00
Hongze Cheng
64363627fe enh: refact tqueue code 2024-07-16 17:30:32 +08:00
Haojun Liao
38ee5dc472 fix(stream):fix syntax error. 2024-07-16 16:04:51 +08:00
Haojun Liao
19ba5af5e7 refactor: remove the invalid return value. 2024-07-16 15:59:16 +08:00
Haojun Liao
d2cb53ab3d refactor: remove the invalid return value. 2024-07-16 15:49:08 +08:00
Haojun Liao
691c1dfa7d fix(stream): check dst stable schema before generating auto create table. 2024-07-16 14:45:09 +08:00
Haojun Liao
8dde576c6f fix(stream): add explicit create table into sink cache. 2024-07-16 09:32:13 +08:00
Haojun Liao
dd590f36e2 refactor: do some refactor. 2024-07-15 23:53:12 +08:00
Haojun Liao
25f5c9dc5e other: merge 3.0 2024-07-15 19:41:54 +08:00
Haojun Liao
51e9723d66 refactor: do some refactor. 2024-07-15 19:37:52 +08:00
Haojun Liao
14a7cebc56 fix(stream): add explicit create table into sink cache. 2024-07-15 18:51:58 +08:00
Haojun Liao
019a1eb76b fix(tsdb): check return value. 2024-07-15 15:28:32 +08:00
wangmm0220
1e1612a5fa opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-15 10:19:03 +08:00
wangmm0220
e78a75d183 opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-15 09:48:04 +08:00
Yihao Deng
142f9132a5 fix failed to load task 2024-07-12 12:08:57 +00:00
dapan1121
e527f2fd0b fix: validate function return value 2024-07-12 15:22:39 +08:00
54liuyao
6c84d926ab Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30837 2024-07-12 11:04:44 +08:00
54liuyao
1c9011e820 stream time slice 2024-07-12 11:03:45 +08:00
Shungang Li
3cc926d597 fix: tsdbCacheUpdate incorrect filling cache 2024-07-10 17:52:13 +08:00
Hongze Cheng
0fcc57b52a
Merge pull request #26439 from taosdata/enh/TD-30442 
Enh/TD-30442
 2024-07-09 18:04:34 +08:00
Haojun Liao
c71413c2aa fix(stream): discard the repeat send consensus-checkpointId msg. 2024-07-09 14:52:15 +08:00
Haojun Liao
acde36a25b Merge branch '3.0' into fix/3_liaohj 2024-07-09 14:43:35 +08:00
Hongze Cheng
b3be47fdbb cancel bg tasks when alter stt_trigger 2024-07-08 15:39:25 +08:00
Haojun Liao
6e15c16cf7 fix(stream): check the set consensus-checkpointId ts. 2024-07-08 14:33:28 +08:00
Haojun Liao
647f9f47ef refactor: do some internal refactor. 2024-07-08 10:32:23 +08:00
Haojun Liao
ce4153b6fc fix(stream): use hb to send the consens-checkpointid req. 2024-07-08 09:05:33 +08:00
Haojun Liao
8e6bb176c2 fix(stream): use trans to set the consensus-checkpoint id 2024-07-05 16:17:20 +08:00
Haojun Liao
db4a00c74e fix(stream): not restart for reset task status. 2024-07-05 08:55:40 +08:00
Yihao Deng
94a480292f Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-05 00:48:41 +00:00
Yihao Deng
0cdfae3a2c refactor backend 2024-07-04 12:13:17 +00:00
Haojun Liao
4cfecfcf28 other: fix coverity issue. 2024-07-04 19:23:58 +08:00
Yihao Deng
8428a5be37 refactor backend 2024-07-04 10:25:37 +00:00
Haojun Liao
47b0a0464e fix(stream): send checkpoint-source-rsp to mnode before reset task status. 2024-07-04 15:21:16 +08:00
Yihao Deng
0bd51f2133 fix comment 2024-07-04 06:36:36 +00:00
Haojun Liao
653f7a1a43 fix(stream): refactor the checkpoint consensus policy. 2024-07-04 13:55:50 +08:00
Minglei Jin
0fa44fe8cf fix(tsdb/commit): make commit failing core in release buildings 2024-07-03 16:40:54 +08:00
dapan1121
56689cf97a
Merge pull request #26360 from taosdata/fix/3.0/TD-30305 
fix coverity issues
 2024-07-03 08:50:11 +08:00
Hongze Cheng
991d43b610
Merge pull request #26314 from taosdata/fix/TS-2518-3.0 
fix/TS-2518
 2024-07-02 18:52:02 +08:00
Haojun Liao
0a9bcc0870
Merge pull request #26370 from taosdata/fix/3_liaohj 
fix(stream): remove invalid assert.
 2024-07-02 18:41:45 +08:00
Yihao Deng
471580ec5e Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-02 08:26:10 +00:00
Haojun Liao
c7d4f45b7f fix(stream): remove invalid assert. 2024-07-02 15:33:25 +08:00
Haojun Liao
279bfb4de0
Merge pull request #26364 from taosdata/fix/3_liaohj 
fix(stream): fix error in pause/resume procedure.
 2024-07-02 15:32:43 +08:00
Haojun Liao
4e56b6f9eb fix(stream): fix error in pause/resume procedure. 2024-07-02 13:33:31 +08:00
wangjiaming0909
024422bfd7 fix coverity issues 2024-07-02 09:27:14 +08:00
Haojun Liao
420b59fea5
Merge pull request #26344 from taosdata/fix/3_liaohj 
fix(stream): validate the stream hb msg, and discard the invalid hb msg.
 2024-07-02 09:07:31 +08:00
dapan1121
6d0b8eeed4
Merge pull request #26302 from taosdata/TD-26483 
feat(query):add thread pool
 2024-07-01 19:04:52 +08:00
dapan1121
b3eb938527 enh: add query memory pool 2024-07-01 17:22:43 +08:00
Hongze Cheng
88a24c5457
Merge pull request #26345 from taosdata/fix/TD-30843 
fix(tsdb/retention): fix null pointer crash (uaf)
 2024-07-01 15:50:27 +08:00
Minglei Jin
299cf3a00b fix(tsdb/retention): fix null pointer crash (uaf) 2024-07-01 14:20:48 +08:00
Haojun Liao
f09be802ea other: merge 3.0 2024-07-01 13:32:30 +08:00
wangjiaming0909
5040ff5bd9 mnode/qnode support QueryAutoQWorkerPool 2024-07-01 11:08:40 +08:00
wangjiaming0909
11a98ffab2 QueryAutoQWorker 2024-07-01 11:08:39 +08:00
Yihao Deng
6c6bff611a add self check 2024-06-29 12:56:36 +00:00
Yihao Deng
7290920c6f add self check 2024-06-29 04:35:54 +00:00
Haojun Liao
79085015d6 fix(stream): set correct msg start position. 2024-06-29 00:49:37 +08:00
Haojun Liao
707fe02885 fix(stream):set the initial transId 2024-06-28 16:30:12 +08:00
Haojun Liao
f6e32529fc fix(stream): set initial update ep transId. 2024-06-28 14:13:16 +08:00
Haojun Liao
025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao
48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Haojun Liao
b5661752aa fix(tsdb):check the result of the binary search for the end position in data file block. 2024-06-27 14:32:18 +08:00
Haojun Liao
dc78cf32cb fix(tsdb):check the result of the binary search for the end position in data file block. 2024-06-27 14:29:29 +08:00
dmchen
5001cab278 fix/TS-2518 2024-06-27 04:38:17 +00:00
Haojun Liao
a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
Hongze Cheng
b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao
1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Haojun Liao
bd8c7d8c93 fix(stream): pause not stop the start procedure of stream tasks. 2024-06-24 13:25:48 +08:00
Haojun Liao
119001e30b fix(stream): update the retrieve checkpoint-trigger msg. 2024-06-21 15:11:48 +08:00
Haojun Liao
e7105edaa4 fix(stream): disable pause if task is un-init. 2024-06-21 14:14:44 +08:00
Haojun Liao
aea4254d40 fix(stream): async start task. 2024-06-21 10:37:06 +08:00
Haojun Liao
2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Haojun Liao
ece139d921 fix(stream): initialize the sink stream task. 2024-06-21 09:22:09 +08:00
Hongze Cheng
70851f6bed
Merge pull request #26160 from taosdata/enh/TD-30554-3.0 
tfs: support disable create new file
 2024-06-20 16:46:00 +08:00
kailixu
cefff2bfee Merge branch '3.0' into enh/TD-30554-3.0 2024-12-31 08:35:03 +08:00
Yihao Deng
639df3dfad update case 2024-06-20 00:14:26 +00:00
Yihao Deng
01ee8b36a4 update case 2024-06-19 12:36:13 +00:00
Haojun Liao
da63a40796
Merge pull request #26188 from taosdata/fix/3_liaohj 
fix(stream): fix a typo.
 2024-06-19 14:58:21 +08:00
Haojun Liao
2534ce5071 fix(stream): fix a typo. 2024-06-19 10:29:01 +08:00
kailixu
809c691b22 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-18 16:47:51 +08:00
Minglei Jin
356f6645ad
Merge branch '3.0' into fix/TD-30545 2024-06-18 11:28:29 +08:00
kailixu
d87a7d2809 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-18 08:51:53 +08:00
Haojun Liao
c3ae66c95c
Merge pull request #26169 from taosdata/fix/3_liaohj 
fix(stream): not revise the stream id for fill-history task.
 2024-06-18 08:38:29 +08:00
Haojun Liao
c4a2756907 fix(stream): not revise the stream id for fill-history task. 2024-06-17 23:13:54 +08:00
Haojun Liao
60fac80345 fix(stream): add some logs. 2024-06-17 19:34:09 +08:00
Haojun Liao
3aa6e00bee fix(stream): fix some typo. 2024-06-17 15:58:59 +08:00
Haojun Liao
848b1e19b5 fix(stream): fix some typo. 2024-06-17 14:39:46 +08:00
Hongze Cheng
3645bce918
Merge pull request #26127 from taosdata/fix/TD-30567 
add compress to child table
 2024-06-17 13:18:51 +08:00
kailixu
e1f5e6d533 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-17 10:44:11 +08:00
dapan1121
e34a8b48df
Merge pull request #26008 from taosdata/fix/TS-4833/dataloaded 
partition interval and limimt, dataload error
 2024-06-17 08:32:19 +08:00
kailixu
4ed3b30352 tfs: support disable create new file 2024-06-17 06:14:49 +08:00
kailixu
e3645def98 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-17 05:52:15 +08:00
factosea
19f6766c9a fix: blockAgg 2024-06-15 18:08:25 +08:00
Haojun Liao
62b69932b2
Merge pull request #26150 from taosdata/fix/3_liaohj 
fix(stream): move the expansion of the stream task related task to right place.
 2024-06-15 17:37:39 +08:00
Haojun Liao
42e0dff589 fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already. 2024-06-14 17:03:04 +08:00
Haojun Liao
85baf2b3e1
Merge pull request #26147 from taosdata/fix/3_liaohj 
fix(test): wait for a little bit more time.
 2024-06-14 16:34:40 +08:00
Haojun Liao
b25e6d3250 fix(stream): always return 0 for enqueuing retrieve block. 2024-06-14 14:43:27 +08:00
Haojun Liao
5f4b506777
Merge pull request #26131 from taosdata/fix/3_liaohj 
fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.
 2024-06-13 17:38:28 +08:00
Haojun Liao
0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
Haojun Liao
6f32a617f7 fix(tsdb): check for malloc failure. 2024-06-13 13:45:42 +08:00
Haojun Liao
5d2d5c3eee fix(tsdb): check for null ptr for block load info when retrieving block distribution. 2024-06-13 13:43:57 +08:00
Haojun Liao
849f64d557 fix(tsdb): check null for tsdb block load info 2024-06-13 13:25:29 +08:00
kailixu
50d163f10d Merge branch '3.0' into enh/TD-30554-3.0 2024-06-13 11:11:29 +08:00
kailixu
cdc7083b09 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-13 11:11:01 +08:00
Yihao Deng
b7ef054b38 add compress to child table 2024-06-13 02:11:41 +00:00
Hongze Cheng
470b0e6730
Merge pull request #26119 from taosdata/feat/TS-4724-3.0 
feat: data migration speed limit
 2024-06-13 09:59:53 +08:00
dapan1121
d21e2f52de
Merge pull request #26054 from taosdata/fix/TD-30365 
fix:[TD-30365] ci case error & drop topic error if vnode is splitted
 2024-06-13 09:55:34 +08:00
Haojun Liao
9c42c90209
Merge pull request #26118 from taosdata/fix/3_liaohj 
fix(stream): add fill-history task id in msg.
 2024-06-12 18:03:43 +08:00
Hongze Cheng
e060535c13 feat: data migration speed limit 2024-06-12 17:23:57 +08:00
kailixu
e7754a0b3e Merge branch '3.0' into enh/TD-30554-3.0 2024-06-12 15:40:01 +08:00
Haojun Liao
d06e1549f1 fix(stream): add fill-history task id in msg. 2024-06-12 15:27:19 +08:00
Minglei Jin
568799a6a3 fix(wal/level): enable alter replica from fake walLevel 1 2024-06-12 15:16:58 +08:00
kailixu
f2401f32a2 enh: support enable/disable tfs config entries 2024-06-12 15:14:38 +08:00
Haojun Liao
623a73f57b
Merge pull request #26089 from taosdata/fix/3_liaohj 
fix(stream): init the node list and task list when starting mnode.
 2024-06-12 11:34:10 +08:00
Haojun Liao
9406be9aa6 fix(stream): remove invalid reset. 2024-06-11 18:58:16 +08:00
Haojun Liao
a41a04dc37 fix(stream): remove the related history task correctly. 2024-06-11 18:35:59 +08:00
wangmm0220
70db803aec fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-11 17:24:29 +08:00
Haojun Liao
539543b011
Merge pull request #25846 from taosdata/enh/opt_prj 
enh(query): optimize the project query performance
 2024-06-11 14:35:27 +08:00
Hongze Cheng
5c1c65751a
Merge pull request #26083 from taosdata/fix/TD-30200-3.0 
fix: last cache rebuild from multi brinBlk
 2024-06-11 13:46:55 +08:00
Haojun Liao
20bade24c3
Merge branch '3.0' into fix/3_liaohj 2024-06-10 01:34:55 +08:00
Haojun Liao
cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao
895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
Shungang Li
f9950d5fa3 fix: last cache rebuild from multi brinBlk 2024-06-07 14:47:02 +08:00
Minglei Jin
01e5e124fb fix(last_row): fix empty table condition 2024-06-07 13:47:04 +08:00
Haojun Liao
6ef3c02717 fix(tsdb): remove invalid assert. 2024-06-06 19:09:54 +08:00
wangmm0220
0e337d3418 fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-06 17:26:20 +08:00
wangmm0220
697b81aa8a fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-06 11:15:23 +08:00
wangmm0220
48ecba95da fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-05 18:02:57 +08:00
Haojun Liao
29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao
c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj 
fix(stream): update the checkpoint info for followers, and some internal refactor.
 2024-06-05 13:38:51 +08:00
Hongze Cheng
4490cd7db3
Merge pull request #26040 from taosdata/enh/lsg-restore-3.0 
enh: add more log for restore
 2024-06-05 09:11:42 +08:00
Shungang Li
1f73bb106e enh: add more log for restore 2024-06-04 17:14:59 +08:00
factosea
c42e627a41 test 2024-06-04 11:39:47 +08:00
Haojun Liao
3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao
927e2237de Merge branch '3.0' into fix/3_liaohj 2024-06-03 15:56:02 +08:00
Hongze Cheng
6f72fd4170
Merge pull request #25996 from taosdata/feat/TD-30006-3 
Feat/TD-30006-3
 2024-06-03 15:41:47 +08:00
dapan1121
affdeed944
Merge pull request #25909 from taosdata/feat/ly_tmq_batch_meta 
optimize tmq snapshot meta
 2024-06-03 10:19:57 +08:00
Hongze Cheng
c8f13874a7
Merge pull request #25984 from taosdata/fix/TD-30309-3.0 
fix: coverity scan problem
 2024-06-03 08:58:48 +08:00
Haojun Liao
2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
54liuyao
e0167511c1 use tDeleteSVCreateTbBatchReq free mem 2024-05-31 17:18:25 +08:00
Haojun Liao
76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Yihao Deng
5293c4a1dd Merge branch '3.0' into feat/TD-30006 2024-05-31 02:49:58 +00:00
Yihao Deng
a1ccf91298 support add column compress 2024-05-31 02:47:57 +00:00
Yihao Deng
b364379671 add compress 2024-05-31 02:31:29 +00:00
Haojun Liao
ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Yihao Deng
c6407277dc support add column compress 2024-05-30 11:41:22 +00:00
Haojun Liao
815a9e953b fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-30 18:41:56 +08:00
Haojun Liao
e66283d99c fix(stream): remove table meta in table-meta cache. 2024-05-30 18:41:17 +08:00
Hongze Cheng
d28abdf837 fix coverity scan problem 2024-05-30 16:11:53 +08:00
Haojun Liao
b4956392d9 fix(stream): return in_progress code if not send retrieve rsp to downstream. 2024-05-30 15:54:08 +08:00
Haojun Liao
5768cc94a1 Merge branch '3.0' into fix/3_liaohj 2024-05-30 15:35:00 +08:00
Haojun Liao
cff5e753ef fix(stream): discard the result data block if the primary timestamp of results is expired. 2024-05-30 14:16:49 +08:00
Hongze Cheng
91394f2e6d fix more 2024-05-30 11:01:44 +08:00
Hongze Cheng
88a2c373b3 more fix 2024-05-30 10:22:26 +08:00
54liuyao
129d04a449 adj tmq param 2024-05-29 16:29:04 +08:00
Hongze Cheng
e75ab5b298 fix more 2024-05-29 14:10:34 +08:00
Hongze Cheng
bb83ed2469 fix: compact and commit concurrency problem 2024-05-29 11:33:17 +08:00
Haojun Liao
d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
54liuyao
a2255ca355 add tmq param 2024-05-28 18:34:37 +08:00
Haojun Liao
8d54d45054 fix(stream): fix error found by CI. 2024-05-28 17:30:14 +08:00
Haojun Liao
c3c6b680fb Merge branch '3.0' into fix/3_liaohj 2024-05-28 17:29:22 +08:00
Hongze Cheng
242b836eca compile error 2024-05-28 14:35:58 +08:00
Hongze Cheng
913612e4a6
Merge pull request #25913 from taosdata/enh/TS-4723-3.0 
enh: reduce compact block write time
 2024-05-28 13:18:57 +08:00
Haojun Liao
cc318d7e2d enh(stream): sink task does not initialize the backend. 2024-05-28 11:34:04 +08:00
Haojun Liao
bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
54liuyao
57bf9d1048 adj log 2024-05-28 10:56:43 +08:00
54liuyao
7fc2e8cc26 batch meta 2024-05-28 10:17:20 +08:00
Haojun Liao
be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Shungang Li
9947d8ec42 fix: last cache memory leak 2024-05-24 12:57:49 +08:00
Haojun Liao
89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00
Hongze Cheng
21ea1e3735 fix memory leak 2024-05-23 19:05:11 +08:00
Hongze Cheng
9531cba834 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-4723-3.0 2024-05-23 18:02:26 +08:00
Hongze Cheng
f729072044 enh: reduce compact block write time 2024-05-23 17:57:07 +08:00
54liuyao
441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
Shungang Li
0e76ba4034 fix: last cache update ts for col format 2024-05-22 15:15:41 +08:00
wangmm0220
f21eeae56c fix:[TD-30180]error in judging if groupId already added to the end of table name 2024-05-21 16:57:00 +08:00
Haojun Liao
f6af165d9a refactor(stream): add more info in info-meta 2024-05-21 10:09:55 +08:00
Haojun Liao
3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
dapan1121
68640f52be
Merge pull request #25833 from taosdata/fix/TS-4716-3.0 
fix:[TS-4716]wait too long if change system time
 2024-05-20 09:47:06 +08:00
Haojun Liao
93292d8149 other: merge 3.0 2024-05-18 09:58:36 +08:00
Haojun Liao
27c4e3634c refactor: do some internal refactor. 2024-05-17 17:04:05 +08:00
Shungang Li
bf40585f6c fix: cache update for last key 2024-05-17 16:41:26 +08:00
wangmm0220
3c0dbacf37 fix:[TS-4716]wait too long if change system time 2024-05-17 16:37:40 +08:00
Minglei Jin
7292d7a0ff fix(tsdb/cache): update array reference to fix missing tables/groupby 2024-05-17 14:59:20 +08:00
wangmm0220
b0cdf887b4 fix:[TS-4716]wait too long if change system time 2024-05-17 14:27:09 +08:00
Shungang Li
b79dda6689 enh: adjust order for row format cache update 2024-05-17 11:31:09 +08:00
Minglei Jin
3b8c27764d Merge branch '3.0' into fix/TD-29995-3.0 2024-05-17 10:17:33 +08:00
Haojun Liao
15181eb14b enh(tsdb): increase the capacity for return data. 2024-05-17 09:51:56 +08:00
Shungang Li
5c952fc922 enh: cleanup 2024-05-17 09:10:35 +08:00
Haojun Liao
5307f15766 refactor: do some internal refactor. 2024-05-16 19:54:29 +08:00
Haojun Liao
41b55cf4d6
Merge pull request #25792 from taosdata/fix/TD-29745-1 
adj code
 2024-05-16 13:56:31 +08:00
Shungang Li
fc047ddafc fix: last cache update rule 2024-05-16 09:30:27 +08:00
Hongze Cheng
9dd3f326ea
Merge pull request #25731 from taosdata/enh/TD-29968-3.0 
enh: grant support s3/active-active/dual-replica/db_encryption
 2024-05-15 15:52:28 +08:00
Haojun Liao
abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
54liuyao
2a67b83a27 adj code 2024-05-15 14:11:55 +08:00
Haojun Liao
43e018e210
Merge pull request #25733 from taosdata/fix/TD-29745 
optimize scan data
 2024-05-15 13:41:08 +08:00
54liuyao
167cdc79c5 format code 2024-05-15 10:54:53 +08:00
54liuyao
4c603fee55 format code 2024-05-15 10:54:24 +08:00
54liuyao
3c56f623ed adj inline func 2024-05-15 10:46:19 +08:00
54liuyao
ab3ba3f2e4 optimize scan tsdb 2024-05-15 09:09:20 +08:00
Haojun Liao
a3bd3a4c76
Merge pull request #25769 from taosdata/fix/TS-4791 
fix(tsdb): fix the length of column type overflow.
 2024-05-15 00:44:59 +08:00
Haojun Liao
610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao
9300b7a401 fix(tsdb): fix the length of column type overflow. 2024-05-14 16:22:11 +08:00
Haojun Liao
6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Minglei Jin
b6eec20dfb fix(s3/grant): checking grant when doing migrate 2024-05-14 11:01:06 +08:00
Shungang Li
694680600e fix: tsdbCache vartype of zero size 2024-05-14 09:23:32 +08:00
Haojun Liao
b7e7de0354 fix(stream): set the stream task load flag. 2024-05-13 16:45:38 +08:00
Haojun Liao
3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
t_max
f030af3aab fix: build fails on macOS and Windows 2024-05-11 14:59:05 +08:00
Haojun Liao
d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
Haojun Liao
7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Hongze Cheng
4d4fa9ea94
Merge pull request #25703 from taosdata/fix/TD-29912 
fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit
 2024-05-10 15:29:44 +08:00
Hongze Cheng
db68b9a1f0
Merge pull request #25707 from taosdata/fix/TD-29981 
fix: refactor lastcache ser/des for compatibility
 2024-05-10 09:15:29 +08:00
Shungang Li
0ac5d393e6 fix: tsdbcache last disk data format change 2024-05-09 23:37:28 +08:00
Shungang Li
544999c01b fix: tsdbCacheSerialize copy from null ptr 2024-05-09 22:55:29 +08:00
Shungang Li
457b98fee8 fix: adjust SValueV0 data order 2024-05-09 21:52:43 +08:00
Shungang Li
7ae4415890 fix: refactor lastcache ser/des for compatibility 2024-05-09 19:04:11 +08:00
Shungang Li
6895bb121f fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit 2024-05-09 14:55:48 +08:00
dmchen
454b4047cb fix/audit-memory-leak 2024-05-09 10:19:14 +08:00
Hongze Cheng
e76d15e33f
Merge pull request #25690 from taosdata/fix/TD-29962 
enh: refactor tsdbCache ser/des
 2024-05-09 09:04:09 +08:00
Shungang Li
70598a3038 enh: refactor tsdbCache ser/des 2024-05-09 00:13:19 +08:00
Hongze Cheng
9e21eacf26
Merge pull request #25687 from taosdata/fix/TD-29934-3.0 
fix(tsdb/cache-update): compare when rocks's colVal not null
 2024-05-08 21:48:01 +08:00
Minglei Jin
3d1612e44b fix(tsdb/cache-update): compare when rocks's colVal not null 2024-05-08 19:27:43 +08:00
Hongze Cheng
431c3c0066
Merge pull request #25675 from taosdata/fix/TD-29934-3.0 
fix(tsdb/cache-update): discard none colVals for same timestamp
 2024-05-08 18:54:17 +08:00
Minglei Jin
bb227a9798 fix(tsdb/cache-update): discard none colVals for same timestamp 2024-05-08 17:29:07 +08:00
Shungang Li
733c8f8f9a fix: (compatibility) SLastCol field change cause 'last' crash 2024-05-08 16:12:43 +08:00
Haojun Liao
b26656fd1c
Merge pull request #25661 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-05-08 13:03:13 +08:00
Haojun Liao
cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao
55a630911d
Merge pull request #25653 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-05-07 23:12:30 +08:00
Haojun Liao
b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Hongze Cheng
c4b2f5681c
Merge pull request #25654 from taosdata/fix/TD-29845 
fix: fix last col version when updating rocks
 2024-05-07 11:33:51 +08:00
Haojun Liao
0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Minglei Jin
562bf0fe1e tsdb/cache: fix last col version when updating rocks 2024-05-07 10:24:07 +08:00
Shungang Li
b979c584fb fix: tsdbCacheGetBatch ref of tmp memory 2024-05-07 10:22:58 +08:00
Haojun Liao
18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao
7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao
cdc7b03ac6 fix(stream): fix syntax error. 2024-04-30 22:44:32 +08:00
Haojun Liao
732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao
94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao
629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao
f2bc93b78d
Merge pull request #25598 from taosdata/fix/3_liaohj 
refactor(stream): opt stream sink perf.
 2024-04-30 16:59:22 +08:00
dapan1121
f54dd2b818
Merge pull request #25602 from taosdata/fix/TS-4728-3.0 
fix:use path of SStreamMeta
 2024-04-30 16:12:50 +08:00
Haojun Liao
cb5a0563e6 fix(stream): fix error caused by merge. 2024-04-30 15:43:12 +08:00
wangmm0220
35003cbb34 fix:use path of SStreamMeta 2024-04-30 14:36:16 +08:00
Haojun Liao
4c27af9b13 refactor: do some internal refactor. 2024-04-30 13:25:39 +08:00
wangmm0220
3a1c210601 fix:use path of SStreamMeta 2024-04-30 11:06:03 +08:00
Haojun Liao
54e9522c62 refactor(stream): opt stream sink perf. 2024-04-30 09:41:29 +08:00
dapan1121
6187bf4e06
Merge pull request #25584 from taosdata/fix/TS-4728-3.0 
fix:[TS-4728]transform store data if data is too big
 2024-04-30 09:02:40 +08:00
wangmm0220
cd3f3046f7 fix:memory leak 2024-04-29 19:36:41 +08:00
wangmm0220
1f85cb42e6 fix:[TS-4728]transform strore data if data is too big 2024-04-29 17:22:40 +08:00
Haojun Liao
b0ef022e87 fix(tsdb): set the correct start pos for binary search. 2024-04-29 15:13:52 +08:00
Haojun Liao
7a5cdb81d5 fix(tsdb): set the correct start pos for binary search. 2024-04-29 14:40:49 +08:00
Haojun Liao
bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Haojun Liao
324072fed8
Merge pull request #25525 from taosdata/fix/3_liaohj 
fix(stream): update stream task meta info.
 2024-04-26 18:15:09 +08:00
Haojun Liao
6d06188b9f fix(stream): fix memory leak. 2024-04-26 17:06:15 +08:00
Haojun Liao
b1b3246066 fix(stream): update the checkpoint executed transId range. 2024-04-26 17:03:01 +08:00
Haojun Liao
5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj 
fix(stream): add task node into update list if it is timeout for more than 100sec.
 2024-04-26 17:00:23 +08:00
Haojun Liao
8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Hongze Cheng
efdc943a3d Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 14:57:58 +08:00
Haojun Liao
c565e31638
Merge pull request #25510 from taosdata/fix/3_liaohj 
fix(stream): handle disorder node Update trans Id.
 2024-04-26 12:44:00 +08:00
Haojun Liao
815489d20a fix(tsdb): set the pk info when converting fileblockinfo to binrecord. 2024-04-26 11:10:20 +08:00
Haojun Liao
77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
Haojun Liao
feb176149e
Merge pull request #25507 from taosdata/fix/3_liaohj 
fix(tsdb): overlap check take pk into consideration.
 2024-04-26 09:06:38 +08:00
Hongze Cheng
f500762af7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 09:00:09 +08:00
Haojun Liao
59a3e8ca40 fix(tsdb): overlap check take pk into consideration. 2024-04-25 23:25:24 +08:00
Haojun Liao
b3d2ccec83
Merge pull request #25483 from taosdata/fix/3_liaohj 
fix(query): add ts in cache_scan_operator if pk exists and only retri…
 2024-04-25 22:32:26 +08:00
Haojun Liao
eef5e6e409 fix(stream): fix syntax error. 2024-04-25 18:30:33 +08:00
Haojun Liao
3b932599ab fix(stream): fix syntax error. 2024-04-25 17:47:03 +08:00
Minglei Jin
eaa1e7a775 tsdb/writer: use latest version of data for writing 2024-04-25 16:40:58 +08:00
Haojun Liao
cd8baa7ba0 fix(stream): add log for update task epset, set correct update flag if epset updated. 2024-04-25 16:39:11 +08:00
Minglei Jin
a9094d7602 fix(cos/multi-writing): use lasted version of data 2024-04-25 16:37:24 +08:00
Hongze Cheng
10d82a3acf
Merge pull request #25476 from taosdata/enh/TS-4710-3.0 
enh: recover file
 2024-04-25 11:15:02 +08:00
Hongze Cheng
ca9aebc5ff
Merge pull request #25473 from taosdata/fix/TD-29773 
Fix/TD-29773
 2024-04-25 09:45:47 +08:00
Haojun Liao
ac860f7fe8 fix(query): add ts in cache_scan_operator if pk exists and only retrieve ts column. 2024-04-25 09:29:42 +08:00
Haojun Liao
3b08ee3d16
Merge pull request #25458 from taosdata/fix/3_liaohj 
fix(stream): add task update trans conflict level.
 2024-04-24 18:54:06 +08:00
Hongze Cheng
2cac0d5691 enh: recover file 2024-04-24 18:04:10 +08:00
dapan1121
ab2c9aaf5b
Merge pull request #25466 from taosdata/enh/TD-29758 
enh:[TD-29758]optimize log in tmq
 2024-04-24 17:47:28 +08:00
Yihao Deng
1181f9de28 Fix metaGetColCmpr function and remove commented code 2024-04-24 08:22:54 +00:00
Hongze Cheng
b1fb14e49e
Merge pull request #25465 from taosdata/fix/TD-29759 
fix(s3migrate/datas3): init fd of from & to early
 2024-04-24 11:29:47 +08:00
Hongze Cheng
c3275dc61c
Merge pull request #25459 from taosdata/fix/TD-29750-3.0 
fix: if not exists logic for topic/stream/table
 2024-04-24 10:52:53 +08:00
Hongze Cheng
0eae851257
Merge pull request #25425 from taosdata/fix/ci_monitor_memory 
fix ci monitor memory
 2024-04-24 10:35:04 +08:00
wangmm0220
20cedc3339 enh:[TD-29758]optimize log in tmq 2024-04-24 10:02:58 +08:00
Minglei Jin
c76f886c91 fix(s3migrate/datas3): init fd of from & to early 2024-04-24 09:36:44 +08:00
kailixu
c173be667c Merge branch '3.0' into fix/TD-29750-3.0 2024-04-24 08:44:43 +08:00
Haojun Liao
ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
Cary Xu
44b4580bd5
Update metaTable.c 2024-04-23 18:37:40 +08:00
kailixu
89ee62ac09 fix: if not exists logic for topic/stream/table 2024-04-23 18:19:16 +08:00
Haojun Liao
0f8ff48c6b fix(stream): fix double free 2024-04-23 18:18:01 +08:00
Haojun Liao
0c7373509e fix(stream): add task update trans conflict level. 2024-04-23 18:07:00 +08:00
Hongze Cheng
328f95f7cb fix: possible write block when error occurs 2024-04-23 16:48:49 +08:00
Haojun Liao
7fda9d9fcb Merge branch '3.0' into fix/3_liaohj 2024-04-23 15:08:43 +08:00
Haojun Liao
b0f68a9147 refactor: do some internal refactor. 2024-04-23 14:58:51 +08:00
Haojun Liao
1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
Haojun Liao
d7a08909dd
Merge pull request #25442 from taosdata/fix/3_liaohj 
fix(stream): save the epset if task epset updated.
 2024-04-23 09:10:45 +08:00
Haojun Liao
315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00
Haojun Liao
ada1c6d4c0
Merge pull request #25434 from taosdata/fix/3_liaohj 
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
 2024-04-22 22:13:19 +08:00
Haojun Liao
a8fac441be fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure. 2024-04-22 14:02:31 +08:00
Yihao Deng
541b070765 Remove commented out code in metaCreateSTable function 2024-04-20 07:45:39 +00:00
Yihao Deng
ba30339d4e Refactor meteDecodeColCmprEntry function to return -1 on error 2024-04-20 03:07:12 +00:00
Yihao Deng
517365467d Merge branch '3.0' into fix/compatibleWithVeryOldMeta 2024-04-20 01:54:02 +00:00
Haojun Liao
e5dddc4abf Merge branch '3.0' into fix/3_liaohj 2024-04-19 19:13:28 +08:00
Haojun Liao
ea527b19b8 fix(stream): set correct start version if no checkpoint exist. 2024-04-19 19:12:23 +08:00
dmchen
62bc1074c0 fix monitor memory 2024-04-19 10:44:08 +00:00
dapan1121
a46b7cca3d
Merge pull request #25413 from taosdata/feat/TS-4243-tmq 
opti:raw data from tmq
 2024-04-19 18:22:21 +08:00
Yihao Deng
18cdeaf960 compatible with older meta 2024-04-19 07:37:43 +00:00
Hongze Cheng
69222543a2
Merge pull request #25401 from taosdata/fix/TD-29562 
Fix/td 29562
 2024-04-19 13:57:19 +08:00
wangmm0220
1695824c73 fix:merge from 3.0 2024-04-19 13:52:57 +08:00
wangmm0220
42467c0e00 opti:raw data from tmq 2024-04-19 13:48:17 +08:00
Hongze Cheng
fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834 
Feat/td 24834
 2024-04-19 13:34:37 +08:00
Haojun Liao
62260bff79
Merge pull request #25389 from taosdata/fix/3_liaohj 
fix(stream): reset checkpoint info after receiving task-reset info.
 2024-04-19 11:23:55 +08:00
Hongze Cheng
e4e00c8953
Merge pull request #25403 from taosdata/fix/TD-29621 
fix: geometry crash in stream & tmq
 2024-04-19 11:15:26 +08:00
Yihao Deng
2314771209 fix TD-29562 2024-04-19 02:09:40 +00:00
Yihao Deng
ee8a96fb42 fix TD-29562 2024-04-19 02:04:32 +00:00
Haojun Liao
34f7dc4782
Merge pull request #25404 from taosdata/feat/TS-4243-3.0 
fix(tsdb): set correct compare func for merge tree.
 2024-04-19 09:10:03 +08:00
Haojun Liao
eb1fed177f fix(tsdb): set correct compare func for merge tree. 2024-04-19 00:32:41 +08:00
Haojun Liao
525b574c85
Merge pull request #25402 from taosdata/feat/TS-4243-3.0 
fix(tsdb): update the initial value of pk for varchar type.
 2024-04-18 19:49:05 +08:00
Shungang Li
f3438ce04e fix: geometry crash in stream & tmq 2024-04-18 19:27:02 +08:00
Haojun Liao
815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao
4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Hongze Cheng
05d853bd9e
Merge pull request #25383 from taosdata/fix/dropStreamData 
Fix/drop stream data
 2024-04-18 17:10:57 +08:00
Hongze Cheng
874b4b1911
Merge pull request #25400 from taosdata/enh/TD-28945-pk 
fix(vnode): encode the missing tsdbPageSize
 2024-04-18 17:04:29 +08:00
Haojun Liao
8962010caf other: merge 3.0 2024-04-18 16:31:15 +08:00
Haojun Liao
c94c9a900c fix(tsdb): update the initial value of pk for varchar type. 2024-04-18 16:17:29 +08:00
Yihao Deng
d21341c943 fix TD-29562 2024-04-18 08:16:40 +00:00
kailixu
20c4385d27 Merge branch '3.0' into feat/TD-24834 2024-04-18 15:54:01 +08:00
Yihao Deng
3f4fa8b74e fix TD-29562 2024-04-18 07:03:18 +00:00
Minglei Jin
eb51a7c5b5 vnode: encode the missing tsdbPageSize 2024-04-18 14:48:05 +08:00
Hongze Cheng
a4edab720c
Merge pull request #25391 from taosdata/enh/TD-28945-pk 
cos/multi-writing: init fid & cid for s3 page cache
 2024-04-18 14:05:28 +08:00
Haojun Liao
deee0c3793 refactor: do some internal refactor. 2024-04-18 13:05:45 +08:00
Haojun Liao
d5d23b0434 fix(tsdb): set reader status normal once successful taking snapshot. 2024-04-18 13:05:44 +08:00
Minglei Jin
8ca2b08d5c cos/multi-writing: fix remove_file with -1 lcn 2024-04-18 08:48:44 +08:00
Haojun Liao
9056a48efd refactor: do some internal refactor. 2024-04-17 21:58:02 +08:00
Haojun Liao
ac84a5f82b refactor: do some internal refactor. 2024-04-17 21:57:09 +08:00
Minglei Jin
7034cbee22 cos/multi-writing: init fid & cid for s3 page cache 2024-04-17 19:48:50 +08:00
Haojun Liao
ddf98ae0c2 refactor: do some internal refactor. 2024-04-17 18:04:02 +08:00
Haojun Liao
289ec6cf66 fix(stream): reset checkpoint info after receiving task-reset info. 2024-04-17 17:57:12 +08:00
dm chen
1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
Hongze Cheng
a34b644640
Merge pull request #25366 from taosdata/feat/compress_3.0 
Feat/compress 3.0
 2024-04-17 16:15:26 +08:00
Yihao Deng
354f33fa88 drop stream data 2024-04-17 05:38:45 +00:00
Yihao Deng
74b7bf6bbc drop stream data 2024-04-17 05:37:35 +00:00
Haojun Liao
2ce7d18e94 refactor: do some internal refactor. 2024-04-17 11:35:03 +08:00
Haojun Liao
69cb630e7f fix(tsdb): update the compare func. 2024-04-17 11:32:48 +08:00
Yihao Deng
04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
kailixu
74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
dapan1121
5936d3a1b0
Merge pull request #25300 from taosdata/draft/tsma_before_ci 
feat: support tsma
 2024-04-17 10:00:17 +08:00
Haojun Liao
a439f61708
Merge pull request #25375 from taosdata/fix/3_liaohj 
fix(stream): generate the checkpoint id
 2024-04-16 19:41:07 +08:00
wangjiaming0909
fb72e29fe1 fix stream progress delay 2024-04-16 18:17:33 +08:00
Yihao Deng
6f9de676f0 Merge branch 'fix/compress_3.0' into feat/compress_3.0 2024-04-16 09:27:26 +00:00
Haojun Liao
8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
wangjiaming0909
1978a06e6e merge with 3.0 2024-04-16 14:27:06 +08:00
wangjiaming0909
6ce0616ffd fix ci and TODOs 2024-04-16 14:25:34 +08:00
wangjiaming0909
a2cbbba24d find TODO 2024-04-16 14:23:26 +08:00
wangjiaming0909
a8e00f7410 drop tb in transaction 2024-04-16 14:23:26 +08:00
wangjiaming0909
3d77e8432d support rm ttl tb 2024-04-16 14:23:26 +08:00
wangjiaming0909
c3e73d9168 fix recursive tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909
d8200b2f63 fetch lastts vnode version before create tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909
8e56d9a359 fix tsmas 2024-04-16 14:18:10 +08:00
wangjiaming0909
e947a2fb0d catalog cache get stream progress 2024-04-16 14:18:10 +08:00
wangjiaming0909
a4d2dfed67 stream supported api 2024-04-16 14:18:10 +08:00
Haojun Liao
e0cb17211b
Merge pull request #25358 from taosdata/feat/TS-4243-3.0 
fix: extracted data block shall initialize pks of datablock info
 2024-04-16 13:30:48 +08:00
dm chen
aedec5ead7
Merge branch '3.0' into feat/TD-24834 2024-04-16 11:35:49 +08:00
Hongze Cheng
ace8f30bdf
Merge pull request #25361 from taosdata/fix/TD-29560-3.0 
fix: drop table after commit
 2024-04-16 11:15:29 +08:00
Haojun Liao
51dfa20cf4 fix(tsdb): set correct initial value for compare. 2024-04-16 10:13:15 +08:00
Haojun Liao
ee62b66b07 Merge branch 'enh/TD-28945-pk' into fix/3_liaohj 2024-04-15 19:15:39 +08:00
Haojun Liao
13bd296d58 Merge branch '3.0' into fix/3_liaohj 2024-04-15 18:53:48 +08:00
Haojun Liao
d92f0706e7 fix(tsdb): check the boundary value when reseting range. 2024-04-15 18:43:58 +08:00
Haojun Liao
1ac192c069 fix(stream): keep the original tsdb scan version range. 2024-04-15 18:41:38 +08:00
Yihao Deng
ce137d3084 Merge branch 'enh/TD-28945-pk' into feat/compress_3.0 2024-04-15 10:36:13 +00:00
Minglei Jin
9cce9c221d cos/multi-write: empty impl for tsdb async compact 2024-04-15 18:32:06 +08:00
Hongze Cheng
29194df1ec Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-29560-3.0 2024-04-15 18:26:21 +08:00
Hongze Cheng
b936969a01 more fix 2024-04-15 18:25:23 +08:00
Yihao Deng
a7722fbf3c Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:33:15 +00:00
Yihao Deng
ea9385912f Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:06:30 +00:00
dmchen
9a99b8526d resolve conflict 2024-04-15 08:24:40 +00:00
kailixu
123090e18a fix: solve conflicts 2024-04-15 16:12:15 +08:00
Hongze Cheng
ac2853f28c fix: drop table after commit 2024-04-15 15:36:54 +08:00
dmchen
a6c36a6cf3 resolve conflict 2024-04-15 07:36:41 +00:00
dm chen
4d660d89c0
Merge branch '3.0' into feat/TD-24834 2024-04-15 15:12:32 +08:00
Haojun Liao
665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
dmchen
0526618fe5 resolve conflict 2024-04-15 03:45:37 +00:00
yihaoDeng
4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00
Minglei Jin
4b3e3f9091 Merge branch '3.0' into enh/TD-28945-pk 2024-04-15 09:31:56 +08:00
Minglei Jin
e14d4e172d cos/multi-writing: fix remove with different version 2024-04-15 09:30:24 +08:00
Haojun Liao
15c18af221 fix(stream): fix init error. 2024-04-13 18:27:38 +08:00
Haojun Liao
46fd0cb0b5 fix(tsdb): set correct initial value 2024-04-12 23:32:47 +08:00
Haojun Liao
27af9de628 fix(tsdb):add placeholder if no rowkeys exist. 2024-04-12 22:16:48 +08:00
Haojun Liao
528497944c fix(tsdb): update log. 2024-04-12 19:03:03 +08:00
Haojun Liao
df4dd2ec93 fix(tsdb): update log. 2024-04-12 18:57:27 +08:00
Haojun Liao
ffe5bb4024 fix(tsdb): update log. 2024-04-12 18:46:39 +08:00
Haojun Liao
6d1c07e3a5 fix(tsdb): fix syntax error. 2024-04-12 18:39:29 +08:00
Haojun Liao
2b6f02f894 fix(tsdb): add some logs. 2024-04-12 18:37:03 +08:00
Haojun Liao
04227904ea fix(tsdb): adjust assert. 2024-04-12 18:30:02 +08:00
Haojun Liao
0656ba1bf2 fix(tsdb):add assert 2024-04-12 18:16:59 +08:00
Haojun Liao
f398e5b5e5 fix(tsdb): update code. 2024-04-12 18:05:21 +08:00
Haojun Liao
cf30db8795 fix(tsdb): fix invalid empty time window check. 2024-04-12 17:52:52 +08:00
Haojun Liao
6127185e3b fix(tsdb): set correct initial value for compare. 2024-04-12 14:10:43 +08:00
Haojun Liao
2b953735bc Merge remote-tracking branch 'origin/feat/TS-4243-3.0' into feat/TS-4243-3.0 2024-04-12 13:51:43 +08:00
Haojun Liao
1e89b86827 refactor: do some internal refactor. 2024-04-12 13:51:29 +08:00
yihaoDeng
e3acb10acd Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-12 11:10:00 +08:00
Minglei Jin
16b65b7311 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-12 10:32:25 +08:00
Haojun Liao
d799212fb2 refactor: do some internal refactor. 2024-04-12 10:02:18 +08:00
wangmm0220
ca8153fb98 fix:filter data error & add test case 2024-04-12 09:49:08 +08:00
Haojun Liao
efdd0c8a2a refactor: do some internal refactor. 2024-04-11 22:34:47 +08:00
Haojun Liao
5ee40fb5c9 fix(tsdb): fix invalid free 2024-04-11 18:38:17 +08:00
wangmm0220
035b61218c fix:filter data error & add test case 2024-04-11 18:01:27 +08:00
Haojun Liao
14242331b9 fix(tsdb): fix error in decode key. 2024-04-11 17:25:58 +08:00
wangmm0220
2478519c5d Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-11 17:16:16 +08:00
Haojun Liao
b4ea80b637 fix(tsdb): prepare the pk buf for blocks generated by reader. 2024-04-11 17:09:07 +08:00
wangmm0220
f609a45dd2 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-11 16:21:14 +08:00
Minglei Jin
6515d74fa2 Merge branch '3.0' into enh/TD-28945-pk 2024-04-11 16:02:01 +08:00
54liuyao
1d42e927c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-04-11 15:35:42 +08:00
Haojun Liao
a3bbf3ba0e fix(tsdb): check numOfPks before load pk 2024-04-11 15:16:21 +08:00
Haojun Liao
1751b84188 Merge remote-tracking branch 'origin/feat/TS-4243-3.0' into feat/TS-4243-3.0 2024-04-11 14:32:18 +08:00
Haojun Liao
312f7864c8 refactor: do some internal refactor. 2024-04-11 14:32:17 +08:00
kailixu
e0f7b14ffa fix: eliminate double free 2024-04-11 11:41:05 +08:00
Haojun Liao
563efeb560 fix(tsdb): fix memory leak. 2024-04-11 11:09:57 +08:00
kailixu
3738ce9e10 chore: solve conflicts of sql.c 2024-04-11 11:05:58 +08:00
Haojun Liao
1f85a47cab fix(tsdb): fix memory leak. 2024-04-11 10:47:05 +08:00
Haojun Liao
9f95360ecc fix(tsdb): fix error in read rowkey with null. 2024-04-11 10:14:15 +08:00
Haojun Liao
79be7eea8c fix(tsdb): fix invalid read, and do some internal refactor. 2024-04-11 10:06:07 +08:00
Haojun Liao
e261023ee6 fix(stream): add lock, and fix race condition. 2024-04-10 18:42:44 +08:00
Haojun Liao
f0beceb5eb fix(tsdb): check for the duplicated ts in delete-skyline. 2024-04-10 18:32:08 +08:00
Haojun Liao
9811a9e216 fix(tsdb): deep copy the pk for varchar type. 2024-04-10 18:06:58 +08:00
dmchen
8875311f23 remove log output 2024-04-10 09:04:53 +00:00
yihaoDeng
a02426fd2f Merge branch '3.0' into feature/compressData 2024-04-10 09:03:50 +00:00
Haojun Liao
ded66fc4e5 Merge branch 'feat/TS-4243-3.0' of github.com:taosdata/tdengine into feat/TS-4243-3.0 2024-04-10 16:43:54 +08:00
Haojun Liao
f23a8a37bc refactor: do some internal refactor. 2024-04-10 16:43:02 +08:00
wangmm0220
539d1f441f Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-10 16:41:15 +08:00
wangmm0220
d3fa85b7bd fix:make log different to locate the cause 2024-04-10 16:40:12 +08:00
Minglei Jin
0761692b14 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-10 16:30:06 +08:00
Hongze Cheng
1bcf693f07 more code 2024-04-10 15:06:43 +08:00
Minglei Jin
fe12f87c58 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-10 11:21:50 +08:00
Minglei Jin
dcd9901d5f Merge branch '3.0' into feat/TS-4243-3.0 2024-04-10 11:18:19 +08:00
Haojun Liao
980382d433 fix(tsdb): fix memory error. 2024-04-10 11:18:08 +08:00
Minglei Jin
d1cb05bba0 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-10 09:09:51 +08:00
Minglei Jin
6eb014e32b Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-09 19:11:46 +08:00
Haojun Liao
881ae3e040
Merge pull request #25310 from taosdata/fix/3_liaohj 
fix(stream): add dropped stream task check.
 2024-04-09 19:09:57 +08:00
Shungang Li
b664e2078b fix: last memory errors 2024-04-09 18:33:33 +08:00
Haojun Liao
22b0067819 fix(stream): add dropped stream task check. 2024-04-09 17:58:03 +08:00
Shungang Li
dd55034c94 fix: pk last write error 2024-04-09 17:43:10 +08:00
dmchen
5f31575624 refactor 2024-04-09 06:55:01 +00:00
Haojun Liao
87b04c4eea fix(stream): add null check. 2024-04-09 14:52:51 +08:00
wangmm0220
da6eda6912 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-09 13:44:09 +08:00
dmchen
239acea831 remove useless vnode cfg 2024-04-09 02:38:45 +00:00
Haojun Liao
df516703e1 fix(stream): check the pk during merge rows with identical timestamp. 2024-04-09 10:22:13 +08:00
dapan1121
a3abc775ea
Merge pull request #25295 from taosdata/mark/3.0 
fix:send data to large in tmq if subscribe stable
 2024-04-09 10:10:03 +08:00
54liuyao
9ed74085d8 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-09 09:16:57 +08:00
wangmm0220
ccc3491cdd fix:send data to large in tmq if subscribe stable 2024-04-08 18:39:35 +08:00
54liuyao
53265e9e09 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-08 17:24:09 +08:00
Haojun Liao
ee7d25602e fix(tsdb): fix error in retrieve varchar pk. 2024-04-08 15:40:52 +08:00
Haojun Liao
33b1391b9a fix(cache): fix memory leak, and update some test cases. 2024-04-08 11:33:26 +08:00
Minglei Jin
a407f76165 Merge branch '3.0' into enh/TD-28945 2024-04-08 10:55:47 +08:00
Haojun Liao
e3b246a1e9 Merge remote-tracking branch 'origin/feat/TS-4243-3.0' into feat/TS-4243-3.0 2024-04-08 10:44:26 +08:00
Haojun Liao
97f7e67234 fix(tsdb): set correct merge row. 2024-04-08 10:44:10 +08:00
Minglei Jin
d5e9169769 cos/multi-write: dnode part including mnode/vnode/tsdb 2024-04-08 10:31:49 +08:00
Shungang Li
bc1c7545a8 mock commit for pk last read, need to revert 2024-04-07 17:31:06 +08:00
Shungang Li
b649a73a19 feat: pk insert/drop last cache 2024-04-07 17:30:54 +08:00
kailixu
b4c8375cb9 chore: solve conflicts 2024-04-07 14:53:05 +08:00
Haojun Liao
16c17bbf72 fix(tsdb): fix error in tsdbread. 2024-04-07 14:46:22 +08:00
dmchen
c43e937538 write config lock 2024-04-07 02:24:41 +00:00
Haojun Liao
ead77fe767 fix(tsdb): fix memory leak. 2024-04-07 10:23:51 +08:00
Haojun Liao
e7ed8fbaa6 fix(tsdb): not copy range key if no pk exists. 2024-04-06 00:10:24 +08:00
Haojun Liao
dc954e112e fix(tsdb): add key for lastProcessKey, and remove invalid assign for key 2024-04-05 19:47:59 +08:00
Haojun Liao
5184e444df Merge branch '3.0' into fix/3_liaohj 2024-04-02 18:45:49 +08:00
Haojun Liao
24559725da fix(stream): add lock for when set checkpoint dispatch msg. 2024-04-02 18:45:30 +08:00
yihaoDeng
a7058668d5 fix compatible error 2024-04-02 10:41:38 +00:00
Haojun Liao
94e6f96a75 other: merge 3.0 2024-04-02 13:39:26 +08:00
yihaoDeng
684055bc7c Merge branch '3.0' into feature/compressData 2024-04-02 04:20:39 +00:00
yihaoDeng
d85ae3c26e fix invalid free 2024-04-02 12:14:02 +08:00
Haojun Liao
aff681ac64 fix(tsdb):set correct varchar type compare function. 2024-04-02 10:43:38 +08:00
dmchen
d06bfd9cea free and log 2024-04-02 02:30:56 +00:00
yihaoDeng
cb27761e66 Merge branch '3.0' into feature/compressData 2024-04-01 13:14:37 +00:00
Hongze Cheng
c28ee64477 fix: meta snapshot drop table error 2024-04-01 21:11:35 +08:00
yihaoDeng
ec35f5718e fix invalid free 2024-04-01 19:58:04 +08:00
dmchen
a1b7444a48 refactor 2024-04-01 09:39:29 +00:00
yihaoDeng
a77d98cab6 Merge branch '3.0' into feature/compressData 2024-04-01 08:40:50 +00:00
kailixu
c4aba0ac37 feat: encryption key optimize and test case adjust 2024-04-01 16:14:55 +08:00
yihaoDeng
53ecfe511a Merge branch '3.0' into feature/compressData 2024-04-01 08:04:16 +00:00
kailixu
717c4b3d9c chore: restore codes 2024-04-01 14:01:09 +08:00
kailixu
6eaa99bb2d feat: encryption algorithm 2024-04-01 13:58:13 +08:00
yihaoDeng
237ec5a46c fix ci error 2024-04-01 01:39:50 +00:00
wangmm0220
fe7a42b118 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-01 09:11:39 +08:00
yihaoDeng
22f9830bbb fix ci error 2024-03-31 12:51:27 +00:00
yihaoDeng
e71eefddfc Merge branch 'feat/TS-4243-3.0' into feature/compressData 2024-03-30 14:58:29 +00:00
yihaoDeng
cad8fec42e Merge branch '3.0' into feature/compressData 2024-03-30 13:59:45 +00:00
yihaoDeng
aa5ccf2b0b Merge branch '3.0' into feature/compressData 2024-03-30 09:57:23 +00:00
yihaoDeng
0cce8df6b5 Merge branch '3.0' into feature/compressData 2024-03-30 02:00:24 +00:00
yihaoDeng
d7cee5dd80 fix invalid compress/decompress 2024-03-29 13:48:58 +00:00
Haojun Liao
dd2f6287ec fix(tsdb): fix rowkey assign error. 2024-03-29 18:59:29 +08:00
Haojun Liao
55bb6ab341 fix(tsdb): set correct initial value for compare 2024-03-29 18:15:03 +08:00
yihaoDeng
b7067e61c8 fix ci error 2024-03-29 08:40:19 +00:00
kailixu
8dce61b68f chore: merge TD-29280-3.0 2024-03-29 11:39:46 +08:00
dmchen
b9deb71fc5 basic function 2024-03-29 02:48:49 +00:00
factosea
9ddc0b51cb merge 2024-03-29 10:37:59 +08:00
wangmm0220
8e2a2414c0 fix:same subtable same partition by leads to same table name in stream 2024-03-28 13:48:46 +08:00
kailixu
d64594932b feat: support database encryption 2024-03-27 20:03:38 +08:00
Haojun Liao
a2112625f9 fix(tsdb): set correct uid list. 2024-03-27 15:06:51 +08:00
yihaoDeng
18986c0ced refactor code 2024-03-26 12:44:53 +00:00
Haojun Liao
f61596706d fix(tsdb): add attributes for cache scan optr. 2024-03-26 17:34:30 +08:00
yihaoDeng
02e0e45183 refactor code 2024-03-26 08:50:21 +00:00
Hongze Cheng
ee4dda56c1 more code 2024-03-26 14:43:28 +08:00
yihaoDeng
ab69c2e750 refactor code 2024-03-26 03:28:31 +00:00
Haojun Liao
52a04cd008 fix(tsdb): fix bug for filter brin record. 2024-03-26 10:55:56 +08:00
Haojun Liao
765546585a
Merge pull request #25184 from taosdata/fix/3_liaohj 
fix(stream): not return error when failing to load stream task meta.
 2024-03-26 10:29:42 +08:00
Haojun Liao
a70d5a4947 fix(tsdb): fix bug during filtering brin records. 2024-03-26 09:50:06 +08:00
Haojun Liao
9638f8d7fc fix(tsdb): set the correct sttkey 2024-03-26 00:14:46 +08:00
Haojun Liao
a11b2c614e fix(stream): not return error when failing to load stream task meta. 2024-03-25 23:49:26 +08:00
Haojun Liao
5c729cc836 refactor: do some internal refactor. 2024-03-25 17:57:59 +08:00
Haojun Liao
750ea5789f fix(tsdb): fix errors identified by CI. 2024-03-25 14:20:46 +08:00
Minglei Jin
ea424e822e fix(tsdb/util): fix missing column value with row iter 2024-03-25 11:00:33 +08:00
Haojun Liao
75d6b1edde fix(tsdb): fix the bug caused by sttKey changing. 2024-03-25 09:59:10 +08:00
yihaoDeng
54294f6479 refactor code 2024-03-24 09:24:40 +00:00
yihaoDeng
3ccf9942a9 refactor code 2024-03-24 05:35:07 +00:00
Haojun Liao
447b8ddd32 fix(tsdb): remove invalid assert. 2024-03-23 23:33:40 +08:00
yihaoDeng
2d6c9ec7de fix mem problem 2024-03-23 12:56:24 +00:00
yihaoDeng
cbb4e83fc4 fix mem problem 2024-03-23 12:12:39 +00:00
yihaoDeng
f5c8c8f7c5 fix mem problem 2024-03-23 11:49:09 +00:00
Haojun Liao
c35e834141 fix(tsdb): fix error. 2024-03-23 00:11:21 +08:00
Haojun Liao
17a65430cd fix(tsdb): remove assert 2024-03-22 18:42:54 +08:00
wangmm0220
912cb09839 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-03-22 18:22:13 +08:00
Haojun Liao
ef6ea16d64 other: merge 3.0 2024-03-22 17:57:25 +08:00
Haojun Liao
9f492a8962 other: merge 3.0 2024-03-22 17:53:11 +08:00
wangmm0220
f1853ced26 feat:[TS-4243] add logic for primark key in tmq 2024-03-22 17:48:59 +08:00
Haojun Liao
ca28bb60ef refactor: do some internal refactor. 2024-03-22 17:32:12 +08:00
Haojun Liao
5808c1b86f refactor: do some internal refactor. 2024-03-22 17:31:44 +08:00
Haojun Liao
cbf22ed72a refactor: do some internal refactor. 2024-03-22 17:26:56 +08:00
Haojun Liao
018e6f2a71 refactor: do some internal refactor. 2024-03-22 17:18:31 +08:00
Haojun Liao
2ec24c1e04 refactor: do some internal refactor. 2024-03-22 16:43:34 +08:00
Hongze Cheng
e36e7d0427 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-22 15:14:32 +08:00
Hongze Cheng
974691e84b fix coredump 2024-03-22 15:14:23 +08:00
Haojun Liao
7d2110bb12 refactor: do some internal refactor. 2024-03-22 15:09:30 +08:00
Haojun Liao
a8a0e3edf8 refactor: do some internal refactor. 2024-03-22 14:47:00 +08:00
Haojun Liao
8c5ec3205c refactor: do some internal refactor. 2024-03-22 10:56:04 +08:00
kailixu
fb2667d92d fix: sys table scan and meta query 2024-03-22 10:33:46 +08:00
Haojun Liao
ecd09059f5 fix(tsdb): fix error in reading data from file block 2024-03-22 10:16:56 +08:00
yihaoDeng
2903d568ea add test 2024-03-21 11:06:46 +00:00
Haojun Liao
8bdd12c3a8 refactor: do some internal refactor. 2024-03-21 17:47:40 +08:00
Haojun Liao
fd8f065c67 refactor: do some internal refactor. 2024-03-21 15:08:23 +08:00
Haojun Liao
0c578ab6c0 refactor: do some internal refactor. 2024-03-21 10:44:27 +08:00
Haojun Liao
b12e65d144 fix(tsdb): set pk column index. 2024-03-21 09:37:46 +08:00
Haojun Liao
1d77cde433 refactor: do some internal refactor. 2024-03-20 23:03:48 +08:00
Haojun Liao
55f7bc2c9c fix(tsdb):add attributes for ssdatablock. 2024-03-20 15:29:05 +08:00
Haojun Liao
78b0d3fa74 fix(tsdb): fix error in comparing pk. 2024-03-20 14:27:48 +08:00
Haojun Liao
5ed0283494 fix(tsdb): support composite primary key. 2024-03-20 14:17:37 +08:00
Haojun Liao
7ff383cb1f
Merge pull request #25116 from taosdata/fix/3_liaohj 
fix(stream):adjust current offset by using the scanning version, not …
 2024-03-19 16:44:58 +08:00
Hongze Cheng
a9c1bcc91c
Merge pull request #25097 from taosdata/feat/TD-25880 
feat: support 2 replica with arbitrator
 2024-03-19 16:44:07 +08:00
Haojun Liao
65e4048f5d Merge branch '3.0' into fix/3_liaohj 2024-03-19 15:36:07 +08:00
Haojun Liao
77f8dbeeb9 refactor: do some internal refactor. 2024-03-19 15:21:23 +08:00
Haojun Liao
1c2c2b2b9a refactor: do some internal refactor. 2024-03-19 15:20:38 +08:00
Haojun Liao
6795f6e1cc fix(tsdb): handle the case that no stt statistics info existsin stt files generated by early version of TDengine. 2024-03-19 15:16:46 +08:00
Shungang Li
3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
wangmm0220
0ccad9d5de Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/tmq-opti 2024-03-18 21:23:58 +08:00
yihaoDeng
cd5f8ea415 tsdb support compress 2024-03-18 12:13:35 +00:00
yihaoDeng
d31c7f40c7 tsdb support compress 2024-03-18 12:12:55 +00:00
yihaoDeng
3964f01793 fix invalid read 2024-03-18 07:23:55 +00:00
wangmm0220
5624efff4e opti:tmq 2024-03-18 14:31:40 +08:00
Haojun Liao
2b706f00ad refactor(meta): add some logs. 2024-03-18 14:16:49 +08:00
Haojun Liao
7bdabc309b Merge branch '3.0' into fix/3_liaohj 2024-03-18 14:16:15 +08:00
Hongze Cheng
a962441252
Merge pull request #25106 from taosdata/fix/TD-29064-3.0 
fix: delete table snapshot coredump
 2024-03-18 12:40:52 +08:00
dapan1121
062bdf686e
Merge pull request #25102 from taosdata/fix/TS-4563 
fix:[TS-4563]retrieve data error from wal if colid is bigger in tmq
 2024-03-17 16:52:29 +08:00
Haojun Liao
74d7a0bd3e
Merge pull request #25112 from taosdata/fix/3_liaohj 
fix(meta): fix repeatly reader lock for tsdb meta.
 2024-03-16 23:57:55 +08:00
Haojun Liao
15e65d5f07 refactor: do some internal refactor. 2024-03-16 22:42:49 +08:00
yihaoDeng
b8fbb804cc tsdb support compress 2024-03-16 14:41:37 +00:00
yihaoDeng
c81d90a527 tsdb support compress 2024-03-16 14:31:24 +00:00
yihaoDeng
54d63fe87c tsdb support compress 2024-03-16 14:23:35 +00:00
yihaoDeng
0a03e7ac84 tsdb support compress 2024-03-16 14:01:42 +00:00
yihaoDeng
4fcd80ad27 tsdb support compress 2024-03-16 13:46:50 +00:00
yihaoDeng
f607cd60e3 tsdb support compress 2024-03-15 10:22:57 +00:00
Hongze Cheng
6c41fa48dd fix: delete table snapshot coredump 2024-03-15 16:55:50 +08:00
wangmm0220
5f687f0d88 fix:[TS-4563]retrieve data error from wal if colid is bigger in tmq 2024-03-15 15:59:03 +08:00
yihaoDeng
ec227180e1 add alg to block col 2024-03-14 12:37:15 +00:00
yihaoDeng
646478c6dc Merge branch 'feat/TS-4243-3.0' into feature/compressData 2024-03-14 12:22:58 +00:00
yihaoDeng
bdbe9b042c Merge branch 'feature/compressData' of https://github.com/taosdata/TDengine into feature/compressData 2024-03-14 12:20:13 +00:00
yihaoDeng
739e3ba7ab add zstd lib 2024-03-14 12:19:12 +00:00
facetosea
6678a65dc4 merge ts-4243 2024-03-14 19:06:34 +08:00
Haojun Liao
f28e994409
Merge pull request #25091 from taosdata/fix/3_liaohj 
fix(stream): transfer state before do checkpoint
 2024-03-14 17:59:13 +08:00
Haojun Liao
34c849bdbe enh(tsdb): read composed key in stt. 2024-03-14 17:03:57 +08:00
Haojun Liao
cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
yihaoDeng
fe10867547 Merge branch '3.0' into feature/compressData 2024-03-14 03:19:39 +00:00
Haojun Liao
15663ab450
Merge pull request #25084 from taosdata/fix/3_liaohj 
fix(tsdb): set strict varchar length check.
 2024-03-14 11:16:03 +08:00
Haojun Liao
190b02dd1a fix(stream):set correct version for sink/agg tasks. 2024-03-14 10:04:43 +08:00
Haojun Liao
2b7fd0d15c fix(tsdb): set strict varchar length check. 2024-03-14 10:04:14 +08:00
yihaoDeng
cc7d5ce484 add api 2024-03-13 12:58:05 +00:00
yihaoDeng
a5eebc90cb add api 2024-03-13 12:04:21 +00:00
yihaoDeng
3c11dc4ec1 fix show create table crash 2024-03-13 09:54:14 +00:00
yihaoDeng
5c67a67363 fix desc crash 2024-03-13 08:33:53 +00:00
yihaoDeng
064e7ef017 fix desc crash 2024-03-13 08:03:43 +00:00
54liuyao
3835e0c156 open operator after resume stream 2024-03-12 16:35:55 +08:00
Haojun Liao
0315e5ac63 feat(tsdb): read complex primary key from buf. 2024-03-12 16:22:56 +08:00
Haojun Liao
bc98f12798 feat(tsdb): read complex primary key from buf. 2024-03-12 14:06:59 +08:00
Hongze Cheng
f6c2a6bba2 more fix 2024-03-11 19:17:30 +08:00
Hongze Cheng
797a30ec02 more fix 2024-03-11 14:25:26 +08:00
Hongze Cheng
409c170404 fix more 2024-03-11 14:18:04 +08:00
Hongze Cheng
acbde220bf more bug fix 2024-03-08 17:04:26 +08:00
yihaoDeng
a52213dd23 fix create stable error 2024-03-08 08:40:33 +00:00
Hongze Cheng
fbc52d2a9c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-08 13:15:11 +08:00
Hongze Cheng
710a8ccbf2 fix more code 2024-03-08 13:14:54 +08:00
dapan1121
2349b28c12
Merge pull request #25024 from taosdata/fix/TS-4540 
fix:[TS-4540]seperate block if insert in one sql when subscribe query
 2024-03-08 10:50:30 +08:00
Hongze Cheng
1d49fc6148 fix more code 2024-03-08 10:43:40 +08:00
Hongze Cheng
7ffcb60f02 fix more code 2024-03-07 16:04:51 +08:00
Hongze Cheng
f43a7a6153 fix copy bug 2024-03-07 15:43:15 +08:00
Hongze Cheng
f6a5144972 more code 2024-03-07 14:40:42 +08:00
dmchen
69741d6e10 fix/TS-4535 2024-03-07 06:33:45 +00:00
wangmm0220
80f55abc61 fix:[TS-4540]seperate block if insert in one sql when subscribe query 2024-03-07 14:16:10 +08:00
Hongze Cheng
b764d51fae more code 2024-03-07 14:02:13 +08:00
Hongze Cheng
456db5b4c3 more code 2024-03-07 13:14:56 +08:00
Hongze Cheng
4dbdd2e35b more code 2024-03-07 10:42:20 +08:00
Hongze Cheng
fea538b4c9 remove useless code 2024-03-07 10:02:15 +08:00
yihaoDeng
63d3671f42 add new msg 2024-03-06 12:06:26 +00:00
Hongze Cheng
b6c71d8a43 more code 2024-03-06 17:56:35 +08:00
Hongze Cheng
3cb2838202 more code 2024-03-06 17:53:49 +08:00
Hongze Cheng
a705ee476c more change 2024-03-06 17:23:51 +08:00
Hongze Cheng
c941ad58ee more code 2024-03-06 17:06:39 +08:00
Hongze Cheng
28d83d6ab6 more code 2024-03-06 16:42:54 +08:00
Hongze Cheng
f05fe86ef0 more code 2024-03-06 16:23:02 +08:00
Hongze Cheng
5ed903dd01 more code 2024-03-06 15:52:34 +08:00
Hongze Cheng
dfd725fbdb more code 2024-03-06 15:37:57 +08:00
Minglei Jin
60ef86da6d vnd/clusterId: new interface to get cluster id for vnode 2024-03-06 14:35:44 +08:00
Hongze Cheng
b06e1b8236 refact more code 2024-03-06 13:30:23 +08:00
Hongze Cheng
050d1bc002 more code 2024-03-05 17:25:02 +08:00
Hongze Cheng
b33074dcbb &&&b/github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-05 17:06:45 +08:00
Hongze Cheng
fb4e17a0cb more code 2024-03-05 17:06:14 +08:00
Hongze Cheng
a728f2b5c9 more code 2024-03-05 16:47:59 +08:00
Hongze Cheng
1440c1b942 more code 2024-03-05 16:13:14 +08:00
dapan1121
19b51ec02c
Merge pull request #24994 from taosdata/mark/3.0 
fix:add excluded msg for delete in tmq
 2024-03-05 15:46:49 +08:00
Hongze Cheng
8aadc70b06 more code 2024-03-05 15:43:46 +08:00
Minglei Jin
d2ae4a6e26 enh(s3/writing): enable writing to s3 always 2024-03-05 09:52:26 +08:00
Hongze Cheng
b0d9c2632f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-05 09:27:32 +08:00
Haojun Liao
4d10f28a00
Merge pull request #24999 from taosdata/fix/nullcheck 
fix(stream): remove related fill-history if task in stop status.
 2024-03-05 09:15:21 +08:00
Haojun Liao
2ac803bf3c fix(stream): clear and set task status. 2024-03-04 22:16:41 +08:00
Haojun Liao
80fd3e0445 fix(stream): remove related fill-history if task in stop status. 2024-03-04 19:31:47 +08:00
Hongze Cheng
40a2b06451 more code 2024-03-04 19:25:20 +08:00
wangmm0220
c7d115d8aa fix:add excluded msg for delete in tmq 2024-03-04 14:58:13 +08:00
Hongze Cheng
e9371a1eab Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-04 09:16:08 +08:00
Haojun Liao
0d82ea9e62
Merge pull request #24966 from taosdata/fix/3_liaohj 
enh(stream): async handle pause event
 2024-03-04 09:10:10 +08:00
Hongze Cheng
c8280e05dd Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-03 16:01:34 +08:00
Hongze Cheng
9b8dec7691 more code 2024-03-03 16:01:12 +08:00
Hongze Cheng
818b9d1564
Merge pull request #24943 from taosdata/ENH/TD-28888-3.0 
enh: adjust an error logging msg in process sync msg
 2024-03-01 10:00:31 +08:00
Haojun Liao
8791a163f8 other: merge 3.0 2024-02-29 22:31:52 +08:00
Haojun Liao
db92bf84d8 other: merge 3.0 2024-02-29 22:21:50 +08:00
Hongze Cheng
c353f6b350
Merge pull request #24963 from taosdata/fix/TD-28329-2 
fix(tsdb/cache): new case for column changing
 2024-02-29 21:01:12 +08:00
Minglei Jin
3c80f171ef fix(tsdb/cache): new case for column changing 2024-02-29 18:56:14 +08:00
Hongze Cheng
d7a44a22f4 more change 2024-02-29 17:24:31 +08:00
Hongze Cheng
2de7f87c74 more code 2024-02-29 17:06:53 +08:00
Hongze Cheng
b8754b4209 more code 2024-02-29 16:32:11 +08:00
Hongze Cheng
f6fd32a0c2 more 2024-02-29 16:21:56 +08:00
Benguang Zhao
d5eda8c0a9 enh: adjust an error logging msg in process sync msg 2024-02-29 10:42:27 +08:00
Hongze Cheng
a8f95f53b7 more code 2024-02-28 16:49:44 +08:00
Hongze Cheng
81d6a1479d more code 2024-02-28 14:34:37 +08:00
Hongze Cheng
1903a7a981 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-28 13:23:02 +08:00
Hongze Cheng
d9a4e5ed0f more code 2024-02-28 10:58:42 +08:00
dmchen
34cda13494 enable switch 2024-02-27 10:57:32 +00:00
dmchen
cf753cf2e0 fix/TD-28860 2024-02-27 09:24:23 +00:00
Haojun Liao
9762c53cf9
Merge pull request #24895 from taosdata/fix/nullcheck 
enh(stream):rsp the checkpoint ready msg.
 2024-02-27 14:42:00 +08:00
Haojun Liao
d05c55f3fe fix(stream): update the msg struct. 2024-02-27 12:59:08 +08:00
Haojun Liao
de1c67f773 fix(stream): rsp the checkpoint ready msg. 2024-02-27 12:57:43 +08:00
Haojun Liao
402a43bf67 fix(stream): disable halt. 2024-02-27 11:25:32 +08:00
Haojun Liao
80d027da19 fix(stream): restore from the crash. 2024-02-27 11:22:58 +08:00
Haojun Liao
aee0460daf enh(stream):rsp the checkpoint ready msg. 2024-02-27 11:15:09 +08:00
Haojun Liao
dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
Hongze Cheng
793ee02cbc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-27 09:56:25 +08:00
Hongze Cheng
2c1f978fd2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-27 09:26:37 +08:00
Benguang Zhao
bbe6fe02d2 enh: use optimistic locking to protect snapshot reader open against vnode commit 2024-02-26 20:21:53 +08:00
Hongze Cheng
048f8ee7c5
Merge pull request #24879 from taosdata/fix/TD-28765 
fix(meta/table): remove cache table dropping
 2024-02-26 18:03:51 +08:00
Hongze Cheng
98eeef9d07 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-26 16:40:05 +08:00
Hongze Cheng
2ea5903132
Merge pull request #23373 from taosdata/feat/TD-26529-3.0 
TD-26529
 2024-02-26 13:22:56 +08:00
Minglei Jin
323938df36 fix(meta/table): remove cache table dropping 2024-02-26 12:29:33 +08:00
Hongze Cheng
8a669d3adc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-26 10:48:14 +08:00
Haojun Liao
59ad27fcae other(stream): comment some logs. 2024-02-24 22:50:17 +08:00
Haojun Liao
bb31b0c121 fix(stream): add logs. 2024-02-24 02:08:49 +08:00
Haojun Liao
2800454c35 Merge branch '3.0' into fix/nullcheck 2024-02-24 01:46:15 +08:00
Haojun Liao
df2488431e fix(stream): add logs. 2024-02-24 00:40:26 +08:00
chenhaoran
ab07900895 Merge branch '3.0' into feat/TD-26529-3.0 2024-02-23 20:54:19 +08:00
Hongze Cheng
78da82784c more code 2024-02-23 17:27:03 +08:00
Hongze Cheng
a6423b7816 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-23 14:47:10 +08:00
Hongze Cheng
aaa36b580e more code 2024-02-23 14:44:46 +08:00
Minglei Jin
e80ac5a4a6 fix(vnd/query): not release reader if not initialized 2024-02-23 10:14:59 +08:00
dapan1121
794d4a931c
Merge pull request #24820 from taosdata/mark/3.0 
fix:add excluded msg for meta in tmq
 2024-02-23 09:41:39 +08:00
Haojun Liao
da0265ddde fix(tsdb): set correct error code info extract method. 2024-02-22 15:52:47 +08:00
dm chen
271e997438
Merge pull request #24823 from taosdata/3.0 
merge 3.0
 2024-02-22 12:47:42 +08:00
wangmm0220
6e13e4aa63 fix:add excluded msg for meta in tmq 2024-02-22 10:58:32 +08:00
Hongze Cheng
665cc2c2c4 more code change 2024-02-22 10:13:35 +08:00
Hongze Cheng
a9e3ca41a9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-22 09:39:48 +08:00
Haojun Liao
6f8a54f27b fix(stream): free dummy rsp msg. 2024-02-21 16:27:52 +08:00
dmchen
606aa61c4f remove errors and delete 2024-02-21 08:06:45 +00:00
Hongze Cheng
b0b71bc3c2 more code 2024-02-21 15:21:46 +08:00
Haojun Liao
b361eb4a7c fix(stream): add hb rsp handle function for vnode and snode. 2024-02-21 15:16:07 +08:00
Hongze Cheng
4b71031014 more code 2024-02-21 14:29:10 +08:00
Hongze Cheng
b7b9c02694 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 13:18:56 +08:00
slzhou
87c8f1aa82 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 13:09:36 +08:00
dmchen
c55e9b1877 insert user empty 2024-02-21 04:12:45 +00:00
Haojun Liao
d6f5ae226b refactor: do some internal refactor. 2024-02-21 09:42:23 +08:00
Hongze Cheng
fca1c077fe
Merge pull request #24790 from taosdata/fix/TD-28329 
fix(tsdb/cache): remove unused block index cache
 2024-02-21 09:03:54 +08:00
Minglei Jin
efd2bc6bac fix(tsdb/cache): remove unused block index cache 2024-02-20 17:12:55 +08:00
Hongze Cheng
6cdef62f92
Merge pull request #24772 from taosdata/fix/TD-28539-3.0 
fix: invalid memory access during meta snapshot transfer
 2024-02-20 17:01:46 +08:00
Hongze Cheng
261d38d4a7
Merge pull request #24710 from taosdata/fix/TD-24422-2 
enh(tsdb/cache): flag empty table when creating
 2024-02-20 16:17:18 +08:00
Hongze Cheng
cb0a5b4725 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28539-3.0 2024-02-20 14:20:48 +08:00
Haojun Liao
13c3654bf5 other: merge 3.0 2024-02-20 10:51:04 +08:00
Alex Duan
2eb33b6ee6
Merge pull request #24759 from taosdata/coverage/TD-28602-3.0 
coverage: add schUtil.c and schedulerTest
 2024-02-20 09:14:03 +08:00
dapan1121
980e1b83be
Merge pull request #24775 from taosdata/opti/TS-4480 
opti:consume performance if all data is in format of "insert into using"
 2024-02-20 09:07:59 +08:00
Haojun Liao
46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023 
stream count window
 2024-02-20 08:50:25 +08:00
wangmm0220
77e2500a81 fix:conflicts from 3.0 2024-02-19 18:46:31 +08:00
54liuyao
af1893d109 merge 3.0 2024-02-19 18:30:12 +08:00
Haojun Liao
931b9f0b51 other: merge 3.0 2024-02-19 18:27:18 +08:00
Alex Duan
ba306043bb Merge branch '3.0' into coverage/TD-28602-3.0 2024-02-19 16:06:57 +08:00
Haojun Liao
bf242a4f64 fix(stream): handle pause event in waiting list. 2024-02-19 15:57:21 +08:00
wangmm0220
a74f12e2e1 opti:consume performance if all data is in format of "insert into using" 2024-02-19 15:50:43 +08:00
Haojun Liao
a3b04c3c58 fix(stream): set the processVer for streamTask when initializing the task object. 2024-02-19 14:50:09 +08:00
Hongze Cheng
ad0c91e6c3 fix: invalid memory access during meta snapshot transfer 2024-02-19 14:06:45 +08:00
wangmm0220
ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao
d3e8adf2eb enh(stream): async handle pause event 2024-02-19 13:36:57 +08:00
Haojun Liao
7e866c5527 refactor: do some internal refactor. 2024-02-19 11:32:04 +08:00
54liuyao
b53dc5602e Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-02-19 10:58:20 +08:00
Haojun Liao
cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
Hongze Cheng
45684e49c7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-19 09:08:58 +08:00
54liuyao
05eaa90c11 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-19 08:59:15 +08:00
Alex Duan
b3a6fa9c12 coverage: add explain.c 2024-02-18 19:36:35 +08:00
wangmm0220
a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao
245f0ef806 fix(stream): fix deadlock. 2024-02-18 17:05:00 +08:00
Haojun Liao
472020a2b9 enh(stream): handle event async function. 2024-02-18 14:07:15 +08:00
Hongze Cheng
8f1fa68994 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-02-18 10:53:51 +08:00
dapan1121
8f63952ad5
Merge pull request #24750 from taosdata/mark/3.0 
fix:[TD-28590]add logic for consume excluded
 2024-02-18 10:13:25 +08:00
Hongze Cheng
52ed1ec5f7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-18 09:52:53 +08:00
Alex Duan
f5e0563891 coverage: tsdbCache.c 2024-02-17 12:12:37 +08:00
Alex Duan
8852beb2cc coverage: tsdbUtil.c 2024-02-16 15:17:15 +08:00
dm chen
6d2d37d964
Merge pull request #24751 from taosdata/3.0 
merge 3.0
 2024-02-06 19:16:53 +08:00
dmchen
e5dcef0794 forward client directly 2024-02-06 08:29:09 +00:00
wangmm0220
871ebfa7ba Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-06 14:02:46 +08:00
Haojun Liao
2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao
7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
wangmm0220
5796f411e4 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-05 17:08:05 +08:00
wangmm0220
a656d75ca7 opti:consume data excluded from some source 2024-02-05 17:07:50 +08:00
54liuyao
c588770699 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 15:10:34 +08:00
wade zhang
0ebd7d2527
Merge pull request #24737 from taosdata/feat/TD-27463-3.0 
feat: support uniq grant
 2024-02-05 10:32:34 +08:00
54liuyao
b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
dmchen
16aef66260 ci case fail 2024-02-05 01:34:20 +00:00
Haojun Liao
2e79c766fa
Merge pull request #24731 from taosdata/fix/3_liaohj 
fix(tsdb): check and return if the rows in stt are before the data rows in data files.
 2024-02-05 09:00:32 +08:00
54liuyao
ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao
6736fd1615 fix(tsdb): check and return if the rows in stt are before the data rows in data files. 2024-02-04 14:11:17 +08:00
kailixu
f53d0bce5d feat: support uniq grant 2024-02-04 00:24:42 +08:00
Hongze Cheng
89f0aa4bc4 more code 2024-02-02 12:45:01 +08:00
Hongze Cheng
b79859d2a3 more code 2024-02-02 12:26:05 +08:00
slzhou
4a6317a047 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-02 11:29:04 +08:00
Haojun Liao
3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Alex Duan
035f7d096c
Merge pull request #24715 from taosdata/coverage/TD-28550-3.0 
coverage: metaIdx.c comment no use function
 2024-02-02 09:05:51 +08:00
Alex Duan
963bb20ce3 coverage: metaIdx.c comment no use funciton 2024-02-01 19:11:50 +08:00
Minglei Jin
d59b767af3 enh(tsdb/cache): flag empty table when creating 2024-02-01 17:40:32 +08:00
Haojun Liao
cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220
a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao
556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao
4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
dmchen
8d683983e0 interface name 2024-01-29 10:11:17 +00:00
54liuyao
d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
Haojun Liao
bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 18:08:54 +08:00
Hongze Cheng
e7177dae57 more code 2024-01-26 17:14:00 +08:00
Hongze Cheng
09a65e5992 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-01-26 16:51:47 +08:00
Haojun Liao
ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao
bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
Haojun Liao
649d26ce72 fix(stream): seek to right place to start wal read. 2024-01-26 14:14:04 +08:00
Haojun Liao
49aff4571b fix(stream): fix memory leak. 2024-01-26 11:33:07 +08:00
Haojun Liao
db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 09:09:44 +08:00
Haojun Liao
d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao
834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj 
fix(stream): do checkpoint after fill-history task completed.
 2024-01-25 16:53:11 +08:00
Hongze Cheng
e8a8748dc9 more fix 2024-01-25 15:48:45 +08:00
Hongze Cheng
7d27c3902a feat: avoid meta rwlock starvation 2024-01-25 15:45:09 +08:00
54liuyao
7105b0ffe3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-25 10:12:13 +08:00
dmchen
d9af07de6f new table structure 2024-01-24 09:44:44 +00:00
Hongze Cheng
82f3b3a931
Merge pull request #24589 from taosdata/fix/ttlnoretry-3.0 
fix: no retry for ttl drop table
 2024-01-24 14:03:18 +08:00
Haojun Liao
8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Shungang Li
5bd14b4866 enh: errcode for message has been processed in preprocess 2024-01-23 13:53:51 +08:00
Benguang Zhao
192bb179e7 enh: trigger vnodeCommit at exit even if no data changed 2024-01-23 10:15:00 +08:00
54liuyao
0975e37845 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-23 10:07:50 +08:00
Haojun Liao
ecd51e366f
Merge pull request #24512 from taosdata/opti/TD-28118 
opti:[TD-28118] raw block data for tmq
 2024-01-22 11:47:13 +08:00
Haojun Liao
d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
54liuyao
5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
wangmm0220
7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
factosea
b83bb8c150 fix: last_row error 2024-01-18 17:20:31 +08:00
Haojun Liao
76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao
719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
Haojun Liao
f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
wangmm0220
d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
Haojun Liao
d1dbd03341 fix(tsdb): fix invalid set. 2024-01-17 17:29:00 +08:00
Haojun Liao
d44dc5bbb2 fix(tsdb): fix race condition. 2024-01-17 15:20:17 +08:00
Haojun Liao
56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao
1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao
fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj 
fix(stream): fix some errors and do some internal refactor.
 2024-01-17 14:25:32 +08:00
54liuyao
3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
dapan1121
66c9c076e8
Merge pull request #24469 from taosdata/fix/xsren/TD-28204/whereOptimizeConditional 
Fix/xsren/td 28204/where optimize conditional
 2024-01-17 10:20:51 +08:00
Haojun Liao
a56e589048
Merge pull request #24490 from taosdata/fix/TD-28338 
fix:[TD-28338]empty varchar value return NULL in tmq
 2024-01-17 10:09:40 +08:00
yihaoDeng
0d4cc6b8e2 fix:[TD-28338]empty varchar value return NULL in tmq 2024-01-16 18:46:37 +08:00
Haojun Liao
3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
jiajingbin
d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Haojun Liao
9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Haojun Liao
80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
xinsheng Ren
ae5f540692
Merge branch '3.0' into fix/xsren/TD-28204/whereOptimizeConditional 2024-01-16 14:28:37 +08:00
Haojun Liao
dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj 
fix(stream): fix deadlock in pause.
 2024-01-16 12:58:27 +08:00
Haojun Liao
63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
dapan1121
53094f62d8
Merge pull request #24359 from taosdata/FIX/TD-27003 
Fix : use last row scan when select last_row, last
 2024-01-16 08:50:23 +08:00
fullhonest
fafb5b1f03 Fix TD-28018: last row num error where partition by null column 2024-01-15 18:29:41 +08:00
wangmm0220
2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
factosea
2c0dd3db03 fix: memory leak 2024-01-15 16:41:52 +08:00
Haojun Liao
43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
fullhonest
cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao
143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao
e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao
c710718f9e
Merge pull request #24457 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-15 10:58:45 +08:00
Haojun Liao
00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
wangmm0220
00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao
ee24bb9b03
Merge pull request #24444 from taosdata/fix/3_liaohj 
fix(stream): close the inputQ of the related stream task.
 2024-01-12 13:41:30 +08:00
Haojun Liao
cf941f7488 fix(stream): check status when resume to run. 2024-01-12 11:12:23 +08:00
Haojun Liao
b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Hongze Cheng
8399f5253f
Merge pull request #24439 from taosdata/fix/TD-28285-30 
fix(tsdb/cache): clear fs state before next open
 2024-01-12 10:38:43 +08:00
dapan1121
3b928237d7
Merge pull request #24419 from wangjiaming0909/draft/fix/TD-28182 
fix: table merge scan return disordered rows
 2024-01-12 10:16:21 +08:00
Haojun Liao
ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode 
opt msg on mnd
 2024-01-12 09:36:37 +08:00
Minglei Jin
aa410a6deb fix(tsdb/cache): clear fs state before next open 2024-01-12 09:32:40 +08:00
wangjiaming0909
686108050b fix: table merge scan return disordered rows 2024-01-11 09:57:35 +08:00
Haojun Liao
f6c0649108 fix(stream): fix syntax error. 2024-01-11 09:53:19 +08:00
Haojun Liao
bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
Haojun Liao
1c562bd535 refactor: enable the restart of stream tasks. 2024-01-11 09:41:40 +08:00
wangmm0220
216830f8b4 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 20:33:13 +08:00
wangmm0220
df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Yihao Deng
b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
wangmm0220
02c7bdd4f0 fix:[TD-28032]fsdfasd 2024-01-10 14:57:16 +08:00
Haojun Liao
b0202bb853 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:44:21 +08:00
Haojun Liao
e8aea42498 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:42:36 +08:00
Haojun Liao
1b6d55616f fix(stream): fix syntax error. 2024-01-10 11:28:06 +08:00
Haojun Liao
eac0d14868 fix(stream): add check when merging rows from files and buffer. 2024-01-10 11:02:44 +08:00
Haojun Liao
9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Haojun Liao
2b3ad002f5
Merge pull request #24401 from taosdata/fix/TD-28142-3.0 
opti:[TD-28142]memory size if block num is too large
 2024-01-10 09:40:07 +08:00
Haojun Liao
dc0c5539a0 fix(stream): remove invalid timer controllers. 2024-01-10 08:48:49 +08:00
Hongze Cheng
7fa06df958
Merge pull request #24395 from taosdata/fix/TD-28208 
fix(tsdb/cache): destory brin block with fs loading
 2024-01-09 16:31:41 +08:00
wangmm0220
6444af84e4 opti:[TD-28142]memory size if block num is too large 2024-01-09 16:28:58 +08:00
Minglei Jin
d93b4f88b3 fix(tsdb/cache): destory brin block with fs loading 2024-01-09 15:23:15 +08:00
Haojun Liao
f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao
af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Hongze Cheng
5e45ecd3fd fix: possible race condition 2024-01-08 16:46:07 +08:00
Haojun Liao
3bcd038b7d refactor: not reload info from disk when trying to restart stream tasks. 2024-01-08 14:04:36 +08:00
Haojun Liao
275e2d6f94 refactor: do some internal refactor. 2024-01-08 11:34:47 +08:00
Haojun Liao
bb9edde79e fix(stream): add some logs. 2024-01-08 11:33:54 +08:00
Haojun Liao
a024fe960c fix(stream): fix deadlock. 2024-01-07 14:53:17 +08:00
Haojun Liao
29219ba9f4 fix(stream): add task number check. 2024-01-07 01:32:50 +08:00
Haojun Liao
02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao
cfda97beef refactor: disable commit temp 2024-01-06 15:27:48 +08:00
Haojun Liao
23341e1bdf refactor: opt perf by avoid save tasks during restoring 2024-01-05 22:58:43 +08:00
Haojun Liao
445605ed22 refactor: do some internal refactor. 2024-01-05 22:35:56 +08:00
Haojun Liao
522e688387 fix(stream): check if in restart procedure in call back. 2024-01-05 22:16:58 +08:00
Haojun Liao
2386f842fb enh(stream): remove sleep to opt perf. 2024-01-05 18:46:15 +08:00
Haojun Liao
0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
Haojun Liao
1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
Haojun Liao
33f698e926 fix(stream): remove invalid assert and add check for task status before launching related fill-history task. 2024-01-04 19:09:45 +08:00
Hongze Cheng
df74b2d755
Merge pull request #24284 from taosdata/fix/TD-27988 
fix: remove useless code
 2024-01-04 19:03:45 +08:00
Haojun Liao
6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao
c494252002 fix(stream): record the related fill-history task failure. 2024-01-04 17:44:05 +08:00
dm chen
39f2e75a9e
Merge branch '3.0' into feat/TD-26529-3.0 2024-01-04 15:46:23 +08:00
Hongze Cheng
13834802ef
Merge pull request #24269 from taosdata/FIX/TD-28101-3.0 
enh: send rsp msg on rejecting snap replication due to smaller term
 2024-01-04 10:15:09 +08:00
dapan1121
670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813 
enh: support group by tag/tbname to list empty groups
 2024-01-04 09:08:03 +08:00
Haojun Liao
1e3aad8883 refactor: do some internal refactor. 2024-01-03 23:57:33 +08:00
wangmm0220
b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
wangmm0220
317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
Haojun Liao
4399867e14 fix(stream): fix the not running bug. 2024-01-03 18:28:23 +08:00
Haojun Liao
4138692cea fix(stream): scan wal data files. 2024-01-03 18:16:18 +08:00
Haojun Liao
185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
dapan1121
f0fbffa772
Merge pull request #24301 from taosdata/fix/3.0/TD-28104 
fix: last table scan reported invalid param when col was dropped which
 2024-01-03 15:47:33 +08:00
Haojun Liao
a2e85c44c2
Merge pull request #24228 from taosdata/fix/3_liaohj 
refactor: remove stream-scan-history event for stream task.
 2024-01-03 14:43:20 +08:00
Haojun Liao
453d3e8a30 fix(stream): fix dead lock on windows. 2024-01-03 10:50:38 +08:00
wangmm0220
ab262550d1 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:37:05 +08:00
wangmm0220
9ba2f71487 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:16:43 +08:00
Haojun Liao
6c7683dba6
Merge pull request #24310 from taosdata/fix/crash_stream 
fix(tsdb): check if stt blocks are clean before building data blocks.
 2024-01-02 21:30:28 +08:00
wangmm0220
8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao
5bbf12c2c9 fix(tsdb): check if stt blocks are clean before building composed data blocks. 2024-01-02 18:35:17 +08:00
Haojun Liao
29afc2ad6a fix(stream):add jump condition for loop. 2024-01-02 15:48:08 +08:00
Haojun Liao
e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao
4368bfb20a fix(stream): fix dead lock. 2024-01-02 11:40:29 +08:00
Haojun Liao
b3d8f4e9d6 fix(stream): fix a typo. 2024-01-02 10:39:01 +08:00
Haojun Liao
d217412691 fix(stream): avoid race condition in starting threads. 2024-01-02 10:33:25 +08:00
wangjiaming0909
be0d35a5af fix: last table scan reported invalid param when col was dropped which 
should report invalid col
 2024-01-02 10:20:04 +08:00
Haojun Liao
8ac02adc0b refactor: do some internal refactor. 2023-12-29 17:42:23 +08:00
Hongze Cheng
7cb12db8ce remove more useless code 2023-12-29 15:20:27 +08:00
Benguang Zhao
68cb86602e fix: reuse cid with fs eid updated in tsdbFSetRAWWriteFileDataBegin 2023-12-29 11:49:57 +08:00
Benguang Zhao
baa7f9c895 enh: adjust error msg as warn for not ready to propose etc 2023-12-28 17:29:49 +08:00
Haojun Liao
1659164926 fix(stream): remove invalid checkpoint id check. 2023-12-27 23:00:18 +08:00
Haojun Liao
7eb0e42bb9 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-27 22:57:58 +08:00
Hongze Cheng
90645cbc77
Merge pull request #24220 from taosdata/fix/TD-27988 
fix: remove useless code
 2023-12-27 21:23:26 +08:00
Hongze Cheng
2ada7d455e
Merge pull request #24236 from taosdata/fix/TD-28061 
fix(tsdb/cache): erase entry from lru if deleted
 2023-12-27 18:13:16 +08:00
Haojun Liao
5592e11235 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-26 19:02:52 +08:00
54liuyao
ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
Minglei Jin
2ba586513f fix(tsdb/cache): erase entry from lru if deleted 2023-12-26 16:41:33 +08:00
Yihao Deng
40aa5f697f fix tag index double free 2023-12-26 07:21:02 +00:00
Yihao Deng
dc01625ea1 fix tag index double free 2023-12-26 06:52:33 +00:00
Haojun Liao
62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Hongze Cheng
a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
Haojun Liao
e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
Haojun Liao
00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Haojun Liao
0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao
30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Haojun Liao
25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Bob Liu
e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao
b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao
7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Haojun Liao
e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao
90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Hongze Cheng
02bb9e90d2
Merge pull request #24189 from taosdata/fix/TD-27974 
fix(tsdb/cache): prepend ts col to load stt
 2023-12-22 13:53:15 +08:00
Minglei Jin
16ad59fb18 fix(tsdb/cache): prepend ts col to load stt 2023-12-22 12:14:27 +08:00
Hongze Cheng
46211258b3
Merge pull request #24173 from taosdata/fix/TD-27974 
fix(tsdb/cache): plus 1 to nCols to load stt data
 2023-12-22 09:43:20 +08:00
Haojun Liao
c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Minglei Jin
9d3eb02f3c fix(tsdb/cache): plus 1 to nCols to load stt data 2023-12-21 17:53:44 +08:00
Haojun Liao
2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Alex Duan
9d4a75b0be coverage: vnodeSrv.c tmsg.c trow.c 2023-12-21 14:22:22 +08:00
Haojun Liao
71f6d9f06f fix(stream): handle the case that recvs drop msg twice. 2023-12-21 11:52:45 +08:00
wangmm0220
de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao
1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao
d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
Haojun Liao
81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao
541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Haojun Liao
2de0f6e971 test(stream): lock the update procedure. 2023-12-19 18:56:15 +08:00
Haojun Liao
92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
Haojun Liao
17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao
fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
Haojun Liao
ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao
579366ec00
Merge pull request #24121 from taosdata/fix/liaohj 
other: merge main into 3.0
 2023-12-18 23:11:36 +08:00
Haojun Liao
e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao
bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Minglei Jin
64378be7f4 fix(tsdb/cache): fix buffer-overflow with column adding 2023-12-18 18:06:40 +08:00
Haojun Liao
ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
wade zhang
4cac96d2df
Merge pull request #24111 from taosdata/fix/TD-27845 
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
 2023-12-18 16:27:18 +08:00
Haojun Liao
79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj 
fix(stream): add check for null ptr and leader .
 2023-12-18 16:24:07 +08:00
Minglei Jin
5dd9ce8ceb fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange 2023-12-18 15:02:34 +08:00
Haojun Liao
b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
Haojun Liao
ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj 
fix(stream): send checkpoint complete msg to mnode when dropping it.
 2023-12-17 11:03:04 +08:00
Haojun Liao
4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao
0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj 
fix(tsdb): add desc check for clean file block.
 2023-12-16 18:10:15 +08:00
Haojun Liao
4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
Haojun Liao
1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash 
Fix/snode backend crash
 2023-12-16 13:13:28 +08:00
Haojun Liao
f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
slzhou
8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
Haojun Liao
a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj 
fix(query): add rows info if blocks exist.
 2023-12-15 18:24:45 +08:00
yihaoDeng
bb5f0d9112 Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash 2023-12-15 18:16:38 +08:00
yihaoDeng
7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
Hongze Cheng
4ae13f411e
Merge pull request #24010 from taosdata/feat/TS-4229 
feat: compact monitor and kill
 2023-12-15 16:20:13 +08:00
Haojun Liao
e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
shenglian zhou
cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao
556eaa22ac
Merge pull request #24074 from taosdata/mark/3.0 
fix:core dump if tqOpen error in vnodeOpen
 2023-12-15 13:55:10 +08:00
wangmm0220
812f0f97a7 fix:rollback size to old logic 2023-12-15 10:09:18 +08:00
slzhou
d3146a5bec fix: when no file block, no proc mem before fileset 2023-12-15 09:51:06 +08:00
Yihao Deng
5f2d93d62c
Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 09:22:33 +08:00
wangmm0220
740228a653 fix:core dump if tqOpen error in vnodeOpen 2023-12-15 09:07:35 +08:00
slzhou
5bf364cc0a enhance: refactor code 2023-12-15 08:23:25 +08:00
dmchen
d7ac3558f8 fix wrong merge 2023-12-14 11:21:41 +00:00
dm chen
81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
slzhou
4dc39e74c5 fix: the block return from buildBlockFromFiles should be of new fileset 2023-12-14 16:57:04 +08:00
wade zhang
c95c567376
Merge pull request #24046 from taosdata/fix/TS-4251-3.0 
revert dependency
 2023-12-14 14:03:04 +08:00
Haojun Liao
05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-14 13:52:04 +08:00
Haojun Liao
7cf0add513 fix(stream): fix error caused by refactor. 2023-12-14 11:28:03 +08:00
Haojun Liao
f0d63a977a refactor: do some internal refactor. 2023-12-14 10:01:57 +08:00
Haojun Liao
8e042e34cb refactor: do some internal refactor. 2023-12-14 09:48:14 +08:00
Haojun Liao
81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
Haojun Liao
26af397431
Merge pull request #24052 from taosdata/fix/3_liaohj 
fix(tsdb): fix error in tsdb read.
 2023-12-13 22:35:08 +08:00
Haojun Liao
88a8e4e9f0 fix(tsdb): fix syntax error. 2023-12-13 17:01:55 +08:00
Haojun Liao
840b457308 fix(tsdb): fix error in tsdb read. 2023-12-13 17:00:39 +08:00
dmchen
04366f2e68 revert dependency 2023-12-13 15:29:32 +08:00
Benguang Zhao
b1dd76b924 fix: assert on offset leq file.size in tsdbDataFileRAWWriterCloseCommit 2023-12-12 18:33:42 +08:00
Hongze Cheng
613ca2c370
Merge pull request #23982 from taosdata/fix/PI-30-3.0 
fix(tsdb/cache): remove malloc zero bytes
 2023-12-12 15:22:38 +08:00
dmchen
1547d95742 break dependency 2023-12-12 12:19:12 +08:00
dmchen
67e9f695c9 debug info and default setting 2023-12-12 12:18:35 +08:00
dmchen
daa2c2238a fix/TS-4251 2023-12-12 12:17:49 +08:00
Minglei Jin
c4bf9a92bc Merge branch '3.0' into enh/TD-27119 2023-12-11 19:38:04 +08:00
Minglei Jin
fe824c51e2 tsdb/cos: not remove cp files 2023-12-11 19:36:06 +08:00
dmchen
a861e55764 revert dependency 2023-12-11 11:24:31 +00:00
slzhou
2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
Haojun Liao
39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj 
fix(tsdb): opt read stt file
 2023-12-09 21:28:52 +08:00
Haojun Liao
9acd4af1f9 fix(tsdb):fix capacity rows value. 2023-12-09 01:49:55 +08:00
Haojun Liao
5528c2bf67 fix(tsdb): do some internal refactor. 2023-12-08 23:47:49 +08:00
Haojun Liao
f2592f7399 fix(tsdb): prepare the memory buffer. 2023-12-08 23:44:05 +08:00
Haojun Liao
da636ab527 fix(tsdb): add null check. 2023-12-08 18:55:20 +08:00
Haojun Liao
67d967e22f fix(tsdb): check the overlap between stt blocks and data file blocks. 2023-12-08 18:48:00 +08:00
Hongze Cheng
853fb6f119
Merge pull request #23987 from taosdata/fix/little_fix_3.0 
fix: little fix
 2023-12-08 17:29:24 +08:00
Hongze Cheng
f830fc2f4c more dev 2023-12-08 17:26:44 +08:00
Haojun Liao
63b34c7acf fix(tsdb): add check for not load stt file blocks. 2023-12-08 16:09:58 +08:00
Minglei Jin
2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
Hongze Cheng
a0487529d0 more fix 2023-12-08 14:37:21 +08:00
wade zhang
638e4c1f00
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0 
feat: support tsdb snap replication of raw data mode
 2023-12-08 14:36:16 +08:00
Haojun Liao
9c72ce846e fix(tsdb): add more condition for not load data. 2023-12-08 14:23:37 +08:00
Hongze Cheng
16068bab41
Merge pull request #23964 from taosdata/fix/TD-27707 
fix(tsdb/cache): del from mem with time range
 2023-12-08 14:22:08 +08:00
Hongze Cheng
b9d056c6a8 fix: little fix 2023-12-08 14:11:36 +08:00
dmchen
18dbc47949 break dependency 2023-12-08 04:24:33 +00:00
Haojun Liao
da1207ef74 fix(tsdb): add return flag for stt files. 2023-12-08 11:07:45 +08:00
Minglei Jin
d4dbb55669 fix(tsdb/cache): remove malloc zero bytes 2023-12-08 11:04:04 +08:00
Haojun Liao
2e13b0b97d refactor: do some internal refactor. 2023-12-08 10:43:17 +08:00
Haojun Liao
9477146b30 fix(tsdb): fix syntax error. 2023-12-08 10:29:38 +08:00
Haojun Liao
4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao
446c14da72 fix(tsdb): opt read stt file 2023-12-08 10:03:36 +08:00
dapan1121
a2ee41233e
Merge pull request #23835 from taosdata/szhou/tms-duration 
feat: tsdb output in duration order
 2023-12-08 09:07:41 +08:00
Haojun Liao
7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
dmchen
348bef49ec message handle 2023-12-07 11:42:32 +00:00
Hongze Cheng
aee070918b more dev 2023-12-07 17:37:47 +08:00
Benguang Zhao
1255b46469 fix: destroy dataReaderArr properly in tsdbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao
ebd3b69745 enh: control playload size of tsdb snap replication with TSDB_SNAP_DATA_PAYLOAD_SIZE 2023-12-07 15:29:42 +08:00
Benguang Zhao
5cdf2b0b04 fixup: remove call to obsolete funcs of BgTask in tsdbSnapRAWWriter open and close 2023-12-07 15:29:42 +08:00
Benguang Zhao
28e1d83662 fix: adjust tsdbReadFile call in tsdbDataFileRAWReadBlockData 2023-12-07 15:29:42 +08:00
Benguang Zhao
52672657c1 feat: toggle tsdb snap replication mode by snap info handshake ahead of time 2023-12-07 15:29:42 +08:00
Benguang Zhao
ef34176e37 fix: close data file readers in tsbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao
6c4c0242fd refact: adjust logging format in tsdbSnapRAWReaderOpen 2023-12-07 15:29:42 +08:00
Benguang Zhao
f136266972 feat: support snap replication by file blocks 2023-12-07 15:29:42 +08:00
Benguang Zhao
1dc9019baa feat: add tsdbSnapRAWRead into vnodeSnapRead 2023-12-07 15:29:42 +08:00
Benguang Zhao
ae60e1f810 refact: add tsdbSnapRAWReaderIterNext 2023-12-07 15:29:42 +08:00
Benguang Zhao
a504007ade refact: alloc just enough memory for snap data in tsdbSnapRAWReadData 2023-12-07 15:29:42 +08:00
Benguang Zhao
6c419423de feat: impl tsdb snapshot reader and writer for raw files 2023-12-07 15:29:42 +08:00
Benguang Zhao
a4c504169d feat: add file tsdbFSetRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao
da646b5a5b feat: add file tsdbDataFileRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao
e05914119e feat: add file tsdbSnapshotRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao
fe258e226d feat: add data type of SNAP_DATA_RAW for snap replication 2023-12-07 15:29:42 +08:00
Benguang Zhao
de9c9d4f20 refact: improve code of tsdbPartitionInfoSerialize 2023-12-07 15:28:14 +08:00
Benguang Zhao
1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
Benguang Zhao
f68804322c refact: improve code of tsdbSnapGetDetails as tsdbSnapPrepDescription 2023-12-07 15:28:14 +08:00
Benguang Zhao
ed39c9a572 refact: rename snap range to fset range in tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao
3550347f0c refact: use tsdbFSDestroyCopyRangedSnapshot and tsdbFSDestroyRefRangedSnapshot 2023-12-07 15:28:14 +08:00
Benguang Zhao
962febef02 refact: rename tsdb snap range to tsdb fset range 2023-12-07 15:28:14 +08:00
Benguang Zhao
ed916b1a80 refact: rename tsdb snap partition to fset partition 2023-12-07 15:28:14 +08:00
Benguang Zhao
20b5cf8d49 refact: remove redundent includes from tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao
4487eeacb5 refact: improve funcs dealing with SnapInfo for vnode snap reader and writer 2023-12-07 15:28:14 +08:00
Benguang Zhao
b8b53a4b0e refact: put source code of snap info into tsdbSnapInfo.c 2023-12-07 15:28:06 +08:00
Benguang Zhao
3ad68bdfea enh: add tsdbSnapInfo.c 2023-12-07 15:20:55 +08:00
Benguang Zhao
ddcabcfa4a refact: remove unused fn tSerializeSnapRangeArray 2023-12-07 15:20:55 +08:00
Benguang Zhao
e429526789 refact: rename STSnapRange to STFileSetRange 2023-12-07 15:20:55 +08:00
dmchen
27a86a6faa debug info and default setting 2023-12-07 03:13:23 +00:00
dapan1121
30eb035447
Merge pull request #23940 from taosdata/fix/TS-4327 
fix: last/last_row crash with dropped column
 2023-12-06 17:57:24 +08:00
Minglei Jin
a9309cb295 fix(tsdb/cache): del from mem with time range 2023-12-06 17:52:15 +08:00
Hongze Cheng
04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
dmchen
dc9408ed5f fix/TS-4251 2023-12-06 07:48:40 +00:00
shenglian zhou
a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
Haojun Liao
85c7dc76e9
Merge pull request #23948 from taosdata/mark/3.0 
fix:offset out of range if poll offset is read from offsetRestored wh…
 2023-12-06 09:12:38 +08:00
wangmm0220
cc51fd47d0 fix:offset out of range if poll offset is read from offsetRestored while wal is deleted 2023-12-05 19:09:29 +08:00
yihaoDeng
87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
Minglei Jin
e9cc54d87b cos_cp/load: load checkpoint from json 2023-12-05 16:37:28 +08:00
wangjiaming0909
a6c876bbc1 fix: last/last_row crash with dropped column 2023-12-05 14:16:01 +08:00
Minglei Jin
e0a14bd359 fix(tsdb/cache): remove debug log 2023-12-05 14:05:16 +08:00
Haojun Liao
9d451ab56e
Merge pull request #23934 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-05 12:58:18 +08:00
Haojun Liao
cb8dfae0cc refactor: do some internal refactor. 2023-12-05 10:47:19 +08:00
slzhou
e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
Haojun Liao
cc5890d56a
Merge pull request #23924 from taosdata/fix/3_liaohj 
enh(tsdb): extract rows for the given tables in all stt files.
 2023-12-04 19:21:19 +08:00
Hongze Cheng
26774f87c9
Merge pull request #23920 from taosdata/fix/TD-27619 
fix: bg task memory waste
 2023-12-04 18:10:30 +08:00
Haojun Liao
7145a7b8a1 fix(tsdb): calculate the rows in next fileset. 2023-12-04 18:03:32 +08:00
Haojun Liao
6d82900a32 fix(tsdb): fix error in block dist. 2023-12-04 18:00:41 +08:00
Hongze Cheng
ac2d9ebc27 fix: memory leak 2023-12-04 16:48:43 +08:00
slzhou
8c290587b7 fix: typo error 2023-12-04 16:19:07 +08:00
Haojun Liao
24d9337632 enh(tsdb): extract rows for the given tables in all stt files. 2023-12-04 15:38:24 +08:00
slzhou
a517271f39 Merge branch 'szhou/tms-duration-2' into szhou/tms-duration 2023-12-04 14:56:19 +08:00
slzhou
07e43fe56b fix: two intervals are intesected or not 2023-12-04 14:54:15 +08:00
Hongze Cheng
cea4be6f3c fix: bg task memory waste 2023-12-04 13:40:28 +08:00
54liuyao
38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao
48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455 
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
 2023-12-04 09:10:00 +08:00
Haojun Liao
5467bba86b fix(tsdb): do some internal refactor. 2023-12-04 09:03:40 +08:00
Haojun Liao
7b0cf47fd6 fix(tsdb): do some internal refactor. 2023-12-04 08:58:10 +08:00
Haojun Liao
29a1c6d518 fix(tsdb): do some internal refactor. 2023-12-04 08:55:53 +08:00
wangmm0220
f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
Haojun Liao
3194ff41aa
Merge pull request #23900 from taosdata/fix/3_liaohj 
fix(stream): merge fix from main to 3.0
 2023-12-01 16:39:38 +08:00
shenglian zhou
bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
slzhou
82629c2658 fix: notify when there are no memory pre fileset 2023-12-01 15:11:43 +08:00
Haojun Liao
7e63943c4e
Merge pull request #23860 from taosdata/fix/TD-27455 
fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode
 2023-12-01 14:18:58 +08:00
wade zhang
041add545c
Merge pull request #23844 from taosdata/FIX/TS-4306-3.0 
enh: limit size of snap replication msg by data length
 2023-12-01 14:06:36 +08:00
slzhou
4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
Haojun Liao
eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao
e008d0f440 fix(tsdb): fix invalid read. 2023-12-01 10:20:45 +08:00
Haojun Liao
fbb604d1f5 fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-12-01 10:20:44 +08:00
Haojun Liao
1c9ff8030b fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-12-01 10:20:39 +08:00
Haojun Liao
17d4a22e47 fix(stream): add logs. 2023-12-01 10:19:54 +08:00
Haojun Liao
b9c727575d fix(stream): reset the scheduler status. 2023-12-01 10:19:54 +08:00
Haojun Liao
2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Minglei Jin
49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
wangmm0220
4fc19a6343 fix:snode can only be created 1 2023-11-30 15:49:31 +08:00
54liuyao
271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
Hongze Cheng
0bfa86f188
Merge pull request #23864 from taosdata/feat/TD-27461-3.0 
feat: backgroud task priority
 2023-11-30 13:51:57 +08:00
Haojun Liao
e9ead3bd28
Merge pull request #23341 from taosdata/enh/refactorBackend 
Enh/refactor backend
 2023-11-30 13:48:18 +08:00
Hongze Cheng
8ee4e2c1fe
Merge pull request #23862 from taosdata/fix/TD-27571 
fix(tsdb/cache): flush dirty lru entries before del
 2023-11-30 13:46:50 +08:00
slzhou
80ee5bfb3e fix: the initial value of first fileset start / end key 2023-11-30 11:08:18 +08:00
yihaoDeng
5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
WANG MINGMING
9b72d890c8
Merge branch '3.0' into fix/TD-27455 2023-11-30 09:37:23 +08:00
Hongze Cheng
547e673955 fix: coredump caused by typo 2023-11-30 09:20:18 +08:00
Haojun Liao
130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj 
enh(stream/tsdb): do multiple optimization and fix some bugs.
 2023-11-30 09:20:15 +08:00
Minglei Jin
ab2c7abca1 tsdb/cache-del: commit before get from rocks 2023-11-30 09:15:58 +08:00
Haojun Liao
28e17a61b9 fix(tsdb): fix invalid read. 2023-11-29 19:28:53 +08:00
Haojun Liao
66f25712fd fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-11-29 18:07:15 +08:00
Hongze Cheng
65ccc4aa48 feat: backgroud task priority 2023-11-29 18:01:31 +08:00
Minglei Jin
2c9c117529 fix(tsdb/cache): flush dirty lru entries before del 2023-11-29 17:37:40 +08:00
wangmm0220
4f168b4b2d fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode 2023-11-29 17:22:43 +08:00
Benguang Zhao
e66a1d6c9a enh: limit snap replication msg by size of block data in tsdbSnapReadTimeSeriesData 2023-11-29 16:01:11 +08:00
slzhou
1a3e280ea8 fix: use imem maxKey/minKey 2023-11-29 13:50:53 +08:00
slzhou
09e314c3ae fix: pStatus->pTableIter is set to null when getting mem table time range 2023-11-29 12:26:32 +08:00
54liuyao
ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
shenglian zhou
4691a7767a restore buildBlockFromBufferSequentially back 2023-11-29 10:29:40 +08:00
shenglian zhou
8a79df1113 enhance: prepare duration for next fileset 2023-11-29 10:15:43 +08:00
shenglian zhou
765b8384c0 Merge branch 'szhou/tms-duration' of github.com:taosdata/TDengine into szhou/tms-duration-2 2023-11-29 08:18:27 +08:00
slzhou
b2fa6209d9 fix: descending traverse wrong endkey 2023-11-29 08:09:00 +08:00
Haojun Liao
a5c8eaacaa fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-11-28 23:52:19 +08:00
shenglian zhou
5a75d74421 fix:mem table has data in the fileset duration 2023-11-28 15:58:33 +08:00
slzhou
4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
shenglian zhou
89cd2b6f17 enhance: tsdb output duration order 2023-11-28 14:39:08 +08:00
yihaoDeng
08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
shenglian zhou
cdb7eb462d Revert "Revert "fix: pass compilation"" 
This reverts commit 644dbad920.
 2023-11-28 10:31:18 +08:00
shenglian zhou
df4f7d6956 Revert "Revert "enhance: duration notification"" 
This reverts commit 3331e25aaf.
 2023-11-28 10:31:18 +08:00
shenglian zhou
3331e25aaf Revert "enhance: duration notification" 
This reverts commit 9dd306e1ef.
 2023-11-28 08:29:05 +08:00
shenglian zhou
644dbad920 Revert "fix: pass compilation" 
This reverts commit 1a7ee3643e.
 2023-11-28 08:28:49 +08:00
yihaoDeng
a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
wangmm0220
06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220
70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng
e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
dapan1121
d3ac79aeb7
Merge pull request #23808 from taosdata/fix/PI-23-3.0 
fix: add check in mnode/vnode when alter table col/tag
 2023-11-26 17:31:38 +08:00
Haojun Liao
9194c0c0cd fix(stream): add logs. 2023-11-25 00:56:18 +08:00
Haojun Liao
30c776cc0a fix(stream): reset the scheduler status. 2023-11-25 00:54:32 +08:00
Haojun Liao
d5e123db78
Merge pull request #23791 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-11-24 14:42:43 +08:00
Hongze Cheng
24932d2d41
Merge pull request #23799 from taosdata/fix/TD-27423 
fix(tsdb/skip-row): remove s3 size condition
 2023-11-24 10:48:03 +08:00
Minglei Jin
b1841ee97b tsdb/reader-writer: fix pgno iteration with cache setting 2023-11-24 09:06:43 +08:00
kailixu
ac47d3ea7d enh: more check for column bytes 2023-11-24 06:51:57 +08:00
kailixu
c4f1babdcf enh: naming optimize 2023-11-24 06:42:30 +08:00
kailixu
dc977ca200 fix: stash drop column 2023-11-23 23:09:49 +08:00
kailixu
9ce28483a0 fix: add check in mnode/vnode when alter table col/tag 2023-11-23 21:22:41 +08:00
wangmm0220
d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
yihaoDeng
6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Minglei Jin
3c3763a774 tsdb/read-by-column: fix last column index 2023-11-23 17:30:49 +08:00
Minglei Jin
9334fbcb06 tsdb/read-by-column: zero hint size when i's nonzero 2023-11-23 17:14:26 +08:00
Benguang Zhao
f7f9546d1e enh: trigger vnode commit at exit if meta changed, for dbs of single replica 2023-11-23 16:32:57 +08:00
Minglei Jin
3034ca2875 tsdb/open-file: log not exist file path 2023-11-23 16:25:39 +08:00
Minglei Jin
f076bfdfca fix(tsdb/skip-row): remove s3 size condition 2023-11-23 16:19:26 +08:00
Minglei Jin
460638d294 enh(tsdb/open-file): new s3 failed to connect error code 2023-11-23 16:09:02 +08:00
Minglei Jin
c6721be112 fix stt read compilation 2023-11-23 15:49:42 +08:00
Haojun Liao
0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Minglei Jin
08e5525012 tsdb/read-file-page: new arg for hint size 2023-11-23 15:37:26 +08:00
Minglei Jin
023821a80b enh(tsdb/read-by-column): calc hint size for preloading 2023-11-23 15:16:36 +08:00
yihaoDeng
6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao
8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao
f3355000a3 refactor: do some internal refactor. 2023-11-23 09:34:20 +08:00
Haojun Liao
3edb25a49e fix(stream): add check for assert. 2023-11-23 09:33:40 +08:00
Haojun Liao
7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj 
fix(stream): fix error in generating token in bucket.
 2023-11-23 09:32:14 +08:00
wangmm0220
15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Hongze Cheng
44866b7b12 fix: possible race condition coredump 2023-11-22 20:35:18 +08:00
wangmm0220
cfab06239b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-22 19:37:44 +08:00
wangmm0220
9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao
91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao
c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
slzhou
1a7ee3643e fix: pass compilation 2023-11-22 14:09:09 +08:00
shenglian zhou
9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
dapan1121
1b6a3c2069
Merge pull request #23771 from taosdata/enh/xsren/TD-27022/windows 
Enh/xsren/td 27022/windows
 2023-11-22 10:58:39 +08:00
yihaoDeng
0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng
0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao
b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao
7a0dfdb0cc fix(tsdb): fix invalid read. 2023-11-22 08:40:10 +08:00
yihaoDeng
947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
Haojun Liao
785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060 
fix: errors in snode in conditions like fill history/checkpoint/restart
 2023-11-21 19:02:38 +08:00
facetosea
845493294d osfile 2023-11-21 16:31:31 +08:00
yihaoDeng
a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Haojun Liao
2b099b11dd refactor: do some internal refactor. 2023-11-21 10:09:59 +08:00
yihaoDeng
939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
Minglei Jin
d12bc41236 tsdb/merge: clear file set before return 0 2023-11-20 14:30:25 +08:00
Haojun Liao
1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream 
fix(stream): remove invalid assert
 2023-11-17 23:48:47 +08:00
Haojun Liao
709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
wangmm0220
3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00
yihaoDeng
20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
Haojun Liao
0fac706fa6
Merge pull request #23732 from taosdata/fix/pause_stream 
fix(stream): add check for assert.
 2023-11-17 11:33:19 +08:00
Haojun Liao
2a1a7c82e2 Merge branch '3.0' into fix/3_liaohj 2023-11-17 10:17:14 +08:00
Haojun Liao
8fe79685a2 fix(stream): add check for assert. 2023-11-16 23:45:38 +08:00
Haojun Liao
c070e79d36 fix(stream): add check for assert. 2023-11-16 23:18:07 +08:00
wangmm0220
a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
Minglei Jin
65a27dd9c8 fix(tsdb/cos-merge): skip stt merging & not block commit 2023-11-16 18:58:58 +08:00
dapan1121
dc71252096 Merge remote-tracking branch 'origin/3.0' into merge/32m 2023-11-15 19:43:19 +08:00
wangmm0220
a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
wangmm0220
45782f278b fix:send update msg to vnodes if snode restart 2023-11-15 18:13:35 +08:00
Haojun Liao
9d2256ec9c refactor: do some internal refactor. 2023-11-15 16:03:23 +08:00
Haojun Liao
2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898 
stream event window
 2023-11-15 14:18:07 +08:00
dapan1121
9457cf0b46
Merge pull request #23702 from taosdata/merge/m23 
merge: from main to 3.0
 2023-11-15 13:54:21 +08:00
Hongze Cheng
082ddbddf6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-11-15 13:41:28 +08:00
Hongze Cheng
8050d73202 first version 2023-11-15 13:41:00 +08:00
Haojun Liao
86f2673849
Merge pull request #23703 from taosdata/fix/drop_stream 
fix(tsdb): fix invalid read.
 2023-11-15 13:35:46 +08:00
dapan1121
dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
Haojun Liao
f1b1b8911b fix(tsdb): fix invalid read. 2023-11-15 11:26:43 +08:00
wade zhang
d800d59bf0
Merge pull request #23693 from taosdata/FIX/TD-27303-3.0 
TD-27303
 2023-11-15 11:22:47 +08:00
Haojun Liao
62c7877176 fix(tsdb): fix invalid read. 2023-11-15 11:13:06 +08:00
Hongze Cheng
ed6be3b8c5
Merge pull request #23695 from taosdata/fix/TD-27313 
fix(cos/list): free object array in exception
 2023-11-15 11:09:38 +08:00
Minglei Jin
7f65e92b81 tsdb/retention: not allow migrate backward 2023-11-14 19:27:18 +08:00
dmchen
d8277d5505 TD-27303 2023-11-14 19:18:06 +08:00
dmchen
056993b519 TD-27303 2023-11-14 11:10:22 +00:00
yihaoDeng
f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
Hongze Cheng
f7e63ad1ca
Merge pull request #23680 from taosdata/fix/TD-27273 
fix(tsdb/merge): skip merge if data file cannot be written
 2023-11-14 16:08:12 +08:00
Minglei Jin
cb3fe4d6de fix(tsdb/merge): skip merge if data file cannot be written 2023-11-14 14:15:02 +08:00
Haojun Liao
436c7871a3
Merge pull request #23673 from taosdata/fix/3_liaohj 
fix(stream): fix deadlock and do some internal refactor.
 2023-11-14 11:26:54 +08:00
Haojun Liao
f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
Haojun Liao
cfa7c19dd5
Merge pull request #23667 from taosdata/fix/liaohj 
fix(stream): fix deadlock.
 2023-11-13 22:15:06 +08:00
Haojun Liao
aad8a2eb87 fix(stream): fix deadlock. 2023-11-13 18:20:30 +08:00
Minglei Jin
acd816a364 fix(tsdb/retention): move fset destruction out of for loop 2023-11-13 16:59:26 +08:00
liuyao
37c102a115 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-13 16:06:17 +08:00
yihaoDeng
de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
wade zhang
8e5de50050
Merge pull request #23641 from taosdata/FIX/TS-4249-3.0 
TS-4249
 2023-11-13 10:03:03 +08:00
dapan1121
a51df86e43
Merge pull request #23636 from taosdata/enh/TD-25601-3.0 
enh: support delete msg for rsma
 2023-11-13 08:47:42 +08:00
Haojun Liao
9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao
8925c721e5 fix(stream): adjust critical section. 2023-11-11 15:40:16 +08:00
Haojun Liao
5937bdddf5 refactor:disable test. 2023-11-11 15:40:12 +08:00
Haojun Liao
cb0d244d5a fix(stream): release lock. 2023-11-11 15:40:11 +08:00
Haojun Liao
af08a189c1 fix(stream): disable concurrently restart stream tasks. 2023-11-11 15:40:10 +08:00
Haojun Liao
4d9b422874 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-11 15:40:10 +08:00
Haojun Liao
45ab92a02d fix(stream): remove invalid free. 2023-11-11 15:39:55 +08:00
Haojun Liao
77d6fd5394 refactor: do some internal refactor. 2023-11-11 15:39:09 +08:00
Haojun Liao
608c72e901 refactor(stream): create sim env for stream processing. 2023-11-11 15:39:08 +08:00
Cary Xu
1c2e9c18d5
Update tqSink.c 2023-11-10 22:01:28 +08:00
kailixu
3707857c12 chore: remove obsolete code 2023-11-10 18:43:23 +08:00
kailixu
42e4e2b7a4 fix: macro define 2023-11-10 18:27:42 +08:00
kailixu
9017e2ed68 chore: code optimization 2023-11-10 18:11:06 +08:00
kailixu
c04fb6d543 enh: logic optimization 2023-11-10 17:23:17 +08:00
kailixu
bc44659826 fix: buffer overflow 2023-11-10 17:14:57 +08:00
kailixu
11c0427b22 enh: test case to delete mutiple tables 2023-11-10 16:41:41 +08:00
dmchen
65870ae117 TS-4249 2023-11-10 16:29:59 +08:00
dmchen
22d6204fa9 TS-4249 2023-11-10 08:23:09 +00:00
kailixu
d5d8568bad fix: skip delete msg affects 0 row 2023-11-10 15:30:49 +08:00
kailixu
b1bca4e1e2 fix: batch delete logic 2023-11-10 15:12:10 +08:00
kailixu
5fae10bc76 enh: error code when build delete req 2023-11-10 15:09:01 +08:00
kailixu
2a14a10d0d Merge branch '3.0' into enh/TD-25601-3.0 2023-11-10 14:45:45 +08:00
kailixu
674e878ffa enh: rsma support delete 2023-11-10 14:44:29 +08:00
Haojun Liao
5824caa8f5
Merge pull request #23631 from taosdata/fix/liaohj 
multiple fix
 2023-11-10 13:09:40 +08:00
Minglei Jin
32528ab9cd fix(tsdb/reader-writer): fix pgnoEnd calc 2023-11-10 12:44:09 +08:00
wade zhang
b5b15f36f2
Merge pull request #23627 from taosdata/FIX/TD-27243-3.0 
fix/TD-27243
 2023-11-10 11:05:33 +08:00
Haojun Liao
233777b6ac fix(stream): adjust critical section. 2023-11-10 10:26:45 +08:00
Haojun Liao
d8ab8d2d03 refactor:disable test. 2023-11-10 09:46:20 +08:00
Haojun Liao
ed49294e9b fix(stream): release lock. 2023-11-10 09:35:41 +08:00
Haojun Liao
9978667c48 fix(stream): disable concurrently restart stream tasks. 2023-11-10 09:24:08 +08:00
liuyao
6d2d5823dc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 09:24:05 +08:00
yihaoDeng
3e2314b09b Merge branch '3.0' into enh/refactorBackend 2023-11-10 09:22:16 +08:00
kailixu
ee6e68a71e enh: rsma support delete 2023-11-10 07:02:46 +08:00
Haojun Liao
730434ed82 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-09 23:26:09 +08:00
kailixu
7288b0fc77 enh: rsma delete error code 2023-11-09 20:16:29 +08:00
kailixu
ff3621f382 enh: rsma delete logic 2023-11-09 20:09:39 +08:00
Hongze Cheng
ec3685db94
Merge pull request #23600 from taosdata/fix/TD-27206 
fix(vnode/cos): fix error printing to avoid buffer overflow
 2023-11-09 06:06:54 -06:00
kailixu
572eb691fb enh: support delete msg for rsma 2023-11-09 19:51:01 +08:00
dapan1121
4f67629ea1
Merge pull request #23621 from taosdata/fix/TS-4122 
correct colid in blockinfo
 2023-11-09 18:09:09 +08:00
dmchen
2fbf0a532d fix/TD-27243 2023-11-09 18:02:06 +08:00
yihaoDeng
757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
dmchen
65bebb0912 fix/TD-27243 2023-11-09 09:51:35 +00:00
Minglei Jin
d3cf6a4340 tsdb/file: new nlevel field for remove 2023-11-09 17:44:24 +08:00
Hongze Cheng
b1fbdfcdc9
Merge pull request #23617 from taosdata/fix/little_typo 
fix: code typo
 2023-11-09 03:35:31 -06:00
wade zhang
c0c665d785
Merge pull request #23614 from taosdata/FIX/TD-27230-3.0 
fix: close vnode in the failed mode properly in vmCloseVnode
 2023-11-09 16:32:20 +08:00
wangjiaming0909
a6600ab23a correct colid in blockinfo 2023-11-09 15:41:01 +08:00
Minglei Jin
386c25a99a tsdb/retention: remove file when ref's clear 2023-11-09 15:24:19 +08:00
kailixu
9cf154543f chore: merge 3.0 2023-11-09 15:09:30 +08:00
kailixu
aa3ba74f6e chore: code optimization 2023-11-09 15:03:14 +08:00
dapan1121
8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x 
enh: checkpoint for rsma
 2023-11-09 14:51:37 +08:00
kailixu
74cddda24b Merge branch '3.0' into enh/TD-25601-3.0 2023-11-09 14:37:13 +08:00
Hongze Cheng
e60f69a7ed fix: code typo 2023-11-09 14:20:27 +08:00
yihaoDeng
f74edc7618 Merge branch '3.0' into enh/refactorBackend 2023-11-09 06:14:08 +00:00
Minglei Jin
398771da5b Merge branch '3.0' into fix/TD-27206 2023-11-09 14:06:15 +08:00
liuyao
e56a3e8a1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-09 13:59:39 +08:00
Benguang Zhao
b80770dea8 fix: close vnode in the failed mode properly in vmCloseVnode 2023-11-09 13:05:52 +08:00
kailixu
1a950afdb8 enh: test case for rsma snapshot 2023-11-09 12:09:27 +08:00
Haojun Liao
257ab4f270
Merge pull request #23526 from taosdata/feat/TD-26060 
feat:checkpoint backup function
 2023-11-09 11:46:28 +08:00
kailixu
349e190120 enh: rsma result 2023-11-09 11:23:50 +08:00
kailixu
3495efaac7 enh: rsma exception process 2023-11-09 10:49:40 +08:00
Haojun Liao
62f34c757e fix(stream): remove invalid free. 2023-11-09 10:10:37 +08:00
Minglei Jin
1bb10bb862 vnode/cos: check get object block size optionally 2023-11-09 09:32:13 +08:00
kailixu
501d5a7acc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 20:47:15 +08:00
kailixu
72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
Minglei Jin
5ccdde4495 vnode/cos: error on incomplete fetching 2023-11-08 20:43:52 +08:00
yihaoDeng
3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
liuyao
a8b415ed35 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 17:26:00 +08:00
Minglei Jin
128353a861 vnode/cos: fix get object handler mem 2023-11-08 16:04:24 +08:00
Minglei Jin
e5bbcf76f1 vnode/cos: fix get object block callback 2023-11-08 15:57:56 +08:00
Haojun Liao
99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
Minglei Jin
a1e692a796 fix(vnode/cos): fix error printing to avoid buffer overflow 2023-11-08 15:18:55 +08:00
wangjiaming0909
3e850df3c2 fix: last(ts2), ts2, ts caused data err 2023-11-08 14:43:11 +08:00
Minglei Jin
3f125bc6bf vnode/cos: make err msg buffer big enough for detailed msg 2023-11-08 14:30:30 +08:00
liuyao
340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
Haojun Liao
658fafd03c refactor: do some internal refactor. 2023-11-08 14:02:08 +08:00
wangjiaming0909
fc6c4fba90 feat: cache scan for select last(c), ts/c 2023-11-08 13:39:28 +08:00
Haojun Liao
809dd064a7 refactor(stream): create sim env for stream processing. 2023-11-08 11:04:16 +08:00
Haojun Liao
17bd6badec refactor(stream): do checkpoint for each task. 2023-11-08 10:47:54 +08:00
yihaoDeng
7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
kailixu
d1106c51dc enh: rsma code optimization 2023-11-08 09:54:03 +08:00
xinsheng Ren
96a3c373e0
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-08 09:28:27 +08:00
Minglei Jin
764f8d2e45 fix(vnode/s3): move init & cleanup to dnode 2023-11-08 09:03:19 +08:00
kailixu
b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu
f2d24306b1 enh: rsma tasks share one checkpoint and fix memory leak 2023-11-08 08:35:52 +08:00
Haojun Liao
666b8c531b
Merge pull request #23548 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-11-08 08:08:36 +08:00
Haojun Liao
e052d3cd62 fix(stream): check null. 2023-11-08 00:10:08 +08:00
Haojun Liao
9ba854d49d Merge branch '3.0' into fix/3_liaohj 2023-11-07 23:51:07 +08:00
Haojun Liao
7bfea5a82e fix(stream): fix syntax error. 2023-11-07 22:31:35 +08:00
kailixu
6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
wangmm0220
c0068abc9a fix:merge from 3.0 2023-11-07 18:55:46 +08:00
Haojun Liao
2674698b36 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-07 18:51:46 +08:00
yihaoDeng
95b14ee39b merge 3.0 2023-11-07 17:15:49 +08:00
Haojun Liao
1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao
8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao
7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao
e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
Haojun Liao
207b53f3f6 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:19:09 +08:00
kailixu
ac62714492 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-07 14:20:38 +08:00
Haojun Liao
4d8548e938 refactor: do some internal refactor. 2023-11-06 23:42:16 +08:00
kailixu
f5d796a081 chore: print stream state 2023-11-06 19:53:09 +08:00
Haojun Liao
d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
kailixu
dc5284a19c chore: add debug info 2023-11-06 17:27:36 +08:00
Haojun Liao
6b1889284b fix(stream): record the start failure tasks. 2023-11-06 15:45:44 +08:00
Minglei Jin
ec908fa4d0 fix(cache/reader): use int64 max instead of uint 2023-11-06 15:34:28 +08:00
wangmm0220
dffaac55ea fix:move cos from util to common 2023-11-06 14:57:32 +08:00
Minglei Jin
31ce6453c2 fix(cmake/s3): make cmake config portable 2023-11-06 14:17:27 +08:00
Haojun Liao
69863febe6 fix(stream):reset the starting flag for the followers. 2023-11-06 13:17:13 +08:00
Haojun Liao
bfd14076d7 fix(stream): fix dead-lock. 2023-11-06 12:05:47 +08:00
Haojun Liao
d41fd27189 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-06 11:57:21 +08:00
Haojun Liao
0e44950a37 enh(stream): execute scan history by using time slice 1s. 2023-11-06 09:21:33 +08:00
Haojun Liao
680eb5674e refactor: do some internal refactor. 2023-11-06 09:15:49 +08:00
kailixu
7e8c123fca chore: rsma code optimization 2023-11-06 08:46:04 +08:00
Haojun Liao
d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao
e13f003b90 refactor: do some internal refactor. 2023-11-05 01:23:23 +08:00
kailixu
411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
yihaoDeng
f038f88c07 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-03 18:29:18 +08:00
Haojun Liao
3415ba5195
Merge pull request #23528 from taosdata/fix/liaohj 
enh(tsdb): on-demand open stt file reader.
 2023-11-03 17:29:55 +08:00
kailixu
77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
Haojun Liao
d3ddaaa9f3 other(tsdb): adjust some log info. 2023-11-03 15:08:25 +08:00
Haojun Liao
de5c4d8d5d other(tsdb): adjust some log info. 2023-11-03 15:07:40 +08:00
kailixu
c95fc014a8 enh: rsma checkpoint 2023-11-03 14:57:36 +08:00
kailixu
a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Haojun Liao
34403534ed Merge branch '3.0' into fix/3_liaohj 2023-11-03 14:06:58 +08:00
liuyao
b1d1e2c778 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 14:02:59 +08:00
dm chen
dffc4d317f
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 13:57:08 +08:00
Haojun Liao
b4d14d3847 fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 13:51:18 +08:00
Haojun Liao
675c9ca613 enh(tsdb): on-demand open stt file reader. 2023-11-03 13:51:18 +08:00
wangmm0220
0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
Haojun Liao
c980e2030c fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 11:04:32 +08:00
Haojun Liao
0acf4f1795 enh(tsdb): on-demand open stt file reader. 2023-11-03 10:35:05 +08:00
Hongze Cheng
1ff3f96b08
Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write 
enh(tsdb/retention): enable last tier write
 2023-11-02 21:21:38 -05:00
dm chen
0371064acc
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 10:20:54 +08:00
yihaoDeng
24e961976f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-03 09:31:57 +08:00
liuyao
31ad73f6d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 09:12:17 +08:00
Haojun Liao
ff5d69352f
Merge pull request #23493 from taosdata/fix/3_liaohj 
fix(stream): add unsupport trans.
 2023-11-03 09:07:33 +08:00
Haojun Liao
70388bafd2
Merge pull request #23523 from taosdata/fix/liaohj 
fix(stream): fix deadlock in transfer state.
 2023-11-03 09:07:23 +08:00
kailixu
d9ed63473c Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 08:37:41 +08:00
yihaoDeng
6ce878948f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 20:44:36 +08:00
kailixu
6c944bb192 enh: skip rsma_task during load stream tasks 2023-11-02 20:32:54 +08:00
wangmm0220
159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
liuyao
389117b806 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 20:07:12 +08:00
Haojun Liao
b3d57e4a2d fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:31:35 +08:00
Haojun Liao
7a32b3a209 fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:12:36 +08:00
kailixu
fa5d896787 enh: rsma checkpoint 2023-11-02 18:56:36 +08:00
Haojun Liao
c4079332ff fix(stream):update the log level. 2023-11-02 18:18:04 +08:00
Haojun Liao
0a227e807f refactor: set different tq level. 2023-11-02 18:18:04 +08:00
Haojun Liao
48aff868b6 fix(stream):update the log level. 2023-11-02 18:16:47 +08:00
Haojun Liao
3aed8c29ae refactor: set different tq level. 2023-11-02 17:12:20 +08:00
Hongze Cheng
faea18c38f fix: invalid read when file is deleted 2023-11-02 16:59:11 +08:00
kailixu
2d597659bc enh: rsma checkpoint 2023-11-02 15:20:54 +08:00
liuyao
330b04a8bc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 14:36:13 +08:00
Haojun Liao
f5fa3edeba
Merge pull request #23503 from taosdata/fix/liaohj 
fix(stream): fix dead lock.
 2023-11-02 13:52:50 +08:00
kailixu
722777f8c9 enh: rsma checkpoint 2023-11-02 13:15:31 +08:00
kailixu
96b5024347 enh: rsma checkpoint 2023-11-02 13:05:36 +08:00
kailixu
698fb804f9 enh: disable update tbUidList during reboot 2023-11-02 12:54:23 +08:00
kailixu
76536e1c82 enh: rsma logic 2023-11-02 11:03:18 +08:00
Haojun Liao
95efa07e92 fix(stream): add full unsupported event filtering. 2023-11-02 11:02:39 +08:00
Minglei Jin
46d3be1f08 config/page-cache-size: new parameter for pcache size 2023-11-02 10:10:03 +08:00
kailixu
9649e87cab fix: rsma checkpoint 2023-11-02 09:44:43 +08:00
Haojun Liao
351a31302f fix(stream): add full unsupported event filtering. 2023-11-02 09:43:48 +08:00
Minglei Jin
d0327e07b8 tsdb/pg-cache: use pgno for cache key instead of blkno 2023-11-02 09:42:19 +08:00
Hongze Cheng
a6ee7c4685 fix: possible coredump 2023-11-01 20:34:47 +08:00
kailixu
3803f952f9 chore: rsma checkpoint verify 2023-11-01 20:05:00 +08:00
Haojun Liao
7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao
00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao
9a9c1d689d fix(stream): add lock log. 2023-11-01 19:38:12 +08:00
Haojun Liao
246ed4e022 refactor: do some internal refactor. 2023-11-01 17:19:21 +08:00
liuyao
505c44d9aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-01 16:50:46 +08:00
kailixu
c32e60d199 chore: more code for rsma checkpoint 2023-11-01 16:27:41 +08:00
Haojun Liao
12bc4f32cf refactor: add some logs. 2023-11-01 16:12:15 +08:00
yihaoDeng
4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
kailixu
59be62c96e chore: set stream input checkpoint 2023-11-01 15:34:17 +08:00
Minglei Jin
6f0fa5d47e tsdb/retention: remove incorrect right brace 2023-11-01 14:56:57 +08:00
Haojun Liao
5ff89bc098 fix(stream): add lock log. 2023-11-01 13:19:53 +08:00
kailixu
ab266c712f chore: checkpoint for rsma stream state 2023-11-01 12:29:54 +08:00
Haojun Liao
0cf0ff3bbf
Merge pull request #23455 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-11-01 12:01:54 +08:00
Haojun Liao
3e6c89d8eb fix(stream): add unsupport trans. 2023-11-01 11:43:02 +08:00
Minglei Jin
221afff9ee vnode/write: remove keep modify code block 2023-11-01 11:00:47 +08:00
Minglei Jin
64644d673b
Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 10:53:55 +08:00
Minglei Jin
a61502411d tsdb/pg-cache: new page cache for tsdb s3 read file page 2023-11-01 10:49:05 +08:00
kailixu
1530fe0c49 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-01 09:52:16 +08:00
kailixu
ad1e6accd4 chore: build checkpoint for rsma 2023-11-01 09:45:58 +08:00
Haojun Liao
7359f98eca
Merge pull request #23428 from taosdata/fix/3_liaohj 
other: merge refactor into 3.0
 2023-11-01 09:44:31 +08:00
Haojun Liao
639d5cde47 fix(stream): add unsupport trans. 2023-10-31 23:14:02 +08:00
yihaoDeng
bb8252df16 fix mem leak 2023-10-31 20:59:24 +08:00
kailixu
e6684fa5de enh: rsma retetion and stream state 2023-10-31 20:26:42 +08:00
dapan1121
d40cc27abc
Merge pull request #23464 from taosdata/enh/TD-26638-3.0 
enh: use placeholder '-' for interval of 1st retention level
 2023-10-31 18:36:43 +08:00
Haojun Liao
a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao
0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
Haojun Liao
4c0242a58d fix(stream): fix error in finishing event handling. 2023-10-31 16:39:14 +08:00
liuyao
696294c208 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-31 15:41:04 +08:00
wade zhang
76c9b9afc5
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0 
feat: support pipelining of snap replication
 2023-10-31 15:19:07 +08:00
wade zhang
25b09b467f
Merge pull request #23439 from taosdata/feat/TD-26971-3.0 
TD-26971
 2023-10-31 13:53:49 +08:00
kailixu
28cd8f4915 enh: file duration for rsma 2023-10-31 11:38:33 +08:00
Hongze Cheng
ac3df85d8a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684 2023-10-31 11:23:23 +08:00
Haojun Liao
fc70fa053c fix(tsdb): fix syntax error. 2023-10-31 10:45:14 +08:00
Haojun Liao
6a7ba0f5f5 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 10:45:14 +08:00
Haojun Liao
00626de6e4 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-31 10:45:13 +08:00
Haojun Liao
cb43299faa fix(tsdb): avoid to read duplicated rows in buf. 2023-10-31 10:45:13 +08:00
Haojun Liao
635243f01a refactor: do some internal refactor. 2023-10-31 10:45:12 +08:00
Haojun Liao
6e2240a3d1 fix(stream): fix the deadlock. 2023-10-31 10:45:12 +08:00
Haojun Liao
0c982093cd fix(stream): enable the set of fill-history task to be un-init. 2023-10-31 10:45:12 +08:00
Haojun Liao
8b9bc988f1 fix(tsdb): fix syntax error. 2023-10-31 10:42:34 +08:00
Haojun Liao
eaf76854f6 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 09:29:24 +08:00
dmchen
ffb1e1e8c3 end point 2023-10-30 12:05:20 +00:00
kailixu
b03baaed2c chore: revert the code change 2023-10-30 19:49:50 +08:00
kailixu
89651626e3 chore: reopen rsma stream commit 2023-10-30 19:45:18 +08:00
dmchen
fe044051c8 memory leak 2023-10-30 19:36:27 +08:00
dmchen
5120d25297 memory leak 2023-10-30 11:34:34 +00:00
Minglei Jin
867ce92dcc tsdb/file-rw: fix log msg 2023-10-30 19:28:18 +08:00
Minglei Jin
800cbfbb05 tsdb/file: new s3flag in mem 2023-10-30 17:36:49 +08:00
Haojun Liao
6e118c7963 fix(stream): fix memory leak. 2023-10-30 17:28:57 +08:00
dmchen
0f40e1dbb9 memory leak 2023-10-30 16:59:12 +08:00
dmchen
40c9622df5 memory leak 2023-10-30 08:57:07 +00:00
Haojun Liao
ed07486405 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-30 16:40:09 +08:00
Haojun Liao
bc1c2a879a fix(tsdb): avoid to read duplicated rows in buf. 2023-10-30 16:12:08 +08:00
dmchen
be0a85a0ff memory leak 2023-10-30 15:22:54 +08:00
Minglei Jin
84d2f9c379 tsdb/upload: delay data file uploading 2023-10-30 15:22:34 +08:00
dmchen
6172b820ac memory leak 2023-10-30 07:19:08 +00:00
Haojun Liao
fdf3f210ac refactor: do some internal refactor. 2023-10-30 14:39:24 +08:00
Haojun Liao
3275452bce fix(stream): fix the deadlock. 2023-10-30 14:38:51 +08:00
kailixu
c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
Haojun Liao
15d217fc3e fix(stream): fix memory leak. 2023-10-30 13:29:35 +08:00
Haojun Liao
b0700d6095 Merge branch '3.0' into fix/3_liaohj 2023-10-30 11:57:54 +08:00
Haojun Liao
93232a0e14 fix(stream): enable the set of fill-history task to be un-init. 2023-10-30 11:48:51 +08:00
liuyao
1a37f19c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 11:43:23 +08:00
dapan1121
1b7a6bccdf
Merge pull request #23430 from taosdata/enh/TD-26641-3.0 
enh: only float/double allowed for sum/avg of rsma
 2023-10-30 10:08:55 +08:00
Minglei Jin
4fede02da4 tsdb/retention: remove s3 evict cache hook 2023-10-30 10:06:42 +08:00
Haojun Liao
c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao
4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
Hongze Cheng
a7f3041ff3 more fix 2023-10-27 17:59:27 +08:00
Benguang Zhao
4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
Hongze Cheng
cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
dmchen
43e6dec6c2 TD-26971 2023-10-27 17:39:50 +08:00
dmchen
34c4ffde26 TD-26971 2023-10-27 09:30:30 +00:00
Minglei Jin
8c6f452f09 tsdb/write: make last tier writable to mem 2023-10-27 15:51:52 +08:00
Haojun Liao
dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
Haojun Liao
9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
Haojun Liao
454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao
33dc51cc86 fix(stream): add some logs. 2023-10-27 09:59:44 +08:00
Haojun Liao
1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao
2493c21ed3 fix(stream): fix the invalid write in sma 2023-10-27 09:58:52 +08:00
Haojun Liao
7cce53f7e5 fix(stream): ignore the check status when is ready. 2023-10-27 09:58:52 +08:00
Haojun Liao
c99f434706 fix(stream): set checkpoint failure when in pause status. 2023-10-27 09:58:52 +08:00
Haojun Liao
2c1af8dad8 refactor: do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao
1ad2c3029a refactor(stream): do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao
7311f9d2fe fix(sma): fix bugs in sma and do some internal refactor. 2023-10-27 09:58:51 +08:00
Haojun Liao
3bcffcf1da other: merge stream refactor from main. 2023-10-27 09:56:02 +08:00
Haojun Liao
226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao
091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao
e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao
8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao
1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao
579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao
6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao
596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao
62c58ecd8b fix(stream):add more check for test cases. 2023-10-27 09:54:06 +08:00
liuyao
cf3bfe9310 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-27 09:39:00 +08:00
dmchen
ca5e252c0c atomic init 2023-10-27 01:20:33 +00:00
dmchen
21dd6f70a9 atomic init 2023-10-27 01:16:53 +00:00
Hongze Cheng
b8c379a20d
Merge pull request #23413 from taosdata/fix/TD-26669 
fix(tsdb/commmit): make ts big enough to skip row
 2023-10-26 07:17:53 -05:00
dmchen
9af7b7b178 init error 2023-10-26 11:50:34 +00:00
wade zhang
d1e4e909c3
Merge pull request #23384 from taosdata/fix/TD-26884-3.0 
Fix/td 26884 3.0
 2023-10-26 17:00:00 +08:00
wade zhang
951442e3db
Merge pull request #23381 from taosdata/fix/TD-26884-main 
TD-26884
 2023-10-26 16:59:39 +08:00
Minglei Jin
b314758108 tsdb/commit: make ts big enough to skip row 2023-10-26 16:24:06 +08:00
yihaoDeng
4c03d372ef fix stream case error 2023-10-26 14:19:34 +08:00
kailixu
bb77015998 Merge branch '3.0' into enh/TD-26641-3.0 2023-10-26 10:40:54 +08:00
Hongze Cheng
209ebbde84
Merge pull request #23402 from taosdata/fix/TD-26189-libs3 
cmake/xml2: use sha256 to verify distribution release
 2023-10-25 20:27:29 -05:00
kailixu
64765579e9 enh: check interval and keep for retentions 2023-10-25 22:42:01 +08:00
yihaoDeng
db0f6258fe fix stream case error 2023-10-25 19:38:22 +08:00
liuyao
f51c985914 stream event window 2023-10-25 17:50:16 +08:00
Minglei Jin
d77ecbbb1b cmake/xml2: use sha256 to verify distribution release 2023-10-25 17:41:55 +08:00
dmchen
14be9c81e2 create table user and clusterid 2023-10-25 14:53:06 +08:00
dmchen
7ef019d105 create table user and clusterid 2023-10-25 06:49:23 +00:00
Haojun Liao
f36b24ed24 fix(stream): disable follower nodes exec reset. 2023-10-25 14:16:36 +08:00
Hongze Cheng
3ff331b8b7
Merge pull request #23391 from taosdata/fix/TD-26189-libs3 
cmake: new option: BUILD_S3
 2023-10-24 22:37:20 -05:00
Haojun Liao
03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
Haojun Liao
26aaa4a83c other: merge main. 2023-10-25 00:39:14 +08:00
Haojun Liao
13d979a2ee fix(stream): add some logs. 2023-10-25 00:03:46 +08:00
Haojun Liao
8cde39eebd fix(stream): fix dead lock when shutdown all tasks. 2023-10-24 19:11:24 +08:00
Minglei Jin
f9ca8fe962 cmake: new option: BUILD_S3 2023-10-24 16:10:46 +08:00
Haojun Liao
f1498f8929 fix(stream): fix the invalid write in sma 2023-10-24 15:24:34 +08:00
dmchen
162066235b create table 2023-10-24 14:31:27 +08:00
Hongze Cheng
e7e7748e6d
Merge pull request #23366 from taosdata/fix/TD-26669 
tsdb/commit: skip last tier ts data committing
 2023-10-24 01:29:01 -05:00
dmchen
ae728ab412 create table 2023-10-24 06:17:13 +00:00
yihaoDeng
95b0d4f083 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-24 13:40:47 +08:00
Haojun Liao
a6e706ba2d fix(stream): ignore the check status when is ready. 2023-10-24 11:38:14 +08:00
Haojun Liao
e92b276e3e fix(stream): set checkpoint failure when in pause status. 2023-10-24 10:14:29 +08:00
Minglei Jin
e826532592 cmake/vnode: specify no default path for ssl & crypto 2023-10-24 10:10:43 +08:00
Haojun Liao
0dae8c3c76 refactor: do some internal refactor. 2023-10-24 09:49:14 +08:00
Haojun Liao
f446ff1c36 refactor(stream): do some internal refactor. 2023-10-24 09:48:10 +08:00
Haojun Liao
7a8b046a35 fix(sma): fix bugs in sma and do some internal refactor. 2023-10-24 09:40:38 +08:00
Minglei Jin
7fdf6cc696 cmake: use new dir for libs3 2023-10-24 09:04:24 +08:00
dmchen
dec257ff59 TD-26529 2023-10-23 08:59:54 +00:00
Minglei Jin
80fb38f172 Merge branch '3.0' into fix/TD-26189-libs3 2023-10-23 16:31:21 +08:00
Minglei Jin
f630fc38f8 tsdb/commit: skip last tier ts data committing 2023-10-23 15:46:32 +08:00
Haojun Liao
2ee3319611
Merge pull request #23360 from taosdata/fix/liaohj 
fix(tsdb): apply the window range when building blocks from stt files.
 2023-10-23 12:45:42 +08:00
Haojun Liao
6dc8fc50bc
Merge pull request #23359 from taosdata/fix/3_liaohj 
fix(tsdb): apply the window range when building blocks from stt files.
 2023-10-21 14:57:14 +08:00
Haojun Liao
f667bf3866 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:19:45 +08:00
Haojun Liao
f1207d8d42 fix(tsdb): apply the window range when building blocks from stt files. 2023-10-20 18:18:58 +08:00
Haojun Liao
c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
yihaoDeng
1a4cfd11a5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:28:10 +08:00
Minglei Jin
55647f9ce9 cos/put: make chunk small to not block other reqs 2023-10-20 15:15:03 +08:00
Haojun Liao
3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
Minglei Jin
74d05c2771 vnode/cos: fix multipart uploading 2023-10-20 13:47:25 +08:00
Haojun Liao
270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Benguang Zhao
959f8105ee enh: require command to trigger repairing vnodes on replaced disks 2023-10-19 18:55:12 +08:00
Haojun Liao
d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao
c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
Haojun Liao
402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
Benguang Zhao
a2e0480839 refact: rename as SYNC_FSM_STATE_COMPLETE 2023-10-19 11:18:57 +08:00
Benguang Zhao
a515f8a94f feat: use vnode config info if existing during vnodeCreate 2023-10-19 11:18:57 +08:00
Benguang Zhao
a95f6e6862 feat: support restore dnode with vnodes of replaced disks for primary dirs 2023-10-19 11:18:57 +08:00
Benguang Zhao
c4e9069a66 fix: set nextProcessedVer properly in tqProcessTaskScanHistory 2023-10-19 11:18:57 +08:00
Benguang Zhao
5c85525fd0 enh: add tsdbFSCreateRefSnapshotWithoutLock 2023-10-19 11:18:57 +08:00
Benguang Zhao
f2bd43c07e fix: set field length properly in tsdbGetSnapDetails 2023-10-19 11:18:57 +08:00
Benguang Zhao
83013e0fe5 enh: return error in case of out of memory for tsdbGetSnapRangeHash 2023-10-19 11:18:57 +08:00
Benguang Zhao
59e8a2104c refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
eb8c4d3e8c enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
4e74533878 enh: avoid _Static_assert 2023-10-19 11:18:57 +08:00
Benguang Zhao
094cf408df enh: prepare vnode dir again in vnodeOpen 2023-10-19 11:18:57 +08:00
Benguang Zhao
c1f1709d59 fix: add rsmaSnapWriterPrepareClose 2023-10-19 11:18:57 +08:00
Benguang Zhao
74185b8b9c feat: exchange snapshot info for rsma tsdbs 2023-10-19 11:18:57 +08:00
Benguang Zhao
d5d713b1b4 enh: fill snapshot info for rsma tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao
b80f8201ce feat: detect fs incompleteness of RSMA tsdbs 2023-10-19 11:04:39 +08:00
Benguang Zhao
29bbebc323 enh: refactor a func name as tsdbSnapGetDetails 2023-10-19 11:04:39 +08:00
Benguang Zhao
00aeb031d4 enh: replicate a fset if it is corrupted without valid minVer 2023-10-19 11:04:39 +08:00
Benguang Zhao
a6d5deb5d1 fixup: fix tsdbFSDoSanAndFix 2023-10-19 11:04:39 +08:00
Benguang Zhao
eb4e2aa58f feat: restore incomplete fsm state with maxVerValid via snapshot replication 2023-10-19 11:04:36 +08:00
Benguang Zhao
0c41fa56dc feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot 2023-10-19 11:00:44 +08:00
Benguang Zhao
e1c03118ab enh: extract snapshot info for both of snap reader and writer 2023-10-19 10:51:13 +08:00
Benguang Zhao
410ced8320 feat: use TLV format to encode data of snapshot info 2023-10-19 10:51:13 +08:00
Benguang Zhao
f99795d027 enh: use tsdbSnapRangeArrayDestroy 2023-10-19 10:51:13 +08:00
Benguang Zhao
c1b2eedd3c feat: impl tsdbSnapGetInfo 2023-10-19 10:51:08 +08:00
Benguang Zhao
4d55488495 feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen 2023-10-19 10:37:34 +08:00
Benguang Zhao
083dd148be feat: exchange difference of snapshot info for replication 2023-10-19 10:37:34 +08:00
Benguang Zhao
b23bcee690 fixup: about to revert this commit 2023-10-19 10:37:34 +08:00
Benguang Zhao
0ddbcd50d0 enh: maintain independent version range of tombs for SDataFileWriter 2023-10-19 10:37:34 +08:00