Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
67094 commits 554 branches 514 tags 1.7 GiB
Commit graph

15104 commits

Author SHA1 Message Date
Hongze Cheng
6c41fa48dd fix: delete table snapshot coredump 2024-03-15 16:55:50 +08:00
wangmm0220
5f687f0d88 fix:[TS-4563]retrieve data error from wal if colid is bigger in tmq 2024-03-15 15:59:03 +08:00
Haojun Liao
a576be6ae5 fix(stream): set the correct rows info for stream tasks when retreiving task info. 2024-03-15 15:19:20 +08:00
yihaoDeng
ec227180e1 add alg to block col 2024-03-14 12:37:15 +00:00
yihaoDeng
646478c6dc Merge branch 'feat/TS-4243-3.0' into feature/compressData 2024-03-14 12:22:58 +00:00
yihaoDeng
bdbe9b042c Merge branch 'feature/compressData' of https://github.com/taosdata/TDengine into feature/compressData 2024-03-14 12:20:13 +00:00
yihaoDeng
739e3ba7ab add zstd lib 2024-03-14 12:19:12 +00:00
factosea
c6adba9bfc fix: merge error 2024-03-14 19:56:19 +08:00
facetosea
6678a65dc4 merge ts-4243 2024-03-14 19:06:34 +08:00
Haojun Liao
f28e994409
Merge pull request #25091 from taosdata/fix/3_liaohj 
fix(stream): transfer state before do checkpoint
 2024-03-14 17:59:13 +08:00
Haojun Liao
34c849bdbe enh(tsdb): read composed key in stt. 2024-03-14 17:03:57 +08:00
Haojun Liao
cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
wangmm0220
c866c9ad02 fix:case error 2024-03-14 14:27:13 +08:00
yihaoDeng
fe10867547 Merge branch '3.0' into feature/compressData 2024-03-14 03:19:39 +00:00
Haojun Liao
15663ab450
Merge pull request #25084 from taosdata/fix/3_liaohj 
fix(tsdb): set strict varchar length check.
 2024-03-14 11:16:03 +08:00
Haojun Liao
190b02dd1a fix(stream):set correct version for sink/agg tasks. 2024-03-14 10:04:43 +08:00
Haojun Liao
2b7fd0d15c fix(tsdb): set strict varchar length check. 2024-03-14 10:04:14 +08:00
wangmm0220
f27becb76a opti:tmq logic 2024-03-14 00:08:56 +08:00
wangmm0220
5a5bf29acb opti:tmq logic 2024-03-13 23:50:42 +08:00
yihaoDeng
cc7d5ce484 add api 2024-03-13 12:58:05 +00:00
wangmm0220
6f4809fe21 opti:tmq logic 2024-03-13 20:28:37 +08:00
yihaoDeng
a5eebc90cb add api 2024-03-13 12:04:21 +00:00
wangmm0220
d0bdb0ce2b opti:tmq logic 2024-03-13 19:36:00 +08:00
yihaoDeng
3c11dc4ec1 fix show create table crash 2024-03-13 09:54:14 +00:00
Haojun Liao
2466e169a0
Merge pull request #25067 from taosdata/fix/TD-29073 
open operator after resume stream
 2024-03-13 17:43:13 +08:00
yihaoDeng
5c67a67363 fix desc crash 2024-03-13 08:33:53 +00:00
yihaoDeng
064e7ef017 fix desc crash 2024-03-13 08:03:43 +00:00
yihaoDeng
e9b0c877b0 fix double free 2024-03-13 06:01:16 +00:00
yihaoDeng
85fec026d6 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-29130 2024-03-13 05:57:20 +00:00
yihaoDeng
e72ddf9429 fix double free 2024-03-13 05:56:13 +00:00
Hongze Cheng
d9db5b015c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-13 13:31:59 +08:00
wangmm0220
4dfc531e6c opti:subscribe logic 2024-03-12 19:42:26 +08:00
yihaoDeng
796ff03eb5 fix invalid copy 2024-03-12 09:47:01 +00:00
54liuyao
3835e0c156 open operator after resume stream 2024-03-12 16:35:55 +08:00
Haojun Liao
0315e5ac63 feat(tsdb): read complex primary key from buf. 2024-03-12 16:22:56 +08:00
yihaoDeng
e25024cca3 fix invalid free 2024-03-12 07:09:50 +00:00
Haojun Liao
bc98f12798 feat(tsdb): read complex primary key from buf. 2024-03-12 14:06:59 +08:00
Hongze Cheng
f6c2a6bba2 more fix 2024-03-11 19:17:30 +08:00
Hongze Cheng
797a30ec02 more fix 2024-03-11 14:25:26 +08:00
Hongze Cheng
409c170404 fix more 2024-03-11 14:18:04 +08:00
Hongze Cheng
8480fd9181 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-08 17:08:09 +08:00
Hongze Cheng
acbde220bf more bug fix 2024-03-08 17:04:26 +08:00
Haojun Liao
abc16cda18
Merge pull request #25039 from taosdata/fix/nullcheck 
test(stream): add some test cases to inc coverage.
 2024-03-08 17:03:20 +08:00
yihaoDeng
a52213dd23 fix create stable error 2024-03-08 08:40:33 +00:00
Haojun Liao
3de1413974 test(stream): add some test cases to inc coverage. 2024-03-08 13:38:51 +08:00
Hongze Cheng
fbc52d2a9c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-08 13:15:11 +08:00
Hongze Cheng
710a8ccbf2 fix more code 2024-03-08 13:14:54 +08:00
factosea
af9fdcd29d create stable/table 2024-03-08 11:23:11 +08:00
dapan1121
2349b28c12
Merge pull request #25024 from taosdata/fix/TS-4540 
fix:[TS-4540]seperate block if insert in one sql when subscribe query
 2024-03-08 10:50:30 +08:00
Hongze Cheng
1d49fc6148 fix more code 2024-03-08 10:43:40 +08:00
Hongze Cheng
7ffcb60f02 fix more code 2024-03-07 16:04:51 +08:00
Hongze Cheng
f43a7a6153 fix copy bug 2024-03-07 15:43:15 +08:00
Hongze Cheng
f6a5144972 more code 2024-03-07 14:40:42 +08:00
dmchen
69741d6e10 fix/TS-4535 2024-03-07 06:33:45 +00:00
wangmm0220
80f55abc61 fix:[TS-4540]seperate block if insert in one sql when subscribe query 2024-03-07 14:16:10 +08:00
Hongze Cheng
b764d51fae more code 2024-03-07 14:02:13 +08:00
Hongze Cheng
456db5b4c3 more code 2024-03-07 13:14:56 +08:00
Hongze Cheng
4dbdd2e35b more code 2024-03-07 10:42:20 +08:00
Hongze Cheng
fea538b4c9 remove useless code 2024-03-07 10:02:15 +08:00
yihaoDeng
63d3671f42 add new msg 2024-03-06 12:06:26 +00:00
Hongze Cheng
b6c71d8a43 more code 2024-03-06 17:56:35 +08:00
Hongze Cheng
3cb2838202 more code 2024-03-06 17:53:49 +08:00
Hongze Cheng
a705ee476c more change 2024-03-06 17:23:51 +08:00
Hongze Cheng
c941ad58ee more code 2024-03-06 17:06:39 +08:00
Hongze Cheng
28d83d6ab6 more code 2024-03-06 16:42:54 +08:00
Hongze Cheng
f05fe86ef0 more code 2024-03-06 16:23:02 +08:00
Hongze Cheng
5ed903dd01 more code 2024-03-06 15:52:34 +08:00
Hongze Cheng
dfd725fbdb more code 2024-03-06 15:37:57 +08:00
Minglei Jin
60ef86da6d vnd/clusterId: new interface to get cluster id for vnode 2024-03-06 14:35:44 +08:00
Hongze Cheng
b06e1b8236 refact more code 2024-03-06 13:30:23 +08:00
Hongze Cheng
dd155a52fa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-06 08:57:51 +08:00
Haojun Liao
3aa2e24d78
Merge pull request #25006 from taosdata/fix/nullcheck 
fix(stream): set the dest epset from mnode, and set the retry error
 2024-03-05 19:46:41 +08:00
Hongze Cheng
512892648b
Merge pull request #25007 from taosdata/fix/TD-29012 
fix: dynmaic config supportvnodes in ent
 2024-03-05 17:55:19 +08:00
Hongze Cheng
050d1bc002 more code 2024-03-05 17:25:02 +08:00
Hongze Cheng
b33074dcbb &&&b/github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-05 17:06:45 +08:00
Hongze Cheng
fb4e17a0cb more code 2024-03-05 17:06:14 +08:00
Hongze Cheng
a728f2b5c9 more code 2024-03-05 16:47:59 +08:00
Hongze Cheng
1440c1b942 more code 2024-03-05 16:13:14 +08:00
dapan1121
19b51ec02c
Merge pull request #24994 from taosdata/mark/3.0 
fix:add excluded msg for delete in tmq
 2024-03-05 15:46:49 +08:00
Hongze Cheng
8aadc70b06 more code 2024-03-05 15:43:46 +08:00
Shungang Li
254afc070c fix: dynmaic config supportvnodes in ent 2024-03-05 15:20:11 +08:00
Haojun Liao
cdfbbc2985 fix(stream): set the dest epset from mnode, and set the retry error code for trans. 2024-03-05 13:28:34 +08:00
Minglei Jin
d2ae4a6e26 enh(s3/writing): enable writing to s3 always 2024-03-05 09:52:26 +08:00
Hongze Cheng
b0d9c2632f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-05 09:27:32 +08:00
Haojun Liao
4d10f28a00
Merge pull request #24999 from taosdata/fix/nullcheck 
fix(stream): remove related fill-history if task in stop status.
 2024-03-05 09:15:21 +08:00
Haojun Liao
2ac803bf3c fix(stream): clear and set task status. 2024-03-04 22:16:41 +08:00
Haojun Liao
80fd3e0445 fix(stream): remove related fill-history if task in stop status. 2024-03-04 19:31:47 +08:00
Hongze Cheng
40a2b06451 more code 2024-03-04 19:25:20 +08:00
wangmm0220
c7d115d8aa fix:add excluded msg for delete in tmq 2024-03-04 14:58:13 +08:00
Hongze Cheng
e9371a1eab Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-04 09:16:08 +08:00
Haojun Liao
0d82ea9e62
Merge pull request #24966 from taosdata/fix/3_liaohj 
enh(stream): async handle pause event
 2024-03-04 09:10:10 +08:00
Hongze Cheng
c8280e05dd Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-03 16:01:34 +08:00
Hongze Cheng
9b8dec7691 more code 2024-03-03 16:01:12 +08:00
yihaoDeng
e084ee9d22 compress impl 2024-03-01 06:19:37 +00:00
Hongze Cheng
818b9d1564
Merge pull request #24943 from taosdata/ENH/TD-28888-3.0 
enh: adjust an error logging msg in process sync msg
 2024-03-01 10:00:31 +08:00
Hongze Cheng
ddea43e5d5
Merge pull request #24964 from taosdata/fix/fixMemleakWhileQuit 
Fix/fix memleak while taosd quit
 2024-03-01 09:26:14 +08:00
Hongze Cheng
22e52d6d82
Merge pull request #24958 from taosdata/fix/TD-28920-3.0 
fix/TD-28920
 2024-03-01 09:21:07 +08:00
Haojun Liao
8791a163f8 other: merge 3.0 2024-02-29 22:31:52 +08:00
Haojun Liao
db92bf84d8 other: merge 3.0 2024-02-29 22:21:50 +08:00
Hongze Cheng
c353f6b350
Merge pull request #24963 from taosdata/fix/TD-28329-2 
fix(tsdb/cache): new case for column changing
 2024-02-29 21:01:12 +08:00
Minglei Jin
3c80f171ef fix(tsdb/cache): new case for column changing 2024-02-29 18:56:14 +08:00
yihaoDeng
e0b1b5a1c6 fix mem leak while taosd quit 2024-02-29 10:54:35 +00:00
yihaoDeng
a0c77f5baa fix mem leak while taosd quit 2024-02-29 18:40:21 +08:00
Hongze Cheng
d7a44a22f4 more change 2024-02-29 17:24:31 +08:00
Hongze Cheng
2de7f87c74 more code 2024-02-29 17:06:53 +08:00
Hongze Cheng
b8754b4209 more code 2024-02-29 16:32:11 +08:00
Hongze Cheng
f6fd32a0c2 more 2024-02-29 16:21:56 +08:00
dmchen
4e67da7017 fix/TD-28920 2024-02-29 07:24:29 +00:00
Hongze Cheng
a6c7d5fcf4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-29 15:00:25 +08:00
dmchen
f4c4465c0e fix/TD-28490 2024-02-29 06:54:24 +00:00
Hongze Cheng
8fca8018e3
Merge pull request #24944 from taosdata/fix/TD-28910-3.0 
fix/TD-28910
 2024-02-29 14:21:28 +08:00
Haojun Liao
4fb9595744
Merge pull request #24948 from taosdata/fix/nullcheck 
fix(util): fix the new size remaining bug.
 2024-02-29 13:59:29 +08:00
dmchen
85b78b0947 fix/TD-28910 2024-02-29 02:43:15 +00:00
Benguang Zhao
d5eda8c0a9 enh: adjust an error logging msg in process sync msg 2024-02-29 10:42:27 +08:00
Hongze Cheng
a8f95f53b7 more code 2024-02-28 16:49:44 +08:00
dmchen
00d6611ba7 fix/TD-28895 2024-02-28 08:31:45 +00:00
Hongze Cheng
81d6a1479d more code 2024-02-28 14:34:37 +08:00
Hongze Cheng
8a4b9db172 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-28 13:55:53 +08:00
Hongze Cheng
09a04ed0a4
Merge pull request #24911 from taosdata/fix/TD-28877 
fix: config global debugflag
 2024-02-28 13:55:04 +08:00
Hongze Cheng
1903a7a981 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-28 13:23:02 +08:00
Hongze Cheng
d9a4e5ed0f more code 2024-02-28 10:58:42 +08:00
Hongze Cheng
7bd85aaedb
Merge pull request #24902 from taosdata/fix/TD-28860 
fix/TD-28860
 2024-02-28 09:13:32 +08:00
Hongze Cheng
31b8fd803d
Merge pull request #24901 from taosdata/FIX/TD-28853-3.0 
enh: change redo log of trans compact-db as prepare log
 2024-02-28 08:58:59 +08:00
Shungang Li
2021eda22d fix: config global debugflag 2024-02-27 19:45:39 +08:00
dmchen
34cda13494 enable switch 2024-02-27 10:57:32 +00:00
kailixu
bd77aff696 enh: cloud edition check 2024-02-27 17:45:52 +08:00
dmchen
cf753cf2e0 fix/TD-28860 2024-02-27 09:24:23 +00:00
Benguang Zhao
871c898920 enh: change redo log of trans compact-db as prepare log 2024-02-27 17:05:36 +08:00
Haojun Liao
6bc12c8728 refactor: do some internal refactor. 2024-02-27 16:27:59 +08:00
Hongze Cheng
9a2f5fa2d2
Merge pull request #24893 from taosdata/fix/TD-28776-2-3.0 
fix/TD-28776
 2024-02-27 14:59:04 +08:00
Haojun Liao
9762c53cf9
Merge pull request #24895 from taosdata/fix/nullcheck 
enh(stream):rsp the checkpoint ready msg.
 2024-02-27 14:42:00 +08:00
Haojun Liao
d05c55f3fe fix(stream): update the msg struct. 2024-02-27 12:59:08 +08:00
Haojun Liao
de1c67f773 fix(stream): rsp the checkpoint ready msg. 2024-02-27 12:57:43 +08:00
Haojun Liao
402a43bf67 fix(stream): disable halt. 2024-02-27 11:25:32 +08:00
Haojun Liao
80d027da19 fix(stream): restore from the crash. 2024-02-27 11:22:58 +08:00
Haojun Liao
aee0460daf enh(stream):rsp the checkpoint ready msg. 2024-02-27 11:15:09 +08:00
dmchen
c4f08b8275 fix/TD-28776 2024-02-27 03:05:45 +00:00
Haojun Liao
dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
Hongze Cheng
793ee02cbc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-27 09:56:25 +08:00
Hongze Cheng
2c1f978fd2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-27 09:26:37 +08:00
Haojun Liao
81a1eac87a fix(stream): add some logs. 2024-02-26 22:49:38 +08:00
Benguang Zhao
bbe6fe02d2 enh: use optimistic locking to protect snapshot reader open against vnode commit 2024-02-26 20:21:53 +08:00
Hongze Cheng
048f8ee7c5
Merge pull request #24879 from taosdata/fix/TD-28765 
fix(meta/table): remove cache table dropping
 2024-02-26 18:03:51 +08:00
Hongze Cheng
98eeef9d07 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-26 16:40:05 +08:00
Hongze Cheng
f7ec6248dc
Merge pull request #24851 from taosdata/ENH/TD-28731-3.0 
enh: adjust code format in logging msg of mndTransSync
 2024-02-26 16:20:15 +08:00
Haojun Liao
0659662223
Merge pull request #24874 from taosdata/fix/nullcheck 
fix(stream): add into buffer before start the create stream trans.
 2024-02-26 13:43:36 +08:00
Hongze Cheng
2ea5903132
Merge pull request #23373 from taosdata/feat/TD-26529-3.0 
TD-26529
 2024-02-26 13:22:56 +08:00
Hongze Cheng
200b5dc09e
Merge pull request #24862 from taosdata/fix/TD-28376-3.0a 
fix: user sysinfo
 2024-02-26 13:09:31 +08:00
Minglei Jin
323938df36 fix(meta/table): remove cache table dropping 2024-02-26 12:29:33 +08:00
Hongze Cheng
8a669d3adc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-26 10:48:14 +08:00
Haojun Liao
6e891b0145 fix(stream): add into buffer before start the create stream trans. 2024-02-26 10:22:34 +08:00
kailixu
4afd45992a fix: sysinfo of dnode variables 2024-02-26 09:30:33 +08:00
Haojun Liao
d167dcb678
Merge pull request #24861 from taosdata/fix/nullcheck 
fix(stream): fix the invalid check for subtable name.
 2024-02-25 23:34:30 +08:00
Haojun Liao
59ad27fcae other(stream): comment some logs. 2024-02-24 22:50:17 +08:00
Hongze Cheng
fdb430d2e7
Merge pull request #24859 from taosdata/fix/TD-28776-3.0 
fix/TD-28776
 2024-02-24 16:16:03 +08:00
Haojun Liao
bb31b0c121 fix(stream): add logs. 2024-02-24 02:08:49 +08:00
Haojun Liao
2800454c35 Merge branch '3.0' into fix/nullcheck 2024-02-24 01:46:15 +08:00
Haojun Liao
df2488431e fix(stream): add logs. 2024-02-24 00:40:26 +08:00
chenhaoran
ab07900895 Merge branch '3.0' into feat/TD-26529-3.0 2024-02-23 20:54:19 +08:00
dmchen
1ca24fae6e fix/TD-28776 2024-02-23 11:44:55 +00:00
Hongze Cheng
78da82784c more code 2024-02-23 17:27:03 +08:00
Hongze Cheng
0b8b64feb4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-23 15:17:39 +08:00
Hongze Cheng
c52f064670
Merge pull request #24843 from taosdata/FIX/TS-4505-3.0 
enh: ensure the redos and undos of parallle mnd trans are of the same type
 2024-02-23 14:48:27 +08:00
Hongze Cheng
a6423b7816 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-23 14:47:10 +08:00
Hongze Cheng
aaa36b580e more code 2024-02-23 14:44:46 +08:00
Benguang Zhao
e4fa687100 enh: adjust code format in logging msg of mndTransSync 2024-02-23 14:42:52 +08:00
Hongze Cheng
20cd0d08bb
Merge pull request #24842 from taosdata/fix/TD-28765 
fix(vnd/query): not release reader if not initialized
 2024-02-23 14:32:34 +08:00
Hongze Cheng
67f5684151
Merge pull request #24798 from taosdata/feat/TD-27463-3.0 
enh: get machine id and tbase58 codec
 2024-02-23 14:18:45 +08:00
Benguang Zhao
f2c1b7da05 enh: keep in redo stage on context switch for rollback trans 2024-02-23 13:18:36 +08:00
Benguang Zhao
ec093cb477 enh: ensure decoded obj cleared in new obj action validate 2024-02-23 11:25:42 +08:00
Benguang Zhao
1b2bccd1d9 enh: not use prepare log in trans create-stb anymore 2024-02-23 10:40:50 +08:00
Benguang Zhao
dfef26866a enh: decode sdb raw object in SdbValidateFp instead 2024-02-23 10:39:50 +08:00
Benguang Zhao
a371afa58e enh: change type of trans create-qnode and drop-qnode as serial 2024-02-23 10:22:59 +08:00
Benguang Zhao
fbd2a0035c enh: change type of trans create-snode and drop-snode as serial 2024-02-23 10:22:58 +08:00
Benguang Zhao
94f7e0c811 enh: change redo logs of trans create-stb-index and drop-index as prepare logs 2024-02-23 10:22:58 +08:00
Benguang Zhao
8f3b6a717d enh: change redo logs of trans alter-db and drop-db as prepare logs 2024-02-23 10:22:57 +08:00
Benguang Zhao
3a81c9777c enh: change redo logs of trans alter-stb and drop-stb as prepare logs 2024-02-23 10:22:56 +08:00
Benguang Zhao
03d68a0376 enh: change redo logs of trans create-stb as prepare logs 2024-02-23 10:22:55 +08:00
Minglei Jin
e80ac5a4a6 fix(vnd/query): not release reader if not initialized 2024-02-23 10:14:59 +08:00
dapan1121
794d4a931c
Merge pull request #24820 from taosdata/mark/3.0 
fix:add excluded msg for meta in tmq
 2024-02-23 09:41:39 +08:00
dmchen
7c9ae19989 core at show user 2024-02-22 12:31:33 +00:00
kailixu
a34402a11f Merge branch '3.0' into feat/TD-27463-3.0 2024-02-22 17:35:34 +08:00
Haojun Liao
da0265ddde fix(tsdb): set correct error code info extract method. 2024-02-22 15:52:47 +08:00
Haojun Liao
7c8eb21ee5 fix(stream): halt the correct task. 2024-02-22 15:01:04 +08:00
dmchen
607971b514 uptime unit 2024-02-22 06:54:06 +00:00
dmchen
2f6fc4a9ce grant default 2024-02-22 04:55:54 +00:00
dm chen
271e997438
Merge pull request #24823 from taosdata/3.0 
merge 3.0
 2024-02-22 12:47:42 +08:00
Haojun Liao
5de8617a32
Merge pull request #24783 from taosdata/fix/crash_stream 
test(stream): add unit test cases.
 2024-02-22 11:28:17 +08:00
wangmm0220
6e13e4aa63 fix:add excluded msg for meta in tmq 2024-02-22 10:58:32 +08:00
Hongze Cheng
665cc2c2c4 more code change 2024-02-22 10:13:35 +08:00
Haojun Liao
dbd3b4e2b9 test: remove print info. 2024-02-22 10:02:25 +08:00
dmchen
ee84e2d75e uptime unit 2024-02-22 02:00:33 +00:00
Haojun Liao
045a30035f test(stream): init lock. 2024-02-22 09:52:47 +08:00
Hongze Cheng
a9e3ca41a9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-22 09:39:48 +08:00
Haojun Liao
637e604368 test(stream): add print info. 2024-02-22 09:38:44 +08:00
Haojun Liao
5c817d101a test(stream): add print info. 2024-02-22 09:29:40 +08:00
Haojun Liao
705ae7d827 test(stream): init mnode lock. 2024-02-22 09:04:57 +08:00
dmchen
46ee4cd00f uptime 2024-02-22 00:49:51 +00:00
Haojun Liao
1cf7790b1c
Merge pull request #24816 from taosdata/fix/nullcheck 
fix(stream): send hb correctly after the leader of mnode switching in a cluster.
 2024-02-22 08:45:34 +08:00
Hongze Cheng
ccd65fd495 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 19:26:31 +08:00
Haojun Liao
bad3730387 fix(stream): set the vgId in hb rsp msg. 2024-02-21 18:25:35 +08:00
Haojun Liao
4440243b17 fix(stream): clear the handle after send msg. 2024-02-21 18:17:31 +08:00
Haojun Liao
6f8a54f27b fix(stream): free dummy rsp msg. 2024-02-21 16:27:52 +08:00
Haojun Liao
8740c3cb4a fix(stream): send hb rsp explicitly. 2024-02-21 16:17:06 +08:00
dmchen
606aa61c4f remove errors and delete 2024-02-21 08:06:45 +00:00
wangmm0220
2049fa688a fix:add log 2024-02-21 16:01:02 +08:00
Hongze Cheng
b0b71bc3c2 more code 2024-02-21 15:21:46 +08:00
Haojun Liao
b361eb4a7c fix(stream): add hb rsp handle function for vnode and snode. 2024-02-21 15:16:07 +08:00
Hongze Cheng
4b71031014 more code 2024-02-21 14:29:10 +08:00
Hongze Cheng
b7b9c02694 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 13:18:56 +08:00
slzhou
87c8f1aa82 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 13:09:36 +08:00
dmchen
c55e9b1877 insert user empty 2024-02-21 04:12:45 +00:00
Haojun Liao
d6f5ae226b refactor: do some internal refactor. 2024-02-21 09:42:23 +08:00
kailixu
c7932675ce enh: get machine id 2024-02-21 09:07:38 +08:00
Hongze Cheng
fca1c077fe
Merge pull request #24790 from taosdata/fix/TD-28329 
fix(tsdb/cache): remove unused block index cache
 2024-02-21 09:03:54 +08:00
dapan1121
97452c666c
Merge pull request #24788 from taosdata/fix/TD-28666 
fix:stream load error
 2024-02-20 17:38:15 +08:00
kailixu
b2ad162a8b enh: remove obsolete codes 2024-02-20 17:13:58 +08:00
Minglei Jin
efd2bc6bac fix(tsdb/cache): remove unused block index cache 2024-02-20 17:12:55 +08:00
Hongze Cheng
6cdef62f92
Merge pull request #24772 from taosdata/fix/TD-28539-3.0 
fix: invalid memory access during meta snapshot transfer
 2024-02-20 17:01:46 +08:00
Hongze Cheng
261d38d4a7
Merge pull request #24710 from taosdata/fix/TD-24422-2 
enh(tsdb/cache): flag empty table when creating
 2024-02-20 16:17:18 +08:00
wangmm0220
22b1db5191 fix:stream load error 2024-02-20 14:49:52 +08:00
Hongze Cheng
cb0a5b4725 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28539-3.0 2024-02-20 14:20:48 +08:00
Haojun Liao
13c3654bf5 other: merge 3.0 2024-02-20 10:51:04 +08:00
Haojun Liao
03bc2d7c6d test(stream): add unit test cases. 2024-02-20 10:27:02 +08:00
Alex Duan
2eb33b6ee6
Merge pull request #24759 from taosdata/coverage/TD-28602-3.0 
coverage: add schUtil.c and schedulerTest
 2024-02-20 09:14:03 +08:00
dapan1121
980e1b83be
Merge pull request #24775 from taosdata/opti/TS-4480 
opti:consume performance if all data is in format of "insert into using"
 2024-02-20 09:07:59 +08:00
Haojun Liao
46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023 
stream count window
 2024-02-20 08:50:25 +08:00
Haojun Liao
f95fb4f27e
Merge pull request #24763 from taosdata/fix/crash_stream 
refactor: do some internal refactor.
 2024-02-20 08:50:12 +08:00
Hongze Cheng
ffedfbaf1e
Merge pull request #24777 from taosdata/feat/TD-27463-3.0 
fix: grant check for stream/topic/subscription
 2024-02-19 19:36:22 +08:00
wangmm0220
77e2500a81 fix:conflicts from 3.0 2024-02-19 18:46:31 +08:00
54liuyao
af1893d109 merge 3.0 2024-02-19 18:30:12 +08:00
kailixu
c0cb72ca56 feat: grant check for topic/subscription 2024-02-19 18:28:50 +08:00
Haojun Liao
931b9f0b51 other: merge 3.0 2024-02-19 18:27:18 +08:00
kailixu
5b69e22e9b fix: grant check for streams 2024-02-19 16:29:40 +08:00
Alex Duan
ba306043bb Merge branch '3.0' into coverage/TD-28602-3.0 2024-02-19 16:06:57 +08:00
Haojun Liao
bf242a4f64 fix(stream): handle pause event in waiting list. 2024-02-19 15:57:21 +08:00
wangmm0220
a74f12e2e1 opti:consume performance if all data is in format of "insert into using" 2024-02-19 15:50:43 +08:00
Haojun Liao
a3b04c3c58 fix(stream): set the processVer for streamTask when initializing the task object. 2024-02-19 14:50:09 +08:00
Hongze Cheng
ad0c91e6c3 fix: invalid memory access during meta snapshot transfer 2024-02-19 14:06:45 +08:00
wangmm0220
ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao
d3e8adf2eb enh(stream): async handle pause event 2024-02-19 13:36:57 +08:00
Haojun Liao
7e866c5527 refactor: do some internal refactor. 2024-02-19 11:32:04 +08:00
54liuyao
b53dc5602e Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-02-19 10:58:20 +08:00
Haojun Liao
cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
Hongze Cheng
45684e49c7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-19 09:08:58 +08:00
54liuyao
05eaa90c11 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-19 08:59:15 +08:00
Alex Duan
6dec22c1c2 coverage: add tglobal.c 2024-02-18 20:51:49 +08:00
Alex Duan
b3a6fa9c12 coverage: add explain.c 2024-02-18 19:36:35 +08:00
wangmm0220
ee96127020 fix:conflicts from 3.0 2024-02-18 18:38:38 +08:00
wangmm0220
a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao
245f0ef806 fix(stream): fix deadlock. 2024-02-18 17:05:00 +08:00
Haojun Liao
c4f9bee629 fix(stream): add into buffer pool before start trans, to avoid false alarm on orphan task. 2024-02-18 15:46:37 +08:00
Haojun Liao
472020a2b9 enh(stream): handle event async function. 2024-02-18 14:07:15 +08:00
Hongze Cheng
8f1fa68994 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-02-18 10:53:51 +08:00
dapan1121
8f63952ad5
Merge pull request #24750 from taosdata/mark/3.0 
fix:[TD-28590]add logic for consume excluded
 2024-02-18 10:13:25 +08:00
Hongze Cheng
52ed1ec5f7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-18 09:52:53 +08:00
Hongze Cheng
461a0687ec
Merge pull request #24752 from taosdata/feat/TD-27463-3.0 
feat: support uniq grant
 2024-02-18 09:13:22 +08:00
Alex Duan
4816290a60 coverage: tsched.c mndTrans.h 2024-02-17 18:25:10 +08:00
Alex Duan
f5e0563891 coverage: tsdbCache.c 2024-02-17 12:12:37 +08:00
Alex Duan
8852beb2cc coverage: tsdbUtil.c 2024-02-16 15:17:15 +08:00
kailixu
f76a61c777 feat: support uniq grant 2024-02-13 23:17:05 +08:00
dm chen
6d2d37d964
Merge pull request #24751 from taosdata/3.0 
merge 3.0
 2024-02-06 19:16:53 +08:00
wangmm0220
478e1a67ae fix:[TD-28590]add logic for consume excluded 2024-02-06 18:14:06 +08:00
dmchen
e5dcef0794 forward client directly 2024-02-06 08:29:09 +00:00
wangmm0220
871ebfa7ba Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-06 14:02:46 +08:00
Haojun Liao
2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao
7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
wangmm0220
5796f411e4 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-05 17:08:05 +08:00
wangmm0220
a656d75ca7 opti:consume data excluded from some source 2024-02-05 17:07:50 +08:00
54liuyao
c588770699 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 15:10:34 +08:00
Haojun Liao
ecdcc6dee1
Merge pull request #24738 from taosdata/fix/3_liaohj 
test(stream): add unit test case for the mnode stream module.
 2024-02-05 13:32:46 +08:00
dmchen
5c7f839da8 remove tmp log 2024-02-05 03:28:33 +00:00
Haojun Liao
fc218a1f69 fix(test): fix syntax errors on windows. 2024-02-05 11:09:19 +08:00
wade zhang
0ebd7d2527
Merge pull request #24737 from taosdata/feat/TD-27463-3.0 
feat: support uniq grant
 2024-02-05 10:32:34 +08:00
54liuyao
b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
dmchen
16aef66260 ci case fail 2024-02-05 01:34:20 +00:00
Haojun Liao
3533f7ecea Merge branch '3.0' into fix/3_liaohj 2024-02-05 09:23:29 +08:00
kailixu
196256d9af feat: support uniq grant 2024-02-05 09:23:19 +08:00
kailixu
7e5dc8a024 feat: support uniq grant 2024-02-05 09:21:11 +08:00
Haojun Liao
3111a01a12 test: add unit test files. 2024-02-05 09:10:43 +08:00
Haojun Liao
739485a419 test(stream): add unit test case for the mnode stream module. 2024-02-05 09:10:04 +08:00
Haojun Liao
2e79c766fa
Merge pull request #24731 from taosdata/fix/3_liaohj 
fix(tsdb): check and return if the rows in stt are before the data rows in data files.
 2024-02-05 09:00:32 +08:00
dmchen
71d9065d47 tmp log 2024-02-05 00:12:35 +00:00
kailixu
6098538162 feat: support uniq grant 2024-02-04 18:00:02 +08:00
kailixu
d281bc70b0 feat: remove hb of grantInfo 2024-02-04 16:46:24 +08:00
kailixu
3ebc26e1fb feat: support uniq grant 2024-02-04 16:33:43 +08:00
54liuyao
ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao
6736fd1615 fix(tsdb): check and return if the rows in stt are before the data rows in data files. 2024-02-04 14:11:17 +08:00
kailixu
f53d0bce5d feat: support uniq grant 2024-02-04 00:24:42 +08:00
kailixu
3a08926319 feat: support uniq grant 2024-02-03 17:32:02 +08:00
kailixu
1a6b491405 Merge branch '3.0' into feat/TD-27463-3.0 2024-02-03 12:11:23 +08:00
Hongze Cheng
89f0aa4bc4 more code 2024-02-02 12:45:01 +08:00
Hongze Cheng
b79859d2a3 more code 2024-02-02 12:26:05 +08:00
slzhou
4a6317a047 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-02 11:29:04 +08:00
Haojun Liao
3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Alex Duan
035f7d096c
Merge pull request #24715 from taosdata/coverage/TD-28550-3.0 
coverage: metaIdx.c comment no use function
 2024-02-02 09:05:51 +08:00
kailixu
231cf000da Merge branch 'feat/TD-27463-3.0a' into feat/TD-27463-3.0 2024-02-02 00:07:15 +08:00
kailixu
67425fce1e feat: support uniq grant 2024-02-01 22:57:56 +08:00
Alex Duan
963bb20ce3 coverage: metaIdx.c comment no use funciton 2024-02-01 19:11:50 +08:00
kailixu
adee720128 feat: support uniq grant 2024-02-01 17:48:29 +08:00
Minglei Jin
d59b767af3 enh(tsdb/cache): flag empty table when creating 2024-02-01 17:40:32 +08:00
Haojun Liao
0fe9c05c5f
Merge pull request #24704 from taosdata/fix/3_liaohj 
fix(stream): take ver snapshot for all vgroups
 2024-02-01 17:07:36 +08:00
Haojun Liao
88f246b988 fix(stream): fix syntax error on windows, and add null ptr check for pTrans obj. 2024-02-01 15:08:06 +08:00
dmchen
907e06ad4d clusterid by taosd 2024-02-01 04:52:54 +00:00
Haojun Liao
cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220
a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
wade zhang
eeba6a24ad
Merge pull request #24686 from taosdata/feat/TD-27463-3.0 
feat: support uniq grant
 2024-02-01 09:47:14 +08:00
54liuyao
0afed5263e add mid operator retrive 2024-01-31 18:09:13 +08:00
kailixu
1e9c963e02 feat: support uniq grant 2024-01-31 17:22:57 +08:00
kailixu
9458b86b41 feat: support uniq grant 2024-01-31 16:09:06 +08:00
kailixu
a860e9039d feat: support uniq grant 2024-01-31 13:52:03 +08:00
kailixu
4ffc4017bd feat: support uniq grant 2024-01-31 13:02:17 +08:00
kailixu
ac5fa32867 feat: support uniq grant 2024-01-31 12:36:58 +08:00
dmchen
5cf8687fd7 fix/TD-28519 2024-01-31 04:23:28 +00:00
kailixu
f50867831b feat: support uniq grant 2024-01-31 10:43:31 +08:00
kailixu
18ece50f86 feat: support uniq grant 2024-01-31 10:02:44 +08:00
kailixu
41072348b9 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-31 10:02:12 +08:00
kailixu
a11410378f feat: support uniq grant 2024-01-31 09:47:10 +08:00
kailixu
93c0890f68 feat: support uniq grant 2024-01-31 09:13:10 +08:00
wade zhang
17e74e76e6
Merge pull request #24679 from taosdata/fix/TD-28503-3.0 
fix/TD-28503
 2024-01-31 09:11:36 +08:00
kailixu
2b1a0cdbfe feat: support uniq grant 2024-01-31 08:53:45 +08:00
kailixu
5fd10d4049 feat: support uniq grant 2024-01-31 00:40:47 +08:00
Haojun Liao
556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao
086943ea5c
Merge pull request #24610 from taosdata/fix/TD-28446 
fix:[TD-28446] modify trans confilct in subscribe
 2024-01-30 17:49:05 +08:00
Haojun Liao
4c22e03c1b
Merge pull request #24642 from taosdata/feat/TD-28247 
feat:[TD-28247]add grant for subscribe and stream
 2024-01-30 17:48:05 +08:00
dmchen
917a6eb5a7 fix/TD-28503 2024-01-30 09:47:20 +00:00
Haojun Liao
efbc7e1402 fix(stream): fix memory leak. 2024-01-30 15:35:01 +08:00
Haojun Liao
4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
Haojun Liao
584b7f236f
Merge pull request #24665 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-30 10:38:19 +08:00
Haojun Liao
11c9c7d936 refactor: do some internal refactor. 2024-01-30 09:17:02 +08:00
Haojun Liao
45891babd3
Merge pull request #24655 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-30 09:15:10 +08:00
dmchen
8d683983e0 interface name 2024-01-29 10:11:17 +00:00
54liuyao
d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
wangmm0220
51b7cd99d6 feat:[TD-28247]add grant for subscribe and stream 2024-01-29 14:28:48 +08:00
Haojun Liao
b714c70434 refactor: do some internal refactor. 2024-01-29 13:46:33 +08:00
Haojun Liao
f4f01e4bf4
Merge pull request #24654 from taosdata/fix/3_liaohj 
feat(stream): drop orphan tasks.
 2024-01-29 13:10:47 +08:00
Haojun Liao
9087a0d9d0 feat(stream): drop orphan tasks. 2024-01-29 11:03:50 +08:00
kailixu
80b1ad77d6 feat: support uniq grant 2024-01-28 21:24:30 +08:00
kailixu
e0d61c40f5 feat: support uniq grant 2024-01-26 19:06:56 +08:00
Haojun Liao
bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 18:08:54 +08:00
Hongze Cheng
e7177dae57 more code 2024-01-26 17:14:00 +08:00
Hongze Cheng
09a65e5992 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-01-26 16:51:47 +08:00
wangmm0220
35e2b681c7 fix:conflicts from 3.0 2024-01-26 16:32:40 +08:00
Haojun Liao
ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
Haojun Liao
50b59ad936 fix(stream): add null ptr check. 2024-01-26 16:08:01 +08:00
54liuyao
bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
wangmm0220
ce2a3e4be2 fix:test case error 2024-01-26 15:35:29 +08:00
wangmm0220
bd2bef2428 fix:add test case 2024-01-26 15:05:31 +08:00
Haojun Liao
649d26ce72 fix(stream): seek to right place to start wal read. 2024-01-26 14:14:04 +08:00
Haojun Liao
49aff4571b fix(stream): fix memory leak. 2024-01-26 11:33:07 +08:00
Haojun Liao
9b3b03caab refactor: do some internal refactor. 2024-01-26 10:22:16 +08:00
Haojun Liao
bc7fe1fe6a refactor: do some internal refactor. 2024-01-26 10:08:20 +08:00
Haojun Liao
bd1d1cddaf refactor: do some internal refactor. 2024-01-26 10:03:54 +08:00
Haojun Liao
db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 09:09:44 +08:00
wangmm0220
474514ab66 fix:test case error 2024-01-25 17:29:55 +08:00
Haojun Liao
43c035678f refactor: do some internal refactor. 2024-01-25 16:55:05 +08:00
Haojun Liao
d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao
834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj 
fix(stream): do checkpoint after fill-history task completed.
 2024-01-25 16:53:11 +08:00
wangmm0220
2798ff824c feat:[TD-28247]add grant for subscribe and stream 2024-01-25 16:07:09 +08:00
Hongze Cheng
e8a8748dc9 more fix 2024-01-25 15:48:45 +08:00
Hongze Cheng
7d27c3902a feat: avoid meta rwlock starvation 2024-01-25 15:45:09 +08:00
54liuyao
7105b0ffe3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-25 10:12:13 +08:00
Hongze Cheng
9d9306a03b
Merge pull request #24612 from taosdata/fix/TD-28437-3.0 
fix/TD-28437
 2024-01-25 10:01:29 +08:00
dmchen
f6ecd8d204 keep old protocal 2024-01-25 01:37:32 +00:00
kailixu
4d345b819a feat: support uniq grant 2024-01-24 19:08:19 +08:00
dmchen
d9af07de6f new table structure 2024-01-24 09:44:44 +00:00
Haojun Liao
dc1ea9f9a1 fix(stream): clear htask info when unregistering the task. 2024-01-24 16:23:47 +08:00
kailixu
e13e61f4d5 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-24 14:26:17 +08:00
Hongze Cheng
82f3b3a931
Merge pull request #24589 from taosdata/fix/ttlnoretry-3.0 
fix: no retry for ttl drop table
 2024-01-24 14:03:18 +08:00
Haojun Liao
8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Hongze Cheng
77e36f401f
Merge pull request #24591 from taosdata/FIX/TD-28415-3.0 
enh: trigger vnodeCommit at exit even if no data changed
 2024-01-24 11:12:45 +08:00
dmchen
262bb4cf12 fix/TD-28437 2024-01-24 02:30:03 +00:00
wade zhang
86272dee4e
Merge pull request #24542 from taosdata/fix/refactorRetry1 
refactor retry
 2024-01-24 09:57:55 +08:00
Hongze Cheng
200c57ed8e
Merge pull request #24604 from taosdata/fix/TD-28437-3.0 
fix/TD-28437
 2024-01-24 09:41:31 +08:00
wangmm0220
416c87b5b7 fix:[TD-28446] modify trans confilct in subscribe 2024-01-23 18:48:19 +08:00
Haojun Liao
0cd84aa587 fix(stream): gen checkpoint for single task. 2024-01-23 17:51:50 +08:00
dmchen
e65c80d495 fix/TD-28431 2024-01-23 09:43:23 +00:00
dmchen
f349bbd51f fix/TD-28437 2024-01-23 09:25:48 +00:00
dmchen
74fdc14ed3 fix/TD-28430 2024-01-23 08:33:12 +00:00
Yihao Deng
2479df3b1e sort epset 2024-01-23 06:42:42 +00:00
Yihao Deng
62e6b5ca31 sort epset 2024-01-23 06:23:34 +00:00
Shungang Li
5bd14b4866 enh: errcode for message has been processed in preprocess 2024-01-23 13:53:51 +08:00
Benguang Zhao
192bb179e7 enh: trigger vnodeCommit at exit even if no data changed 2024-01-23 10:15:00 +08:00
54liuyao
0975e37845 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-23 10:07:50 +08:00
Shungang Li
6c823efc60 fix: no retry for ttl drop table 2024-01-22 19:55:27 +08:00
kailixu
486e3b7479 feat: support uniq grant 2024-01-22 18:18:01 +08:00
kailixu
dbd3c53182 feat: support uniq grant 2024-01-22 13:20:15 +08:00
kailixu
5208829f23 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-22 13:20:00 +08:00
Haojun Liao
db474626e6 fix(stream): fix memory leak. 2024-01-22 11:49:16 +08:00
Haojun Liao
ecd51e366f
Merge pull request #24512 from taosdata/opti/TD-28118 
opti:[TD-28118] raw block data for tmq
 2024-01-22 11:47:13 +08:00
Haojun Liao
2cc584ff44 fix(stream): fix error in check vgId. 2024-01-22 11:05:42 +08:00
Yihao Deng
a20845ec69 refactor retry 2024-01-22 01:04:06 +00:00
Haojun Liao
4a5ab10b3d fix(stream): fix memory leak. 2024-01-19 20:28:43 +08:00
kailixu
b7ea583f3a feat: support uniq grant 2024-01-19 17:01:19 +08:00
Haojun Liao
d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
Yihao Deng
c56ddc1ba9 refactor retry 2024-01-19 07:52:32 +00:00
kailixu
5d6703c3ef feat: support uniq grant 2024-01-19 14:59:02 +08:00
Yihao Deng
6c732a14a3 refactor retry 2024-01-19 06:20:16 +00:00
54liuyao
5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
kailixu
99c493dc5c feat: support uniq grant 2024-01-18 19:40:41 +08:00
wangmm0220
7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
kailixu
1daa224651 feat: support uniq grant 2024-01-18 17:49:11 +08:00
factosea
b83bb8c150 fix: last_row error 2024-01-18 17:20:31 +08:00
Haojun Liao
996e2939a9 refactor: do some internal refactor. 2024-01-18 15:58:46 +08:00
Haojun Liao
76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
kailixu
76558da849 feat: support uniq grant 2024-01-18 15:23:38 +08:00
Haojun Liao
719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
Haojun Liao
f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
wangmm0220
d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
Haojun Liao
d1dbd03341 fix(tsdb): fix invalid set. 2024-01-17 17:29:00 +08:00
Haojun Liao
d44dc5bbb2 fix(tsdb): fix race condition. 2024-01-17 15:20:17 +08:00
Haojun Liao
56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao
1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao
fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj 
fix(stream): fix some errors and do some internal refactor.
 2024-01-17 14:25:32 +08:00
54liuyao
3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
kailixu
bf0205b54d Merge branch '3.0' into feat/TD-27463-3.0 2024-01-17 11:29:47 +08:00
kailixu
95cb004f80 feat: support uniq active code 2024-01-17 11:24:48 +08:00
dapan1121
66c9c076e8
Merge pull request #24469 from taosdata/fix/xsren/TD-28204/whereOptimizeConditional 
Fix/xsren/td 28204/where optimize conditional
 2024-01-17 10:20:51 +08:00
Haojun Liao
a56e589048
Merge pull request #24490 from taosdata/fix/TD-28338 
fix:[TD-28338]empty varchar value return NULL in tmq
 2024-01-17 10:09:40 +08:00
yihaoDeng
0d4cc6b8e2 fix:[TD-28338]empty varchar value return NULL in tmq 2024-01-16 18:46:37 +08:00
Haojun Liao
3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
Haojun Liao
0280f129bd fix(stream):add some logs. 2024-01-16 18:21:29 +08:00
Haojun Liao
882b916940 fix(stream): adjust stream trans conflict check. 2024-01-16 16:11:04 +08:00
Haojun Liao
8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
jiajingbin
d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Hongze Cheng
c40a87ab0e
Merge pull request #24319 from taosdata/ENH/TD-28135-3.0 
enh: use learner in redistribute vgroup
 2024-01-16 15:04:52 +08:00
Haojun Liao
9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Haojun Liao
80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
xinsheng Ren
ae5f540692
Merge branch '3.0' into fix/xsren/TD-28204/whereOptimizeConditional 2024-01-16 14:28:37 +08:00
Haojun Liao
d1da8ef986
Merge pull request #24477 from taosdata/fix/fixResumeBug 
fix pause/resume error
 2024-01-16 14:06:20 +08:00
Haojun Liao
dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj 
fix(stream): fix deadlock in pause.
 2024-01-16 12:58:27 +08:00
Haojun Liao
63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
dapan1121
53094f62d8
Merge pull request #24359 from taosdata/FIX/TD-27003 
Fix : use last row scan when select last_row, last
 2024-01-16 08:50:23 +08:00
Yihao Deng
7a09ba2630 fix pause/resume error 2024-01-15 11:56:38 +00:00
fullhonest
fafb5b1f03 Fix TD-28018: last row num error where partition by null column 2024-01-15 18:29:41 +08:00
Haojun Liao
1296700092
Merge pull request #24433 from taosdata/fix/TD-28188 
fix:[TD-28188]the epset of snode is error because epset is not initil…
 2024-01-15 17:05:11 +08:00
wangmm0220
2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
factosea
2c0dd3db03 fix: memory leak 2024-01-15 16:41:52 +08:00
Haojun Liao
43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
fullhonest
cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao
143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao
e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao
c710718f9e
Merge pull request #24457 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-15 10:58:45 +08:00
kailixu
414e15a810 chore: merge 3.0 2024-01-15 10:42:45 +08:00
Haojun Liao
00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
wangmm0220
00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao
59ee690301
Merge pull request #24450 from taosdata/fix/3_liaohj 
fix(stream): set error code for return.
 2024-01-12 16:04:14 +08:00
Haojun Liao
bc7434e2b5 fix(stream): set error code for return. 2024-01-12 14:49:16 +08:00
Haojun Liao
ee24bb9b03
Merge pull request #24444 from taosdata/fix/3_liaohj 
fix(stream): close the inputQ of the related stream task.
 2024-01-12 13:41:30 +08:00
Haojun Liao
cf941f7488 fix(stream): check status when resume to run. 2024-01-12 11:12:23 +08:00
Haojun Liao
b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Hongze Cheng
8399f5253f
Merge pull request #24439 from taosdata/fix/TD-28285-30 
fix(tsdb/cache): clear fs state before next open
 2024-01-12 10:38:43 +08:00
dapan1121
3b928237d7
Merge pull request #24419 from wangjiaming0909/draft/fix/TD-28182 
fix: table merge scan return disordered rows
 2024-01-12 10:16:21 +08:00
Haojun Liao
ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode 
opt msg on mnd
 2024-01-12 09:36:37 +08:00
Haojun Liao
fe839527f3
Merge pull request #24435 from taosdata/fix/TD-28202 
fix:[TD-28202]move tq timer to write thread in mnode
 2024-01-12 09:35:45 +08:00
Minglei Jin
aa410a6deb fix(tsdb/cache): clear fs state before next open 2024-01-12 09:32:40 +08:00
kailixu
ddefc5f46a chore: merge 3.0 2024-01-11 20:05:23 +08:00
wangmm0220
d3659db2ff fix:[TD-28202]move tq timer to write thread in mnode 2024-01-11 19:22:54 +08:00
wangmm0220
89ca3418af fix:[TD-28188]the epset of snode is error because epset is not initilized 2024-01-11 17:38:15 +08:00
Haojun Liao
9703018f56 fix(stream): add checkpoint status check. 2024-01-11 16:47:51 +08:00
Yihao Deng
b0f6709474 split sync/status channel 2024-01-11 07:30:39 +00:00
Yihao Deng
5a1510aa2f split sync/status channel 2024-01-11 07:30:03 +00:00
Yihao Deng
5e1a7c694b split sync/status channel 2024-01-11 07:23:46 +00:00
Yihao Deng
423fa76207 split sync/status channel 2024-01-11 06:01:06 +00:00
yihaoDeng
44146caa9a opt msg on mnd 2024-01-11 13:46:54 +08:00
Haojun Liao
5f7ce21530 refactor: do some internal refactor. 2024-01-11 11:59:29 +08:00
Haojun Liao
58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
Yihao Deng
df235b0adf split sync/status channel 2024-01-11 03:22:34 +00:00
wangjiaming0909
686108050b fix: table merge scan return disordered rows 2024-01-11 09:57:35 +08:00
Haojun Liao
f6c0649108 fix(stream): fix syntax error. 2024-01-11 09:53:19 +08:00
Haojun Liao
bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
Haojun Liao
1c562bd535 refactor: enable the restart of stream tasks. 2024-01-11 09:41:40 +08:00
wangmm0220
216830f8b4 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 20:33:13 +08:00
wangmm0220
df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Yihao Deng
b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
wangmm0220
02c7bdd4f0 fix:[TD-28032]fsdfasd 2024-01-10 14:57:16 +08:00
Yihao Deng
3f0236ec17 opt msg on mnode 2024-01-10 06:18:39 +00:00
Yihao Deng
2537adb728 opt msg on mnode 2024-01-10 06:00:44 +00:00
Haojun Liao
b0202bb853 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:44:21 +08:00
Haojun Liao
e8aea42498 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:42:36 +08:00
Haojun Liao
1b6d55616f fix(stream): fix syntax error. 2024-01-10 11:28:06 +08:00
Haojun Liao
eac0d14868 fix(stream): add check when merging rows from files and buffer. 2024-01-10 11:02:44 +08:00
yihaoDeng
9dbddeed16 opt msg on mnd 2024-01-10 10:03:38 +08:00
Haojun Liao
9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Haojun Liao
273e47a1fb
Merge pull request #24405 from taosdata/fix/optMsgOnMnd 
opt msg on mnode
 2024-01-10 09:43:48 +08:00
Haojun Liao
2b3ad002f5
Merge pull request #24401 from taosdata/fix/TD-28142-3.0 
opti:[TD-28142]memory size if block num is too large
 2024-01-10 09:40:07 +08:00
Haojun Liao
dc0c5539a0 fix(stream): remove invalid timer controllers. 2024-01-10 08:48:49 +08:00
Yihao Deng
220cef4a61 opt msg on mnode 2024-01-09 11:02:10 +00:00
Hongze Cheng
7fa06df958
Merge pull request #24395 from taosdata/fix/TD-28208 
fix(tsdb/cache): destory brin block with fs loading
 2024-01-09 16:31:41 +08:00
wangmm0220
6444af84e4 opti:[TD-28142]memory size if block num is too large 2024-01-09 16:28:58 +08:00
Minglei Jin
d93b4f88b3 fix(tsdb/cache): destory brin block with fs loading 2024-01-09 15:23:15 +08:00
Hongze Cheng
a518cba133
Merge pull request #24380 from taosdata/fix/TD-28134-3.0 
fix: possible race condition
 2024-01-09 09:47:01 +08:00
Haojun Liao
f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao
af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Hongze Cheng
5e45ecd3fd fix: possible race condition 2024-01-08 16:46:07 +08:00
Yihao Deng
1eee7b44e0 fix crash found on 3.1 2024-01-08 07:31:35 +00:00
Haojun Liao
3bcd038b7d refactor: not reload info from disk when trying to restart stream tasks. 2024-01-08 14:04:36 +08:00
Haojun Liao
f7ab55fb71
Merge pull request #24342 from taosdata/fix/TD-28155 
fix:[TD-28155] set consumer lost if all current topic is 0
 2024-01-08 11:39:16 +08:00
Haojun Liao
275e2d6f94 refactor: do some internal refactor. 2024-01-08 11:34:47 +08:00
Haojun Liao
bb9edde79e fix(stream): add some logs. 2024-01-08 11:33:54 +08:00
Haojun Liao
a024fe960c fix(stream): fix deadlock. 2024-01-07 14:53:17 +08:00
Haojun Liao
29219ba9f4 fix(stream): add task number check. 2024-01-07 01:32:50 +08:00
Haojun Liao
02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao
cfda97beef refactor: disable commit temp 2024-01-06 15:27:48 +08:00
Haojun Liao
23341e1bdf refactor: opt perf by avoid save tasks during restoring 2024-01-05 22:58:43 +08:00
Haojun Liao
445605ed22 refactor: do some internal refactor. 2024-01-05 22:35:56 +08:00
Haojun Liao
522e688387 fix(stream): check if in restart procedure in call back. 2024-01-05 22:16:58 +08:00
wangmm0220
f2a1d24ab1 fix:[TD-28155] set consumer lost if all current topic is 0 2024-01-05 19:28:40 +08:00
Haojun Liao
2386f842fb enh(stream): remove sleep to opt perf. 2024-01-05 18:46:15 +08:00
Haojun Liao
0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
dmchen
8ddff2eecb fix/TD-28073 2024-01-05 07:02:16 +00:00
Haojun Liao
1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
wade zhang
a4f68411ed
Merge pull request #24332 from taosdata/ENH/TD-25112-3.0 
enh: use learner in split vgroup
 2024-01-05 14:26:27 +08:00
wade zhang
cab9a243de
Merge pull request #24334 from taosdata/ENH/TD-26498-3.0 
enh: allow to drop an empty dnode, no matter online or not
 2024-01-05 14:16:50 +08:00
kailixu
1169fe357a feat: uniq grant 2024-01-05 00:53:38 +08:00
Haojun Liao
33f698e926 fix(stream): remove invalid assert and add check for task status before launching related fill-history task. 2024-01-04 19:09:45 +08:00
Hongze Cheng
df74b2d755
Merge pull request #24284 from taosdata/fix/TD-27988 
fix: remove useless code
 2024-01-04 19:03:45 +08:00
wangmm0220
bd64a78094 fix:[TD-28155] set consumer lost if all current topic is 0 2024-01-04 18:53:37 +08:00
Haojun Liao
6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao
c494252002 fix(stream): record the related fill-history task failure. 2024-01-04 17:44:05 +08:00
dm chen
39f2e75a9e
Merge branch '3.0' into feat/TD-26529-3.0 2024-01-04 15:46:23 +08:00
Benguang Zhao
b85f36bcea enh: allow to drop an empty dnode, no matter online or not 2024-01-04 12:00:49 +08:00
Hongze Cheng
13834802ef
Merge pull request #24269 from taosdata/FIX/TD-28101-3.0 
enh: send rsp msg on rejecting snap replication due to smaller term
 2024-01-04 10:15:09 +08:00
Benguang Zhao
f4ad4ea998 enh: use learner in split vgroup 2024-01-04 10:01:05 +08:00
wade zhang
5aae347566
Merge pull request #24330 from taosdata/fix/TS-4419 
fix: refactor logdebugs
 2024-01-04 09:58:51 +08:00
dapan1121
670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813 
enh: support group by tag/tbname to list empty groups
 2024-01-04 09:08:03 +08:00
Haojun Liao
1e3aad8883 refactor: do some internal refactor. 2024-01-03 23:57:33 +08:00
Shungang Li
de631e20a5 fix: refactor logdebugs 2024-01-03 19:57:22 +08:00
wangmm0220
b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
Haojun Liao
3fea717373 fix(stream): discard the orphan tasks. 2024-01-03 19:28:49 +08:00
Haojun Liao
b06ccc0ca7 fix(stream): cleanup the checkpoint trans & task info in execInfo 2024-01-03 19:18:06 +08:00
wangmm0220
317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
Haojun Liao
4399867e14 fix(stream): fix the not running bug. 2024-01-03 18:28:23 +08:00
Haojun Liao
4138692cea fix(stream): scan wal data files. 2024-01-03 18:16:18 +08:00
Haojun Liao
185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
dapan1121
f0fbffa772
Merge pull request #24301 from taosdata/fix/3.0/TD-28104 
fix: last table scan reported invalid param when col was dropped which
 2024-01-03 15:47:33 +08:00
Haojun Liao
284ef7d085 fix(stream): remove the related checkpoint trans when trying to drop stream. 2024-01-03 14:44:04 +08:00
Haojun Liao
a2e85c44c2
Merge pull request #24228 from taosdata/fix/3_liaohj 
refactor: remove stream-scan-history event for stream task.
 2024-01-03 14:43:20 +08:00
Benguang Zhao
de5f9b351f enh: use learner in redistribute vgroup 2024-01-03 11:49:05 +08:00
Haojun Liao
453d3e8a30 fix(stream): fix dead lock on windows. 2024-01-03 10:50:38 +08:00
wangmm0220
ab262550d1 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:37:05 +08:00
wangmm0220
9ba2f71487 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:16:43 +08:00
Haojun Liao
6c7683dba6
Merge pull request #24310 from taosdata/fix/crash_stream 
fix(tsdb): check if stt blocks are clean before building data blocks.
 2024-01-02 21:30:28 +08:00
wangmm0220
8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao
5bbf12c2c9 fix(tsdb): check if stt blocks are clean before building composed data blocks. 2024-01-02 18:35:17 +08:00
Haojun Liao
29afc2ad6a fix(stream):add jump condition for loop. 2024-01-02 15:48:08 +08:00
Haojun Liao
e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao
4368bfb20a fix(stream): fix dead lock. 2024-01-02 11:40:29 +08:00
Haojun Liao
b3d8f4e9d6 fix(stream): fix a typo. 2024-01-02 10:39:01 +08:00
Haojun Liao
59642c674d
Merge pull request #24254 from taosdata/fix/TS-3491-3.0 
fix:[TS-4391] rebalance cnt always 1 if msg lost
 2024-01-02 10:34:41 +08:00
Haojun Liao
d217412691 fix(stream): avoid race condition in starting threads. 2024-01-02 10:33:25 +08:00
wangjiaming0909
be0d35a5af fix: last table scan reported invalid param when col was dropped which 
should report invalid col
 2024-01-02 10:20:04 +08:00
Haojun Liao
83172f4580
Merge pull request #24286 from taosdata/fix/crash_stream 
fix(stream): update the stream error code.
 2023-12-29 22:39:24 +08:00
Haojun Liao
7abeb5a27a fix(stream): update the stream error code. 2023-12-29 17:44:10 +08:00
Haojun Liao
8ac02adc0b refactor: do some internal refactor. 2023-12-29 17:42:23 +08:00
wangmm0220
d158ca74d8 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 17:22:27 +08:00
Hongze Cheng
7cb12db8ce remove more useless code 2023-12-29 15:20:27 +08:00
wangmm0220
c83989754f fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 14:09:49 +08:00
wangmm0220
b58a23df49 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 13:57:13 +08:00
Benguang Zhao
68cb86602e fix: reuse cid with fs eid updated in tsdbFSetRAWWriteFileDataBegin 2023-12-29 11:49:57 +08:00
Benguang Zhao
baa7f9c895 enh: adjust error msg as warn for not ready to propose etc 2023-12-28 17:29:49 +08:00
Haojun Liao
1659164926 fix(stream): remove invalid checkpoint id check. 2023-12-27 23:00:18 +08:00
Haojun Liao
7eb0e42bb9 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-27 22:57:58 +08:00
Hongze Cheng
90645cbc77
Merge pull request #24220 from taosdata/fix/TD-27988 
fix: remove useless code
 2023-12-27 21:23:26 +08:00
wangmm0220
10e86fc733 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-27 19:25:08 +08:00
Hongze Cheng
2ada7d455e
Merge pull request #24236 from taosdata/fix/TD-28061 
fix(tsdb/cache): erase entry from lru if deleted
 2023-12-27 18:13:16 +08:00
Haojun Liao
5592e11235 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-26 19:02:52 +08:00
54liuyao
ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
Haojun Liao
130f57859f
Merge pull request #24234 from taosdata/fix/TS-4403_30 
fix tag index double free
 2023-12-26 18:01:01 +08:00
wade zhang
1a215daefa
Merge pull request #24176 from taosdata/FIX/TD-27916-3.0 
enh: demarcate top and bottom halves of task trans execution
 2023-12-26 18:00:41 +08:00
Minglei Jin
2ba586513f fix(tsdb/cache): erase entry from lru if deleted 2023-12-26 16:41:33 +08:00
Yihao Deng
40aa5f697f fix tag index double free 2023-12-26 07:21:02 +00:00
Yihao Deng
dc01625ea1 fix tag index double free 2023-12-26 06:52:33 +00:00
Haojun Liao
b74e98b25c fix(stream): set the correct split timestamp for session/state window. 2023-12-26 14:17:46 +08:00
Haojun Liao
62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Hongze Cheng
a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
Haojun Liao
e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
Haojun Liao
00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Benguang Zhao
7edfbf8023 fix: set commit log for mndAddCompactDetailToTran 2023-12-25 09:47:17 +08:00
Benguang Zhao
4f29500f74 fix: set commit log for mndDropSubByTopic 2023-12-25 09:46:55 +08:00
Haojun Liao
0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao
30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Haojun Liao
25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Bob Liu
e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao
b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao
7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Benguang Zhao
2de6d6c81d enh: add TSDB_CODE_MND_TRANS_CTX_SWITCH 2023-12-22 16:06:59 +08:00
wangmm0220
902504b39b fix:partical func parameters for middle interval[checkStreamSTable1.sim] 2023-12-22 15:28:02 +08:00
Haojun Liao
e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao
67edc29a65
Merge pull request #24179 from taosdata/fix/TD-27957-30 
fix snode crash
 2023-12-22 14:41:41 +08:00
Haojun Liao
90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Hongze Cheng
02bb9e90d2
Merge pull request #24189 from taosdata/fix/TD-27974 
fix(tsdb/cache): prepend ts col to load stt
 2023-12-22 13:53:15 +08:00
Minglei Jin
16ad59fb18 fix(tsdb/cache): prepend ts col to load stt 2023-12-22 12:14:27 +08:00
Hongze Cheng
46211258b3
Merge pull request #24173 from taosdata/fix/TD-27974 
fix(tsdb/cache): plus 1 to nCols to load stt data
 2023-12-22 09:43:20 +08:00
Haojun Liao
c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Haojun Liao
0fab9a1827 other: fix syntax error. 2023-12-22 00:29:49 +08:00
kailixu
3005ab1953 chore: more code 2023-12-21 19:45:09 +08:00
Haojun Liao
84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
yihaoDeng
913fda4a36 fix snode crash 2023-12-21 18:52:25 +08:00
Minglei Jin
9d3eb02f3c fix(tsdb/cache): plus 1 to nCols to load stt data 2023-12-21 17:53:44 +08:00
Haojun Liao
2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Alex Duan
9d4a75b0be coverage: vnodeSrv.c tmsg.c trow.c 2023-12-21 14:22:22 +08:00
kailixu
47fedce263 chore: more code 2023-12-21 12:11:00 +08:00
Haojun Liao
71f6d9f06f fix(stream): handle the case that recvs drop msg twice. 2023-12-21 11:52:45 +08:00
Benguang Zhao
572368703d enh: ensure mndTransProcessRsp invoked in mnode-write thread 2023-12-21 09:33:56 +08:00
Haojun Liao
ad5d78a6ca fix(stream): fix deadlock. 2023-12-20 19:12:47 +08:00
Haojun Liao
64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
wangmm0220
de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao
1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao
a0d1933134
Merge pull request #24113 from taosdata/mark/3.0 
opti:logic in parse raw line & make log more specific
 2023-12-20 15:25:26 +08:00
Haojun Liao
d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
wangmm0220
1f70f51ac8 fix:sdb maxId should use int64* instead of int32* 2023-12-20 11:20:41 +08:00
wangmm0220
dd0afef6f2 fix:set triggerParams=0 in mid interval 2023-12-20 11:00:25 +08:00
Haojun Liao
81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao
541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Benguang Zhao
e06f355143 enh: improve logging msg of mndPostMgmtCode 2023-12-19 20:16:33 +08:00
Benguang Zhao
f7ab8e99b5 enh: demarcate top and bottom halves of task trans execution to ensure a consistent order 2023-12-19 19:52:11 +08:00
Haojun Liao
2de0f6e971 test(stream): lock the update procedure. 2023-12-19 18:56:15 +08:00
Haojun Liao
92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
wade zhang
8bbf03a695
Merge pull request #24116 from taosdata/fix/release-mem-check-3.0 
release mem check
 2023-12-19 18:13:53 +08:00
kailixu
1f5384ad40 feat: support uniq active code 2023-12-19 18:02:53 +08:00
Haojun Liao
17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
wangmm0220
78c8ebae7f fix:remove useless code in split logic plan & random choose vnode in stream task & add test case 2023-12-19 16:35:04 +08:00
Haojun Liao
fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
wangmm0220
81b5f59fa5 Merge branch 'feat/ly_multi_marks' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2023-12-19 10:54:12 +08:00
wangmm0220
3a0af1ea49 fix:aggCnt must bigger than 1 & move msg code to the end to be compatible with old version 2023-12-19 10:53:46 +08:00
Haojun Liao
ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao
579366ec00
Merge pull request #24121 from taosdata/fix/liaohj 
other: merge main into 3.0
 2023-12-18 23:11:36 +08:00
Haojun Liao
e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao
bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Minglei Jin
64378be7f4 fix(tsdb/cache): fix buffer-overflow with column adding 2023-12-18 18:06:40 +08:00
dmchen
19637fd148 release mem check 2023-12-18 09:32:31 +00:00
kailixu
70006bb711 feat: support alter cluster 2023-12-18 16:34:31 +08:00
Haojun Liao
ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
wade zhang
4cac96d2df
Merge pull request #24111 from taosdata/fix/TD-27845 
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
 2023-12-18 16:27:18 +08:00
Haojun Liao
79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj 
fix(stream): add check for null ptr and leader .
 2023-12-18 16:24:07 +08:00
WANG MINGMING
6f23b63d9e
Merge branch '3.0' into feat/ly_multi_marks 2023-12-18 16:22:56 +08:00
Minglei Jin
5dd9ce8ceb fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange 2023-12-18 15:02:34 +08:00
kailixu
9fa90fc953 Merge branch '3.0' into feat/TD-27463-3.0 2023-12-18 14:20:10 +08:00
Benguang Zhao
25ab03e5d3 refact: improve info logging msg in mmProcessWriteMsg 2023-12-18 13:35:21 +08:00
Haojun Liao
b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
Haojun Liao
93f3a3135f
Merge pull request #24104 from taosdata/fix/3_liaohj 
fix(stream): avoid invalid read.
 2023-12-18 11:03:37 +08:00
wangmm0220
64f98744e2 fix:set trigger parms = 0 in source task if levelPlan != 1 2023-12-18 10:57:36 +08:00
Haojun Liao
edc3841a2c fix(stream): avoid invalid read. 2023-12-18 09:26:56 +08:00
dmchen
dd317d6738 add more log 2023-12-17 11:03:25 +00:00
dmchen
6347792a93 TD-27906 2023-12-17 08:47:51 +00:00
wade zhang
967a259219
Merge pull request #24092 from taosdata/fix/TD-27902 
fix/TD-27902
 2023-12-17 12:31:15 +08:00
Haojun Liao
ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj 
fix(stream): send checkpoint complete msg to mnode when dropping it.
 2023-12-17 11:03:04 +08:00
Haojun Liao
4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao
0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj 
fix(tsdb): add desc check for clean file block.
 2023-12-16 18:10:15 +08:00
Haojun Liao
4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
Haojun Liao
1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash 
Fix/snode backend crash
 2023-12-16 13:13:28 +08:00
Haojun Liao
f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
slzhou
8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
dmchen
62672b84a2 fix/TD-27902 2023-12-15 11:39:45 +00:00
Haojun Liao
a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj 
fix(query): add rows info if blocks exist.
 2023-12-15 18:24:45 +08:00
yihaoDeng
bb5f0d9112 Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash 2023-12-15 18:16:38 +08:00
yihaoDeng
7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
dapan1121
50d6f0ed41
Merge pull request #24067 from taosdata/fix/TD-27839-3.0 
fix: update dmodule lib
 2023-12-15 17:44:31 +08:00
Haojun Liao
aedc5e6b05 fix(stream): set the correct dst stable name. 2023-12-15 17:16:25 +08:00
Hongze Cheng
4ae13f411e
Merge pull request #24010 from taosdata/feat/TS-4229 
feat: compact monitor and kill
 2023-12-15 16:20:13 +08:00
Haojun Liao
e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
shenglian zhou
cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao
556eaa22ac
Merge pull request #24074 from taosdata/mark/3.0 
fix:core dump if tqOpen error in vnodeOpen
 2023-12-15 13:55:10 +08:00
wangmm0220
812f0f97a7 fix:rollback size to old logic 2023-12-15 10:09:18 +08:00
kailixu
6f3b578df7 Merge branch '3.0' into feat/TD-27463-3.0 2023-12-15 10:06:44 +08:00
slzhou
d3146a5bec fix: when no file block, no proc mem before fileset 2023-12-15 09:51:06 +08:00
dmchen
5e7aead4d8 keep killed compact 2023-12-15 01:43:24 +00:00
Yihao Deng
5f2d93d62c
Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 09:22:33 +08:00
wangmm0220
740228a653 fix:core dump if tqOpen error in vnodeOpen 2023-12-15 09:07:35 +08:00
dmchen
7183fd66a1 keep killed compact 2023-12-15 00:59:56 +00:00
slzhou
5bf364cc0a enhance: refactor code 2023-12-15 08:23:25 +08:00
kailixu
b7bfbdd2b3 Merge branch '3.0' into fix/TD-27839-3.0 2023-12-14 19:48:13 +08:00
dmchen
7bb3d43f4e kill compact 2023-12-14 11:22:07 +00:00
dmchen
d7ac3558f8 fix wrong merge 2023-12-14 11:21:41 +00:00
kailixu
7d18bd9811 chore: reduce the dependencies 2023-12-14 18:49:32 +08:00
dm chen
81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
slzhou
4dc39e74c5 fix: the block return from buildBlockFromFiles should be of new fileset 2023-12-14 16:57:04 +08:00
Haojun Liao
0449b5f1bd other: add some logs. 2023-12-14 15:43:59 +08:00
dmchen
1ca0858a97 compact detail log 2023-12-14 07:11:00 +00:00
wade zhang
c95c567376
Merge pull request #24046 from taosdata/fix/TS-4251-3.0 
revert dependency
 2023-12-14 14:03:04 +08:00
Haojun Liao
05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-14 13:52:04 +08:00
Haojun Liao
7cf0add513 fix(stream): fix error caused by refactor. 2023-12-14 11:28:03 +08:00
dmchen
606a6fe891 field encode 2023-12-14 03:24:53 +00:00
kailixu
e2fcf79089 chore: remove obsolote code 2023-12-14 10:28:56 +08:00
kailixu
fa7a09589e Merge branch '3.0' into feat/TD-27463-3.0 2023-12-14 10:27:48 +08:00
dapan1121
7803a717c2
Merge pull request #24051 from taosdata/fix/TD-27839-3.0 
enh: add check and reduce offset dependencies in lib
 2023-12-14 10:19:02 +08:00
kailixu
d7e16bb91d chore: merge 3.0 2023-12-14 10:09:32 +08:00
Haojun Liao
f0d63a977a refactor: do some internal refactor. 2023-12-14 10:01:57 +08:00
Haojun Liao
8e042e34cb refactor: do some internal refactor. 2023-12-14 09:48:14 +08:00
Haojun Liao
81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
Cary Xu
46f27a77f1
Update dmMgmt.h 2023-12-13 23:05:46 +08:00
Haojun Liao
26af397431
Merge pull request #24052 from taosdata/fix/3_liaohj 
fix(tsdb): fix error in tsdb read.
 2023-12-13 22:35:08 +08:00
Haojun Liao
105542bb21 fix(stream):handle the case of delete orphaned tasks. 2023-12-13 17:44:00 +08:00
Haojun Liao
88a8e4e9f0 fix(tsdb): fix syntax error. 2023-12-13 17:01:55 +08:00
Haojun Liao
840b457308 fix(tsdb): fix error in tsdb read. 2023-12-13 17:00:39 +08:00
kailixu
f685b6c34a enh: reduce offset dependencies in lib 2023-12-13 16:56:45 +08:00
dmchen
04366f2e68 revert dependency 2023-12-13 15:29:32 +08:00
wade zhang
fe0248afbc
Merge pull request #24029 from taosdata/fix/TS-4251-3.0 
Fix/ts 4251 3.0
 2023-12-13 11:05:51 +08:00
wade zhang
3be9af9765
Merge pull request #24039 from taosdata/FIX/TD-27843-3.0 
enh: resend new snap replication msg on all acked if not finished yet
 2023-12-13 09:51:31 +08:00
dmchen
e9cf639adb db is null 2023-12-13 01:04:34 +00:00
dmchen
71020e4812 show command db field is null 2023-12-13 00:53:33 +00:00
dapan1121
8528fb7a15
Merge pull request #23963 from taosdata/enh/xsren/TD-22212/taosQueryParam3.0 
enh: td-22212 taos query param3.0
 2023-12-13 08:24:39 +08:00
dmchen
4c9763d2c1 mem leak 2023-12-12 13:12:04 +00:00
Benguang Zhao
b1dd76b924 fix: assert on offset leq file.size in tsdbDataFileRAWWriterCloseCommit 2023-12-12 18:33:42 +08:00
wangmm0220
7ba6135f2c fix:error in split plan 2023-12-12 16:37:22 +08:00
dmchen
7e2ce6381f ci case 2023-12-12 07:24:13 +00:00
Hongze Cheng
613ca2c370
Merge pull request #23982 from taosdata/fix/PI-30-3.0 
fix(tsdb/cache): remove malloc zero bytes
 2023-12-12 15:22:38 +08:00
factosea
d25275713e ctest 2023-12-12 13:59:56 +08:00
dmchen
ea9eba5621 fix ci case 2023-12-12 05:34:41 +00:00
dmchen
dad76804e8 mem leak 2023-12-12 12:19:43 +08:00
dmchen
1547d95742 break dependency 2023-12-12 12:19:12 +08:00
dmchen
67e9f695c9 debug info and default setting 2023-12-12 12:18:35 +08:00
dmchen
daa2c2238a fix/TS-4251 2023-12-12 12:17:49 +08:00
facetosea
33897447cb ctest on linux exclude 2023-12-12 10:37:39 +08:00
Minglei Jin
c4bf9a92bc Merge branch '3.0' into enh/TD-27119 2023-12-11 19:38:04 +08:00
Minglei Jin
fe824c51e2 tsdb/cos: not remove cp files 2023-12-11 19:36:06 +08:00
dmchen
a861e55764 revert dependency 2023-12-11 11:24:31 +00:00
wangmm0220
2e596c1376 opti:build task logic 2023-12-11 14:19:55 +08:00
slzhou
2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
Haojun Liao
39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj 
fix(tsdb): opt read stt file
 2023-12-09 21:28:52 +08:00
Haojun Liao
9acd4af1f9 fix(tsdb):fix capacity rows value. 2023-12-09 01:49:55 +08:00
Haojun Liao
5528c2bf67 fix(tsdb): do some internal refactor. 2023-12-08 23:47:49 +08:00
Haojun Liao
f2592f7399 fix(tsdb): prepare the memory buffer. 2023-12-08 23:44:05 +08:00
wangmm0220
d6114f90de feat:add configure for agg cnt 2023-12-08 19:00:10 +08:00
Haojun Liao
da636ab527 fix(tsdb): add null check. 2023-12-08 18:55:20 +08:00
wangmm0220
2a506b3e5e feat:add multi level agg operator for stream task 2023-12-08 18:48:34 +08:00
Haojun Liao
67d967e22f fix(tsdb): check the overlap between stt blocks and data file blocks. 2023-12-08 18:48:00 +08:00
dmchen
e8617812ae update progress rsp 2023-12-08 10:17:04 +00:00
kailixu
fe01fb635d feat: support uniq grant 2023-12-08 18:07:17 +08:00
Hongze Cheng
853fb6f119
Merge pull request #23987 from taosdata/fix/little_fix_3.0 
fix: little fix
 2023-12-08 17:29:24 +08:00
Hongze Cheng
f830fc2f4c more dev 2023-12-08 17:26:44 +08:00
wangmm0220
c3cbc1fbce fix:compile error 2023-12-08 16:52:13 +08:00
Haojun Liao
63b34c7acf fix(tsdb): add check for not load stt file blocks. 2023-12-08 16:09:58 +08:00
wangmm0220
d1c2a03dc7 fix:conflicts from 3.0 2023-12-08 15:58:52 +08:00
wangmm0220
acfcfdc8b6 opti:build task logic in stream 2023-12-08 15:51:01 +08:00
wangmm0220
b36665c9d6 opti:build task logic in stream 2023-12-08 15:48:44 +08:00
dmchen
0be39ebe77 mem leak 2023-12-08 07:26:20 +00:00
Minglei Jin
2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
Hongze Cheng
a0487529d0 more fix 2023-12-08 14:37:21 +08:00
wade zhang
638e4c1f00
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0 
feat: support tsdb snap replication of raw data mode
 2023-12-08 14:36:16 +08:00
Haojun Liao
9c72ce846e fix(tsdb): add more condition for not load data. 2023-12-08 14:23:37 +08:00
Hongze Cheng
16068bab41
Merge pull request #23964 from taosdata/fix/TD-27707 
fix(tsdb/cache): del from mem with time range
 2023-12-08 14:22:08 +08:00
Hongze Cheng
b9d056c6a8 fix: little fix 2023-12-08 14:11:36 +08:00
dmchen
18dbc47949 break dependency 2023-12-08 04:24:33 +00:00
Haojun Liao
da1207ef74 fix(tsdb): add return flag for stt files. 2023-12-08 11:07:45 +08:00
Minglei Jin
d4dbb55669 fix(tsdb/cache): remove malloc zero bytes 2023-12-08 11:04:04 +08:00
Haojun Liao
2e13b0b97d refactor: do some internal refactor. 2023-12-08 10:43:17 +08:00
Haojun Liao
9477146b30 fix(tsdb): fix syntax error. 2023-12-08 10:29:38 +08:00
Haojun Liao
4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao
446c14da72 fix(tsdb): opt read stt file 2023-12-08 10:03:36 +08:00
dapan1121
a2ee41233e
Merge pull request #23835 from taosdata/szhou/tms-duration 
feat: tsdb output in duration order
 2023-12-08 09:07:41 +08:00
Haojun Liao
7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
kailixu
2309e577c6 feat: support uniq grant 2023-12-07 19:50:16 +08:00
dmchen
348bef49ec message handle 2023-12-07 11:42:32 +00:00
Hongze Cheng
aee070918b more dev 2023-12-07 17:37:47 +08:00
kailixu
f850ccbfd4 feat: support uniq grant 2023-12-07 16:00:13 +08:00
Benguang Zhao
1255b46469 fix: destroy dataReaderArr properly in tsdbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao
ebd3b69745 enh: control playload size of tsdb snap replication with TSDB_SNAP_DATA_PAYLOAD_SIZE 2023-12-07 15:29:42 +08:00
Benguang Zhao
5cdf2b0b04 fixup: remove call to obsolete funcs of BgTask in tsdbSnapRAWWriter open and close 2023-12-07 15:29:42 +08:00
Benguang Zhao
28e1d83662 fix: adjust tsdbReadFile call in tsdbDataFileRAWReadBlockData 2023-12-07 15:29:42 +08:00
Benguang Zhao
52672657c1 feat: toggle tsdb snap replication mode by snap info handshake ahead of time 2023-12-07 15:29:42 +08:00
Benguang Zhao
ef34176e37 fix: close data file readers in tsbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao
6c4c0242fd refact: adjust logging format in tsdbSnapRAWReaderOpen 2023-12-07 15:29:42 +08:00
Benguang Zhao
f136266972 feat: support snap replication by file blocks 2023-12-07 15:29:42 +08:00
Benguang Zhao
1dc9019baa feat: add tsdbSnapRAWRead into vnodeSnapRead 2023-12-07 15:29:42 +08:00
Benguang Zhao
ae60e1f810 refact: add tsdbSnapRAWReaderIterNext 2023-12-07 15:29:42 +08:00
Benguang Zhao
a504007ade refact: alloc just enough memory for snap data in tsdbSnapRAWReadData 2023-12-07 15:29:42 +08:00
Benguang Zhao
6c419423de feat: impl tsdb snapshot reader and writer for raw files 2023-12-07 15:29:42 +08:00
Benguang Zhao
a4c504169d feat: add file tsdbFSetRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao
da646b5a5b feat: add file tsdbDataFileRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao
e05914119e feat: add file tsdbSnapshotRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao
fe258e226d feat: add data type of SNAP_DATA_RAW for snap replication 2023-12-07 15:29:42 +08:00
Benguang Zhao
de9c9d4f20 refact: improve code of tsdbPartitionInfoSerialize 2023-12-07 15:28:14 +08:00
Benguang Zhao
1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
Benguang Zhao
f68804322c refact: improve code of tsdbSnapGetDetails as tsdbSnapPrepDescription 2023-12-07 15:28:14 +08:00
Benguang Zhao
ed39c9a572 refact: rename snap range to fset range in tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao
3550347f0c refact: use tsdbFSDestroyCopyRangedSnapshot and tsdbFSDestroyRefRangedSnapshot 2023-12-07 15:28:14 +08:00
Benguang Zhao
962febef02 refact: rename tsdb snap range to tsdb fset range 2023-12-07 15:28:14 +08:00
Benguang Zhao
ed916b1a80 refact: rename tsdb snap partition to fset partition 2023-12-07 15:28:14 +08:00
Benguang Zhao
20b5cf8d49 refact: remove redundent includes from tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao
4487eeacb5 refact: improve funcs dealing with SnapInfo for vnode snap reader and writer 2023-12-07 15:28:14 +08:00
Benguang Zhao
b8b53a4b0e refact: put source code of snap info into tsdbSnapInfo.c 2023-12-07 15:28:06 +08:00
Benguang Zhao
3ad68bdfea enh: add tsdbSnapInfo.c 2023-12-07 15:20:55 +08:00
Benguang Zhao
ddcabcfa4a refact: remove unused fn tSerializeSnapRangeArray 2023-12-07 15:20:55 +08:00
Benguang Zhao
e429526789 refact: rename STSnapRange to STFileSetRange 2023-12-07 15:20:55 +08:00
kailixu
4adce7ed52 feat: support uniq grant 2023-12-07 14:11:41 +08:00
dmchen
27a86a6faa debug info and default setting 2023-12-07 03:13:23 +00:00
kailixu
780f3d9cad Merge branch '3.0' into feat/TD-27463-3.0 2023-12-06 19:14:24 +08:00
kailixu
b015077120 feat: support uniq grant 2023-12-06 19:13:54 +08:00
dapan1121
30eb035447
Merge pull request #23940 from taosdata/fix/TS-4327 
fix: last/last_row crash with dropped column
 2023-12-06 17:57:24 +08:00
Minglei Jin
a9309cb295 fix(tsdb/cache): del from mem with time range 2023-12-06 17:52:15 +08:00
factosea
f01241f720 Merge branch 'fix/xsren/TD-22212/taosQueryParam3.0' into enh/xsren/TD-22212/taosQueryParam3.0 2023-12-06 17:39:25 +08:00
Hongze Cheng
04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
dmchen
dc9408ed5f fix/TS-4251 2023-12-06 07:48:40 +00:00
kailixu
67fd9993b0 feat: support uniq grant 2023-12-06 15:30:26 +08:00
shenglian zhou
a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
Haojun Liao
85c7dc76e9
Merge pull request #23948 from taosdata/mark/3.0 
fix:offset out of range if poll offset is read from offsetRestored wh…
 2023-12-06 09:12:38 +08:00
wangmm0220
fc9dfc77d0 fix:add plan for multi agg operator in stream 2023-12-05 20:07:20 +08:00
wangmm0220
cc51fd47d0 fix:offset out of range if poll offset is read from offsetRestored while wal is deleted 2023-12-05 19:09:29 +08:00
yihaoDeng
87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
Minglei Jin
e9cc54d87b cos_cp/load: load checkpoint from json 2023-12-05 16:37:28 +08:00
wangjiaming0909
a6c876bbc1 fix: last/last_row crash with dropped column 2023-12-05 14:16:01 +08:00
Minglei Jin
e0a14bd359 fix(tsdb/cache): remove debug log 2023-12-05 14:05:16 +08:00
Haojun Liao
9d451ab56e
Merge pull request #23934 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-05 12:58:18 +08:00
wangmm0220
79c8a1494d fix:disable snode unit test temporary 2023-12-05 11:26:12 +08:00
Haojun Liao
cb8dfae0cc refactor: do some internal refactor. 2023-12-05 10:47:19 +08:00
slzhou
e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
Haojun Liao
cc5890d56a
Merge pull request #23924 from taosdata/fix/3_liaohj 
enh(tsdb): extract rows for the given tables in all stt files.
 2023-12-04 19:21:19 +08:00
Hongze Cheng
26774f87c9
Merge pull request #23920 from taosdata/fix/TD-27619 
fix: bg task memory waste
 2023-12-04 18:10:30 +08:00
Haojun Liao
7145a7b8a1 fix(tsdb): calculate the rows in next fileset. 2023-12-04 18:03:32 +08:00
Haojun Liao
6d82900a32 fix(tsdb): fix error in block dist. 2023-12-04 18:00:41 +08:00
Hongze Cheng
ac2d9ebc27 fix: memory leak 2023-12-04 16:48:43 +08:00
slzhou
8c290587b7 fix: typo error 2023-12-04 16:19:07 +08:00
Haojun Liao
24d9337632 enh(tsdb): extract rows for the given tables in all stt files. 2023-12-04 15:38:24 +08:00
slzhou
a517271f39 Merge branch 'szhou/tms-duration-2' into szhou/tms-duration 2023-12-04 14:56:19 +08:00
slzhou
07e43fe56b fix: two intervals are intesected or not 2023-12-04 14:54:15 +08:00
Hongze Cheng
cea4be6f3c fix: bg task memory waste 2023-12-04 13:40:28 +08:00
kailixu
e623c9c3c8 feat: support machine id 2023-12-04 11:44:02 +08:00
54liuyao
38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao
48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455 
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
 2023-12-04 09:10:00 +08:00
Haojun Liao
5467bba86b fix(tsdb): do some internal refactor. 2023-12-04 09:03:40 +08:00
Haojun Liao
7b0cf47fd6 fix(tsdb): do some internal refactor. 2023-12-04 08:58:10 +08:00
Haojun Liao
29a1c6d518 fix(tsdb): do some internal refactor. 2023-12-04 08:55:53 +08:00
kailixu
042291c35b feat: support machine id 2023-12-01 18:15:47 +08:00
wangmm0220
f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
Haojun Liao
3194ff41aa
Merge pull request #23900 from taosdata/fix/3_liaohj 
fix(stream): merge fix from main to 3.0
 2023-12-01 16:39:38 +08:00
shenglian zhou
bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
Haojun Liao
4d9211dcf1
Merge pull request #23899 from taosdata/fix/liaohj 
other: merge the patch of stream from 3.0 branch.
 2023-12-01 15:49:54 +08:00
slzhou
82629c2658 fix: notify when there are no memory pre fileset 2023-12-01 15:11:43 +08:00
Haojun Liao
d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
Haojun Liao
7e63943c4e
Merge pull request #23860 from taosdata/fix/TD-27455 
fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode
 2023-12-01 14:18:58 +08:00
wade zhang
041add545c
Merge pull request #23844 from taosdata/FIX/TS-4306-3.0 
enh: limit size of snap replication msg by data length
 2023-12-01 14:06:36 +08:00
Haojun Liao
33ad05e2c8 fix(stream): fix syntax error. 2023-12-01 13:08:25 +08:00
slzhou
4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
Haojun Liao
12f32f0ae7 fix(stream): fix syntax error. 2023-12-01 11:57:16 +08:00
Haojun Liao
dba58f5e38 fix(stream): fix syntax error. 2023-12-01 11:54:13 +08:00
Haojun Liao
eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao
18273b8d1b fix(stream): ignore the in_progress code. 2023-12-01 10:20:45 +08:00
Haojun Liao
2972f5f420 fix(stream):return the error code if create stream failed. 2023-12-01 10:20:45 +08:00
Haojun Liao
e008d0f440 fix(tsdb): fix invalid read. 2023-12-01 10:20:45 +08:00
Haojun Liao
fbb604d1f5 fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-12-01 10:20:44 +08:00
Haojun Liao
1c9ff8030b fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-12-01 10:20:39 +08:00
Haojun Liao
86618ffd97 refactor: do some internal refactor. 2023-12-01 10:20:38 +08:00
Haojun Liao
31ae46925d fix(stream): fix invalid free. 2023-12-01 10:20:32 +08:00
Haojun Liao
17d4a22e47 fix(stream): add logs. 2023-12-01 10:19:54 +08:00
Haojun Liao
b9c727575d fix(stream): reset the scheduler status. 2023-12-01 10:19:54 +08:00
Haojun Liao
c937f42d88 fix(stream): fix deadlock. 2023-12-01 10:19:54 +08:00
Haojun Liao
8515a2f9b6 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-12-01 10:19:18 +08:00
Haojun Liao
9d735e7f8b fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-12-01 10:18:25 +08:00
Haojun Liao
523573844a fix(stream): fix syntax error. 2023-12-01 10:18:24 +08:00
Haojun Liao
eb2f5ad074 fix(stream): fix error. 2023-12-01 10:18:22 +08:00
Haojun Liao
2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao
60fa7cccbf fix(stream): fix memory leak. 2023-12-01 10:17:14 +08:00
dapan1121
32030ca130
Merge pull request #23886 from taosdata/revert-23730-enh/TD-26976-3.0 
Revert "enh:  grant and active codes"
 2023-11-30 19:04:50 +08:00
Minglei Jin
49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
wangmm0220
4fc19a6343 fix:snode can only be created 1 2023-11-30 15:49:31 +08:00
Haojun Liao
999afd97e5 other: merge 3.0 2023-11-30 14:36:18 +08:00
54liuyao
271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
Haojun Liao
de82aba2e5 fix(stream): ignore the in_progress code. 2023-11-30 14:32:14 +08:00
Haojun Liao
71860bfb46 fix(stream):return the error code if create stream failed. 2023-11-30 13:57:00 +08:00
Hongze Cheng
0bfa86f188
Merge pull request #23864 from taosdata/feat/TD-27461-3.0 
feat: backgroud task priority
 2023-11-30 13:51:57 +08:00
Haojun Liao
e9ead3bd28
Merge pull request #23341 from taosdata/enh/refactorBackend 
Enh/refactor backend
 2023-11-30 13:48:18 +08:00
Hongze Cheng
8ee4e2c1fe
Merge pull request #23862 from taosdata/fix/TD-27571 
fix(tsdb/cache): flush dirty lru entries before del
 2023-11-30 13:46:50 +08:00
Cary Xu
f96044e09f
Revert "enh: grant and active codes" 2023-11-30 13:39:54 +08:00
slzhou
80ee5bfb3e fix: the initial value of first fileset start / end key 2023-11-30 11:08:18 +08:00
yihaoDeng
5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
WANG MINGMING
9b72d890c8
Merge branch '3.0' into fix/TD-27455 2023-11-30 09:37:23 +08:00
Hongze Cheng
547e673955 fix: coredump caused by typo 2023-11-30 09:20:18 +08:00
Haojun Liao
130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj 
enh(stream/tsdb): do multiple optimization and fix some bugs.
 2023-11-30 09:20:15 +08:00
Minglei Jin
ab2c7abca1 tsdb/cache-del: commit before get from rocks 2023-11-30 09:15:58 +08:00
Haojun Liao
28e17a61b9 fix(tsdb): fix invalid read. 2023-11-29 19:28:53 +08:00
Haojun Liao
66f25712fd fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-11-29 18:07:15 +08:00
Hongze Cheng
65ccc4aa48 feat: backgroud task priority 2023-11-29 18:01:31 +08:00
Minglei Jin
2c9c117529 fix(tsdb/cache): flush dirty lru entries before del 2023-11-29 17:37:40 +08:00
wangmm0220
4f168b4b2d fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode 2023-11-29 17:22:43 +08:00
Benguang Zhao
e66a1d6c9a enh: limit snap replication msg by size of block data in tsdbSnapReadTimeSeriesData 2023-11-29 16:01:11 +08:00
slzhou
1a3e280ea8 fix: use imem maxKey/minKey 2023-11-29 13:50:53 +08:00
slzhou
09e314c3ae fix: pStatus->pTableIter is set to null when getting mem table time range 2023-11-29 12:26:32 +08:00
54liuyao
ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
shenglian zhou
4691a7767a restore buildBlockFromBufferSequentially back 2023-11-29 10:29:40 +08:00
shenglian zhou
8a79df1113 enhance: prepare duration for next fileset 2023-11-29 10:15:43 +08:00
shenglian zhou
765b8384c0 Merge branch 'szhou/tms-duration' of github.com:taosdata/TDengine into szhou/tms-duration-2 2023-11-29 08:18:27 +08:00
slzhou
b2fa6209d9 fix: descending traverse wrong endkey 2023-11-29 08:09:00 +08:00
Haojun Liao
a5c8eaacaa fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-11-28 23:52:19 +08:00
kailixu
b54f5b47ad fix: reserve enough buffer for user 2023-11-28 17:58:54 +08:00
shenglian zhou
5a75d74421 fix:mem table has data in the fileset duration 2023-11-28 15:58:33 +08:00
slzhou
4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
shenglian zhou
89cd2b6f17 enhance: tsdb output duration order 2023-11-28 14:39:08 +08:00
yihaoDeng
08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
yihaoDeng
786383118c fix drop stream case 2023-11-28 10:39:17 +08:00
shenglian zhou
cdb7eb462d Revert "Revert "fix: pass compilation"" 
This reverts commit 644dbad920.
 2023-11-28 10:31:18 +08:00
shenglian zhou
df4f7d6956 Revert "Revert "enhance: duration notification"" 
This reverts commit 3331e25aaf.
 2023-11-28 10:31:18 +08:00
Haojun Liao
6bb30822c2 refactor: do some internal refactor. 2023-11-28 10:04:22 +08:00
Haojun Liao
9649db9003 fix(stream): fix invalid free. 2023-11-28 10:04:14 +08:00
Haojun Liao
8b406c0a19
Merge pull request #23830 from taosdata/fix/liaohj 
fix(stream): fix invalid free.
 2023-11-28 09:52:28 +08:00
shenglian zhou
3331e25aaf Revert "enhance: duration notification" 
This reverts commit 9dd306e1ef.
 2023-11-28 08:29:05 +08:00
shenglian zhou
644dbad920 Revert "fix: pass compilation" 
This reverts commit 1a7ee3643e.
 2023-11-28 08:28:49 +08:00
yihaoDeng
a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
Haojun Liao
b419650116 refactor: do some internal refactor. 2023-11-27 18:51:30 +08:00
Haojun Liao
91eea02258 fix(stream): fix invalid free. 2023-11-27 18:49:22 +08:00
wangmm0220
02575e0f28 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-27455 2023-11-27 18:15:53 +08:00
wangmm0220
d007d31c4d fix:process snode when drop stream 2023-11-27 18:15:09 +08:00
wangmm0220
06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220
70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng
630f4f9d80 Merge branch '3.0' into enh/refactorBackend 2023-11-27 13:53:33 +08:00
yihaoDeng
e483570cd7 Merge branch '3.0' into enh/refactorBackend 2023-11-27 11:10:56 +08:00
Haojun Liao
e85c6349a4
Merge pull request #23818 from taosdata/fix/TD-27455 
fix:add O_CLOSEXEC for .running & process snode when drop stream
 2023-11-27 11:01:24 +08:00
yihaoDeng
e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
dapan1121
d3ac79aeb7
Merge pull request #23808 from taosdata/fix/PI-23-3.0 
fix: add check in mnode/vnode when alter table col/tag
 2023-11-26 17:31:38 +08:00
Haojun Liao
9194c0c0cd fix(stream): add logs. 2023-11-25 00:56:18 +08:00
Haojun Liao
30c776cc0a fix(stream): reset the scheduler status. 2023-11-25 00:54:32 +08:00
Haojun Liao
788194c748 fix(stream): fix deadlock. 2023-11-24 22:53:55 +08:00
wangmm0220
ff0828fcc2 fix:add O_CLOSEXEC for .running & process snode when drop stream 2023-11-24 18:30:58 +08:00
wangmm0220
f8477204e1 fix:[TD-27475] send msg to snode wher drop stream to avoid pVgObj is NULL 2023-11-24 18:00:19 +08:00
yihaoDeng
6416a6153a Merge branch '3.0' into enh/refactorBackend 2023-11-24 16:29:09 +08:00
Haojun Liao
f28cf740b0 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-11-24 14:44:00 +08:00
Haojun Liao
d51baab9c2
Merge pull request #23785 from taosdata/fix/liaohj 
other: merge fix from 3.0 to main.
 2023-11-24 14:43:02 +08:00
Haojun Liao
d5e123db78
Merge pull request #23791 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-11-24 14:42:43 +08:00
yihaoDeng
23ae62d268 Merge branch '3.0' into enh/refactorBackend 2023-11-24 11:10:39 +08:00
Hongze Cheng
24932d2d41
Merge pull request #23799 from taosdata/fix/TD-27423 
fix(tsdb/skip-row): remove s3 size condition
 2023-11-24 10:48:03 +08:00
dapan1121
26fe05bb30
Merge pull request #23805 from taosdata/fix/slowReport 
fix: slow down report when error occurs
 2023-11-24 09:18:27 +08:00
Minglei Jin
b1841ee97b tsdb/reader-writer: fix pgno iteration with cache setting 2023-11-24 09:06:43 +08:00
wade zhang
95b5fbbb1a
Merge pull request #23801 from taosdata/enh/PI-25-3.0 
enh: trigger vnode commit at exit if meta changed
 2023-11-24 08:59:24 +08:00
kailixu
ac47d3ea7d enh: more check for column bytes 2023-11-24 06:51:57 +08:00
kailixu
c4f1babdcf enh: naming optimize 2023-11-24 06:42:30 +08:00
kailixu
dc977ca200 fix: stash drop column 2023-11-23 23:09:49 +08:00
kailixu
9ce28483a0 fix: add check in mnode/vnode when alter table col/tag 2023-11-23 21:22:41 +08:00
wangmm0220
d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
wangmm0220
55a4181e5e fix:add O_CLOEXEC for .running lock file to prevent inherited by child processes(rsync) 2023-11-23 20:16:54 +08:00
dmchen
522c848489 clean code 2023-11-23 11:53:14 +00:00
dmchen
75810bbdbb audit 2023-11-23 11:26:14 +00:00
dmchen
682ad9dd96 msg epset 2023-11-23 10:16:18 +00:00
Haojun Liao
2e922fefc6 fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-11-23 18:04:09 +08:00
wade zhang
0e8130b195
Merge pull request #23787 from taosdata/FIX/TD-27473-3.0 
enh: skip request to restore a vnode of single replica in failed mode
 2023-11-23 17:54:08 +08:00
yihaoDeng
6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Minglei Jin
3c3763a774 tsdb/read-by-column: fix last column index 2023-11-23 17:30:49 +08:00
Minglei Jin
9334fbcb06 tsdb/read-by-column: zero hint size when i's nonzero 2023-11-23 17:14:26 +08:00
dapan1121
699c14e781 fix: slow down report when error occurs 2023-11-23 16:51:07 +08:00
kailixu
14f163a795 Merge branch '3.0' into fix/PI-23-3.0 2023-11-23 16:49:19 +08:00
Benguang Zhao
f7f9546d1e enh: trigger vnode commit at exit if meta changed, for dbs of single replica 2023-11-23 16:32:57 +08:00
Minglei Jin
3034ca2875 tsdb/open-file: log not exist file path 2023-11-23 16:25:39 +08:00
Haojun Liao
810eb8e0e3 fix(stream): fix syntax error. 2023-11-23 16:25:12 +08:00
Minglei Jin
f076bfdfca fix(tsdb/skip-row): remove s3 size condition 2023-11-23 16:19:26 +08:00
Minglei Jin
460638d294 enh(tsdb/open-file): new s3 failed to connect error code 2023-11-23 16:09:02 +08:00
Haojun Liao
de4cc2009d fix(stream): fix error. 2023-11-23 16:04:06 +08:00
dmchen
cf4b3ec49f clean code 2023-11-23 08:02:37 +00:00
Minglei Jin
c6721be112 fix stt read compilation 2023-11-23 15:49:42 +08:00
Haojun Liao
0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Minglei Jin
08e5525012 tsdb/read-file-page: new arg for hint size 2023-11-23 15:37:26 +08:00
dmchen
bbbdec5db7 update progress 2023-11-23 07:36:33 +00:00
Haojun Liao
421a154d2a
Merge pull request #23768 from taosdata/fix/fixChkpRespMemleak 
fix mem leak
 2023-11-23 15:29:30 +08:00
Minglei Jin
023821a80b enh(tsdb/read-by-column): calc hint size for preloading 2023-11-23 15:16:36 +08:00
wade zhang
45bbf89a19
Merge pull request #23786 from taosdata/FIX/TD-27456-3.0 
enh: not allow to acquire a vnode in failed mode from vmAcquireVnode
 2023-11-23 14:20:23 +08:00
kailixu
6e3a62803c fix: add check in mnd when alter table col/tag 2023-11-23 14:08:31 +08:00
yihaoDeng
6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Benguang Zhao
d35bf6186f enh: skip restoring a vnode of single replica in failed mode from vmProcessCreateVnodeReq 2023-11-23 13:16:37 +08:00
dmchen
4e1a355052 mnode for compact 2023-11-23 04:43:28 +00:00
Haojun Liao
0654b9299a fix(stream): fix memory leak. 2023-11-23 11:44:25 +08:00
Haojun Liao
8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Benguang Zhao
8d70d023b9 enh: adjust a logging msg in vmRestoreVnodeInThread 2023-11-23 10:12:58 +08:00
Benguang Zhao
917246e236 fix: allow to drop a vnode in failed mode 2023-11-23 10:09:41 +08:00
Benguang Zhao
0a4fac7704 enh: not allow to acquire a vnode in failed mode from vmAcquireVnode 2023-11-23 09:48:42 +08:00
Haojun Liao
630b259d7f fix(stream): fix error in stream. 2023-11-23 09:41:07 +08:00
Haojun Liao
ff9c0c0df4 fix(stream): fix error in check trans conflict. 2023-11-23 09:38:11 +08:00
Haojun Liao
f3355000a3 refactor: do some internal refactor. 2023-11-23 09:34:20 +08:00
Haojun Liao
6fca8c170c enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-23 09:33:44 +08:00
Haojun Liao
8204db13aa enh(stream): add sink_quota column for stream tasks. 2023-11-23 09:33:42 +08:00
Haojun Liao
3edb25a49e fix(stream): add check for assert. 2023-11-23 09:33:40 +08:00
Haojun Liao
41aa175099 fix(stream): add return. 2023-11-23 09:33:36 +08:00
Haojun Liao
7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj 
fix(stream): fix error in generating token in bucket.
 2023-11-23 09:32:14 +08:00
wangmm0220
15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Hongze Cheng
44866b7b12 fix: possible race condition coredump 2023-11-22 20:35:18 +08:00
wangmm0220
6dc91d12d5 fix:add msg type 2023-11-22 20:23:58 +08:00
wangmm0220
cfab06239b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-22 19:37:44 +08:00
Haojun Liao
a2a68ce256 fix(stream): fix memory leak. 2023-11-22 18:28:38 +08:00
Haojun Liao
d88b32e93d fix(stream): fix memory leak. 2023-11-22 18:18:43 +08:00
wangmm0220
9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao
9988720a1e fix(stream): fix the invalid check of trans conflict. 2023-11-22 16:39:29 +08:00
Haojun Liao
ebb1993900 fix(stream): fix error in check trans conflict. 2023-11-22 16:20:59 +08:00
Haojun Liao
91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao
c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
slzhou
1a7ee3643e fix: pass compilation 2023-11-22 14:09:09 +08:00
shenglian zhou
9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
Haojun Liao
9a4222e189
Merge pull request #23767 from taosdata/fix/TD-27414 
fix:test case for windows
 2023-11-22 11:02:08 +08:00
dapan1121
1b6a3c2069
Merge pull request #23771 from taosdata/enh/xsren/TD-27022/windows 
Enh/xsren/td 27022/windows
 2023-11-22 10:58:39 +08:00
yihaoDeng
0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng
0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao
b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao
3907268f40 fix(stream): register checkpoint trans. 2023-11-22 08:40:40 +08:00
Haojun Liao
d355b78884 fix(stream): fix invalid read. 2023-11-22 08:40:28 +08:00
Haojun Liao
7a0dfdb0cc fix(tsdb): fix invalid read. 2023-11-22 08:40:10 +08:00
Haojun Liao
0a2fb5fe9a refactor: do some internal refactor. 2023-11-22 08:38:39 +08:00
Haojun Liao
43e6722fd8 refactor: refactor the stream trans conflict check 2023-11-22 08:38:32 +08:00
yihaoDeng
947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
Haojun Liao
785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060 
fix: errors in snode in conditions like fill history/checkpoint/restart
 2023-11-21 19:02:38 +08:00
facetosea
845493294d osfile 2023-11-21 16:31:31 +08:00
wade zhang
c4a1398050
Merge pull request #23761 from taosdata/enh/TD-27426-3.0 
enh: create replica of the same vgroup one by one for alter db replica
 2023-11-21 15:58:58 +08:00
Haojun Liao
8c4558c5c2
Merge pull request #23763 from taosdata/fix/pause_stream 
fix(stream): fix error in generating token in bucket.
 2023-11-21 15:46:25 +08:00
yihaoDeng
a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
wangmm0220
b3ca673fe9 fix:test case for windows 2023-11-21 14:35:41 +08:00
wade zhang
4f5359f684
Merge pull request #23756 from taosdata/FIX/TD-27416-3.0 
TD-27416
 2023-11-21 12:00:18 +08:00
Haojun Liao
1077378d51 other: merge main. 2023-11-21 10:14:30 +08:00
Haojun Liao
4b3495cd4b refactor: do some internal refactor. 2023-11-21 10:11:02 +08:00
Haojun Liao
2b099b11dd refactor: do some internal refactor. 2023-11-21 10:09:59 +08:00
dapan1121
415d162358
Merge pull request #23730 from taosdata/enh/TD-26976-3.0 
enh:  grant and active codes
 2023-11-21 10:04:20 +08:00
Benguang Zhao
1343c3b274 enh: create replica of the same vgroup one by one for alter db replica 2023-11-21 09:17:34 +08:00
yihaoDeng
939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
dmchen
2d7c4890da TD-27416 2023-11-20 16:50:43 +08:00
dmchen
376f78788e TD-27416 2023-11-20 08:43:12 +00:00
Hongze Cheng
5f849320d1
Merge pull request #23751 from taosdata/fix/TD-27405 
fix(tsdb/merge): clear file set before return 0
 2023-11-20 16:10:38 +08:00
Minglei Jin
d12bc41236 tsdb/merge: clear file set before return 0 2023-11-20 14:30:25 +08:00
Haojun Liao
ec919415b8 enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 12:03:23 +08:00
Haojun Liao
56edf1b52c enh(stream): add sink_quota column for stream tasks. 2023-11-20 12:03:23 +08:00
Haojun Liao
7cfa45e95e enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 11:59:49 +08:00
Haojun Liao
3912e49309 enh(stream): add sink_quota column for stream tasks. 2023-11-20 11:46:11 +08:00
yihaoDeng
734bf07317 Merge branch '3.0' into enh/refactorBackend 2023-11-20 10:48:49 +08:00
Haojun Liao
1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream 
fix(stream): remove invalid assert
 2023-11-17 23:48:47 +08:00
Haojun Liao
709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
wangmm0220
3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00
yihaoDeng
20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
kailixu
3b62d555ab enh: code optimization for active code 2023-11-17 15:50:08 +08:00
Haojun Liao
0fac706fa6
Merge pull request #23732 from taosdata/fix/pause_stream 
fix(stream): add check for assert.
 2023-11-17 11:33:19 +08:00
Haojun Liao
2a1a7c82e2 Merge branch '3.0' into fix/3_liaohj 2023-11-17 10:17:14 +08:00
wade zhang
440a750d64
Merge pull request #23711 from taosdata/fix/TD-27336-main 
fix/TD-27336
 2023-11-17 09:00:06 +08:00
wade zhang
43a8a76719
Merge pull request #23713 from taosdata/FIX/TD-27336-3.0 
fix/TD-27336
 2023-11-17 08:59:50 +08:00
kailixu
14a2be8ed2 enh: adjust test case 2023-11-17 08:41:47 +08:00
Haojun Liao
8fe79685a2 fix(stream): add check for assert. 2023-11-16 23:45:38 +08:00
Haojun Liao
c070e79d36 fix(stream): add check for assert. 2023-11-16 23:18:07 +08:00
wangmm0220
a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
kailixu
63a17295a7 enh: support spread active codes 2023-11-16 20:09:56 +08:00
kailixu
9e12ad408e enh: support spread active codes 2023-11-16 20:01:54 +08:00
kailixu
50126e4425 enh: support spread active codes 2023-11-16 19:52:05 +08:00
Minglei Jin
65a27dd9c8 fix(tsdb/cos-merge): skip stt merging & not block commit 2023-11-16 18:58:58 +08:00
yihaoDeng
7905f22aae fix stream backend convert 2023-11-16 17:35:17 +08:00
yihaoDeng
8023f2bebd fix stream backend convert 2023-11-16 15:30:01 +08:00
dmchen
8dbb7ff2d4 copy sql before destroy 2023-11-16 10:28:11 +08:00
dmchen
1e2c9b03a1 copy sql before destroy 2023-11-16 02:22:01 +00:00
dm chen
b18aa087da Revert "create steam" 
This reverts commit cd6df48df5.
 2023-11-16 10:09:46 +08:00
dmchen
cd6df48df5 create steam 2023-11-16 01:49:31 +00:00
wade zhang
cd8f542143
Merge pull request #23696 from taosdata/fix/TD-27311 
TD-27311
 2023-11-16 08:59:27 +08:00
Haojun Liao
f45c3277c3
Merge pull request #23710 from taosdata/fix/3_liaohj 
fix(stream): check the status before pause
 2023-11-15 22:06:56 +08:00
dapan1121
dc71252096 Merge remote-tracking branch 'origin/3.0' into merge/32m 2023-11-15 19:43:19 +08:00
wade zhang
a405a981be
Merge pull request #23500 from taosdata/fix/transaction-retry-main 
fix/transaction-retry
 2023-11-15 19:19:02 +08:00
wade zhang
297fea94df
Merge pull request #23700 from taosdata/FIX/transaction-retry-3.0 
Fix/transaction retry 3.0
 2023-11-15 19:18:41 +08:00
wangmm0220
a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
dmchen
9e37fd8fc6 create stream 2023-11-15 18:48:41 +08:00
dmchen
82498a9b4e create stream 2023-11-15 10:44:53 +00:00
dmchen
54d235dad0 fix/TD-27336 2023-11-15 18:21:55 +08:00
wangmm0220
45782f278b fix:send update msg to vnodes if snode restart 2023-11-15 18:13:35 +08:00
dmchen
51abd736e0 fix/TD-27336 2023-11-15 10:13:00 +00:00
Haojun Liao
1b89d4f404 fix(stream): add return. 2023-11-15 18:06:16 +08:00
Haojun Liao
6529e56020 fix(stream): check the status before pause 2023-11-15 18:06:16 +08:00
Minglei Jin
3b7e92f7a2 enh(mnode/split): not support split with s3 2023-11-15 17:34:26 +08:00
Haojun Liao
974d0bbb48 fix(stream): add return. 2023-11-15 16:53:51 +08:00
Haojun Liao
115246c877 fix(stream): check the status before pause 2023-11-15 16:46:09 +08:00
kailixu
188a4ce6a5 enh: the latest active code take effect 2023-11-15 16:33:05 +08:00
Haojun Liao
9d2256ec9c refactor: do some internal refactor. 2023-11-15 16:03:23 +08:00
Haojun Liao
1b1ad3068d fix(stream): check node status before start pause trans. 2023-11-15 16:02:56 +08:00
Haojun Liao
f299bdb387 fix(stream): register checkpoint trans. 2023-11-15 14:29:01 +08:00
Haojun Liao
2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898 
stream event window
 2023-11-15 14:18:07 +08:00
dapan1121
9457cf0b46
Merge pull request #23702 from taosdata/merge/m23 
merge: from main to 3.0
 2023-11-15 13:54:21 +08:00
Hongze Cheng
082ddbddf6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-11-15 13:41:28 +08:00
Hongze Cheng
8050d73202 first version 2023-11-15 13:41:00 +08:00
Haojun Liao
86f2673849
Merge pull request #23703 from taosdata/fix/drop_stream 
fix(tsdb): fix invalid read.
 2023-11-15 13:35:46 +08:00
wangmm0220
8a9ded764d fix:add finish history msg to snode 2023-11-15 11:50:14 +08:00
dapan1121
dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
Haojun Liao
f1b1b8911b fix(tsdb): fix invalid read. 2023-11-15 11:26:43 +08:00
wade zhang
bef2991211
Merge pull request #23691 from taosdata/fix/TD-27303-main 
TD-27303
 2023-11-15 11:23:00 +08:00
wade zhang
d800d59bf0
Merge pull request #23693 from taosdata/FIX/TD-27303-3.0 
TD-27303
 2023-11-15 11:22:47 +08:00
Haojun Liao
51897a679f fix(stream): fix invalid read. 2023-11-15 11:21:31 +08:00
Haojun Liao
62c7877176 fix(tsdb): fix invalid read. 2023-11-15 11:13:06 +08:00
Hongze Cheng
ed6be3b8c5
Merge pull request #23695 from taosdata/fix/TD-27313 
fix(cos/list): free object array in exception
 2023-11-15 11:09:38 +08:00
dmchen
46b5f8631c partial retry 2023-11-15 10:26:01 +08:00
dmchen
85729babf8 retry in outside 2023-11-15 10:25:29 +08:00
dmchen
f93d569552 redo 2023-11-15 10:24:59 +08:00
dmchen
20e5702183 revert 2023-11-15 10:24:15 +08:00
dmchen
481c5981d6 fix/transaction-retry 2023-11-15 10:23:46 +08:00
dmchen
1e50b11374 TD-27311 2023-11-15 01:31:51 +00:00
Haojun Liao
3294395617
Merge pull request #23686 from taosdata/fix/3_liaohj 
fix(stream): send msg by using epset extract from mnode
 2023-11-14 22:11:46 +08:00
Minglei Jin
7f65e92b81 tsdb/retention: not allow migrate backward 2023-11-14 19:27:18 +08:00
dmchen
d8277d5505 TD-27303 2023-11-14 19:18:06 +08:00
dmchen
056993b519 TD-27303 2023-11-14 11:10:22 +00:00
yihaoDeng
f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
Haojun Liao
61552e30d9 fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 17:13:40 +08:00
Haojun Liao
b390ee859c fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 17:04:54 +08:00
Hongze Cheng
f7e63ad1ca
Merge pull request #23680 from taosdata/fix/TD-27273 
fix(tsdb/merge): skip merge if data file cannot be written
 2023-11-14 16:08:12 +08:00
Haojun Liao
18333d7347 fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 15:48:00 +08:00
Minglei Jin
cb3fe4d6de fix(tsdb/merge): skip merge if data file cannot be written 2023-11-14 14:15:02 +08:00
Haojun Liao
436c7871a3
Merge pull request #23673 from taosdata/fix/3_liaohj 
fix(stream): fix deadlock and do some internal refactor.
 2023-11-14 11:26:54 +08:00
wade zhang
9167a07e89
Merge pull request #23657 from taosdata/enh/TD-27210 
enh: add humanStr convert func
 2023-11-14 10:04:54 +08:00
wade zhang
2cbce6c442
Merge pull request #23578 from taosdata/FIX/TD-27171-3.0 
enh: improve user error of redistribute vgroup
 2023-11-14 10:04:33 +08:00
Haojun Liao
9f6b0d25c5 refactor: do some internal refactor. 2023-11-13 23:59:05 +08:00
Haojun Liao
f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
Haojun Liao
9a852b723d refactor: refactor the stream trans conflict check 2023-11-13 23:26:16 +08:00
Haojun Liao
cfa7c19dd5
Merge pull request #23667 from taosdata/fix/liaohj 
fix(stream): fix deadlock.
 2023-11-13 22:15:06 +08:00
wangmm0220
56381dea90 fix:conflict from 3.0 2023-11-13 18:42:59 +08:00
wangmm0220
1cbe568be7 fix:add logic when snode restart 2023-11-13 18:39:42 +08:00
Haojun Liao
aad8a2eb87 fix(stream): fix deadlock. 2023-11-13 18:20:30 +08:00
Minglei Jin
6e583de80c fix(config/block-size): remove invalid range (-1, 1024) 2023-11-13 17:46:09 +08:00
Minglei Jin
acd816a364 fix(tsdb/retention): move fset destruction out of for loop 2023-11-13 16:59:26 +08:00
Shungang Li
a96e21aabd enh: refactor dynamic config 2023-11-13 16:28:42 +08:00
Shungang Li
06c4aa431f enh: add humanStr convert func 2023-11-13 16:28:38 +08:00
liuyao
37c102a115 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-13 16:06:17 +08:00
yihaoDeng
de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
wade zhang
05d7274d98
Merge pull request #23639 from taosdata/fix/TS-4249-main 
TS-4249
 2023-11-13 10:03:18 +08:00
wade zhang
8e5de50050
Merge pull request #23641 from taosdata/FIX/TS-4249-3.0 
TS-4249
 2023-11-13 10:03:03 +08:00
wangmm0220
6a44bd54ac fix:load task in snode 2023-11-13 09:12:15 +08:00
dapan1121
a51df86e43
Merge pull request #23636 from taosdata/enh/TD-25601-3.0 
enh: support delete msg for rsma
 2023-11-13 08:47:42 +08:00
Haojun Liao
9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao
3bacd7516e fix(stream): extact stream nodes list if not initialized. 2023-11-11 15:40:35 +08:00
Haojun Liao
15430f4d50 refactor: 2023-11-11 15:40:33 +08:00
Haojun Liao
5fcef5bd89 refactor:add some logs. 2023-11-11 15:40:32 +08:00
Haojun Liao
8925c721e5 fix(stream): adjust critical section. 2023-11-11 15:40:16 +08:00
Haojun Liao
5937bdddf5 refactor:disable test. 2023-11-11 15:40:12 +08:00
Haojun Liao
cb0d244d5a fix(stream): release lock. 2023-11-11 15:40:11 +08:00
Haojun Liao
af08a189c1 fix(stream): disable concurrently restart stream tasks. 2023-11-11 15:40:10 +08:00
Haojun Liao
4d9b422874 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-11 15:40:10 +08:00
Haojun Liao
45ab92a02d fix(stream): remove invalid free. 2023-11-11 15:39:55 +08:00
Haojun Liao
77d6fd5394 refactor: do some internal refactor. 2023-11-11 15:39:09 +08:00
Haojun Liao
608c72e901 refactor(stream): create sim env for stream processing. 2023-11-11 15:39:08 +08:00
Cary Xu
1c2e9c18d5
Update tqSink.c 2023-11-10 22:01:28 +08:00
kailixu
3707857c12 chore: remove obsolete code 2023-11-10 18:43:23 +08:00
kailixu
42e4e2b7a4 fix: macro define 2023-11-10 18:27:42 +08:00
kailixu
9017e2ed68 chore: code optimization 2023-11-10 18:11:06 +08:00
kailixu
c04fb6d543 enh: logic optimization 2023-11-10 17:23:17 +08:00
kailixu
bc44659826 fix: buffer overflow 2023-11-10 17:14:57 +08:00
Haojun Liao
438c303b0d other: merge main. 2023-11-10 17:05:36 +08:00
dmchen
f69a98da9e login 2023-11-10 16:56:18 +08:00
dmchen
ae1347fe5a login 2023-11-10 08:53:29 +00:00
dmchen
7fec818194 password 2023-11-10 16:47:01 +08:00
dmchen
fc8b16a5f3 password 2023-11-10 08:43:24 +00:00
kailixu
11c0427b22 enh: test case to delete mutiple tables 2023-11-10 16:41:41 +08:00
dmchen
65870ae117 TS-4249 2023-11-10 16:29:59 +08:00
Haojun Liao
08a9244230 fix(stream): extact stream nodes list if not initialized. 2023-11-10 16:24:20 +08:00
dmchen
22d6204fa9 TS-4249 2023-11-10 08:23:09 +00:00
kailixu
d5d8568bad fix: skip delete msg affects 0 row 2023-11-10 15:30:49 +08:00
Haojun Liao
d0307e5876 refactor: 2023-11-10 15:30:21 +08:00
kailixu
b1bca4e1e2 fix: batch delete logic 2023-11-10 15:12:10 +08:00
kailixu
5fae10bc76 enh: error code when build delete req 2023-11-10 15:09:01 +08:00
kailixu
2a14a10d0d Merge branch '3.0' into enh/TD-25601-3.0 2023-11-10 14:45:45 +08:00
kailixu
674e878ffa enh: rsma support delete 2023-11-10 14:44:29 +08:00
Haojun Liao
0b36081158 refactor:add some logs. 2023-11-10 14:36:18 +08:00
wangmm0220
8a05bad899 fix:snode error 2023-11-10 14:14:22 +08:00
Haojun Liao
5824caa8f5
Merge pull request #23631 from taosdata/fix/liaohj 
multiple fix
 2023-11-10 13:09:40 +08:00
Minglei Jin
32528ab9cd fix(tsdb/reader-writer): fix pgnoEnd calc 2023-11-10 12:44:09 +08:00
wade zhang
6bea2fe36a
Merge pull request #23625 from taosdata/fix/TD-27243-main 
fix/TD-27243
 2023-11-10 11:06:00 +08:00
wade zhang
b5b15f36f2
Merge pull request #23627 from taosdata/FIX/TD-27243-3.0 
fix/TD-27243
 2023-11-10 11:05:33 +08:00
liuyao
6e9866b1ab Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 10:33:21 +08:00
Haojun Liao
233777b6ac fix(stream): adjust critical section. 2023-11-10 10:26:45 +08:00
wade zhang
bc866ed28f
Merge pull request #23623 from taosdata/FIX/TD-27230-3.0 
fix: remove vnode obj from hash at first when dropping an offline vnode
 2023-11-10 09:50:10 +08:00
Haojun Liao
d8ab8d2d03 refactor:disable test. 2023-11-10 09:46:20 +08:00
Haojun Liao
ed49294e9b fix(stream): release lock. 2023-11-10 09:35:41 +08:00
Haojun Liao
9978667c48 fix(stream): disable concurrently restart stream tasks. 2023-11-10 09:24:08 +08:00
liuyao
6d2d5823dc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 09:24:05 +08:00
yihaoDeng
3e2314b09b Merge branch '3.0' into enh/refactorBackend 2023-11-10 09:22:16 +08:00
kailixu
ee6e68a71e enh: rsma support delete 2023-11-10 07:02:46 +08:00
Haojun Liao
730434ed82 fix(stream): check for the repeatedly sent checkpoint-source msg. 2023-11-09 23:26:09 +08:00
kailixu
7288b0fc77 enh: rsma delete error code 2023-11-09 20:16:29 +08:00
kailixu
ff3621f382 enh: rsma delete logic 2023-11-09 20:09:39 +08:00
Hongze Cheng
ec3685db94
Merge pull request #23600 from taosdata/fix/TD-27206 
fix(vnode/cos): fix error printing to avoid buffer overflow
 2023-11-09 06:06:54 -06:00
kailixu
572eb691fb enh: support delete msg for rsma 2023-11-09 19:51:01 +08:00
Haojun Liao
e6f3d4edc7
Merge pull request #23611 from taosdata/fix/TD-27216-3 
change chkpid gen way
 2023-11-09 18:55:17 +08:00
dapan1121
4f67629ea1
Merge pull request #23621 from taosdata/fix/TS-4122 
correct colid in blockinfo
 2023-11-09 18:09:09 +08:00
dmchen
2fbf0a532d fix/TD-27243 2023-11-09 18:02:06 +08:00
yihaoDeng
757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
dmchen
65bebb0912 fix/TD-27243 2023-11-09 09:51:35 +00:00
Minglei Jin
d3cf6a4340 tsdb/file: new nlevel field for remove 2023-11-09 17:44:24 +08:00
Hongze Cheng
b1fbdfcdc9
Merge pull request #23617 from taosdata/fix/little_typo 
fix: code typo
 2023-11-09 03:35:31 -06:00
Benguang Zhao
73f1c55a47 fix: remove vnode obj from hash 2023-11-09 17:24:02 +08:00
Yihao Deng
0453991cdf
Merge branch '3.0' into fix/TD-27216-3 2023-11-09 17:12:56 +08:00
wade zhang
c0c665d785
Merge pull request #23614 from taosdata/FIX/TD-27230-3.0 
fix: close vnode in the failed mode properly in vmCloseVnode
 2023-11-09 16:32:20 +08:00
wangjiaming0909
a6600ab23a correct colid in blockinfo 2023-11-09 15:41:01 +08:00
Minglei Jin
386c25a99a tsdb/retention: remove file when ref's clear 2023-11-09 15:24:19 +08:00
kailixu
9cf154543f chore: merge 3.0 2023-11-09 15:09:30 +08:00
kailixu
aa3ba74f6e chore: code optimization 2023-11-09 15:03:14 +08:00
dapan1121
8314cb6013
Merge pull request #23494 from taosdata/enh/TD-23769-3.0x 
enh: checkpoint for rsma
 2023-11-09 14:51:37 +08:00
kailixu
74cddda24b Merge branch '3.0' into enh/TD-25601-3.0 2023-11-09 14:37:13 +08:00
Hongze Cheng
e60f69a7ed fix: code typo 2023-11-09 14:20:27 +08:00
yihaoDeng
f74edc7618 Merge branch '3.0' into enh/refactorBackend 2023-11-09 06:14:08 +00:00
Minglei Jin
398771da5b Merge branch '3.0' into fix/TD-27206 2023-11-09 14:06:15 +08:00
liuyao
e56a3e8a1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-09 13:59:39 +08:00
yihaoDeng
15b73354f8 change chkpid gen way 2023-11-09 13:59:21 +08:00
yihaoDeng
ef726fee53 change chkpid gen way 2023-11-09 13:58:36 +08:00
Benguang Zhao
b80770dea8 fix: close vnode in the failed mode properly in vmCloseVnode 2023-11-09 13:05:52 +08:00
kailixu
1a950afdb8 enh: test case for rsma snapshot 2023-11-09 12:09:27 +08:00
Haojun Liao
257ab4f270
Merge pull request #23526 from taosdata/feat/TD-26060 
feat:checkpoint backup function
 2023-11-09 11:46:28 +08:00
kailixu
349e190120 enh: rsma result 2023-11-09 11:23:50 +08:00
kailixu
3495efaac7 enh: rsma exception process 2023-11-09 10:49:40 +08:00
Minglei Jin
5ac66679db config/s3blocksize: move range check from global to mnode 2023-11-09 10:17:46 +08:00
Haojun Liao
62f34c757e fix(stream): remove invalid free. 2023-11-09 10:10:37 +08:00
yihaoDeng
98a2ca6bfd change chkpid gen way 2023-11-09 10:07:24 +08:00
yihaoDeng
17ea6f39c1 change chkp gen way 2023-11-09 09:55:09 +08:00
Minglei Jin
1bb10bb862 vnode/cos: check get object block size optionally 2023-11-09 09:32:13 +08:00
yihaoDeng
06f196b71d change check out seq 2023-11-09 09:08:41 +08:00
kailixu
501d5a7acc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 20:47:15 +08:00
kailixu
72ecb0431c enh: rsma checkpoint 2023-11-08 20:45:44 +08:00
Minglei Jin
5ccdde4495 vnode/cos: error on incomplete fetching 2023-11-08 20:43:52 +08:00
yihaoDeng
0f98f4daa5 change check out seq 2023-11-08 20:29:37 +08:00
yihaoDeng
08e3448498 add seq 2023-11-08 19:54:57 +08:00
yihaoDeng
3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
liuyao
a8b415ed35 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 17:26:00 +08:00
Minglei Jin
128353a861 vnode/cos: fix get object handler mem 2023-11-08 16:04:24 +08:00
Minglei Jin
e5bbcf76f1 vnode/cos: fix get object block callback 2023-11-08 15:57:56 +08:00
Haojun Liao
99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
Minglei Jin
a1e692a796 fix(vnode/cos): fix error printing to avoid buffer overflow 2023-11-08 15:18:55 +08:00
wangjiaming0909
3e850df3c2 fix: last(ts2), ts2, ts caused data err 2023-11-08 14:43:11 +08:00
Minglei Jin
3f125bc6bf vnode/cos: make err msg buffer big enough for detailed msg 2023-11-08 14:30:30 +08:00
liuyao
340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
Haojun Liao
658fafd03c refactor: do some internal refactor. 2023-11-08 14:02:08 +08:00
Minglei Jin
15e1e4cd2c dnode/node_mgmt: cmake define for use_s3 2023-11-08 14:00:10 +08:00
wangjiaming0909
fc6c4fba90 feat: cache scan for select last(c), ts/c 2023-11-08 13:39:28 +08:00
Haojun Liao
809dd064a7 refactor(stream): create sim env for stream processing. 2023-11-08 11:04:16 +08:00
Minglei Jin
8bb65119a4 dnode: fix dnode s3 init 2023-11-08 10:52:23 +08:00
Haojun Liao
17bd6badec refactor(stream): do checkpoint for each task. 2023-11-08 10:47:54 +08:00
yihaoDeng
7ada7f34ac fix:merge from 3.0 2023-11-08 10:45:15 +08:00
kailixu
d1106c51dc enh: rsma code optimization 2023-11-08 09:54:03 +08:00
xinsheng Ren
96a3c373e0
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-08 09:28:27 +08:00
Minglei Jin
764f8d2e45 fix(vnode/s3): move init & cleanup to dnode 2023-11-08 09:03:19 +08:00
kailixu
b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu
f2d24306b1 enh: rsma tasks share one checkpoint and fix memory leak 2023-11-08 08:35:52 +08:00
Haojun Liao
666b8c531b
Merge pull request #23548 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-11-08 08:08:36 +08:00
Haojun Liao
e052d3cd62 fix(stream): check null. 2023-11-08 00:10:08 +08:00
Haojun Liao
9ba854d49d Merge branch '3.0' into fix/3_liaohj 2023-11-07 23:51:07 +08:00
Haojun Liao
7bfea5a82e fix(stream): fix syntax error. 2023-11-07 22:31:35 +08:00
kailixu
6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
wangmm0220
c0068abc9a fix:merge from 3.0 2023-11-07 18:55:46 +08:00
Haojun Liao
2674698b36 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-07 18:51:46 +08:00
yihaoDeng
95b14ee39b merge 3.0 2023-11-07 17:15:49 +08:00
Haojun Liao
1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao
8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao
7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao
e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
Haojun Liao
207b53f3f6 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:19:09 +08:00
wade zhang
4e70df5856
Merge pull request #23560 from taosdata/fix/TS-4187 
fix(cache/reader): use int64 max instead of uint
 2023-11-07 14:56:47 +08:00
kailixu
ac62714492 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-07 14:20:38 +08:00
Benguang Zhao
c851774a02 enh: improve user error of redistribute vgroup with TSDB_CODE_MND_REQ_REJECTED 2023-11-07 12:04:42 +08:00
wade zhang
9a342efd85
Merge pull request #23513 from taosdata/feat/TS-4094 
feat: add dynamic configuration
 2023-11-07 11:23:21 +08:00
Haojun Liao
4d8548e938 refactor: do some internal refactor. 2023-11-06 23:42:16 +08:00
kailixu
f5d796a081 chore: print stream state 2023-11-06 19:53:09 +08:00
Haojun Liao
d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
kailixu
dc5284a19c chore: add debug info 2023-11-06 17:27:36 +08:00
Haojun Liao
6b1889284b fix(stream): record the start failure tasks. 2023-11-06 15:45:44 +08:00
Minglei Jin
ec908fa4d0 fix(cache/reader): use int64 max instead of uint 2023-11-06 15:34:28 +08:00
wangmm0220
dffaac55ea fix:move cos from util to common 2023-11-06 14:57:32 +08:00
Minglei Jin
31ce6453c2 fix(cmake/s3): make cmake config portable 2023-11-06 14:17:27 +08:00
Haojun Liao
69863febe6 fix(stream):reset the starting flag for the followers. 2023-11-06 13:17:13 +08:00
Haojun Liao
bfd14076d7 fix(stream): fix dead-lock. 2023-11-06 12:05:47 +08:00
Haojun Liao
d41fd27189 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-06 11:57:21 +08:00
Haojun Liao
0e44950a37 enh(stream): execute scan history by using time slice 1s. 2023-11-06 09:21:33 +08:00
Haojun Liao
680eb5674e refactor: do some internal refactor. 2023-11-06 09:15:49 +08:00
kailixu
7e8c123fca chore: rsma code optimization 2023-11-06 08:46:04 +08:00
Haojun Liao
d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao
e13f003b90 refactor: do some internal refactor. 2023-11-05 01:23:23 +08:00
xinsheng Ren
da24384f0e
Merge branch '3.0' into fix/xsren/TD-22212/taosQueryParam3.0 2023-11-04 17:41:41 +08:00
kailixu
411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
yihaoDeng
f038f88c07 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-03 18:29:18 +08:00
Haojun Liao
3415ba5195
Merge pull request #23528 from taosdata/fix/liaohj 
enh(tsdb): on-demand open stt file reader.
 2023-11-03 17:29:55 +08:00
kailixu
77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
Haojun Liao
d3ddaaa9f3 other(tsdb): adjust some log info. 2023-11-03 15:08:25 +08:00
Haojun Liao
de5c4d8d5d other(tsdb): adjust some log info. 2023-11-03 15:07:40 +08:00
kailixu
c95fc014a8 enh: rsma checkpoint 2023-11-03 14:57:36 +08:00
kailixu
a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Shungang Li
c6f5e2a9bd enh: add dynamic configuration 2023-11-03 14:28:02 +08:00
Haojun Liao
34403534ed Merge branch '3.0' into fix/3_liaohj 2023-11-03 14:06:58 +08:00
liuyao
b1d1e2c778 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 14:02:59 +08:00
dm chen
dffc4d317f
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 13:57:08 +08:00
Haojun Liao
b4d14d3847 fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 13:51:18 +08:00
Haojun Liao
675c9ca613 enh(tsdb): on-demand open stt file reader. 2023-11-03 13:51:18 +08:00
dmchen
0e43b00194 partial retry 2023-11-03 04:07:18 +00:00
wangmm0220
0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
Haojun Liao
c980e2030c fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 11:04:32 +08:00
Haojun Liao
0acf4f1795 enh(tsdb): on-demand open stt file reader. 2023-11-03 10:35:05 +08:00
Hongze Cheng
1ff3f96b08
Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write 
enh(tsdb/retention): enable last tier write
 2023-11-02 21:21:38 -05:00
dm chen
0371064acc
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 10:20:54 +08:00
yihaoDeng
24e961976f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-03 09:31:57 +08:00
liuyao
31ad73f6d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 09:12:17 +08:00
Haojun Liao
ff5d69352f
Merge pull request #23493 from taosdata/fix/3_liaohj 
fix(stream): add unsupport trans.
 2023-11-03 09:07:33 +08:00
Haojun Liao
70388bafd2
Merge pull request #23523 from taosdata/fix/liaohj 
fix(stream): fix deadlock in transfer state.
 2023-11-03 09:07:23 +08:00
kailixu
d9ed63473c Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 08:37:41 +08:00
yihaoDeng
6ce878948f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 20:44:36 +08:00
kailixu
6c944bb192 enh: skip rsma_task during load stream tasks 2023-11-02 20:32:54 +08:00
wangmm0220
159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
liuyao
389117b806 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 20:07:12 +08:00
wade zhang
a3723b74ed
Merge pull request #23497 from taosdata/FIX/audit-db-resource-3.0 
db and resource
 2023-11-02 19:33:40 +08:00
wade zhang
dc581a83a1
Merge pull request #23495 from taosdata/fix/audit-db-resource-main 
db and resource
 2023-11-02 19:33:25 +08:00
Haojun Liao
b3d57e4a2d fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:31:35 +08:00
Haojun Liao
7a32b3a209 fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:12:36 +08:00
kailixu
fa5d896787 enh: rsma checkpoint 2023-11-02 18:56:36 +08:00
Haojun Liao
c4079332ff fix(stream):update the log level. 2023-11-02 18:18:04 +08:00
Haojun Liao
0a227e807f refactor: set different tq level. 2023-11-02 18:18:04 +08:00
Haojun Liao
48aff868b6 fix(stream):update the log level. 2023-11-02 18:16:47 +08:00
Hongze Cheng
4cf97ef6ae
Merge pull request #23520 from taosdata/fix/TD-27057 
fix: invalid read when file is deleted
 2023-11-02 04:49:49 -05:00
liuyao
f6ff356b81 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 17:45:50 +08:00
Haojun Liao
3aed8c29ae refactor: set different tq level. 2023-11-02 17:12:20 +08:00
Hongze Cheng
faea18c38f fix: invalid read when file is deleted 2023-11-02 16:59:11 +08:00
dmchen
abda605300 retry in outside 2023-11-02 08:20:03 +00:00
dmchen
55a5c3dd54 redo 2023-11-02 07:31:41 +00:00
kailixu
2d597659bc enh: rsma checkpoint 2023-11-02 15:20:54 +08:00
liuyao
330b04a8bc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 14:36:13 +08:00
dapan1121
e0f49f8000 fix: remove user table/view privilege issue 2023-11-02 14:14:26 +08:00
Haojun Liao
f5fa3edeba
Merge pull request #23503 from taosdata/fix/liaohj 
fix(stream): fix dead lock.
 2023-11-02 13:52:50 +08:00
dmchen
88da6e0879 revert 2023-11-02 05:42:17 +00:00
kailixu
722777f8c9 enh: rsma checkpoint 2023-11-02 13:15:31 +08:00
kailixu
96b5024347 enh: rsma checkpoint 2023-11-02 13:05:36 +08:00
kailixu
698fb804f9 enh: disable update tbUidList during reboot 2023-11-02 12:54:23 +08:00
kailixu
76536e1c82 enh: rsma logic 2023-11-02 11:03:18 +08:00
Haojun Liao
95efa07e92 fix(stream): add full unsupported event filtering. 2023-11-02 11:02:39 +08:00
Minglei Jin
46d3be1f08 config/page-cache-size: new parameter for pcache size 2023-11-02 10:10:03 +08:00
kailixu
9649e87cab fix: rsma checkpoint 2023-11-02 09:44:43 +08:00
Haojun Liao
351a31302f fix(stream): add full unsupported event filtering. 2023-11-02 09:43:48 +08:00
Minglei Jin
d0327e07b8 tsdb/pg-cache: use pgno for cache key instead of blkno 2023-11-02 09:42:19 +08:00
Hongze Cheng
a6ee7c4685 fix: possible coredump 2023-11-01 20:34:47 +08:00
kailixu
3803f952f9 chore: rsma checkpoint verify 2023-11-01 20:05:00 +08:00
Haojun Liao
7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao
00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao
9a9c1d689d fix(stream): add lock log. 2023-11-01 19:38:12 +08:00
Minglei Jin
52fd71ce13 config/block-size: default to -1 to enable page cache 2023-11-01 18:00:31 +08:00
yihaoDeng
1e96edcdd7 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 17:30:46 +08:00
Haojun Liao
246ed4e022 refactor: do some internal refactor. 2023-11-01 17:19:21 +08:00
dmchen
41749b7c52 fix/transaction-retry 2023-11-01 09:03:13 +00:00
liuyao
505c44d9aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-01 16:50:46 +08:00
dm chen
14eb345c8c
Update mndUser.c 2023-11-01 16:37:45 +08:00
kailixu
c32e60d199 chore: more code for rsma checkpoint 2023-11-01 16:27:41 +08:00
Haojun Liao
12bc4f32cf refactor: add some logs. 2023-11-01 16:12:15 +08:00
yihaoDeng
4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
kailixu
59be62c96e chore: set stream input checkpoint 2023-11-01 15:34:17 +08:00
Haojun Liao
034546a490
Merge pull request #23445 from taosdata/fix/TD-26685-new 
fix:print log if assert & check epoch when update epoch
 2023-11-01 15:32:40 +08:00
Haojun Liao
f76417535c
Merge pull request #23451 from taosdata/fix/TD-26685-3.0 
fix:print log if assert & check epoch when update epoch
 2023-11-01 15:32:25 +08:00
dmchen
0ab4e809c5 db and resource 2023-11-01 15:12:45 +08:00
Minglei Jin
f10d1ebdc5 Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 15:06:22 +08:00
dmchen
bbfecb7383 db and resource 2023-11-01 07:04:20 +00:00
Minglei Jin
6f0fa5d47e tsdb/retention: remove incorrect right brace 2023-11-01 14:56:57 +08:00
Haojun Liao
5ff89bc098 fix(stream): add lock log. 2023-11-01 13:19:53 +08:00
kailixu
ab266c712f chore: checkpoint for rsma stream state 2023-11-01 12:29:54 +08:00
Haojun Liao
0cf0ff3bbf
Merge pull request #23455 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-11-01 12:01:54 +08:00
Haojun Liao
3e6c89d8eb fix(stream): add unsupport trans. 2023-11-01 11:43:02 +08:00
Minglei Jin
0f5a124cb1 config/block-size: enable dynamic config for debugging 2023-11-01 11:08:39 +08:00
Minglei Jin
221afff9ee vnode/write: remove keep modify code block 2023-11-01 11:00:47 +08:00
Minglei Jin
64644d673b
Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 10:53:55 +08:00
Minglei Jin
a61502411d tsdb/pg-cache: new page cache for tsdb s3 read file page 2023-11-01 10:49:05 +08:00
dapan1121
6305353290 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-11-01 10:38:50 +08:00
kailixu
1530fe0c49 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-01 09:52:16 +08:00
kailixu
ad1e6accd4 chore: build checkpoint for rsma 2023-11-01 09:45:58 +08:00
Haojun Liao
7359f98eca
Merge pull request #23428 from taosdata/fix/3_liaohj 
other: merge refactor into 3.0
 2023-11-01 09:44:31 +08:00
yihaoDeng
6cab686e82 fix mem leak 2023-11-01 09:37:54 +08:00
Haojun Liao
639d5cde47 fix(stream): add unsupport trans. 2023-10-31 23:14:02 +08:00
yihaoDeng
bb8252df16 fix mem leak 2023-10-31 20:59:24 +08:00
kailixu
e6684fa5de enh: rsma retetion and stream state 2023-10-31 20:26:42 +08:00
wade zhang
b7ea04bdf4
Merge pull request #23475 from taosdata/enh/TD-26910 
enh: new errcode TSDB_CODE_MND_NO_ENOUGH_VNODES
 2023-10-31 20:05:34 +08:00
Shungang Li
c98228eff9 enh: new errcode TSDB_CODE_MND_NO_ENOUGH_VNODES 2023-10-31 20:03:52 +08:00
dapan1121
91df56fcf0 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-31 18:44:54 +08:00
dapan1121
d40cc27abc
Merge pull request #23464 from taosdata/enh/TD-26638-3.0 
enh: use placeholder '-' for interval of 1st retention level
 2023-10-31 18:36:43 +08:00
Haojun Liao
a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao
0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
Haojun Liao
4c0242a58d fix(stream): fix error in finishing event handling. 2023-10-31 16:39:14 +08:00
liuyao
696294c208 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-31 15:41:04 +08:00
wangmm0220
17a58697fa fix:print log if assert & check epoch when update epoch 2023-10-31 15:37:59 +08:00
wangmm0220
fc228d65f2 fix:print log if assert & check epoch when update epoch 2023-10-31 15:36:40 +08:00
wade zhang
76c9b9afc5
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0 
feat: support pipelining of snap replication
 2023-10-31 15:19:07 +08:00
wade zhang
25b09b467f
Merge pull request #23439 from taosdata/feat/TD-26971-3.0 
TD-26971
 2023-10-31 13:53:49 +08:00
wade zhang
9cea0e60de
Merge pull request #23437 from taosdata/feat/TD-26971-main 
TD-26971
 2023-10-31 13:53:32 +08:00
Haojun Liao
0ca85a4c03
Merge pull request #23424 from taosdata/refact/streamsm 
refactor: do some internal refactor.
 2023-10-31 12:48:22 +08:00
kailixu
28cd8f4915 enh: file duration for rsma 2023-10-31 11:38:33 +08:00
Hongze Cheng
ac3df85d8a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684 2023-10-31 11:23:23 +08:00
Haojun Liao
fc70fa053c fix(tsdb): fix syntax error. 2023-10-31 10:45:14 +08:00
Haojun Liao
6a7ba0f5f5 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 10:45:14 +08:00
Haojun Liao
00626de6e4 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-31 10:45:13 +08:00
Haojun Liao
cb43299faa fix(tsdb): avoid to read duplicated rows in buf. 2023-10-31 10:45:13 +08:00
Haojun Liao
635243f01a refactor: do some internal refactor. 2023-10-31 10:45:12 +08:00
Haojun Liao
6e2240a3d1 fix(stream): fix the deadlock. 2023-10-31 10:45:12 +08:00
Haojun Liao
0c982093cd fix(stream): enable the set of fill-history task to be un-init. 2023-10-31 10:45:12 +08:00
Haojun Liao
8b9bc988f1 fix(tsdb): fix syntax error. 2023-10-31 10:42:34 +08:00
Haojun Liao
eaf76854f6 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 09:29:24 +08:00
dmchen
ffb1e1e8c3 end point 2023-10-30 12:05:20 +00:00
kailixu
b03baaed2c chore: revert the code change 2023-10-30 19:49:50 +08:00
kailixu
89651626e3 chore: reopen rsma stream commit 2023-10-30 19:45:18 +08:00
dmchen
fe044051c8 memory leak 2023-10-30 19:36:27 +08:00
dmchen
5120d25297 memory leak 2023-10-30 11:34:34 +00:00
Minglei Jin
867ce92dcc tsdb/file-rw: fix log msg 2023-10-30 19:28:18 +08:00
kailixu
4a5b4b51e2 chore: remove obsolete codes 2023-10-30 17:51:42 +08:00
Minglei Jin
800cbfbb05 tsdb/file: new s3flag in mem 2023-10-30 17:36:49 +08:00
Haojun Liao
6e118c7963 fix(stream): fix memory leak. 2023-10-30 17:28:57 +08:00
dmchen
0f40e1dbb9 memory leak 2023-10-30 16:59:12 +08:00
dmchen
40c9622df5 memory leak 2023-10-30 08:57:07 +00:00
Haojun Liao
ed07486405 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-30 16:40:09 +08:00
Haojun Liao
bc1c2a879a fix(tsdb): avoid to read duplicated rows in buf. 2023-10-30 16:12:08 +08:00
dmchen
be0a85a0ff memory leak 2023-10-30 15:22:54 +08:00
Minglei Jin
84d2f9c379 tsdb/upload: delay data file uploading 2023-10-30 15:22:34 +08:00
dmchen
6172b820ac memory leak 2023-10-30 07:19:08 +00:00
Haojun Liao
fdf3f210ac refactor: do some internal refactor. 2023-10-30 14:39:24 +08:00
Haojun Liao
3275452bce fix(stream): fix the deadlock. 2023-10-30 14:38:51 +08:00
kailixu
c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
Haojun Liao
15d217fc3e fix(stream): fix memory leak. 2023-10-30 13:29:35 +08:00
Haojun Liao
b0700d6095 Merge branch '3.0' into fix/3_liaohj 2023-10-30 11:57:54 +08:00
Haojun Liao
93232a0e14 fix(stream): enable the set of fill-history task to be un-init. 2023-10-30 11:48:51 +08:00
liuyao
1a37f19c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 11:43:23 +08:00
dapan1121
6f0b634f95 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 10:24:16 +08:00
dapan1121
53e9c483c9
Merge pull request #23422 from taosdata/enh/TD-25879-3.0x 
enh: dmodule API dependence and grant process
 2023-10-30 10:13:28 +08:00
dapan1121
1b7a6bccdf
Merge pull request #23430 from taosdata/enh/TD-26641-3.0 
enh: only float/double allowed for sum/avg of rsma
 2023-10-30 10:08:55 +08:00
Minglei Jin
4fede02da4 tsdb/retention: remove s3 evict cache hook 2023-10-30 10:06:42 +08:00
Haojun Liao
1bbad532a7 fix(stream): add more check. 2023-10-30 09:32:40 +08:00
Haojun Liao
91121974d7 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-30 09:32:40 +08:00
Haojun Liao
48202a1e45 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
Haojun Liao
1a1b9f5ea3 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
dapan1121
972e10a238 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 08:45:29 +08:00
Haojun Liao
790d869494 fix(stream): add more check. 2023-10-29 22:57:33 +08:00
kailixu
22d6b95585 enh: dm init API 2023-10-29 21:13:18 +08:00
Haojun Liao
da6e3cb293 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-29 17:37:10 +08:00
Haojun Liao
1e696287d8 fix(stream): set the trans exec sequentially. 2023-10-29 02:45:47 +08:00
kailixu
3f65773222 enh: send grant to dnodes online and in async mode 2023-10-29 02:18:47 +08:00
Haojun Liao
3bf3d00d90 fix(stream): set the trans exec sequentially. 2023-10-27 23:45:50 +08:00
Haojun Liao
c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao
4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
Hongze Cheng
a7f3041ff3 more fix 2023-10-27 17:59:27 +08:00
Benguang Zhao
4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
Hongze Cheng
cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
dmchen
43e6dec6c2 TD-26971 2023-10-27 17:39:50 +08:00
dmchen
34c4ffde26 TD-26971 2023-10-27 09:30:30 +00:00
Minglei Jin
8c6f452f09 tsdb/write: make last tier writable to mem 2023-10-27 15:51:52 +08:00
kailixu
dc8cb7a99e fix: memory leak 2023-10-27 14:36:01 +08:00
Haojun Liao
dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
Haojun Liao
29b3a7a5e9 refactor: do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao
38eb5d2f89 refactor(stream): do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao
b4992a8506 other: add some logs. 2023-10-27 09:59:52 +08:00
Haojun Liao
9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
Haojun Liao
fa670a93f3 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-27 09:59:52 +08:00
Haojun Liao
454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao
33dc51cc86 fix(stream): add some logs. 2023-10-27 09:59:44 +08:00
Haojun Liao
1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao
2493c21ed3 fix(stream): fix the invalid write in sma 2023-10-27 09:58:52 +08:00
Haojun Liao
7cce53f7e5 fix(stream): ignore the check status when is ready. 2023-10-27 09:58:52 +08:00
Haojun Liao
c99f434706 fix(stream): set checkpoint failure when in pause status. 2023-10-27 09:58:52 +08:00
Haojun Liao
2c1af8dad8 refactor: do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao
1ad2c3029a refactor(stream): do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao
7311f9d2fe fix(sma): fix bugs in sma and do some internal refactor. 2023-10-27 09:58:51 +08:00
Haojun Liao
3bcffcf1da other: merge stream refactor from main. 2023-10-27 09:56:02 +08:00
Haojun Liao
47d4bac57a fix(stream): remove invalid assert. 2023-10-27 09:55:07 +08:00
Haojun Liao
4845474ea4 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao
5313543a9e refactor: do some internal refactor. 2023-10-27 09:55:05 +08:00
Haojun Liao
48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao
226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao
091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao
e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao
8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao
1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao
579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao
6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao
596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao
4badb445c4 refactor: do some internal refactor W.R.T. global configurations. 2023-10-27 09:54:07 +08:00