Commit graph

4456 commits

Author SHA1 Message Date
Haojun Liao
acde36a25b Merge branch '3.0' into fix/3_liaohj 2024-07-09 14:43:35 +08:00
Yihao Deng
b96e282aff refactor code 2024-07-09 03:28:27 +00:00
factosea
28dc3c85ea type overflow 2024-07-08 20:38:23 +08:00
Haojun Liao
bdced636b3 fix(stream): free task state when stopping stream tasks. 2024-07-08 18:20:35 +08:00
Yihao Deng
ef46c0c545 Merge remote-tracking branch 'origin/3.0' into enh/TD-30880 2024-07-08 07:34:39 +00:00
Haojun Liao
6e15c16cf7 fix(stream): check the set consensus-checkpointId ts. 2024-07-08 14:33:28 +08:00
Yihao Deng
1c4f354adf add http interface 2024-07-08 02:32:55 +00:00
Haojun Liao
647f9f47ef refactor: do some internal refactor. 2024-07-08 10:32:23 +08:00
Hongze Cheng
c8aa963417
Merge pull request #26434 from xinjiempolde/enh/TD-21826-3.0
enh/td-21826-3.0 error handling for stmt
2024-07-08 10:21:14 +08:00
Haojun Liao
ce4153b6fc fix(stream): use hb to send the consens-checkpointid req. 2024-07-08 09:05:33 +08:00
Hongze Cheng
9fd0132dee
Merge pull request #26435 from taosdata/fix/TD-30876-3.0
fix/TD-30876
2024-07-07 11:04:56 +08:00
wangjiaming0909
dbc2e9ec75 support bigger tsma interval 2024-07-05 18:21:48 +08:00
dapan1121
d544d3628d
Merge pull request #26411 from taosdata/fix/TS-4921
fix:[TS-4921] send data to queue error if monitor thread starts later or failed
2024-07-05 17:58:00 +08:00
Haojun Liao
8e6bb176c2 fix(stream): use trans to set the consensus-checkpoint id 2024-07-05 16:17:20 +08:00
wangmm0220
9d42b31d4a fix:[TS-4921]refactor code 2024-07-05 16:12:13 +08:00
dmchen
3a4412b282 fix/TD-30876 2024-07-05 06:24:53 +00:00
wangmm0220
6c5acdfc4b fix:[TS-4921]refactor code 2024-07-05 14:03:12 +08:00
Haojun Liao
c35c634977 fix(stream): add flag to disable the concurrently started consensus-checkpointId procedure. 2024-07-04 17:08:32 +08:00
Haojun Liao
47b0a0464e fix(stream): send checkpoint-source-rsp to mnode before reset task status. 2024-07-04 15:21:16 +08:00
wangmm0220
64e7c4c842 fix:[TS-4921] send data to queue error if monitor thread starts later or failed 2024-07-04 14:56:56 +08:00
dapan1121
9493ad96b6
Merge pull request #26380 from taosdata/fix/TS-4921
fix:[TS-4921]refactor reporting logic for slow log
2024-07-04 14:45:13 +08:00
Haojun Liao
653f7a1a43 fix(stream): refactor the checkpoint consensus policy. 2024-07-04 13:55:50 +08:00
factosea
5f0ac46029 diff 2024-07-04 11:04:59 +08:00
wangmm0220
cfbd475fc2 fix:[TS-4921]refactor reporting logic for slow log 2024-07-03 15:21:56 +08:00
wangmm0220
f593b644fc fix:compile error in windows & modify the size of send max 2024-07-02 22:48:32 +08:00
wangmm0220
470796ae88 fix:[TS-4921]refactor reporting logic for slow log 2024-07-02 18:03:26 +08:00
wangmm0220
65696ce97f fix:[TS-4921]refactor reporting logic for slow log 2024-07-02 14:52:20 +08:00
xjzhou
88aa15e944 enh: Enhance error handling for stmt 2024-07-02 11:05:54 +08:00
Haojun Liao
420b59fea5
Merge pull request #26344 from taosdata/fix/3_liaohj
fix(stream): validate the stream hb msg, and discard the invalid hb msg.
2024-07-02 09:07:31 +08:00
wangmm0220
a17ff3dbf5 fix:[TS-4921]refactor reporting logic for slow log 2024-07-01 19:08:16 +08:00
Haojun Liao
f09be802ea other: merge 3.0 2024-07-01 13:32:30 +08:00
54liuyao
8fdd64e92e limit the size of query queue 2024-07-01 11:08:39 +08:00
wangjiaming0909
11a98ffab2 QueryAutoQWorker 2024-07-01 11:08:39 +08:00
wangmm0220
328dfa3146 fix:remove using alarm when sending slow log & use one thread to send all slow log 2024-06-28 20:58:48 +08:00
Haojun Liao
025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao
48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
xjzhou
12c64a1c45 Merge remote-tracking branch 'origin/3.0' into enh/TD-23926-3.0 2024-06-27 17:02:54 +08:00
dapan1121
7074260e75
Merge pull request #26307 from taosdata/fix/TS-4921
fix:[TS-4921] errors in test
2024-06-27 14:20:51 +08:00
wangmm0220
1ec867449e fix:[TS-4921] errors in test 2024-06-27 10:11:38 +08:00
wangmm0220
d4b31cfd8e fix:[TS-4921] errors in test 2024-06-26 18:32:09 +08:00
Haojun Liao
a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
xjzhou
1a32279f7f Merge remote-tracking branch 'origin/3.0' into enh/TS-23926-3.0 2024-06-26 14:21:15 +08:00
xjzhou
1c8110e7a4 Merge remote-tracking branch 'origin/3.0' into enh/TS-23926 2024-06-26 10:34:36 +08:00
Hongze Cheng
b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao
1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Hongze Cheng
59c8656e61
Merge pull request #26275 from taosdata/feat/TS-4917-3.0
feat: 'create table' from csv file
2024-06-25 17:56:23 +08:00
xjzhou
3fb5f2b1d3 Merge remote-tracking branch 'origin/3.0' into enh/TS-23926 2024-06-25 16:16:56 +08:00
xjzhou
b444e18d90 enh: stmt supports 'insert into db.?' 2024-06-25 16:16:32 +08:00
Shungang Li
17e84e1fca Merge branch '3.0' into feat/TS-4917-3.0 2024-06-25 10:33:12 +08:00
Shungang Li
b3368f6472 feat: 'create table' from csv file 2024-06-24 22:13:03 +08:00
wangmm0220
ed16b1e8db fix:conflict from 3.0 2024-06-24 12:03:10 +08:00
wangmm0220
b5b43e1e9b fix:[TS-4921] stop timer in the end 2024-06-22 23:33:04 +08:00
wangmm0220
65fac20367 fix:[TS-4921] merge from 3.0 2024-06-22 15:02:34 +08:00
Haojun Liao
119001e30b fix(stream): update the retrieve checkpoint-trigger msg. 2024-06-21 15:11:48 +08:00
Haojun Liao
2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Hongze Cheng
9a97f976e9
Merge pull request #26178 from taosdata/feat/TS-4954-3.0
Feat/ts-4954-3.0-2
2024-06-20 15:07:13 +08:00
Haojun Liao
9c16549561
Merge pull request #26202 from taosdata/fix/TD-30558
fix(stream): adj stream tbname cache
2024-06-20 14:41:51 +08:00
54liuyao
ecfb5e5f4c adj par name catch 2024-06-20 09:28:04 +08:00
wangmm0220
5dcfed2d51 feat:[TS-4921]add logic for slow log 2024-06-19 18:54:26 +08:00
dapan1121
0397826c68
Merge pull request #26139 from taosdata/feat/TD-30313
optimize show cluster alive stmt
2024-06-19 15:49:59 +08:00
Haojun Liao
da63a40796
Merge pull request #26188 from taosdata/fix/3_liaohj
fix(stream): fix a typo.
2024-06-19 14:58:21 +08:00
Haojun Liao
2534ce5071 fix(stream): fix a typo. 2024-06-19 10:29:01 +08:00
Minglei Jin
356f6645ad
Merge branch '3.0' into fix/TD-30545 2024-06-18 11:28:29 +08:00
54liuyao
e858dd5df0 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-30313 2024-06-18 10:28:01 +08:00
Haojun Liao
c3ae66c95c
Merge pull request #26169 from taosdata/fix/3_liaohj
fix(stream): not revise the stream id for fill-history task.
2024-06-18 08:38:29 +08:00
Haojun Liao
985d619569 fix(stream): fix syntax error. 2024-06-17 23:14:33 +08:00
Haojun Liao
c4a2756907 fix(stream): not revise the stream id for fill-history task. 2024-06-17 23:13:54 +08:00
dmchen
4c8ce7a14c feat/TS-4954 2024-06-17 06:31:39 +00:00
dapan1121
e34a8b48df
Merge pull request #26008 from taosdata/fix/TS-4833/dataloaded
partition interval and limimt, dataload error
2024-06-17 08:32:19 +08:00
Haojun Liao
42e0dff589 fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already. 2024-06-14 17:03:04 +08:00
54liuyao
7620be6e28 optimize show cluster alive stmt 2024-06-13 16:23:50 +08:00
Haojun Liao
0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
Minglei Jin
568799a6a3 fix(wal/level): enable alter replica from fake walLevel 1 2024-06-12 15:16:58 +08:00
Haojun Liao
623a73f57b
Merge pull request #26089 from taosdata/fix/3_liaohj
fix(stream): init the node list and task list when starting mnode.
2024-06-12 11:34:10 +08:00
Haojun Liao
a41a04dc37 fix(stream): remove the related history task correctly. 2024-06-11 18:35:59 +08:00
dapan1121
bee01f9dba
Merge pull request #26081 from taosdata/enh/stmtPerf.3
enh: optimize stmt performance
2024-06-11 16:12:58 +08:00
Hongze Cheng
d321fbbc87
Merge pull request #26005 from taosdata/enh/TS-3737-3.0
enh: support createdb permission for user
2024-06-11 15:46:00 +08:00
Haojun Liao
20bade24c3
Merge branch '3.0' into fix/3_liaohj 2024-06-10 01:34:55 +08:00
Haojun Liao
cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao
895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
dapan1121
0616d886cb enh: optimize table columns allocation 2024-06-07 13:50:57 +08:00
dapan1121
3f99e5e064 fix: memory issues 2024-06-07 09:25:17 +08:00
kailixu
2f5179cf44 Merge branch '3.0' into enh/TS-3737-3.0 2024-06-06 16:42:04 +08:00
Hongze Cheng
070ec1412e
Merge pull request #26048 from taosdata/enh/TS-4885
enh/wal_level: new level 0 to disable wal writing
2024-06-06 10:19:50 +08:00
dapan1121
ddf15fa55c Merge remote-tracking branch 'origin/3.0' into enh/stmtPerf.3 2024-06-05 17:13:48 +08:00
dapan1121
da8616d98a fix: add stbInterlace mode test cases 2024-06-05 17:12:15 +08:00
Minglei Jin
d6b2bcba68 enh/wal_level: new level 0 to disable wal writing 2024-06-05 15:19:55 +08:00
kailixu
c89f06eaf3 chore: adjust test case 2024-06-05 14:56:47 +08:00
Haojun Liao
c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-06-05 13:38:51 +08:00
kailixu
2f222514dc chore: merge 3.0 2024-06-04 16:34:02 +08:00
Haojun Liao
6d7e1eb576 fix(query): check for the server ep and client ep to set the compress flag. 2024-06-04 15:07:02 +08:00
factosea
c42e627a41 test 2024-06-04 11:39:47 +08:00
Haojun Liao
4fc21cc8b0 refactor: do some internal refactor. 2024-06-04 10:08:18 +08:00
dapan1121
91375c8ca1 fix: taosc exit issue 2024-06-03 19:13:14 +08:00
Haojun Liao
3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao
927e2237de Merge branch '3.0' into fix/3_liaohj 2024-06-03 15:56:02 +08:00
dapan1121
affdeed944
Merge pull request #25909 from taosdata/feat/ly_tmq_batch_meta
optimize tmq snapshot meta
2024-06-03 10:19:57 +08:00
Haojun Liao
2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
kailixu
4ae8aeb909 Merge branch '3.0' into enh/TS-3737-3.0 2024-05-31 15:48:19 +08:00
Haojun Liao
76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao
bef1953b24
Merge branch '3.0' into fix/3_liaohj 2024-05-31 14:27:46 +08:00
Haojun Liao
ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
dapan1121
4f67ccc5d5
Merge pull request #25935 from taosdata/fix/3.0/TD-30188
fix select from union all caused crash
2024-05-30 15:45:44 +08:00
dapan1121
c0e4ab20a4 enh: optimize stmt performance 2024-05-30 13:26:17 +08:00
Yihao Deng
5a91039f04 TD-30340 2024-05-30 03:00:56 +00:00
Haojun Liao
27ac6ca16e fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-29 14:12:14 +08:00
Haojun Liao
d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
Haojun Liao
bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
Haojun Liao
be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
wangjiaming0909
fd34087b8c fix select from union all caused crash 2024-05-27 16:20:13 +08:00
dapan1121
6064ea0125 fix: support timeline query from union and order by 2024-05-24 11:24:19 +08:00
54liuyao
441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
kailixu
0ef202a56b enh: createdb permission for users 2024-05-22 19:00:47 +08:00
Haojun Liao
be39044b66 fix(stream): add more info 2024-05-22 11:04:54 +08:00
Haojun Liao
3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
Haojun Liao
1e5098f676 fix(query): fix bugs caused by refactor. 2024-05-19 13:32:30 +08:00
Haojun Liao
217fb7551c fix(query): fix bugs caused by refactor. 2024-05-19 13:18:12 +08:00
Haojun Liao
93292d8149 other: merge 3.0 2024-05-18 09:58:36 +08:00
Haojun Liao
92b247e5b4 refactor: move compress data in query threads. 2024-05-16 15:55:48 +08:00
Haojun Liao
abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
Haojun Liao
610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao
6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao
b7e7de0354 fix(stream): set the stream task load flag. 2024-05-13 16:45:38 +08:00
dmchen
7c31014c4d add sql 2024-05-13 08:20:27 +00:00
Haojun Liao
3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
t_max
f030af3aab fix: build fails on macOS and Windows 2024-05-11 14:59:05 +08:00
Haojun Liao
d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
Haojun Liao
7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Shungang Li
7ae4415890 fix: refactor lastcache ser/des for compatibility 2024-05-09 19:04:11 +08:00
Haojun Liao
6721ec3cd8 refactor: do some internal refactor. 2024-05-09 14:06:25 +08:00
Haojun Liao
6693efaa85 refactor: do some internal refactor. 2024-05-09 10:11:37 +08:00
Haojun Liao
c43fbf6fee refactor: do some internal refactor. 2024-05-08 11:21:24 +08:00
Haojun Liao
5ee1cba173 fix(test): fix syntax error. 2024-05-08 10:18:19 +08:00
Haojun Liao
cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao
b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Haojun Liao
0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Haojun Liao
18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao
7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao
d879c7c967 fix(stream): set global close flag in the streamMeta. 2024-05-06 16:40:49 +08:00
Haojun Liao
732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao
f115a33a94
Merge pull request #25538 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-04-28 23:21:52 +08:00
Haojun Liao
bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Hongze Cheng
13cd60f17f
Merge pull request #25524 from taosdata/feat/TD-29823
Feat/TD-29823
2024-04-28 17:51:39 +08:00
Haojun Liao
3c5ca17737 Merge branch '3.0' into fix/3_liaohj 2024-04-28 13:57:16 +08:00
Haojun Liao
6ea4823f1e fix(stream): update the timeout measurement. 2024-04-28 11:14:10 +08:00
Haojun Liao
b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
Haojun Liao
9df2bc2634 refactor: do some internal refactor. 2024-04-26 22:23:23 +08:00
Haojun Liao
2d1e9ba631 fix(stream):add ref for task in check rsp monitor timer. 2024-04-26 19:11:57 +08:00
Haojun Liao
5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Yihao Deng
ac15015cb8 Add RpcNoDelayfp function to handle specific message types 2024-04-26 08:10:39 +00:00