Commit graph

15104 commits

Author SHA1 Message Date
Minglei Jin
01e5e124fb fix(last_row): fix empty table condition 2024-06-07 13:47:04 +08:00
Haojun Liao
1e47cb7eba other: update the test case. 2024-06-07 11:15:23 +08:00
kailixu
7de2928c86 Merge branch '3.0' into feat/TD-30053-3.0 2024-06-07 10:28:22 +08:00
Haojun Liao
34205ba62c refactor: do some internal refactor. 2024-06-07 10:09:40 +08:00
Haojun Liao
88e77d6bc6 fix(stream): remove expired stream in buf. 2024-06-06 23:54:48 +08:00
Haojun Liao
6ef3c02717 fix(tsdb): remove invalid assert. 2024-06-06 19:09:54 +08:00
wangmm0220
0e337d3418 fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-06 17:26:20 +08:00
kailixu
2f5179cf44 Merge branch '3.0' into enh/TS-3737-3.0 2024-06-06 16:42:04 +08:00
Haojun Liao
0e9f720cc4 fix(stream):add logs. 2024-06-06 11:27:20 +08:00
wangmm0220
697b81aa8a fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-06 11:15:23 +08:00
kailixu
4beaf871b7 Merge branch '3.0' into feat/TD-30053-3.0 2024-06-06 08:33:48 +08:00
wangmm0220
48ecba95da fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-05 18:02:57 +08:00
kailixu
8dc092936d enh: user permission for balance vgroup leader 2024-06-05 17:10:41 +08:00
dmchen
e867e7061c fix/TD-30443 2024-06-05 08:43:53 +00:00
kailixu
c89f06eaf3 chore: adjust test case 2024-06-05 14:56:47 +08:00
Haojun Liao
29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao
c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-06-05 13:38:51 +08:00
kailixu
ee9ccdea86 Merge branch '3.0' into feat/TD-30053-3.0 2024-06-05 12:38:09 +08:00
Haojun Liao
1e33a1f408 fix(stream): fix memory leak. 2024-06-05 11:43:39 +08:00
kailixu
88da4d4376 chore: createdb permission for super user 2024-06-05 10:28:13 +08:00
kailixu
d5f8cb66e7 enh: createdb for default user 2024-06-05 10:20:24 +08:00
kailixu
872d986a2c fix: show users for super user when upgrade 2024-06-05 10:10:20 +08:00
Hongze Cheng
9739c9d7d5
Merge pull request #26032 from taosdata/fix/TD-30422-3.0
TD-30422
2024-06-05 09:14:55 +08:00
Haojun Liao
82293406f1 fix(stream): fix syntax error. 2024-06-05 09:14:33 +08:00
Hongze Cheng
4490cd7db3
Merge pull request #26040 from taosdata/enh/lsg-restore-3.0
enh: add more log for restore
2024-06-05 09:11:42 +08:00
Haojun Liao
29648be30d fix(stream): add the new node info when adding stream tasks. 2024-06-04 23:28:08 +08:00
Shungang Li
1f73bb106e enh: add more log for restore 2024-06-04 17:14:59 +08:00
kailixu
2f222514dc chore: merge 3.0 2024-06-04 16:34:02 +08:00
dmchen
e1b32e12a1 TD-30422 2024-06-04 05:07:56 +00:00
factosea
c42e627a41 test 2024-06-04 11:39:47 +08:00
Haojun Liao
4fc21cc8b0 refactor: do some internal refactor. 2024-06-04 10:08:18 +08:00
dapan1121
8a4070f06c
Merge pull request #25966 from taosdata/fix/TD-30323-3.0
fix:[TD-30323]tmq close error if consumer is cleared
2024-06-03 19:02:59 +08:00
Haojun Liao
be36207ecd
Merge pull request #26019 from taosdata/fix/TD-30028
fix(stream): disable stream checkpoint when related fill-history task exists.
2024-06-03 18:59:58 +08:00
Haojun Liao
111e1b2f60 fix(stream): disable stream checkpoint when related fill-history task exists. 2024-06-03 16:50:51 +08:00
Haojun Liao
3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao
927e2237de Merge branch '3.0' into fix/3_liaohj 2024-06-03 15:56:02 +08:00
Hongze Cheng
6f72fd4170
Merge pull request #25996 from taosdata/feat/TD-30006-3
Feat/TD-30006-3
2024-06-03 15:41:47 +08:00
dapan1121
affdeed944
Merge pull request #25909 from taosdata/feat/ly_tmq_batch_meta
optimize tmq snapshot meta
2024-06-03 10:19:57 +08:00
Haojun Liao
f13dc1858a fix(stream): disable stream checkpoint when related fill-history task exists. 2024-06-03 09:54:28 +08:00
Hongze Cheng
c8f13874a7
Merge pull request #25984 from taosdata/fix/TD-30309-3.0
fix: coverity scan problem
2024-06-03 08:58:48 +08:00
wangmm0220
a096e2c071 fix:memory leak 2024-06-02 21:28:53 +08:00
Haojun Liao
2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
wangmm0220
ad075ef1de fix:[TD-30323]tmq close error if consumer is cleared 2024-06-01 16:19:17 +08:00
kailixu
767934ad4a enh: support createdb permission for user 2024-05-31 17:50:57 +08:00
54liuyao
e0167511c1 use tDeleteSVCreateTbBatchReq free mem 2024-05-31 17:18:25 +08:00
kailixu
4ae8aeb909 Merge branch '3.0' into enh/TS-3737-3.0 2024-05-31 15:48:19 +08:00
Haojun Liao
76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao
bef1953b24
Merge branch '3.0' into fix/3_liaohj 2024-05-31 14:27:46 +08:00
Yihao Deng
5293c4a1dd Merge branch '3.0' into feat/TD-30006 2024-05-31 02:49:58 +00:00
Yihao Deng
a1ccf91298 support add column compress 2024-05-31 02:47:57 +00:00
Yihao Deng
b364379671 add compress 2024-05-31 02:31:29 +00:00
Haojun Liao
ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Hongze Cheng
0988064f9c
Merge pull request #25950 from taosdata/fix/TD-30291-3.0
fix: arb distinguish between isSync and acked
2024-05-30 19:50:51 +08:00
Yihao Deng
c6407277dc support add column compress 2024-05-30 11:41:22 +00:00
Haojun Liao
815a9e953b fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-30 18:41:56 +08:00
Haojun Liao
e66283d99c fix(stream): remove table meta in table-meta cache. 2024-05-30 18:41:17 +08:00
Hongze Cheng
d28abdf837 fix coverity scan problem 2024-05-30 16:11:53 +08:00
Haojun Liao
b4956392d9 fix(stream): return in_progress code if not send retrieve rsp to downstream. 2024-05-30 15:54:08 +08:00
Haojun Liao
5768cc94a1 Merge branch '3.0' into fix/3_liaohj 2024-05-30 15:35:00 +08:00
Haojun Liao
cff5e753ef fix(stream): discard the result data block if the primary timestamp of results is expired. 2024-05-30 14:16:49 +08:00
Hongze Cheng
91394f2e6d fix more 2024-05-30 11:01:44 +08:00
Hongze Cheng
88a2c373b3 more fix 2024-05-30 10:22:26 +08:00
Haojun Liao
0946f25e5f fix(stream): fix syntax error. 2024-05-29 22:36:22 +08:00
Haojun Liao
becc4cb368 enh(stream): limit the concurrent started checkpoint tasks. 2024-05-29 19:29:26 +08:00
54liuyao
129d04a449 adj tmq param 2024-05-29 16:29:04 +08:00
wangmm0220
1a6a0d3107 fix:[TD-30323]tmq close error if consumer is cleared 2024-05-29 16:04:37 +08:00
Hongze Cheng
e75ab5b298 fix more 2024-05-29 14:10:34 +08:00
Hongze Cheng
bb83ed2469 fix: compact and commit concurrency problem 2024-05-29 11:33:17 +08:00
Haojun Liao
d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
54liuyao
a2255ca355 add tmq param 2024-05-28 18:34:37 +08:00
Haojun Liao
8d54d45054 fix(stream): fix error found by CI. 2024-05-28 17:30:14 +08:00
Haojun Liao
c3c6b680fb Merge branch '3.0' into fix/3_liaohj 2024-05-28 17:29:22 +08:00
Shungang Li
4c47626baf fix: arb distinguish between isSync and acked 2024-05-28 16:29:42 +08:00
Shungang Li
a8383369ba enh: arb check roletime before check sync 2024-05-28 15:13:58 +08:00
Hongze Cheng
242b836eca compile error 2024-05-28 14:35:58 +08:00
Hongze Cheng
913612e4a6
Merge pull request #25913 from taosdata/enh/TS-4723-3.0
enh: reduce compact block write time
2024-05-28 13:18:57 +08:00
Haojun Liao
cc318d7e2d enh(stream): sink task does not initialize the backend. 2024-05-28 11:34:04 +08:00
Haojun Liao
bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
54liuyao
57bf9d1048 adj log 2024-05-28 10:56:43 +08:00
54liuyao
7fc2e8cc26 batch meta 2024-05-28 10:17:20 +08:00
Haojun Liao
be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Hongze Cheng
81768b40fd
Merge pull request #25924 from taosdata/fix/TD-30248-3.0
fix: last cache memory leak
2024-05-27 18:14:36 +08:00
Hongze Cheng
72736ba7b9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-4723-3.0 2024-05-27 09:33:33 +08:00
dapan1121
2f9c341208
Merge pull request #25887 from taosdata/fix/3.0/TD-30105
fix smaTest unit test
2024-05-24 13:50:23 +08:00
Shungang Li
9947d8ec42 fix: last cache memory leak 2024-05-24 12:57:49 +08:00
wangjiaming0909
22aad41810 fix smaTest failed caused by mnode not inited 2024-05-24 11:42:01 +08:00
Haojun Liao
89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00
Haojun Liao
499ca6c23b
Merge pull request #25910 from taosdata/fix/TD-30028
fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec.
2024-05-24 10:25:17 +08:00
Hongze Cheng
a33fd60721 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-4723-3.0 2024-05-23 19:05:24 +08:00
Hongze Cheng
21ea1e3735 fix memory leak 2024-05-23 19:05:11 +08:00
Hongze Cheng
f9834898c6
Merge pull request #25894 from taosdata/fix/TD-30113-2-3.0
TD-30113
2024-05-23 18:03:34 +08:00
Hongze Cheng
9531cba834 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-4723-3.0 2024-05-23 18:02:26 +08:00
Hongze Cheng
f729072044 enh: reduce compact block write time 2024-05-23 17:57:07 +08:00
54liuyao
441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
Haojun Liao
0c61fb20d6 fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec. 2024-05-23 17:22:29 +08:00
kailixu
585ec14fea feat(grant): support industry edition 2024-05-23 17:17:18 +08:00
Hongze Cheng
987d3d84f0
Merge pull request #25897 from taosdata/fix/TD-30106-2-3.0
fix/TD-30106
2024-05-23 17:12:00 +08:00
Hongze Cheng
f492d4ad40
Merge pull request #25891 from taosdata/fix/TS-4827-3.0
fix: last cache update ts for col format
2024-05-23 16:45:12 +08:00
kailixu
c632a64294 Merge branch '3.0' into feat/TD-30053-3.0 2024-05-23 14:39:57 +08:00
Hongze Cheng
eac6408339
Merge pull request #25879 from taosdata/enh/TD-29713-3.0
enh: batch update arbgroup in trans
2024-05-23 14:28:11 +08:00
dmchen
5055dad3cf fix/TD-30106 2024-05-23 04:22:52 +00:00
kailixu
0ef202a56b enh: createdb permission for users 2024-05-22 19:00:47 +08:00
kailixu
0303ea7bd2 enh: refine error code 2024-05-22 16:44:57 +08:00
dmchen
889b420270 TD-30113 2024-05-22 08:17:20 +00:00
Shungang Li
0e76ba4034 fix: last cache update ts for col format 2024-05-22 15:15:41 +08:00
Haojun Liao
317742acc1 fix(stream): adjust buf size. 2024-05-22 13:29:38 +08:00
Haojun Liao
565d1f408c fix(stream): adjust buf size, and avoid overflow 2024-05-22 13:26:49 +08:00
Haojun Liao
77852fa702 fix(stream): avoid data overflow and fix test cases. 2024-05-22 13:20:45 +08:00
Haojun Liao
be39044b66 fix(stream): add more info 2024-05-22 11:04:54 +08:00
Shungang Li
307ddc632f enh: batch update arbgroup in trans 2024-05-22 10:44:46 +08:00
kailixu
ea1b4c3b9d Merge branch '3.0' into enh/TD-30149-3.0 2024-05-22 10:44:44 +08:00
Haojun Liao
ed12ef1c02
Merge pull request #25878 from taosdata/fix/TD-30180-3.0
fix:[TD-30180]error in judging if groupId already added to the end of…
2024-05-22 09:12:56 +08:00
wangmm0220
f21eeae56c fix:[TD-30180]error in judging if groupId already added to the end of table name 2024-05-21 16:57:00 +08:00
kailixu
04c0c8b6cd enh(grant): refine error code 2024-05-21 15:26:29 +08:00
Haojun Liao
f6af165d9a refactor(stream): add more info in info-meta 2024-05-21 10:09:55 +08:00
dmchen
a297a38818 fix/TD-29772 2024-05-21 01:57:33 +00:00
Haojun Liao
3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
dapan1121
68640f52be
Merge pull request #25833 from taosdata/fix/TS-4716-3.0
fix:[TS-4716]wait too long if change system time
2024-05-20 09:47:06 +08:00
Haojun Liao
217fb7551c fix(query): fix bugs caused by refactor. 2024-05-19 13:18:12 +08:00
Haojun Liao
93292d8149 other: merge 3.0 2024-05-18 09:58:36 +08:00
Haojun Liao
27c4e3634c refactor: do some internal refactor. 2024-05-17 17:04:05 +08:00
Shungang Li
bf40585f6c fix: cache update for last key 2024-05-17 16:41:26 +08:00
wangmm0220
3c0dbacf37 fix:[TS-4716]wait too long if change system time 2024-05-17 16:37:40 +08:00
Minglei Jin
7292d7a0ff fix(tsdb/cache): update array reference to fix missing tables/groupby 2024-05-17 14:59:20 +08:00
wangmm0220
b0cdf887b4 fix:[TS-4716]wait too long if change system time 2024-05-17 14:27:09 +08:00
Shungang Li
b79dda6689 enh: adjust order for row format cache update 2024-05-17 11:31:09 +08:00
Minglei Jin
3b8c27764d Merge branch '3.0' into fix/TD-29995-3.0 2024-05-17 10:17:33 +08:00
Haojun Liao
15181eb14b enh(tsdb): increase the capacity for return data. 2024-05-17 09:51:56 +08:00
Shungang Li
5c952fc922 enh: cleanup 2024-05-17 09:10:35 +08:00
Haojun Liao
5307f15766 refactor: do some internal refactor. 2024-05-16 19:54:29 +08:00
kailixu
a0167f91b5 Merge branch '3.0' into feat/TD-30053-3.0 2024-05-16 17:30:52 +08:00
kailixu
cb5bdd29b5 feat(grant): support industry edition 2024-05-16 17:30:03 +08:00
Haojun Liao
41b55cf4d6
Merge pull request #25792 from taosdata/fix/TD-29745-1
adj code
2024-05-16 13:56:31 +08:00
Shungang Li
fc047ddafc fix: last cache update rule 2024-05-16 09:30:27 +08:00
Hongze Cheng
f4a9c5e3c8
Merge pull request #25669 from taosdata/enh/TD-29953
Enh/TD-29953
2024-05-15 17:26:26 +08:00
Hongze Cheng
9dd3f326ea
Merge pull request #25731 from taosdata/enh/TD-29968-3.0
enh: grant support s3/active-active/dual-replica/db_encryption
2024-05-15 15:52:28 +08:00
Haojun Liao
abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
54liuyao
2a67b83a27 adj code 2024-05-15 14:11:55 +08:00
Haojun Liao
43e018e210
Merge pull request #25733 from taosdata/fix/TD-29745
optimize scan data
2024-05-15 13:41:08 +08:00
54liuyao
167cdc79c5 format code 2024-05-15 10:54:53 +08:00
54liuyao
4c603fee55 format code 2024-05-15 10:54:24 +08:00
54liuyao
3c56f623ed adj inline func 2024-05-15 10:46:19 +08:00
Hongze Cheng
156b5e71f4
Merge pull request #25735 from taosdata/fix/TD-29772-3.0
fix/TD-29772
2024-05-15 09:13:01 +08:00
54liuyao
ab3ba3f2e4 optimize scan tsdb 2024-05-15 09:09:20 +08:00
Haojun Liao
a3bd3a4c76
Merge pull request #25769 from taosdata/fix/TS-4791
fix(tsdb): fix the length of column type overflow.
2024-05-15 00:44:59 +08:00
Haojun Liao
610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao
9300b7a401 fix(tsdb): fix the length of column type overflow. 2024-05-14 16:22:11 +08:00
Haojun Liao
6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Minglei Jin
b6eec20dfb fix(s3/grant): checking grant when doing migrate 2024-05-14 11:01:06 +08:00
Shungang Li
694680600e fix: tsdbCache vartype of zero size 2024-05-14 09:23:32 +08:00
Haojun Liao
b7e7de0354 fix(stream): set the stream task load flag. 2024-05-13 16:45:38 +08:00
Haojun Liao
3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
kailixu
6f07e48826 Merge branch '3.0' into enh/TD-29968-3.0 2024-05-13 10:35:53 +08:00
dmchen
939183d3df fix/TD-29772 2024-05-13 01:56:49 +00:00
Haojun Liao
56a1e7e01f
Merge pull request #25727 from taosdata/fix/xftan/TD-29988-3.0
fix: build fails on macOS and Windows
2024-05-13 09:44:19 +08:00
kailixu
60e02eb3e6 Merge branch '3.0' into enh/TD-29968-3.0 2024-05-12 23:15:40 +08:00
kailixu
e3442474cf fix: grants for database encryption 2024-05-12 23:09:56 +08:00
dapan1121
05788d25b0
Merge pull request #25629 from taosdata/fix/TD-29893-3.0
fix:[TD-29893]avoid returning 0 if vnode init error
2024-05-12 18:07:08 +08:00
Shungang Li
c575d7a850 enh: grant check for dual-replica-ha 2024-05-11 18:32:04 +08:00
t_max
f030af3aab fix: build fails on macOS and Windows 2024-05-11 14:59:05 +08:00
Haojun Liao
d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
dmchen
9cf2529cac check grant first 2024-05-11 02:12:31 +00:00
Haojun Liao
7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Hongze Cheng
4d4fa9ea94
Merge pull request #25703 from taosdata/fix/TD-29912
fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit
2024-05-10 15:29:44 +08:00
Hongze Cheng
db68b9a1f0
Merge pull request #25707 from taosdata/fix/TD-29981
fix: refactor lastcache ser/des for compatibility
2024-05-10 09:15:29 +08:00
Shungang Li
0ac5d393e6 fix: tsdbcache last disk data format change 2024-05-09 23:37:28 +08:00
Shungang Li
544999c01b fix: tsdbCacheSerialize copy from null ptr 2024-05-09 22:55:29 +08:00
Shungang Li
457b98fee8 fix: adjust SValueV0 data order 2024-05-09 21:52:43 +08:00
Shungang Li
7ae4415890 fix: refactor lastcache ser/des for compatibility 2024-05-09 19:04:11 +08:00
Minglei Jin
41eb82c4de enh(s3/grant): disable s3 with expired grant 2024-05-09 15:19:50 +08:00
Shungang Li
6895bb121f fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit 2024-05-09 14:55:48 +08:00
dmchen
e5547eccbf encrypt grant 2024-05-09 02:44:38 +00:00
dmchen
454b4047cb fix/audit-memory-leak 2024-05-09 10:19:14 +08:00
Hongze Cheng
e76d15e33f
Merge pull request #25690 from taosdata/fix/TD-29962
enh: refactor tsdbCache ser/des
2024-05-09 09:04:09 +08:00
Shungang Li
70598a3038 enh: refactor tsdbCache ser/des 2024-05-09 00:13:19 +08:00
Hongze Cheng
9e21eacf26
Merge pull request #25687 from taosdata/fix/TD-29934-3.0
fix(tsdb/cache-update): compare when rocks's colVal not null
2024-05-08 21:48:01 +08:00
Minglei Jin
3d1612e44b fix(tsdb/cache-update): compare when rocks's colVal not null 2024-05-08 19:27:43 +08:00
Hongze Cheng
431c3c0066
Merge pull request #25675 from taosdata/fix/TD-29934-3.0
fix(tsdb/cache-update): discard none colVals for same timestamp
2024-05-08 18:54:17 +08:00
Minglei Jin
bb227a9798 fix(tsdb/cache-update): discard none colVals for same timestamp 2024-05-08 17:29:07 +08:00
Shungang Li
733c8f8f9a fix: (compatibility) SLastCol field change cause 'last' crash 2024-05-08 16:12:43 +08:00
yihaoDeng
697ca8914e enh compress 2024-06-22 11:35:47 +08:00
Haojun Liao
b26656fd1c
Merge pull request #25661 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 13:03:13 +08:00
Haojun Liao
64ae35affe fix(test): fix syntax error. 2024-05-08 09:18:36 +08:00
Haojun Liao
cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao
55a630911d
Merge pull request #25653 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-07 23:12:30 +08:00
Haojun Liao
b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Hongze Cheng
c4b2f5681c
Merge pull request #25654 from taosdata/fix/TD-29845
fix: fix last col version when updating rocks
2024-05-07 11:33:51 +08:00
Haojun Liao
0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Minglei Jin
562bf0fe1e tsdb/cache: fix last col version when updating rocks 2024-05-07 10:24:07 +08:00
Shungang Li
b979c584fb fix: tsdbCacheGetBatch ref of tmp memory 2024-05-07 10:22:58 +08:00
Hongze Cheng
3ffe2740e5
Merge pull request #25138 from taosdata/ENH/TD-29195-3.0
enh: add logging info for alter vnode hash range action
2024-05-07 09:02:32 +08:00
Haojun Liao
3b43b8f8c7
Merge pull request #25646 from taosdata/fix/3_liaohj
fix(stream): set global close flag in the streamMeta.
2024-05-06 22:19:23 +08:00
Haojun Liao
18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao
7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
wangmm0220
5f6d3fcf7e fix:[TD-29893]avoid returning 0 if vnode init error 2024-05-06 10:09:53 +08:00
Haojun Liao
44100139a4
Merge pull request #25614 from taosdata/fix/3_liaohj
fix(stream): close task if it's in checkdown stream procedure.
2024-05-01 08:06:59 +08:00
dapan1121
355db3a0a3
Merge pull request #25609 from taosdata/fix/TD-29869
fix:[TD-29869]use latest vg info when drop topic
2024-05-01 07:37:03 +08:00
Haojun Liao
cdc7b03ac6 fix(stream): fix syntax error. 2024-04-30 22:44:32 +08:00
Haojun Liao
732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao
94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao
629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao
f2bc93b78d
Merge pull request #25598 from taosdata/fix/3_liaohj
refactor(stream): opt stream sink perf.
2024-04-30 16:59:22 +08:00
dapan1121
f54dd2b818
Merge pull request #25602 from taosdata/fix/TS-4728-3.0
fix:use path of SStreamMeta
2024-04-30 16:12:50 +08:00
Haojun Liao
cb5a0563e6 fix(stream): fix error caused by merge. 2024-04-30 15:43:12 +08:00
wangmm0220
0758c4ece0 fix:[TD-29869]use latest vg info when drop topic 2024-04-30 15:38:09 +08:00
wangmm0220
35003cbb34 fix:use path of SStreamMeta 2024-04-30 14:36:16 +08:00
Haojun Liao
d73fd5492a fix(test): update test case. 2024-04-30 14:24:20 +08:00
Haojun Liao
4c27af9b13 refactor: do some internal refactor. 2024-04-30 13:25:39 +08:00
wangmm0220
3a1c210601 fix:use path of SStreamMeta 2024-04-30 11:06:03 +08:00
Hongze Cheng
09dcbdd352
Merge pull request #25593 from taosdata/opt/optTransfer30
opt transfer
2024-04-30 10:50:28 +08:00
Haojun Liao
d3e676b084 fix(cos): fix syntax error. 2024-04-30 10:14:32 +08:00
Haojun Liao
9c39d11ea0 other: add some logs for drop streams. 2024-04-30 09:55:56 +08:00
Haojun Liao
54e9522c62 refactor(stream): opt stream sink perf. 2024-04-30 09:41:29 +08:00
Haojun Liao
9ba8e6bd34 refactor: add logs for drop streams. 2024-04-30 09:26:06 +08:00
dapan1121
6187bf4e06
Merge pull request #25584 from taosdata/fix/TS-4728-3.0
fix:[TS-4728]transform store data if data is too big
2024-04-30 09:02:40 +08:00
wangmm0220
cd3f3046f7 fix:memory leak 2024-04-29 19:36:41 +08:00
Yihao Deng
f99cad9443 opt transfer 2024-04-29 11:30:38 +00:00
wangmm0220
1f85cb42e6 fix:[TS-4728]transform strore data if data is too big 2024-04-29 17:22:40 +08:00
Haojun Liao
ed73617cc3
Merge pull request #25575 from taosdata/fix/3_liaohj
fix(tsdb): set the correct start pos for binary search.
2024-04-29 16:48:01 +08:00
Haojun Liao
b0ef022e87 fix(tsdb): set the correct start pos for binary search. 2024-04-29 15:13:52 +08:00
Haojun Liao
7a5cdb81d5 fix(tsdb): set the correct start pos for binary search. 2024-04-29 14:40:49 +08:00
dapan1121
0997355460
Merge pull request #25560 from taosdata/tsma_tradeoff
usable tsma
2024-04-29 09:22:50 +08:00
wangjiaming0909
cb008f18dc usable tsma 2024-04-29 09:18:40 +08:00
dapan1121
df4421b0a2
Merge pull request #25542 from taosdata/fix/TD-29841
use debug log when fetching no tsmas for table
2024-04-29 08:26:12 +08:00
Haojun Liao
f115a33a94
Merge pull request #25538 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-04-28 23:21:52 +08:00
Haojun Liao
bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Hongze Cheng
13cd60f17f
Merge pull request #25524 from taosdata/feat/TD-29823
Feat/TD-29823
2024-04-28 17:51:39 +08:00
Hongze Cheng
0253aed220
Merge pull request #25522 from taosdata/enh/TD-29801-3.0
enh: batch create table
2024-04-28 17:16:23 +08:00
Haojun Liao
3c5ca17737 Merge branch '3.0' into fix/3_liaohj 2024-04-28 13:57:16 +08:00
kailixu
4eb1763b52 enh: batch create table 2024-04-28 13:52:17 +08:00
wangjiaming0909
88cc43250f use debug log when fetching no tsmas for table 2024-04-28 12:42:10 +08:00
Yihao Deng
d9c112244b profile opt 2024-04-28 03:48:00 +00:00
kailixu
4d572ebe88 enh: batch create table 2024-04-28 11:25:40 +08:00
kailixu
bc1f9bca93 enh: batch create table 2024-04-28 11:07:53 +08:00
kailixu
e392b39323 enh: batch create table 2024-04-28 10:24:16 +08:00
Haojun Liao
ed962186a1 enh(stream): add attrs for stream tasks. 2024-04-28 10:22:09 +08:00
Haojun Liao
b2d8260f14 refactor: do some internal refactor. 2024-04-28 10:05:22 +08:00
Haojun Liao
384efdc185
Merge pull request #25531 from taosdata/fix/3_liaohj
fix(stream):add ref for task in check rsp monitor timer.
2024-04-28 09:22:00 +08:00
kailixu
53e9e0b3af enh: batch create table 2024-04-28 04:58:05 +08:00
kailixu
3b504e6e96 enh: batch create table 2024-04-28 04:47:00 +08:00
kailixu
504263315d enh: batch create table 2024-04-28 04:37:30 +08:00
kailixu
0b5e35643c Merge branch '3.0' into enh/TD-29801-3.0 2024-04-28 04:27:25 +08:00
Haojun Liao
8e47adba09 fix(util): fix syntax error. 2024-04-27 17:46:23 +08:00
Haojun Liao
324072fed8
Merge pull request #25525 from taosdata/fix/3_liaohj
fix(stream): update stream task meta info.
2024-04-26 18:15:09 +08:00
Haojun Liao
6d06188b9f fix(stream): fix memory leak. 2024-04-26 17:06:15 +08:00
Haojun Liao
b1b3246066 fix(stream): update the checkpoint executed transId range. 2024-04-26 17:03:01 +08:00
Haojun Liao
5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Hongze Cheng
63a735a546
Merge pull request #25512 from taosdata/fix/TD-29713
fix: arb reduce duplicate updates
2024-04-26 16:33:04 +08:00
Yihao Deng
ac15015cb8 Add RpcNoDelayfp function to handle specific message types 2024-04-26 08:10:39 +00:00
Haojun Liao
8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
kailixu
55ec5f164c enh: batch create table 2024-04-26 15:09:53 +08:00
Hongze Cheng
efdc943a3d Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 14:57:58 +08:00
Haojun Liao
c565e31638
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
2024-04-26 12:44:00 +08:00
wangjiaming0909
ffea69ac5c remove forbid funcs 2024-04-26 12:14:43 +08:00
Shungang Li
21f508fe58 fix: arb reduce duplicate updates 2024-04-26 11:40:06 +08:00
Haojun Liao
815489d20a fix(tsdb): set the pk info when converting fileblockinfo to binrecord. 2024-04-26 11:10:20 +08:00
Haojun Liao
77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
Haojun Liao
feb176149e
Merge pull request #25507 from taosdata/fix/3_liaohj
fix(tsdb): overlap check take pk into consideration.
2024-04-26 09:06:38 +08:00
Hongze Cheng
f500762af7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 09:00:09 +08:00
Haojun Liao
59a3e8ca40 fix(tsdb): overlap check take pk into consideration. 2024-04-25 23:25:24 +08:00
Haojun Liao
b3d2ccec83
Merge pull request #25483 from taosdata/fix/3_liaohj
fix(query): add ts in cache_scan_operator if pk exists and only retri…
2024-04-25 22:32:26 +08:00
Haojun Liao
eef5e6e409 fix(stream): fix syntax error. 2024-04-25 18:30:33 +08:00
Haojun Liao
3b932599ab fix(stream): fix syntax error. 2024-04-25 17:47:03 +08:00
Minglei Jin
eaa1e7a775 tsdb/writer: use latest version of data for writing 2024-04-25 16:40:58 +08:00
Haojun Liao
cd8baa7ba0 fix(stream): add log for update task epset, set correct update flag if epset updated. 2024-04-25 16:39:11 +08:00
Minglei Jin
a9094d7602 fix(cos/multi-writing): use lasted version of data 2024-04-25 16:37:24 +08:00
Haojun Liao
c7806ebca2 fix(util): fix race condition. 2024-04-25 13:58:02 +08:00
Haojun Liao
740115e117
Merge pull request #25474 from taosdata/fix/TD-29749
fix(stream):opt bloom filter
2024-04-25 11:29:28 +08:00
Hongze Cheng
10d82a3acf
Merge pull request #25476 from taosdata/enh/TS-4710-3.0
enh: recover file
2024-04-25 11:15:02 +08:00
Hongze Cheng
ca9aebc5ff
Merge pull request #25473 from taosdata/fix/TD-29773
Fix/TD-29773
2024-04-25 09:45:47 +08:00
Haojun Liao
ac860f7fe8 fix(query): add ts in cache_scan_operator if pk exists and only retrieve ts column. 2024-04-25 09:29:42 +08:00
54liuyao
2a72ceadd1 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-04-24 18:57:22 +08:00
Haojun Liao
3b08ee3d16
Merge pull request #25458 from taosdata/fix/3_liaohj
fix(stream): add task update trans conflict level.
2024-04-24 18:54:06 +08:00
Hongze Cheng
c085efb4f8
Merge pull request #25456 from taosdata/FIX/TD-29704-3.0
fix: execute undo actions of TRN_EXEC_SERIAL trans sequentially
2024-04-24 18:09:56 +08:00
Hongze Cheng
2cac0d5691 enh: recover file 2024-04-24 18:04:10 +08:00
dapan1121
ab2c9aaf5b
Merge pull request #25466 from taosdata/enh/TD-29758
enh:[TD-29758]optimize log in tmq
2024-04-24 17:47:28 +08:00
54liuyao
3300bf04c1 opt bloom filter 2024-04-24 17:27:24 +08:00
Yihao Deng
1181f9de28 Fix metaGetColCmpr function and remove commented code 2024-04-24 08:22:54 +00:00
Hongze Cheng
b1fb14e49e
Merge pull request #25465 from taosdata/fix/TD-29759
fix(s3migrate/datas3): init fd of from & to early
2024-04-24 11:29:47 +08:00
Benguang Zhao
9f8e970a32 enh: set default errcode as action in progress in executing serial trans 2024-04-24 11:23:53 +08:00
Hongze Cheng
e47d17e826
Merge pull request #25451 from taosdata/enh/refactorCompress
refactor compress
2024-04-24 10:55:00 +08:00
Hongze Cheng
c3275dc61c
Merge pull request #25459 from taosdata/fix/TD-29750-3.0
fix: if not exists logic for topic/stream/table
2024-04-24 10:52:53 +08:00
Benguang Zhao
396c08e14a fix: execute undo actions of TRN_EXEC_SERIAL trans sequentially 2024-04-24 10:52:49 +08:00
Benguang Zhao
edcd1b87d8 refact: add mndTransExecuteActionsSerial 2024-04-24 10:52:49 +08:00
Hongze Cheng
0eae851257
Merge pull request #25425 from taosdata/fix/ci_monitor_memory
fix ci monitor memory
2024-04-24 10:35:04 +08:00
wangmm0220
20cedc3339 enh:[TD-29758]optimize log in tmq 2024-04-24 10:02:58 +08:00
Minglei Jin
c76f886c91 fix(s3migrate/datas3): init fd of from & to early 2024-04-24 09:36:44 +08:00
kailixu
c173be667c Merge branch '3.0' into fix/TD-29750-3.0 2024-04-24 08:44:43 +08:00
Haojun Liao
ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
Cary Xu
44b4580bd5
Update metaTable.c 2024-04-23 18:37:40 +08:00
Yihao Deng
7ddfe085f1 refactor code 2024-04-23 10:26:56 +00:00
kailixu
89ee62ac09 fix: if not exists logic for topic/stream/table 2024-04-23 18:19:16 +08:00
Haojun Liao
0f8ff48c6b fix(stream): fix double free 2024-04-23 18:18:01 +08:00
Haojun Liao
0c7373509e fix(stream): add task update trans conflict level. 2024-04-23 18:07:00 +08:00
Hongze Cheng
328f95f7cb fix: possible write block when error occurs 2024-04-23 16:48:49 +08:00
Benguang Zhao
10e9d79201 refact: rename STrans redoActionPos to actionPos 2024-04-23 16:44:05 +08:00
Haojun Liao
7fda9d9fcb Merge branch '3.0' into fix/3_liaohj 2024-04-23 15:08:43 +08:00
Haojun Liao
b0f68a9147 refactor: do some internal refactor. 2024-04-23 14:58:51 +08:00
Haojun Liao
1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
dapan1121
07e01b3e97
Merge pull request #25386 from taosdata/fix/3.0/TD-29631
fix cancel create tsma memory use after free
2024-04-23 13:17:55 +08:00
Haojun Liao
d7a08909dd
Merge pull request #25442 from taosdata/fix/3_liaohj
fix(stream): save the epset if task epset updated.
2024-04-23 09:10:45 +08:00
Haojun Liao
315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00
Haojun Liao
ada1c6d4c0
Merge pull request #25434 from taosdata/fix/3_liaohj
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
2024-04-22 22:13:19 +08:00
Haojun Liao
a8fac441be fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure. 2024-04-22 14:02:31 +08:00
wangjiaming0909
2c0624a8ae fix create tsma transaction 2024-04-22 13:21:32 +08:00
Yihao Deng
541b070765 Remove commented out code in metaCreateSTable function 2024-04-20 07:45:39 +00:00
Yihao Deng
ba30339d4e Refactor meteDecodeColCmprEntry function to return -1 on error 2024-04-20 03:07:12 +00:00
Yihao Deng
517365467d Merge branch '3.0' into fix/compatibleWithVeryOldMeta 2024-04-20 01:54:02 +00:00
Haojun Liao
e5dddc4abf Merge branch '3.0' into fix/3_liaohj 2024-04-19 19:13:28 +08:00
Haojun Liao
ea527b19b8 fix(stream): set correct start version if no checkpoint exist. 2024-04-19 19:12:23 +08:00
dmchen
62bc1074c0 fix monitor memory 2024-04-19 10:44:08 +00:00
dapan1121
a46b7cca3d
Merge pull request #25413 from taosdata/feat/TS-4243-tmq
opti:raw data from tmq
2024-04-19 18:22:21 +08:00
Yihao Deng
18cdeaf960 compatible with older meta 2024-04-19 07:37:43 +00:00
Hongze Cheng
69222543a2
Merge pull request #25401 from taosdata/fix/TD-29562
Fix/td 29562
2024-04-19 13:57:19 +08:00
wangmm0220
1695824c73 fix:merge from 3.0 2024-04-19 13:52:57 +08:00
wangmm0220
42467c0e00 opti:raw data from tmq 2024-04-19 13:48:17 +08:00
Hongze Cheng
fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
2024-04-19 13:34:37 +08:00
Haojun Liao
62260bff79
Merge pull request #25389 from taosdata/fix/3_liaohj
fix(stream): reset checkpoint info after receiving task-reset info.
2024-04-19 11:23:55 +08:00
Hongze Cheng
e4e00c8953
Merge pull request #25403 from taosdata/fix/TD-29621
fix: geometry crash in stream & tmq
2024-04-19 11:15:26 +08:00
kailixu
a044308150 enh: error code optimization for encryption key 2024-04-19 10:36:09 +08:00
Yihao Deng
2314771209 fix TD-29562 2024-04-19 02:09:40 +00:00
Yihao Deng
ee8a96fb42 fix TD-29562 2024-04-19 02:04:32 +00:00
Haojun Liao
34f7dc4782
Merge pull request #25404 from taosdata/feat/TS-4243-3.0
fix(tsdb): set correct compare func for merge tree.
2024-04-19 09:10:03 +08:00
Haojun Liao
eb1fed177f fix(tsdb): set correct compare func for merge tree. 2024-04-19 00:32:41 +08:00
Haojun Liao
525b574c85
Merge pull request #25402 from taosdata/feat/TS-4243-3.0
fix(tsdb): update the initial value of pk for varchar type.
2024-04-18 19:49:05 +08:00
Shungang Li
f3438ce04e fix: geometry crash in stream & tmq 2024-04-18 19:27:02 +08:00
Haojun Liao
815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao
4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Hongze Cheng
05d853bd9e
Merge pull request #25383 from taosdata/fix/dropStreamData
Fix/drop stream data
2024-04-18 17:10:57 +08:00
Hongze Cheng
874b4b1911
Merge pull request #25400 from taosdata/enh/TD-28945-pk
fix(vnode): encode the missing tsdbPageSize
2024-04-18 17:04:29 +08:00
Haojun Liao
8962010caf other: merge 3.0 2024-04-18 16:31:15 +08:00
Haojun Liao
c94c9a900c fix(tsdb): update the initial value of pk for varchar type. 2024-04-18 16:17:29 +08:00
Yihao Deng
d21341c943 fix TD-29562 2024-04-18 08:16:40 +00:00
kailixu
20c4385d27 Merge branch '3.0' into feat/TD-24834 2024-04-18 15:54:01 +08:00
Yihao Deng
3f4fa8b74e fix TD-29562 2024-04-18 07:03:18 +00:00
Minglei Jin
eb51a7c5b5 vnode: encode the missing tsdbPageSize 2024-04-18 14:48:05 +08:00
Hongze Cheng
a4edab720c
Merge pull request #25391 from taosdata/enh/TD-28945-pk
cos/multi-writing: init fid & cid for s3 page cache
2024-04-18 14:05:28 +08:00
Haojun Liao
deee0c3793 refactor: do some internal refactor. 2024-04-18 13:05:45 +08:00
Haojun Liao
d5d23b0434 fix(tsdb): set reader status normal once successful taking snapshot. 2024-04-18 13:05:44 +08:00
Minglei Jin
8ca2b08d5c cos/multi-writing: fix remove_file with -1 lcn 2024-04-18 08:48:44 +08:00
Haojun Liao
9056a48efd refactor: do some internal refactor. 2024-04-17 21:58:02 +08:00
Haojun Liao
ac84a5f82b refactor: do some internal refactor. 2024-04-17 21:57:09 +08:00
Minglei Jin
7034cbee22 cos/multi-writing: init fid & cid for s3 page cache 2024-04-17 19:48:50 +08:00
Haojun Liao
ddf98ae0c2 refactor: do some internal refactor. 2024-04-17 18:04:02 +08:00
Haojun Liao
289ec6cf66 fix(stream): reset checkpoint info after receiving task-reset info. 2024-04-17 17:57:12 +08:00
dm chen
1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
kailixu
3bad06b76f enh: error log optimization for invalid dnode cfg 2024-04-17 16:59:43 +08:00
Hongze Cheng
a34b644640
Merge pull request #25366 from taosdata/feat/compress_3.0
Feat/compress 3.0
2024-04-17 16:15:26 +08:00
kailixu
384e650882 enh: show encryptions 2024-04-17 14:41:47 +08:00
Yihao Deng
354f33fa88 drop stream data 2024-04-17 05:38:45 +00:00
Yihao Deng
74b7bf6bbc drop stream data 2024-04-17 05:37:35 +00:00
Haojun Liao
2ce7d18e94 refactor: do some internal refactor. 2024-04-17 11:35:03 +08:00
Haojun Liao
69cb630e7f fix(tsdb): update the compare func. 2024-04-17 11:32:48 +08:00
Yihao Deng
04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
kailixu
74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
dapan1121
5936d3a1b0
Merge pull request #25300 from taosdata/draft/tsma_before_ci
feat: support tsma
2024-04-17 10:00:17 +08:00
Haojun Liao
a439f61708
Merge pull request #25375 from taosdata/fix/3_liaohj
fix(stream): generate the checkpoint id
2024-04-16 19:41:07 +08:00
wangjiaming0909
fb72e29fe1 fix stream progress delay 2024-04-16 18:17:33 +08:00
Yihao Deng
6f9de676f0 Merge branch 'fix/compress_3.0' into feat/compress_3.0 2024-04-16 09:27:26 +00:00
Haojun Liao
5ae8b68b17 fix(stream): fix deadlock. 2024-04-16 15:37:51 +08:00
Haojun Liao
8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
wangjiaming0909
92e91c2032 fix ci 2024-04-16 14:27:06 +08:00
wangjiaming0909
1978a06e6e merge with 3.0 2024-04-16 14:27:06 +08:00
wangjiaming0909
039939196a forbid tsma agg funcs with tag columns 2024-04-16 14:25:34 +08:00
wangjiaming0909
1b37ef03fb fix duplicate tsma funcs 2024-04-16 14:25:34 +08:00
wangjiaming0909
97498e1844 fix create tsma txn and fix fetch wrong stream progress 2024-04-16 14:25:34 +08:00
wangjiaming0909
de1c28d623 tsma avoid fetching tsma for no tsma tables 2024-04-16 14:25:34 +08:00
wangjiaming0909
f6200dd923 support long ctb names 2024-04-16 14:25:34 +08:00
wangjiaming0909
6ce0616ffd fix ci and TODOs 2024-04-16 14:25:34 +08:00
wangjiaming0909
e43580f71b fix ci 2024-04-16 14:25:20 +08:00
wangjiaming0909
2b594e02d2 fix tsma name too long 2024-04-16 14:25:20 +08:00
wangjiaming0909
7de0a34ae6 support maxTsmaCalcDelay, maxTsmaNum, skip_tsma 2024-04-16 14:25:01 +08:00
wangjiaming0909
3566cac206 add max tsma num opt 2024-04-16 14:23:26 +08:00
wangjiaming0909
a2cbbba24d find TODO 2024-04-16 14:23:26 +08:00
wangjiaming0909
d1101a0325 support filter out tsma res tbs when show stables/tables 2024-04-16 14:23:26 +08:00
wangjiaming0909
a8e00f7410 drop tb in transaction 2024-04-16 14:23:26 +08:00
wangjiaming0909
3d77e8432d support rm ttl tb 2024-04-16 14:23:26 +08:00
wangjiaming0909
1ef153de63 support drop ctb for tsma 2024-04-16 14:23:25 +08:00
wangjiaming0909
1a06dd684e support drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909
94f2f6ae22 fix drop ctb 2024-04-16 14:23:25 +08:00
wangjiaming0909
98ca847eb8 add tests 2024-04-16 14:18:11 +08:00
wangjiaming0909
a75c67efc8 rebase with stream sub table name no group id 2024-04-16 14:18:10 +08:00
wangjiaming0909
c3e73d9168 fix recursive tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909
d8200b2f63 fetch lastts vnode version before create tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909
8e56d9a359 fix tsmas 2024-04-16 14:18:10 +08:00
wangjiaming0909
e947a2fb0d catalog cache get stream progress 2024-04-16 14:18:10 +08:00
wangjiaming0909
a4d2dfed67 stream supported api 2024-04-16 14:18:10 +08:00
wangjiaming0909
6e7dc4b7b4 normal table tsma and add tests 2024-04-16 14:17:12 +08:00
wangjiaming0909
70ca830378 support recursive tsma creation 2024-04-16 14:17:12 +08:00
Haojun Liao
810eb22eb2 fix(stream): generate the checkpoint id after checking the max checkpoint id from vnode. 2024-04-16 14:15:18 +08:00
wangjiaming0909
a438a77e78 rewrite tbname for partition by tbname 2024-04-16 14:14:40 +08:00
wangjiaming0909
895a4584e6 generate tsma plan 2024-04-16 14:14:39 +08:00
wangjiaming0909
4b6fb0ffc6 tsma optimization 2024-04-16 14:14:39 +08:00
wangjiaming0909
0fd66d7e8a tsma optimization 2024-04-16 14:14:39 +08:00
wangjiaming0909
ef47fd57d6 support tsma catalog cache 2024-04-16 14:14:34 +08:00
wangjiaming0909
f77cd43d26 ins_tsmas 2024-04-16 14:13:10 +08:00
wangjiaming0909
08fc9170f5 refine 2024-04-16 14:13:10 +08:00
wangjiaming0909
6324d1293a drop tsma 2024-04-16 14:13:10 +08:00
wangjiaming0909
8e2977d083 create tsma request 2024-04-16 14:13:10 +08:00
wangjiaming0909
5589cf0309 server handle tsma creation 2024-04-16 14:13:10 +08:00
Haojun Liao
e0cb17211b
Merge pull request #25358 from taosdata/feat/TS-4243-3.0
fix: extracted data block shall initialize pks of datablock info
2024-04-16 13:30:48 +08:00
dmchen
b2bc5d4df1 fix/TD-29612 2024-04-16 03:37:41 +00:00
dm chen
aedec5ead7
Merge branch '3.0' into feat/TD-24834 2024-04-16 11:35:49 +08:00
Hongze Cheng
ace8f30bdf
Merge pull request #25361 from taosdata/fix/TD-29560-3.0
fix: drop table after commit
2024-04-16 11:15:29 +08:00
Haojun Liao
51dfa20cf4 fix(tsdb): set correct initial value for compare. 2024-04-16 10:13:15 +08:00
kailixu
91215d7cc0 enh: code optimization 2024-04-16 09:10:21 +08:00
kailixu
8ea9c8b879 enh: code optimization 2024-04-16 09:04:33 +08:00
kailixu
a6fe9a861f sdb release for dnode 2024-04-16 08:34:41 +08:00
Haojun Liao
ee62b66b07 Merge branch 'enh/TD-28945-pk' into fix/3_liaohj 2024-04-15 19:15:39 +08:00
Haojun Liao
13bd296d58 Merge branch '3.0' into fix/3_liaohj 2024-04-15 18:53:48 +08:00
Haojun Liao
d92f0706e7 fix(tsdb): check the boundary value when reseting range. 2024-04-15 18:43:58 +08:00
Haojun Liao
1ac192c069 fix(stream): keep the original tsdb scan version range. 2024-04-15 18:41:38 +08:00
Haojun Liao
87dfc1f931 fix(stream):fix error in unit test cases. 2024-04-15 18:40:51 +08:00
Yihao Deng
ce137d3084 Merge branch 'enh/TD-28945-pk' into feat/compress_3.0 2024-04-15 10:36:13 +00:00
Minglei Jin
9cce9c221d cos/multi-write: empty impl for tsdb async compact 2024-04-15 18:32:06 +08:00
Hongze Cheng
29194df1ec Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-29560-3.0 2024-04-15 18:26:21 +08:00
Hongze Cheng
b936969a01 more fix 2024-04-15 18:25:23 +08:00
Yihao Deng
a7722fbf3c Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:33:15 +00:00
Yihao Deng
ea9385912f Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:06:30 +00:00
kailixu
4862a18d44 Merge branch 'feat/TD-24834' of https://github.com/taosdata/TDengine into feat/TD-24834 2024-04-15 16:29:59 +08:00
kailixu
545519bc3d enh: default encrypt algorightm for db 2024-04-15 16:29:49 +08:00
dmchen
9a99b8526d resolve conflict 2024-04-15 08:24:40 +00:00
kailixu
123090e18a fix: solve conflicts 2024-04-15 16:12:15 +08:00
Hongze Cheng
ac2853f28c fix: drop table after commit 2024-04-15 15:36:54 +08:00
dmchen
a6c36a6cf3 resolve conflict 2024-04-15 07:36:41 +00:00
dm chen
4d660d89c0
Merge branch '3.0' into feat/TD-24834 2024-04-15 15:12:32 +08:00
Haojun Liao
665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
dmchen
0526618fe5 resolve conflict 2024-04-15 03:45:37 +00:00
yihaoDeng
4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00
dmchen
c2c1a41af5 revert tmp ci 2024-04-15 02:21:11 +00:00
Minglei Jin
4b3e3f9091 Merge branch '3.0' into enh/TD-28945-pk 2024-04-15 09:31:56 +08:00
Minglei Jin
e14d4e172d cos/multi-writing: fix remove with different version 2024-04-15 09:30:24 +08:00
Haojun Liao
15c18af221 fix(stream): fix init error. 2024-04-13 18:27:38 +08:00
Haojun Liao
46fd0cb0b5 fix(tsdb): set correct initial value 2024-04-12 23:32:47 +08:00
Haojun Liao
27af9de628 fix(tsdb):add placeholder if no rowkeys exist. 2024-04-12 22:16:48 +08:00
Haojun Liao
528497944c fix(tsdb): update log. 2024-04-12 19:03:03 +08:00
Haojun Liao
df4dd2ec93 fix(tsdb): update log. 2024-04-12 18:57:27 +08:00
Haojun Liao
ffe5bb4024 fix(tsdb): update log. 2024-04-12 18:46:39 +08:00
Haojun Liao
6d1c07e3a5 fix(tsdb): fix syntax error. 2024-04-12 18:39:29 +08:00
Haojun Liao
2b6f02f894 fix(tsdb): add some logs. 2024-04-12 18:37:03 +08:00
Haojun Liao
04227904ea fix(tsdb): adjust assert. 2024-04-12 18:30:02 +08:00
Haojun Liao
0656ba1bf2 fix(tsdb):add assert 2024-04-12 18:16:59 +08:00
Haojun Liao
f398e5b5e5 fix(tsdb): update code. 2024-04-12 18:05:21 +08:00
Haojun Liao
cf30db8795 fix(tsdb): fix invalid empty time window check. 2024-04-12 17:52:52 +08:00
Haojun Liao
6127185e3b fix(tsdb): set correct initial value for compare. 2024-04-12 14:10:43 +08:00
Haojun Liao
2b953735bc Merge remote-tracking branch 'origin/feat/TS-4243-3.0' into feat/TS-4243-3.0 2024-04-12 13:51:43 +08:00
Haojun Liao
1e89b86827 refactor: do some internal refactor. 2024-04-12 13:51:29 +08:00
yihaoDeng
e3acb10acd Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-12 11:10:00 +08:00
Minglei Jin
16b65b7311 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-12 10:32:25 +08:00
Haojun Liao
d799212fb2 refactor: do some internal refactor. 2024-04-12 10:02:18 +08:00
wangmm0220
ca8153fb98 fix:filter data error & add test case 2024-04-12 09:49:08 +08:00
Haojun Liao
efdd0c8a2a refactor: do some internal refactor. 2024-04-11 22:34:47 +08:00
Haojun Liao
5ee40fb5c9 fix(tsdb): fix invalid free 2024-04-11 18:38:17 +08:00
wangmm0220
035b61218c fix:filter data error & add test case 2024-04-11 18:01:27 +08:00
Haojun Liao
14242331b9 fix(tsdb): fix error in decode key. 2024-04-11 17:25:58 +08:00
wangmm0220
2478519c5d Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-11 17:16:16 +08:00
Haojun Liao
b4ea80b637 fix(tsdb): prepare the pk buf for blocks generated by reader. 2024-04-11 17:09:07 +08:00
Minglei Jin
356f668542 mnd: fix s3_chunksize & s3_keeplocal if zero 2024-04-11 16:26:39 +08:00
wangmm0220
f609a45dd2 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-11 16:21:14 +08:00
wangmm0220
14531fbf7b fix:filter data error & add test case 2024-04-11 16:20:28 +08:00
Minglei Jin
6515d74fa2 Merge branch '3.0' into enh/TD-28945-pk 2024-04-11 16:02:01 +08:00
Minglei Jin
69a7db50b0 mnd: fix s3_keeplocal's format 2024-04-11 15:40:36 +08:00
54liuyao
1d42e927c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-04-11 15:35:42 +08:00
Haojun Liao
a3bbf3ba0e fix(tsdb): check numOfPks before load pk 2024-04-11 15:16:21 +08:00
Haojun Liao
1751b84188 Merge remote-tracking branch 'origin/feat/TS-4243-3.0' into feat/TS-4243-3.0 2024-04-11 14:32:18 +08:00
Haojun Liao
312f7864c8 refactor: do some internal refactor. 2024-04-11 14:32:17 +08:00
kailixu
e0f7b14ffa fix: eliminate double free 2024-04-11 11:41:05 +08:00
Haojun Liao
563efeb560 fix(tsdb): fix memory leak. 2024-04-11 11:09:57 +08:00
kailixu
3738ce9e10 chore: solve conflicts of sql.c 2024-04-11 11:05:58 +08:00
dmchen
f1d7d79c24 tdb break, try revert 2024-04-11 03:01:05 +00:00
Minglei Jin
3d733370f0 mnd: fix mnode dump db info with arb 2024-04-11 10:48:54 +08:00
Haojun Liao
1f85a47cab fix(tsdb): fix memory leak. 2024-04-11 10:47:05 +08:00
Haojun Liao
9f95360ecc fix(tsdb): fix error in read rowkey with null. 2024-04-11 10:14:15 +08:00
Haojun Liao
79be7eea8c fix(tsdb): fix invalid read, and do some internal refactor. 2024-04-11 10:06:07 +08:00
Haojun Liao
fabb986aa8 fix(stream): fix stack overflow, caused by print epset. 2024-04-10 19:54:33 +08:00
Haojun Liao
e261023ee6 fix(stream): add lock, and fix race condition. 2024-04-10 18:42:44 +08:00
Haojun Liao
f0beceb5eb fix(tsdb): check for the duplicated ts in delete-skyline. 2024-04-10 18:32:08 +08:00
Haojun Liao
9811a9e216 fix(tsdb): deep copy the pk for varchar type. 2024-04-10 18:06:58 +08:00
dmchen
8875311f23 remove log output 2024-04-10 09:04:53 +00:00
yihaoDeng
a02426fd2f Merge branch '3.0' into feature/compressData 2024-04-10 09:03:50 +00:00
dmchen
e68ae8f756 tdb break, try remove 2024-04-10 08:54:01 +00:00
Haojun Liao
ded66fc4e5 Merge branch 'feat/TS-4243-3.0' of github.com:taosdata/tdengine into feat/TS-4243-3.0 2024-04-10 16:43:54 +08:00
Haojun Liao
f23a8a37bc refactor: do some internal refactor. 2024-04-10 16:43:02 +08:00
wangmm0220
539d1f441f Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-10 16:41:15 +08:00
wangmm0220
d3fa85b7bd fix:make log different to locate the cause 2024-04-10 16:40:12 +08:00
Minglei Jin
0761692b14 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-10 16:30:06 +08:00
Hongze Cheng
1bcf693f07 more code 2024-04-10 15:06:43 +08:00
Minglei Jin
fe12f87c58 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-10 11:21:50 +08:00
Minglei Jin
dcd9901d5f Merge branch '3.0' into feat/TS-4243-3.0 2024-04-10 11:18:19 +08:00
Haojun Liao
980382d433 fix(tsdb): fix memory error. 2024-04-10 11:18:08 +08:00
Minglei Jin
d1cb05bba0 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-10 09:09:51 +08:00
Hongze Cheng
5c15779781
Merge pull request #25298 from taosdata/fix/TD-29480
fix: arb reply to set-assigned no matter what error
2024-04-10 09:03:13 +08:00
Minglei Jin
6eb014e32b Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-09 19:11:46 +08:00
Haojun Liao
881ae3e040
Merge pull request #25310 from taosdata/fix/3_liaohj
fix(stream): add dropped stream task check.
2024-04-09 19:09:57 +08:00
Shungang Li
b664e2078b fix: last memory errors 2024-04-09 18:33:33 +08:00
Haojun Liao
22b0067819 fix(stream): add dropped stream task check. 2024-04-09 17:58:03 +08:00
Shungang Li
dd55034c94 fix: pk last write error 2024-04-09 17:43:10 +08:00
dmchen
17907ff8b9 tmp ci 2024-04-09 08:33:38 +00:00
dmchen
5f31575624 refactor 2024-04-09 06:55:01 +00:00
Haojun Liao
87b04c4eea fix(stream): add null check. 2024-04-09 14:52:51 +08:00
wangmm0220
da6eda6912 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-09 13:44:09 +08:00
dmchen
239acea831 remove useless vnode cfg 2024-04-09 02:38:45 +00:00
Haojun Liao
df516703e1 fix(stream): check the pk during merge rows with identical timestamp. 2024-04-09 10:22:13 +08:00
dapan1121
a3abc775ea
Merge pull request #25295 from taosdata/mark/3.0
fix:send data to large in tmq if subscribe stable
2024-04-09 10:10:03 +08:00
Minglei Jin
4d08390d56 cos/multi-writing: fix chunsize's default value setting 2024-04-09 10:06:34 +08:00
54liuyao
9ed74085d8 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-09 09:16:57 +08:00
Shungang Li
16e0fc44e2 fix: arb reply to set-assigned no matter what error 2024-04-08 19:56:22 +08:00
wangmm0220
ccc3491cdd fix:send data to large in tmq if subscribe stable 2024-04-08 18:39:35 +08:00
54liuyao
53265e9e09 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-08 17:24:09 +08:00
Haojun Liao
ee7d25602e fix(tsdb): fix error in retrieve varchar pk. 2024-04-08 15:40:52 +08:00
dmchen
e80d6c810b key len check 2024-04-08 07:07:19 +00:00
Haojun Liao
33b1391b9a fix(cache): fix memory leak, and update some test cases. 2024-04-08 11:33:26 +08:00
Minglei Jin
23d0037c03 cos/multi-write: fix var name from pCfg to pNewCfg 2024-04-08 11:02:28 +08:00
Minglei Jin
a407f76165 Merge branch '3.0' into enh/TD-28945 2024-04-08 10:55:47 +08:00
Haojun Liao
e3b246a1e9 Merge remote-tracking branch 'origin/feat/TS-4243-3.0' into feat/TS-4243-3.0 2024-04-08 10:44:26 +08:00
Haojun Liao
97f7e67234 fix(tsdb): set correct merge row. 2024-04-08 10:44:10 +08:00
Minglei Jin
d5e9169769 cos/multi-write: dnode part including mnode/vnode/tsdb 2024-04-08 10:31:49 +08:00
54liuyao
3b00729cf0 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-08 09:10:34 +08:00
Shungang Li
bc1c7545a8 mock commit for pk last read, need to revert 2024-04-07 17:31:06 +08:00
Shungang Li
b649a73a19 feat: pk insert/drop last cache 2024-04-07 17:30:54 +08:00
Benguang Zhao
2fa55f04e1 enh: check validity of commit actions of trans 2024-04-07 15:26:21 +08:00
Benguang Zhao
ccc7a0bf08 enh: skip trans context switch in error logging 2024-04-07 15:26:20 +08:00
Benguang Zhao
ac6846d76c enh: check validity of parallel actions of trans 2024-04-07 15:26:18 +08:00
kailixu
b4c8375cb9 chore: solve conflicts 2024-04-07 14:53:05 +08:00
Haojun Liao
16c17bbf72 fix(tsdb): fix error in tsdbread. 2024-04-07 14:46:22 +08:00
54liuyao
7f8f342c8a Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-07 11:04:31 +08:00
kailixu
91cefc3c60 chore: restore code change 2024-04-07 10:34:25 +08:00
dmchen
c43e937538 write config lock 2024-04-07 02:24:41 +00:00
Haojun Liao
ead77fe767 fix(tsdb): fix memory leak. 2024-04-07 10:23:51 +08:00
54liuyao
1240a4eb77 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-07 09:37:09 +08:00
Haojun Liao
e7ed8fbaa6 fix(tsdb): not copy range key if no pk exists. 2024-04-06 00:10:24 +08:00
Haojun Liao
dc954e112e fix(tsdb): add key for lastProcessKey, and remove invalid assign for key 2024-04-05 19:47:59 +08:00
Hongze Cheng
5440471e07
Merge pull request #25257 from taosdata/ENH/TS-4595-3.0
enh: not to touch meta data during balance vgroup leader
2024-04-03 18:50:23 +08:00
Haojun Liao
a3bcd9e9c9
Merge pull request #25246 from taosdata/fix/3_liaohj
fix(stream): add lock for when set checkpoint dispatch msg.
2024-04-03 12:42:29 +08:00
54liuyao
537395e845 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-03 09:54:10 +08:00
Haojun Liao
5184e444df Merge branch '3.0' into fix/3_liaohj 2024-04-02 18:45:49 +08:00
Haojun Liao
24559725da fix(stream): add lock for when set checkpoint dispatch msg. 2024-04-02 18:45:30 +08:00
yihaoDeng
a7058668d5 fix compatible error 2024-04-02 10:41:38 +00:00
Benguang Zhao
018d388278 enh: not to write confirm after balance vgroup leader 2024-04-02 18:20:26 +08:00
Hongze Cheng
6c886d1e4a
Merge pull request #25160 from taosdata/ENH/TS-4595-3.0
enh: support changeless transaction of tasks
2024-04-02 16:45:35 +08:00
Haojun Liao
94e6f96a75 other: merge 3.0 2024-04-02 13:39:26 +08:00
yihaoDeng
684055bc7c Merge branch '3.0' into feature/compressData 2024-04-02 04:20:39 +00:00
yihaoDeng
d85ae3c26e fix invalid free 2024-04-02 12:14:02 +08:00
Haojun Liao
aff681ac64 fix(tsdb):set correct varchar type compare function. 2024-04-02 10:43:38 +08:00
dmchen
d06bfd9cea free and log 2024-04-02 02:30:56 +00:00
dapan1121
eb50334baf
Merge pull request #25234 from taosdata/fix/TD-28032
fix:cases error
2024-04-02 10:17:04 +08:00
54liuyao
204c5acefe Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-02 09:10:52 +08:00
yihaoDeng
cb27761e66 Merge branch '3.0' into feature/compressData 2024-04-01 13:14:37 +00:00
Hongze Cheng
c28ee64477 fix: meta snapshot drop table error 2024-04-01 21:11:35 +08:00
wangmm0220
174b0a104e fix:case error 2024-04-01 19:59:30 +08:00
yihaoDeng
ec35f5718e fix invalid free 2024-04-01 19:58:04 +08:00
dmchen
463a5da0d9 checksum len 2024-04-01 09:50:42 +00:00
dmchen
a1b7444a48 refactor 2024-04-01 09:39:29 +00:00
dmchen
0a4556984c merge 2024-04-01 09:19:29 +00:00
yihaoDeng
a77d98cab6 Merge branch '3.0' into feature/compressData 2024-04-01 08:40:50 +00:00
kailixu
c4aba0ac37 feat: encryption key optimize and test case adjust 2024-04-01 16:14:55 +08:00
yihaoDeng
53ecfe511a Merge branch '3.0' into feature/compressData 2024-04-01 08:04:16 +00:00
Haojun Liao
c6294200ea
Merge pull request #25211 from taosdata/fix/TD-28032
fix:same subtable same partition by leads to same table name in stream
2024-04-01 15:49:47 +08:00
kailixu
717c4b3d9c chore: restore codes 2024-04-01 14:01:09 +08:00
kailixu
6eaa99bb2d feat: encryption algorithm 2024-04-01 13:58:13 +08:00
yihaoDeng
237ec5a46c fix ci error 2024-04-01 01:39:50 +00:00
wangmm0220
fe7a42b118 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-01 09:11:39 +08:00
54liuyao
1405b30677 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-04-01 09:09:48 +08:00
kailixu
9e4d692d6b feat: support encryption 2024-04-01 00:49:25 +08:00
yihaoDeng
17b2310df3 fix ci error 2024-03-31 13:57:18 +00:00
yihaoDeng
22f9830bbb fix ci error 2024-03-31 12:51:27 +00:00
yihaoDeng
9e11fe45a9 fix ci error 2024-03-31 00:08:23 +00:00
yihaoDeng
e71eefddfc Merge branch 'feat/TS-4243-3.0' into feature/compressData 2024-03-30 14:58:29 +00:00
yihaoDeng
cad8fec42e Merge branch '3.0' into feature/compressData 2024-03-30 13:59:45 +00:00
yihaoDeng
aa5ccf2b0b Merge branch '3.0' into feature/compressData 2024-03-30 09:57:23 +00:00
yihaoDeng
0cce8df6b5 Merge branch '3.0' into feature/compressData 2024-03-30 02:00:24 +00:00
yihaoDeng
d7cee5dd80 fix invalid compress/decompress 2024-03-29 13:48:58 +00:00
Haojun Liao
dd2f6287ec fix(tsdb): fix rowkey assign error. 2024-03-29 18:59:29 +08:00
Haojun Liao
55bb6ab341 fix(tsdb): set correct initial value for compare 2024-03-29 18:15:03 +08:00
yihaoDeng
b7067e61c8 fix ci error 2024-03-29 08:40:19 +00:00
dmchen
d6ae4d37cc add function for sql 2024-03-29 06:19:44 +00:00
kailixu
8dce61b68f chore: merge TD-29280-3.0 2024-03-29 11:39:46 +08:00
kailixu
9d59fb53f4 feat: support create encrypt key 2024-03-29 11:37:40 +08:00
dmchen
b9deb71fc5 basic function 2024-03-29 02:48:49 +00:00
factosea
9ddc0b51cb merge 2024-03-29 10:37:59 +08:00
kailixu
f99d193335 feat: user config dnode procedure 2024-03-29 10:25:19 +08:00
kailixu
4e54dc09c5 enh: dnode online judgement 2024-03-28 16:59:00 +08:00
kailixu
a3398f791e enh: dnodes status optimization 2024-03-28 16:17:35 +08:00
wangmm0220
8e2a2414c0 fix:same subtable same partition by leads to same table name in stream 2024-03-28 13:48:46 +08:00
54liuyao
3dd7f0731e Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-28 09:11:36 +08:00
kailixu
64e32e5c85 chore: merge 3.0 2024-03-28 08:23:43 +08:00
kailixu
d64594932b feat: support database encryption 2024-03-27 20:03:38 +08:00
wangmm0220
4722f8be87 fix:write schema error if schema ver is 1 more than origin version 2024-03-27 15:17:49 +08:00
Haojun Liao
a2112625f9 fix(tsdb): set correct uid list. 2024-03-27 15:06:51 +08:00
wangmm0220
f4fed29739 fix:write schema error if schema ver is 1 more than origin version 2024-03-27 15:04:37 +08:00
Haojun Liao
0bfd606e5c
Merge pull request #25193 from taosdata/fix/3_liaohj
fix(stream): acquire the stream task in exec buffer if not in mnode store.
2024-03-27 13:17:14 +08:00
54liuyao
715489e22d Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-27 09:14:50 +08:00
Haojun Liao
e776cde461 fix(stream):fix unrelease stream obj. 2024-03-27 09:02:21 +08:00
Haojun Liao
f3c306d582 fix(stream): add some comments. 2024-03-26 23:28:20 +08:00
Haojun Liao
3c7fe5fd01 fix(stream): check null ptr. 2024-03-26 23:27:38 +08:00
yihaoDeng
18986c0ced refactor code 2024-03-26 12:44:53 +00:00
kailixu
374ef4593c feat: encryptions/encrypt_key grammar 2024-03-26 19:56:15 +08:00
Haojun Liao
46280bfee9 fix(stream): add some comments. 2024-03-26 19:40:47 +08:00
Haojun Liao
530e0133b9 fix(stream): acquire the stream task in exec buffer if not in mnode store. 2024-03-26 19:39:58 +08:00
Haojun Liao
f61596706d fix(tsdb): add attributes for cache scan optr. 2024-03-26 17:34:30 +08:00
yihaoDeng
02e0e45183 refactor code 2024-03-26 08:50:21 +00:00
54liuyao
135bdb37a0 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-26 16:38:51 +08:00
Hongze Cheng
ee4dda56c1 more code 2024-03-26 14:43:28 +08:00
yihaoDeng
ab69c2e750 refactor code 2024-03-26 03:28:31 +00:00
Haojun Liao
52a04cd008 fix(tsdb): fix bug for filter brin record. 2024-03-26 10:55:56 +08:00
Haojun Liao
765546585a
Merge pull request #25184 from taosdata/fix/3_liaohj
fix(stream): not return error when failing to load stream task meta.
2024-03-26 10:29:42 +08:00
Haojun Liao
a70d5a4947 fix(tsdb): fix bug during filtering brin records. 2024-03-26 09:50:06 +08:00
Haojun Liao
9638f8d7fc fix(tsdb): set the correct sttkey 2024-03-26 00:14:46 +08:00
Haojun Liao
a11b2c614e fix(stream): not return error when failing to load stream task meta. 2024-03-25 23:49:26 +08:00
yihaoDeng
0bb9e1195d refactor code 2024-03-25 13:48:24 +00:00
Shungang Li
44ce5b951d fix: arb group leak 2024-03-25 18:38:04 +08:00
Haojun Liao
5c729cc836 refactor: do some internal refactor. 2024-03-25 17:57:59 +08:00
54liuyao
aad3a43530 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-25 16:30:47 +08:00
Haojun Liao
750ea5789f fix(tsdb): fix errors identified by CI. 2024-03-25 14:20:46 +08:00
54liuyao
a02535c3ab Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-25 11:15:21 +08:00
Minglei Jin
ea424e822e fix(tsdb/util): fix missing column value with row iter 2024-03-25 11:00:33 +08:00
Haojun Liao
75d6b1edde fix(tsdb): fix the bug caused by sttKey changing. 2024-03-25 09:59:10 +08:00
yihaoDeng
54294f6479 refactor code 2024-03-24 09:24:40 +00:00
yihaoDeng
3ccf9942a9 refactor code 2024-03-24 05:35:07 +00:00
Haojun Liao
447b8ddd32 fix(tsdb): remove invalid assert. 2024-03-23 23:33:40 +08:00
yihaoDeng
2d6c9ec7de fix mem problem 2024-03-23 12:56:24 +00:00
yihaoDeng
cbb4e83fc4 fix mem problem 2024-03-23 12:12:39 +00:00
yihaoDeng
f5c8c8f7c5 fix mem problem 2024-03-23 11:49:09 +00:00
Haojun Liao
c35e834141 fix(tsdb): fix error. 2024-03-23 00:11:21 +08:00
Haojun Liao
17a65430cd fix(tsdb): remove assert 2024-03-22 18:42:54 +08:00
wangmm0220
912cb09839 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-03-22 18:22:13 +08:00
Haojun Liao
ef6ea16d64 other: merge 3.0 2024-03-22 17:57:25 +08:00
Haojun Liao
9f492a8962 other: merge 3.0 2024-03-22 17:53:11 +08:00
wangmm0220
f1853ced26 feat:[TS-4243] add logic for primark key in tmq 2024-03-22 17:48:59 +08:00
Haojun Liao
bd52416af9
Merge pull request #25149 from taosdata/fix/3_liaohj
enh: meta pause/resume for sys table scan
2024-03-22 17:32:35 +08:00
Haojun Liao
ca28bb60ef refactor: do some internal refactor. 2024-03-22 17:32:12 +08:00
Haojun Liao
5808c1b86f refactor: do some internal refactor. 2024-03-22 17:31:44 +08:00
Haojun Liao
cbf22ed72a refactor: do some internal refactor. 2024-03-22 17:26:56 +08:00
Haojun Liao
018e6f2a71 refactor: do some internal refactor. 2024-03-22 17:18:31 +08:00
Haojun Liao
2ec24c1e04 refactor: do some internal refactor. 2024-03-22 16:43:34 +08:00
Benguang Zhao
02528eaa48 enh: not to touch meta data during balance vgroup leader 2024-03-22 16:24:13 +08:00
Benguang Zhao
85ccba0fab enh: support changeless transaction of tasks 2024-03-22 15:37:53 +08:00
Hongze Cheng
e36e7d0427 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-22 15:14:32 +08:00
Hongze Cheng
974691e84b fix coredump 2024-03-22 15:14:23 +08:00
Haojun Liao
7d2110bb12 refactor: do some internal refactor. 2024-03-22 15:09:30 +08:00
Haojun Liao
a8a0e3edf8 refactor: do some internal refactor. 2024-03-22 14:47:00 +08:00
Hongze Cheng
537fa8558b
Merge pull request #25155 from taosdata/fix/TD-29190
fix: arb send set assigned req
2024-03-22 14:11:48 +08:00
Shungang Li
2821e706a5 fix: arb send set assigned req 2024-03-22 12:59:07 +08:00
Haojun Liao
8c5ec3205c refactor: do some internal refactor. 2024-03-22 10:56:04 +08:00
kailixu
fb2667d92d fix: sys table scan and meta query 2024-03-22 10:33:46 +08:00
Haojun Liao
ecd09059f5 fix(tsdb): fix error in reading data from file block 2024-03-22 10:16:56 +08:00
Hongze Cheng
6f174fdb7a
Merge pull request #25126 from taosdata/fix/TD-29180
fix: arb alter database check
2024-03-22 09:54:08 +08:00
54liuyao
680f96156f Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-22 08:37:42 +08:00
yihaoDeng
2903d568ea add test 2024-03-21 11:06:46 +00:00
Shungang Li
be54767897 fix: arb show null in show arbgroups 2024-03-21 18:13:25 +08:00
Haojun Liao
8bdd12c3a8 refactor: do some internal refactor. 2024-03-21 17:47:40 +08:00
Haojun Liao
fd8f065c67 refactor: do some internal refactor. 2024-03-21 15:08:23 +08:00
Hongze Cheng
9429c9d04c
Merge pull request #25048 from taosdata/enh/TS-4531-3.0
enh: logs and show grants
2024-03-21 11:03:28 +08:00
54liuyao
7a0ec25912 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0 2024-03-21 10:50:29 +08:00
54liuyao
a60f390cdc stream primary key 2024-03-21 10:50:07 +08:00
Haojun Liao
0c578ab6c0 refactor: do some internal refactor. 2024-03-21 10:44:27 +08:00
Haojun Liao
b12e65d144 fix(tsdb): set pk column index. 2024-03-21 09:37:46 +08:00
Haojun Liao
1d77cde433 refactor: do some internal refactor. 2024-03-20 23:03:48 +08:00
Haojun Liao
109fd34b38
Merge pull request #25141 from taosdata/fix/3_liaohj
fix(stream): adjust conflict level when creating stream.
2024-03-20 23:02:21 +08:00
Haojun Liao
a9ba534f48 fix(stream): adjust conflict level when creating stream. 2024-03-20 18:31:57 +08:00
Benguang Zhao
b4eb22c7a4 enh: add logging info for alter vnode hash range action 2024-03-20 16:26:52 +08:00
Haojun Liao
55f7bc2c9c fix(tsdb):add attributes for ssdatablock. 2024-03-20 15:29:05 +08:00
Haojun Liao
78b0d3fa74 fix(tsdb): fix error in comparing pk. 2024-03-20 14:27:48 +08:00
Haojun Liao
5ed0283494 fix(tsdb): support composite primary key. 2024-03-20 14:17:37 +08:00
Shungang Li
701ac8b865 fix: arb alter database check 2024-03-20 11:05:57 +08:00
Cary Xu
861528fb6c
Merge branch '3.0' into enh/TS-4531-3.0 2024-03-19 17:03:41 +08:00
Haojun Liao
7ff383cb1f
Merge pull request #25116 from taosdata/fix/3_liaohj
fix(stream):adjust current offset by using the scanning version, not …
2024-03-19 16:44:58 +08:00
Hongze Cheng
a9c1bcc91c
Merge pull request #25097 from taosdata/feat/TD-25880
feat: support 2 replica with arbitrator
2024-03-19 16:44:07 +08:00
Haojun Liao
65e4048f5d Merge branch '3.0' into fix/3_liaohj 2024-03-19 15:36:07 +08:00
Haojun Liao
77f8dbeeb9 refactor: do some internal refactor. 2024-03-19 15:21:23 +08:00
Haojun Liao
1c2c2b2b9a refactor: do some internal refactor. 2024-03-19 15:20:38 +08:00
Haojun Liao
6795f6e1cc fix(tsdb): handle the case that no stt statistics info existsin stt files generated by early version of TDengine. 2024-03-19 15:16:46 +08:00
Shungang Li
4185962c43 fix: arb unit test 2024-03-19 14:26:11 +08:00
kailixu
3da55a48ca enh: code optimization 2024-03-19 11:03:30 +08:00
Shungang Li
7f3b49bde8 enh: arb adjust version code 2024-03-19 09:38:05 +08:00
Shungang Li
d0df927dfa feat: arb add version in sarbgroup 2024-03-19 09:31:05 +08:00
Shungang Li
fc7575279c fix: arb unit test 2024-03-19 09:30:51 +08:00
Shungang Li
3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
kailixu
daa9c1aa9a Merge branch '3.0' into enh/TS-4531-3.0 2024-03-19 08:41:22 +08:00
kailixu
7df12ffe50 fix: update machine id 2024-03-19 08:40:48 +08:00
wangmm0220
4810053142 opti:tmq 2024-03-18 21:43:22 +08:00
wangmm0220
0ccad9d5de Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/tmq-opti 2024-03-18 21:23:58 +08:00
yihaoDeng
cd5f8ea415 tsdb support compress 2024-03-18 12:13:35 +00:00
yihaoDeng
d31c7f40c7 tsdb support compress 2024-03-18 12:12:55 +00:00
kailixu
0b15e3415d enh: machine id persistence 2024-03-18 18:06:18 +08:00
yihaoDeng
3964f01793 fix invalid read 2024-03-18 07:23:55 +00:00
wangmm0220
5624efff4e opti:tmq 2024-03-18 14:31:40 +08:00
Haojun Liao
2b706f00ad refactor(meta): add some logs. 2024-03-18 14:16:49 +08:00
Haojun Liao
7bdabc309b Merge branch '3.0' into fix/3_liaohj 2024-03-18 14:16:15 +08:00
Hongze Cheng
a962441252
Merge pull request #25106 from taosdata/fix/TD-29064-3.0
fix: delete table snapshot coredump
2024-03-18 12:40:52 +08:00
dapan1121
062bdf686e
Merge pull request #25102 from taosdata/fix/TS-4563
fix:[TS-4563]retrieve data error from wal if colid is bigger in tmq
2024-03-17 16:52:29 +08:00
Haojun Liao
74d7a0bd3e
Merge pull request #25112 from taosdata/fix/3_liaohj
fix(meta): fix repeatly reader lock for tsdb meta.
2024-03-16 23:57:55 +08:00
Haojun Liao
15e65d5f07 refactor: do some internal refactor. 2024-03-16 22:42:49 +08:00
yihaoDeng
b8fbb804cc tsdb support compress 2024-03-16 14:41:37 +00:00
yihaoDeng
c81d90a527 tsdb support compress 2024-03-16 14:31:24 +00:00
yihaoDeng
54d63fe87c tsdb support compress 2024-03-16 14:23:35 +00:00
yihaoDeng
0a03e7ac84 tsdb support compress 2024-03-16 14:01:42 +00:00
yihaoDeng
4fcd80ad27 tsdb support compress 2024-03-16 13:46:50 +00:00
Haojun Liao
29d9e8a9f9
Merge pull request #25105 from taosdata/fix/3_liaohj
fix(stream): fix stream task retrieve reallocate error
2024-03-15 21:44:21 +08:00
yihaoDeng
f607cd60e3 tsdb support compress 2024-03-15 10:22:57 +00:00
Hongze Cheng
6c41fa48dd fix: delete table snapshot coredump 2024-03-15 16:55:50 +08:00
wangmm0220
5f687f0d88 fix:[TS-4563]retrieve data error from wal if colid is bigger in tmq 2024-03-15 15:59:03 +08:00
Haojun Liao
a576be6ae5 fix(stream): set the correct rows info for stream tasks when retreiving task info. 2024-03-15 15:19:20 +08:00
yihaoDeng
ec227180e1 add alg to block col 2024-03-14 12:37:15 +00:00
yihaoDeng
646478c6dc Merge branch 'feat/TS-4243-3.0' into feature/compressData 2024-03-14 12:22:58 +00:00
yihaoDeng
bdbe9b042c Merge branch 'feature/compressData' of https://github.com/taosdata/TDengine into feature/compressData 2024-03-14 12:20:13 +00:00
yihaoDeng
739e3ba7ab add zstd lib 2024-03-14 12:19:12 +00:00
factosea
c6adba9bfc fix: merge error 2024-03-14 19:56:19 +08:00
facetosea
6678a65dc4 merge ts-4243 2024-03-14 19:06:34 +08:00
Haojun Liao
f28e994409
Merge pull request #25091 from taosdata/fix/3_liaohj
fix(stream): transfer state before do checkpoint
2024-03-14 17:59:13 +08:00
Haojun Liao
34c849bdbe enh(tsdb): read composed key in stt. 2024-03-14 17:03:57 +08:00
Haojun Liao
cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
wangmm0220
c866c9ad02 fix:case error 2024-03-14 14:27:13 +08:00
yihaoDeng
fe10867547 Merge branch '3.0' into feature/compressData 2024-03-14 03:19:39 +00:00
Haojun Liao
15663ab450
Merge pull request #25084 from taosdata/fix/3_liaohj
fix(tsdb): set strict varchar length check.
2024-03-14 11:16:03 +08:00
Haojun Liao
190b02dd1a fix(stream):set correct version for sink/agg tasks. 2024-03-14 10:04:43 +08:00
Haojun Liao
2b7fd0d15c fix(tsdb): set strict varchar length check. 2024-03-14 10:04:14 +08:00
wangmm0220
f27becb76a opti:tmq logic 2024-03-14 00:08:56 +08:00
wangmm0220
5a5bf29acb opti:tmq logic 2024-03-13 23:50:42 +08:00
yihaoDeng
cc7d5ce484 add api 2024-03-13 12:58:05 +00:00
wangmm0220
6f4809fe21 opti:tmq logic 2024-03-13 20:28:37 +08:00
yihaoDeng
a5eebc90cb add api 2024-03-13 12:04:21 +00:00
wangmm0220
d0bdb0ce2b opti:tmq logic 2024-03-13 19:36:00 +08:00
yihaoDeng
3c11dc4ec1 fix show create table crash 2024-03-13 09:54:14 +00:00
Haojun Liao
2466e169a0
Merge pull request #25067 from taosdata/fix/TD-29073
open operator after resume stream
2024-03-13 17:43:13 +08:00
yihaoDeng
5c67a67363 fix desc crash 2024-03-13 08:33:53 +00:00
yihaoDeng
064e7ef017 fix desc crash 2024-03-13 08:03:43 +00:00
yihaoDeng
e9b0c877b0 fix double free 2024-03-13 06:01:16 +00:00
yihaoDeng
85fec026d6 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-29130 2024-03-13 05:57:20 +00:00
yihaoDeng
e72ddf9429 fix double free 2024-03-13 05:56:13 +00:00
Hongze Cheng
d9db5b015c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-13 13:31:59 +08:00
wangmm0220
4dfc531e6c opti:subscribe logic 2024-03-12 19:42:26 +08:00
yihaoDeng
796ff03eb5 fix invalid copy 2024-03-12 09:47:01 +00:00
54liuyao
3835e0c156 open operator after resume stream 2024-03-12 16:35:55 +08:00
Haojun Liao
0315e5ac63 feat(tsdb): read complex primary key from buf. 2024-03-12 16:22:56 +08:00
yihaoDeng
e25024cca3 fix invalid free 2024-03-12 07:09:50 +00:00
Haojun Liao
bc98f12798 feat(tsdb): read complex primary key from buf. 2024-03-12 14:06:59 +08:00
Hongze Cheng
f6c2a6bba2 more fix 2024-03-11 19:17:30 +08:00
Hongze Cheng
797a30ec02 more fix 2024-03-11 14:25:26 +08:00
Hongze Cheng
409c170404 fix more 2024-03-11 14:18:04 +08:00
Hongze Cheng
8480fd9181 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-08 17:08:09 +08:00
Hongze Cheng
acbde220bf more bug fix 2024-03-08 17:04:26 +08:00
Haojun Liao
abc16cda18
Merge pull request #25039 from taosdata/fix/nullcheck
test(stream): add some test cases to inc coverage.
2024-03-08 17:03:20 +08:00
yihaoDeng
a52213dd23 fix create stable error 2024-03-08 08:40:33 +00:00
Haojun Liao
3de1413974 test(stream): add some test cases to inc coverage. 2024-03-08 13:38:51 +08:00
Hongze Cheng
fbc52d2a9c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-08 13:15:11 +08:00
Hongze Cheng
710a8ccbf2 fix more code 2024-03-08 13:14:54 +08:00
factosea
af9fdcd29d create stable/table 2024-03-08 11:23:11 +08:00
dapan1121
2349b28c12
Merge pull request #25024 from taosdata/fix/TS-4540
fix:[TS-4540]seperate block if insert in one sql when subscribe query
2024-03-08 10:50:30 +08:00
Hongze Cheng
1d49fc6148 fix more code 2024-03-08 10:43:40 +08:00