Commit graph

8702 commits

Author SHA1 Message Date
Haojun Liao
cc318d7e2d enh(stream): sink task does not initialize the backend. 2024-05-28 11:34:04 +08:00
Haojun Liao
bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
54liuyao
57bf9d1048 adj log 2024-05-28 10:56:43 +08:00
54liuyao
7fc2e8cc26 batch meta 2024-05-28 10:17:20 +08:00
Haojun Liao
be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Shungang Li
9947d8ec42 fix: last cache memory leak 2024-05-24 12:57:49 +08:00
Haojun Liao
89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00
Hongze Cheng
21ea1e3735 fix memory leak 2024-05-23 19:05:11 +08:00
Hongze Cheng
9531cba834 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-4723-3.0 2024-05-23 18:02:26 +08:00
Hongze Cheng
f729072044 enh: reduce compact block write time 2024-05-23 17:57:07 +08:00
54liuyao
441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
Shungang Li
0e76ba4034 fix: last cache update ts for col format 2024-05-22 15:15:41 +08:00
wangmm0220
f21eeae56c fix:[TD-30180]error in judging if groupId already added to the end of table name 2024-05-21 16:57:00 +08:00
Haojun Liao
f6af165d9a refactor(stream): add more info in info-meta 2024-05-21 10:09:55 +08:00
Haojun Liao
3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
dapan1121
68640f52be
Merge pull request #25833 from taosdata/fix/TS-4716-3.0
fix:[TS-4716]wait too long if change system time
2024-05-20 09:47:06 +08:00
Haojun Liao
93292d8149 other: merge 3.0 2024-05-18 09:58:36 +08:00
Haojun Liao
27c4e3634c refactor: do some internal refactor. 2024-05-17 17:04:05 +08:00
Shungang Li
bf40585f6c fix: cache update for last key 2024-05-17 16:41:26 +08:00
wangmm0220
3c0dbacf37 fix:[TS-4716]wait too long if change system time 2024-05-17 16:37:40 +08:00
Minglei Jin
7292d7a0ff fix(tsdb/cache): update array reference to fix missing tables/groupby 2024-05-17 14:59:20 +08:00
wangmm0220
b0cdf887b4 fix:[TS-4716]wait too long if change system time 2024-05-17 14:27:09 +08:00
Shungang Li
b79dda6689 enh: adjust order for row format cache update 2024-05-17 11:31:09 +08:00
Minglei Jin
3b8c27764d Merge branch '3.0' into fix/TD-29995-3.0 2024-05-17 10:17:33 +08:00
Haojun Liao
15181eb14b enh(tsdb): increase the capacity for return data. 2024-05-17 09:51:56 +08:00
Shungang Li
5c952fc922 enh: cleanup 2024-05-17 09:10:35 +08:00
Haojun Liao
5307f15766 refactor: do some internal refactor. 2024-05-16 19:54:29 +08:00
Haojun Liao
41b55cf4d6
Merge pull request #25792 from taosdata/fix/TD-29745-1
adj code
2024-05-16 13:56:31 +08:00
Shungang Li
fc047ddafc fix: last cache update rule 2024-05-16 09:30:27 +08:00
Hongze Cheng
9dd3f326ea
Merge pull request #25731 from taosdata/enh/TD-29968-3.0
enh: grant support s3/active-active/dual-replica/db_encryption
2024-05-15 15:52:28 +08:00
Haojun Liao
abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
54liuyao
2a67b83a27 adj code 2024-05-15 14:11:55 +08:00
Haojun Liao
43e018e210
Merge pull request #25733 from taosdata/fix/TD-29745
optimize scan data
2024-05-15 13:41:08 +08:00
54liuyao
167cdc79c5 format code 2024-05-15 10:54:53 +08:00
54liuyao
4c603fee55 format code 2024-05-15 10:54:24 +08:00
54liuyao
3c56f623ed adj inline func 2024-05-15 10:46:19 +08:00
54liuyao
ab3ba3f2e4 optimize scan tsdb 2024-05-15 09:09:20 +08:00
Haojun Liao
a3bd3a4c76
Merge pull request #25769 from taosdata/fix/TS-4791
fix(tsdb): fix the length of column type overflow.
2024-05-15 00:44:59 +08:00
Haojun Liao
610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao
9300b7a401 fix(tsdb): fix the length of column type overflow. 2024-05-14 16:22:11 +08:00
Haojun Liao
6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Minglei Jin
b6eec20dfb fix(s3/grant): checking grant when doing migrate 2024-05-14 11:01:06 +08:00
Shungang Li
694680600e fix: tsdbCache vartype of zero size 2024-05-14 09:23:32 +08:00
Haojun Liao
b7e7de0354 fix(stream): set the stream task load flag. 2024-05-13 16:45:38 +08:00
Haojun Liao
3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
Haojun Liao
d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
Haojun Liao
7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Hongze Cheng
4d4fa9ea94
Merge pull request #25703 from taosdata/fix/TD-29912
fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit
2024-05-10 15:29:44 +08:00
Hongze Cheng
db68b9a1f0
Merge pull request #25707 from taosdata/fix/TD-29981
fix: refactor lastcache ser/des for compatibility
2024-05-10 09:15:29 +08:00
Shungang Li
0ac5d393e6 fix: tsdbcache last disk data format change 2024-05-09 23:37:28 +08:00
Shungang Li
544999c01b fix: tsdbCacheSerialize copy from null ptr 2024-05-09 22:55:29 +08:00
Shungang Li
457b98fee8 fix: adjust SValueV0 data order 2024-05-09 21:52:43 +08:00
Shungang Li
7ae4415890 fix: refactor lastcache ser/des for compatibility 2024-05-09 19:04:11 +08:00
Shungang Li
6895bb121f fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit 2024-05-09 14:55:48 +08:00
dmchen
454b4047cb fix/audit-memory-leak 2024-05-09 10:19:14 +08:00
Hongze Cheng
e76d15e33f
Merge pull request #25690 from taosdata/fix/TD-29962
enh: refactor tsdbCache ser/des
2024-05-09 09:04:09 +08:00
Shungang Li
70598a3038 enh: refactor tsdbCache ser/des 2024-05-09 00:13:19 +08:00
Hongze Cheng
9e21eacf26
Merge pull request #25687 from taosdata/fix/TD-29934-3.0
fix(tsdb/cache-update): compare when rocks's colVal not null
2024-05-08 21:48:01 +08:00
Minglei Jin
3d1612e44b fix(tsdb/cache-update): compare when rocks's colVal not null 2024-05-08 19:27:43 +08:00
Hongze Cheng
431c3c0066
Merge pull request #25675 from taosdata/fix/TD-29934-3.0
fix(tsdb/cache-update): discard none colVals for same timestamp
2024-05-08 18:54:17 +08:00
Minglei Jin
bb227a9798 fix(tsdb/cache-update): discard none colVals for same timestamp 2024-05-08 17:29:07 +08:00
Shungang Li
733c8f8f9a fix: (compatibility) SLastCol field change cause 'last' crash 2024-05-08 16:12:43 +08:00
Haojun Liao
b26656fd1c
Merge pull request #25661 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 13:03:13 +08:00
Haojun Liao
cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao
55a630911d
Merge pull request #25653 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-07 23:12:30 +08:00
Haojun Liao
b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Hongze Cheng
c4b2f5681c
Merge pull request #25654 from taosdata/fix/TD-29845
fix: fix last col version when updating rocks
2024-05-07 11:33:51 +08:00
Haojun Liao
0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Minglei Jin
562bf0fe1e tsdb/cache: fix last col version when updating rocks 2024-05-07 10:24:07 +08:00
Shungang Li
b979c584fb fix: tsdbCacheGetBatch ref of tmp memory 2024-05-07 10:22:58 +08:00
Haojun Liao
18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao
7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao
cdc7b03ac6 fix(stream): fix syntax error. 2024-04-30 22:44:32 +08:00
Haojun Liao
732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao
94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao
629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao
f2bc93b78d
Merge pull request #25598 from taosdata/fix/3_liaohj
refactor(stream): opt stream sink perf.
2024-04-30 16:59:22 +08:00
dapan1121
f54dd2b818
Merge pull request #25602 from taosdata/fix/TS-4728-3.0
fix:use path of SStreamMeta
2024-04-30 16:12:50 +08:00
Haojun Liao
cb5a0563e6 fix(stream): fix error caused by merge. 2024-04-30 15:43:12 +08:00
wangmm0220
35003cbb34 fix:use path of SStreamMeta 2024-04-30 14:36:16 +08:00
Haojun Liao
4c27af9b13 refactor: do some internal refactor. 2024-04-30 13:25:39 +08:00
wangmm0220
3a1c210601 fix:use path of SStreamMeta 2024-04-30 11:06:03 +08:00
Haojun Liao
54e9522c62 refactor(stream): opt stream sink perf. 2024-04-30 09:41:29 +08:00
dapan1121
6187bf4e06
Merge pull request #25584 from taosdata/fix/TS-4728-3.0
fix:[TS-4728]transform store data if data is too big
2024-04-30 09:02:40 +08:00
wangmm0220
cd3f3046f7 fix:memory leak 2024-04-29 19:36:41 +08:00
wangmm0220
1f85cb42e6 fix:[TS-4728]transform strore data if data is too big 2024-04-29 17:22:40 +08:00
Haojun Liao
b0ef022e87 fix(tsdb): set the correct start pos for binary search. 2024-04-29 15:13:52 +08:00
Haojun Liao
7a5cdb81d5 fix(tsdb): set the correct start pos for binary search. 2024-04-29 14:40:49 +08:00
Haojun Liao
bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Haojun Liao
324072fed8
Merge pull request #25525 from taosdata/fix/3_liaohj
fix(stream): update stream task meta info.
2024-04-26 18:15:09 +08:00
Haojun Liao
6d06188b9f fix(stream): fix memory leak. 2024-04-26 17:06:15 +08:00
Haojun Liao
b1b3246066 fix(stream): update the checkpoint executed transId range. 2024-04-26 17:03:01 +08:00
Haojun Liao
5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Haojun Liao
8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Hongze Cheng
efdc943a3d Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 14:57:58 +08:00
Haojun Liao
c565e31638
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
2024-04-26 12:44:00 +08:00
Haojun Liao
815489d20a fix(tsdb): set the pk info when converting fileblockinfo to binrecord. 2024-04-26 11:10:20 +08:00
Haojun Liao
77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
Haojun Liao
feb176149e
Merge pull request #25507 from taosdata/fix/3_liaohj
fix(tsdb): overlap check take pk into consideration.
2024-04-26 09:06:38 +08:00
Hongze Cheng
f500762af7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 09:00:09 +08:00