Commit graph

12021 commits

Author SHA1 Message Date
Haojun Liao
c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao
db897fb03a fix(stream): opt perf. 2023-10-09 20:09:09 +08:00
Haojun Liao
dfe8641c0c refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-10-09 20:08:52 +08:00
Haojun Liao
a248f3d088 refactor: do some internal refactor. 2023-10-09 20:08:12 +08:00
Haojun Liao
0db357401d fix(stream): add new status for meta. 2023-10-09 20:08:12 +08:00
Haojun Liao
3912d80c02 fix(stream): do some internal refactor. 2023-10-09 20:08:11 +08:00
Haojun Liao
feb09c8361 fix(stream): fix error in pause scan-history data. 2023-10-09 20:08:11 +08:00
Haojun Liao
6a98b11bef fix(stream): fix invalid read and memory leak. 2023-10-09 20:08:11 +08:00
Haojun Liao
65f66f0986 fix(stream): transfer state when all downstream rsp already. 2023-10-09 20:08:11 +08:00
Haojun Liao
4af7812f0b fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-10-09 20:08:10 +08:00
Haojun Liao
4fe1382cd9 fix(stream): adjust nodeUpdate check interval. 2023-10-09 20:08:09 +08:00
Haojun Liao
f4f55fcbce fix(stream): record the tasks started info, and do some internal refactor. 2023-10-09 20:08:09 +08:00
Haojun Liao
68b003c804 fix(stream): fix race condition. 2023-10-09 20:08:09 +08:00
Haojun Liao
52763ca2a3 refactor: do some internal refactor. 2023-10-09 20:08:07 +08:00
Haojun Liao
012ddadf25 fix(stream): update logs. 2023-10-09 20:08:07 +08:00
Haojun Liao
c05a8de3e8 fix(stream): rsp when checkpoint source failed. 2023-10-09 20:08:06 +08:00
Haojun Liao
b4bc4fac98 fix(stream): disable auto rsp for checkpoint source. 2023-10-09 20:08:06 +08:00
Haojun Liao
e671e87234 fix(stream): fix invalid assert. 2023-10-09 20:08:06 +08:00
Haojun Liao
d1a6b8bd22 refactor: do some internal refactor. 2023-10-09 20:08:06 +08:00
Haojun Liao
46b17aa9f1 fix(stream): fix race condition. 2023-10-09 20:08:06 +08:00
Haojun Liao
5eee76df65 fix(stream): add msg identifier check. 2023-10-09 20:08:05 +08:00
Haojun Liao
2b16976902 refactor(stream): refactor send msg. 2023-10-09 20:08:03 +08:00
Haojun Liao
498519c94d fix(stream): remove invalid node. 2023-10-09 20:08:02 +08:00
Haojun Liao
27e00b1f19 fix(stream): add some logs, and remove invalid assert. 2023-10-09 20:08:02 +08:00
Haojun Liao
124e1ed1ab enh(stream): add stage info for streamt tasks. 2023-10-09 20:08:02 +08:00
Haojun Liao
12687eb287 fix(stream): add check info detailed information. 2023-10-09 20:08:02 +08:00
Haojun Liao
ab7c18f604 refactor: do some internal refactor. 2023-10-09 20:08:01 +08:00
Haojun Liao
e5535fa1f5 fix(stream): handle dispatch checkpoint-trigger failure. 2023-10-09 20:08:01 +08:00
Haojun Liao
7f4d9b6e41 fix(stream): wait for the task checkpoint before stop. 2023-10-09 20:07:53 +08:00
Haojun Liao
04405b84c5 fix(stream): update logs. 2023-10-09 20:07:53 +08:00
Haojun Liao
118e078f4a log(stream): update log. 2023-10-09 20:07:53 +08:00
Haojun Liao
ef9efc8a8e refactor: do refactor the sink task. 2023-10-09 20:07:53 +08:00
Haojun Liao
a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao
1f45bd82d2 other: merge stream fix in main. 2023-10-09 20:07:01 +08:00
Haojun Liao
02610f5546 fix(stream): avoid invalid read. 2023-10-09 20:06:11 +08:00
Haojun Liao
f5da458c77 fix(stream): unlock when returning. 2023-10-09 20:06:11 +08:00
Haojun Liao
36dcdad1a5 fix(stream): return if failed. 2023-10-09 20:06:10 +08:00
Haojun Liao
d76e3ac718 fix(stream): add task status check. 2023-10-09 20:06:10 +08:00
Haojun Liao
29e1efb757 fix(stream): fix obj. 2023-10-09 20:06:10 +08:00
Haojun Liao
a997fa5552 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-10-09 20:06:09 +08:00
Haojun Liao
dff4bd3c8d log(tsdb): remove some logs. 2023-10-09 20:06:09 +08:00
Haojun Liao
53237c34d1 enh(stream): add info in log. 2023-10-09 20:06:09 +08:00
Haojun Liao
8af76d28c8 log(stream): remove logs. 2023-10-09 20:06:09 +08:00
Haojun Liao
e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao
927f2d896c fix(stream): limit the max scan times. 2023-10-09 20:06:08 +08:00
Haojun Liao
1a86ee6517 refactor: update the log level. 2023-10-09 20:06:06 +08:00
Haojun Liao
ff3ea366e2 fix(stream): keep the status entry in hash table, instead entry index. 2023-10-09 20:06:05 +08:00
Haojun Liao
b95ad74c7f fix(stream): not handle the check msg for follower tasks. 2023-10-09 20:06:04 +08:00
Haojun Liao
38bf2d24e7 fix(stream): remove stream in buf. 2023-10-09 20:05:39 +08:00
Haojun Liao
636eccc160 fix(stream): add null check 2023-10-09 20:05:37 +08:00
Haojun Liao
57bf1cadc4 fix(stream): fix error in decode stream task. 2023-10-09 20:05:37 +08:00
Haojun Liao
0459a4628c fix(stream): fix stream task id error. 2023-10-09 20:05:36 +08:00
Haojun Liao
7ccc273206 other: merge stream fix in main. 2023-10-09 20:05:29 +08:00
Haojun Liao
98ef566eb4 fix(stream): remove fill-history sink task. 2023-10-09 20:04:17 +08:00
Haojun Liao
e84eeee6b8 refactor: do some internal refactor. 2023-10-09 20:04:17 +08:00
Haojun Liao
fe7864b976 fix(stream): fix error in drop task. 2023-10-09 20:04:17 +08:00
Haojun Liao
c33e521aa1 fix(stream): update some logs. 2023-10-09 20:04:17 +08:00
Haojun Liao
5f1146d415 fix(stream): fix memory leak. 2023-10-09 20:04:17 +08:00
Haojun Liao
39e0c57323 fix(stream): set the correct guard flag. 2023-10-09 20:04:16 +08:00
Haojun Liao
3d1f29ff21 fix(stream): fix memory leak. 2023-10-09 20:04:16 +08:00
Haojun Liao
6fa54789cb fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-10-09 19:59:31 +08:00
Haojun Liao
1256eafddb other: merge stream fix. 2023-10-09 19:59:24 +08:00
Haojun Liao
c6355fcc2f fix(tsdb): check return code. 2023-10-09 19:56:18 +08:00
Haojun Liao
be09c173ab fix:fix coverity issue and remove unnecessary files. 2023-10-09 19:56:17 +08:00
Haojun Liao
aaa12ed4f8 refactor: do some internal refactor about the sched status set 2023-10-09 19:56:17 +08:00
kailixu
f180a6e6f3 chore: remove macro for grant notify 2023-10-09 19:26:16 +08:00
Hongze Cheng
cd61dd39fa
Merge pull request #23176 from taosdata/enh/TS-4103
enh: control number of stt files
2023-10-09 05:08:01 -05:00
kailixu
5dd277248e fix: alter active code for different server 2023-10-09 17:16:56 +08:00
Hongze Cheng
e3525dba6e enh: clear files fset by fset 2023-10-09 17:11:50 +08:00
Hongze Cheng
258181e387 change block commit factor 2023-10-09 16:03:42 +08:00
wade zhang
7c738cbe0c
Merge pull request #23168 from taosdata/feat/TS-4036-main
feat: alter local/dnode asynclog
2023-10-09 15:44:39 +08:00
Haojun Liao
8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Minglei Jin
93438ed838 fix(tsdb/carch reader): reset current fileset in cache reader 2023-10-09 15:24:24 +08:00
Hongze Cheng
2c9a0dbcda enh: control stt max level 2023-10-09 14:00:11 +08:00
liuyao
1fbfdb5ab4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 11:40:27 +08:00
wade zhang
40ff071243
Merge pull request #23164 from taosdata/fix/TD-26587
fix(tsdb/retention): free fopArr & fs snapshot resources
2023-10-09 10:22:25 +08:00
Haojun Liao
74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao
ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao
0fda1793e7 fix(stream): fix error in fill-history process. 2023-10-09 10:08:48 +08:00
liuyao
731d4fff27 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-09 08:58:27 +08:00
Haojun Liao
167484ab3a
Merge pull request #23145 from taosdata/mark/tmq
opti:set default offset to latest in subscription
2023-10-08 18:56:37 +08:00
Hongze Cheng
880e8c1941 fix: block commit when there are too many stt file 2023-10-08 18:27:19 +08:00
Shungang Li
a7507d26b0 feat: alter local/dnode asynclog 2023-10-08 18:26:25 +08:00
Minglei Jin
ca809924cd fix(tsdb/retention): free fopArr & fs snapshot resources 2023-10-08 15:10:54 +08:00
dapan1121
9b207b9b3e
Merge pull request #23133 from taosdata/fix/TD-26474-3.0
fix: mutex init for trans
2023-10-08 15:07:47 +08:00
Hongze Cheng
ba27cc0605 fix: fid overflow 2023-10-08 14:54:24 +08:00
liuyao
ed8cad22cb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 13:31:51 +08:00
wade zhang
a9db1ed8e0
Merge pull request #23116 from taosdata/fix/TD-26539
fix(keep0-duration): force keep0 at least thrice of duration
2023-10-08 13:07:05 +08:00
yihaoDeng
9d430c39ae fix mem leak 2023-10-08 11:47:06 +08:00
wangmm0220
fb3197ea89 fix:test case error for reset=latest 2023-10-08 10:55:35 +08:00
kailixu
a2e3109447 chore: add grant method for community 2023-10-08 09:47:57 +08:00
liuyao
c75506b271 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 09:02:51 +08:00
dapan1121
61382c0793
Merge pull request #23126 from taosdata/fix/TD-26426-3.0
fix: support check/merge active code
2023-10-07 19:31:36 +08:00
Haojun Liao
ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
liuyao
c088ee7f91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-07 19:13:07 +08:00
yihaoDeng
97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
kailixu
b9767707cb chore: code optimization for array size 2023-10-07 15:57:26 +08:00
wangmm0220
9c470e9297 opti:set default offset to latest in subscription & return error if use snapshot when consume column 2023-10-07 15:25:24 +08:00
Hongze Cheng
d1e59b9e0e enh: optimize merge strategy 2023-10-07 15:18:08 +08:00
Haojun Liao
7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00