Commit graph

7662 commits

Author SHA1 Message Date
Haojun Liao
c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
kailixu
c70a1b77e6 chore: code optimization for time series 2023-10-07 00:17:21 +08:00
kailixu
c59498d90a chore: code refactor for time series statis 2023-10-06 07:37:18 +08:00
kailixu
e4a86aa70a chore: remove obsolete codes 2023-10-05 23:52:50 +08:00
kailixu
07f043f143 enh: exclude sys tbl for time series 2023-10-05 23:48:52 +08:00
kailixu
47e79ff5b7 enh: exclude sys tbl for time series 2023-10-05 23:45:54 +08:00
kailixu
d0a046c7a3 enh: exclude sys tbl for time series 2023-10-05 23:30:30 +08:00
kailixu
88fdeca5cf enh: dnode notify logic 2023-10-05 22:31:25 +08:00
kailixu
086213a6c2 enh: dnode notify logic 2023-10-05 21:35:57 +08:00
Haojun Liao
5bf8d16ee1 refactor(stream): idle for 100ms when starting next round scan wal. 2023-10-04 23:33:03 +08:00
Haojun Liao
41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao
45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao
5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
Haojun Liao
5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
Haojun Liao
ff44539468 fix(stream): drop related fill-history task when dropping stream tasks. 2023-09-28 23:00:29 +08:00
Haojun Liao
31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao
f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
Haojun Liao
0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
Haojun Liao
0a8f4530f7 fix(tsdb): replace destroy with reset. 2023-09-28 11:42:19 +08:00
kailixu
b1a0912a61 enh: exclude systables in log/audit db 2023-09-28 10:15:34 +08:00
Haojun Liao
22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
Haojun Liao
cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
Minglei Jin
cd811577f3 fix(vnode/cos): use EIO as object put errno 2023-09-27 15:10:34 +08:00
Minglei Jin
5ce1dd6284 fix(tsdb/readerwriter): fix fd writing 2023-09-27 14:02:37 +08:00
Haojun Liao
e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
Minglei Jin
e6287c1a89 fix(tsdb/readerwriter): fix var shadowing 2023-09-26 19:18:10 +08:00
liuyao
ebf4283e91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 17:19:41 +08:00
kailixu
e1cd54a1b3 fix: rwlock reentrant problem on windows 2023-09-26 15:44:35 +08:00
kailixu
c680180894 fix: rwlock reentrant problem on windows 2023-09-26 15:37:29 +08:00
wade zhang
f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao
890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao
525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj
fix(stream): fix several stability-related bugs in stream framework.
2023-09-26 14:10:58 +08:00
Haojun Liao
f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
liuyao
ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
Hongze Cheng
03456ce443 fix: upgrade error when has tomb data 2023-09-26 09:23:22 +08:00
wade zhang
92f5803303
Merge pull request #23050 from taosdata/fix/TD-26478
fix(cos): use EIO as failed code
2023-09-26 09:02:59 +08:00
Haojun Liao
6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao
5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00
Minglei Jin
7fd7902dda fix(cos): use EIO as failed code 2023-09-25 18:38:55 +08:00
Benguang Zhao
5d588cb7d2 enh: trigger failover if tsdbMerge failure 2023-09-25 17:22:38 +08:00
kailixu
126a371170 chore: more code 2023-09-25 16:24:03 +08:00
kailixu
0632fb838a chore: code refactor 2023-09-25 16:17:57 +08:00
Haojun Liao
966ce4f30e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-09-25 16:00:02 +08:00
Haojun Liao
fcf4cc7169 fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read. 2023-09-25 15:58:24 +08:00
kailixu
b0b4d782fc chore: code refactor 2023-09-25 15:57:54 +08:00
Shungang Li
743a5b0640 feat: add db config item keep_time_offset 2023-09-25 15:46:08 +08:00
Haojun Liao
dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao
eb4078b7f3 fix(stream): record the tasks started info, and do some internal refactor. 2023-09-25 09:59:05 +08:00
Haojun Liao
c987f61300 fix(stream): fix race condition. 2023-09-25 01:37:27 +08:00
kailixu
986788d4fe enh: timeseries calculation 2023-09-24 09:14:52 +08:00
kailixu
ff3e36e679 enh: timeseries calculation 2023-09-24 08:41:45 +08:00
kailixu
53a9459c20 enh: update timeseries 2023-09-24 07:52:27 +08:00
Haojun Liao
4ea737571d refactor: do some internal refactor. 2023-09-24 01:26:51 +08:00
kailixu
bc8ebf1562 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-23 18:19:08 +08:00
Haojun Liao
b58ec1ee57 fix(stream): update logs. 2023-09-23 15:22:48 +08:00
Haojun Liao
acd3321494 fix(stream): rsp when checkpoint source failed. 2023-09-23 14:13:33 +08:00
Haojun Liao
7d5f76c6f1 fix(stream): disable auto rsp for checkpoint source. 2023-09-23 11:31:14 +08:00
Haojun Liao
5155519559 fix(stream): fix invalid assert. 2023-09-22 23:06:48 +08:00
Haojun Liao
cf6c255f22 refactor: do some internal refactor. 2023-09-22 22:50:21 +08:00
kailixu
8f828e052b enh: timeseries calculation optimization 2023-09-22 20:07:51 +08:00
liuyao
0d983e28ef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 19:25:41 +08:00
Haojun Liao
5b12e276cf fix(stream): add msg identifier check. 2023-09-22 18:13:18 +08:00
wade zhang
849b05a09b
Merge pull request #22927 from taosdata/fix/TD-26189
s3/block_cache: new tsdb block cache
2023-09-22 16:15:07 +08:00
liuyao
4f8e6d7795 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 15:00:52 +08:00
Haojun Liao
898aea5cfb refactor(stream): refactor send msg. 2023-09-22 14:52:18 +08:00
Minglei Jin
4c151f2031 tsdb/readerwriter: remove size with download 2023-09-22 14:06:06 +08:00
Haojun Liao
7e4410f094
Merge pull request #22992 from taosdata/feat/TD-26052
feat:support vnode split in tmq
2023-09-22 13:57:21 +08:00
Haojun Liao
87ea745861 fix(stream): add some logs, and remove invalid assert. 2023-09-22 10:53:03 +08:00
Haojun Liao
f7bcff862d fix(stream): add check info detailed information. 2023-09-22 10:23:56 +08:00
wangmm0220
19806cbcab fix:memory leak 2023-09-22 10:12:11 +08:00
wangmm0220
5555371fbc fix:memory leak 2023-09-22 10:04:53 +08:00
wangmm0220
86a4bfe28d fix:memory leak 2023-09-22 10:02:16 +08:00
liuyao
dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
wangmm0220
803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao
b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao
b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao
3c921ba66e
Merge pull request #23006 from taosdata/fix/3_liaohj
fix(tsdb): set the correct scaninfo to load the tomb data.
2023-09-21 22:13:16 +08:00
Haojun Liao
f93df639c1 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 17:32:21 +08:00
Minglei Jin
ce1f866416 tsdb/reader: use pTsdb handle instead of pgsz to open file 2023-09-21 16:36:17 +08:00
kailixu
7445b9ff50 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 16:25:06 +08:00
Haojun Liao
2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao
0f97a21163 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 15:21:01 +08:00
Haojun Liao
e4073bd9a8 fix(stream): update logs. 2023-09-21 14:03:14 +08:00
Haojun Liao
09accc71d2 log(stream): update log. 2023-09-21 14:01:41 +08:00
Haojun Liao
17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
liuyao
3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
wangmm0220
f9c5aa01af fix:enable split if there are topics & fix memory leak 2023-09-21 09:20:34 +08:00
Haojun Liao
6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
Minglei Jin
f206fa07d0 s3/put: use put2 2023-09-20 15:59:58 +08:00
Haojun Liao
2418f509ea fix(stream): avoid invalid read. 2023-09-20 15:47:09 +08:00
Haojun Liao
1d1d9a1b0b fix(stream): unlock when returning. 2023-09-20 15:45:15 +08:00
Haojun Liao
c8ab761d2a fix(stream): return if failed. 2023-09-20 15:38:49 +08:00
Haojun Liao
2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
Minglei Jin
d155cfcf0f tsdb/readerwriter: use tsdb's s3 block cache to read file page 2023-09-20 15:24:54 +08:00
liuyao
1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
Haojun Liao
af487c9048 fix(stream): fix obj. 2023-09-20 14:50:43 +08:00
Haojun Liao
361cde6497 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-09-20 14:49:09 +08:00
Haojun Liao
55d4a9686c log(tsdb): remove some logs. 2023-09-20 13:18:42 +08:00
dm chen
4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
Haojun Liao
392aaeb592 log(stream): remove logs. 2023-09-20 10:49:18 +08:00