Commit graph

13185 commits

Author SHA1 Message Date
Yihao Deng
40aa5f697f fix tag index double free 2023-12-26 07:21:02 +00:00
Yihao Deng
dc01625ea1 fix tag index double free 2023-12-26 06:52:33 +00:00
Haojun Liao
b74e98b25c fix(stream): set the correct split timestamp for session/state window. 2023-12-26 14:17:46 +08:00
Haojun Liao
62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Hongze Cheng
a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
Haojun Liao
e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
Haojun Liao
00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Benguang Zhao
7edfbf8023 fix: set commit log for mndAddCompactDetailToTran 2023-12-25 09:47:17 +08:00
Benguang Zhao
4f29500f74 fix: set commit log for mndDropSubByTopic 2023-12-25 09:46:55 +08:00
Haojun Liao
0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao
30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Haojun Liao
25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Bob Liu
e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao
b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao
7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Benguang Zhao
2de6d6c81d enh: add TSDB_CODE_MND_TRANS_CTX_SWITCH 2023-12-22 16:06:59 +08:00
Haojun Liao
e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao
67edc29a65
Merge pull request #24179 from taosdata/fix/TD-27957-30
fix snode crash
2023-12-22 14:41:41 +08:00
Haojun Liao
90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Hongze Cheng
02bb9e90d2
Merge pull request #24189 from taosdata/fix/TD-27974
fix(tsdb/cache): prepend ts col to load stt
2023-12-22 13:53:15 +08:00
Minglei Jin
16ad59fb18 fix(tsdb/cache): prepend ts col to load stt 2023-12-22 12:14:27 +08:00
Hongze Cheng
46211258b3
Merge pull request #24173 from taosdata/fix/TD-27974
fix(tsdb/cache): plus 1 to nCols to load stt data
2023-12-22 09:43:20 +08:00
Haojun Liao
c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Haojun Liao
0fab9a1827 other: fix syntax error. 2023-12-22 00:29:49 +08:00
Haojun Liao
84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
yihaoDeng
913fda4a36 fix snode crash 2023-12-21 18:52:25 +08:00
Minglei Jin
9d3eb02f3c fix(tsdb/cache): plus 1 to nCols to load stt data 2023-12-21 17:53:44 +08:00
Haojun Liao
2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Alex Duan
9d4a75b0be coverage: vnodeSrv.c tmsg.c trow.c 2023-12-21 14:22:22 +08:00
Haojun Liao
71f6d9f06f fix(stream): handle the case that recvs drop msg twice. 2023-12-21 11:52:45 +08:00
Benguang Zhao
572368703d enh: ensure mndTransProcessRsp invoked in mnode-write thread 2023-12-21 09:33:56 +08:00
Haojun Liao
ad5d78a6ca fix(stream): fix deadlock. 2023-12-20 19:12:47 +08:00
Haojun Liao
64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
Haojun Liao
1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao
a0d1933134
Merge pull request #24113 from taosdata/mark/3.0
opti:logic in parse raw line & make log more specific
2023-12-20 15:25:26 +08:00
Haojun Liao
d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
wangmm0220
1f70f51ac8 fix:sdb maxId should use int64* instead of int32* 2023-12-20 11:20:41 +08:00
Haojun Liao
81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao
541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Benguang Zhao
e06f355143 enh: improve logging msg of mndPostMgmtCode 2023-12-19 20:16:33 +08:00
Benguang Zhao
f7ab8e99b5 enh: demarcate top and bottom halves of task trans execution to ensure a consistent order 2023-12-19 19:52:11 +08:00
Haojun Liao
2de0f6e971 test(stream): lock the update procedure. 2023-12-19 18:56:15 +08:00
Haojun Liao
92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
wade zhang
8bbf03a695
Merge pull request #24116 from taosdata/fix/release-mem-check-3.0
release mem check
2023-12-19 18:13:53 +08:00
Haojun Liao
17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao
fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
Haojun Liao
ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao
579366ec00
Merge pull request #24121 from taosdata/fix/liaohj
other: merge main into 3.0
2023-12-18 23:11:36 +08:00
Haojun Liao
e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao
bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Minglei Jin
64378be7f4 fix(tsdb/cache): fix buffer-overflow with column adding 2023-12-18 18:06:40 +08:00
dmchen
19637fd148 release mem check 2023-12-18 09:32:31 +00:00
Haojun Liao
ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
wade zhang
4cac96d2df
Merge pull request #24111 from taosdata/fix/TD-27845
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
2023-12-18 16:27:18 +08:00
Haojun Liao
79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj
fix(stream): add check for null ptr and leader .
2023-12-18 16:24:07 +08:00
Minglei Jin
5dd9ce8ceb fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange 2023-12-18 15:02:34 +08:00
Benguang Zhao
25ab03e5d3 refact: improve info logging msg in mmProcessWriteMsg 2023-12-18 13:35:21 +08:00
Haojun Liao
b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
Haojun Liao
93f3a3135f
Merge pull request #24104 from taosdata/fix/3_liaohj
fix(stream): avoid invalid read.
2023-12-18 11:03:37 +08:00
Haojun Liao
edc3841a2c fix(stream): avoid invalid read. 2023-12-18 09:26:56 +08:00
dmchen
dd317d6738 add more log 2023-12-17 11:03:25 +00:00
dmchen
6347792a93 TD-27906 2023-12-17 08:47:51 +00:00
wade zhang
967a259219
Merge pull request #24092 from taosdata/fix/TD-27902
fix/TD-27902
2023-12-17 12:31:15 +08:00
Haojun Liao
ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj
fix(stream): send checkpoint complete msg to mnode when dropping it.
2023-12-17 11:03:04 +08:00
Haojun Liao
4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao
0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj
fix(tsdb): add desc check for clean file block.
2023-12-16 18:10:15 +08:00
Haojun Liao
4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
Haojun Liao
1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash
Fix/snode backend crash
2023-12-16 13:13:28 +08:00
Haojun Liao
f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
slzhou
8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
dmchen
62672b84a2 fix/TD-27902 2023-12-15 11:39:45 +00:00
Haojun Liao
a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj
fix(query): add rows info if blocks exist.
2023-12-15 18:24:45 +08:00
yihaoDeng
bb5f0d9112 Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash 2023-12-15 18:16:38 +08:00
yihaoDeng
7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
dapan1121
50d6f0ed41
Merge pull request #24067 from taosdata/fix/TD-27839-3.0
fix: update dmodule lib
2023-12-15 17:44:31 +08:00
Haojun Liao
aedc5e6b05 fix(stream): set the correct dst stable name. 2023-12-15 17:16:25 +08:00
Hongze Cheng
4ae13f411e
Merge pull request #24010 from taosdata/feat/TS-4229
feat: compact monitor and kill
2023-12-15 16:20:13 +08:00
Haojun Liao
e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
shenglian zhou
cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao
556eaa22ac
Merge pull request #24074 from taosdata/mark/3.0
fix:core dump if tqOpen error in vnodeOpen
2023-12-15 13:55:10 +08:00
wangmm0220
812f0f97a7 fix:rollback size to old logic 2023-12-15 10:09:18 +08:00
slzhou
d3146a5bec fix: when no file block, no proc mem before fileset 2023-12-15 09:51:06 +08:00
dmchen
5e7aead4d8 keep killed compact 2023-12-15 01:43:24 +00:00
Yihao Deng
5f2d93d62c
Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 09:22:33 +08:00
wangmm0220
740228a653 fix:core dump if tqOpen error in vnodeOpen 2023-12-15 09:07:35 +08:00
dmchen
7183fd66a1 keep killed compact 2023-12-15 00:59:56 +00:00
slzhou
5bf364cc0a enhance: refactor code 2023-12-15 08:23:25 +08:00
kailixu
b7bfbdd2b3 Merge branch '3.0' into fix/TD-27839-3.0 2023-12-14 19:48:13 +08:00
dmchen
7bb3d43f4e kill compact 2023-12-14 11:22:07 +00:00
dmchen
d7ac3558f8 fix wrong merge 2023-12-14 11:21:41 +00:00
kailixu
7d18bd9811 chore: reduce the dependencies 2023-12-14 18:49:32 +08:00
dm chen
81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
slzhou
4dc39e74c5 fix: the block return from buildBlockFromFiles should be of new fileset 2023-12-14 16:57:04 +08:00
Haojun Liao
0449b5f1bd other: add some logs. 2023-12-14 15:43:59 +08:00
dmchen
1ca0858a97 compact detail log 2023-12-14 07:11:00 +00:00
wade zhang
c95c567376
Merge pull request #24046 from taosdata/fix/TS-4251-3.0
revert dependency
2023-12-14 14:03:04 +08:00
Haojun Liao
05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-12-14 13:52:04 +08:00
Haojun Liao
7cf0add513 fix(stream): fix error caused by refactor. 2023-12-14 11:28:03 +08:00
dmchen
606a6fe891 field encode 2023-12-14 03:24:53 +00:00
dapan1121
7803a717c2
Merge pull request #24051 from taosdata/fix/TD-27839-3.0
enh: add check and reduce offset dependencies in lib
2023-12-14 10:19:02 +08:00
Haojun Liao
f0d63a977a refactor: do some internal refactor. 2023-12-14 10:01:57 +08:00
Haojun Liao
8e042e34cb refactor: do some internal refactor. 2023-12-14 09:48:14 +08:00
Haojun Liao
81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
Cary Xu
46f27a77f1
Update dmMgmt.h 2023-12-13 23:05:46 +08:00
Haojun Liao
26af397431
Merge pull request #24052 from taosdata/fix/3_liaohj
fix(tsdb): fix error in tsdb read.
2023-12-13 22:35:08 +08:00
Haojun Liao
105542bb21 fix(stream):handle the case of delete orphaned tasks. 2023-12-13 17:44:00 +08:00
Haojun Liao
88a8e4e9f0 fix(tsdb): fix syntax error. 2023-12-13 17:01:55 +08:00
Haojun Liao
840b457308 fix(tsdb): fix error in tsdb read. 2023-12-13 17:00:39 +08:00
kailixu
f685b6c34a enh: reduce offset dependencies in lib 2023-12-13 16:56:45 +08:00
dmchen
04366f2e68 revert dependency 2023-12-13 15:29:32 +08:00
wade zhang
fe0248afbc
Merge pull request #24029 from taosdata/fix/TS-4251-3.0
Fix/ts 4251 3.0
2023-12-13 11:05:51 +08:00
wade zhang
3be9af9765
Merge pull request #24039 from taosdata/FIX/TD-27843-3.0
enh: resend new snap replication msg on all acked if not finished yet
2023-12-13 09:51:31 +08:00
dmchen
e9cf639adb db is null 2023-12-13 01:04:34 +00:00
dmchen
71020e4812 show command db field is null 2023-12-13 00:53:33 +00:00
dapan1121
8528fb7a15
Merge pull request #23963 from taosdata/enh/xsren/TD-22212/taosQueryParam3.0
enh: td-22212 taos query param3.0
2023-12-13 08:24:39 +08:00
dmchen
4c9763d2c1 mem leak 2023-12-12 13:12:04 +00:00
Benguang Zhao
b1dd76b924 fix: assert on offset leq file.size in tsdbDataFileRAWWriterCloseCommit 2023-12-12 18:33:42 +08:00
dmchen
7e2ce6381f ci case 2023-12-12 07:24:13 +00:00
Hongze Cheng
613ca2c370
Merge pull request #23982 from taosdata/fix/PI-30-3.0
fix(tsdb/cache): remove malloc zero bytes
2023-12-12 15:22:38 +08:00
factosea
d25275713e ctest 2023-12-12 13:59:56 +08:00
dmchen
ea9eba5621 fix ci case 2023-12-12 05:34:41 +00:00
dmchen
dad76804e8 mem leak 2023-12-12 12:19:43 +08:00
dmchen
1547d95742 break dependency 2023-12-12 12:19:12 +08:00
dmchen
67e9f695c9 debug info and default setting 2023-12-12 12:18:35 +08:00
dmchen
daa2c2238a fix/TS-4251 2023-12-12 12:17:49 +08:00
facetosea
33897447cb ctest on linux exclude 2023-12-12 10:37:39 +08:00
Minglei Jin
c4bf9a92bc Merge branch '3.0' into enh/TD-27119 2023-12-11 19:38:04 +08:00
Minglei Jin
fe824c51e2 tsdb/cos: not remove cp files 2023-12-11 19:36:06 +08:00
dmchen
a861e55764 revert dependency 2023-12-11 11:24:31 +00:00
slzhou
2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
Haojun Liao
39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj
fix(tsdb): opt read stt file
2023-12-09 21:28:52 +08:00
Haojun Liao
9acd4af1f9 fix(tsdb):fix capacity rows value. 2023-12-09 01:49:55 +08:00
Haojun Liao
5528c2bf67 fix(tsdb): do some internal refactor. 2023-12-08 23:47:49 +08:00
Haojun Liao
f2592f7399 fix(tsdb): prepare the memory buffer. 2023-12-08 23:44:05 +08:00
Haojun Liao
da636ab527 fix(tsdb): add null check. 2023-12-08 18:55:20 +08:00
Haojun Liao
67d967e22f fix(tsdb): check the overlap between stt blocks and data file blocks. 2023-12-08 18:48:00 +08:00
dmchen
e8617812ae update progress rsp 2023-12-08 10:17:04 +00:00
Hongze Cheng
853fb6f119
Merge pull request #23987 from taosdata/fix/little_fix_3.0
fix: little fix
2023-12-08 17:29:24 +08:00
Hongze Cheng
f830fc2f4c more dev 2023-12-08 17:26:44 +08:00
Haojun Liao
63b34c7acf fix(tsdb): add check for not load stt file blocks. 2023-12-08 16:09:58 +08:00
dmchen
0be39ebe77 mem leak 2023-12-08 07:26:20 +00:00
Minglei Jin
2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
Hongze Cheng
a0487529d0 more fix 2023-12-08 14:37:21 +08:00
wade zhang
638e4c1f00
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0
feat: support tsdb snap replication of raw data mode
2023-12-08 14:36:16 +08:00
Haojun Liao
9c72ce846e fix(tsdb): add more condition for not load data. 2023-12-08 14:23:37 +08:00
Hongze Cheng
16068bab41
Merge pull request #23964 from taosdata/fix/TD-27707
fix(tsdb/cache): del from mem with time range
2023-12-08 14:22:08 +08:00
Hongze Cheng
b9d056c6a8 fix: little fix 2023-12-08 14:11:36 +08:00
dmchen
18dbc47949 break dependency 2023-12-08 04:24:33 +00:00
Haojun Liao
da1207ef74 fix(tsdb): add return flag for stt files. 2023-12-08 11:07:45 +08:00
Minglei Jin
d4dbb55669 fix(tsdb/cache): remove malloc zero bytes 2023-12-08 11:04:04 +08:00