Elgato_dark/TDengine
1
0
Fork 0
mirror of https://github.com/taosdata/TDengine synced 2026-05-24 10:09:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
67094 commits 554 branches 514 tags 1.7 GiB
Commit graph

9491 commits

Author SHA1 Message Date
liuyao
dc2f7872f8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-22 09:41:15 +08:00
wangmm0220
803b17a2db fix:memory leak 2023-09-22 09:31:58 +08:00
Haojun Liao
b1ba716299 refactor: do some internal refactor. 2023-09-22 09:24:36 +08:00
Haojun Liao
b075b4438b fix(stream): handle dispatch checkpoint-trigger failure. 2023-09-21 23:15:18 +08:00
Haojun Liao
3c921ba66e
Merge pull request #23006 from taosdata/fix/3_liaohj 
fix(tsdb): set the correct scaninfo to load the tomb data.
 2023-09-21 22:13:16 +08:00
Haojun Liao
f93df639c1 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 17:32:21 +08:00
Minglei Jin
ce1f866416 tsdb/reader: use pTsdb handle instead of pgsz to open file 2023-09-21 16:36:17 +08:00
kailixu
7445b9ff50 Merge branch '3.0' into enh/TS-3812-3.0 2023-09-21 16:25:06 +08:00
Haojun Liao
2efd155adf fix(stream): wait for the task checkpoint before stop. 2023-09-21 15:53:21 +08:00
Haojun Liao
0f97a21163 fix(tsdb): set the correct scaninfo to load the tomb data. 2023-09-21 15:21:01 +08:00
Haojun Liao
e4073bd9a8 fix(stream): update logs. 2023-09-21 14:03:14 +08:00
Haojun Liao
09accc71d2 log(stream): update log. 2023-09-21 14:01:41 +08:00
Haojun Liao
17586af0ce refactor: do refactor the sink task. 2023-09-21 13:32:57 +08:00
liuyao
3b3c5d7cb8 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-21 10:11:36 +08:00
wangmm0220
f9c5aa01af fix:enable split if there are topics & fix memory leak 2023-09-21 09:20:34 +08:00
Haojun Liao
6633fb971b fix(stream): update logs. 2023-09-20 18:18:31 +08:00
Minglei Jin
f206fa07d0 s3/put: use put2 2023-09-20 15:59:58 +08:00
Haojun Liao
2418f509ea fix(stream): avoid invalid read. 2023-09-20 15:47:09 +08:00
Haojun Liao
1d1d9a1b0b fix(stream): unlock when returning. 2023-09-20 15:45:15 +08:00
Haojun Liao
c8ab761d2a fix(stream): return if failed. 2023-09-20 15:38:49 +08:00
Haojun Liao
2a781c509f fix(stream): add task status check. 2023-09-20 15:32:15 +08:00
Minglei Jin
d155cfcf0f tsdb/readerwriter: use tsdb's s3 block cache to read file page 2023-09-20 15:24:54 +08:00
liuyao
1cebda368a session&state operator buff 2023-09-20 15:06:08 +08:00
Haojun Liao
af487c9048 fix(stream): fix obj. 2023-09-20 14:50:43 +08:00
Haojun Liao
361cde6497 fix(stream): fix deadlock caused by streamTaskHalt function. 2023-09-20 14:49:09 +08:00
Haojun Liao
55d4a9686c log(tsdb): remove some logs. 2023-09-20 13:18:42 +08:00
dm chen
4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
Haojun Liao
392aaeb592 log(stream): remove logs. 2023-09-20 10:49:18 +08:00
Haojun Liao
779c0c5f19
Merge pull request #22970 from taosdata/fix/liaohj 
fix(stream): keep the status entry in hash table, instead entry index.
 2023-09-20 10:33:05 +08:00
kailixu
a9d30f25d2 enh: rsma support delete raw data 2023-09-20 10:11:03 +08:00
wangmm0220
2881a2504c fix:conflicts from 3.0 2023-09-19 18:39:40 +08:00
dmchen
1a7bffb079 ci break 2023-09-19 18:01:38 +08:00
Haojun Liao
b99232fd7a fix(stream): limit the max scan times. 2023-09-19 17:45:28 +08:00
Haojun Liao
271e492188 refactor: update the log level. 2023-09-19 17:40:26 +08:00
wangmm0220
766652a88a fix:vnode tranform support in tmq 2023-09-19 17:27:19 +08:00
dm chen
ee913cbfbc
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-19 14:39:20 +08:00
dmchen
e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
wangmm0220
ad70dc178f fix:conflicts from 3.0 2023-09-19 11:56:52 +08:00
wangmm0220
edb42aa2aa fix:move from main to 3.0 2023-09-19 11:51:52 +08:00
Haojun Liao
e76bab7122 fix(stream): not handle the check msg for follower tasks. 2023-09-19 09:43:14 +08:00
slzhou
900aacd428 fix: fix sanitizer error 2023-09-19 09:40:00 +08:00
kailixu
6698861c8b chore: timeseries distribute 2023-09-19 08:29:51 +08:00
Hongze Cheng
b1797834c1 fix: set snapshot writer compression 2023-09-18 20:58:20 +08:00
wangmm0220
1e859084b7 fix:conflicts from 3.0 2023-09-18 19:57:33 +08:00
wangmm0220
4b74135350 fix:vnode tranform support in tmq 2023-09-18 19:47:28 +08:00
Haojun Liao
101161c52e
Merge pull request #22954 from taosdata/fix/TD-26323 
fix:core in race condition for pTq->pExecStore & return if poll too l…
 2023-09-18 17:41:01 +08:00
Haojun Liao
c33ef4ce88 fix(stream): add null check 2023-09-18 15:14:51 +08:00
wangmm0220
c3498fbfe8 fix:core in race condition for pTq->pExecStore & return if poll too long & fix test cases if submit empty 2023-09-18 14:35:07 +08:00
wangmm0220
7869b693f2 add test case for tmq in vnode transform & fix core in race condition for pTq->pExecStore 2023-09-18 14:09:28 +08:00
dmchen
b473122dac break dependency 2023-09-18 12:29:08 +08:00
dm chen
fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-18 09:41:47 +08:00
dmchen
c674e025e2 skip auto create tb 2023-09-18 09:29:51 +08:00
kailixu
8111c18cc4 chore: merge 3.0 2023-09-18 09:20:43 +08:00
Haojun Liao
8aa9960760
Merge pull request #22944 from taosdata/fix/liaohj 
refactor: do some internal refactor, and fix some bugs.
 2023-09-17 21:25:33 +08:00
Haojun Liao
01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao
4846194bbb refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node. 2023-09-16 21:37:30 +08:00
Haojun Liao
caa7542cea
Merge pull request #22913 from taosdata/fix/liaohj 
fix(stream): fix error in drop task.
 2023-09-16 21:36:38 +08:00
Haojun Liao
91e3d70796 fix(stream): remove fill-history sink task. 2023-09-15 17:46:17 +08:00
Minglei Jin
0181bb24d3 tsdb/readerwriter: use PRId64 instead of lld 2023-09-15 16:40:04 +08:00
Alex Duan
47f2c38a56
Merge pull request #22910 from taosdata/fix/TS-3987 
fix: delete data error
 2023-09-15 16:19:29 +08:00
Minglei Jin
318281356b s3/block_cache: new tsdb block cache 2023-09-15 16:19:21 +08:00
kailixu
03aea454d7 chore: more code 2023-09-15 14:33:35 +08:00
wade zhang
b123dd7df3
Merge pull request #22904 from taosdata/FIX/TD-26292-main 
enh: ignore compact req during restoring
 2023-09-15 11:05:18 +08:00
Haojun Liao
2bfd6e3355 refactor: do some internal refactor. 2023-09-15 09:25:22 +08:00
Haojun Liao
117de7ab7d fix(stream): fix error in drop task. 2023-09-15 00:51:13 +08:00
Haojun Liao
500fcad36c
Merge pull request #22892 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-09-15 00:46:46 +08:00
Haojun Liao
73c2782d78 fix(stream): update some logs. 2023-09-14 23:17:23 +08:00
Haojun Liao
5f55f489d8 fix(stream): fix memory leak. 2023-09-14 22:59:11 +08:00
Haojun Liao
303e8caf0c fix(stream): set the correct guard flag. 2023-09-14 22:44:16 +08:00
kailixu
449092c5dc enh: timeseries update optimize 2023-09-14 20:16:02 +08:00
Haojun Liao
27f626769e fix(stream): fix memory leak. 2023-09-14 19:33:05 +08:00
Haojun Liao
f2c3e0a6e8 fix(stream): disable follower send hb to mnode. and do some internal refactor. 2023-09-14 17:22:31 +08:00
Hongze Cheng
925cc8f55f fix: delete data error 2023-09-14 17:20:10 +08:00
Benguang Zhao
bbcbe460d4 enh: ignore compact req during restoring 2023-09-14 16:17:17 +08:00
Benguang Zhao
2886913fd8 enh: ignore compact req during restoring 2023-09-14 16:09:00 +08:00
Haojun Liao
fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
Haojun Liao
fd6344b319 fix(tsdb): check return code. 2023-09-14 09:25:35 +08:00
Haojun Liao
9b70c0c457 fix:fix coverity issue and remove unnecessary files. 2023-09-14 09:06:10 +08:00
wangmm0220
39fb5f4334 fix:add vnode snaphot for tmq 2023-09-13 18:09:47 +08:00
Haojun Liao
7305c8dbe1 refactor: do some internal refactor about the sched status set 2023-09-13 14:00:34 +08:00
wangmm0220
1dbd322fa0 fix:remove useless code 2023-09-13 11:42:09 +08:00
Haojun Liao
99477babca
Merge pull request #22872 from taosdata/fix/coverityScanDyh 
fix coverity scan problem
 2023-09-13 09:18:27 +08:00
Haojun Liao
09a15bf340 refactor: do some internal refactor. 2023-09-12 22:07:52 +08:00
Haojun Liao
60f5056ab7 other: merge 3.0 2023-09-12 22:00:40 +08:00
Haojun Liao
f6a097d96f refactor: do some internal refactor. 2023-09-12 21:58:22 +08:00
Haojun Liao
4325a0a433
Merge pull request #22866 from taosdata/fix/3_liaohj 
refactor: do  some internal refactor.
 2023-09-12 21:56:44 +08:00
yihaoDeng
8fc33dd74d fix coverity scan problem 2023-09-12 18:52:16 +08:00
Haojun Liao
e457d94ac6 refactor: do some internal refactor. 2023-09-12 18:09:02 +08:00
yihaoDeng
8e064cdd03 fix merge error 2023-09-12 16:41:14 +08:00
Haojun Liao
4d33387e80
Merge pull request #22814 from taosdata/fix/fixTransferCrash2 
fix merge error
 2023-09-12 16:10:07 +08:00
Haojun Liao
52931b530d
Merge pull request #22855 from taosdata/fix/3_liaohj 
fix(stream):check error when vnode is closing.
 2023-09-12 15:58:02 +08:00
dapan1121
ef7eb478e4
Merge pull request #22834 from taosdata/fix/TS-3945 
fix: remove incorrect assert
 2023-09-12 15:55:51 +08:00
yihaoDeng
63c53b6a3a fix transfer crash 2023-09-12 15:03:13 +08:00
yihaoDeng
ccb75a9c11 fix transfer crash 2023-09-12 14:46:56 +08:00
yihaoDeng
3e48f3639c fix transfer crash 2023-09-12 14:46:32 +08:00
wade zhang
f4e785788a
Merge pull request #22833 from taosdata/fix/TS-3943-3.m 
fix: neighbor block overlap judgement
 2023-09-12 11:51:03 +08:00
Haojun Liao
93159729f6 fix(stream):check error when vnode is closing. 2023-09-12 11:45:51 +08:00
Haojun Liao
025a2a3b50
Merge pull request #22846 from taosdata/fix/3_liaohj 
fix(tsdb): check the schema before merge rows in buffer
 2023-09-12 11:43:27 +08:00
yihaoDeng
6ce85f5cae fix transfer crash 2023-09-12 10:44:56 +08:00
Haojun Liao
f602aa965f fix(stream): fix coverity scan issues. 2023-09-12 09:16:18 +08:00
Haojun Liao
a5b93aaf97 fix(tsdb): fix invalid read. 2023-09-11 23:55:34 +08:00
Haojun Liao
e8f7146a2c fix(tsdb): check the schema before merge rows in buffer, and do some refactor. 2023-09-11 22:19:10 +08:00
Haojun Liao
cd1f0ea414
Merge pull request #22826 from taosdata/fix/3_liaohj 
fix(stream): set the correct start version for the step 2 stage in fill history.
 2023-09-11 21:43:58 +08:00
Haojun Liao
5ab739ae46 fix(stream): fix memory leak. 2023-09-11 15:29:12 +08:00
dapan1121
5c21f1ca22 fix: remove incorrect assert 2023-09-11 15:16:22 +08:00
kailixu
78d136dffd fix: neighbor block overlap judgement 2023-09-11 15:10:39 +08:00
Haojun Liao
c729fc989f fix(stream): set the init start timestamp. 2023-09-11 13:49:43 +08:00
Haojun Liao
0980e021e5 fix(stream): set the correct start version for the step 2 stage in fill history. 2023-09-11 13:37:19 +08:00
Haojun Liao
50ef500f51 refactor(stream): do sink module refactor. 2023-09-11 10:09:31 +08:00
Minglei Jin
443756c6ff fix(meta): null txn after abort 2023-09-11 08:55:30 +08:00
Haojun Liao
372747cc23
Merge pull request #22818 from taosdata/fix/3_liaohj 
fix(stream): fix error in fill history and check quit status of vnode.
 2023-09-10 20:47:06 +08:00
Haojun Liao
85a5c45098 fix(stream): limit the already processed data. 2023-09-10 00:01:25 +08:00
Haojun Liao
9a30573b8b fix(stream): disable scan wal when halt is set. 2023-09-09 16:12:08 +08:00
Haojun Liao
aa8909b267 other: add some logs. 2023-09-09 15:18:54 +08:00
Haojun Liao
6f5c855a4b fix(stream): fix msg lost bug. 2023-09-09 15:08:36 +08:00
Haojun Liao
47fd144447 other: add some logs. 2023-09-09 11:19:51 +08:00
yihaoDeng
af08289a06 Merge branch 'fix/mainNew' into fix/fixTransferCrash2 2023-09-08 19:58:21 +08:00
yihaoDeng
a0494695de fix merge error 2023-09-08 19:48:06 +08:00
Haojun Liao
b317c8ebff fix(stream): disable merge submit blocks. 2023-09-08 12:46:15 +08:00
Benguang Zhao
55a9668908 fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord 2023-09-07 17:26:30 +08:00
Benguang Zhao
2d5b18039d fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord 2023-09-07 17:14:50 +08:00
wade zhang
d3f0c5ac3e
Merge pull request #22770 from taosdata/fix/TD-25445-main 
fix/TD-25445: search memory in ttlMgrFindExpired
 2023-09-07 16:13:32 +08:00
Haojun Liao
55ac835294 Merge branch 'main' into fix/3_liaohj 2023-09-07 11:47:25 +08:00
Haojun Liao
b240e91c91 enh(stream): add token bucket to limit the rate of sink operation. 2023-09-07 09:58:48 +08:00
Shungang Li
a6ba7e678f fix: search memory in ttlMgrFindExpired 2023-09-07 09:33:26 +08:00
Haojun Liao
0f909285c4
Merge pull request #22684 from taosdata/mark/tmq-3.0 
fix:use vgstatus before if rebalance
 2023-09-07 09:20:27 +08:00
Haojun Liao
2b84e0b02e refactor: check if the put data into queue is success or failed. 2023-09-06 19:39:00 +08:00
Haojun Liao
8edf86b3bb fix(stream): add some logs. 2023-09-06 19:08:09 +08:00
Haojun Liao
5ba6a68e7a fix(stream): fix syntax error. 2023-09-06 19:00:39 +08:00
Haojun Liao
a82027f492 enh(stream): pack multi-datablock into one submit message. 2023-09-06 18:58:47 +08:00
wade zhang
e493f983ed
Merge pull request #22735 from taosdata/fix/TD-26133 
fix: coverity scan
 2023-09-06 18:45:23 +08:00
Haojun Liao
f8a321695a
Merge pull request #22711 from taosdata/fix/TD-26069-1 
fix rc
 2023-09-06 17:58:33 +08:00
Hongze Cheng
1d343fa57e more fix 2023-09-06 17:10:36 +08:00
Haojun Liao
926cc01cff refactor: do some internal refactor. 2023-09-06 16:48:43 +08:00
Hongze Cheng
cd88c8ec31 fix: little test 2023-09-06 14:45:53 +08:00
Haojun Liao
b382cba58c fix(stream): fix syntax error. 2023-09-06 14:37:58 +08:00
Haojun Liao
236b363996 fix(stream): fix syntax error. 2023-09-06 14:37:11 +08:00
Haojun Liao
8783ebcb02 enh(stream): add some logs and record the submit package performance. 2023-09-06 14:34:36 +08:00
Hongze Cheng
a6743a31b5 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-26133 2023-09-06 14:12:21 +08:00
dapan1121
698b0b21f7
Merge pull request #22630 from taosdata/enh/TS-3812-3.0 
enh: report time series by period and quantity
 2023-09-06 13:38:24 +08:00
Haojun Liao
e607a0a5cb fix(stream): add some logs. 2023-09-06 11:39:07 +08:00
dmchen
231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
Haojun Liao
c86eeb3938 fix(stream): add task status check when waiting for the table create. 2023-09-06 10:58:33 +08:00
wangmm0220
ef87b9c571 fix:conflicts from 3.0 2023-09-05 16:19:04 +08:00
wangmm0220
4e46ce4c03 fix:wait pHandle idle if vnode receives subscribe msg 2023-09-05 16:04:44 +08:00
Haojun Liao
ac8f4f1558
Merge pull request #22736 from taosdata/fix/fixTransferCrash 
fix invalid read
 2023-09-05 15:42:03 +08:00
yihaoDeng
d0503a8a3f fix invalid read 2023-09-05 12:11:58 +08:00
Hongze Cheng
8dbdeccc8f fix: coverity scan 2023-09-05 11:41:36 +08:00
wade zhang
8f27724f1f
Merge pull request #22701 from taosdata/fix/test_1x 
test: add stream cases to main
 2023-09-05 10:57:38 +08:00
Haojun Liao
0441c7a870 Merge branch 'fix/3_liaohj' of github.com:taosdata/tdengine into fix/3_liaohj 2023-09-05 10:40:48 +08:00
Haojun Liao
5b3cb8ec42 fix(stream): fix memory leak. 2023-09-05 09:27:16 +08:00
Haojun Liao
db8073dadd fix(stream): fix memory leak. 2023-09-04 23:13:57 +08:00
Haojun Liao
77eed06bcd
Merge branch '3.0' into fix/3_liaohj 2023-09-04 18:51:07 +08:00
Haojun Liao
aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao
ed22dd5f26 fix(stream): fix deadlock caused during merging branch. 2023-09-04 14:09:39 +08:00
Haojun Liao
375d0abea5 fix(stream): merge main. 2023-09-04 13:12:53 +08:00
Haojun Liao
21dab8ceab other: merge 3.0 2023-09-04 13:08:19 +08:00
yihaoDeng
03cddfa7ce fix rc 2023-09-04 10:33:01 +08:00
wangmm0220
fd85d5885a fix:add limit time for consume in 1 seconds 2023-09-01 16:57:49 +08:00
wangmm0220
02ac3eac5a fix:logic error 2023-09-01 16:51:44 +08:00
Haojun Liao
4fee5ba59a fix(stream): even in ck, start stream tasks. 2023-09-01 14:40:30 +08:00
dapan1121
cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
dapan1121
2141ac8460 Merge remote-tracking branch 'origin/main' into fix/m23.2 2023-09-01 11:21:38 +08:00
Hongze Cheng
113867081e enh: upgrade more efficiently 2023-09-01 10:16:10 +08:00
dapan1121
228e6c6acd Merge remote-tracking branch 'origin/main' into 3.0 2023-09-01 10:01:10 +08:00
Haojun Liao
e8294ed8dc fix(stream): fix bug in multi-replica vnode redistribute. 2023-09-01 03:10:12 +08:00
Haojun Liao
e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069 
fix invalid insert
 2023-08-31 18:29:25 +08:00
wangmm0220
a02ab4ccfb fix:coredump if saved epoch bigger than request epoch & modify test cases 2023-08-31 17:35:41 +08:00
yihaoDeng
1833be028f fix invalid insert 2023-08-31 15:28:31 +08:00
yihaoDeng
9fd0bff673 fix invalid insert 2023-08-31 14:57:26 +08:00
Haojun Liao
92e258617a refactor: do some internal refactor. 2023-08-31 14:31:45 +08:00
Haojun Liao
e2bb64eb18 refactor: do some internal refactor. 2023-08-31 14:23:46 +08:00
Haojun Liao
3fc3dafca6 refactor: do some internal refactor. 2023-08-31 13:46:48 +08:00
Haojun Liao
e53b5d4392 refactor: do some internal refactor. 2023-08-31 11:01:53 +08:00
Haojun Liao
0facde6ddc
Merge pull request #22659 from taosdata/fix/TD-26035 
fix(stream): do not restart the stream tasks when it is running.
 2023-08-31 10:16:59 +08:00
Haojun Liao
0c599fa869
Merge pull request #22415 from taosdata/szhou/tsdb-neigh-block 
tsdb neighbouring block search and set it to global block iterator
 2023-08-31 09:46:37 +08:00
wangmm0220
7f2a9a7262 fix:cancel the limit time for consume 2023-08-31 09:07:40 +08:00
wade zhang
68e4a72021
Merge pull request #22643 from taosdata/feat/audit-user-typestr 
alter user type to str
 2023-08-31 07:59:31 +08:00
wangmm0220
4f20359f43 fix:modify log level to trace 2023-08-30 23:57:48 +08:00
Haojun Liao
a2c6e4306a fix(stream): reset the counter. 2023-08-30 20:20:20 +08:00
Haojun Liao
fd2f988cdb fix(stream): reset the counter. 2023-08-30 20:19:51 +08:00
Haojun Liao
5d23df100c fix(stream): ignore the fill-history tasks. 2023-08-30 19:07:06 +08:00
Haojun Liao
65eaa9b15f fix(stream): add task release. 2023-08-30 19:06:12 +08:00
wangmm0220
23c4d7eb0a fix:dead lock 2023-08-30 18:10:19 +08:00
dmchen
3d9274d713 create table db name 2023-08-30 17:28:03 +08:00
Haojun Liao
d99d8875e1 fix(stream): if stream task is running, do not recheck its status. 2023-08-30 17:24:13 +08:00
Haojun Liao
c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao
24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
liuyao
0a72e576bd op stream pause 
pause data dispatch

opt stream pause
 2023-08-30 14:53:49 +08:00
kailixu
1a34cd1020 chore: optimize of report time series by quantity 2023-08-30 11:45:07 +08:00
kailixu
8e20740622 enh: report time series by quantity 2023-08-30 11:39:21 +08:00
dapan1121
f6321d0c4f Merge remote-tracking branch 'origin/main' into fix/m23.1 2023-08-30 11:03:33 +08:00
Haojun Liao
dec4d69529 fix(stream): set correct user-define table name in sink table info cache. 2023-08-30 10:52:39 +08:00
Haojun Liao
3a7a220d43 fix(stream): fix error found by ci. 2023-08-30 10:14:01 +08:00
kailixu
9d1ac801ed Merge branch '3.0' into enh/TS-3812-3.0 2023-08-30 09:27:17 +08:00
Haojun Liao
610132e29a
Merge pull request #22633 from taosdata/fix/update_db_attr 
fix(tsdb): add more check for block rows
 2023-08-29 22:05:57 +08:00
wade zhang
701ac939c1
Merge pull request #22632 from taosdata/fix/ttl 
fix/TD-26032: ttl cache entry record the original information for deletion
 2023-08-29 18:27:50 +08:00
Haojun Liao
8dadae5d3a fix(stream): fix invalid read. 2023-08-29 18:24:32 +08:00
Haojun Liao
d6368798da fix(query): disable the set quit flag for tsdbreader. 2023-08-29 18:11:17 +08:00
Haojun Liao
b740ce8ad6 fix(tsdb): add more check for block rows to detect the duplicate rows in data block. 2023-08-29 17:49:43 +08:00
Haojun Liao
204fb97f68 fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task. 2023-08-29 17:34:31 +08:00
Shungang Li
df2b2484df fix: ttl cache entry record the original information for deletion 2023-08-29 17:18:22 +08:00
Minglei Jin
82fc1f41fb fix(tsdb/cache read): remove all null row 2023-08-29 16:15:00 +08:00
kailixu
f00596868f fix: remove duplicated line 2023-08-29 16:12:49 +08:00
kailixu
db07511c93 enh: report time series by period and quantity 2023-08-29 16:08:51 +08:00
wade zhang
53a24e04f2
Merge pull request #22604 from taosdata/feat/audit-db-detail 
audit db detail
 2023-08-29 15:46:10 +08:00
Haojun Liao
6e4acddd96
Merge pull request #22603 from taosdata/fix/TD-25962 
fix:unregister push manager if delete subscribe to avoid tqProcessPol…
 2023-08-29 10:58:49 +08:00
Minglei Jin
432eaf5110 Merge branch '3.0' into fix/TD-25963 2023-08-29 10:51:53 +08:00
Minglei Jin
b88d79d2ef fix(tsdb/open fs): fix retval 2023-08-29 10:33:20 +08:00
wade zhang
ff6de8ebe2
Merge pull request #22600 from taosdata/fix/TD-25010-10 
enh(s3/evict): evict cache data files for other migrated head, stt, etc.
 2023-08-28 18:12:40 +08:00
dmchen
1372cede48 init 2023-08-28 17:44:10 +08:00
dapan1121
778e50da79
Merge pull request #22592 from taosdata/fix/m23.0 
Fix/m23.0
 2023-08-28 17:35:35 +08:00
wangmm0220
2e04d513a4 fix:unregister push manager if delete subscribe to avoid tqProcessPollPush 2023-08-28 16:41:28 +08:00
Minglei Jin
9ef455a454 enh(s3/evict): evict cache data files for other migrated head, stt, etc. 2023-08-28 15:57:13 +08:00
Haojun Liao
05bb164675 fix(stream): release tasks. 2023-08-28 15:56:02 +08:00
Haojun Liao
391103bc5a fix(stream): do dome internal refactor. 2023-08-28 15:54:01 +08:00
Haojun Liao
33672f2f35 fix(stream): release stream tasks. 2023-08-28 15:52:54 +08:00
wade zhang
cd3702e91c
Merge pull request #22596 from taosdata/fix/TD-25963 
fix(tsdb/s3): fix scan and fix with s3 files
 2023-08-28 15:19:47 +08:00
Minglei Jin
f299ae9bc3 fix(tsdb/s3): fix scan and fix with s3 files 2023-08-28 12:22:53 +08:00
Haojun Liao
da0b4e1f92 Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-28 10:55:38 +08:00
dapan1121
0cce255a02 Merge remote-tracking branch 'origin/3.0' into fix/m23.0 2023-08-28 10:06:53 +08:00
Haojun Liao
b75ae217f6 fix(stream): notify close for snode. 2023-08-28 09:53:08 +08:00
Haojun Liao
b11975f00c
Merge pull request #22534 from taosdata/mark/tmq 
fix:[TD-258900]modify tmq trans conflict to db level
 2023-08-28 09:45:47 +08:00
dapan1121
1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
dmchen
06083e1eb9 init 2023-08-28 09:15:51 +08:00
dapan1121
cda08087b9
Merge pull request #22586 from taosdata/fix/TD-25936.3 
fix: no explain response issue
 2023-08-28 08:52:13 +08:00
Haojun Liao
6b327886e9 fix(stream): add null ptr check. 2023-08-27 00:27:04 +08:00
Haojun Liao
d8a6ec024a Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 19:21:00 +08:00
Haojun Liao
7ceb8dc627 fix(stream): disable the follower to execute the stop/resume instruction. 2023-08-25 19:20:49 +08:00
yihaoDeng
22b8d90fbc fix invalid read 2023-08-25 18:34:11 +08:00
wangmm0220
047707fa17 fix:error in privilege 2023-08-25 17:56:17 +08:00
Haojun Liao
43a3f9f535 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-25 17:32:50 +08:00
Haojun Liao
e013ba6795 fix(stream): fix the counter. 2023-08-25 17:32:34 +08:00
Minglei Jin
f0fdbaa3f3 fix(tsdb/close): fix uaf with file closing 2023-08-25 17:27:32 +08:00
Haojun Liao
60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-25 15:49:28 +08:00
Haojun Liao
ab2aad2b2c fix(stream): update the task status even it is in stop status. 2023-08-25 15:32:55 +08:00
dapan1121
e24498b0fd enh: add task notify 2023-08-25 14:59:34 +08:00
Hongze Cheng
e1095e7d02 fix: improve upgrade speed 2023-08-25 14:40:29 +08:00
Haojun Liao
4c7ad54c9c fix(stream): not restart tasks when in restoring procedure. 2023-08-25 11:28:28 +08:00
Haojun Liao
38bb123701 fix(stream): release task. 2023-08-25 10:33:15 +08:00
Haojun Liao
ce1a3a379c fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived. 2023-08-25 10:12:12 +08:00
Haojun Liao
6f514b2bee
Merge pull request #22561 from taosdata/fix/TD-25651 
fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no…
 2023-08-25 09:09:41 +08:00
wade zhang
abe97e1e21
Merge pull request #22566 from taosdata/fix/TD-25952 
enh(tsdb/openfile): lazy file open to read/write
 2023-08-25 07:57:52 +08:00
Haojun Liao
f7ea875af1 fix(stream): add some logs. 2023-08-24 23:27:48 +08:00
Haojun Liao
f7dada53b9
Merge pull request #22559 from taosdata/fix/liaohj 
other: merge main.
 2023-08-24 19:01:18 +08:00
Haojun Liao
82e356a9b5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/dnode/vnode/src/tq/tq.c
 2023-08-24 18:04:44 +08:00
Haojun Liao
70396aa5a5 fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure. 2023-08-24 17:54:50 +08:00
yihaoDeng
286ac3e3fc fix merge error 2023-08-24 17:35:53 +08:00
yihaoDeng
9310d138a6 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-24 17:30:35 +08:00
yihaoDeng
8883d66227 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-24 17:20:12 +08:00
yihaoDeng
090515c684 refactor code 2023-08-24 17:20:04 +08:00
Haojun Liao
caf20d7b5d fix(stream): release the stream task. 2023-08-24 17:16:34 +08:00
Minglei Jin
70871139bf enh(tsdb/openfile): lazy file open to read/write 2023-08-24 17:16:28 +08:00
wangmm0220
b83cc11043 fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no data 2023-08-24 16:38:53 +08:00
wangmm0220
49216ffa54 fix:transaction in tmq 2023-08-24 16:32:15 +08:00
Haojun Liao
7d9d4ae850 fix(stream): fix the ptr ref. 2023-08-24 16:26:30 +08:00
Haojun Liao
5344efe181 fix(stream): adjust the ptr. 2023-08-24 16:22:24 +08:00
Haojun Liao
4c6bc4d2c3 fix(stream): continue check wal when meeting empty delete block msg. 2023-08-24 16:10:03 +08:00
Haojun Liao
523bad3951 fix(stream): continue check wal when meeting empty delete block msg. 2023-08-24 15:45:43 +08:00
Haojun Liao
2c9f28d97f Merge branch 'main' into fix/liaohj 2023-08-24 14:12:15 +08:00
wangjiaming0909
7fad1de841 Revert "feat: show create table, desc table with col comments" 
This reverts commit 16754b5ac1.
 2023-08-24 13:38:41 +08:00
wade zhang
0860670d37
Merge pull request #22526 from taosdata/enh/TD-25445-new 
enh/TD-25445: ttl split flush and drop table
 2023-08-24 13:57:07 +08:00
shenglian-zhou
e76e6bbb84
Update tsdbReadUtil.c 2023-08-24 11:34:56 +08:00
shenglian-zhou
1965703d53
Merge branch '3.0' into szhou/tsdb-neigh-block 2023-08-24 10:58:23 +08:00
yihaoDeng
3afea998ac refactor log 2023-08-24 10:15:15 +08:00
Haojun Liao
230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
Haojun Liao
b0c5fa8290 fix(stream): reset the task status. 2023-08-23 14:10:41 +08:00
Hongze Cheng
a601cd21bd fix: alter stt_trigger bug 2023-08-23 13:31:19 +08:00
Shungang Li
458fd07976 enh: ttl split flush and drop table 
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
 2023-08-23 11:13:34 +08:00
wade zhang
8c4062c1b0
Merge pull request #22515 from taosdata/fix/TD-25819-2 
fix(tsdb/file): save errno for shell reporting
 2023-08-23 10:49:48 +08:00
wade zhang
e069d72229
Merge pull request #22513 from taosdata/FIX/TD-25864-3.0 
enh: adjust the order of pre-close actions in vnodePreClose
 2023-08-22 17:27:17 +08:00
Haojun Liao
af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Minglei Jin
345743aba5 fix(tsdb/file): save errno for shell reporting 2023-08-22 14:44:32 +08:00
Haojun Liao
cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Benguang Zhao
8be670aee8 enh: place vnodeSyncPreStop ahead of vnodeQueryPreStop in vnodePreClose 2023-08-22 11:30:40 +08:00
Haojun Liao
64556c9f1d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-22 10:47:02 +08:00
Haojun Liao
def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen
b899a8b7df
Merge branch '3.0' into feat/TD-22970 2023-08-22 10:12:30 +08:00
yihaoDeng
1531e2d7d3 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-22 09:51:38 +08:00
Haojun Liao
873c22abb1 fix(stream): reset update stream tasks. 2023-08-21 19:32:27 +08:00
Haojun Liao
8b27f98ee4 refactor: do some internal refactor. 2023-08-21 19:08:27 +08:00
yihaoDeng
387b4d365e refactor checkpoint 2023-08-21 19:07:15 +08:00
Hongze Cheng
b8d62a86ed feat: clean useless file 2023-08-21 16:29:48 +08:00
Haojun Liao
29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
dm chen
dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
wade zhang
54e1f69db4
Merge pull request #22481 from taosdata/fix/TD-25822 
enh(tsdb/write): timestamp out of range with s3's last tier storage
 2023-08-21 09:33:06 +08:00
yihaoDeng
6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao
b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Minglei Jin
c4a3a5da35 vnode: fix write to s3 last tier 2023-08-18 18:02:53 +08:00
wade zhang
a7e11c2520
Merge pull request #22482 from taosdata/fix/TD-25818 
fix(vnode/destroy): delete objects
 2023-08-18 17:49:22 +08:00
wade zhang
87a8fe34ef
Merge pull request #22480 from taosdata/fix/TD-25819 
fix(tsdb/reader): use ENOENT for not found objects
 2023-08-18 16:49:54 +08:00
Minglei Jin
7b4bb72392 fix(vnode/destroy): delete objects 2023-08-18 16:38:26 +08:00
Minglei Jin
0242d4ce33 enh(tsdb/write): timestamp out of range with s3's last tier storage 2023-08-18 16:07:15 +08:00
Haojun Liao
c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
Minglei Jin
73ae493fa7 tsdb/reader: use ENOENT for not found objects 2023-08-18 15:43:08 +08:00
liuyao
9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao
87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121
9b953707b8 Merge remote-tracking branch 'origin/main' into fix/mainto3.0 2023-08-18 14:42:43 +08:00
Haojun Liao
edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
dm chen
e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
Haojun Liao
a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao
633ecf66e5 other: add logs. 2023-08-18 10:39:32 +08:00
Haojun Liao
9ad8cf48dc other: add logs. 2023-08-18 10:38:24 +08:00
Haojun Liao
87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
slzhou
4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
Hongze Cheng
8582e0c71a fix: important fix for compact file corruption 2023-08-17 18:13:37 +08:00
dmchen
5f138941f8 tsdb snap core 2023-08-17 17:58:35 +08:00
slzhou
85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
Benguang Zhao
7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou
4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121
0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685 
feat: support column comment
 2023-08-17 14:23:54 +08:00
wangjiaming0909
16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
liuyao
5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
wade zhang
e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug 
fix: tsdb snapshot bug
 2023-08-17 08:25:32 +08:00
Haojun Liao
6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
 2023-08-17 00:08:44 +08:00
Haojun Liao
ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao
f8f8e7a8f0
Merge pull request #22465 from taosdata/fix/3_liaohj 
fix(stream): add the back pressure for sink node.
 2023-08-16 22:59:36 +08:00
yihaoDeng
114df7c349 fix transfer error 2023-08-16 11:37:15 +00:00
Haojun Liao
80506b564b
Merge pull request #22461 from taosdata/fix/liaohj 
refactor: do some internal refactcor
 2023-08-16 19:26:39 +08:00
Haojun Liao
9a76ae72d6 fix(stream): add the back pressure for sink node. 2023-08-16 19:11:43 +08:00
Hongze Cheng
32c5b6a947 fix: tsdb snapshot bug 2023-08-16 18:21:02 +08:00
Haojun Liao
cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
dmchen
fee4b875d1 error code 2023-08-16 17:49:17 +08:00
Hongze Cheng
cedc7bf1b6 fix: memory leak when commit 2023-08-16 17:21:51 +08:00
yihaoDeng
ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen
e020c4e8c5
Merge pull request #22456 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-16 16:49:43 +08:00
Haojun Liao
f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-16 16:48:33 +08:00
Haojun Liao
d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
yihaoDeng
993ae84398 close backend 2023-08-16 07:17:15 +00:00
Haojun Liao
4ea58e5682 refactor: do some internal refactor. 2023-08-16 11:44:05 +08:00
Haojun Liao
6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
dmchen
de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
liuyao
919ffbaf72 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 10:04:07 +08:00
Haojun Liao
63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0 
rebuild index at tag0
 2023-08-16 09:47:43 +08:00
liuyao
fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
Haojun Liao
ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao
7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
dapan1121
df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt 
enhance: tag scan optimization
 2023-08-16 08:58:17 +08:00
wade zhang
1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3 
feat(tsdb/cos): s3 migration
 2023-08-16 08:02:20 +08:00
slzhou
4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
Benguang Zhao
239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
Minglei Jin
1792bf306e vnode: fix cos cache evicting 2023-08-15 16:54:26 +08:00
Haojun Liao
39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Minglei Jin
c4e5cfd2fb retention: return code from copy 2023-08-15 15:40:40 +08:00
Minglei Jin
bd758e0269 retention: remove old files last 2023-08-15 15:14:34 +08:00
Minglei Jin
8639c22cc0 vnode, common: USE_COS def 2023-08-15 14:53:58 +08:00
liuyao
1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
Haojun Liao
b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao
ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq 
opti:wal logic
 2023-08-15 09:16:29 +08:00
Haojun Liao
9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559 
feat:[TD-24559]support geomety type in schemaless
 2023-08-14 22:06:41 +08:00
liuyao
9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
Haojun Liao
2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
yihaoDeng
cf9f9ab471 rebuild index at tag0 2023-08-14 08:01:20 +00:00
Haojun Liao
a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Minglei Jin
989abc2bf6 vnode/cos: move includes into USE_COS 2023-08-14 15:03:17 +08:00
Haojun Liao
91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Minglei Jin
c97b9249fc cos: only for linux 2023-08-14 14:38:28 +08:00
slzhou
692d436d68 fix: fix ci error 2023-08-14 14:14:16 +08:00
Haojun Liao
5ec6b64aab fix(stream): add logs. 2023-08-14 13:12:41 +08:00
Haojun Liao
ead04964fd Merge branch 'main' into fix/liaohj 2023-08-14 12:11:15 +08:00
dapan1121
c2417eb5cd
Merge pull request #22404 from taosdata/fix/TD-25621-3.0 
fix: dup read lock on windows
 2023-08-14 11:37:05 +08:00
Haojun Liao
2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
slzhou
646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
yihaoDeng
246efd83c6 refactor chpt transfer 2023-08-14 02:03:41 +00:00
wangmm0220
dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
wade zhang
1b51f53c15
Merge pull request #22407 from taosdata/fix/TD-25671 
fix: infinite tomb data sync loop
 2023-08-14 09:25:47 +08:00
shenglian zhou
46f92d222d fix: typo error 2023-08-14 08:52:25 +08:00
shenglian zhou
db25f6c01b Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block 2023-08-14 08:49:25 +08:00
shenglian zhou
c5a6cac34f fix: fix compilation error 2023-08-14 08:49:10 +08:00
Haojun Liao
01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj 
refactor: refactor the transfer state procedure.
 2023-08-13 23:28:18 +08:00
slzhou
8e7fc91095 enhance: set file data block iter 2023-08-13 18:30:30 +08:00
Haojun Liao
0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao
ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
wangmm0220
efb472d54a fix:heap use after free 2023-08-12 10:15:40 +08:00
Haojun Liao
f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
wangmm0220
767563752a opti:wal logic 2023-08-11 20:21:13 +08:00
wangmm0220
deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
Hongze Cheng
847bc0da08 fix: infinite tomb data sync loop 2023-08-11 18:10:16 +08:00
slzhou
47d2f9ad6d fix: first run without tag cond 2023-08-11 17:52:52 +08:00
wangmm0220
7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou
42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
Minglei Jin
84452c8dee cos: use static sdk 2023-08-11 16:36:53 +08:00
shenglian zhou
eb9d77d639 ehance: destroy blocklist of table scan info, add block global index list to table scan info 2023-08-11 16:33:49 +08:00
Haojun Liao
87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng
6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao
e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
wangmm0220
25e32bbf7c fix:offset error in tmq & add test cases 2023-08-11 14:25:12 +08:00
Haojun Liao
9322f80343 fix(stream): register the rsp callback. 2023-08-11 13:31:50 +08:00
kailixu
64a1636dd2 chore: trigger CI 2023-08-11 12:54:45 +08:00
kailixu
1d089fe085 fix: dup read lock on windows 2023-08-11 11:34:57 +08:00
yihaoDeng
99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao
1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao
6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng
ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
Haojun Liao
d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq 
fix:offset error in tmq & add test cases
 2023-08-11 10:00:08 +08:00
Minglei Jin
4513acfee9 cos: use static libs for mxml, apr, apu, curl 2023-08-11 09:54:54 +08:00
yihaoDeng
32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
shenglian zhou
b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
wangmm0220
78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
Minglei Jin
c04ada3573 cos: link with static libs 2023-08-10 15:28:22 +08:00
Minglei Jin
cd63e81450 cos: separate building phase for apr & apr-util 2023-08-10 14:18:12 +08:00
dm chen
dd271bca6d
Merge pull request #22394 from taosdata/3.0 
merge 3.0 to feat/TD-22970
 2023-08-10 14:14:22 +08:00
Haojun Liao
a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
Haojun Liao
161fd6902a fix(stream): fix the acquire task. 2023-08-10 12:45:20 +08:00
Minglei Jin
33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao
f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao
b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj 
other: merge main.
 2023-08-10 11:43:02 +08:00
yihaoDeng
ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao
c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao
4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao
0757e88ced fix(stream): set the correct hash keys. 2023-08-09 23:52:14 +08:00
Haojun Liao
7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
wangmm0220
1f5532fd67 fix:offset error in tmq & add test cases 2023-08-09 19:41:22 +08:00
Minglei Jin
a853d9d40c mxml: use ~/local/include 2023-08-09 18:21:55 +08:00
Haojun Liao
1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao
4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Hui Li
584427dd44
Merge pull request #22374 from taosdata/szhou/restore-minglei-main 
fix: restore stt/block merge back
 2023-08-09 14:40:03 +08:00
Minglei Jin
b08d5b4d42 mxml: add include dir to vnode 2023-08-09 14:02:10 +08:00
Minglei Jin
7e2859ed43 apr: use tarball to avoid ./buildconf 2023-08-09 13:03:37 +08:00
Haojun Liao
3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
Minglei Jin
2e0519b960 apr: fix apr & apr-util project names 2023-08-09 11:01:42 +08:00
Minglei Jin
7114ad63e5 apr：makefile for apr & apr-util 2023-08-09 10:54:17 +08:00
Minglei Jin
4d1155a5cf curl: makefile for curl 2023-08-09 10:43:27 +08:00
shenglian zhou
e9e06d1eae fix: restore stt block/data block merge back 2023-08-09 10:36:54 +08:00
shenglian zhou
2b1478f46e Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-09 10:36:26 +08:00
Haojun Liao
f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
Minglei Jin
16e015253b s3/mxml: remove os external dependency 2023-08-09 10:10:25 +08:00
Haojun Liao
bb39d94f9c
Merge pull request #22357 from taosdata/fix/liaohj 
other: merge fix from 3.0 to main.
 2023-08-09 09:05:54 +08:00
wangmm0220
d322cfce50 fix:add hashIteratorCancel for hash iterator 2023-08-08 16:28:51 +08:00
Haojun Liao
17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Hongze Cheng
c8f106106a fix: update assert issue 2023-08-08 14:49:05 +08:00
dm chen
70a598f072
Merge pull request #22355 from taosdata/3.0 
merge 3.0 to TD-22970
 2023-08-08 09:53:07 +08:00
Hui Li
05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612 
fix: snapshot invalid read
 2023-08-08 09:19:55 +08:00
Haojun Liao
458143c8b7
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei 
fix: restore stt block and data block merge back
 2023-08-08 08:58:02 +08:00
Haojun Liao
f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao
ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj 
other: merge main and fix bugs in stop stream tasks.
 2023-08-07 22:57:13 +08:00
Haojun Liao
aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
shenglian zhou
ec1270f75c fix: restore stt block/data block merge back 2023-08-07 17:17:12 +08:00
Minglei Jin
9e4da6c089 s3/config: parsing s3 configuration 2023-08-07 17:14:58 +08:00
shenglian zhou
9ddab11d98 Revert "fix(tsdb/read2): reset stt reader when suspended" 
This reverts commit 079d7ff69e.
 2023-08-07 17:13:49 +08:00
yihaoDeng
b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng
eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao
e6b80e6c52 Merge branch '3.0' into fix/3_liaohj 2023-08-07 16:26:31 +08:00
Haojun Liao
225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Hongze Cheng
a545d45b5e fix: snapshot invalid read 2023-08-07 16:12:03 +08:00
Minglei Jin
fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
Hongze Cheng
661f2aca98 fix: memory leak 2023-08-07 14:13:44 +08:00
wangmm0220
9ecabb30f5 fix:ref is not there 2023-08-07 10:27:44 +08:00
wangmm0220
5f02e2ddfb fix:ref is not there 2023-08-07 09:31:29 +08:00
Haojun Liao
8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
wangmm0220
d9a1695257 fix:add log 2023-08-04 18:07:44 +08:00
Minglei Jin
65d8af19ed s3: new api s3Size 2023-08-04 16:35:35 +08:00
Minglei Jin
87783a9650 s3query/get: pull object to local 2023-08-04 15:37:52 +08:00
Minglei Jin
ebd09ca532 tsdb/write: use keep1 as minKey instead of keep2 2023-08-04 13:44:17 +08:00
Minglei Jin
88d755be76 feat(tsdb/cos): s3 migration 2023-08-04 13:31:00 +08:00
wade zhang
abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main 
fix: keep stt iterator valid in the list
 2023-08-04 08:02:16 +08:00
slzhou
fef091b13d fix: keep the stt iterator valid 2023-08-03 21:50:50 +08:00
shenglian zhou
b85c1ae8a1 fix: remove the core 2023-08-03 21:50:50 +08:00
shenglian zhou
5322e38dfe fix: add init add check it 2023-08-03 21:50:50 +08:00
shenglian zhou
97b15ed718 fix: delete SLDataItem if stt level files num is smaller 2023-08-03 21:50:50 +08:00
slzhou
1cb1451e41 fix: set nextIndex when get neighbouring index 2023-08-03 18:26:29 +08:00
dm chen
5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng
f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
wade zhang
68f2018246
Merge pull request #22289 from taosdata/szhou/fix-25385 
fix: keep stt iterator valid
 2023-08-02 20:22:54 +08:00
wade zhang
13c713d33b
Merge pull request #22290 from taosdata/3.0_main 
merge 3.0 into branch main
 2023-08-02 16:04:08 +08:00
Hongze Cheng
f90f0b7047 disable infinite count loop 2023-08-02 15:51:51 +08:00
Minglei Jin
cff85550f9 Merge branch '3.0' into 3.0_main 2023-08-02 14:10:45 +08:00
wade zhang
c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400 
enh(tsdb/cache/read): lazy init table map hash and entries
 2023-08-02 14:08:43 +08:00
Haojun Liao
0feffc687b fix(tsdb): check uid in multiple stt statistics blocks. 2023-08-02 12:44:45 +08:00
Minglei Jin
0e51277521 cache/reader: cleanup contiue nex row 2023-08-02 12:43:57 +08:00
Haojun Liao
2c357f1958 fix(stream): enable filter table based on table statistics. 2023-08-02 11:18:35 +08:00
Minglei Jin
7fca057a81 cache/reader: move pLastCols into single block 2023-08-02 11:10:12 +08:00
slzhou
dd8e893508 fix: keep the stt iterator valid 2023-08-02 11:02:27 +08:00
Minglei Jin
95cc540d9b cache/reader: clean uid in all loop 2023-08-02 10:48:55 +08:00
shenglian zhou
38e797b4ff fix: remove the core 2023-08-02 10:43:26 +08:00
shenglian zhou
d5ca51e94d fix: add init add check it 2023-08-02 10:43:26 +08:00
shenglian zhou
6bf95c0c4d fix: delete SLDataItem if stt level files num is smaller 2023-08-02 10:43:26 +08:00
Haojun Liao
13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Minglei Jin
ed76525c4f cache/reader: cleanup uid in signle loop 2023-08-02 10:28:13 +08:00
Minglei Jin
29b2f32821 cache reader: cleanup stt init 2023-08-02 09:49:41 +08:00
Haojun Liao
53aefa531f Merge branch '3.0' into fix/3_liaohj 2023-08-02 09:45:21 +08:00
Haojun Liao
e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Hongze Cheng
4ba4e83b5b fix: retention file corruption 2023-08-01 20:19:13 +08:00
Minglei Jin
7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin
a593e887fa cache: remove nFileset from fs state 2023-08-01 18:37:23 +08:00
Minglei Jin
7ad628417a fix mem issue: stack-use-after-scope 2023-08-01 17:57:38 +08:00
Minglei Jin
4716fc6400 cache/fs: remove fs state's tsdb handle 2023-08-01 17:49:05 +08:00
Minglei Jin
1d5532019f tsdb/merge-tree: cleanup comment 2023-08-01 17:25:15 +08:00
Minglei Jin
f72f129d41 cache/skyline: cleanup del array 2023-08-01 17:23:53 +08:00
Minglei Jin
c997662ba0 tsdb/cache: build skyline only if there's del data 2023-08-01 16:50:00 +08:00
Minglei Jin
94b9599f95 fix null pointer dereference 2023-08-01 16:39:14 +08:00
Haojun Liao
637f09359a other: merge main. 2023-08-01 16:15:34 +08:00
Minglei Jin
72ac5a4e3b tsdb/cache: use read util's uid compare functor 2023-08-01 16:08:20 +08:00
Minglei Jin
c0a0e07597 cache/read: lazy init uidList when laoding from tsdb 2023-08-01 16:02:09 +08:00
Minglei Jin
b3fae65d90 enh(tsdb/cache/read): lazy init table map hash and entries 2023-08-01 15:53:42 +08:00
Hongze Cheng
78c23f407e fix compile issue 2023-08-01 15:04:14 +08:00
Hongze Cheng
07c40943a4 fix: TD-25408 2023-08-01 15:01:06 +08:00
wade zhang
347e78ecb5
Merge pull request #22272 from taosdata/fix/TD-25466 
Fix/td 25466
 2023-08-01 14:22:24 +08:00
Hongze Cheng
1b39147496 more refact 2023-08-01 11:36:37 +08:00
Hongze Cheng
0e46041c1a fix: tsdbRetention memory leak 2023-08-01 11:21:40 +08:00
Haojun Liao
ae9745ecf2
Merge pull request #22258 from taosdata/mark/tmq-3.0 
fix:add committed & seek process logic
 2023-08-01 09:52:09 +08:00
Haojun Liao
ea875c58f2
Merge pull request #22263 from taosdata/mark/tmq-main 
fix:add committed & seek process logic
 2023-08-01 09:43:23 +08:00
Haojun Liao
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457 
check update data
 2023-07-31 22:56:05 +08:00
Haojun Liao
2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj 
fix(stream): set the correct end key of delete block.
 2023-07-31 22:55:50 +08:00
wangmm0220
68ae64cdb2 fix:add committed & seek process logic 2023-07-31 18:53:25 +08:00
wangmm0220
cddf27e8b4 fix:add committed & seek process logic 2023-07-31 18:48:50 +08:00
Haojun Liao
d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
wangmm0220
6179618b17 fix:add committed & seek process logic 2023-07-31 17:56:04 +08:00
liuyao
32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
wangmm0220
8093ef2dc8 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-31 16:14:25 +08:00
Haojun Liao
9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Minglei Jin
079d7ff69e fix(tsdb/read2): reset stt reader when suspended 2023-07-31 15:21:47 +08:00
wade zhang
c7fa5ed6ef
Merge pull request #22247 from taosdata/fix/TD-25436 
fix(tsdb/cache): check stt data with empty brin index
 2023-07-31 11:24:37 +08:00
Minglei Jin
135beebc0a fix(tsdb/cache): check stt data with empty brin index 2023-07-31 09:15:08 +08:00
wade zhang
bae028d65c
Merge pull request #22230 from taosdata/mark/tmq 
fix:semaphore always wait in tmq commit logic
 2023-07-31 09:10:13 +08:00
wade zhang
c26165975d
Merge pull request #22227 from taosdata/fix/TS-3728 
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
 2023-07-30 14:28:56 +08:00
Haojun Liao
8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao
0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
Haojun Liao
f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
wade zhang
c19feb2fa1
Merge pull request #22236 from taosdata/fix/TD-25416 
fix(tsdb/cache/del): use lru mutex to fix race with committing
 2023-07-28 23:17:45 +08:00
Haojun Liao
936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao
d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
Minglei Jin
1fcbf3432c tsdb/cache/del: remove duplicate lruMutex lock 2023-07-28 17:20:20 +08:00
wangmm0220
d982a7cb80 fix:heap use after free for wal 2023-07-28 16:59:35 +08:00
Minglei Jin
b0f65dfa62 fix(tsdb/cache/del): use lru mutex to fix race with committing 2023-07-28 16:32:07 +08:00
wangmm0220
6e673072cd fix:conflicts 2023-07-28 14:57:13 +08:00
Haojun Liao
9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao
74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao
2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj 
other: merge main.
 2023-07-28 13:06:17 +08:00
wangmm0220
2f6c565392 fix:pHandle not load if taosd restart 2023-07-28 11:48:53 +08:00
wade zhang
b3e5b5bd24
Merge pull request #22217 from taosdata/fix/TD-25386 
fix(tsdb/cache): move to stt next row if data file exausted
 2023-07-28 08:56:29 +08:00
Haojun Liao
ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj 
fix(stream): scan wal in step2
 2023-07-28 00:42:15 +08:00
Haojun Liao
7f3d1dc464 fix(stream): fix memory leak. 2023-07-27 23:06:53 +08:00
wangmm0220
77d43ef5fd fix:tmq ci error 2023-07-27 20:28:45 +08:00
Haojun Liao
fbb33be85d other: add some comments. 2023-07-27 18:59:38 +08:00
Haojun Liao
22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
Minglei Jin
cc9b9bd0b9 fix(tsdb/cache): move to stt next row if data file exausted 2023-07-27 17:19:42 +08:00
Haojun Liao
b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao
3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao
6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
wangmm0220
75eacd56f1 fix:add log 2023-07-27 15:58:32 +08:00
wade zhang
a72c11c8de
Merge pull request #22205 from taosdata/fix/TD-25315 
fix(tsdb/commit2): new maxDelKey for commit context
 2023-07-27 15:48:46 +08:00
wangmm0220
2d41a42976 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728 2023-07-27 15:31:16 +08:00
Haojun Liao
40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Minglei Jin
fe495f7013 tsdb/commit2: fix commit minKey for del 2023-07-27 13:54:48 +08:00
Haojun Liao
e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
Minglei Jin
8a2764c698 tsdb/commit2: use max fileset's maxKey as initial maxDelKey 2023-07-27 10:51:17 +08:00
Minglei Jin
dd32f12f92 tsdb/commit2: reset nextKey to max to stop commit 2023-07-27 09:50:32 +08:00
Minglei Jin
992d623ae5 fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN 2023-07-27 09:34:47 +08:00
Minglei Jin
580b7124cf fix(tsdb/commit2): new maxDelKey for commit context 2023-07-27 09:16:28 +08:00
Haojun Liao
087d54a807
Merge pull request #22198 from taosdata/fix/3_liaohj 
fix(stream): do filter before the update check.
 2023-07-26 18:57:48 +08:00
yihaoDeng
287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
Haojun Liao
c57defa1c9
Merge pull request #22195 from taosdata/szhou/fix-td25369 
fix: stt and data block merge
 2023-07-26 17:11:18 +08:00
Haojun Liao
6a6830761d fix(tsdb): check for null ptr of pScanInfo 2023-07-26 17:08:29 +08:00
Haojun Liao
3c387f6e91 fix(stream): fix syntax error. 2023-07-26 17:00:41 +08:00
Haojun Liao
432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao
610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj 
fix(stream): set the correct step2 scan time window range.
 2023-07-26 16:34:10 +08:00
shenglian zhou
1357e623d0 fix: fix compilation error 2023-07-26 15:43:50 +08:00
shenglian zhou
79020ea4a4 fix: stt and data block merge 2023-07-26 15:01:20 +08:00
Haojun Liao
df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Haojun Liao
cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Haojun Liao
728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
wade zhang
d8fd5b9394
Merge pull request #22190 from taosdata/fix/TD-25315 
fix(tsdb/del): reset next key to del record's ekey
 2023-07-26 10:23:01 +08:00
yihaoDeng
c61393a7a1 fix stream state transfer 2023-07-26 01:33:41 +00:00
Haojun Liao
b6eb739ae0 fix(tsdb): fix the 2023-07-26 09:14:19 +08:00
Minglei Jin
fb860726de fix(tsdb/del): reset next key to del record's ekey 2023-07-26 08:40:44 +08:00
Haojun Liao
1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
wade zhang
02bc1b2a8f
Merge pull request #22186 from taosdata/fix/TD-25315 
fix(tsdb/del): continue committing fileset if more del left
 2023-07-25 17:41:30 +08:00
Haojun Liao
0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Minglei Jin
7bfb4e0f88 fix(tsdb/del): continue committing fileset if more del left 2023-07-25 16:42:45 +08:00
wangmm0220
be4e47e9a7 fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version 2023-07-25 16:15:33 +08:00
Haojun Liao
d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
Haojun Liao
c2588d71c3
Merge pull request #22173 from taosdata/fix/TS-3728 
fix:avoid request offset type is 0
 2023-07-25 14:59:30 +08:00
wade zhang
2bf84c2676
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0 
enh: compatibility between getFileNamePrefix and tsdbTFileName
 2023-07-25 14:26:14 +08:00
Benguang Zhao
01f45b2a99 enh: compatibility between getFileNamePrefix and tsdbTFileName 2023-07-25 11:35:35 +08:00
Minglei Jin
1bce96ea27 fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's) 2023-07-25 10:46:03 +08:00
wade zhang
7ea9cf1ddc
Merge pull request #22166 from taosdata/fix/TD-24422 
fix(tsdb/cache): reuse data file reader
 2023-07-25 10:28:59 +08:00
Haojun Liao
96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj 
fix(stream): fix the invalid check of step2 .
 2023-07-25 00:30:06 +08:00
Haojun Liao
a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
wangmm0220
6a0e994169 fix:avoid request offset type is 0 2023-07-24 19:24:05 +08:00
Haojun Liao
d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj 
fix(stream): add some logs, and remove the invalid loop.
 2023-07-24 16:29:51 +08:00
wangmm0220
9628a9f74e fix:open info log in tmq & ignore wal apply ver when read wal 2023-07-24 15:53:02 +08:00
Haojun Liao
01f11bf5a6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 
# Conflicts:
#	source/common/src/tglobal.c
#	source/libs/executor/src/timewindowoperator.c
 2023-07-24 15:25:43 +08:00
Haojun Liao
1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Minglei Jin
424dd40078 tsdb/cache: reuse pDataFileReader for same fileset 2023-07-24 14:45:35 +08:00
Haojun Liao
9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
Haojun Liao
13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj 
fix(stream): refactor the halt status to check more status.
 2023-07-24 11:04:08 +08:00
Minglei Jin
968cfd9e65 tsdb/cache: pLastIter null pointer check 2023-07-24 11:03:07 +08:00
wade zhang
5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize 
fix(tsdb/cache): new next stt row state for fs tranverse
 2023-07-24 10:47:51 +08:00
Haojun Liao
1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao
6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj 
fix(stream): set the correct flag of pause/resume.
 2023-07-24 09:07:49 +08:00
Minglei Jin
13491fab95 tsdb/cache: new next stt row state for fs tranverse 2023-07-24 08:51:20 +08:00
Haojun Liao
0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao
e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao
4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao
321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-07-22 15:06:28 +08:00
Haojun Liao
bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao
1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao
16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wade zhang
7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize 
for test purpose
 2023-07-21 14:18:32 +08:00
wangmm0220
bb86f5c580 fix:commit offset should not plus 1 2023-07-21 11:13:05 +08:00
wangmm0220
10ebf1f438 fix:subscribeStb.py maybe failed 2023-07-21 11:07:34 +08:00
dmchen
7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
Haojun Liao
39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
Haojun Liao
c9d75eab5a refactor: do some internal refactor. 2023-07-21 09:16:13 +08:00
Haojun Liao
db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng
519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Haojun Liao
9353f7c8cf refactor: do some internal refactor. 2023-07-20 16:35:02 +08:00
Haojun Liao
c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao
45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao
87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao
aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng
6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
Minglei Jin
48222f5dc3 tsdb/cache: move data file reader for fs iter to cache reader 2023-07-20 09:11:26 +08:00
Minglei Jin
6dd4ec41ae tsdb/cache cleanup: remove unused fs methods 2023-07-20 08:51:03 +08:00
Minglei Jin
7f0ea10573 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-20 08:42:12 +08:00
Minglei Jin
46d6dcda3e tsdb/cache: reset skyline when clearing fileset 2023-07-20 08:41:32 +08:00
Haojun Liao
bfcc538205 fix(tsdb):disable stt statistics. 2023-07-20 00:01:30 +08:00
yihaoDeng
733db123ad refactor code 2023-07-19 13:24:59 +00:00
Haojun Liao
97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
wangmm0220
d7d81d82a0 feat:add committed & position & commite_offset interface 2023-07-19 18:27:19 +08:00
Yihao Deng
91a15fd7bd
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 18:14:08 +08:00
Minglei Jin
ce71b8bbe7 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-19 18:11:14 +08:00
Minglei Jin
4eaecd11de tsdb/cache: merge fs & stt row 2023-07-19 18:10:36 +08:00
wangmm0220
5cb35f2fa6 feat:add committed & position & commite_offset interface 2023-07-19 17:29:39 +08:00
Haojun Liao
37ae80d135 fix(tsdb): fix memory leak. 2023-07-19 16:42:51 +08:00
Haojun Liao
d82fb45a4f Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-19 15:01:37 +08:00
Haojun Liao
a84efab2c8 enh(tsdb): add table filter according to stt block statistics data. 2023-07-19 15:01:25 +08:00
Minglei Jin
913cfe43e8 tsdb/cache: remove input[3] 2023-07-19 12:20:54 +08:00
Minglei Jin
7a716d452e tsdb/fs2: fix vnode get primary dir args 2023-07-19 11:36:26 +08:00
Minglei Jin
4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
Shungang Li
1d88a6a7c6 enh: ttlMgrFlush adjust log level 2023-07-19 11:15:54 +08:00
Minglei Jin
185081a948 tsdb/fsreader: clear last fileset's resources 2023-07-19 11:04:28 +08:00
dm chen
141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
yihaoDeng
b1f3dfe88f Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2 2023-07-19 02:17:42 +00:00
yihaoDeng
34c2e6a180 forbidden streamsnapshot reader 2023-07-19 02:15:12 +00:00
Haojun Liao
a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao
2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao
fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang
c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0 
feat: distribute vnode primary dirs among disks of level 0
 2023-07-19 09:44:43 +08:00
wangmm0220
5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
Haojun Liao
9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
Minglei Jin
a127e91534 tsdb/cache skyline: first round implementation of cache skyline 2023-07-18 17:17:06 +08:00
dmchen
3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
Benguang Zhao
2faa3d2e7b enh: check validity of diskPrimary during vnodeOpen 2023-07-18 15:39:29 +08:00
Minglei Jin
9f9efe9a5e tsdb/cache reader: remove dataf & dataf last readers 2023-07-18 15:30:31 +08:00
Haojun Liao
901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
Benguang Zhao
24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
Benguang Zhao
5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao
6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
Haojun Liao
92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
Minglei Jin
998fbe574d tsdb/cache reader: move suid into reader's info field 2023-07-17 19:10:33 +08:00
yihaoDeng
40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
Minglei Jin
463b5b608b tsdb/read2: fix null pointer runtime error 2023-07-17 18:35:56 +08:00
Minglei Jin
62cfda1a88 tsdb/read2: fix UAF 2023-07-17 17:35:08 +08:00
Minglei Jin
832b68e17d tsdb/cache: load mem del data 2023-07-17 15:48:08 +08:00
Minglei Jin
a05383e29e tsdb/cache: new load tomb callback from tsdb mergetree 2023-07-17 15:07:10 +08:00
Minglei Jin
27b8671f97 tsdb/cache: new cacheReader field for tsdb & cache reader 2023-07-17 14:27:27 +08:00
Minglei Jin
9b0b4061e0 tsdb/cache: relayout cache row reader 2023-07-17 14:16:54 +08:00
Haojun Liao
eaaf306c81 fix(stream): fix syntax error 2023-07-17 12:54:05 +08:00
Haojun Liao
d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Benguang Zhao
b21e603481 enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json 2023-07-17 11:48:48 +08:00
Minglei Jin
8263c49c17 tsdb/cache: fix compilation 2023-07-17 09:00:17 +08:00
Minglei Jin
2b21c5e0f6 tsdb2: adapt cache with tsdb2 API 2023-07-17 08:50:54 +08:00
Haojun Liao
a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao
c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng
e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
yihaoDeng
3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
wade zhang
c2b3c2db52
Merge pull request #22066 from taosdata/fix/TD-25215-main 
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main
 2023-07-14 17:53:25 +08:00
wade zhang
021fcf2a59
Merge pull request #22059 from taosdata/fix/TD-25215 
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables
 2023-07-14 17:53:06 +08:00
Haojun Liao
b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao
eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
wangmm0220
6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220
bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
Hongze Cheng
145c43e346 little fix 2023-07-14 16:38:35 +08:00
yihaoDeng
15f5fd19eb fix recover error 2023-07-14 14:47:06 +08:00
yihaoDeng
e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
Shungang Li
a48d359f8b fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-14 14:37:17 +08:00
Hongze Cheng
25120cede4 fix sma merge error 2023-07-14 13:46:01 +08:00
Hongze Cheng
5a89b96e91 make compile 2023-07-14 10:21:06 +08:00
Hongze Cheng
1fad69df3b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-14 10:13:15 +08:00
dapan1121
9bf7180074
Merge pull request #21969 from taosdata/enh/TD-23769-3.0 
enh: rsma stream state adaption
 2023-07-13 19:19:37 +08:00
Haojun Liao
e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj 
other: merge main
 2023-07-13 17:55:28 +08:00
Shungang Li
a39a9428af fix: ttlMgrDeleteTtl should ignore ttl 0 tables 2023-07-13 17:43:32 +08:00
Benguang Zhao
81a2cd16e7 enh: unify handling of vnode primary dir in current_fname 2023-07-13 17:37:53 +08:00
kailixu
6ee135cb52 chore: more code 2023-07-13 17:37:31 +08:00
kailixu
67461d92a7 chore: merge 3.0 and solve conflict 2023-07-13 17:35:55 +08:00
Hongze Cheng
d81d2790ea Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-13 17:20:45 +08:00
Haojun Liao
e2ae868377
Merge pull request #22032 from taosdata/mark/tmq 
fix:set firset version to reqOffset of response
 2023-07-13 16:35:21 +08:00
Haojun Liao
813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
wade zhang
ec86a68b6f
Merge pull request #22045 from taosdata/FEAT/TS-2699-3.0 
enh: unify handling of vnode primary dir for vnd, tsdb and sma
 2023-07-13 13:55:46 +08:00
Benguang Zhao
dc75f7ce21 enh: use VNODE_RSMA_DIR in tdRSmaGetCurrentFName 2023-07-13 11:27:31 +08:00
Haojun Liao
f41bcd73b0 other: merge main. 2023-07-13 11:02:09 +08:00
Benguang Zhao
e209b487c6 enh: rename func name vnodeGetPrimaryDir 2023-07-13 10:38:05 +08:00
Haojun Liao
2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
Haojun Liao
08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
kailixu
466f1037b4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 18:50:16 +08:00
Haojun Liao
c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj 
fix(stream): fix concurrent bug in save task meta.
 2023-07-12 18:17:27 +08:00
kailixu
8f58f9aa5b fix: skip primary key for block sma 2023-07-12 18:07:01 +08:00
Benguang Zhao
05e8af4837 enh: unify handling of vnode primary dir for vnd and tsdb 2023-07-12 17:58:18 +08:00
Benguang Zhao
4c3bf41178 enh: unify handling of vnode primary dir for sma 2023-07-12 17:56:21 +08:00
Benguang Zhao
bbf58d2d9d enh: unify handling of vnode primary dir in vnodeCreate and metaOpen 2023-07-12 17:56:21 +08:00
wangmm0220
cf64d4c9c5 fix:set get_assignment offset to first version of response block 2023-07-12 17:22:23 +08:00
Hongze Cheng
3fc282f035 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-12 11:57:19 +08:00
Haojun Liao
3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao
d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
kailixu
8cb6356b99 chore: more code 2023-07-12 10:47:02 +08:00
Haojun Liao
9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
kailixu
f282acbc4c chore: rsma refactor 2023-07-12 10:13:50 +08:00
kailixu
8c8bcabdd4 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-12 09:11:34 +08:00
wade zhang
2cfdd234b3
Merge pull request #22034 from taosdata/feat/TS-3239 
feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0
 2023-07-12 08:18:38 +08:00
Haojun Liao
fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
kailixu
ba0bce8092 chore: code revert 2023-07-11 18:52:51 +08:00
kailixu
30f8c9c79e chore: more check 2023-07-11 18:08:48 +08:00
Shungang Li
4886cb4674 feat: port 'keepTimeOffset' from 2.6 to 3.0 2023-07-11 17:40:35 +08:00
kailixu
7c85f7701d chore: more check 2023-07-11 16:32:29 +08:00
wangmm0220
8dd7f36993 fix:set firset version to reqOffset of response 2023-07-11 16:19:38 +08:00
wangmm0220
7bc19df0ef fix:set firset version to reqOffset of response 2023-07-11 15:48:19 +08:00
Haojun Liao
2e386a6fdf fix(stream): check if stream task is in normal state. 2023-07-11 15:23:49 +08:00
wangmm0220
cb62d4cb97 fix:set firset version to reqOffset of response 2023-07-11 14:49:53 +08:00
Haojun Liao
6d78816d22 fix(stream): fix syntax error. 2023-07-11 14:06:25 +08:00
kailixu
314123ef34 chore: add check 2023-07-11 14:05:09 +08:00
Haojun Liao
09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
kailixu
d5435926c2 chore: more code 2023-07-11 12:37:01 +08:00
Haojun Liao
3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao
04f5bcd23a fix(stream): remove invalid set of task status . 2023-07-11 08:51:13 +08:00
kailixu
14b438ec64 chore: bug fix 2023-07-11 07:02:36 +08:00
kailixu
f391462e34 chore: more code 2023-07-10 20:01:50 +08:00
kailixu
57ceaed535 chore: code revert 2023-07-10 19:55:01 +08:00
kailixu
f16fa6d000 enh: exclude tk log from time series check 2023-07-10 19:48:50 +08:00
Haojun Liao
87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao
385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
Hongze Cheng
7014f790a0 optmize table statistic info 2023-07-10 17:35:26 +08:00
liuyao
84f0dfd6d4 stream operator checkpoint 2023-07-10 11:07:08 +08:00
kailixu
802112c00a chore: more code 2023-07-09 21:49:37 +08:00
Haojun Liao
98349a4265 refactor(tsdb): do some internal refactor. 2023-07-09 18:05:24 +08:00
kailixu
a7253fc390 Merge branch '3.0' into enh/TD-25083-3.0 2023-07-09 16:04:38 +08:00
wangmm0220
35ba132a29 fix:conflicts from main 2023-07-09 12:52:18 +08:00
wangmm0220
a5363e6e03 fix:test case in tmq 2023-07-09 12:49:50 +08:00
Haojun Liao
ba4d726af6 fix(tsdb): fix error in tsdbread. 2023-07-09 01:31:02 +08:00
Haojun Liao
b39198a53a refactor: do some internal refactor. 2023-07-08 21:44:58 +08:00
Haojun Liao
1470e51dc1 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-08 21:25:24 +08:00
Haojun Liao
14844c7b4b refactor(tsdb): opt tsdb read perf 2023-07-08 21:25:11 +08:00
wangmm0220
f9f656b21a fix:return offset stored if get assignment in init mode 2023-07-08 13:25:39 +08:00
Haojun Liao
4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao
a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao
9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
wangmm0220
4436eb7e0f fix:set commitOffset is send msg success & optimize log & add test cases for TD-25129 2023-07-07 19:12:18 +08:00
kailixu
a746d288a1 chore: add debug info 2023-07-07 18:53:01 +08:00
Haojun Liao
128f67784a fix(stream): fix error in parsing checkpoint msg. 2023-07-07 18:17:50 +08:00
Haojun Liao
8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
wangmm0220
106e273157 fix:bugs in get_assignment 2023-07-07 16:12:15 +08:00
Haojun Liao
47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
wade zhang
0865b1a828
Merge pull request #21973 from luckeverda/fix/TD-25074-main 
fix/TD-25074 for main
 2023-07-07 11:24:33 +08:00
Hongze Cheng
090ca39132 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-07 10:38:04 +08:00
kailixu
cb8b10f6a2 Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:19:43 +08:00
kailixu
64ef48e0dd Merge branch '3.0' into enh/TD-23769-3.0 2023-07-07 10:17:25 +08:00
kailixu
06c52af2c2 enh: exclude tk_log from timeseries check 2023-07-07 10:14:37 +08:00
wade zhang
47a7a45d1d
Merge pull request #21978 from taosdata/fix/TD-24962 
fix(coverity): fix coverity scan issues
 2023-07-07 08:20:07 +08:00
wangmm0220
0928bd5510 fix:send rsp offset to client if unregister push mgr 2023-07-06 19:35:48 +08:00
wangmm0220
b2d41ce907 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-25071 2023-07-06 19:34:22 +08:00
Haojun Liao
aad906f2b0 fix(stream): fix syntax error. 2023-07-06 18:26:44 +08:00
Haojun Liao
d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
Minglei Jin
09222801c4 fix(coverity): fix coverity scan issues 2023-07-06 17:52:48 +08:00
wangmm0220
f1ce91f600 fix:race condition for pTq->pStore->pHash 2023-07-06 16:49:59 +08:00
wangmm0220
9e6e59adc2 fix:race condition for pTq->pStore->pHash 2023-07-06 16:47:48 +08:00
Shungang Li
a31e054146 fix: ttlmgr convert in metaUpgrade 2023-07-06 15:47:32 +08:00
Shungang Li
a1a2b8331f fix: ttl fill cache only in initialization 2023-07-06 15:47:32 +08:00
wade zhang
84740e96ee
Merge pull request #21939 from luckeverda/fix/TD-25074 
fix/TD-25074
 2023-07-06 15:44:22 +08:00
Haojun Liao
a94ace4cc8 refactor:do some internal refactor. 2023-07-06 15:10:45 +08:00
wangmm0220
47ae92af93 fix:conflicts from main 2023-07-06 13:40:04 +08:00
wangmm0220
11e6856d3e fix:init char array 2023-07-06 13:37:58 +08:00
kailixu
c1393fb2e2 chore: invoke streamStateCommit for rsma 2023-07-06 13:26:25 +08:00
Haojun Liao
5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
kailixu
e8cdf132fb chore: rsma code refactor 2023-07-06 11:32:20 +08:00
Haojun Liao
f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
kailixu
61380b7822 chore: test case adaption 2023-07-06 11:09:44 +08:00
Haojun Liao
851f6df094 enh(tsdb): opt perf. 2023-07-06 09:58:15 +08:00
wangmm0220
34a62c3f38 fix:vginfo assigment not in same time,we should get vginfo by vg,not all vg 2023-07-05 22:55:41 +08:00
kailixu
3f6768d8cf chore: rsma rocksdb adaption 2023-07-05 19:43:29 +08:00
Haojun Liao
aeb9473382 enh(tsdb): add some logs. 2023-07-05 19:41:34 +08:00
Haojun Liao
a0a116b674 fix(tsdb): fix error in sma extracting and do NOT clear fileDelData when extracting data from stt files. 2023-07-05 19:11:14 +08:00
kailixu
df7866e9f6 chore: refactor 2023-07-05 19:08:43 +08:00
kailixu
59e83fca5d chore: build fix 2023-07-05 18:33:09 +08:00
Benguang Zhao
9b477eed81 enh: terminate on failure to recover WAL from writing errors, or to commit vnode 2023-07-05 17:54:56 +08:00
Haojun Liao
74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory 
refactor: do some internal refactor.
 2023-07-05 17:47:00 +08:00
Shungang Li
e6e52c3641 fix: ttlmgr convert in metaUpgrade 2023-07-05 17:44:17 +08:00
Haojun Liao
8f8dfc593b Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-05 17:43:56 +08:00
Haojun Liao
a738b6eba6 fix(tsdb): add empty del skyline check. 2023-07-05 17:43:41 +08:00
Hongze Cheng
21d972938f more fix 2023-07-05 17:43:15 +08:00
Haojun Liao
f35db3ba6c fix(tsdb): add none check. 2023-07-05 17:36:55 +08:00
Haojun Liao
f0cec22d4f fix(tsdb): fix some error. 2023-07-05 17:20:17 +08:00
kailixu
d093b0e20f chore: merge 3.0 2023-07-05 16:45:12 +08:00
Haojun Liao
8c8aa5cd57 fix(tsdb): fix error in extract brinblock. 2023-07-05 16:39:04 +08:00
wangmm0220
bdfeb32923 fix:bugs in tmq_get_topic_assignment 2023-07-05 16:04:34 +08:00
Haojun Liao
03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao
7d7e12a5e7 fix(tsdb): fix syntax error. 2023-07-05 11:22:58 +08:00
Hongze Cheng
1304c08cdd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-05 10:57:55 +08:00
Haojun Liao
9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory 
refactor: refactor the fill history operation
 2023-07-05 10:48:51 +08:00
Haojun Liao
6e15478c43 fix(tsdb): do some internal refactor. 2023-07-05 10:31:38 +08:00
Haojun Liao
6fb1e716c0 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-07-05 10:31:09 +08:00
Haojun Liao
8ab10a8da1 fix(tsdb): fix error in check tomb record. #TD-25117 2023-07-05 10:30:55 +08:00
Hongze Cheng
23a743fd66 fix snapshot coredump 2023-07-05 10:01:00 +08:00
Haojun Liao
37ff3a419a fix(tsdb): fix error in load tomb from stt files. 2023-07-04 23:35:52 +08:00
wade zhang
bc8efd7014
Merge pull request #21949 from taosdata/FIX/TD-25103-3.0 
enh: tfsRename in the reverse order of levels with tiered storages
 2023-07-04 17:34:49 +08:00
Benguang Zhao
1ca4256927 enh: use var prefixLen instead in vnodeRenameVgroupId 2023-07-04 15:36:42 +08:00
Haojun Liao
ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
wade zhang
35a35ad4f9
Merge pull request #21930 from taosdata/fix/TD-24966 
fix: coverity scan
 2023-07-04 14:55:54 +08:00
Hongze Cheng
acde8586e0 ignore file check 2023-07-04 14:16:09 +08:00
Hongze Cheng
2e88ad2c14 fix: upgrade bug 2023-07-04 14:00:44 +08:00
Haojun Liao
82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678 
feat:subscribe only meta info
 2023-07-04 11:28:27 +08:00
Shungang Li
dbf47f5fc1 fix: ttl fill cache only in initialization 2023-07-03 21:30:53 -04:00
wangmm0220
dbcd33a402 fix:memory leak 2023-07-03 18:43:12 +08:00
Benguang Zhao
ddaba463c0 enh: check failure of tfsMkdirRecurAt 2023-07-03 16:16:27 +08:00
Haojun Liao
200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao
20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj 
fix: fix coverity issue.
 2023-07-03 15:15:21 +08:00
Hongze Cheng
8384b6ce29 fix CI case 2023-07-03 15:01:05 +08:00
Hongze Cheng
5390732f42 fix: coverity scan 2023-07-03 14:13:01 +08:00
Hongze Cheng
214c92264c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-03 11:27:26 +08:00
wangmm0220
136bc379d1 feat:ignore delete info 2023-07-03 11:02:08 +08:00
Haojun Liao
9e98c64b1e fix(tsdb): set correct stt load info. update the test case. 2023-06-30 22:57:49 +08:00
Haojun Liao
450a9f3ca1 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-30 18:22:35 +08:00
Haojun Liao
c2a7c37b00 fix(tsdb): opt perf for reading data from stt files. 2023-06-30 18:22:20 +08:00
wade zhang
84c20463f3
Merge pull request #21907 from luckeverda/fix/ttlpresubmit 
fix: ttl compatibility for main
 2023-06-30 16:47:25 +08:00
wade zhang
617115ba85
Merge pull request #21906 from luckeverda/fix/ttlpresubmit 
fix: ttl compatibility for 3.0
 2023-06-30 16:45:58 +08:00
Hongze Cheng
9fd453d78a more code 2023-06-30 16:13:48 +08:00
yihaoDeng
93391f73e5 vnode snapshot read 2023-06-30 07:46:56 +00:00
Hongze Cheng
2f57c8439b more fix 2023-06-30 15:04:18 +08:00
Hongze Cheng
e79fe91ba0 more code 2023-06-30 14:57:57 +08:00
Shungang Li
8f164a7922 fix: ttl compatibility 2023-06-30 14:57:34 +08:00
Hongze Cheng
c714138e9e fix snapshot problem 2023-06-30 14:37:26 +08:00
Hongze Cheng
55840709ed skip dropped table tomb data commit 2023-06-30 13:54:49 +08:00
wangmm0220
58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
yihaoDeng
e25df41536 vnode snapshot read 2023-06-30 03:11:55 +00:00
Haojun Liao
ee5e3b7cc0 fix(tsdb): fix error in tsdb2 2023-06-30 00:38:53 +08:00
Haojun Liao
9740d1353c fix(tsdb): opt perf for read data in stt files. 2023-06-29 23:16:07 +08:00
Haojun Liao
15487c9c8f fix(tsdb): fix memory leak. 2023-06-29 22:52:07 +08:00
yihaoDeng
60a0b1e1bd vnode snapshot read 2023-06-29 11:52:34 +00:00
Haojun Liao
17c6b9f81b fix(tsdb): fix error in set file reader. 2023-06-29 18:40:14 +08:00
Hongze Cheng
eee8007736 fix bug 2023-06-29 17:48:36 +08:00
yihaoDeng
9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Haojun Liao
622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
Haojun Liao
63834713b2 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-29 15:09:14 +08:00
Haojun Liao
81eb8523f1 fix(tsdb): fix invalid ptr. 2023-06-29 15:09:01 +08:00
Hongze Cheng
1e5fef9dbe fix retention CI cases 2023-06-29 15:01:54 +08:00
yihaoDeng
5cebd36c1c add checkpoint 2023-06-29 06:56:14 +00:00
dapan1121
c8435de64a
Merge branch '3.0' into fix/m23.0 2023-06-29 14:03:56 +08:00
Hongze Cheng
1556dedb85 fix file remove by edit 2023-06-29 14:03:01 +08:00
Haojun Liao
ba38a625cf fix(stream): remove the shared ptr between reader ptr. 2023-06-29 13:42:23 +08:00
dapan1121
3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
Haojun Liao
c4a6b85bdf fix(tsdb): support stt and file block overlap. 2023-06-28 22:38:51 +08:00
yihaoDeng
3d532a54a8 add checkpoint 2023-06-28 12:22:27 +00:00
yihaoDeng
6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
liuyao
2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Hongze Cheng
9be13427f6 fix tomb record loss bug 2023-06-28 17:01:08 +08:00
yihaoDeng
871f66565d add checkpoint 2023-06-28 07:02:20 +00:00
Haojun Liao
8867a57262 fix(stream): fix syntax error. 2023-06-28 14:48:59 +08:00
Haojun Liao
57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
wangmm0220
1fc664693e fix:continue consume if wal is dropped 2023-06-28 11:54:48 +08:00
yihaoDeng
f6d5d0c8ca add checkpoint 2023-06-28 02:39:01 +00:00
Haojun Liao
3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Hongze Cheng
c3a34f5012 Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-28 09:16:48 +08:00
Hongze Cheng
b13010c490 fix retention infinit loop 2023-06-28 09:16:43 +08:00
Haojun Liao
9116a4092a fix(tsdb):fix memory leak. 2023-06-28 01:04:58 +08:00
Haojun Liao
15c55508ac fix(stream): fix error in read tombblock in stt files. 2023-06-27 23:37:11 +08:00
Haojun Liao
a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
yihaoDeng
9adccf5715 add checkpoint 2023-06-27 14:31:50 +00:00
yihaoDeng
977d6b7803 add checkpoint 2023-06-27 12:52:27 +00:00
yihaoDeng
74764108fd add checkpoint 2023-06-27 12:46:08 +00:00
yihaoDeng
f2b96fb4b3 add checkpoint 2023-06-27 12:28:28 +00:00
yihaoDeng
9d69b284db add checkpoint 2023-06-27 12:03:29 +00:00
Yihao Deng
4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
yihaoDeng
0a0410cd09 add checkpoint 2023-06-27 09:56:14 +00:00
Haojun Liao
4bb78df27c fix(stream): reduce the sleep time. 2023-06-27 16:44:35 +08:00
Haojun Liao
32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
yihaoDeng
a824db4fd5 add checkpoint 2023-06-27 07:46:30 +00:00
Hongze Cheng
d23902877e make it compile on win 2023-06-27 14:33:55 +08:00
Haojun Liao
1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize 2023-06-27 11:46:37 +08:00
Haojun Liao
3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao
1073b5e4c2 fix(tsdb): support to read multi-level of stt files. 2023-06-27 11:15:53 +08:00
liuyao
71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao
b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
Hongze Cheng
3edee3fe9f fix memory leak 2023-06-26 22:04:29 +08:00
dapan1121
4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Hongze Cheng
3172306f65 more fix 2023-06-26 16:38:26 +08:00
Hongze Cheng
5a0218d1ca fix memory leak 2023-06-26 16:34:58 +08:00
Hongze Cheng
58ce6a3f26 fix vnode close 2023-06-26 16:28:33 +08:00
Haojun Liao
6a29bce44e Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-26 15:56:11 +08:00
Haojun Liao
9f664cbf14 fix(tsdb): fix error in extracting block distribution. 2023-06-26 15:54:44 +08:00
Hongze Cheng
5ad9bd938f change default stt trigger as 2 2023-06-26 15:47:36 +08:00
Hongze Cheng
e79683a684 fix more 2023-06-26 13:57:18 +08:00
Minglei Jin
020678391c fix(tsdb/cache): refine del locks 2023-06-26 11:19:31 +08:00
Hongze Cheng
27e17048ac fix: retention coredump 2023-06-26 09:06:59 +08:00
Minglei Jin
5eb57f2e6e enh(tsdb/cache): writebatch with rcache locked 2023-06-26 08:41:14 +08:00
yihaoDeng
04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao
402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
Hongze Cheng
b881b87218 more code 2023-06-25 18:02:31 +08:00
liuyao
e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
Hongze Cheng
cc0727aee3 more code 2023-06-25 17:13:12 +08:00
Hongze Cheng
014bfc4ad4 more code 2023-06-25 16:27:14 +08:00
Hongze Cheng
5b1492cb4b refact code 2023-06-25 15:09:15 +08:00
wangmm0220
7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
Haojun Liao
7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
liuyao
c950c7379d Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory 2023-06-25 10:58:43 +08:00
liuyao
e9d3198e05 mem leak 2023-06-25 10:57:10 +08:00
Haojun Liao
6ac179501a fix: fix syntax error. 2023-06-25 10:46:21 +08:00
Haojun Liao
6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Hongze Cheng
c161943fe0 fix snapshot problem 2023-06-25 10:01:30 +08:00
Hongze Cheng
3582046129 fix coredump 2023-06-25 09:45:58 +08:00
Haojun Liao
3099ec31cb fix(tsdb): fix syntax error. 2023-06-25 09:36:43 +08:00
Haojun Liao
dad1854cbb other: merge 3.0 2023-06-25 09:33:37 +08:00
Haojun Liao
7c23630fe4 fix(stream): set correct stream error code. 2023-06-25 09:26:37 +08:00
wade zhang
254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739 
feat/TD-23739: enhance ttl, deletetime modified by writing-op
 2023-06-25 09:06:57 +08:00
Haojun Liao
a8de3694fa Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-06-24 18:55:03 +08:00
Haojun Liao
ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
Haojun Liao
4a7698d4ab fix(tsdb): add null ptr check. 2023-06-24 00:41:05 +08:00
Haojun Liao
4ce1614045 fix(tsdb): fix error in retrieve sma. 2023-06-24 00:33:47 +08:00
Haojun Liao
5cac7c7a02 fix(tsdb): fix error in query super table. 2023-06-23 02:06:50 +08:00
yihaoDeng
c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
Hongze Cheng
a5049b4861 fix bug 2023-06-21 20:26:52 +08:00
Haojun Liao
0c2273daf2 fix(tsdb): fix memory leak. 2023-06-21 19:38:25 +08:00
Haojun Liao
3ca3dc54ae Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 19:22:58 +08:00
Haojun Liao
cf02ac7229 fix(tsdb): extract tomb data in stt files. 2023-06-21 18:57:14 +08:00
Haojun Liao
92249d892a
Merge pull request #21717 from taosdata/enh/staticLibMain 
Enh/static lib main
 2023-06-21 17:46:30 +08:00
Hongze Cheng
feda122fdc more code 2023-06-21 17:29:41 +08:00
Haojun Liao
f49f96049e Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:56:11 +08:00
Hongze Cheng
32a256bfee fix commit bug 2023-06-21 16:55:31 +08:00
Haojun Liao
e76ae4ffc5 fix(tsdb) : fix memory leak. 2023-06-21 16:53:47 +08:00
Hongze Cheng
1160f53062 more code 2023-06-21 16:35:06 +08:00
Haojun Liao
84bd2fb7a1 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-21 16:15:04 +08:00
Hongze Cheng
5e9d263e19 fix: infinite loop 2023-06-21 15:08:16 +08:00
Hongze Cheng
0e97340e50 more code 2023-06-21 14:53:36 +08:00
Haojun Liao
6261359efe fix(tsdb): reset the stt reader for new files. 2023-06-21 14:46:35 +08:00
yihaoDeng
ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
Hongze Cheng
4a1010cdec more 2023-06-21 13:39:29 +08:00
wade zhang
e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0 
enh: make alter-hashrange atomic and idempotent
 2023-06-21 13:29:04 +08:00
Haojun Liao
ea7b8e91d3 fix(stream): fix memory leak. 2023-06-21 12:03:26 +08:00
Haojun Liao
f6e3ad27f0 fix(tsdb): fix memory leak. 2023-06-21 11:38:35 +08:00
Haojun Liao
a92d16a508 fix(tsdb): adjust invalid assert. 2023-06-21 00:12:08 +08:00
Hongze Cheng
413d00db9e fix memory leak 2023-06-20 20:10:57 +08:00
yihaoDeng
daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
Haojun Liao
f8437789f9 Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize 2023-06-20 18:38:59 +08:00
Haojun Liao
a16dce1873 fix(tsdb): set correct callback fp. 2023-06-20 18:38:45 +08:00
Hongze Cheng
a3f784a5bc more code 2023-06-20 18:25:24 +08:00
Hongze Cheng
ccc8faf3ee Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-20 18:24:02 +08:00
Hongze Cheng
8855659534 more code 2023-06-20 18:23:58 +08:00
liuyao
74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
Haojun Liao
2d4eed4234 other: merge other branch. 2023-06-20 17:12:31 +08:00
Hongze Cheng
fbc4cc9053 fix commit issue 2023-06-20 16:48:54 +08:00
Haojun Liao
7627035629 fix(tsdb): set the hasVal initial value. 2023-06-20 15:58:22 +08:00
Benguang Zhao
424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
Haojun Liao
a87c3cfd24 fix(tsdb):check null ptr. 2023-06-20 15:39:53 +08:00
liuyao
aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
Haojun Liao
a1f2ce389b fix(tsdb): fix memory leak. 2023-06-20 14:46:32 +08:00
Hongze Cheng
09f2858927 fix some coredump 2023-06-20 14:34:52 +08:00
Haojun Liao
976dc322db enh(tsdb): support delete data read. 2023-06-20 14:26:15 +08:00
Hongze Cheng
a33ce92e5d more code 2023-06-20 13:33:31 +08:00
liuyao
870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
Hongze Cheng
927f6861be more code 2023-06-20 10:41:24 +08:00
Hongze Cheng
a4ca770449 refact code 2023-06-20 09:33:22 +08:00
Shungang Li
aa3dd2bbe8 fix for compile 2023-06-20 09:06:23 +08:00
yihaoDeng
548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
Shungang Li
b93f653d7e feat: enhance ttl, deletetime modified by writing-ops 
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
 2023-06-19 19:03:35 +08:00
Haojun Liao
77af819708 Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize 2023-06-19 17:57:00 +08:00
Haojun Liao
524ef6edda fix(tsdb): read data from new storage format. 2023-06-19 17:51:05 +08:00
liuyao
41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
Benguang Zhao
090a1a1595 enh: rename dir at the end in vnodeRenameVgroupId 2023-06-19 15:48:32 +08:00
Hongze Cheng
6d2ce5cd39 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-19 14:13:08 +08:00
Hongze Cheng
3074ab6541 more code 2023-06-19 14:12:48 +08:00
Hongze Cheng
de60e688f6 more fix 2023-06-19 12:52:09 +08:00
Hongze Cheng
9ce58a2d80 refact more code 2023-06-19 11:32:19 +08:00
Hongze Cheng
073a2b8dd3 refact more code 2023-06-19 09:32:29 +08:00
yihaoDeng
fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
kailixu
b40069c0e1 chore: log optimization 2023-06-17 05:05:43 +08:00
Hongze Cheng
aba73614df more code 2023-06-17 00:12:11 +08:00
wangmm0220
c5dfe169a6 fix:error 2023-06-16 19:33:03 +08:00
kailixu
4097b860d3 enh: support delete tsma interval 2023-06-16 19:04:12 +08:00
dapan1121
1329dce320
Merge pull request #21712 from taosdata/fix/TS-3484 
fix: fix order by ts desc error
 2023-06-16 18:01:16 +08:00
Hongze Cheng
a9fcebbdaf more code 2023-06-16 17:12:05 +08:00
Haojun Liao
64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Hongze Cheng
d97f34931d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-16 13:54:59 +08:00
Hongze Cheng
ec288ade15 change stt from multi seg to one seg 2023-06-16 12:16:53 +08:00
wade zhang
01b1cfe965
Merge pull request #21676 from taosdata/fix/TD-24715 
enh(vnd/svr): convert msyType to string
 2023-06-16 12:06:47 +08:00
wade zhang
d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761 
fix(tsdb/cache): rewrite cache update to fix cpu usage
 2023-06-16 11:52:02 +08:00
Minglei Jin
968e3cf1ea lru/applyF: fix ret value 2023-06-16 10:00:17 +08:00
Haojun Liao
4c82558eab Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 2023-06-16 09:55:24 +08:00
Haojun Liao
933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
Yihao Deng
97fa74ae2e
Merge branch 'main' into enh/staticLibMain 2023-06-15 21:37:01 +08:00
liuyao
0aa141ec77 use stream task state 2023-06-15 18:24:40 +08:00
Haojun Liao
a3e1882fb2 fix: fix dead lock. 2023-06-15 18:17:38 +08:00
Haojun Liao
2ad30e2946 other: add files. 2023-06-15 17:31:59 +08:00
Minglei Jin
2cb6c7af16 cache/commit: use outter lock 2023-06-15 17:16:14 +08:00
Minglei Jin
9d6a22e35e cache/apply: use tsdb's flushState as ud 2023-06-15 17:07:56 +08:00
Minglei Jin
c56f29c031 cache/flushState: init flush state when open cache 2023-06-15 17:01:27 +08:00
Minglei Jin
158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
Haojun Liao
74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
wangmm0220
22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
Hongze Cheng
b6a567f92e more code 2023-06-15 14:43:14 +08:00
Hongze Cheng
eacd2ac234 more code 2023-06-15 14:23:12 +08:00
liuyao
693942b821 trans state 2023-06-15 14:13:17 +08:00
Hongze Cheng
e34ff2a894 more code 2023-06-15 14:10:35 +08:00
Haojun Liao
5fdfe98696 fix: fix syntax error. 2023-06-15 13:31:30 +08:00
Hongze Cheng
56dfeadd50 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-15 13:17:44 +08:00
Haojun Liao
1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao
13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Minglei Jin
6d23ea93ea cache/update: fix memory leak 2023-06-15 08:40:36 +08:00
Haojun Liao
53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Benguang Zhao
b86fc3a697 fix: vnodeRenameVgroupId correctly 2023-06-14 21:38:25 +08:00
Yihao Deng
7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
Hongze Cheng
33eaeb743c more code 2023-06-14 16:15:40 +08:00
liuyao
9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Minglei Jin
d04a33f349 fix(tsdb/cache): rewrite cache update to fix cpu usage 2023-06-14 15:35:21 +08:00
Haojun Liao
7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Hongze Cheng
4138361839 refact code 2023-06-14 14:05:41 +08:00
Hongze Cheng
5bacfb4f94 refact code 2023-06-14 13:38:51 +08:00
Hongze Cheng
48ea3963e7 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 13:12:31 +08:00
yihaoDeng
30ea3aa419 add static lib 2023-06-14 12:15:02 +08:00
yihaoDeng
ee3017ed3a add static lib 2023-06-14 12:14:49 +08:00
Haojun Liao
b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao
844a23225a
Merge pull request #21600 from taosdata/mark/tmq 
fix:check wal not exist again before register to push & move push log…
 2023-06-14 10:18:39 +08:00
Ganlin Zhao
4bd1ae90fa fix: fix order by ts desc error 2023-06-14 09:52:41 +08:00
Hongze Cheng
c85c032158 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-14 09:14:16 +08:00
wangmm0220
8070223aba fix:lock error 2023-06-13 18:27:06 +08:00
Ganlin Zhao
647ddaad97 fix: fix order by ts desc error 2023-06-13 17:28:31 +08:00
Hongze Cheng
e01d598da9 more code 2023-06-13 17:16:06 +08:00
Haojun Liao
97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
wangmm0220
d8d6b6dd21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749 2023-06-13 15:15:05 +08:00
wangmm0220
8a81278024 fix:load pHandle if necessary wher tq restore 2023-06-13 15:14:11 +08:00
Haojun Liao
933d08b489
Merge pull request #21690 from taosdata/feature/TS-3495 
feat:add parameters for consumer & add offset rows for subscription
 2023-06-13 14:59:15 +08:00
Hongze Cheng
42a09cc9df more code 2023-06-13 14:30:24 +08:00
Hongze Cheng
7baeabc6b9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-13 13:21:12 +08:00
wangmm0220
fb123d8761 fix:conflict from 3.0 2023-06-13 09:47:08 +08:00
Haojun Liao
fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
yihaoDeng
83dde6a212 add trigger checkpoint 2023-06-12 14:33:08 +00:00
Hongze Cheng
e4840cb5ab fix 2023-06-12 17:48:49 +08:00
Hongze Cheng
bd01d08b05 mroe code 2023-06-12 17:19:31 +08:00
Hongze Cheng
71df0a00be more code 2023-06-12 17:17:00 +08:00
Hongze Cheng
438d0caef7 mroe code 2023-06-12 16:55:20 +08:00
Hongze Cheng
9a4f6abe54 more code 2023-06-12 16:12:29 +08:00
Benguang Zhao
16fbcbb67a fix: filter by tbFName in metaFilterTableByHash 2023-06-12 14:19:50 +08:00
Hongze Cheng
5405a967fb refact code 2023-06-12 13:39:25 +08:00
Hongze Cheng
4813af0867 refact code 2023-06-12 13:27:02 +08:00
Haojun Liao
78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
Hongze Cheng
22b80c55bf refact code 2023-06-12 10:27:22 +08:00
Hongze Cheng
e6039839f1 refact code 2023-06-12 10:26:18 +08:00
Hongze Cheng
b8fb34e6c6 refact 2023-06-12 10:13:15 +08:00
Hongze Cheng
8be0e1710e refact code 2023-06-12 10:08:35 +08:00
wangmm0220
1903b815d4 fix:modify offset description to string 2023-06-12 09:45:06 +08:00
wangmm0220
6657b8d849 fix:modify offset description to string 2023-06-12 09:44:00 +08:00
Benguang Zhao
3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
Hongze Cheng
0c6acda102 refact code 2023-06-10 17:16:01 +08:00
yihaoDeng
a2030dc378 add trigger checkpoint 2023-06-09 12:12:51 +00:00
Minglei Jin
4884d0af53 vnd/svr: convert msyType to string 2023-06-09 18:00:04 +08:00
Hongze Cheng
9cdaf24113 more code 2023-06-09 17:52:57 +08:00
Hongze Cheng
2c5b5289d0 fix more code 2023-06-09 16:43:09 +08:00
Hongze Cheng
cbd5da5dee more code 2023-06-09 16:07:06 +08:00
Hongze Cheng
1ee9f80e1f more code 2023-06-09 15:10:54 +08:00
Haojun Liao
69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao
63ef04593d fix: fix syntax error. 2023-06-09 09:48:18 +08:00
Haojun Liao
53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Hongze Cheng
3753c7d602 refact more 2023-06-09 09:23:56 +08:00
Minglei Jin
cab07b2736 vnode/svr: fix missing colon post vgId 2023-06-09 08:21:45 +08:00
wangmm0220
3f46a9bbc9 feat:add parameters for consumer & add offset rows for subscription 2023-06-08 18:14:02 +08:00
Haojun Liao
6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
Hongze Cheng
cb52b7a747 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 17:39:01 +08:00
Hongze Cheng
e9a0210ea6 more code 2023-06-08 17:31:35 +08:00
Haojun Liao
2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
Hongze Cheng
ef524f6965 more code 2023-06-08 15:35:43 +08:00
yihaoDeng
8b91617145 Merge branch 'enh/dv3' into enh/triggerCheckpoint 2023-06-08 07:20:41 +00:00
yihaoDeng
77f287d9be add trigger checkpoint 2023-06-08 07:19:59 +00:00
Minglei Jin
a6968485a8 enh(vnd/sync): refine invalid message log 2023-06-08 14:45:02 +08:00
Haojun Liao
30eba472c3
Merge pull request #21602 from taosdata/fix/TD-24600-dv3 
fix/td-24600-dv3
 2023-06-08 13:42:02 +08:00
Hongze Cheng
13229b0ee1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 13:38:32 +08:00
Hongze Cheng
9d4a626f42 more code 2023-06-08 13:28:13 +08:00
Hongze Cheng
685c0e5593 more code 2023-06-08 11:41:01 +08:00
Hongze Cheng
0c9b66b574 more code 2023-06-08 10:51:43 +08:00
yihaoDeng
9b749b8faa change link op t 2023-06-08 02:43:44 +00:00
Hongze Cheng
2f5f0b75df refact code 2023-06-08 10:31:19 +08:00
Hongze Cheng
91c8391bff Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-08 09:53:57 +08:00
yihaoDeng
1f1f37312d add trigger checkpoint 2023-06-07 14:32:48 +00:00
Haojun Liao
06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
yihaoDeng
4fa1cc6dd3 change link opt 2023-06-07 05:26:07 +00:00
liuyao
1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
Haojun Liao
6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Hongze Cheng
e6fb46c072 more code 2023-06-06 16:42:51 +08:00
Hongze Cheng
89a9e01375 more code 2023-06-06 16:17:29 +08:00
Hongze Cheng
96d29bc93b more code 2023-06-06 11:07:45 +08:00
Minglei Jin
57b0cb84eb fix(cache/binary): fix crash in freeItem 2023-06-06 10:23:50 +08:00
Hongze Cheng
d3bf34e92a more code 2023-06-05 22:55:00 +08:00
Hongze Cheng
aad386e795 more code 2023-06-05 22:35:06 +08:00
yihaoDeng
ae09d1d031 fix:wal error 2023-06-05 19:49:54 +08:00
Hongze Cheng
5d1783f4d4 more code 2023-06-05 18:31:59 +08:00
Hongze Cheng
9caf359ee1 more code 2023-06-05 18:29:05 +08:00
Minglei Jin
c4418046e1
Merge branch '3.0' into fix/TS-3247 2023-06-05 18:17:18 +08:00
Haojun Liao
0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
wade zhang
11321aa279
Merge pull request #21386 from taosdata/fix/TD-23549 
fix(meta): split meta
 2023-06-05 17:47:19 +08:00
wangmm0220
1b9387b683 fix:remove tq lock in write thread 2023-06-05 17:45:46 +08:00
wangmm0220
f2ee657b62 fix:check wal not exist again before register to push & move push logic from write thread to query thread 2023-06-05 17:21:47 +08:00
Hongze Cheng
46aa6d4896 refact code 2023-06-05 16:22:06 +08:00
Hongze Cheng
37ae918114 more code 2023-06-05 16:08:02 +08:00
Hongze Cheng
934a170e64 more code 2023-06-05 16:02:53 +08:00
Haojun Liao
fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Hongze Cheng
ac62592140 more code 2023-06-05 15:46:35 +08:00
Minglei Jin
d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
Haojun Liao
077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Hongze Cheng
efff4e77f0 more code 2023-06-05 09:36:26 +08:00
Hongze Cheng
5649401a65 more code 2023-06-05 09:22:20 +08:00
Hongze Cheng
3df9620450 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-05 09:10:16 +08:00
Haojun Liao
044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao
4bb6429249 fix(query): fix syntax error. 2023-06-03 00:20:59 +08:00
Haojun Liao
becacbc84b fix(query): fix syntax error. 2023-06-02 23:36:47 +08:00
Haojun Liao
b5b4cd2a05 fix(query): load del info with upper version limitation. 2023-06-02 23:15:27 +08:00
Hongze Cheng
53ff6edad7 fix bug 2023-06-02 19:03:34 +08:00
Hongze Cheng
632c6fb4dd more code 2023-06-02 18:42:15 +08:00
Haojun Liao
cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
Hongze Cheng
a2dafefe03 more code 2023-06-02 17:36:14 +08:00
wangmm0220
56f7a137ee fix:conflict 2023-06-02 15:47:53 +08:00
wangmm0220
b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
Hongze Cheng
33afb08e5c Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-02 14:40:01 +08:00
Hongze Cheng
da31d92b7e more code 2023-06-02 14:39:54 +08:00
yihaoDeng
f4bde33dc3 avoid mem leak 2023-06-02 06:06:05 +00:00
Haojun Liao
cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao
709e3f5079
Merge pull request #21566 from taosdata/fix/TD-24570 
reset ud table name
 2023-06-02 13:26:49 +08:00
Haojun Liao
d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main 
other: merge main into 3.0.
 2023-06-02 13:11:12 +08:00
Haojun Liao
f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
Haojun Liao
27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
liuyao
27f791ac7f reset ud table name 2023-06-02 11:05:39 +08:00
Hongze Cheng
884d2cc834 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-02 09:31:54 +08:00
yihaoDeng
4d0ce625c4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-06-01 22:55:30 +08:00
wangmm0220
a7418d439b Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-06-01 22:50:51 +08:00
Hongze Cheng
5e75fe006c more code 2023-06-01 18:56:40 +08:00
wangmm0220
56782a5d41 fix:open task case & modify mqRebVgReq encode/decode style 2023-06-01 18:29:16 +08:00
Haojun Liao
ee8a9856cb
Merge pull request #21557 from taosdata/feature/TD-19042 
fix:make version compatible
 2023-06-01 18:25:37 +08:00
Hongze Cheng
9d1e90f914 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-06-01 17:20:37 +08:00
Hongze Cheng
65720b80fa more code 2023-06-01 17:12:26 +08:00
Hongze Cheng
a3cacfe68b more code 2023-06-01 17:08:46 +08:00
Hongze Cheng
e07afeeeaf more code 2023-06-01 17:05:20 +08:00
wangmm0220
69499b9582 fix:make version compatible 2023-06-01 16:09:17 +08:00
wangmm0220
d20e0a06f6 fix:make version compatible 2023-06-01 16:04:45 +08:00
wangmm0220
21920721f3 fix:make version compatible 2023-06-01 15:10:08 +08:00
Hongze Cheng
e99b33ede5 more code 2023-06-01 15:08:45 +08:00
Hongze Cheng
bdc9fc473c more code 2023-06-01 11:11:02 +08:00
Minglei Jin
9b9bf2de68 meta/tbc: key cannot be null 2023-06-01 10:41:01 +08:00
Hongze Cheng
fbc4d649de more code 2023-06-01 10:36:12 +08:00
Haojun Liao
5d98a319c7
Merge pull request #21515 from taosdata/feature/TD-19042 
feat: support create topic as stable with conditions
 2023-06-01 09:56:55 +08:00
Haojun Liao
5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
Minglei Jin
fb2f367aac meta/split: trim invalidated uids 2023-06-01 08:13:32 +08:00
Haojun Liao
6d04c4e2fd refactor: do some internal refactor. 2023-05-31 19:05:40 +08:00
Haojun Liao
9e021087a9 refactor: do some internal refactor. 2023-05-31 19:04:53 +08:00
Haojun Liao
a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
Hongze Cheng
d4f4ac1d89 more code 2023-05-31 17:49:08 +08:00
Haojun Liao
fa5c024b3e refactor: do some internal refactor. 2023-05-31 17:22:59 +08:00
Haojun Liao
18b971c666 fix(query): check the version range when dump partial rows of file block to sdata block directly. 2023-05-31 17:06:38 +08:00
Haojun Liao
bbb6359ea2 fix(query): add check for version range when dumping partial rows of file block to data block 2023-05-31 17:03:39 +08:00
Hongze Cheng
dc8901268e fix code 2023-05-31 16:34:50 +08:00
Hongze Cheng
cf0228f87e more code 2023-05-31 15:57:51 +08:00
Minglei Jin
99d6c5cfa0 Merge branch '3.0' into fix/TD-23549 2023-05-31 15:31:20 +08:00
Hongze Cheng
10e6e52670 more code 2023-05-31 15:19:28 +08:00
Hongze Cheng
616a675682 more code 2023-05-31 10:59:47 +08:00
Benguang Zhao
28efd7dcd7 enh: check trans conflicts in mndTransValidate 2023-05-31 10:53:36 +08:00
Haojun Liao
e237b4ac39 refactor: do some internal refactor. 2023-05-31 09:19:05 +08:00
Hongze Cheng
938d87f601 more code 2023-05-31 09:02:50 +08:00
Hongze Cheng
838a47cb45 more code 2023-05-30 18:08:32 +08:00
Hongze Cheng
03f7c6533e more code 2023-05-30 18:06:28 +08:00
Haojun Liao
eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
wangmm0220
689ee05527 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 15:45:46 +08:00
Hongze Cheng
e0889b404d more code 2023-05-30 15:31:11 +08:00
Hongze Cheng
9222d9651e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-30 14:21:19 +08:00
Hongze Cheng
29c29871d2 more code 2023-05-30 14:20:15 +08:00
Haojun Liao
d122a398b3
Merge pull request #21516 from taosdata/fix/TD-24447 
set sched status
 2023-05-30 10:59:28 +08:00
Hongze Cheng
8626d3e691 more code 2023-05-30 10:43:44 +08:00
wangmm0220
d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
Haojun Liao
65b1574fbe
Merge pull request #21499 from taosdata/mark/tmq 
fix:put poll to push manager if wal not exist when offset is latest
 2023-05-30 09:36:53 +08:00
Haojun Liao
20a0054c4a
Merge pull request #21472 from taosdata/enh/addCompileError 
change parameter
 2023-05-30 09:36:36 +08:00
dapan1121
2d6859d5d6
Merge pull request #21510 from taosdata/szhou/fix-ts3461 
fix: if block row num is less than definit min rows, set the bucket index to 0
 2023-05-30 08:51:24 +08:00
wade zhang
3a2831a3f4
Merge pull request #21517 from taosdata/fix/TD-24472 
fix(rocks/log): set info log level to warn_level
 2023-05-30 08:35:00 +08:00
Hongze Cheng
b479a0a06b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-29 21:46:26 +08:00
Hongze Cheng
41459a92c0 more code 2023-05-29 18:42:31 +08:00
wangmm0220
41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220
07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
wangmm0220
9eb15e41ef fix:put poll to push manager if wal not exist when offset is latest 2023-05-29 16:44:03 +08:00
Hongze Cheng
6aac0e0c49 more code 2023-05-29 15:58:54 +08:00
Minglei Jin
3a9d55ca35 fix(rocks/log): set info log level to warn_level 2023-05-29 15:56:28 +08:00
wangmm0220
5eb1c559e5 fix:save offset if latest 2023-05-29 15:51:00 +08:00
liuyao
b541a0a053 set sched status 2023-05-29 15:42:47 +08:00
wangmm0220
78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
wangmm0220
a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao
8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
shenglian zhou
43c0656df2 fix: if block row num is less than definit min rows, set the bucket index to 0 2023-05-29 10:45:26 +08:00
yihaoDeng
342ce14c7d Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:37:47 +00:00
yihaoDeng
58cc631c22 Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:29:56 +00:00
Haojun Liao
953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Hongze Cheng
9d6a264e4d more code 2023-05-28 23:33:03 +08:00
Hongze Cheng
9d031f4d7b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-28 11:08:39 +08:00
Hongze Cheng
5bcc9c540a more code 2023-05-27 23:08:08 +08:00
Haojun Liao
1e786624b2
Merge pull request #21501 from taosdata/refact/fillhistory 
fix(stream): set the skip offset when resume stream task.
 2023-05-27 22:45:54 +08:00
Hongze Cheng
6668da43f8 more code 2023-05-27 20:13:07 +08:00
Hongze Cheng
e4b7318ced more code 2023-05-27 19:54:07 +08:00
Hongze Cheng
442586692b more code 2023-05-27 19:01:52 +08:00
Haojun Liao
d9de1813da Merge branch '3.0' into refact/fillhistory 2023-05-27 16:31:11 +08:00
Hongze Cheng
2cf70ab0cc more code 2023-05-27 15:29:22 +08:00
Hongze Cheng
880359ddb3 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-27 11:50:25 +08:00
Hongze Cheng
62a3c27176 more code 2023-05-27 11:49:59 +08:00
Hongze Cheng
b4b0db9a3d more code 2023-05-26 23:51:18 +08:00
Hongze Cheng
0090d02226 more code 2023-05-26 23:42:47 +08:00
Haojun Liao
b38e253019 fix(stream): set the skip offset when resume stream task. 2023-05-26 22:51:58 +08:00
Hongze Cheng
9abfe52c4d more code 2023-05-26 19:41:27 +08:00
Hongze Cheng
4cb4c6388c more code 2023-05-26 19:32:02 +08:00
wangmm0220
a3e214b9e8 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:17:04 +08:00
wangmm0220
50487255b3 fix:put poll to push manager if wal not exist when offset is latest 2023-05-26 19:02:40 +08:00
wade zhang
66b7d90849
Merge pull request #21479 from taosdata/fix/TD-24405 
fix(cache): fix deleted data
 2023-05-26 17:02:33 +08:00
Haojun Liao
87957e2bb0
Merge pull request #21478 from taosdata/fix/TD-23423 
fix tsdb read error version
 2023-05-26 16:56:09 +08:00
Hongze Cheng
f5286359fa more code 2023-05-26 15:57:31 +08:00
Hongze Cheng
7acc124dfc more code 2023-05-26 15:25:29 +08:00
Minglei Jin
34b9b322cd cache/var-data: realloc for cache reading 2023-05-26 15:01:57 +08:00
Hongze Cheng
b07ad168c3 more code 2023-05-26 14:49:50 +08:00
Haojun Liao
f61f37c936 fix(tmq): set the correct offset rsp when no poll occuring. 2023-05-26 14:20:01 +08:00
Minglei Jin
6e29d7879f cache/var-data: realloc var data 2023-05-26 14:13:01 +08:00
Hongze Cheng
9156b297ae more code 2023-05-26 11:51:08 +08:00
Haojun Liao
1e845acabe fix(tmq): allow seek before get assignment 2023-05-26 11:34:12 +08:00
Minglei Jin
bb481c52b6 cache/skyline: fix skyline false condition 2023-05-26 11:26:55 +08:00
Haojun Liao
ccbea13012 Merge branch '3.0' into refact/fillhistory 2023-05-26 10:40:53 +08:00
Haojun Liao
974b59c238 fix(query): fix bug in iterating the table list. 2023-05-26 10:10:10 +08:00
Haojun Liao
409656f7b6 fix(query): fix bug in iterating the table list. 2023-05-26 10:05:54 +08:00
Hongze Cheng
fa00d0df77 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-26 09:55:27 +08:00
Haojun Liao
cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory 
refactor: remove the module dependency.  TD-24279
 2023-05-26 09:01:45 +08:00
liuyao
75eb724c37 fix tsdb read error version 2023-05-26 08:55:23 +08:00
Haojun Liao
e24ce2111f fix: set function ptr. 2023-05-26 00:00:07 +08:00
Haojun Liao
1e22d875b3 fix: fix dead lock. 2023-05-25 20:00:26 +08:00
Haojun Liao
c3be7b14be fix: set correct function ptr. 2023-05-25 17:51:03 +08:00
Minglei Jin
8ee1288611 fix(cache): remove deleted data 2023-05-25 17:47:55 +08:00
Haojun Liao
0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao
da9f33a483 fix: fix error in set function ptr. 2023-05-25 09:56:34 +08:00
wade zhang
511ff7130b
Merge pull request #21445 from taosdata/fix/TD-24373 
fix(cache/read): associate tbname with primary ts column
 2023-05-25 08:01:51 +08:00
Haojun Liao
4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
Haojun Liao
a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao
ab907e3344 fix(query): fix syntax error. 2023-05-24 21:53:40 +08:00
Hongze Cheng
5586c6d8fb Merge branch 'fix/shared_link_rocksdb' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 19:05:30 +08:00
Hongze Cheng
4d526ed0cd change more 2023-05-24 18:59:09 +08:00
Minglei Jin
fc5d06681e cache/last_row: treat none as null with last_row 2023-05-24 18:55:51 +08:00
Hongze Cheng
3c2a54ab4b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 18:28:56 +08:00
Hongze Cheng
7d7c8af852 more code 2023-05-24 18:28:44 +08:00
wangmm0220
8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Haojun Liao
fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Ganlin Zhao
89bea7100f fix: fix count var type error 2023-05-24 00:31:05 -07:00
dapan1121
cbbbaca553
Merge pull request #21437 from taosdata/fix/TD-23955-3.0 
fix: delete index filter for desc query
 2023-05-24 14:05:07 +08:00
Hongze Cheng
ab7f6eb764 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 13:47:35 +08:00
Hongze Cheng
106f701ebb more code 2023-05-24 13:47:28 +08:00
Haojun Liao
b2ce45b07b refactor: do some internal refactor. 2023-05-24 13:39:20 +08:00
Haojun Liao
a2f29aa0f5 refactor: do some internal refactor. 2023-05-24 13:34:46 +08:00
Haojun Liao
1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
Hongze Cheng
4775b26e5e more code 2023-05-24 11:52:38 +08:00
kailixu
ef899a0cc3 fix: delete index filter for desc query 2023-05-24 11:28:45 +08:00
Minglei Jin
26bfa4363d fix(cache/read): associate tbname with primary ts column 2023-05-24 11:01:47 +08:00
Hongze Cheng
d6d0bf0e41 enh: add varchar sma 2023-05-24 10:47:26 +08:00
liuyao
180abf2229 set agg task status 2023-05-24 09:34:40 +08:00
Hongze Cheng
166a86db69 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-24 09:31:20 +08:00
Hongze Cheng
0c09d6f0d2 more code 2023-05-24 09:30:14 +08:00
liuyao
b5d01f9bab set agg pause status 2023-05-24 09:19:28 +08:00
Haojun Liao
39a1fa8f78 refactor: do some internal refactor. 2023-05-23 19:20:25 +08:00
Haojun Liao
66477a28ca refactor: do some internal refactor. 2023-05-23 19:10:50 +08:00
Haojun Liao
3d084adf1f Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 
# Conflicts:
#	source/dnode/vnode/inc/vnode.h
#	source/libs/executor/src/executil.c
#	source/libs/index/CMakeLists.txt
#	source/libs/index/src/indexFilter.c
 2023-05-23 18:32:47 +08:00
Haojun Liao
e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
kailixu
82b8c3c3d1 fix: delete index filter for desc query 2023-05-23 18:21:21 +08:00
kailixu
18e83173c8 fix: delete index filter for desc query 2023-05-23 17:21:45 +08:00
wade zhang
68a98d4d09
Merge pull request #21429 from taosdata/fix/TD-24306 
fix(cache): sychronize commit, read and write threads with writebatch
 2023-05-23 16:20:59 +08:00
Hongze Cheng
1c10694fde more code 2023-05-23 16:20:19 +08:00
Hongze Cheng
36b2495cf6 more code 2023-05-23 15:07:42 +08:00
Minglei Jin
6d620a7d7c fix(cache/read): set none to null instead of skipping column 2023-05-23 14:51:26 +08:00
Hongze Cheng
5d5add3f4b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-23 14:31:47 +08:00
Hongze Cheng
cd39d129c2 more code 2023-05-23 14:25:47 +08:00
Hongze Cheng
85c4c61027 more code 2023-05-23 14:18:23 +08:00
Minglei Jin
81048f93b0 fix(cache): sychronize commit, read and write threads with writebatch 2023-05-23 13:44:33 +08:00
yihaoDeng
c15b1e3520 opt compile 2023-05-23 11:46:02 +08:00
Hongze Cheng
91a5e17b9b more code 2023-05-23 11:45:33 +08:00
Hongze Cheng
57bde4f311 more code 2023-05-23 11:35:44 +08:00
Hongze Cheng
ca28c99f80 more code 2023-05-23 11:19:24 +08:00
wangmm0220
ed612088c0 fix:lost data because tsdbreader or task is killed 2023-05-23 10:32:13 +08:00
Hongze Cheng
89eafa18cb Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-23 09:58:53 +08:00
Hongze Cheng
46b72f340a more fix 2023-05-23 09:58:40 +08:00
kailixu
a171c0c860 Merge branch '3.0' into fix/TD-21457-3.0 2023-05-23 09:27:31 +08:00
wade zhang
9e73a69316
Merge pull request #21389 from taosdata/fix/TD-24306 
fix(cache/commit): skip batch write if empty
 2023-05-23 08:22:33 +08:00
kailixu
a3bf49d22f chore: revert 2023-05-22 20:35:52 +08:00
kailixu
c75aa54a3d fix: tsdb read and append _wstart for tsma 2023-05-22 20:33:29 +08:00
wangmm0220
d8387b95ff fix:set task status to 0 in inti 2023-05-22 20:14:43 +08:00
Hongze Cheng
c16126fa96 more code 2023-05-22 18:39:10 +08:00
Haojun Liao
f3491310a9
Merge pull request #21411 from taosdata/fix/TD-24144 
fix:remove get schema from previous for taosx
 2023-05-22 18:37:20 +08:00
Minglei Jin
75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
dapan1121
08ff4f4540 fix: crash issue 2023-05-22 17:06:01 +08:00
Hongze Cheng
8b83c85b0c more code 2023-05-22 16:28:31 +08:00
kailixu
f18fc19d76 fix: tsdb read and tsma _wstart append 2023-05-22 16:13:50 +08:00
Hui Li
0f4fb1c31d
Merge pull request #21407 from taosdata/mark/tmq 
fix:set task code success after kill
 2023-05-22 16:10:18 +08:00
wangmm0220
ae515851c4 fix:remove get schema from previous for taosx 2023-05-22 15:32:30 +08:00
Minglei Jin
21adc23af4 cache/loading: skip partial loading tables 2023-05-22 15:21:19 +08:00
Hongze Cheng
e731a08f2d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-22 14:07:49 +08:00
wangmm0220
591b51f624 fix:set task code success after kill 2023-05-22 12:42:21 +08:00
Haojun Liao
f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Hui Li
3f824e2045
Merge pull request #21355 from taosdata/mark/tmq 
fix:error in pHandle lock
 2023-05-22 08:57:45 +08:00
Haojun Liao
9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory 
Refact/fillhistory
 2023-05-21 01:12:00 +08:00
Haojun Liao
899e4d3350 refactor: do some internal refactor. 2023-05-20 18:13:58 +08:00
Haojun Liao
de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
wangmm0220
7b735c67d0 fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:36:25 +08:00
wangmm0220
8183be4aff fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:13:52 +08:00
wangmm0220
04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
wangmm0220
1ddbdad33c fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 21:40:33 +08:00
wangmm0220
33d6df8717 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 19:11:49 +08:00
Haojun Liao
e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
wangmm0220
c7c255e967 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 18:06:05 +08:00
Hongze Cheng
545d7a6ad6 more code 2023-05-19 17:56:21 +08:00
Haojun Liao
bcaa44e290
Merge pull request #21385 from taosdata/fix/liaohj_main 
fix(query): add null check.
 2023-05-19 17:55:02 +08:00
Hongze Cheng
de1bdf97f9 more code 2023-05-19 17:20:53 +08:00
wangmm0220
ff2b545b27 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 17:16:47 +08:00
Minglei Jin
a5c1b9a054 cache/commit: skip batch write if empty 2023-05-19 17:10:24 +08:00
Hongze Cheng
b75aca7538 more code 2023-05-19 16:44:32 +08:00
Minglei Jin
962db65775 Merge branch '3.0' into fix/TD-23549 2023-05-19 16:19:57 +08:00
Haojun Liao
be35194d16 fix(query): add null check. 2023-05-19 15:54:46 +08:00
Hongze Cheng
1c4abc62c3 more code 2023-05-19 15:16:01 +08:00
wangmm0220
f7ab8dabf0 fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-19 15:14:39 +08:00
wangmm0220
238254e49e fix:add task status check in doQueueScan & checkout consumer in tqProcessPollReq 2023-05-19 14:06:43 +08:00
Hongze Cheng
e247870548 more code 2023-05-19 13:35:32 +08:00
Haojun Liao
d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
Hongze Cheng
66ea10755e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 10:58:12 +08:00
Hongze Cheng
944d6a9c74 more code 2023-05-19 10:24:07 +08:00
wade zhang
208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097 
enh(cache/batchread): load columns in one trip
 2023-05-19 10:20:47 +08:00
dapan1121
e882601b67 fix: last table scan issue 2023-05-19 09:15:48 +08:00
wangmm0220
bca1af3f5d fix:change tmq subscribe try time to 60mins 2023-05-18 21:18:44 +08:00
Minglei Jin
35f74ce2e8 cache/schema: not cache schema 2023-05-18 18:35:06 +08:00
Haojun Liao
c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao
dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate 
state merge into 3.0
 2023-05-18 17:25:44 +08:00
Hongze Cheng
a622a1065a more code 2023-05-18 17:08:46 +08:00
liuyao
da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
Hongze Cheng
c7d1c88fbc more code 2023-05-18 15:06:21 +08:00
Minglei Jin
f95867d255 cache/del: fix lru key length 2023-05-18 14:48:08 +08:00
Minglei Jin
3b316051bf cache/schema: fix schema double free 2023-05-18 13:51:07 +08:00
yihaoDeng
9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Minglei Jin
0f8b7c87f7 cache/delete: fix rocks key length 2023-05-18 13:15:25 +08:00
Haojun Liao
5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
Haojun Liao
ce61b2ab00 fix: fix syntax error in tqRead 2023-05-18 11:35:45 +08:00
Haojun Liao
c3491dae16 refactor: do some interal refactor. 2023-05-18 10:56:40 +08:00
Haojun Liao
81f821a6fc refactor: do some internal refactor. 2023-05-18 10:51:43 +08:00
Hongze Cheng
c8ba83cb31 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-18 10:38:50 +08:00
wangmm0220
54f4860139 fix:rollback [TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-17 19:44:56 +08:00
Haojun Liao
b9bda9b30f fix(stream): set the correct start offset for resumed stream task. 2023-05-17 19:36:42 +08:00
wangmm0220
405cdfa7bc fix:error in pHandle lock 2023-05-17 19:02:16 +08:00
wangmm0220
1d9dd153ea fix:error in pHandle lock 2023-05-17 18:57:45 +08:00
Minglei Jin
765cc72618 cache/memtable: update cache when flag is on 2023-05-17 18:56:03 +08:00
Haojun Liao
73b1a4bddf fix(stream): fix syntax error. 2023-05-17 18:29:52 +08:00
Haojun Liao
92feb89a09 refactor: do some internal refactor. 2023-05-17 18:08:04 +08:00
Hongze Cheng
d4ab729c10 more code 2023-05-17 17:14:11 +08:00
Hongze Cheng
4b5ea55d1a more code 2023-05-17 16:46:10 +08:00
Haojun Liao
a4d9210b07 fix(tmq): add filter for taosX poll rsp. 2023-05-17 16:40:44 +08:00
Minglei Jin
f428a68ec1 cache/update: update lru when deleting or updating 2023-05-17 16:08:48 +08:00
wangmm0220
4bb25c280f fix:add log 2023-05-17 15:54:36 +08:00
Haojun Liao
041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Minglei Jin
b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Haojun Liao
f55f8d245c fix(tmq): avoid the offset is revised by pool rsp which is issued before invoking tmq_offset_seek function. 2023-05-17 15:19:51 +08:00
Hongze Cheng
ccbc7c5ba0 more code 2023-05-17 15:18:08 +08:00
Haojun Liao
366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main 
fix(stream):extract delete msg from wal.
 2023-05-17 14:52:49 +08:00
Minglei Jin
e95613ec10 cache/commit: update & commit cache if cache not off 2023-05-17 14:32:02 +08:00
Minglei Jin
86e3c1d20d cache/stt: remove ts from merge tree loading 2023-05-17 14:05:28 +08:00
Haojun Liao
3896e148fd log(tmq): add some logs. 2023-05-17 11:37:38 +08:00
dapan1121
fb7a06e06e
Merge pull request #21271 from taosdata/enh/tsbsPerf.4 
Enh/tsbs perf.4
 2023-05-17 11:00:14 +08:00
Haojun Liao
f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Haojun Liao
d457b84aba
Merge pull request #21311 from taosdata/mark/tmq 
fix:add lock to pHandle for safety
 2023-05-17 09:11:39 +08:00
wangmm0220
c52a4ea4f0 fix:merge from 3.0 2023-05-17 01:11:55 +08:00
Minglei Jin
756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
wangmm0220
90099ea1c0 fix:compile error in windows 2023-05-16 18:41:35 +08:00
wangmm0220
e6860cada8 fix:compile error in windows 2023-05-16 18:35:10 +08:00
wangmm0220
a52939127f fix:dead lock 2023-05-16 17:58:31 +08:00
Hongze Cheng
0e466a97f0 more code 2023-05-16 15:48:17 +08:00
Hongze Cheng
f39b8a0652 more code 2023-05-16 15:31:38 +08:00
Hongze Cheng
ec7cb5f217 more code 2023-05-16 15:19:13 +08:00
kailixu
9faefb7498 Merge branch 'main' into enh/TD-22404-M 2023-05-16 15:17:42 +08:00
Hongze Cheng
0b17e3fe1c more code 2023-05-16 14:35:57 +08:00
wangmm0220
e6e0ac7603 fix:alwalys in exec if consumer Id mismatch & check result for wal seek ver 2023-05-16 14:01:38 +08:00
Haojun Liao
e35d145734 fix(stream): fix memory leak. 2023-05-16 13:59:13 +08:00
Hongze Cheng
d273d10ff0 more code 2023-05-16 11:39:53 +08:00
Haojun Liao
cbb02458ed fix(stream): fix the seek condition. 2023-05-16 11:19:11 +08:00
Hongze Cheng
7cc7d35be4 more code 2023-05-16 11:09:15 +08:00
Haojun Liao
30e7cb5860 fix(tmq): avoid return delete msg for table subscription. 2023-05-16 10:42:02 +08:00
Hongze Cheng
f40986408c more code 2023-05-16 10:34:02 +08:00
Hongze Cheng
96bfbbe784 refact more code 2023-05-16 10:07:46 +08:00
Hongze Cheng
e783609ebd more code 2023-05-16 09:36:32 +08:00
Haojun Liao
5e16db4e19 fix(stream):extract delete msg from wal. 2023-05-16 08:54:03 +08:00
wangmm0220
62520af2e5 fix:core dump 2023-05-16 00:32:21 +08:00
Haojun Liao
d585f34ea9 fix(tmq): avoid seek to previous position. 2023-05-15 18:48:50 +08:00
wangmm0220
36454c73ed fix:add lock to pHandle for safety 2023-05-15 18:38:14 +08:00
Hongze Cheng
f8220e8b90 more code 2023-05-15 17:26:00 +08:00
Haojun Liao
04c8c933c8 fix(stream): add initial offset check. 2023-05-15 17:15:03 +08:00
Hongze Cheng
68f07c4bec more code 2023-05-15 17:14:45 +08:00
Hongze Cheng
23ad540035 more code 2023-05-15 15:56:13 +08:00
Hongze Cheng
066786e681 more code 2023-05-15 15:47:06 +08:00
Hongze Cheng
c31b1034cd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-15 14:26:40 +08:00
Haojun Liao
17592ea294 refactor: do some internal refactor. 2023-05-15 13:49:26 +08:00
Haojun Liao
9feb0a86d6 fix(tmq): assert after the assignment of value. 2023-05-15 12:46:00 +08:00
Hongze Cheng
33b8ff9bce more code 2023-05-15 11:39:00 +08:00
Haojun Liao
6aa197123e refactor: do some internal refactor. 2023-05-15 11:29:23 +08:00
Haojun Liao
6f7add8870 refactor: do some internal refactor. 2023-05-15 10:48:03 +08:00
Haojun Liao
6cbedc5d4a refactor: do some internal refactor. 2023-05-15 10:45:01 +08:00
Haojun Liao
ac287572ef fix: free table sink info 2023-05-15 00:03:53 +08:00
Haojun Liao
3d00f6ce54 refactor: do some internal refactor. 2023-05-14 22:08:17 +08:00
Haojun Liao
8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao
170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao
99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao
236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao
1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
Haojun Liao
40ffe0cd83 fix(tmq): check handle status before close sub. 2023-05-13 16:45:21 +08:00
Haojun Liao
b383651d8b fix(tmq): fix the invalid write and set the flag when closing taosx sub. 2023-05-13 16:17:26 +08:00
Haojun Liao
5b2ef2a675 other: merge main and remove invalid return data for poll. 2023-05-13 02:31:39 +08:00
dapan1121
3ca5559b37 fix: invalid read issue 2023-05-12 19:27:11 +08:00
dapan1121
1a52b3d519 fix: taosd crash issue 2023-05-12 18:13:16 +08:00
Hongze Cheng
e7ebb5c2db more code 2023-05-12 16:23:07 +08:00
Haojun Liao
99422c87c3 fix(tq): set the offset to be the consume offset, instead of the committed offset. And update the table sim. 2023-05-12 16:14:56 +08:00
kailixu
a39ff5f3bc chore: more code 2023-05-12 14:26:15 +08:00
Hongze Cheng
a15a1ab806 Merge branches 'enh/tsdb_optimize' and '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-12 14:14:45 +08:00
kailixu
0c9aa5bf3f merge main 2023-05-12 13:55:22 +08:00
kailixu
00f15c19aa merge main 2023-05-12 13:52:47 +08:00
dapan1121
69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
dapan1121
0dd0b16842 enh: optimize table scan for last query 2023-05-12 13:30:17 +08:00
Haojun Liao
7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
wangmm0220
cd105381a9 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 11:41:59 +08:00
wangmm0220
d85f0f56d5 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 10:51:13 +08:00
Hongze Cheng
a792bcad68 more code 2023-05-12 09:07:50 +08:00
Haojun Liao
26f94ecd60
Merge pull request #21260 from taosdata/feature/3_liaohj 
fix(tmq): update the local offset when retrieving offset from vnode.
 2023-05-11 23:12:33 +08:00
liuyao
8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
Hongze Cheng
2a754394bf more code 2023-05-11 18:16:55 +08:00
Haojun Liao
26bea33ccc fix(tmq): add null check for print log. 2023-05-11 17:56:19 +08:00
Haojun Liao
a76e47ef54 refactor: add some logs. 2023-05-11 14:19:27 +08:00
Haojun Liao
f0f90888ab refactor: update some logs. 2023-05-11 13:48:50 +08:00
Haojun Liao
2b736ffd60 fix(stream): avoid duplicated task id in task id list. 2023-05-11 11:47:57 +08:00
Haojun Liao
8a1b0ed052 refactor: do some internal refactor. 2023-05-11 10:35:09 +08:00
Haojun Liao
b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
Minglei Jin
7d23b176e5 meta/table: new api metaTrimTables for vnode split 2023-05-11 09:09:32 +08:00
Minglei Jin
81d4673153 cache/get: clear writebatch after writing 2023-05-10 17:52:26 +08:00
Minglei Jin
74c9a4b80b Merge branch '3.0' into fix/TS-3181 2023-05-10 17:42:46 +08:00
Minglei Jin
10cee51d32 fix(cache/get): move rocks wring out of column iterating 2023-05-10 17:32:51 +08:00
yihaoDeng
5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Hongze Cheng
3f4b4b5235 more code 2023-05-10 14:54:13 +08:00
Minglei Jin
9bbf36d35d cache/serialize: keep original col value untouched 2023-05-10 14:39:51 +08:00
Minglei Jin
84987c494a cache/fs: fix primary ts column loading 2023-05-10 12:25:36 +08:00
Hui Li
b1b85c3d95
Merge pull request #21227 from taosdata/fix/TD-24058 
fix:[TD-24058]send poll result to client if no data 5 times to avoid …
 2023-05-10 11:12:20 +08:00
Minglei Jin
0958fe5635 cache/binary: memcpy binary pData if pLastCol is from rocks lookup 2023-05-10 10:15:48 +08:00
Yihao Deng
c6e5879f44
Merge branch 'main' into enh/rocksdbSstate 2023-05-10 10:04:28 +08:00
yihaoDeng
8356533eb1 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-09 12:13:16 +00:00
dapan1121
d0e26d2efc
Merge pull request #21216 from taosdata/fix/TS-3358 
fix:after restarting taosd, stream does not work.
 2023-05-09 19:01:43 +08:00
dapan1121
39adac8537
Merge pull request #21224 from taosdata/fix/TS-3376 
fix: fix crash caused by tsdbReaderResume error not handled
 2023-05-09 18:56:36 +08:00
wangmm0220
587f750c94 fix:[TD-24058]send poll result to client if no data 5 times to avoid lost data 2023-05-09 17:42:11 +08:00
liuyao
8224d49702 fix:after restarting taosd, stream does not work. 2023-05-09 17:24:11 +08:00
Ganlin Zhao
76dd5a962a fix: fix crash caused by tsdbReaderResume error not handled 2023-05-09 17:19:45 +08:00
dapan1121
52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
yihaoDeng
55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
Hongze Cheng
c748e4af25 more code 2023-05-09 16:46:23 +08:00
Hongze Cheng
61eb991eca more code 2023-05-09 16:24:18 +08:00
Hongze Cheng
023281ae32 more code 2023-05-09 14:50:37 +08:00
Hongze Cheng
faadf5d3a2 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-09 13:32:16 +08:00
Minglei Jin
412fc9b0bc cache/memory: fix double free issue with tsim/parser/last_cache.sim 2023-05-09 11:09:53 +08:00
Minglei Jin
064c46bc7b cache/dclp: double check to load from tsdb 2023-05-09 09:17:26 +08:00
dapan1121
1f973123c4
Merge pull request #21177 from taosdata/fix/TD-23972 
fix:[TD-23972] push subscribe msg to vnode even though consumer not c…
 2023-05-08 20:29:31 +08:00
Hongze Cheng
f45d10bb28 more code 2023-05-08 18:15:31 +08:00
Minglei Jin
9b275f7421 cache/last_row cid: first round implementation for last_row with cid 2023-05-08 17:33:35 +08:00
Hongze Cheng
ebfd8b03a3 more code 2023-05-08 16:16:45 +08:00
Minglei Jin
e0f0536d2d cache/serialize: nullize pData if zero-length 2023-05-08 15:56:54 +08:00
Hongze Cheng
198fe28967 more code 2023-05-08 13:20:15 +08:00
Minglei Jin
5349fac910 cache/last: use rowTs instead of lastRowTs 2023-05-08 11:33:01 +08:00
Minglei Jin
2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
Minglei Jin
198ce399d2 cache/get: store recalced column value back into rocks 2023-05-08 10:59:56 +08:00
Hongze Cheng
592c4393dd more code 2023-05-08 10:53:39 +08:00
Hongze Cheng
c9dc9b3170 more code 2023-05-08 10:27:55 +08:00
Yihao Deng
cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
yihaoDeng
08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
dapan1121
c83367e455 enh: add table group cache 2023-05-06 19:24:47 +08:00
Haojun Liao
9392c03b7f fix(stream): add some logs. 2023-05-06 19:05:55 +08:00
Haojun Liao
c6007d53e8
Merge pull request #21190 from taosdata/fix/TS-3347 
fix:[TS-3347]set ver to first version if version stored is smaller th…
 2023-05-06 18:51:49 +08:00
Minglei Jin
dca985214c cache/last: new api: merge last with cid 2023-05-06 18:44:15 +08:00
wangmm0220
279fe0803f fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 18:35:24 +08:00
wangmm0220
ee32620808 fix:[TS-3347]set ver to first version if version stored is smaller than first version in wal when subscribe db 2023-05-06 16:22:30 +08:00
Minglei Jin
596bee8028 Merge branch '3.0' into fix/TD-23623 2023-05-06 16:07:26 +08:00
Haojun Liao
f1a638c196 refactor: do some internal refactor. 2023-05-06 13:36:42 +08:00
Haojun Liao
6b305bf745 refactor: do some internal refactor. 2023-05-06 13:35:18 +08:00
Hongze Cheng
8f058c8571 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-06 13:22:49 +08:00
Haojun Liao
7dfa4c2105 fix(query): fix syntax error. 2023-05-06 13:13:28 +08:00
Haojun Liao
da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
wangmm0220
446097434e fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 11:06:41 +08:00
wangmm0220
55eddbfb5e fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 10:54:05 +08:00
Haojun Liao
1fa4327f6c Merge branch 'main' into fix/liaohj_main 2023-05-06 10:15:23 +08:00
Haojun Liao
29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao
5d4a3116d5
Merge pull request #21139 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-05-06 09:49:26 +08:00
Haojun Liao
50ba55561b fix(stream): set correct group id and table id. 2023-05-05 22:11:59 +08:00
Haojun Liao
8958aabe4b fix(stream): opt task scan performance. 2023-05-05 19:33:30 +08:00
Haojun Liao
08ce790cda fix(query): fix memory leak. 2023-05-05 18:20:27 +08:00
Hongze Cheng
2fd7974113 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-05 15:39:29 +08:00
Haojun Liao
8b12d4d3da fix(stream): secure the delete task operation. TD-1198 2023-05-05 15:02:03 +08:00
Benguang Zhao
c949fee06b enh: commit vnode after consolidating alter hash range 2023-05-05 13:48:04 +08:00
Haojun Liao
38cbe0b768 fix(query): fix the invalid copmarison. 2023-05-05 12:52:10 +08:00
Haojun Liao
42b23e6471 fix(query): stop tsdb reader asap. 2023-05-05 10:40:55 +08:00
Minglei Jin
992480eb00 cache/read: fix ltype calc 2023-05-05 10:22:59 +08:00
Haojun Liao
32b4642dac fix(tmq): fix invalid free. 2023-05-05 00:57:43 +08:00
Haojun Liao
25f451ba81 fix(tmq): fix result data block info. 2023-05-04 23:34:35 +08:00
Benguang Zhao
5d63f438b5 enh: confirm alter hash range 2023-05-04 19:43:11 +08:00
Minglei Jin
90be20a662 cache/lstring: use ltype with cache/get 2023-05-04 18:08:03 +08:00
Haojun Liao
1a8a834a2c fix(tmq): fix memory leak. 2023-05-04 17:03:53 +08:00
Haojun Liao
23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
Haojun Liao
09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Hongze Cheng
80511b334d more code 2023-05-04 13:28:16 +08:00
Haojun Liao
11dccf12de
Merge pull request #21131 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-05-04 11:26:00 +08:00
Haojun Liao
851193a033
Merge pull request #21060 from taosdata/fix/TS-3222 
opti:change push mgr to consume msg for subscribe
 2023-05-04 10:16:41 +08:00
liuyao
d8a1f15d10 fix resum bug 2023-05-04 09:28:06 +08:00
kailixu
94d945a889 Merge branch 'main' into enh/TD-22404-M 2023-05-02 18:34:41 +08:00
Haojun Liao
3b814f2478 fix(stream): do some internal refactor. 2023-05-01 23:21:29 +08:00
Haojun Liao
3c61932ecc refactor: do some internal refactor. 2023-05-01 19:28:54 +08:00
Haojun Liao
563fca5c54 fix(tmq): remove unnecessary error log. 2023-05-01 14:47:01 +08:00
Haojun Liao
465c595c3a Merge branch 'main' into fix/liaohj_main 2023-04-30 18:19:35 +08:00
Haojun Liao
9cc4721e2a refactor: do some internal refactor. 2023-04-30 16:37:09 +08:00
Haojun Liao
d8e0d02e6e refactor: do some internal refactor. 2023-04-30 16:32:51 +08:00
Haojun Liao
2fe494c2c7 fix(query):add more check. 2023-04-30 02:42:26 +08:00
Haojun Liao
f645454f6c fix(query): add check. 2023-04-30 01:58:08 +08:00
Haojun Liao
a88a4f5db0 fix(query): add more check for stopping tsdb reader 2023-04-30 01:03:13 +08:00
Haojun Liao
ace193ca9b fix(stream): set the seek version if the reader's version is earlier than the first version in wal. 2023-04-29 23:34:49 +08:00
Haojun Liao
777ed1761f refactor: update logs. 2023-04-29 18:24:46 +08:00
Haojun Liao
bbb8aaa0dc refactor: add some logs. 2023-04-29 02:37:10 +08:00
Haojun Liao
8b57184a9a
Merge pull request #21123 from taosdata/fix/liaohj_main 
refactor: remove assert.
 2023-04-29 00:44:24 +08:00
Haojun Liao
b69137df44 refactor(log): add some logs. 2023-04-29 00:00:25 +08:00
Haojun Liao
05d416f3b9 fix(stream): fix invalid access when handling error, not start stream if tsDisablestream is set. 2023-04-28 23:53:53 +08:00
wangmm0220
3b66e63444 fix:[TD-23788] client wait if task status error in taosx transform data 2023-04-28 20:07:54 +08:00
Haojun Liao
c647ded0da fix(stream): add some logs. 2023-04-28 19:47:49 +08:00
wangmm0220
8d84e8f8a5 fix:[TD-23788] client wait if task status error in taosx transform data 2023-04-28 19:29:17 +08:00
yihaoDeng
dda1c8803c Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-04-28 09:17:22 +00:00
wangmm0220
18d05ff69f fix:memory leak 2023-04-28 15:53:56 +08:00
Haojun Liao
ad059db91b
Merge pull request #21120 from taosdata/fix/liaohj_main 
other: add some logs.
 2023-04-28 14:12:04 +08:00
Haojun Liao
b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao
f9a64cbcd6 other: add some logs. 2023-04-28 12:58:03 +08:00
Haojun Liao
a0c2b34788
Merge pull request #21119 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-04-28 12:53:31 +08:00
Haojun Liao
da0d9c78ef refactor: do some internal refactor. 2023-04-28 11:42:34 +08:00
liuyao
2984c5a758 merge main 2023-04-28 10:34:46 +08:00
wangmm0220
cce868d140 fix:offset encode assert error 2023-04-28 09:45:16 +08:00
wangmm0220
1ee1b0422c fix:change push mgr from SArray to Hash 2023-04-27 23:44:27 +08:00
yihaoDeng
36a4413bf1 merge rocksdb inst 2023-04-27 14:38:33 +00:00
wangmm0220
db5b5c828e fix:add log for msg push 2023-04-27 18:35:10 +08:00
Haojun Liao
ad7c3218f7
Merge pull request #21111 from taosdata/fix/liaohj_main 
enh(query): stop tsdb reader ASAP.  TD-23249
 2023-04-27 17:45:38 +08:00
Haojun Liao
802c05150a enh(query): stop tsdb reader ASAP. 2023-04-27 16:18:28 +08:00
Haojun Liao
e822dc2025 enh(query): add reader status. 2023-04-27 16:10:36 +08:00
Haojun Liao
7762e0ea47 refactor: do some internal refactor. 2023-04-27 16:10:06 +08:00
Haojun Liao
91f9b58f9a refactor: do some internal refactor. 2023-04-27 16:06:06 +08:00
wangmm0220
8677b56a4f fix:assert error in tqProcessSubmitReqForSubscribe if put pHandle to array twice 2023-04-27 15:44:44 +08:00
Haojun Liao
b7040ed15e enh(stream): support resume from the latest data, and do some internal refactor. 2023-04-27 15:07:54 +08:00
Haojun Liao
e1bd65ec0a
Merge pull request #21105 from taosdata/fix/liaohj_main 
fix(query): check the init status for pReader->status.merger  TD-23903
 2023-04-27 12:40:13 +08:00
Haojun Liao
3093726c5a fix(query): init row merger for tsdbread. 2023-04-27 11:49:00 +08:00
Haojun Liao
fe3f3f478a fix(query): check the init status for pReader->status.merger 2023-04-27 10:15:52 +08:00
wangmm0220
6a889ae80e Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-27 09:48:04 +08:00
Haojun Liao
db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
liuyao
863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
wangmm0220
224d87b131 fix:cosume null if rebalance 2023-04-26 17:58:14 +08:00
Haojun Liao
9a35d4e950
Merge pull request #21087 from taosdata/fix/liaohj_main 
refactor: do some internal refactor.
 2023-04-26 17:57:37 +08:00
Minglei Jin
a1fba2df65 Merge branch '3.0' into fix/TD-23623 2023-04-26 17:38:47 +08:00
Hongze Cheng
98384b1a4e more code 2023-04-26 17:17:32 +08:00
Haojun Liao
ca4df761f1 fix(query): fix syntax error. 2023-04-26 17:14:54 +08:00
Haojun Liao
627429d490 fix(query): fix the comparion error. 2023-04-26 16:05:57 +08:00
Hongze Cheng
e2df5f772e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-26 15:36:30 +08:00
Hongze Cheng
a3877153bb more code 2023-04-26 15:35:16 +08:00
Haojun Liao
3e80f57fc7 refactor: do some internal refactor. 2023-04-26 12:09:05 +08:00
Haojun Liao
59725d1d87 refactor: do some internal refactor. 2023-04-26 12:02:43 +08:00
Haojun Liao
8d0a4772a5
Merge pull request #21070 from taosdata/fix/liaohj_main 
enh(query): opt last row read performance. TD-23313
 2023-04-26 11:54:48 +08:00
Hongze Cheng
37fb13fa9d more code 2023-04-26 11:16:49 +08:00
Hui Li
133327140f
Merge pull request #21078 from taosdata/fix/TS-3267 
fix: more fix
 2023-04-26 10:42:09 +08:00
Minglei Jin
6835e75903 cache/get: malloc zero-length binary to unify frees 2023-04-26 10:07:15 +08:00
Haojun Liao
8e2edd6ebf fix(query): fix null ptr access. 2023-04-26 10:00:00 +08:00
Minglei Jin
5758aa4d80 cache/read: fix pRow, pLastCols memory issues 2023-04-26 08:17:08 +08:00
Haojun Liao
2a45ef88b0 fix(query): fix memory leak. 2023-04-26 00:40:33 +08:00
Haojun Liao
7b7a483afc fix(query): add tmp variable to hold the TSDBROW value. 2023-04-25 18:43:48 +08:00
Minglei Jin
c8cbabe419 cache/none column: move to outter scope 2023-04-25 18:13:33 +08:00
Hongze Cheng
49728a235e fix: more fix 2023-04-25 17:32:45 +08:00
54liuyao
b79313ecd7 pause&resume 2023-04-25 16:59:09 +08:00
wangmm0220
4321012ac4 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-25 16:24:28 +08:00
wangmm0220
d1e5d6e0f9 fix:pHandle->msg is not null if rebalance 2023-04-25 16:23:58 +08:00
slzhou
aede1090ff fix: the latest schema may delete columns 2023-04-25 16:23:30 +08:00
Minglei Jin
2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Haojun Liao
16fe48f770 fix(query): fix memory leak. 2023-04-25 16:09:58 +08:00
Haojun Liao
bca5fc7893 fix(query): fix memory leak. 2023-04-25 15:28:54 +08:00
cadem
2fd9640a39 change learner config format 2023-04-25 15:15:28 +08:00
Haojun Liao
8dbc3b3457 refactor: do some internal refactor. 2023-04-25 15:07:37 +08:00
Haojun Liao
0b6e531dd3 refactor: do some internal refactor. 2023-04-25 14:56:20 +08:00
Haojun Liao
81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Haojun Liao
05d1692073 refactor: do some internal refactor. 2023-04-25 13:50:05 +08:00
Haojun Liao
d8762b9bc9 refactor: do some internal refactor. 2023-04-25 10:48:21 +08:00
Haojun Liao
6467b99a52 refactor: do some internal refactor. 2023-04-25 10:23:21 +08:00
Haojun Liao
4c4e148635 refactor: do some internal refactor. 2023-04-25 10:19:37 +08:00
wangmm0220
41bec8560a opti:change push mgr to consume msg for subscribe 2023-04-25 09:58:28 +08:00
Haojun Liao
e724bc15e0 refactor: do some internal refactor. 2023-04-25 09:54:00 +08:00
Hongze Cheng
d57676c924 fix: delete table error 2023-04-25 09:52:16 +08:00
Minglei Jin
33fba6f99a cache/read: fix transferBuf index 2023-04-25 09:48:56 +08:00
Haojun Liao
ae8a9d25c0 refactor: do some internal refactor. 2023-04-25 09:41:49 +08:00
Haojun Liao
a73957aaba fix(query): fix error in add row into merger. 2023-04-25 09:24:15 +08:00
Haojun Liao
37d042a338 fix(query): fix error in add row into merger. 2023-04-25 00:33:24 +08:00
Haojun Liao
9a14e0db47 fix(query): fix error in add row into merger. 2023-04-25 00:30:43 +08:00
Haojun Liao
c6daa68e54 enh(query): opt merge life cycle. 2023-04-25 00:17:37 +08:00
wangmm0220
8572f4a32f opti:change push mgr to consume msg for subscribe 2023-04-24 19:41:30 +08:00
Minglei Jin
4adc95f9db cache/deserialize: fix binary pData calc 2023-04-24 18:21:25 +08:00
Minglei Jin
3b88efbd5f cache/delete: fix null column values 2023-04-24 17:07:20 +08:00
Haojun Liao
7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
Haojun Liao
d73306f616 enh(query): opt last row read performance. 2023-04-24 16:08:49 +08:00
Haojun Liao
5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
Minglei Jin
c7d5b48920 cache/read: fix pRes buffer index 2023-04-24 15:42:53 +08:00
Xiaoyu Wang
f5a974489e
Merge pull request #21045 from taosdata/fix/block-check-to-async-check 
fix/block-check-to-async-check
 2023-04-24 15:41:17 +08:00
Haojun Liao
48c36a8c35 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 14:44:13 +08:00
Minglei Jin
f8bf98f6dc Merge branch '3.0' into fix/TD-23623 2023-04-24 14:28:49 +08:00
Haojun Liao
fa46165227 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 12:59:24 +08:00
Haojun Liao
057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj 
fix(stream): set the correct start offset for stream task.
 2023-04-24 12:02:20 +08:00
Minglei Jin
8f21090343 cache/delete: just remove affected cache entries 2023-04-24 10:47:28 +08:00
cadem
a781d43577 fix/block-check-to-async-check 2023-04-24 10:23:43 +08:00
wangmm0220
9bd74ec5b2 Merge branch 'fix/TS-3222' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-24 10:14:32 +08:00
Haojun Liao
134c0528ae Merge branch 'main' into fix/liaohj_main 2023-04-24 01:43:00 +08:00
wangmm0220
77e03bfd78 opti:change push mgr to consume msg for subscribe 2023-04-23 20:14:49 +08:00
Hongze Cheng
50319f2630 more code 2023-04-23 18:00:02 +08:00
Hongze Cheng
651ca6aca2 more code 2023-04-23 17:37:12 +08:00
liuyao
641c707b37 pause&resume 2023-04-23 17:37:10 +08:00
Hongze Cheng
59e543e18d more code 2023-04-23 16:31:11 +08:00
Hongze Cheng
81efe36d30 more code 2023-04-23 16:18:18 +08:00
Hongze Cheng
172eeee609 refact more code 2023-04-23 15:45:57 +08:00
Hongze Cheng
eba557effe more code 2023-04-23 15:31:23 +08:00
wangmm0220
4bc319c6dd Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-23 15:15:33 +08:00
Xiaoyu Wang
35f02cdbad
Merge pull request #21013 from taosdata/FIX/TD-23768-main 
fix: change tdbTbInsert to tdbTbUpsert for meta update in tdb
 2023-04-23 15:15:17 +08:00
liuyao
5bd8fe5441 feat:add pause&resume 2023-04-23 15:09:01 +08:00
54liuyao
5089528a02 feat:stream pause&resume 2023-04-23 15:08:51 +08:00
kailixu
df40699a50 Merge branch 'main' into enh/TD-22404-M 2023-04-23 15:01:31 +08:00
Hongze Cheng
7cf2911c23 more code 2023-04-23 14:57:49 +08:00
Hongze Cheng
85a36d625e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-23 14:03:59 +08:00
Hongze Cheng
c336ec749a more code 2023-04-23 14:02:43 +08:00
Haojun Liao
6fc364db19 fix(query): add null ptr check. 2023-04-23 13:53:55 +08:00
Haojun Liao
9cf89c6b6f enh(tmq): add check for consumer Id; 2023-04-23 11:51:43 +08:00
Xiaoyu Wang
206887166c fix: vnode errcode setting error 2023-04-23 10:53:28 +08:00
yihaoDeng
917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao
3dbe208712 enh(tmq): fix memory error and add retrieve wal info as required. 2023-04-22 15:34:46 +08:00
Benguang Zhao
3c53516299 fix: use tdbTbUpsert for metaUpdate functions 2023-04-21 19:24:09 +08:00
Minglei Jin
9918d326cc Merge branch '3.0' into fix/TD-23623 2023-04-21 18:39:07 +08:00
Minglei Jin
a75d43a259 cache/read: remove unused extract function 2023-04-21 18:38:20 +08:00
Minglei Jin
12fc21ae84 cache/get: use pRow from reader 2023-04-21 18:34:58 +08:00
wangmm0220
6efbcfec4b Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-21 17:46:35 +08:00
Minglei Jin
09c62e6ca2 fix values_list index when freeing 2023-04-21 16:30:00 +08:00
Minglei Jin
8e87b21a59 rocks/multi_get value: free rocks allocated memory 2023-04-21 16:23:40 +08:00
chenhaoran
7d7a0769b3 Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.1 2023-04-21 16:20:37 +08:00
Minglei Jin
01d95b5e95 cache/read: use new interface with signle query 2023-04-21 16:07:22 +08:00
kailixu
6292fb766f Merge branch 'main' into enh/TD-22404-M 2023-04-21 16:04:11 +08:00
Minglei Jin
0394c6a50c free rocks errs array 2023-04-21 15:24:42 +08:00
Minglei Jin
c9959b5bf6 dst slot for last_row 2023-04-21 14:18:04 +08:00
Haojun Liao
b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Hongze Cheng
2f91256a09 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-21 10:45:41 +08:00
Hongze Cheng
bf8b9e744f more code 2023-04-21 10:45:27 +08:00
Haojun Liao
8fac91e265 refactor: do some internal refactor. 2023-04-21 09:38:51 +08:00
Haojun Liao
6c641cff39 fix(stream): fix error in start stream tasks. 2023-04-21 09:37:16 +08:00
Haojun Liao
471abd9160 log: update the log. 2023-04-20 23:39:13 +08:00
Haojun Liao
5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
dm chen
d594e4963f
Merge branch '3.0' into feat/learner 2023-04-20 19:11:06 +08:00
Haojun Liao
65fded4a28 fix(stream): set the correct number of tasks. 2023-04-20 19:03:43 +08:00
Haojun Liao
f9801ba9c5 enh(stream): stop stream asap. 2023-04-20 18:58:07 +08:00
Haojun Liao
6f595fb5fd other: add some logs. 2023-04-20 18:50:44 +08:00
wangmm0220
5df7906a62 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-20 18:33:37 +08:00
Minglei Jin
7d896bbc85 last/empty_table: continue if table's empty 2023-04-20 17:36:46 +08:00
Haojun Liao
c7e42d5422 other: do some internal refactor. 2023-04-20 17:30:02 +08:00
Haojun Liao
8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Minglei Jin
1e51b2d781
Merge branch '3.0' into fix/TD-23623 2023-04-20 16:32:43 +08:00
Minglei Jin
642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
Benguang Zhao
1b2fe38f75 enh: improve logging msg in metaSnapWrite 2023-04-20 16:22:16 +08:00
Haojun Liao
b60b1796f7 fix(stream): add lock during check wal to create new stream task. 2023-04-20 15:53:41 +08:00
Benguang Zhao
a21e0fe75e enh: propose vnode commit synchronously 2023-04-20 14:28:56 +08:00
Haojun Liao
742b5ee08c other: update wal logs level. 2023-04-20 13:42:16 +08:00
Haojun Liao
c654f1145d enh(stream): add new msg for seek, and do some internal refactor. 2023-04-20 10:59:16 +08:00
cadem
8b16f4b118 config compitible 2023-04-19 18:02:04 +08:00
yihaoDeng
5402a6061f Merge branch 'dev' into enh/rocksRevert 2023-04-19 17:37:07 +08:00
cadem
c22bd63ed4 vnode config compitible 2023-04-19 15:11:16 +08:00
Hongze Cheng
b81f1c7be1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-19 14:38:24 +08:00
Xiaoyu Wang
7cf9919ab0
Merge pull request #20964 from taosdata/enh/3.0_planner_optimize 
feat: last queries with tags output can be read from cache
 2023-04-19 14:34:32 +08:00
Haojun Liao
3f12156c53 enh(tmq): support seek in tmq. 2023-04-19 13:56:42 +08:00
Xiaoyu Wang
586b3945d1 feat: last queries with tags output can be read from cache 2023-04-19 13:09:11 +08:00
wangmm0220
594d68b8a4 fix:remove lock for consume handler 2023-04-19 11:46:59 +08:00
wangmm0220
14fd2e7904 fix:remove lock for consume handler 2023-04-19 11:44:52 +08:00
wangmm0220
1061eef144 fix:move consumer msg from fetch thread to query thread 2023-04-19 10:49:18 +08:00
wangmm0220
25542c26c7 fix:remove tmPushMsg in consumer 2023-04-19 10:43:13 +08:00
Minglei Jin
76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
cadem
3b78d4382b add learner 2023-04-18 19:03:45 +08:00
kailixu
b93c85fbf5 Merge branch 'main' into enh/TD-22404-M 2023-04-18 18:49:25 +08:00
Haojun Liao
fb32ffd960 fix(stream): update the reference count value to be int32, insead of int8 2023-04-18 18:06:03 +08:00
dapan1121
2af63992ea
Merge pull request #20952 from taosdata/fix/TD-23639 
fix: fix double free caused crash
 2023-04-18 17:50:45 +08:00
Xiaoyu Wang
6669c3a5ad feat: last queries with tags output can be read from cache 2023-04-18 17:13:14 +08:00
Haojun Liao
cc67b631f6 refactor: do some internal refactor. 2023-04-18 17:01:09 +08:00
Haojun Liao
9f16802451 fix(stream): set the initial value. 2023-04-18 16:42:40 +08:00
Ganlin Zhao
e58bf86c33 fix local variable 2023-04-18 16:34:06 +08:00
Haojun Liao
abfc2455e6 fix(stream): update the atomic variables. 2023-04-18 16:21:30 +08:00
Haojun Liao
7da998ecfb other: merge main. 2023-04-18 16:15:08 +08:00
Minglei Jin
dee2ca3476 tsdb/cache: inplace_update are commented out 2023-04-18 16:09:42 +08:00
Haojun Liao
7a8dd0db45 refactor: update the log. 2023-04-18 16:08:51 +08:00
Minglei Jin
dd42db0077 tsdb/mem table: remove unused codes 2023-04-18 15:09:13 +08:00
Minglei Jin
e159c4ead9 first round rocks batch write implementation 2023-04-18 14:25:35 +08:00
Haojun Liao
76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj 
fix(stream): set the correct initial checkpoint versions.
 2023-04-18 11:26:48 +08:00
Haojun Liao
97da34050b fix(query): fix invalid free. 2023-04-18 10:40:53 +08:00
Haojun Liao
7d3e5aa3d3 fix(query): set the table schema correctly when the table is dropped. 2023-04-18 09:03:30 +08:00
Haojun Liao
2ae05b8cf6 fix(stream): set the correct initial offset value. 2023-04-18 08:56:31 +08:00
liuyao
27d14f742d fix:stream memory leak 2023-04-17 17:27:02 +08:00
Ganlin Zhao
d21628b2c9 fix: fix double free caused crash 2023-04-17 16:57:29 +08:00
kailixu
751a821e5d Merge branch 'main' into enh/TD-22404-M 2023-04-17 13:57:53 +08:00
kailixu
fcb587b456 Merge branch 'main' into enh/TD-22404-M 2023-04-17 11:42:48 +08:00
Hongze Cheng
a2bf1e2c7a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-17 10:59:41 +08:00
Haojun Liao
be90d2c511 fix(stream): disable stream task when no tasks exist. 2023-04-16 23:07:54 +08:00
Haojun Liao
1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao
04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao
efb9ebe875
Merge pull request #20873 from taosdata/feature/3_liaohj 
enh(stream): the stream will start after vnode restore being completed.
 2023-04-15 09:34:34 +08:00
Hongze Cheng
edf9fdbecc make it compile 2023-04-14 23:19:36 +08:00
Hongze Cheng
bd1c8e1902 fix more code 2023-04-14 21:59:08 +08:00
Hongze Cheng
01bacc10ef fix: an important fix 2023-04-14 21:43:40 +08:00
Haojun Liao
1cd2268a99 Merge branch 'main' into feature/3_liaohj 2023-04-14 18:30:55 +08:00
Minglei Jin
ec4ea9cf5d enh(cache/rocks): base for rocks put/get 2023-04-14 18:28:15 +08:00
Haojun Liao
ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
Haojun Liao
e0cb8aa534 fix(stream): don't the initial task status and do some internal refactor. 2023-04-14 17:43:37 +08:00
dapan1121
423ec923ca enh: reuse tsdb cache reader 2023-04-14 14:30:20 +08:00
Hongze Cheng
d1289d4c21 more code 2023-04-14 13:39:42 +08:00
Haojun Liao
eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao
b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Xiaoyu Wang
96d2c5b9e3
Merge pull request #20927 from taosdata/FIX/TD-23552-main 
enh: try to propose vnode commit at vnode closing
 2023-04-14 09:14:10 +08:00
Haojun Liao
f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao
4d83118ff7 fix(stream): fix memory leak. 2023-04-13 23:49:14 +08:00
Haojun Liao
70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
Benguang Zhao
d8386754ee enh: try to propose vnode commit at vnode closing 2023-04-13 19:45:24 +08:00
Xiaoyu Wang
7e51190bc8
Merge pull request #20914 from taosdata/fix/TD-22941-1 
fix(tsdb/read): release bi cache entry before returning
 2023-04-13 19:24:06 +08:00
Hongze Cheng
ac0bb0cf44 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-13 15:13:42 +08:00
Hongze Cheng
e60672d019 more code 2023-04-13 15:13:27 +08:00
Minglei Jin
ab372d501a fix(tsdb/read): release bi cache entry before returning 2023-04-13 14:33:37 +08:00
Xiaoyu Wang
a44d455e56 merge 3.0 2023-04-13 14:32:05 +08:00
Xiaoyu Wang
3d962cd950
Merge pull request #20905 from taosdata/fix/TD-22941 
fix(tsdb/cache): fix block index ref releasing
 2023-04-13 13:37:20 +08:00
Minglei Jin
589ed9d0ce fix(tsdb/cache): fix block index ref releasing 2023-04-13 12:09:44 +08:00
Minglei Jin
ef219095cf fix(tsdb/read): remove duplicat schema fetching 2023-04-13 10:06:49 +08:00
kailixu
85e11d8cbf Merge branch 'main' into enh/TD-22404-M 2023-04-12 18:30:43 +08:00
Hongze Cheng
58ed42b063 more code 2023-04-12 15:18:12 +08:00
Xiaoyu Wang
933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Hongze Cheng
3f8f7bb451 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-12 11:28:30 +08:00
Hongze Cheng
d24fed6ffa more code 2023-04-12 11:14:52 +08:00
Xiaoyu Wang
813591f993
Merge pull request #20872 from taosdata/fix/TD-23474 
fix(tsdb/cache): skip schema updating for non ts row
 2023-04-12 10:47:02 +08:00
Xiaoyu Wang
8b8ac0cd77 merge main 2023-04-12 10:43:28 +08:00
Haojun Liao
f6315af0c9 other: merge main. 2023-04-11 19:41:17 +08:00
Haojun Liao
5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
Haojun Liao
f083697dba refactor(tq): do some internal refactor. 2023-04-11 19:04:33 +08:00
Haojun Liao
24c9495772
Merge pull request #20857 from taosdata/fix/TS-3081 
fix:optimize log & change the length of tag if tag is null in schemaless
 2023-04-11 19:01:07 +08:00
yihaoDeng
b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Minglei Jin
3ac5b35f4b fix(tsdb/cache): skip schema updating for non ts row 2023-04-11 18:57:11 +08:00
Hongze Cheng
8d7055b123 more code 2023-04-11 17:04:52 +08:00
Haojun Liao
aae2758863 fix(stream): disable the deploy msg when restart taosd. 2023-04-11 16:58:51 +08:00
Xiaoyu Wang
4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Haojun Liao
18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
Hongze Cheng
1df5680e9e more code 2023-04-11 15:34:40 +08:00
Hongze Cheng
2f51c609f4 more code 2023-04-11 15:01:42 +08:00
Hongze Cheng
a72633d715 more code 2023-04-11 14:22:36 +08:00
wangmm0220
c40c695ea7 fix:optimize log & change the length of tag if tag is null in schemaless 2023-04-11 13:49:18 +08:00
Haojun Liao
15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00
Hongze Cheng
47b961018c more code 2023-04-11 11:00:35 +08:00
Haojun Liao
a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
liuyao
524bb214e7 delete invalid code 2023-04-10 19:18:56 +08:00
Haojun Liao
497c9ea9c8 Merge branch 'main' into feature/3_liaohj 2023-04-10 17:57:26 +08:00
Hongze Cheng
6bc0d17605 more code 2023-04-10 17:52:51 +08:00
Haojun Liao
7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
Hongze Cheng
a0039fe271 more code 2023-04-10 15:00:01 +08:00
Hongze Cheng
90a13bf451 more code 2023-04-10 14:50:50 +08:00
Hongze Cheng
fe4dca9b1e more code 2023-04-10 14:09:39 +08:00
Xiaoyu Wang
4dff8950c2
Merge pull request #20812 from taosdata/fix/TS-3025 
fix(tsdb/read): use the correct schema with multilevel merging
 2023-04-10 10:30:37 +08:00
kailixu
7f6fdd4b6b Merge branch 'main' into enh/TD-22404-M 2023-04-09 13:26:56 +08:00
Haojun Liao
f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
kailixu
3530ae0307 Merge branch 'main' into enh/TD-22404-M 2023-04-07 17:51:40 +08:00
Hongze Cheng
f100a328b4 more code 2023-04-07 16:52:30 +08:00
Haojun Liao
5de76e4b72
Merge pull request #20809 from taosdata/fix/TD-23517 
fix:[TD-23517] set offset type to wal if only meta & check if tag is …
 2023-04-07 16:35:08 +08:00
Minglei Jin
8ae43fe6cb fix(tsdb/read): use the correct schema for mem/imem rows 2023-04-07 15:28:23 +08:00
Hongze Cheng
afbaeb0d2d more code 2023-04-07 15:12:31 +08:00
Minglei Jin
f262ac8230 fix(tsdb/read): use irow's schema instead of NULL 2023-04-07 14:37:56 +08:00
wangmm0220
05ec2b0928 fix:[TD-23517] set offset type to wal if only meta & check if tag is the same type in schemaless 2023-04-07 14:24:29 +08:00
Hongze Cheng
d370d6a662 more code 2023-04-07 14:23:42 +08:00
Minglei Jin
1ff8511eb3 tsdb/row merger: comment init out 2023-04-07 13:43:07 +08:00
Minglei Jin
55f7e41f3b tsdb/row merger: remove tsdbRowMerge 2023-04-07 13:31:33 +08:00
Minglei Jin
360113115f fix(tsdb/row merger): remove unused code 2023-04-07 09:49:48 +08:00
Hongze Cheng
4e8e3854a7 more code 2023-04-06 16:26:41 +08:00
Hongze Cheng
e8e0e4976e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-06 15:51:20 +08:00
Hongze Cheng
fd16a6b3b7 more code 2023-04-06 14:27:18 +08:00
Haojun Liao
871cfb4760
Merge pull request #20775 from taosdata/fix/TD-23450 
fix:tq memory leak
 2023-04-06 11:48:45 +08:00
Haojun Liao
2b2059ef18
Merge pull request #20534 from taosdata/fix/TD-22671 
fix:error in TD-23218 & remove useless logic
 2023-04-06 11:47:24 +08:00
yihaoDeng
5aff5aa93b add backpressure 2023-04-04 12:38:56 +00:00
54liuyao
519e2f1cfd fix:tq memory leak 2023-04-04 18:21:37 +08:00
yihaoDeng
628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Haojun Liao
c91d8a5901 Merge branch 'main' into feature/3_liaohj 2023-04-04 15:18:24 +08:00
Xiaoyu Wang
e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Hongze Cheng
6e6100f254 more code 2023-04-04 14:38:17 +08:00
Xiaoyu Wang
0e53e578a7
Merge pull request #20748 from taosdata/fix/TD-23473 
ehn(plan/optimizer): remove tbname fetching with cached groupby
 2023-04-04 09:36:56 +08:00
dapan1121
ec3c706c3b
Merge pull request #20739 from taosdata/fix/TS-3063 
fix(query): fix interp tsdbReader external range not setting properly
 2023-04-04 09:23:47 +08:00
wangmm0220
d651ba02ae fix:lose consume data because of exec close if consume while insert data 2023-04-03 19:54:52 +08:00
Haojun Liao
d48be5c0ce refactor: do some internal refactor. 2023-04-03 18:23:35 +08:00
Haojun Liao
a3ac8b647c refactor: do some internal refactor. 2023-04-03 18:20:35 +08:00
Haojun Liao
482c319bee refactor: do some internal refactor. 2023-04-03 18:07:28 +08:00
Haojun Liao
3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
Ganlin Zhao
aa6a4efd5b fix(query): fix interp tsdbReader external range not setting properly 2023-04-03 16:18:16 +08:00
Hongze Cheng
2bab385071 more code 2023-04-03 16:15:21 +08:00
Hongze Cheng
7e48fc3ca5 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-03 15:25:04 +08:00
Hongze Cheng
ffb655bae6 more code 2023-04-03 13:59:37 +08:00
wangmm0220
2d6436c57d fix:modify log & sleep 500ms if data is inserting while consume 2023-04-03 11:24:22 +08:00
wangmm0220
858144145f fix:memory leak 2023-04-02 23:39:59 +08:00
wangmm0220
b029c8f157 fix:remove useless setmsg 2023-04-02 22:34:51 +08:00
wangmm0220
afcc3d2064 opti:code for tmq 2023-03-31 19:02:38 +08:00
wangmm0220
97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
Hongze Cheng
171d360cac
Revert "current from binary to json" 2023-03-31 15:25:00 +08:00
Hongze Cheng
552ea09690 more code 2023-03-30 17:43:54 +08:00
Hongze Cheng
88907b1996 more code 2023-03-30 17:05:58 +08:00
Hongze Cheng
8afa2c5354 more code 2023-03-30 16:06:07 +08:00
dapan1121
15578cf980
Merge branch 'main' into fix/cencVer 2023-03-30 15:36:30 +08:00
kailixu
9552ac2800 enh: coverity scan for sma 2023-03-30 15:11:35 +08:00
Haojun Liao
5f4cb41e28 fix(tmq): set correct start offset value. 2023-03-29 23:45:41 +08:00
Haojun Liao
c8ad465a0d refactor: do some internal refactor. 2023-03-29 19:40:34 +08:00
Haojun Liao
56c98d7768 refactor: do some internal refactor. 2023-03-29 19:35:04 +08:00
kailixu
9ee43c271d enh: coverity scan for sma 2023-03-29 18:38:35 +08:00
wangmm0220
2243184a4d fix:conflicts 2023-03-29 17:53:05 +08:00
Hongze Cheng
0404810252 more code 2023-03-29 17:34:36 +08:00
dapan1121
6a1150301e fix: column rows size 2023-03-29 17:30:20 +08:00
wangmm0220
9d9ae749d1 opti:tmq logic & fix CI cases 2023-03-29 17:27:04 +08:00
Haojun Liao
25245b9005 Merge branch 'main' into feature/3_liaohj 2023-03-29 16:40:12 +08:00
Haojun Liao
152fc5daab fix(stream):fix the race condition when creating new tsables. 2023-03-29 16:36:35 +08:00
kailixu
fabd96deef enh: coverity scan for sma 2023-03-29 15:56:44 +08:00
dapan1121
a90354cd92 fix: restore debug code 2023-03-29 15:56:08 +08:00
dapan1121
9952be43f6 Merge remote-tracking branch 'origin/main' into fix/cencVer 2023-03-29 15:50:14 +08:00
dapan1121
4f06728c17 fix: restore sl level 2023-03-29 15:48:11 +08:00
dapan1121
84eef542d5 fix: memory rows count issue 2023-03-29 15:45:18 +08:00
Xiaoyu Wang
b9d905c2d3
Merge pull request #20686 from taosdata/fix/liaohj 
fix(tsdb/read): use correct scheme for mem & imem merging
 2023-03-29 15:38:21 +08:00
Minglei Jin
91c16f0344 tsdb/read: remove dup mem schema fetching 2023-03-29 15:34:55 +08:00
Minglei Jin
7eb8a63944 Merge branch 'fix/liaohj' of https://github.com/taosdata/TDengine into fix/liaohj 2023-03-29 14:21:05 +08:00
Minglei Jin
8cf8ac84d7 fix(tsdb/read): use correct scheme for mem & imem merging 2023-03-29 14:19:15 +08:00
Hongze Cheng
d2185b7e68 more code 2023-03-29 13:27:36 +08:00
dapan1121
2714ce2af8 fix: rows count issue 2023-03-29 13:22:12 +08:00
kailixu
eb301a1d61 enh: coverage for sma 2023-03-29 12:16:12 +08:00
dapan1121
0659814d16
Merge pull request #20674 from taosdata/fix/TS-3010 
fix: query schema is old issue
 2023-03-29 11:41:07 +08:00
Xiaoyu Wang
eaf56916fe
Merge pull request #20678 from taosdata/FIX/TD-22975-main 
enh: separate sync read and write
 2023-03-29 11:09:31 +08:00
dapan1121
0327a8eaa3 fix: block rows number type 2023-03-29 10:46:56 +08:00
Haojun Liao
7a050d64bd fix(query): set ptr to be NULL. 2023-03-29 10:27:05 +08:00
dapan1121
702202d4af fix: fix block scan issue 2023-03-29 10:14:53 +08:00
Haojun Liao
f1ff5dcec4 fix(query): use hashmap to keep the multiple schema. 2023-03-28 22:53:57 +08:00
dapan1121
a0c8dd52b1 fix: memory count issue 2023-03-28 19:42:09 +08:00
dapan1121
c5f37d284e fix: memory row count issue 2023-03-28 19:27:49 +08:00
dapan1121
e0f951e668 fix: memory rows issue 2023-03-28 19:15:38 +08:00
wangmm0220
d0c55ef572 fix:conflicts 2023-03-28 18:12:13 +08:00
Benguang Zhao
ae8d87643f Merge branch 'main' into FIX/TD-22975-main 2023-03-28 18:00:51 +08:00
dapan1121
def8c9044e Merge remote-tracking branch 'origin/enh/TS-2967' into fix/cencVer 2023-03-28 17:47:41 +08:00
dapan1121
a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00
Hongze Cheng
8233a5bc31 more code 2023-03-28 16:43:22 +08:00
Haojun Liao
0ae2034ebb fix: fix syntax error. 2023-03-28 16:05:05 +08:00
Haojun Liao
7342aeb750 fix(tmq): fix the syntax error. 2023-03-28 15:42:53 +08:00
Hongze Cheng
dc10b0196e more code 2023-03-28 15:38:55 +08:00
dapan1121
22ad3129b9 fix: query schema is old issue 2023-03-28 15:21:47 +08:00
Haojun Liao
a883e57cf2 Merge branch 'main' into fix/liaohj 2023-03-28 15:07:32 +08:00
Haojun Liao
68f310dd48 refactor: do some internal refactor. 2023-03-28 15:05:10 +08:00
Haojun Liao
4fd3064fd9 refactor: do some internal refactor. 2023-03-28 14:43:37 +08:00
Haojun Liao
ac9773b5df
Merge pull request #20670 from taosdata/fix/liaohj 
refactor: do some internal refactor.
 2023-03-28 14:32:10 +08:00
Haojun Liao
c36c5253c5 refactor: do some internal refactor. 2023-03-28 13:31:40 +08:00
Haojun Liao
fca79dbc53 Merge branch 'fix/liaohj' into main 2023-03-28 11:20:01 +08:00
Haojun Liao
c158087d66 fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers. 2023-03-28 09:53:49 +08:00
Haojun Liao
5c128e2292 refactor: do some internal refactor. 2023-03-28 09:27:48 +08:00
dapan1121
61571d9296 enh: optimize count performance 2023-03-27 19:40:29 +08:00
Hongze Cheng
23e78dd908 more code 2023-03-27 19:12:25 +08:00
Xiaoyu Wang
77f27bb9df
Merge pull request #20613 from taosdata/FIX/TD-23308-main 
enh: disable timely vnodeCommit
 2023-03-27 17:58:20 +08:00
Hongze Cheng
8f84e88616 more code 2023-03-27 17:07:59 +08:00
Hongze Cheng
7b82bd5ebb Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-27 16:30:40 +08:00
Hongze Cheng
978c73fb48 more code 2023-03-27 16:30:22 +08:00
kailixu
11bf7511e5 Merge branch 'main' into enh/TD-22404-M 2023-03-27 11:16:11 +08:00
Hongze Cheng
69a2f7129c more code 2023-03-27 09:42:08 +08:00
wangmm0220
f1d67b6059 fix:conflict 2023-03-25 19:03:23 +08:00
wangmm0220
750cd8c5a4 fix:ci error 2023-03-25 16:33:47 +08:00
dapan1121
8a89550f16 fix: skiplist level 2023-03-25 13:10:14 +08:00
wangmm0220
9f5e435140 fix:conflict from main 2023-03-25 11:49:37 +08:00
dapan1121
dd12e41227
Merge pull request #20618 from taosdata/fix/TS-2974 
fix: change float display mode
 2023-03-25 09:19:04 +08:00
dapan1121
481091bae6 fix: sma load issue 2023-03-24 19:01:19 +08:00
Hongze Cheng
0a13fc497d more code 2023-03-24 18:07:16 +08:00
Hongze Cheng
052d9c6e4b more code 2023-03-24 17:57:37 +08:00
dapan1121
8bf49fdbd2 fix: skiplist level 2023-03-24 17:16:06 +08:00
Haojun Liao
b22cc82270 others: merge main. 2023-03-24 15:43:13 +08:00
Haojun Liao
8f6ac6d771 fix(tmq): wait for 2mins when subscribe topics. 2023-03-24 15:36:42 +08:00
dapan1121
4167e4c00c fix: some columns sma are not set issue 2023-03-24 15:20:27 +08:00
wangmm0220
57331cd71d Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD023101 2023-03-24 14:51:11 +08:00
wangmm0220
5d06474f2e fix:send data batch if consume wal where subscribe db 2023-03-24 14:43:29 +08:00
Hongze Cheng
873c9705fe more code 2023-03-24 14:24:34 +08:00
wangmm0220
1a2513d212 Merge branch 'fix/TD023101' of https://github.com/taosdata/TDengine into fix/TD023101 2023-03-24 10:12:12 +08:00
wangmm0220
bf78f63e22 fix:send data batch if consume wal where subscribe db 2023-03-24 10:10:52 +08:00
cadem
86ca5ce210 fix/trigger election by sync msg 2023-03-24 09:13:20 +08:00
Benguang Zhao
9be09492f0 enh: disable timely vnodeCommit 2023-03-24 09:05:06 +08:00
Xiaoyu Wang
bddba107be
Merge pull request #20608 from taosdata/fix/TS-2960 
fix(tdb/restore): rollback journal files backward
 2023-03-23 19:47:31 +08:00
Hongze Cheng
62231ef14c more code 2023-03-23 18:40:44 +08:00
Hongze Cheng
8fa2f08711 more code 2023-03-23 17:15:51 +08:00
Hongze Cheng
d596f3be4a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-23 16:29:03 +08:00
Hongze Cheng
5173d85c8c more code 2023-03-23 16:28:13 +08:00
dapan1121
7f50b463bb
Merge pull request #20599 from taosdata/fix/mainT3.0 
fix: merge main to 3.0
 2023-03-23 16:17:01 +08:00
Hongze Cheng
7bc38466bf more code 2023-03-23 16:10:08 +08:00
Hongze Cheng
2b7fa84e24 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-23 13:27:07 +08:00
Hongze Cheng
54da9e6ec5 more code 2023-03-23 13:26:57 +08:00
Hongze Cheng
71c967d603 more code 2023-03-23 13:15:14 +08:00
Xiaoyu Wang
a5d8549cb1
Merge pull request #20593 from taosdata/FEAT/TD-23258-3.0 
feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database
 2023-03-23 11:43:01 +08:00
Xiaoyu Wang
323d8ee0b4
Merge pull request #20598 from taosdata/FIX/TD-23187-main 
fix: set pWriter->info.state.committed as ever in vnodeSnapWriterClose
 2023-03-23 11:42:48 +08:00
wangmm0220
5f9c7e9a7d fix:[TS-2961] consume error change from snapshot to wal for taosx 2023-03-22 20:14:19 +08:00
wangmm0220
6fae38619d fix:error in TD-23218 & remove useless logic 2023-03-22 19:36:12 +08:00
Hongze Cheng
9490bf2a5e more code 2023-03-22 19:24:40 +08:00
dapan1121
e58afd12e1 fix: merge main to 3.0 2023-03-22 17:42:09 +08:00
wangmm0220
dd4cf0597b fix:error in optimize consume logic 2023-03-22 17:04:02 +08:00
dapan1121
5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
Benguang Zhao
24af249f55 fix: set pWriter->info.state.committed as ever in vnodeSnapWriterClose 2023-03-22 16:05:57 +08:00
Hongze Cheng
4f0833e1a0 more code 2023-03-22 14:41:16 +08:00
Hongze Cheng
275f195c50 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-22 14:12:17 +08:00
Benguang Zhao
0b101e4952 feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database 2023-03-22 11:40:24 +08:00
Minglei Jin
0bf98096c9 fix(tsdb/cache): init isLast once for each fileset 2023-03-22 10:57:27 +08:00
Minglei Jin
cb93ac2613 enh(tsdb/cache): make merge tree next one less 2023-03-22 10:50:34 +08:00
wangmm0220
c07e563ecd fix:error in optimize consume logic 2023-03-22 10:43:11 +08:00
Minglei Jin
0b31aac2c5 enh(tsdb/cache): skip data block with merge tree 2023-03-22 10:19:58 +08:00
cadem
ea35f0ae11 feat/balance vgroup leader 2023-03-22 09:36:59 +08:00
yihaoDeng
914d391845 fix tag filter 2023-03-21 12:28:16 +00:00
Haojun Liao
69ca2b2f7b fix(tmq): do some internal refactor. 2023-03-21 19:40:36 +08:00
Haojun Liao
c3acab2070 fix(tmq): do some internal refactor. 2023-03-21 19:38:34 +08:00
dapan1121
3ab55496c1
Merge pull request #20561 from taosdata/fix/TS-2891-M 
fix: select ins_columns from stb/tb
 2023-03-21 16:24:46 +08:00
Haojun Liao
ca29dd344f other: merge main. 2023-03-21 14:04:52 +08:00
Hongze Cheng
e2de2d1286 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-21 14:04:47 +08:00
Haojun Liao
d5a386a563 fix(client): fix coverity issues. 2023-03-21 14:03:36 +08:00
Haojun Liao
18b121c69c fix(tmq): fix the invalid write and do some internal refactor. 2023-03-21 13:45:43 +08:00
Haojun Liao
ea0cc2c584
Merge pull request #20554 from taosdata/fix/TS-2828 
fix: add retry if insert error with meta change
 2023-03-21 09:01:22 +08:00
kailixu
179579f204 chore: more code 2023-03-20 17:41:22 +08:00
wangmm0220
f7b7320f5f fix:set offset if read wal none 2023-03-20 16:57:45 +08:00
wangmm0220
506c192bff fix:error in TD-23218 & remove useless logic 2023-03-20 16:26:15 +08:00
Haojun Liao
ca1dffff45
Merge pull request #20508 from taosdata/fix/liaohj 
fix(client): fix potential memory leak.
 2023-03-20 16:11:22 +08:00
wangmm0220
f80078030c fix:error in TD-23218 & remove useless logic 2023-03-20 15:40:01 +08:00
Haojun Liao
625b2dc901
Merge pull request #20513 from taosdata/fix/TD-23136 
fix:converity scan defects
 2023-03-20 15:37:59 +08:00
Haojun Liao
2517f9bb83 fix(tmq): add some logs. 2023-03-20 15:27:16 +08:00
wangmm0220
c0b41ea0b3 fix:error in TD-23218 & remove useless logic 2023-03-20 14:09:13 +08:00
Haojun Liao
a24d537d9e Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-03-20 13:28:13 +08:00
Haojun Liao
4cb1c51d4e fix(tmq): update some logs. 2023-03-20 13:27:58 +08:00
yihaoDeng
192570ce77 fix tag filter 2023-03-20 04:14:57 +00:00
Hongze Cheng
664133c945 prepare optimization 2023-03-20 10:59:16 +08:00
wangmm0220
a5144f0ba2 fix:set offset if read wal none 2023-03-20 10:10:07 +08:00
Haojun Liao
a5e9fad0f9 fix(query): set correct lastkeyInstt. 2023-03-19 23:58:17 +08:00
Haojun Liao
c678740968 refactor: do some internal refactor. 2023-03-19 19:22:43 +08:00
Haojun Liao
7e712a14b6 fix(tmq): adjust log. 2023-03-19 19:06:28 +08:00
Xiaoyu Wang
f86c8d0d6e enh: optimize last pruning logic 2023-03-19 14:40:16 +08:00
Xiaoyu Wang
6277b2564b enh: optimize last pruning logic 2023-03-19 13:41:32 +08:00
Xiaoyu Wang
9affd11eb7
Merge pull request #20542 from taosdata/fix/main_bugfix_wxy 
enh: optimize last pruning logic
 2023-03-19 12:00:18 +08:00
Xiaoyu Wang
5a4fe943dc enh: optimize last pruning logic 2023-03-19 11:01:39 +08:00
Haojun Liao
ae5155edcf fix(tmq): do some internal refactor. 2023-03-19 10:49:30 +08:00
Minglei Jin
3a5542bbbc fix(tsdb/cache): update nCols of merge tree to avoid assert failed 2023-03-19 10:19:49 +08:00
wangmm0220
ccba1d07c6 fix:error in TD-23218 & remove useless logic 2023-03-18 18:42:49 +08:00
wangmm0220
7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
yihaoDeng
afaa77cc3e fix tag filter 2023-03-18 10:01:45 +00:00
yihaoDeng
f24e06f36b fix tag filter 2023-03-18 08:58:26 +00:00
kailixu
4317564d5f Merge branch 'main' into enh/TD-22404-M 2023-03-18 14:25:34 +08:00
dapan1121
859f2594ed fix: add sma load time 2023-03-17 15:21:43 +08:00
wangmm0220
0a54d00cd2 fix:converity scan defects 2023-03-17 14:54:27 +08:00
Shengliang Guan
aa656c9c29
Merge pull request #20505 from taosdata/fix/TD-23196 
ehn(tsdb/cache): skip invalid row or data block directly with merge tree
 2023-03-17 13:19:06 +08:00
Haojun Liao
d5a8a4aefe
Merge pull request #20502 from taosdata/fix/liaohj 
fix(client): set the initial value for num_of_rows.
 2023-03-17 12:50:04 +08:00
Minglei Jin
ca115b1c87 fix(tsdb/cache): break loop to return current row 2023-03-17 11:41:17 +08:00
wangmm0220
4fdef7421c fix:add log for taosCreateLog error 2023-03-17 10:50:54 +08:00
Minglei Jin
a8d146c512 ehn(tsdb/cache): skip invalid row or data block directly with merge tree 2023-03-17 10:22:36 +08:00
Haojun Liao
970155a845 fix(query): fix coverity issues. 2023-03-16 21:53:34 +08:00
wangmm0220
6323a6e801 fix:conflicts 2023-03-16 19:18:07 +08:00
wangmm0220
14970478dc fix:conflicts 2023-03-16 19:15:08 +08:00
wangmm0220
fa2e7b234c fix:add log for schemaless & sleep longer if modify schema error 2023-03-16 19:13:15 +08:00
Shengliang Guan
925693c8a9
Merge pull request #20493 from taosdata/fix/TD-23172 
ehn(tsdb/cache): load necessary columns only
 2023-03-16 15:49:04 +08:00
yihaoDeng
3ac11ce87a enh: change log 2023-03-16 06:17:45 +00:00
Minglei Jin
b1949b5584 fix(tsdb/cache): skip remaining rows in current data block 2023-03-16 14:11:34 +08:00
Haojun Liao
345b46769c
Merge pull request #20490 from taosdata/fix/liaohj 
fix(tmq): disable non-leader vnode responsing the poll request.
 2023-03-16 14:00:42 +08:00
Minglei Jin
6e0343fc08 enh(tsdb/cache): load necessary columns only 2023-03-16 11:18:36 +08:00
Haojun Liao
a1682664f2 fix(tmq): disable non-leader vnode responsing the poll request. 2023-03-16 10:12:34 +08:00
yihaoDeng
ef092c1cce enh: add queue limit 2023-03-15 11:54:36 +00:00
Shengliang Guan
af4532dc63
Merge pull request #20476 from taosdata/fix/TD-23163 
enh(tsdb/cache): skip invalid datablock directly when traversing fs with last
 2023-03-15 19:03:48 +08:00
Minglei Jin
04d501d64a fix: destroy aColArray anyway 2023-03-15 17:41:29 +08:00
Minglei Jin
f1414355e3 tsdb/cache: skip invalid datablock directly when traversing fs with last 2023-03-15 16:24:36 +08:00
Haojun Liao
36cec7894b
Merge pull request #20472 from taosdata/fix/liaohj 
fix(query): set the correct cached tags list key length, and update s…
 2023-03-15 15:56:50 +08:00
Haojun Liao
52576071ae refactor: do some internal refactor. 2023-03-15 14:37:48 +08:00
Haojun Liao
253a760810 fix(query): set the correct cached tags list key length, and update some logs. 2023-03-15 14:30:12 +08:00
Shengliang Guan
09ca41b3f7
Merge pull request #20467 from taosdata/fix/TS-2893 
fix:create same sub table
 2023-03-15 14:07:47 +08:00
kailixu
43a029e3c4 enh: coverity scan for sma 2023-03-15 12:30:44 +08:00
54liuyao
d5defa3def fix:create same sub table 2023-03-15 11:10:55 +08:00
Hongze Cheng
e43b606917 current from binary to json 2023-03-15 10:48:51 +08:00
Benguang Zhao
cc76d78673 enh: separate sync read and write events 2023-03-14 20:35:39 +08:00
Haojun Liao
32ddecc347 other: merge main. 2023-03-14 12:13:09 +08:00
Shengliang Guan
e98b32a69f
Merge pull request #20427 from taosdata/fix/main_bugfix_wxy 
fix: last redundant read stt file
 2023-03-14 09:41:19 +08:00
Shengliang Guan
214c595491
Merge pull request #20412 from taosdata/fix/TD-23095 
fix:auto fill null column
 2023-03-14 09:36:57 +08:00
Shengliang Guan
bf03965931
Merge pull request #20413 from taosdata/FIX/TD-22564-main 
enh: not allow to propose if fsm applying progress lagging behind too far
 2023-03-14 09:36:04 +08:00
Shengliang Guan
6989f1be61
Merge pull request #20418 from taosdata/fix/TD-22671 
fix:deal with ASSERT in tmq
 2023-03-14 09:34:52 +08:00
Xiaoyu Wang
ca39dfcf2d feat: show vgroup display num of cache tables 2023-03-13 17:21:32 +08:00
Haojun Liao
731a2138df fix(tmq): fix error in tmq. 2023-03-13 17:08:17 +08:00
Xiaoyu Wang
62377619ba enh: optimizing stt file reading in last query 2023-03-13 15:05:24 +08:00
Haojun Liao
7f2aae69d4 fix(tmq): fix error in taosx 2023-03-13 01:54:29 +08:00
Xiaoyu Wang
25778754e2 fix: last redundant read stt file 2023-03-12 22:36:26 +08:00
Xiaoyu Wang
45e38d258c fix: last redundant read stt file 2023-03-12 20:40:17 +08:00
Haojun Liao
564e9bb833 Merge branch 'main' into fix/liaohj 2023-03-12 14:38:38 +08:00
wangmm0220
0e2cf0ed73 fix:deal with ASSERT in tmq 2023-03-11 16:51:34 +08:00
Xiaoyu Wang
a846c26ef9 merge main 2023-03-11 16:14:27 +08:00
wangmm0220
9cc7a9f504 fix:deal with ASSERT in tmq 2023-03-11 16:12:11 +08:00
Shengliang Guan
584f213739
Merge pull request #20401 from taosdata/fix/main_bugfix_wxy 
fix: error in last cache handle deleted data
 2023-03-11 15:43:55 +08:00
54liuyao
84ef1c78d4 fix:auto fill null column 2023-03-11 11:33:50 +08:00
Xiaoyu Wang
38a6d02ca9 Merge remote-tracking branch 'origin/main' into fix/main_bugfix_wxy 2023-03-11 10:58:47 +08:00
Benguang Zhao
d679eaf648 enh: update pMnode->applied only when pMsg->code as zero 2023-03-10 18:10:34 +08:00
Xiaoyu Wang
11e55f028b fix: error in last cache handle deleted data 2023-03-10 17:49:27 +08:00
Hongze Cheng
7e071ff458 enh: optimize snapshot transfer 2023-03-10 16:01:40 +08:00
Shengliang Guan
cf1bf07bbb
Merge pull request #20387 from taosdata/fix/main_bugfix_wxy 
enh: optimize last/last_row cost when the cache was first loaded
 2023-03-10 14:51:45 +08:00
Haojun Liao
05ddf68247 fix(tmq): fix invalid free. 2023-03-10 14:27:34 +08:00
Haojun Liao
d8807d3d5a fix(tmq): fix memory leak. 2023-03-10 14:23:16 +08:00
Xiaoyu Wang
4e4f7de0ab enh: optimize last/last_row cost when the cache was first loaded 2023-03-10 12:00:17 +08:00