Commit graph

5614 commits

Author SHA1 Message Date
Haojun Liao
a0c2b34788
Merge pull request #21119 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-28 12:53:31 +08:00
Haojun Liao
da0d9c78ef refactor: do some internal refactor. 2023-04-28 11:42:34 +08:00
liuyao
2984c5a758 merge main 2023-04-28 10:34:46 +08:00
wangmm0220
cce868d140 fix:offset encode assert error 2023-04-28 09:45:16 +08:00
wangmm0220
1ee1b0422c fix:change push mgr from SArray to Hash 2023-04-27 23:44:27 +08:00
yihaoDeng
36a4413bf1 merge rocksdb inst 2023-04-27 14:38:33 +00:00
wangmm0220
db5b5c828e fix:add log for msg push 2023-04-27 18:35:10 +08:00
Haojun Liao
ad7c3218f7
Merge pull request #21111 from taosdata/fix/liaohj_main
enh(query): stop tsdb reader ASAP.  TD-23249
2023-04-27 17:45:38 +08:00
Haojun Liao
802c05150a enh(query): stop tsdb reader ASAP. 2023-04-27 16:18:28 +08:00
Haojun Liao
e822dc2025 enh(query): add reader status. 2023-04-27 16:10:36 +08:00
Haojun Liao
7762e0ea47 refactor: do some internal refactor. 2023-04-27 16:10:06 +08:00
Haojun Liao
91f9b58f9a refactor: do some internal refactor. 2023-04-27 16:06:06 +08:00
wangmm0220
8677b56a4f fix:assert error in tqProcessSubmitReqForSubscribe if put pHandle to array twice 2023-04-27 15:44:44 +08:00
Haojun Liao
b7040ed15e enh(stream): support resume from the latest data, and do some internal refactor. 2023-04-27 15:07:54 +08:00
Haojun Liao
e1bd65ec0a
Merge pull request #21105 from taosdata/fix/liaohj_main
fix(query): check the init status for pReader->status.merger  TD-23903
2023-04-27 12:40:13 +08:00
Haojun Liao
3093726c5a fix(query): init row merger for tsdbread. 2023-04-27 11:49:00 +08:00
Haojun Liao
fe3f3f478a fix(query): check the init status for pReader->status.merger 2023-04-27 10:15:52 +08:00
wangmm0220
6a889ae80e Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-27 09:48:04 +08:00
Haojun Liao
db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
liuyao
863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
wangmm0220
224d87b131 fix:cosume null if rebalance 2023-04-26 17:58:14 +08:00
Haojun Liao
9a35d4e950
Merge pull request #21087 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-26 17:57:37 +08:00
Minglei Jin
a1fba2df65 Merge branch '3.0' into fix/TD-23623 2023-04-26 17:38:47 +08:00
Haojun Liao
ca4df761f1 fix(query): fix syntax error. 2023-04-26 17:14:54 +08:00
Haojun Liao
627429d490 fix(query): fix the comparion error. 2023-04-26 16:05:57 +08:00
Haojun Liao
3e80f57fc7 refactor: do some internal refactor. 2023-04-26 12:09:05 +08:00
Haojun Liao
59725d1d87 refactor: do some internal refactor. 2023-04-26 12:02:43 +08:00
Haojun Liao
8d0a4772a5
Merge pull request #21070 from taosdata/fix/liaohj_main
enh(query): opt last row read performance. TD-23313
2023-04-26 11:54:48 +08:00
Hui Li
133327140f
Merge pull request #21078 from taosdata/fix/TS-3267
fix: more fix
2023-04-26 10:42:09 +08:00
Minglei Jin
6835e75903 cache/get: malloc zero-length binary to unify frees 2023-04-26 10:07:15 +08:00
Haojun Liao
8e2edd6ebf fix(query): fix null ptr access. 2023-04-26 10:00:00 +08:00
Minglei Jin
5758aa4d80 cache/read: fix pRow, pLastCols memory issues 2023-04-26 08:17:08 +08:00
Haojun Liao
2a45ef88b0 fix(query): fix memory leak. 2023-04-26 00:40:33 +08:00
Haojun Liao
7b7a483afc fix(query): add tmp variable to hold the TSDBROW value. 2023-04-25 18:43:48 +08:00
Minglei Jin
c8cbabe419 cache/none column: move to outter scope 2023-04-25 18:13:33 +08:00
Hongze Cheng
49728a235e fix: more fix 2023-04-25 17:32:45 +08:00
54liuyao
b79313ecd7 pause&resume 2023-04-25 16:59:09 +08:00
wangmm0220
4321012ac4 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-25 16:24:28 +08:00
wangmm0220
d1e5d6e0f9 fix:pHandle->msg is not null if rebalance 2023-04-25 16:23:58 +08:00
slzhou
aede1090ff fix: the latest schema may delete columns 2023-04-25 16:23:30 +08:00
Minglei Jin
2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Haojun Liao
16fe48f770 fix(query): fix memory leak. 2023-04-25 16:09:58 +08:00
Haojun Liao
bca5fc7893 fix(query): fix memory leak. 2023-04-25 15:28:54 +08:00
cadem
2fd9640a39 change learner config format 2023-04-25 15:15:28 +08:00
Haojun Liao
8dbc3b3457 refactor: do some internal refactor. 2023-04-25 15:07:37 +08:00
Haojun Liao
0b6e531dd3 refactor: do some internal refactor. 2023-04-25 14:56:20 +08:00
Haojun Liao
81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Haojun Liao
05d1692073 refactor: do some internal refactor. 2023-04-25 13:50:05 +08:00
Haojun Liao
d8762b9bc9 refactor: do some internal refactor. 2023-04-25 10:48:21 +08:00
Haojun Liao
6467b99a52 refactor: do some internal refactor. 2023-04-25 10:23:21 +08:00
Haojun Liao
4c4e148635 refactor: do some internal refactor. 2023-04-25 10:19:37 +08:00
wangmm0220
41bec8560a opti:change push mgr to consume msg for subscribe 2023-04-25 09:58:28 +08:00
Haojun Liao
e724bc15e0 refactor: do some internal refactor. 2023-04-25 09:54:00 +08:00
Hongze Cheng
d57676c924 fix: delete table error 2023-04-25 09:52:16 +08:00
Minglei Jin
33fba6f99a cache/read: fix transferBuf index 2023-04-25 09:48:56 +08:00
Haojun Liao
ae8a9d25c0 refactor: do some internal refactor. 2023-04-25 09:41:49 +08:00
Haojun Liao
a73957aaba fix(query): fix error in add row into merger. 2023-04-25 09:24:15 +08:00
Haojun Liao
37d042a338 fix(query): fix error in add row into merger. 2023-04-25 00:33:24 +08:00
Haojun Liao
9a14e0db47 fix(query): fix error in add row into merger. 2023-04-25 00:30:43 +08:00
Haojun Liao
c6daa68e54 enh(query): opt merge life cycle. 2023-04-25 00:17:37 +08:00
wangmm0220
8572f4a32f opti:change push mgr to consume msg for subscribe 2023-04-24 19:41:30 +08:00
Minglei Jin
4adc95f9db cache/deserialize: fix binary pData calc 2023-04-24 18:21:25 +08:00
Minglei Jin
3b88efbd5f cache/delete: fix null column values 2023-04-24 17:07:20 +08:00
Haojun Liao
7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
Haojun Liao
d73306f616 enh(query): opt last row read performance. 2023-04-24 16:08:49 +08:00
Haojun Liao
5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
Minglei Jin
c7d5b48920 cache/read: fix pRes buffer index 2023-04-24 15:42:53 +08:00
Xiaoyu Wang
f5a974489e
Merge pull request #21045 from taosdata/fix/block-check-to-async-check
fix/block-check-to-async-check
2023-04-24 15:41:17 +08:00
Haojun Liao
48c36a8c35 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 14:44:13 +08:00
Minglei Jin
f8bf98f6dc Merge branch '3.0' into fix/TD-23623 2023-04-24 14:28:49 +08:00
Haojun Liao
fa46165227 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 12:59:24 +08:00
Haojun Liao
057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
Minglei Jin
8f21090343 cache/delete: just remove affected cache entries 2023-04-24 10:47:28 +08:00
cadem
a781d43577 fix/block-check-to-async-check 2023-04-24 10:23:43 +08:00
wangmm0220
9bd74ec5b2 Merge branch 'fix/TS-3222' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-24 10:14:32 +08:00
Haojun Liao
134c0528ae Merge branch 'main' into fix/liaohj_main 2023-04-24 01:43:00 +08:00
wangmm0220
77e03bfd78 opti:change push mgr to consume msg for subscribe 2023-04-23 20:14:49 +08:00
liuyao
641c707b37 pause&resume 2023-04-23 17:37:10 +08:00
wangmm0220
4bc319c6dd Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-23 15:15:33 +08:00
Xiaoyu Wang
35f02cdbad
Merge pull request #21013 from taosdata/FIX/TD-23768-main
fix: change tdbTbInsert to tdbTbUpsert for meta update in tdb
2023-04-23 15:15:17 +08:00
liuyao
5bd8fe5441 feat:add pause&resume 2023-04-23 15:09:01 +08:00
54liuyao
5089528a02 feat:stream pause&resume 2023-04-23 15:08:51 +08:00
Haojun Liao
6fc364db19 fix(query): add null ptr check. 2023-04-23 13:53:55 +08:00
Haojun Liao
9cf89c6b6f enh(tmq): add check for consumer Id; 2023-04-23 11:51:43 +08:00
Xiaoyu Wang
206887166c fix: vnode errcode setting error 2023-04-23 10:53:28 +08:00
yihaoDeng
917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao
3dbe208712 enh(tmq): fix memory error and add retrieve wal info as required. 2023-04-22 15:34:46 +08:00
Benguang Zhao
3c53516299 fix: use tdbTbUpsert for metaUpdate functions 2023-04-21 19:24:09 +08:00
Minglei Jin
9918d326cc Merge branch '3.0' into fix/TD-23623 2023-04-21 18:39:07 +08:00
Minglei Jin
a75d43a259 cache/read: remove unused extract function 2023-04-21 18:38:20 +08:00
Minglei Jin
12fc21ae84 cache/get: use pRow from reader 2023-04-21 18:34:58 +08:00
wangmm0220
6efbcfec4b Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-21 17:46:35 +08:00
Minglei Jin
09c62e6ca2 fix values_list index when freeing 2023-04-21 16:30:00 +08:00
Minglei Jin
8e87b21a59 rocks/multi_get value: free rocks allocated memory 2023-04-21 16:23:40 +08:00
Minglei Jin
01d95b5e95 cache/read: use new interface with signle query 2023-04-21 16:07:22 +08:00
Minglei Jin
0394c6a50c free rocks errs array 2023-04-21 15:24:42 +08:00
Minglei Jin
c9959b5bf6 dst slot for last_row 2023-04-21 14:18:04 +08:00
Haojun Liao
b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Haojun Liao
8fac91e265 refactor: do some internal refactor. 2023-04-21 09:38:51 +08:00
Haojun Liao
6c641cff39 fix(stream): fix error in start stream tasks. 2023-04-21 09:37:16 +08:00
Haojun Liao
471abd9160 log: update the log. 2023-04-20 23:39:13 +08:00
Haojun Liao
5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
dm chen
d594e4963f
Merge branch '3.0' into feat/learner 2023-04-20 19:11:06 +08:00
Haojun Liao
65fded4a28 fix(stream): set the correct number of tasks. 2023-04-20 19:03:43 +08:00
Haojun Liao
f9801ba9c5 enh(stream): stop stream asap. 2023-04-20 18:58:07 +08:00
Haojun Liao
6f595fb5fd other: add some logs. 2023-04-20 18:50:44 +08:00
wangmm0220
5df7906a62 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-20 18:33:37 +08:00
Minglei Jin
7d896bbc85 last/empty_table: continue if table's empty 2023-04-20 17:36:46 +08:00
Haojun Liao
c7e42d5422 other: do some internal refactor. 2023-04-20 17:30:02 +08:00
Haojun Liao
8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Minglei Jin
1e51b2d781
Merge branch '3.0' into fix/TD-23623 2023-04-20 16:32:43 +08:00
Minglei Jin
642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
Benguang Zhao
1b2fe38f75 enh: improve logging msg in metaSnapWrite 2023-04-20 16:22:16 +08:00
Haojun Liao
b60b1796f7 fix(stream): add lock during check wal to create new stream task. 2023-04-20 15:53:41 +08:00
Benguang Zhao
a21e0fe75e enh: propose vnode commit synchronously 2023-04-20 14:28:56 +08:00
Haojun Liao
742b5ee08c other: update wal logs level. 2023-04-20 13:42:16 +08:00
Haojun Liao
c654f1145d enh(stream): add new msg for seek, and do some internal refactor. 2023-04-20 10:59:16 +08:00
cadem
8b16f4b118 config compitible 2023-04-19 18:02:04 +08:00
yihaoDeng
5402a6061f Merge branch 'dev' into enh/rocksRevert 2023-04-19 17:37:07 +08:00
cadem
c22bd63ed4 vnode config compitible 2023-04-19 15:11:16 +08:00
Xiaoyu Wang
7cf9919ab0
Merge pull request #20964 from taosdata/enh/3.0_planner_optimize
feat: last queries with tags output can be read from cache
2023-04-19 14:34:32 +08:00
Haojun Liao
3f12156c53 enh(tmq): support seek in tmq. 2023-04-19 13:56:42 +08:00
Xiaoyu Wang
586b3945d1 feat: last queries with tags output can be read from cache 2023-04-19 13:09:11 +08:00
wangmm0220
594d68b8a4 fix:remove lock for consume handler 2023-04-19 11:46:59 +08:00
wangmm0220
14fd2e7904 fix:remove lock for consume handler 2023-04-19 11:44:52 +08:00
wangmm0220
1061eef144 fix:move consumer msg from fetch thread to query thread 2023-04-19 10:49:18 +08:00
wangmm0220
25542c26c7 fix:remove tmPushMsg in consumer 2023-04-19 10:43:13 +08:00
Minglei Jin
76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
cadem
3b78d4382b add learner 2023-04-18 19:03:45 +08:00
Haojun Liao
fb32ffd960 fix(stream): update the reference count value to be int32, insead of int8 2023-04-18 18:06:03 +08:00
dapan1121
2af63992ea
Merge pull request #20952 from taosdata/fix/TD-23639
fix: fix double free caused crash
2023-04-18 17:50:45 +08:00
Xiaoyu Wang
6669c3a5ad feat: last queries with tags output can be read from cache 2023-04-18 17:13:14 +08:00
Haojun Liao
cc67b631f6 refactor: do some internal refactor. 2023-04-18 17:01:09 +08:00
Haojun Liao
9f16802451 fix(stream): set the initial value. 2023-04-18 16:42:40 +08:00
Ganlin Zhao
e58bf86c33 fix local variable 2023-04-18 16:34:06 +08:00
Haojun Liao
abfc2455e6 fix(stream): update the atomic variables. 2023-04-18 16:21:30 +08:00
Haojun Liao
7da998ecfb other: merge main. 2023-04-18 16:15:08 +08:00
Minglei Jin
dee2ca3476 tsdb/cache: inplace_update are commented out 2023-04-18 16:09:42 +08:00
Haojun Liao
7a8dd0db45 refactor: update the log. 2023-04-18 16:08:51 +08:00
Minglei Jin
dd42db0077 tsdb/mem table: remove unused codes 2023-04-18 15:09:13 +08:00
Minglei Jin
e159c4ead9 first round rocks batch write implementation 2023-04-18 14:25:35 +08:00
Haojun Liao
76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj
fix(stream): set the correct initial checkpoint versions.
2023-04-18 11:26:48 +08:00
Haojun Liao
97da34050b fix(query): fix invalid free. 2023-04-18 10:40:53 +08:00
Haojun Liao
7d3e5aa3d3 fix(query): set the table schema correctly when the table is dropped. 2023-04-18 09:03:30 +08:00
Haojun Liao
2ae05b8cf6 fix(stream): set the correct initial offset value. 2023-04-18 08:56:31 +08:00
liuyao
27d14f742d fix:stream memory leak 2023-04-17 17:27:02 +08:00
Ganlin Zhao
d21628b2c9 fix: fix double free caused crash 2023-04-17 16:57:29 +08:00
Haojun Liao
be90d2c511 fix(stream): disable stream task when no tasks exist. 2023-04-16 23:07:54 +08:00
Haojun Liao
1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao
04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00