354 commits

Author	SHA1	Message	Date
Haojun Liao	97772e9aab	fix(stream): the checkpoint version can only be updated when generating checkpoint.	2023-11-11 15:40:05 +08:00
Haojun Liao	1301b92844	fix(stream): fix errors in scan-history, introduced by refactor	2023-11-07 16:41:15 +08:00
Haojun Liao	8c2f6bab0e	fix(stream): exec scan-history in timer.	2023-11-07 16:40:03 +08:00
Haojun Liao	d440da0d8c	enh(stream): execute scan history by using time slice 1s.	2023-11-05 01:26:53 +08:00
Haojun Liao	53b2158c54	refactor: do some internal refactor.	2023-11-03 13:51:17 +08:00
Haojun Liao	7a32b3a209	fix(stream): not transfer state if state is not appropriate.	2023-11-02 19:12:36 +08:00
Haojun Liao	706f1e4744	fix(stream): fix deadlock in transfer state.	2023-11-02 18:18:04 +08:00
Haojun Liao	7cf90dde5c	refactor: do some internal refactor.	2023-11-01 19:38:13 +08:00
Haojun Liao	00f029e44f	refactor: add some logs.	2023-11-01 19:38:12 +08:00
Haojun Liao	3f561fb8e4	fix(stream): remove invalid assert.	2023-11-01 11:43:02 +08:00
Haojun Liao	762cfef498	fix(stream): adjust the stop condition for stream tasks.	2023-10-31 16:40:16 +08:00
Haojun Liao	88469568b8	fix(stream): handle failure during checkpoint	2023-10-31 10:45:14 +08:00
Haojun Liao	c7285c0ede	fix(stream): add expired epset node list for stream tasks in hb to mnode.	2023-10-27 23:41:57 +08:00
Haojun Liao	091238e7be	fix(stream): fix bugs caused by refactor sm.	2023-10-27 09:54:58 +08:00
Haojun Liao	e1f6043eed	fix(stream): fix bugs caused by refactor sm.	2023-10-27 09:54:57 +08:00
Haojun Liao	1eac7f44c0	fix(stream): fix error in stream.	2023-10-27 09:54:56 +08:00
Haojun Liao	579dd8e6b2	refactor(stream): do some internal refactor.	2023-10-27 09:54:56 +08:00
Haojun Liao	6f3c0d17cc	refactor(stream): add state machine to manage the state of stream tasks.	2023-10-27 09:54:49 +08:00
Haojun Liao	596eb073b7	refactor(stream): do some internal refactor.	2023-10-27 09:54:48 +08:00
Haojun Liao	62c58ecd8b	fix(stream):add more check for test cases.	2023-10-27 09:54:06 +08:00
Haojun Liao	4780474877	fix(stream): continue	2023-10-09 20:10:23 +08:00
Haojun Liao	da833ccb30	refactor: inc the dump batch.	2023-10-09 20:10:23 +08:00
Haojun Liao	af2c0c95e9	refactor: do some internal refactor.	2023-10-09 20:10:22 +08:00
Haojun Liao	940d6a3cb4	fix(stream): check items in queue and qall, stead of only the queue items.	2023-10-09 20:10:21 +08:00
Haojun Liao	932d93ab35	refactor: wait for more time for future data	2023-10-09 20:09:21 +08:00
Haojun Liao	dfe8641c0c	refactor: optimize the fill-history task launch policy, and do some other internal refactor.	2023-10-09 20:08:52 +08:00
Haojun Liao	38164435f9	refactor: do some internal refactor.	2023-10-09 20:08:52 +08:00
Haojun Liao	f2848de12a	fix(stream): reduce the counter when remove stream tasks.	2023-10-09 20:08:52 +08:00
Haojun Liao	7f8da725bc	enh(stream): add quota limitation for sink task.	2023-10-09 20:08:13 +08:00
Haojun Liao	a248f3d088	refactor: do some internal refactor.	2023-10-09 20:08:12 +08:00
Haojun Liao	52763ca2a3	refactor: do some internal refactor.	2023-10-09 20:08:07 +08:00
Haojun Liao	ef9efc8a8e	refactor: do refactor the sink task.	2023-10-09 20:07:53 +08:00
Haojun Liao	e4ac835554	fix(stream): disable token bucket.	2023-10-09 20:07:53 +08:00
Haojun Liao	1f45bd82d2	other: merge stream fix in main.	2023-10-09 20:07:01 +08:00
Haojun Liao	ce85945583	fix(stream): set correct size for results generated by scan history stream tasks.	2023-10-09 20:06:05 +08:00
Haojun Liao	b38f9e0288	fix(stream): update logs.	2023-10-09 20:06:05 +08:00
Haojun Liao	636eccc160	fix(stream): add null check	2023-10-09 20:05:37 +08:00
Haojun Liao	7ccc273206	other: merge stream fix in main.	2023-10-09 20:05:29 +08:00
Haojun Liao	98ef566eb4	fix(stream): remove fill-history sink task.	2023-10-09 20:04:17 +08:00
Haojun Liao	e84eeee6b8	refactor: do some internal refactor.	2023-10-09 20:04:17 +08:00
Haojun Liao	3d1f29ff21	fix(stream): fix memory leak.	2023-10-09 20:04:16 +08:00
Haojun Liao	283118bf68	fix(stream):fix missing unlock.	2023-10-09 19:56:17 +08:00
Haojun Liao	aaa12ed4f8	refactor: do some internal refactor about the sched status set	2023-10-09 19:56:17 +08:00
Haojun Liao	01d104706e	refactor(stream): remove unnecessary streamschedTask function to improve the performance.	2023-10-09 19:56:17 +08:00
Haojun Liao	f6a097d96f	refactor: do some internal refactor.	2023-09-12 21:58:22 +08:00
Haojun Liao	e457d94ac6	refactor: do some internal refactor.	2023-09-12 18:09:02 +08:00
Haojun Liao	85a5c45098	fix(stream): limit the already processed data.	2023-09-10 00:01:25 +08:00
Haojun Liao	6f5c855a4b	fix(stream): fix msg lost bug.	2023-09-09 15:08:36 +08:00
Haojun Liao	35b97cbd19	fix(stream): set correct token in bucket.	2023-09-08 23:50:41 +08:00
Haojun Liao	2285b834b0	refactor: do some internal refactor.	2023-08-31 13:53:12 +08:00