29975a7a26
Remove Consume() API from mqstream interface ( #15886 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-11 20:09:59 +08:00
89356ebcb9
Modify import rpc interfaces ( #16006 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig ( #15843 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
7a3a721380
Reconstruct mqstream module ( #15784 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
9f4c59e621
Add prometheus metrics for RootCoord ( #15684 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-02 21:11:57 +08:00
f43d96b58d
[skip e2e] Modify code comments according to the naming conventions ( #15173 )
...
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
2022-02-09 10:19:56 +08:00
1f337891e1
Rename base_param to service_param, rename global_param to component_param ( #15463 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable ( #15434 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
4bccc85534
Use MsgChannelConfig in GlobalParams for all components ( #15163 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
eef295465a
Fix timetick inconsistency in drop collection ( #15408 )
...
When rootcoord drops a collection, it'll produce a `drop-collection DDL` msg
and one last timetick into DML channels of this collection.
So that when DataNode receives this msg, DN can release the resources for the specific collection.
Before this PR, RootCoord produced these two msgs with an older timestamp, generated
before many time-consuming RPCs.
Once these RPCs spend more time than timetick producing interval, the timetick of these 2 msgs are
older to the channel current timestamp, causing in-consistency in time, thus
making msgstream fail to consume the last `drop-collection DDL` msg.
This PR generates a new timestamp for `drop-collection DDL` msg and timetick msg after those time-consuming
RPCs
Fixes : #15406
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-28 20:49:41 +08:00
dee1961b4d
Make SearchResults and QueryResults return collectionID ( #15377 )
...
* Make SearchResults and QueryResults return collectionID
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
* add return collection name from QueryRequest and SearchRequest
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
* remove comment
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
2022-01-27 22:55:41 +08:00
885ecaf222
Refine time sync logic log ( #15251 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-27 11:25:41 +08:00
3a024307f4
Release collection first when drop collection ( #15370 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-24 21:51:22 +08:00
356efee492
Rename timetickSync APIs and variables for better readability ( #15264 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-18 14:47:36 +08:00
f564ea7fc7
RootCoord set healthy state after registered service ( #15261 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-18 12:09:37 +08:00
1b1d4e502b
Remove session from timetickSync ( #15255 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-18 00:07:37 +08:00
f36e02dfbb
Add more log when tt failed ( #15227 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-15 18:53:34 +08:00
f617c8887b
Time Tick Failed need log ( #15225 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
6323907566
Use CommonConfig in GlobalParams for all components ( #15106 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 19:03:35 +08:00
7efb02a4c5
Use PulsarConfig in GlobalParams for all components ( #15046 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-09 23:45:33 +08:00
f8f61fb116
Use BaseParams etcd configuration for all components ( #15012 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
18d36d78d2
[skip e2e] Add comment for rootCood.Core ( #14665 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-31 14:23:55 +08:00
e7e40c2328
RootCoord should get all binlog paths for vector field ( #14621 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-30 19:39:21 +08:00
d5e6adf381
Add log for timetickSync ( #14517 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 10:32:03 +08:00
69087ff8dd
Support embedded etcd ( #14333 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
1408926cd9
Remove logs without enough info ( #14440 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
2faf35707e
[skip e2e] Refine rootcoord comment ( #14447 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-28 19:47:21 +08:00
8b7af673a8
[skip e2e] Grammar correction ( #14417 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:24:17 +08:00
7ff9ed33ad
[skip e2e] Grammar correction ( #14416 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:21:18 +08:00
0759538855
[skip e2e] Grammar correction ( #14415 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:18:20 +08:00
30382d8bf9
Let rootcoord share proxy.TimeTickInterval ( #14326 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 21:38:45 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
f2d25ce338
[skip e2e] Refine rootcoord comment ( #14045 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-23 14:34:13 +08:00
9e9475b4fe
[skip e2e] Fix grammar mistake in meta_table ( #14017 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-22 21:31:15 +08:00
8a63dba149
Add consistency level field in collection meta ( #13766 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-21 19:49:02 +08:00
3c2605f174
[skip e2e]Update license for rc util ( #13889 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 19:19:21 +08:00
83df76d7af
[skip e2e]Update license for rc timetick ( #13888 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 18:50:59 +08:00
9fa2d757a2
[skip e2e]Update license for rc timestamp ( #13748 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 19:01:12 +08:00
907f554a0b
[skip e2e]Update license for rc suffix ( #13747 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 18:49:06 +08:00
33f326d576
[skip e2e]Update license for rc root_coord ( #13746 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 17:45:37 +08:00
8f8021eeb8
[skip e2e]Update license for rc proxyclient manager ( #13572 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:23:29 +08:00
67d99490ed
[skip e2e]Update license for rc paramtable ( #13571 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:21:31 +08:00
fc67e4bc93
[skip e2e]Update license for rc proxymanager ( #13570 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:19:36 +08:00
dea0e0277c
[skip e2e] Update root_coord imports ( #13593 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 14:13:16 +08:00
807aab3dd8
[skip e2e] Update metrics_info imports ( #13591 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 14:11:26 +08:00
12173f94f0
[skip ci]Update license for rc meta table ( #13498 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:07:10 +08:00
c544bb21ac
[skip ci]Update license for rc dml channels ( #13497 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:03:23 +08:00
12766540bd
[skip ci]Update license for rc meta snapshot ( #13496 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:01:35 +08:00
42ac5f76ed
Add constraints to the combination of load and release ( #13110 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 22:11:09 +08:00
769b05682a
[skip ci] Fix grammar mistake in suffix_snapshot ( #13420 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 12:07:44 +08:00
9f23fc7f2a
Register the service when the component state is healthy ( #13248 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
829077ad0c
Optimize reSentDdMsg logic ( #13378 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-15 08:59:08 +08:00
30e18cb5a7
Optimize rootcoord reSendDdMsg ( #13363 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-14 19:15:06 +08:00
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
2b59e15ef4
Use typeutil.RootCoordRole instead of Params.RoleName in rootcoord ( #13215 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-13 09:59:27 +08:00
2905182282
[skip ci]Fix error log output format in task.go ( #13131 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:19:10 +08:00
3ddcec79b4
[skip ci]Fix error log output format in root_coord_test.go ( #13130 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:17:30 +08:00
342200ce13
Estimate the memory size of the index before building the index ( #12973 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
a9a332dbcf
Fix empty segment compact and load ( #12710 )
...
1. Fix compaction save empty segment bug
2. Fix load empty segment bug
3. Add UT for dmlchannels to 100%
Resolves : #12450
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:03:08 +08:00
c289a19fb8
Remove log string concat in root_coord.go ( #12932 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 14:23:05 +08:00
e4de86ba42
Update rootcoord state to unhealthy before stopping ( #12845 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-07 18:39:03 +08:00
92eff1565c
Fix unlocked mutex in rootcoord ( #12772 )
...
issue: #12297
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-06 17:25:35 +08:00
1a806a174a
Support load collection with multiple vector column ( #12630 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-03 11:29:33 +08:00
9af7e179f2
Fix zero length slice declaration in timeticksync.go ( #12372 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 20:21:41 +08:00
a05a74fca2
Improve proxy manager in rootcoord ( #12303 )
...
issue: #11275
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-29 17:33:41 +08:00
cbbeb2a383
Add debug log when proxy idle for a long time ( #12319 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-27 13:57:16 +08:00
6188ac280b
Fix drop alias error ( #12281 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 18:03:17 +08:00
858e95f377
Move dmlChannel and deltaChannel into timeticksync ( #12254 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 10:07:15 +08:00
6c4c0ef6b5
Add more deploy metrics ( #12248 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
1f27eb604e
Remove all index when drop collection ( #12227 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 23:01:15 +08:00
4121e31df1
Send SIGINT to runner goroutine after etcd disconnects ( #12163 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
99b3c56b3e
Update rootcoord debug log ( #12160 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-22 16:01:14 +08:00
d4c297b1a8
Enhance dml channel operations ( #12143 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-21 21:33:13 +08:00
ee0f753f7a
Fix datarace between GetComponentStates and Register ( #11935 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-19 13:57:12 +08:00
074687e32e
Unify rootcoord debug log ( #12080 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-19 12:11:12 +08:00
27715c15f4
Fix 0 len slice declaration for dml_channels.go ( #12094 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-18 22:33:26 +08:00
5edbb82610
Add session revoke ( #11908 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
b0f268e087
Add more debug log for proxy registry in rootcoord ( #11899 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 19:21:49 +08:00
12f50cb22c
[skip ci]Update OWNERS files ( #11898 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
29e9adc7be
Fix golint warnings for rootcoord ( #11872 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:27:11 +08:00
173e7b3808
Fix golint warnings for rootcoord/root_coord.go ( #11871 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:25:17 +08:00
959d8c2ce1
Fix golint warnings for rootcoord/meta_table.go ( #11870 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:19:20 +08:00
3a9d6ee070
[skip ci] Add a log ( #11729 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-15 19:26:49 +08:00
3cd47cd89e
Remove common.yaml and component.yaml ( #11662 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 18:53:11 +08:00
5357e301f4
Fix retrieve search error ( #11501 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
5f08b67156
Move node.yaml to component.yaml ( #11363 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-10 14:27:37 +08:00
639800241d
Make flow graph for delta channel ( #11379 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
0699176d24
[skip ci]Fix golint error in rootcoord ( #11352 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 23:06:58 +08:00
a2ad88237d
Add deltaChannels in rootcoord core ( #11097 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 21:04:14 +08:00
628a3274bf
Use lazy mode to set dml msgstream as producer ( #10993 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 20:18:48 +08:00
54be3c15bf
Improve error message in rootcoord ( #11071 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:18:36 +08:00
260c0597cb
Improve error message in rootcoord ( #11070 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:16:43 +08:00
394e8ad634
Improve error message in rootcoord ( #11072 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:14:36 +08:00
66b9684fe5
Update ListCollectionPhysicalChannels and ListCollectionVirtualChannels ( #11007 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 15:50:30 +08:00
53b6b8d0fb
Improve error message in rootcoord ( #10876 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:40:10 +08:00
07818ec26a
Improve error message in rootcoord ( #10875 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:38:06 +08:00
1835a7cb0c
Improve error message in rootcoord ( #10877 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:35:57 +08:00
2df2d488e1
Fix Unit test fatal fail ( #10933 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
93f205b49e
Rename param names ( #10853 )
...
* Rename param names
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
* Rename configs
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-28 23:16:40 +08:00
a7d55229f0
Improve error message in rootcoord ( #10836 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-28 20:03:29 +08:00
jaime
groot
Cai Yudong
cai.zhang
guoxiangzhou
XuanYang-cn
Filipe Caixeta
Xiaofan
xige-16
shaoyue
Jiquan Long
edward.zeng
cxytz01
jaime
Xiangyu Wang
JackLCL
congqixia
Bingyi Sun
godchen
zhenshan.cao