Commit Graph

296 Commits (e2d16ed84d358331a34246bfee2e8f8fe629ef9e)

Author SHA1 Message Date
xige-16 8259f81ae6
[skip ci] Fix golint for loadBalanceSegmentLoop (#13548)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 22:37:34 +08:00
xige-16 8f0b3ccd08
[skip ci] Fix golint for QueryNode (#13547)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 22:35:38 +08:00
xige-16 cf82a248d5
[skip ci]Fix golint for QueryNode (#13468)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 19:57:14 +08:00
xige-16 b404138ba7
[skip ci]Fix golint for chooseSegmentToBalance (#13303)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 22:19:10 +08:00
xige-16 42ac5f76ed
Add constraints to the combination of load and release (#13110)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 22:11:09 +08:00
xige-16 7c18be6e08
[skip ci]Fix golint for loadBalanceSegmentLoop (#13302)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 21:01:10 +08:00
xige-16 97d5231a0a
Reorganize querycoord proto (#13181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
congqixia 322f0c5c5c
Remove unused variables (#13380)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-15 11:11:24 +08:00
xige-16 c68bae236e
[skip ci]Fix golint for watchHandoffSegmentLoop (#13301)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 07:01:09 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
congqixia 835e0985fd
Reduce queryNodeCluster range prevent blocking online/offline events (#13249)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-13 21:51:10 +08:00
xige-16 6f8ea8cc7b
Fix querycoord panic at getRecoveryInfo (#12983)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-13 10:29:27 +08:00
Cai Yudong b7e97f67e5
Use typeutil.QueryCoordRole instead of Params.RoleName in querycoord (#13216)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-13 10:15:26 +08:00
dragondriver 255be8f4a8
Fix querycoord panic when close before init scheduler (#13051)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-11 10:15:13 +08:00
xige-16 9ccbffc4b1
[skip ci]Fix golint for watchNodeLoop (#13199)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 21:55:48 +08:00
xige-16 f85c1e8f1e
[skip ci]Fix golint for SetIndexCoord (#13198)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 21:54:01 +08:00
JackLCL 554b7918e9
[skip ci]Fix error log output format in task_scheduler.go (#13129)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:16:03 +08:00
jaime 874c24862b
[skip ci] Fix a grammar mistake in querycoord task (#13127)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-10 10:13:44 +08:00
jaime 4e538f9929
[skip ci] Fix a grammar mistake in querycoord task_scheduler (#13126)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-10 10:11:59 +08:00
xige-16 63ead50544
[skip ci]fix golint for SetDataCoord (#13121)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 22:25:08 +08:00
xige-16 60d70e82fd
[skip ci]fix golint for SetRootCoord (#13120)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 22:23:22 +08:00
xige-16 1a83064d5a
[skip ci]fix golint for querycoord.start (#13119)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 22:21:43 +08:00
xige-16 00720f8dd6
[skip ci]Fix golint for ReleasePartitions (#13022)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 09:27:06 +08:00
xige-16 5dd0cb35bc
[skip ci]Fix golint for LoadPartitions (#13021)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 09:25:16 +08:00
congqixia de454956fe
Refactor session WatchSessions to allow rewatch when Rev Compacted (#12880)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 10:11:04 +08:00
xige-16 03c27b17e2
[skip ci]Fix golint for LoadCollection (#12919)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-08 09:41:05 +08:00
jaime 7d02208d71
[skip ci] Add a comment for reloadFromKV in index_checker (#12921)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-07 21:49:04 +08:00
xige-16 6050504d43
[skip ci]Fix golint for querycoord cluster (#12918)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-07 21:47:12 +08:00
xige-16 39557f1e4d
[skip ci]Fix golint for ReleaseCollection (#12920)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-07 21:33:04 +08:00
congqixia 615b23a7b3
Update querycoord state to unhealthy before stopping (#12905)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-07 21:27:29 +08:00
xige-16 c9fa6d6dd1
[skip ci]Fix golint for setCollectionInfo (#12833)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 21:51:45 +08:00
xige-16 52978273b5
[skip ci]Fix golint for node.start (#12831)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 21:49:53 +08:00
xige-16 d98b808f26
[skip ci]Fix golint for addCollection (#12832)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 21:47:58 +08:00
xige-16 9a208254d8
[skip ci] Fix golint of cluster (#12737)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 11:43:34 +08:00
xige-16 7d723abdff
Start balanceLoop when Params.autoBalance equal to true (#12660)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 10:19:41 +08:00
xige-16 e980516036
[skip ci] Fix golint of balanceLoop (#12736)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 10:07:35 +08:00
xige-16 6d9a93ef37
[skip ci] Fix golint of reloadFromKV (#12735)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 10:05:41 +08:00
congqixia b009b39557
Fix zero length slice declaration in querycoord/channel_allocator.go (#12716)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-04 00:41:33 +08:00
edward.zeng 877bfdac58
[skip ci] Refine querycoord param table comment (#12722)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-03 18:51:33 +08:00
zhenshan.cao af22977cd3
Fixbug: grpc connection is closed by mistake (#12307)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-03 15:15:32 +08:00
xige-16 567c657310
[skip ci]Fix golint for getComponentInfos (#12665)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-02 22:55:36 +08:00
xige-16 0e48ac19e9
[skip ci]Fix golint for isOnline (#12664)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-02 22:53:40 +08:00
xige-16 d237edd846
[skip ci]Fix golint for getOfflineNodes (#12663)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-02 22:51:46 +08:00
xige-16 6dd7afd1a4
[skip ci]Add comment for getOnlineNodes (#12575)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-01 22:41:33 +08:00
godchen a76f490f12
Remove querycoord grpc error (#12535)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 22:15:37 +08:00
xige-16 e6d9be3dfa
[skip ci]Add comment for stopNode (#12574)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-01 22:01:33 +08:00
xige-16 d9af522af5
[skip ci]Add comment for removeNodeInfo (#12573)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-01 21:59:31 +08:00
godchen b45d7baf97
Add logs for add delta channels (#12347)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 16:39:31 +08:00
xige-16 60831cae99
[skip ci]Add comment for getNodeInfoByID (#12493)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-30 21:23:34 +08:00
xige-16 0abc0ecf20
[skip ci]Add comment for registerNode (#12492)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-30 21:21:39 +08:00
xige-16 300027b0d2
[skip ci]Add comment for getNumDmChannels (#12491)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-30 21:19:43 +08:00
xige-16 b1da696767
[skip ci]Add comment for getSegmentInfoByNode (#12411)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:21:41 +08:00
xige-16 a4cfd1cb46
[skip ci]Add comment for releasePartitions (#12410)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:17:46 +08:00
xige-16 fa26804279
[skip ci]Add comment for releaseCollection (#12409)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:15:49 +08:00
godchen 48bdeb56d8
Merge watch delta channel positions (#12309)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-26 22:47:17 +08:00
godchen ad83090925
Merge delta channels when load partition (#12274)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 18:49:16 +08:00
godchen 88012acb86
Clear useless segments info. (#12262)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 17:37:15 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
xige-16 99397535be
Fix update rollBackTask after triggerTask fail (#12228)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-24 10:19:15 +08:00
godchen d7cc1c1e36
Check load segments length before watch delta channel (#12200)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-23 11:21:15 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
xige-16 e66537f9c9
Parallel estimate segment size (#12136)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-19 18:09:13 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-19 13:57:12 +08:00
xige-16 38afc63c16
Add ut for loadbalanceTask when index created (#11981)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-18 22:21:55 +08:00
xige-16 d666c2a190
Fix txn limit error when querycoord remove task from etcd (#12084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-18 19:35:15 +08:00
XuanYang-cn 7066e75112
Add global mutex for global map (#12071)
Fixes: #12070

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-18 15:35:12 +08:00
dragondriver d35bd761b1
[skip ci] Enhance log when load failed (#12054)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-18 11:31:12 +08:00
bigsheeper 152d55dbfa
Fix the deadlock of the querycoord cluster (#11796)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 23:37:11 +08:00
XuanYang-cn 3acb73ebe6
[skip ci]Update license for qc task (#12016)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:49:32 +08:00
XuanYang-cn de95a6c866
[skip ci]Update license for qc qn (#12015)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:47:36 +08:00
XuanYang-cn ed8cfed18a
[skip ci]Update license for qc mock (#12014)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:45:45 +08:00
XuanYang-cn 403be89420
[skip ci]Update license for qc meta (#12013)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:43:50 +08:00
XuanYang-cn e8398eb02d
[skip ci]Update license for qc impl (#12012)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:41:41 +08:00
XuanYang-cn 360d89d2cf
[skip ci]Update license for qc cluster (#12011)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:39:17 +08:00
xige-16 55d162356b
Fix wrong set of segmentLoadInfo.enableIndex (#11964)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 14:37:11 +08:00
xige-16 53012efbe4
Fix query coord panic when handoff (#11962)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 12:27:10 +08:00
Xiaofan f654621650
Remove the etcd deletion of segment data path on querynode (#11863)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 12:13:10 +08:00
xige-16 8a0ee27799
Estimate segment size according index and binlog file header (#11875)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
congqixia 5edbb82610
Add session revoke (#11908)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
xige-16 7908045a28
[skip ci] Fix golint of removeQueryChannel in queryCoord (#11941)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:53:13 +08:00
xige-16 544f1da95b
[skip ci] Fix golint of addQueryChannel in queryCoord (#11940)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:51:18 +08:00
xige-16 acd75c312a
[skip ci] Fix golint of WatchDeltaChannels in queryCoord (#11939)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:49:25 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
xige-16 1278f4f356
[skip ci] Fix golint of watchDmChannels in queryCoord (#11861)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:35:14 +08:00
xige-16 354fd03729
[skip ci] Fix golint of releaseSegments in queryCoord (#11860)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:33:20 +08:00
xige-16 20a1c9774b
[skip ci] Fix golint of loadSegments in queryCoord (#11859)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:31:24 +08:00
godchen 4d58ff2df7
Fix reload delta channel error (#11783)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-15 15:17:09 +08:00
godchen 4cd7680f87
Reschedule load segments (#11391)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-13 08:49:08 +08:00
Xiaofan 71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
xige-16 d857577a7b
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 18:49:10 +08:00
xige-16 94b31e6bf9
Postpone the execution of handoff until index creation is complete (#11665)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 16:49:10 +08:00
xige-16 dba0ae4421
Refactor segment allocate policy on querycoord (#11181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-11 12:56:42 +08:00
Xiaofan 5f08b67156
Move node.yaml to component.yaml (#11363)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-10 14:27:37 +08:00
godchen 639800241d
Make flow graph for delta channel (#11379)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
xige-16 fcbe46ba75
Remove sealed segemnt from query node after compaction (#11430)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-08 21:00:02 +08:00
xige-16 96cd9352ff
Fix wrong TriggerCondition When load balance (#11389)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-08 11:15:04 +08:00
bigsheeper 38375ee1d3
Add LoadBalance (#9945)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 16:54:59 +08:00
xige-16 82c199227c
Add execute logic for balancing sealed segments (#11343)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-06 15:22:56 +08:00
xige-16 9fcfbde368
Add getNodeInfoByID and getSegmentInfoByNode function for cluster (#11247)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 16:00:55 +08:00