Commit Graph

217 Commits (5eb6127fc58598a5ce4e1a9bc5dae2f3a77cf92b)

Author SHA1 Message Date
Xiaofan 69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
cai.zhang 1dd909f3fa
[skip e2e]Reorder head files for task.go (#14488)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-29 12:04:03 +08:00
cai.zhang cac2ee717a
[skip e2e]Reorder head files for priority_queue_test.go (#14487)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-29 12:02:16 +08:00
cai.zhang 85e1acb64e
[skip e2e]Reorder head files for node_manager.go (#14486)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-29 11:45:29 +08:00
Xiaofan 1408926cd9
Remove logs without enough info (#14440)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
cai.zhang 523dbd69c2
[skip e2e]Reorder head files for metrics_info_test.go (#14421)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-28 19:31:27 +08:00
cai.zhang c7ae7d93a3
[skip e2e]Reorder head files for meta_table_test.go (#14420)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-28 19:29:20 +08:00
cai.zhang d760a94636
[skip e2e]Reorder head files for indexcoord_test.go (#14419)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-28 19:26:56 +08:00
cai.zhang 4d21874aab
[skip e2e]Reorder head files for indexcoord/indexcoord.go (#14296)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-27 17:20:06 +08:00
cai.zhang 3b5b8194cb
[skip e2e]Reorder head files for indexcoord/index_coord_mock_test.go (#14297)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-27 14:26:20 +08:00
cai.zhang c4a4ef6f37
[skip e2e]Reorder head files for indexcoord/errors_test.go (#14295)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-27 14:24:22 +08:00
Jiquan Long e18dac16f3
Fix close indexcoord panic (#14237)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-27 14:16:38 +08:00
cai.zhang df82dcc783
[skip e2e]Add log for HasSameReq in indexcoord (#14233)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 23:14:50 +08:00
cai.zhang 74cf787c1d
[skip e2e]Format log for LoadMetaFromETCD in indexcoord (#14234)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 14:58:19 +08:00
cai.zhang 33afe1b576
[skip e2e]Add log for GetUnassignedTasks in indexcoord (#14232)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 14:56:24 +08:00
cai.zhang 0b77c4455e
[skip e2e]Add log for GetUnusedIndexFiles in indexcoord (#14223)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 11:42:21 +08:00
cai.zhang 8c0f96f8c1
[skip e2e]Add log for ListNode in indexcoord (#14222)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 11:40:29 +08:00
cai.zhang 410cf600be
[skip e2e]Add log for PeekClient in indexcoord (#14221)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 11:34:21 +08:00
cai.zhang 2e70326f31
[skip e2e]Format log for DeleteIndex in indexcoord (#14068)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 21:40:25 +08:00
cai.zhang 62b7e09163
[skip e2e]Add log for GetIndexFilePathInfo in indexcoord (#14067)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 21:38:34 +08:00
zhenshan.cao 3b7dad4486
Add node ctx mananger logic for IndexCoord (#13862)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-23 21:35:52 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
cai.zhang a53140bd39
[skip e2e]Add log for GetIndexStates in indexcoord (#14066)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 17:13:15 +08:00
JackLCL bf66721ea3
[skip e2e]Fix error log output format in meta_table.go (#14027)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-23 14:25:53 +08:00
congqixia ef3b71f22b
Use indexInfo SerializedSize when estimating segment size (#13969)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 20:27:34 +08:00
edward.zeng 5c003a023e
[skip e2e] Refine indexcoord util comment (#13998)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-22 20:03:38 +08:00
cai.zhang f4ac7cbfd1
[skip e2e]Add log for indexcoord peek indexnode (#13855)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-21 16:08:59 +08:00
cai.zhang f64a1a5bae
[skip e2e]Add comment for PeekClientV1 (#13857)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-21 15:48:17 +08:00
cai.zhang 1eb5645762
[skip e2e]Add comment for PeekClientV0 (#13856)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-21 15:46:13 +08:00
cai.zhang 04c210f4dd
[skip e2e]Add comment for PeekClientPolicy in indexcoord (#13759)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-20 18:09:06 +08:00
cai.zhang 2da7f528e8
[skip e2e]Add comment for getDimension in indexcoord (#13761)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-20 17:47:23 +08:00
cai.zhang 05919ed346
[skip e2e]Add comment for estimate in indexcoord (#13760)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-20 17:44:06 +08:00
cai.zhang 2ef2228ad0
Check component state before get index files (#13578)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-17 23:10:42 +08:00
cai.zhang 037b9b0d4e
[skip e2e]Format log (#13579)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-17 22:17:03 +08:00
cai.zhang 461130e933
[skip e2e]Add log for BuildIndex (#13577)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-17 22:15:08 +08:00
cai.zhang ce3f39c4d5
Adjust the order of import packages (#13499)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-16 16:31:43 +08:00
cai.zhang e2da1ae598
Adjust the order of import packages for meta_table.go (#13501)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-16 15:31:52 +08:00
cai.zhang 6304717f81
Adjust the order of import packages for indexcoord.go (#13500)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-16 15:30:04 +08:00
cai.zhang bb4ae9879d
[skip ci]Add comment for setClient in indexcoord (#13438)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 18:27:32 +08:00
cai.zhang fd9c5203e8
[skip ci]Add comment for getMetrics in indexcoord (#13440)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 17:07:10 +08:00
cai.zhang 1f8f5a7d4e
[skip ci]Add comment for indexNodeGetMetricsResponse (#13439)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 16:55:26 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
cai.zhang 70fdee850c
[skip ci]Add comment for HasSameReq in indexcoord (#13344)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 18:39:09 +08:00
edward.zeng 1858ef9924
[skip ci] Refine indexcoord meta table comment (#13360)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-14 18:33:32 +08:00
cai.zhang f604d13090
[skip ci]Add comment for GetUnassignedTasks in indexcoord (#13347)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-14 16:55:07 +08:00
cai.zhang f6c17ce4b6
[skip ci]Add comment for LoadMetaFromETCD (#13343)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 16:45:34 +08:00
cai.zhang 302584c59c
[skip ci]Add comment for ListNode (#13346)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 16:41:33 +08:00
cai.zhang 4d578f6c13
[skip ci]Add comment for GetIndexMetaByIndexBuildID (#13345)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 16:39:46 +08:00
cai.zhang 259a728a4e
[skip ci]Add comment for GetNodeTaskStats (#13342)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 16:37:58 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
cai.zhang af46998a2a
The memory of indexnode must be 6 times the segment size (#13213)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-13 15:06:29 +08:00
cai.zhang a2a9f47575
[skip ci]Add comment for DeleteIndex in indexcoord (#13171)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-10 21:09:00 +08:00
cai.zhang d6ed860a67
[skip ci]Add comment for GetUnusedIndexFiles in indexcoord (#13175)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-10 17:09:08 +08:00
cai.zhang 9a8e1be36e
[skip ci]Add comment for UpdateRecycleState in indexcoord (#13173)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-10 17:07:22 +08:00
cai.zhang 2c6c74669f
Get indexnode metrics when building index tasks (#13107)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 20:45:04 +08:00
cai.zhang 29f4a209c0
[skip ci]Add comment for GetIndexFilePathInfo in indexcoord (#13059)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 15:49:51 +08:00
cai.zhang 6f71bf42d4
[skip ci]Add comment for GetIndexStates in indexcoord (#13058)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 15:47:51 +08:00
cai.zhang 7966691696
[skip ci]Add comment for MarkIndexAsDeleted in indexcoord (#13057)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 15:31:18 +08:00
cai.zhang 342200ce13
Estimate the memory size of the index before building the index (#12973)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
cai.zhang 961e9379c6
Check the indexcoord state before get index state (#12452)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 11:43:09 +08:00
cai.zhang 719dc34ed1
[skip ci]Add comment for UpdateVersion in indexcoord (#12979)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 16:49:05 +08:00
cai.zhang 1d4d3e6ad0
[skip ci] Add comment for BuildIndex in indexcoord (#12978)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 16:47:17 +08:00
cai.zhang f5700da683
[skip ci]Add comment for AddIndex in indexcoord (#12977)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 16:45:23 +08:00
JackLCL 22c002606b
[skip ci]Fix error log output format in meta_table.go (#12931)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-08 13:14:19 +08:00
congqixia de454956fe
Refactor session WatchSessions to allow rewatch when Rev Compacted (#12880)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 10:11:04 +08:00
cai.zhang ae92cc1270
[skip ci]Add comment for reloadMeta in indexcoord (#12876)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 09:35:32 +08:00
cai.zhang 65182f0227
[skip ci]Add comment for reloadFromKV in indexcoord (#12875)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 09:33:41 +08:00
cai.zhang 02dabbe4b5
[skip ci]Add comment for saveIndexMeta in indexcoord (#12874)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 09:31:47 +08:00
cai.zhang 4175fde7bc
Check the indexcoord state before drop index (#12453)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 21:07:22 +08:00
cai.zhang 926f47e318
Add log for indexcoord (#12789)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 09:55:56 +08:00
yanliang567 b2402cd916
[skip ci]Update etcd name in comments (#12800)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-12-06 19:01:49 +08:00
cai.zhang c12885dcf9
[skip ci]Add the comment for metaTable in indexcoord (#12790)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 18:31:47 +08:00
cai.zhang c3e0299f06
[skip ci]Add comment for assignTask in indexcoord (#12788)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 18:29:54 +08:00
congqixia 19000e6af2
Update indexcoord state to unhealthy before stopping (#12723)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-06 10:37:40 +08:00
Xiaofan 0f5776e5fb
Index coord should not get all node from etcd each time (#12668)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-04 11:39:34 +08:00
cai.zhang ed546d0a55
Check the indexcoord state before building index (#12451)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-02 23:11:35 +08:00
godchen 5e3e3b3b41
Remove grpc returned error (#12537)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 22:17:46 +08:00
dragondriver 074c36de2d
[skip ci] Fix golang format error (#12432)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-30 10:37:44 +08:00
jaime 2576cf796f
[skip ci] Add comments for Task interface (#12418)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-30 00:01:49 +08:00
jaime 832b771dcd
[skip ci] Add comments for Task interface (#12420)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-29 23:57:45 +08:00
dragondriver b6d0150dc5
Fix health check when disconnect to etcd (#12292)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-26 11:39:16 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-19 13:57:12 +08:00
congqixia 5edbb82610
Add session revoke (#11908)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
Xiaofan 5f08b67156
Move node.yaml to component.yaml (#11363)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-10 14:27:37 +08:00
XuanYang-cn 35e8779bd9
Rename IndexRootPath to IndexStorageRootPath (#11236)
IndexRootPath is index file's blob storage prefix.
But the name is confusing with the MetaRootPath, which is prefix of etcd.

This PR changes the IndexRootPath to IndexStorageRootPath to
elimilate the confusion.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-05 11:45:00 +08:00
cai.zhang 5e077fd261
Fix bug for indexnode load balancing (#10994)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-01 17:16:05 +08:00
Xiaofan 2df2d488e1
Fix Unit test fatal fail (#10933)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
cai.zhang e5f159ddd6
IndexNode finished the task before IndexCoord changes the meta (#10821)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-28 18:20:27 +08:00
Xiaofan 6fddcb3925
Fix Session checker for proxy (#10737)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
XuanYang-cn a030c2a81b
[skip ci]Update license for ic node (#10758)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 19:00:48 +08:00
XuanYang-cn 46add09692
[skip ci]Update license for ic meta (#10757)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 18:04:47 +08:00
XuanYang-cn 92185a7465
[skip ci]Update license for ic ic (#10756)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 18:02:56 +08:00
XuanYang-cn 4c46948a7d
[skip ci]Update license for ic task (#10759)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 17:44:48 +08:00
cai.zhang e18debb3cf
Fix the bug of indexcoord meta returns the underlying pointer (#10504)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-24 13:29:10 +08:00
congqixia 6b8ff60de3
Close event channel when watch event found error (#9819)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 19:20:35 +08:00
congqixia ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
dragondriver 72d3d470ba
Use the server id as identifier in system topology graph (#9825)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 11:12:38 +08:00