c8688a6275
Organize log for GetIndexFilePaths ( #16230 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-28 21:27:27 +08:00
78557ca6d7
Replace minio kv with minio chunk manager ( #15936 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-17 18:03:23 +08:00
3cd28420f1
Support compile under windows ( #15786 )
...
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
* using gofrs/flock instead of syscall.Flock
* using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`
issue #7706
Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
b435c422c1
Add prometheus metrics for IndexCoord ( #15638 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-02-21 17:15:51 +08:00
c7f55c2e34
Make SessionWatch keep watch even no Rewatch func when find ErrCompacted ( #15497 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-15 15:07:48 +08:00
1f337891e1
Rename base_param to service_param, rename global_param to component_param ( #15463 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable ( #15434 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
b6a48817b0
Add MinioConfig in GlobalParams for all components ( #15099 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 17:29:34 +08:00
f8f61fb116
Use BaseParams etcd configuration for all components ( #15012 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
4f71fff388
Fix panic when close IndexCoord ( #14611 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-04 10:19:18 +08:00
69087ff8dd
Support embedded etcd ( #14333 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
1408926cd9
Remove logs without enough info ( #14440 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
4d21874aab
[skip e2e]Reorder head files for indexcoord/indexcoord.go ( #14296 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-27 17:20:06 +08:00
3b7dad4486
Add node ctx mananger logic for IndexCoord ( #13862 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-23 21:35:52 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
2ef2228ad0
Check component state before get index files ( #13578 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-17 23:10:42 +08:00
037b9b0d4e
[skip e2e]Format log ( #13579 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-17 22:17:03 +08:00
461130e933
[skip e2e]Add log for BuildIndex ( #13577 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-17 22:15:08 +08:00
6304717f81
Adjust the order of import packages for indexcoord.go ( #13500 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-16 15:30:04 +08:00
9f23fc7f2a
Register the service when the component state is healthy ( #13248 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
af46998a2a
The memory of indexnode must be 6 times the segment size ( #13213 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-13 15:06:29 +08:00
342200ce13
Estimate the memory size of the index before building the index ( #12973 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
961e9379c6
Check the indexcoord state before get index state ( #12452 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 11:43:09 +08:00
de454956fe
Refactor session WatchSessions to allow rewatch when Rev Compacted ( #12880 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 10:11:04 +08:00
4175fde7bc
Check the indexcoord state before drop index ( #12453 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 21:07:22 +08:00
926f47e318
Add log for indexcoord ( #12789 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 09:55:56 +08:00
b2402cd916
[skip ci]Update etcd name in comments ( #12800 )
...
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-12-06 19:01:49 +08:00
c3e0299f06
[skip ci]Add comment for assignTask in indexcoord ( #12788 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 18:29:54 +08:00
19000e6af2
Update indexcoord state to unhealthy before stopping ( #12723 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-06 10:37:40 +08:00
0f5776e5fb
Index coord should not get all node from etcd each time ( #12668 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-04 11:39:34 +08:00
ed546d0a55
Check the indexcoord state before building index ( #12451 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-02 23:11:35 +08:00
5e3e3b3b41
Remove grpc returned error ( #12537 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 22:17:46 +08:00
b6d0150dc5
Fix health check when disconnect to etcd ( #12292 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-26 11:39:16 +08:00
4121e31df1
Send SIGINT to runner goroutine after etcd disconnects ( #12163 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
ee0f753f7a
Fix datarace between GetComponentStates and Register ( #11935 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-19 13:57:12 +08:00
5edbb82610
Add session revoke ( #11908 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
35e8779bd9
Rename IndexRootPath to IndexStorageRootPath ( #11236 )
...
IndexRootPath is index file's blob storage prefix.
But the name is confusing with the MetaRootPath, which is prefix of etcd.
This PR changes the IndexRootPath to IndexStorageRootPath to
elimilate the confusion.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-05 11:45:00 +08:00
2df2d488e1
Fix Unit test fatal fail ( #10933 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
6fddcb3925
Fix Session checker for proxy ( #10737 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
92185a7465
[skip ci]Update license for ic ic ( #10756 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 18:02:56 +08:00
6b8ff60de3
Close event channel when watch event found error ( #9819 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 19:20:35 +08:00
ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order ( #9860 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
91641b75d3
Refine index coord logs ( #9492 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-09 19:49:53 +08:00
9b65aad4cf
Add IndexCoord implementation Assertion ( #9203 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-04 17:26:38 +08:00
2c2b800ff4
Change Log Name with NodeId ( #8721 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
0b6f792a69
[skip ci] Fix golint in indexcoord/priority_queue.go ( #8848 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-30 11:06:04 +08:00
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal ( #8542 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
eab7027a60
[skip ci] Fix golint in index_coord.go ( #8785 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-09-28 21:58:33 +08:00
ed4d912b5b
Add minio root path for indexcoord ( #8673 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-27 23:54:03 +08:00
cai.zhang
godchen
Ji Bin
congqixia
Cai Yudong
Jiquan Long
Xiaofan
zhenshan.cao
Xiangyu Wang
yanliang567
XuanYang-cn