milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
15,268 Commits
142 Branches
117 Tags
566 MiB
Commit Graph

88 Commits (6e7831470c7a0cde137b4be075f08825550f7930)

Author SHA1 Message Date
congqixia be6ca6358d
Use serialized size before compression in log meta (#18336) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-19 21:30:30 +08:00
cai.zhang 93d9dfad1a
Ignore task when IndexNode load empty index meta (#18266) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-07-14 15:08:28 +08:00
cai.zhang 90faf4a212
Fix bug for IndexCoord recycles index files (#18168) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-07-08 16:54:22 +08:00
cai.zhang 0ad15a22c8
IndexCoord handle events correctly (#17878) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-07-07 14:44:21 +08:00
Xiaofan a9b1d71a8f
change the etcd compareAndSwap interface (#18068) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-07-06 13:54:21 +08:00
cai.zhang 899a9bf86d
IndexNode still writes finished state to ETCD when task was deleted (#17761) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-06-28 12:08:17 +08:00
cai.zhang 3685ff9e0c
Mark indexing task to retry when minio occurs error (#17153) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-05-23 15:47:58 +08:00
cai.zhang b37b87eb97
The GetIndexFilePaths interface judges whether the index is complete (#17052) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-05-17 20:41:56 +08:00
xige-16 515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
zhenshan.cao 0a953948af
Simplify monitoring metrics (#16687) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-04-27 23:03:47 +08:00
Xiaofan b657b10eb5
Remove useless log (#16624) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-27 10:01:47 +08:00
Xiaofan 89b4a34892
Fix Data race in NodeID (#16603) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-24 22:03:44 +08:00
godchen bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
cai.zhang 04076393c5
Fix log error (#16363) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-04-06 10:13:32 +08:00
Jiquan Long f8d9bc919d
Unify interface of vector index & scalar index. (#15959) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-21 14:23:24 +08:00
godchen 78557ca6d7
Replace minio kv with minio chunk manager (#15936) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-17 18:03:23 +08:00
zhenshan.cao f3eeecf146
Reduce the number of metrics (#16030) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 21:51:21 +08:00
cai.zhang 2512dff261
Fix misuse of timerecord (#15868) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-03-04 15:45:56 +08:00
cai.zhang 09a27d1620
Add prometheus metrics for indexnode (#15640) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-03-02 20:49:56 +08:00
zhenshan.cao f1aec49a74
Fixbug: building index return nil by mistake when error not occur (#15809) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-02 09:41:56 +08:00
zhenshan.cao 3f48a40ab0
Load index meta in every retry (#15376) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-25 13:28:05 +08:00
zhenshan.cao 6bc2efe429
Fixbug: IndexNode should panic when save meta failed to MetaKV (#15347) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-24 17:18:46 +08:00
zhenshan.cao 871e093dc8
Call release memory in case error occured (#15237) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-17 14:43:38 +08:00
Jiquan Long 2819f6cc6f
Release memory to OS after index is built (#15196) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-13 20:27:34 +08:00
zhenshan.cao 1aafb56694
Clarify the index building process (#15044) 
Reduce peak memory usage

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-10 20:51:34 +08:00
congqixia fc256e7924
Index parallel respect CPU quota (#14991) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-07 17:31:22 +08:00
cai.zhang 2327d53915
[skip e2e]Add comment for setID (#14841) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-01-05 13:07:25 +08:00
cai.zhang 47b89ba84a
[skip e2e]Add comment for checkIndexMeta (#14842) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-01-05 13:05:25 +08:00
cai.zhang d4c325adbb
[skip e2e]Reorder head files for indexnode/task.go (#14661) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-12-31 16:11:24 +08:00
xige-16 a8cb995216
Improve log for build index in indexNode (#14051) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-23 22:00:16 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 18:39:11 +08:00
JackLCL 2c0d9397fb
[skip e2e]Fix error log output format in task.go (#14028) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-23 14:28:25 +08:00
JackLCL 7cb35e4172
[skip ci]Fix error log output format in task.go (#13102) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-09 19:45:28 +08:00
cai.zhang 342200ce13
Estimate the memory size of the index before building the index (#12973) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-09 14:19:40 +08:00
jaime 90a1d016a0
Refine return value (#11730) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-30 19:32:17 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 17:27:14 +08:00
Baiqiang Zhao ba9977951a
Fix log in indexnode (#11988) 
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
 2021-11-17 16:41:13 +08:00
XuanYang-cn 35e8779bd9
Rename IndexRootPath to IndexStorageRootPath (#11236) 
IndexRootPath is index file's blob storage prefix.
But the name is confusing with the MetaRootPath, which is prefix of etcd.

This PR changes the IndexRootPath to IndexStorageRootPath to
elimilate the confusion.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-05 11:45:00 +08:00
XuanYang-cn a086042b45
[skip ci]Update in task (#11032) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-01 22:51:41 +08:00
groot d33e810aa1
[skip ci] Fix a typo (#10155) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-19 16:24:35 +08:00
Xiaofan 91d8f85df7
Refine log in task.go (#8992) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-13 23:24:32 +08:00
cai.zhang 7801357dd3
Retry index building task in case of internal error such as minio failure (#9552) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-11 16:38:33 +08:00
cai.zhang 6b58c5930e
[skip ci]Fix golint for BaseTask in indexnode.go (#9495) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-09 18:27:00 +08:00
cai.zhang e368b51d3e
[skip ci]Fix golint for task executing in indexnode.go (#9494) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-09 18:24:58 +08:00
cai.zhang 3b7b10c18e
[skip ci]Fix golint for IndexBuildTask in indexnode.go (#9493) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-09 00:05:49 +08:00
zhenshan.cao d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-29 20:26:00 +08:00
dragondriver cf8600077f
Refactor the index file format (#8514) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 09:52:12 +08:00
cai.zhang df30315144
Standard indexnode log printing (#8587) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-26 21:22:04 +08:00
cai.zhang 0fa38d5d93
Add root path for index files in minio (#8212) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-26 19:19:57 +08:00
cai.zhang d51fec6678
Enhance log when create index failed (#6871) 
* Enhance log when create index failed

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for repeatedly drop index

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-29 14:47:22 +08:00