3685ff9e0c
Mark indexing task to retry when minio occurs error ( #17153 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-23 15:47:58 +08:00
b37b87eb97
The GetIndexFilePaths interface judges whether the index is complete ( #17052 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-17 20:41:56 +08:00
515d0369de
Support string type in segcore ( #16546 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
0a953948af
Simplify monitoring metrics ( #16687 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-27 23:03:47 +08:00
b657b10eb5
Remove useless log ( #16624 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-27 10:01:47 +08:00
89b4a34892
Fix Data race in NodeID ( #16603 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-24 22:03:44 +08:00
bb7a0766fe
Add dependency factory ( #16204 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
04076393c5
Fix log error ( #16363 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-04-06 10:13:32 +08:00
f8d9bc919d
Unify interface of vector index & scalar index. ( #15959 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
78557ca6d7
Replace minio kv with minio chunk manager ( #15936 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-17 18:03:23 +08:00
f3eeecf146
Reduce the number of metrics ( #16030 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
2512dff261
Fix misuse of timerecord ( #15868 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-04 15:45:56 +08:00
09a27d1620
Add prometheus metrics for indexnode ( #15640 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-02 20:49:56 +08:00
f1aec49a74
Fixbug: building index return nil by mistake when error not occur ( #15809 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-02 09:41:56 +08:00
3f48a40ab0
Load index meta in every retry ( #15376 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-25 13:28:05 +08:00
6bc2efe429
Fixbug: IndexNode should panic when save meta failed to MetaKV ( #15347 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-24 17:18:46 +08:00
871e093dc8
Call release memory in case error occured ( #15237 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-17 14:43:38 +08:00
2819f6cc6f
Release memory to OS after index is built ( #15196 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-13 20:27:34 +08:00
1aafb56694
Clarify the index building process ( #15044 )
...
Reduce peak memory usage
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-10 20:51:34 +08:00
fc256e7924
Index parallel respect CPU quota ( #14991 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-07 17:31:22 +08:00
2327d53915
[skip e2e]Add comment for setID ( #14841 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-05 13:07:25 +08:00
47b89ba84a
[skip e2e]Add comment for checkIndexMeta ( #14842 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-05 13:05:25 +08:00
d4c325adbb
[skip e2e]Reorder head files for indexnode/task.go ( #14661 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-31 16:11:24 +08:00
a8cb995216
Improve log for build index in indexNode ( #14051 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-23 22:00:16 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
2c0d9397fb
[skip e2e]Fix error log output format in task.go ( #14028 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-23 14:28:25 +08:00
7cb35e4172
[skip ci]Fix error log output format in task.go ( #13102 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-09 19:45:28 +08:00
342200ce13
Estimate the memory size of the index before building the index ( #12973 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
90a1d016a0
Refine return value ( #11730 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-30 19:32:17 +08:00
9d5bcd3e3a
Close event and binlog reader ( #12173 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
ba9977951a
Fix log in indexnode ( #11988 )
...
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-11-17 16:41:13 +08:00
35e8779bd9
Rename IndexRootPath to IndexStorageRootPath ( #11236 )
...
IndexRootPath is index file's blob storage prefix.
But the name is confusing with the MetaRootPath, which is prefix of etcd.
This PR changes the IndexRootPath to IndexStorageRootPath to
elimilate the confusion.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-05 11:45:00 +08:00
a086042b45
[skip ci]Update in task ( #11032 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 22:51:41 +08:00
d33e810aa1
[skip ci] Fix a typo ( #10155 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-19 16:24:35 +08:00
91d8f85df7
Refine log in task.go ( #8992 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-13 23:24:32 +08:00
7801357dd3
Retry index building task in case of internal error such as minio failure ( #9552 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-11 16:38:33 +08:00
6b58c5930e
[skip ci]Fix golint for BaseTask in indexnode.go ( #9495 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-09 18:27:00 +08:00
e368b51d3e
[skip ci]Fix golint for task executing in indexnode.go ( #9494 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-09 18:24:58 +08:00
3b7b10c18e
[skip ci]Fix golint for IndexBuildTask in indexnode.go ( #9493 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-09 00:05:49 +08:00
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal ( #8542 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
cf8600077f
Refactor the index file format ( #8514 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 09:52:12 +08:00
df30315144
Standard indexnode log printing ( #8587 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-26 21:22:04 +08:00
0fa38d5d93
Add root path for index files in minio ( #8212 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-26 19:19:57 +08:00
d51fec6678
Enhance log when create index failed ( #6871 )
...
* Enhance log when create index failed
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug for repeatedly drop index
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-29 14:47:22 +08:00
e1b52b0583
Add unittest for IndexCoord and IndexNode ( #6698 )
...
* Add unittest for IndexCoord and IndexNode
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix verifiers
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-23 10:44:12 +08:00
9aa56cd7b8
Add log for IndexCoord and IndexNode ( #6597 )
...
* Add log for IndexCoord and IndexNode
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Make verifier
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Delete unused script
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-22 11:40:11 +08:00
a7a9eeeffe
Add time record for build index and search process ( #6231 )
...
* add timerecord for build index process
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix build error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add timerecord for query process
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-30 19:46:14 +08:00
99be4c09a5
change retry ( #5996 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
5c69c6902d
Refactor proxy channelTimeTick and fix search timeout ( #5760 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:36 +08:00
bc46e4780d
Fixbug:index is not loaded in some cases ( #5633 )
...
* Fixbug:index is not created in some cases
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Delete unecessary print
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* fix create index
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-06 09:41:35 +08:00
cai.zhang
xige-16
zhenshan.cao
Xiaofan
godchen
Jiquan Long
congqixia
Cai Yudong
JackLCL
jaime
Baiqiang Zhao
XuanYang-cn
groot