Commit Graph

6096 Commits (c71a16fb8d79d587e9371cc4a6c5c689c6db749e)

Author SHA1 Message Date
BossZou c71a16fb8d Remove blacklist index from VecIndex (#4239)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-20 11:46:08 +08:00
shengjun.li 3c181d8f74 remove setting omp thread num (#4244)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-20 11:46:08 +08:00
BossZou bd8b5f25f7 Opt some code (#4238)
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-20 11:46:08 +08:00
yukun b030f3f5ad Fix metrics (#4237)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-20 11:46:08 +08:00
BossZou 3f53ee3fbe The scalar field value of search result is wrong after deleted (#4209)
* The scalar field information of search result is wrong after some entities deleted

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix bitset count passing error

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code style

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add more db del test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] add ()

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-20 11:46:08 +08:00
XuPeng-SH b028d75e17
Phase 1 of implementation of read-write seperation (#4214)
* (db/snapshot): add SnapshotPolicy

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* (db/snapshot): add some snapshot policy

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* (db/snapshot): add policy factory

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* add ut

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* implement ut for snapshot policy

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* fix clang format

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* add some comments

Signed-off-by: XuPeng-SH <xupeng3112@163.com>
2020-11-14 10:12:12 +08:00
Jin Hai 8605a7f122
Update Mergify config (#4228)
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-11-12 18:24:16 +08:00
Kate Shao fc8da4724f
Remove Hacktoberfest from README.md (#4217) 2020-11-12 16:24:16 +08:00
shengjun.li ba11f8e65a In GPU mode, faiss::LOG should be set though GPU is disabled (#4218)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-12 13:04:33 +08:00
groot d16f44c599 merge segments at startup (#4215)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-12 13:04:33 +08:00
yukun c18e70fab3 Restful API error: When the specified partition is retrieved, the partition_tag is not valid (#4206)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-12 13:04:33 +08:00
yukun 9d0099ad2d ResfulApi Search return null (#4117)
* ResfulApi Search return null

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Use milvus::json instead

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* dummy commit

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-12 13:04:33 +08:00
groot ebd9998bac #4193 Milvus hangs after continually insert to non-exist partition (#4199)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-12 13:04:33 +08:00
yukun 9799bf05f4 [skip ci]Update C++ sdk search interface (#4164)
* [skip ci]Update C++ sdk search interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Must_not query check failed in dsl

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-12 13:04:33 +08:00
groot 247a9544fc #4154 Incorrect collection data size when row count larger than 2610000 (#4155)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-12 13:04:33 +08:00
BossZou 3e1ab51367 Set synchronous = NORMAL for sqlite (#4120)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-12 13:04:33 +08:00
FluorineDog 2a6ddc3b8e
Fix some compatibility issues on ArchLinux (#4198)
* use nlohmann.json 3.9.1

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* use support dynamic system libs

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* use dynamic libs

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2020-11-09 17:58:28 +08:00
shengjun.li 19cc848791
fix change log (#4194)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-09 11:53:10 +08:00
Snyk bot 0f8d3e8e01
fix: upgrade com.alibaba:fastjson from 1.2.73 to 1.2.74 (#4179)
Snyk has created this PR to upgrade com.alibaba:fastjson from 1.2.73 to 1.2.74.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.alibaba/fastjson/

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
2020-11-09 10:36:54 +08:00
İsmail Öcal eef33c6292
Anchor bugfix (#4190)
Signed-off-by: İsmail Öcal <ismailocal@gmail.com>
2020-11-08 01:35:10 +00:00
op-hunter f09147ae0c
Repair index ngt (#4183)
* calculate the memory occupy of index ngt*

Signed-off-by: cmli <chengming.li@zilliz.com>
2020-11-06 10:12:04 +08:00
Wang Xiangyu 6939a3a26a
Refine ConfigMgr & add StatusMgr (#4181)
* overload = operator of Value class

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>

* extract Value abstract

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>

* create new directory  and move  into

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>

* rename ConfigType to ValueType

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>

* mv indexing status to server_status

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>

* add ConfigUpdate avoid callback conflict

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>

* solve ut compile failed

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>

* fix clang-format

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>

* solve ut compile failed

Signed-off-by: Wang Xiangyu <xiangyu.wang@zilliz.com>
2020-11-05 17:26:28 +08:00
Wang Xiangyu d08bbca4c2
Rename optimizer to selector (#4166)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-11-04 20:24:04 +08:00
BossZou 9643af6909
[skip ci] restrict server python sdk version (#4177)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-11-04 15:46:38 +08:00
shengjun.li 3c75c2c7e7
tuning nbits (#4165)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-04 10:59:42 +08:00
op-hunter 3b9b691be5
redirect the log info of ngt to milvus debug log (#4167)
* update the search parameter search_edge_size's default value of index ngt

Signed-off-by: cmli <chengming.li@zilliz.com>

* redirect the debug info of ngt to milvus debug log

Signed-off-by: cmli <chengming.li@zilliz.com>
2020-11-03 20:00:38 +08:00
yukun 7bc7e23e5b When execute a multiple vectors request, if the result of somerow is not enough, the query data field will be disorder. (#4140)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-31 15:18:12 +08:00
groot 16a583c879 #4135 Error should be raised if field not exised in collection during drop_index (#4142)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-31 15:18:12 +08:00
yukun 7f9a22beef After milvus 0.11.0 version vector data is misaligned (#4115)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-31 15:18:12 +08:00
shengjun.li 04d653b5e2 modify the log warning (#4087)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-31 15:18:12 +08:00
groot bc66b877b0
#4101 Trim blank space for collection name, partition name and field … (#4127)
* #4101 Trim blank space for collection name, partition name and field name

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-30 15:18:28 +08:00
Wang Xiangyu 55b32bd1c6
Unify exception in config module (#4121)
* Unify exception in config module

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* fix unittest

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-30 15:18:15 +08:00
op-hunter 7904b9d4b7
Repair index ngt (#4128)
* index ngt supplement

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix ut and lint error

Signed-off-by: cmli <chengming.li@zilliz.com>
2020-10-30 14:02:38 +08:00
Xiaohai Xu 97b180271a
Pass "nbits" as an argument to IVF_PQ create_index (#4109)
* add nbits choices between 1 and 16

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix python case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-10-29 09:59:09 +08:00
Wang Xiangyu 1cd0169a82
Reduce lock granularity in Config (#4106)
* Reduce lock granularity in Config

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* fix unittest

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-28 09:46:05 +08:00
quicksilver 7830b54cd3
Use tini for Docker quicker exit. (#4108) 2020-10-27 16:35:52 +08:00
Wang Xiangyu 936967dfd3
remove scheduler task label (#4100)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-27 11:23:48 +08:00
Wang Xiangyu 29ae7ad985
Remove update_fn in config parameters (#4097)
* Remove update_fn in config parameterss

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-26 17:30:07 +08:00
Wang Xiangyu 8244b4fe8b
Improve config codes (#4085)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-24 17:58:52 +08:00
chen qingxiang 1596d924e1 Fix #3793. A supplementary fix for the bug caused by CPU resource suspension control (#4078)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-24 11:11:53 +08:00
chen qingxiang b138a0a0da Fix #3793. Solve the resource allocation problem (#4058)
* Fix #3793. Solve the resource allocation problem

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change CHANGELOG

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* clang format

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-24 11:11:53 +08:00
yukun 816b53aae4 milvus raise exception when passing a complex dsl during searching (#4063)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-24 11:11:53 +08:00
cqy123456 df132cfe69 getuids change (#4056)
Signed-off-by: cqy <yaya645@126.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-24 11:11:53 +08:00
shengjun.li a3506a8863
[skip ci] update cmake version (#4084)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-24 02:39:15 +00:00
Wang Xiangyu 992961ee85
add macro config (#4080)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-23 08:44:33 +00:00
groot 93e2684630
#4051 Improvement Job::Dump to get more information from snapshot (#4065)
* #4051 Improvement Job::Dump to get more information from snapshot

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-23 11:13:16 +08:00
groot a009a19403
#4053 fix partition tag regex match (#4061)
* #4053 fix partition tag regex match

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-22 17:51:29 +08:00
Wang Xiangyu 85b6506be4
update codeowner of CHANGELOG.md (#4044)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-10-21 14:25:49 +08:00
jinhai eb97dd301b Update CODEOWNERS
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-10-20 16:47:02 +08:00
Cai Yudong 78257bebe3
update devtest groovy (#4034)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-10-20 11:36:48 +08:00