Commit Graph

5728 Commits (22ea1e34231a5ebb87b2903fcf0f9e73d6eed2d9)

Author SHA1 Message Date
groot 22ea1e3423
clean unused code (#3190)
Signed-off-by: groot <yihua.mo@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-10 13:58:45 +08:00
chen qingxiang 30e02954f6
[skip ci]fix test bug in whether user defined id (#3192)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-10 12:06:11 +08:00
chen qingxiang eb4eea6251
add getEntity unittest (#3183)
* add getEntity ut

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add getEntity unittest

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change getEntity ut uid field name

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-10 09:42:49 +08:00
quicksilver 1304e03d97
Modefied CCACHE_SLOPPINESS options in order to increase the ccache hit rat (#3186)
* Modefied CCACHE_SLOPPINESS options

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Modefied CCACHE_SLOPPINESS options

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Modefied CCACHE_SLOPPINESS options

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Modefied CCACHE_SLOPPINESS options

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Modefied CCACHE_SLOPPINESS options

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Modefied CCACHE_SLOPPINESS options

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-08-10 00:36:00 +08:00
XuPeng-SH c0f77a7e47
(db/snapshot): retry remove if remove_all fails due to bug in filesystem remove_all (#3187)
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-08-09 23:19:30 +08:00
BossZou d37e0a39e5
Make Memsegment create segment explicitly (#3181)
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-08-09 08:46:14 +00:00
op-hunter ab5a48cfa6
revert hnsw to version 0.10.0 (#3184)
* revert hnsw to version 0.10.0

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-09 00:17:37 +08:00
chen qingxiang 01b8057c63
fix the bug cpu cache not make effect (#3178)
* fix the bug not make effect

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* code format

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case level

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case level

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case level

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-08 20:35:18 +08:00
XuPeng-SH 36d512da81
(db/snapshot): replace boost filesystem with std::experimental filesystem (#3166)
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-08-08 16:23:08 +08:00
quicksilver 1135c06834
Tell ccache to relax some checks in order to increase the hit rat (#3174)
* Tell ccache to relax some checks in order to increase the hit rat

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* ccache has support for GCC’s precompiled headers

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* ccache has support for GCC’s precompiled headers

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* ccache check precompiled headers

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Set an absolute path to workspace directory

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-08-08 15:31:46 +08:00
shengjun.li 6f040491d1
[skip ci]modify sdk simple (#3182)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-08 15:09:29 +08:00
shengjun.li fd92afc5ed
fix metric type (#3179)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-08 14:17:44 +08:00
shengjun.li 032118e13d
[skip ci]changelog (#3177)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-08 10:26:02 +08:00
chen qingxiang f9e8c16e29
fix bug caused by bloomfilter file not release (#3173)
* fix bug caused by bloomfilter file not release

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug caused by apply delete

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* cancel annotation

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-08 09:41:33 +08:00
yukun 237e909e7c
Fix test_search.py::TestSearchDSL bugs (#3170)
* Fix dsl test case nb bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix dsl test case bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add metric_type judge in search

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_db

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix search metric_type

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* ci retry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search.py::TestSearchDSL bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-07 20:36:12 +08:00
groot eca7d3c90c
fix merge hang issue (#3171)
* fix merge hang issue

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* index type case sensitive

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-07 18:14:05 +08:00
quicksilver db6d4d5b9d
Use ccache with Make (#3164)
* using ccache if defined

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* using ccache if defined

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* using ccache if defined

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* using ccache if defined

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* using ccache if defined

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* using ccache if defined

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* using ccache if defined

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* using ccache if defined

Signed-off-by: jeffoverflow <zhifeng.zhang@zilliz.com>

* call "ccache -z" before build start, call "ccache -s" after build finish

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-08-07 16:13:49 +08:00
groot 15a07951ab
fix build index crash (#3167)
* fix build index crash

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-07 14:08:13 +08:00
BossZou c05f67baf2
Fix delete crash when delete multi time (#3163)
* Fix Delete Bug when delete multi time

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix multi delete crash bug

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add filter field when get active collection

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix cmake link error & code format

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-07 14:07:45 +08:00
shengjun.li 186f36c794
fix metric type (#3158)
* fix metric type

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix config

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix query

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-07 11:56:01 +08:00
chen qingxiang aca1aeb5ec
fix bug casued by merge and drop at the same time (#3160)
* add log message

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug casued by merge and drop at the same time

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-07 09:37:41 +08:00
XuPeng-SH 596808a376
(db/snapshot): fix DeleteEntity bug (#3165)
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-08-07 09:37:26 +08:00
groot ce1e528d1c
fix delete entity test case (#3162)
* fix delete eneity bug

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix delete entity test case

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-07 09:33:08 +08:00
op-hunter 1042f2e1f1
Remove useless index (#3157)
* update change log and make clang-format

Signed-off-by: cmli <chengming.li@zilliz.com>

* remove sq8nr_nm

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* update changelog

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-06 19:29:57 +08:00
ThreadDao 59640954cb
[skip ci] Update dsl search test cases (#3156)
* add some dsl search cases

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* update dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* update dsl search test cases

Signed-off-by: zongyufen <zongyufen@foxmail.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-06 19:09:57 +08:00
yukun cbba262442
Fix metric_type bug in search (#3155)
* Fix dsl test case nb bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix dsl test case bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add metric_type judge in search

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_db

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix search metric_type

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* ci retry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-06 19:08:42 +08:00
XuanYang-cn 38a3fe766d
Move gtest download and build process to thirdparty/gtest (#3145)
* fix cmake configure warning

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* add config tests to ctest

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm customed add_test, using default add_test

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* add thirdparty/gtest and built-able

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* add dependences fiu

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* add license, rm not useful comments

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix include dir not exist bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* add some config

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* gtest download at configure time

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-06 19:07:20 +08:00
groot d22ff25a35
fix delete eneity bug (#3161)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-08-06 18:18:25 +08:00
groot c73a58a114
add unittest case FetchTest (#3153)
* add unittest cases

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* add unittest case

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-06 14:07:11 +08:00
op-hunter 7688f51343
Faiss hnsw upgrade (#3134)
* combine the hnsw's implemention of faiss and hnswlib

Signed-off-by: cmli <chengming.li@zilliz.com>

* transplant the datastructure of hnsw from hnswlib 2 faiss

Signed-off-by: cmli <chengming.li@zilliz.com>

* basic work finished, pass compile, to be tested

Signed-off-by: cmli <chengming.li@zilliz.com>

* rhnswflat, rhnswsq, rhnswpq pass ut

Signed-off-by: cmli <chengming.li@zilliz.com>

* remove AssertAnns of RHNSWPQ because PQ has accuracy loss

Signed-off-by: cmli <chengming.li@zilliz.com>


Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-06 11:36:41 +08:00
Wang Xiangyu b662295d63
[skip ci]disable test_config and some cases in test_ping (#3151)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-06 00:11:09 +08:00
Wang Xiangyu fccf91fa51
[skip ci]change test index level (#3150)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 23:38:49 +08:00
Wang Xiangyu b869788e17
[skip ci]change test level in entity dir (#3149)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 23:08:46 +08:00
yukun ef24a8b340
Fix dsl test cases bug (#3130)
* Fix dsl test case nb bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix dsl test case bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add metric_type judge in search

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_db

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-08-05 21:44:17 +08:00
chen qingxiang 4645fd80a8
[skip ci]change search test case level (#3148)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-05 20:16:56 +08:00
chen qingxiang 1ce49c2dba
[skip ci]change test case level (#3147)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-05 20:06:27 +08:00
chen qingxiang 3970b982e6
[skip ci]change test case level (#3143)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 18:54:11 +08:00
Wang Xiangyu d252df9050
[skip ci]add a pytest arg named tag (#3144)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 18:53:32 +08:00
del-zhenwu 83a22702c9
[skip ci] add auto_id (#3142)
* [skip ci] add auto_id

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix compact bug

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update ub/2

Signed-off-by: zw <zw@milvus.io>

* [skip ci] remove jac_collection

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-05 18:28:32 +08:00
groot 2b2ebc27e5
fix auto-generated id field bug (#3137)
* autogen id

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix bug

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 18:19:51 +08:00
ThreadDao e4a70abec3
[skip ci] add dsl search cases (#3140)
* add some dsl search cases

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* update dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-05 17:51:10 +08:00
BossZou fc393b3aeb
(scalar) Debug delete request (#3107)
* Debug delete request

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Chang previous bloom filter and deleted docs file to stale during ApplyDeletes

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add delete case

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add delete ut

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add Delete test

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Format

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 16:27:58 +08:00
chen qingxiang aad8f82d41
fix index bug caused by json parse (#3129)
* fix index bug caused by json parse

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-05 16:24:47 +08:00
groot 3dfbe61422
modify proto (#3126)
* modify proto

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix compact

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* print cache

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 14:02:51 +08:00
del-zhenwu ba48ef6fa5
Dsl case (#3128)
* [skip ci] fix gen_query

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update dsl query expr

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-05 12:18:10 +08:00
del-zhenwu 2dd604e3d5
[skip ci] fix gen_query (#3127)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-05 11:32:29 +08:00
groot 362bf7a94e
cache (#3124)
* cache

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 10:04:41 +08:00
Wang Xiangyu f18c95eed3
update grpc commit (#3125)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 09:44:10 +08:00
yukun b12a19df34
Fix bug (#3121)
* Fix Block Format Read bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix Search crash bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix CreateCollection bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add db->Query unittest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix index name bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_db error

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: Wang XiangYu <xy.wang@zilliz.com>
2020-08-04 18:29:50 +08:00
Wang Xiangyu 7861da3e92
[skip ci]update grpc commit and md5 (#3123)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-04 18:22:33 +08:00