Commit Graph

1325 Commits (cbba262442a42cc22ae24e00842d901b58321c97)

Author SHA1 Message Date
groot 4872fff4e0
fix build index bug (#3066)
* build index

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix some problem

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* build index ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* avoid ut error

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-30 14:06:13 +08:00
groot 824ff3e1ff
build index (#3058)
* build index

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix some problem

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* build index ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* avoid ut error

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-30 10:53:35 +08:00
Cai Yudong d91facc86d
fix collection ci (#3061)
* fix set config issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add auto_flush_interval observer in DBImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix some issues in SegmentReader

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update CreateCollection interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-30 09:37:27 +08:00
XuPeng-SH 412eac3e8f
(db/snapshot): add CompoundSegmentsOperation and related test (#3057)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Store.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update store related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add field element modification operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change new operation name

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add Segment File Operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): crtp for BaseResource

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add InActiveResourcesGCEvent

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix ut error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update snapshot segmentcommit operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update drop all index operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix gc

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix gc segment files

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): refactor Event related

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change 1

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change for GC event

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix build error for high version of boost filesystem

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update compound operations

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add operation test

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for CompoundSegmentsOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add test for CompoundSegmentsOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-29 20:09:04 +08:00
groot c2bb284247
build index (#3056)
* build index

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix some problem

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-29 14:11:16 +08:00
chen qingxiang a7f211f8ad
add valid row implementation (#3053)
* fix bug in test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bugs in test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug in DB GetEntityById interface

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add valid row implementation

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* cancel annotation of index thread

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-07-29 12:06:11 +08:00
groot 666524a4f6
refine code (#3054)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-29 09:44:12 +08:00
yukun 2f73f2eab6
Add index fields in QueryPtr (#3049)
* Add search implementation in ExecutionEngine

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove attr_type from query_ptr

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add CreateStructuredIndex in ExecutionEngine

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add index fields in QueryPtr

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix SearchReq bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-07-29 09:36:25 +08:00
XuPeng-SH 442e6aee9a
(snapshot/db): add ChangeSegmentFileOperation and related test (#3050)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Store.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update store related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add field element modification operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change new operation name

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add Segment File Operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): crtp for BaseResource

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add InActiveResourcesGCEvent

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix ut error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update snapshot segmentcommit operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update drop all index operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix gc

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix gc segment files

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): refactor Event related

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change 1

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change for GC event

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix build error for high version of boost filesystem

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update compound operations

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add operation test

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-28 19:34:23 +08:00
BossZou cd4b667b30
Update InactiveResourceGCEvent (#3051)
Signed-off-by: yhz <413554850@qq.com>
2020-07-28 19:33:33 +08:00
groot 5b1fdcf7ba
clean code (#3052)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-28 18:49:38 +08:00
XuanYang-cn 4b52c573fb
Remove repeated built src files in unittest/CMakeLists (#3047)
* add LICENSE to CMKLists.txt

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Rearrange utils CMKLists

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* mov main.cpp to to CMKLists

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* tidy src/db CMKLists.txt

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* remove repeated build src files in unittest/CMKLists and /unittest/db/CMKlists

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix format

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix typo

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-28 17:26:20 +08:00
chen qingxiang 5437814d71
fix bugs in inserting vectors test case (#3045)
* fix bug in test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bugs in test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug in DB GetEntityById interface

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-07-28 17:25:55 +08:00
yukun 508eaff0a3
Add search implementation in ExecutionEngine (#3039)
* Add search implementation in ExecutionEngine

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove attr_type from query_ptr

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add CreateStructuredIndex in ExecutionEngine

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-07-28 16:31:26 +08:00
Wang XiangYu 86dd5e3619
cmd case insensitive (#3042)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-28 15:35:02 +08:00
groot 34309709ed
refine scheduler job task (#3044)
* remove SS

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* modify pr template

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine job task

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-28 14:12:25 +08:00
XuPeng-SH ecf05526c2
(snapshot/db): fix GC bug and some enhancement (#3035)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Store.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update store related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add field element modification operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change new operation name

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add Segment File Operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): crtp for BaseResource

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add InActiveResourcesGCEvent

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix ut error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update snapshot segmentcommit operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update drop all index operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix gc

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix gc segment files

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): refactor Event related

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change 1

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change for GC event

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix build error for high version of boost filesystem

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-28 14:05:23 +08:00
Cai Yudong 298358f6d1
update collection sdk (#3041)
* update request enum

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update collection request

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update request

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update request interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update request names

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-formatg

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove DescribeIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update sdk

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update sdk

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename request

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update sdk

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update BaseReq

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ReqScheduler

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-28 14:04:02 +08:00
BossZou 4d2a03cc83
(db/snapshot) Fix sqlite start fail (#3038)
* Force check function return value using CMake

Signed-off-by: yhz <413554850@qq.com>

* Fix sqlite run fail

Signed-off-by: yhz <413554850@qq.com>

* Add return value in faiss

Signed-off-by: yhz <413554850@qq.com>
2020-07-28 11:51:25 +08:00
groot 77fa39f483
remove SS (#3040)
* remove SS

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* modify pr template

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-28 11:31:47 +08:00
cqy123456 c933a97c52
#1842 Remove code for 0.7.0 compatibility (#3033)
* delete old indextype

Signed-off-by: cqy <yaya645@126.com>
2020-07-28 10:37:28 +08:00
Cai Yudong 32bb441a36
update collection sdk (#3037)
* update request enum

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update collection request

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update request

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update request interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update request names

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-formatg

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove DescribeIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update sdk

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update sdk

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-27 23:16:47 +08:00
Wang XiangYu fc3839ccc5
add cmake macro (#3036)
* add cmake macro

Signed-off-by: wxyu <xy.wang@zilliz.com>

* remove unused code

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-27 19:31:51 +08:00
BossZou f5e2db1800
Add return value status (#3031)
Signed-off-by: yhz <413554850@qq.com>
2020-07-27 18:52:17 +08:00
BossZou 6675a9a421
(db/snapshot) Remove sqlite-orm (#3028)
* Remove SqliteMetaImpl

Signed-off-by: yhz <413554850@qq.com>

* Remove sqlite-orm

Signed-off-by: yhz <413554850@qq.com>
2020-07-27 18:51:42 +08:00
Wang XiangYu 1307ba4eaa
disable wal (#3029)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-27 15:35:37 +08:00
godchen0212 44bb1d0e35
fix bug in GetEntityByID with multi id querys (#3027)
* Fix bug in GetEntityById

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code and delete useless code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug in GetEntityByID with multi id querys

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-07-27 14:29:30 +08:00
groot 43cfe506ac
remove unused code (#3024)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-27 11:38:45 +08:00
groot 8b3b15c980
refine code (#3022)
* clean code first stage

Signed-off-by: groot <yihua.mo@zilliz.com>

* rename some files

Signed-off-by: groot <yihua.mo@zilliz.com>

* rename

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-26 17:36:06 +08:00
BossZou b565b33fc5
(db/snapshot) Support sqlite (#3021)
* Add Class MetaField

Signed-off-by: yhz <413554850@qq.com>

* Modify to MetaSchema

Signed-off-by: yhz <413554850@qq.com>

* Add SqliteEngine

Signed-off-by: yhz <413554850@qq.com>

* Add sqlite in store

Signed-off-by: yhz <413554850@qq.com>

* Add Sqlite

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Fix lint error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-07-26 12:16:42 +08:00
godchen0212 3d9a81068c
Improvement in GetEntityById grpc interface (#3019)
* Fix bug in GetEntityById

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code and delete useless code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-07-26 11:22:35 +08:00
shengjun.li 10799ce1f2
optimizer parallel policy (#3015)
* modify parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-26 08:20:23 +08:00
Wang XiangYu 290e253bae
add dependency (#3020)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-25 23:12:24 +08:00
XuanYang-cn a33c71ab7c
Rearrange CMKLists.txt for dirs Utils (#3018)
* add LICENSE to CMKLists.txt

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Rearrange utils CMKLists

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-25 21:32:08 +08:00
Wang XiangYu dfdb5cfbe4
log module (#3017)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-25 19:46:34 +08:00
Wang XiangYu 7057f13e66
fix unittest test_ssdb failed (#3013)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-25 17:01:11 +08:00
XuanYang-cn c7a4b5421f
Rearrange CMLists for dir Metrics (#3010)
* rearrange CMLists for dir metrics

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix metrics gpu build failure

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-25 16:34:12 +08:00
XuanYang-cn d10873a9ab
Rearrange CMlists dir db (#3005)
* delete repeated parent-scoup set INDEX_INCLUDE_DIRS

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* -ERearrange CMLists.txt for dir db

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Rearrange CMkListx.txt for dir db

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix index include dirs not find problem

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix a bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-25 14:30:01 +08:00
godchen0212 4d7fb16ec0
add GetEntityById realization (#3004)
* add web_impl testcase

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add GetEntityById realization

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* merge files

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-07-25 10:45:43 +08:00
yukun cd281453a3
Fix insert vectors bug (#3003)
* Use unordered_map in CollectionMappings

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix ParseMetaUri bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Delete GetVectorsByID

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix CreateCollection extra_param bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change dimension to dim

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix InsertEntities bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix insert vectors bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-07-25 10:44:34 +08:00
cqy123456 eba5bdf32d
Improve IVF search performance when NQ and nProbe are both large (#3001)
Signed-off-by: cqy <yaya645@126.com>
2020-07-24 20:39:17 +08:00
groot c94699fbdd
refine code (#3002)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-24 20:13:27 +08:00
yukun 26536fac80
Fix CreateCollection extra_param bugs (#2995)
* Use unordered_map in CollectionMappings

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix ParseMetaUri bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Delete GetVectorsByID

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix CreateCollection extra_param bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change dimension to dim

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix InsertEntities bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-07-24 18:19:46 +08:00
BossZou 0f7e8085c7
Fix HasPartition (#2997)
Signed-off-by: yhz <413554850@qq.com>
2020-07-24 18:19:22 +08:00
Wang XiangYu 2aa020947c
optimize config code (#2996)
* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update pull request template

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-24 16:45:11 +08:00
groot b2137a4f64
get collection info (#2991)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-24 14:25:55 +08:00
yukun 1e167202e4
Using CollectionMappings in DescribeCollection (#2990)
* Use unordered_map in CollectionMappings

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix ParseMetaUri bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Delete GetVectorsByID

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-07-24 14:10:39 +08:00
yukun 6783d36ce5
Use unordered_map in CollectionMappings (#2989)
* Use unordered_map in CollectionMappings

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix ParseMetaUri bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-07-24 11:01:07 +08:00
XuPeng-SH b2e547934f
(db/snapshot): fix GC behavior (#2978)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Store.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update store related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add field element modification operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change new operation name

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add Segment File Operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): crtp for BaseResource

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add InActiveResourcesGCEvent

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix ut error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update snapshot segmentcommit operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update drop all index operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix gc

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-24 10:32:45 +08:00
groot c448d4a535
insert entity request (#2987)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-24 09:47:24 +08:00
yukun 7cb09006bb
Collection and Search call SSDBImpl (#2988)
* Fix test_rpc

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search.py and test_index.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* CreateCollection to SSDBImpl

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Collection to SSDBImpl

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Search to SSDBImpl

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix DescribeCollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Index to SSDB

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-07-23 21:04:30 +08:00
Wang XiangYu 12be12d9bc
udpate config usage (#2985)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-23 18:57:28 +08:00
XuanYang-cn b081c9e4f1
Rearrange CMakeLists.txt of lib tracing (#2986)
* sort out cmake commands in before project

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* update

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

* rearrange core CmakeLists.txt

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix conflict

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bugs on ENABLE_FIU

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm BUILD_WITH_MKL

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* buildable version

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* orgnize lib search and query

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix query and search bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm null variable

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rearrange CMakeLists.txt of lib tracing

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: Xiangyu Wang <xy.wang@zilliz.com>
2020-07-23 18:56:26 +08:00
XuanYang-cn 8fe7a40946
Rearrange CMakeLists of lib query and lib search (#2983)
* sort out cmake commands in before project

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* update

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

* rearrange core CmakeLists.txt

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix conflict

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bugs on ENABLE_FIU

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm BUILD_WITH_MKL

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* buildable version

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* orgnize lib search and query

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix query and search bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm null variable

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: Xiangyu Wang <xy.wang@zilliz.com>
2020-07-23 18:08:43 +08:00
Cai Yudong 26502bcbd8
grpc partition related APIs use snapshot (#2982)
* opt interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update partition grpc APIs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-23 17:31:13 +08:00
groot 67809c6e2e
build snapshot index (#2979)
* implement build index

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix warning

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* compress missed

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* ssdb

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-23 15:53:11 +08:00
Wang XiangYu 4288097aa0
Rewrite config module (#2962)
* rewrite config module

Signed-off-by: wxyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* remove empty test

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix include

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-07-23 15:27:07 +08:00
Cai Yudong f492d80cbb
add Macro MILVUS_USE_SNAPSHOT (#2972)
* add Macro MILVUS_USE_SNAPSHOT to control

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix merge error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-23 14:15:01 +08:00
yukun 54df521fce
Fix master unittest (#2980)
* Fix test_rpc

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search.py and test_index.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-07-23 14:08:41 +08:00
yukun fd4969edaf
Merge scalar-field-filtering to master (#2976)
* [skip ci] remove timeout in partition-test case

Signed-off-by: zw <zw@milvus.io>

* Update server_versiong

Signed-off-by: zw <zw@milvus.io>

* fix client_test.go

Signed-off-by: zw <zw@milvus.io>

* Add ci param is_manual_trigger

Signed-off-by: zw <zw@milvus.io>

* update ci param

Signed-off-by: zw <zw@milvus.io>

* Replace wal to hybrid

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Reconstruct create structured index

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add filter cases

Signed-off-by: zw <zw@milvus.io>

* Change interfaces for hybrid search in GrpcHandler

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc for new proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Filter case (#2655)

* [skip ci] remove timeout in partition-test case

Signed-off-by: zw <zw@milvus.io>

* Update server_versiong

Signed-off-by: zw <zw@milvus.io>

* fix client_test.go

Signed-off-by: zw <zw@milvus.io>

* Add ci param is_manual_trigger

Signed-off-by: zw <zw@milvus.io>

* update ci param

Signed-off-by: zw <zw@milvus.io>

* add filter cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Fix all compile errors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Comment all test_db

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* undo clange format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci]Filter case (#2688)

* [skip ci] remove timeout in partition-test case

Signed-off-by: zw <zw@milvus.io>

* Update server_versiong

Signed-off-by: zw <zw@milvus.io>

* fix client_test.go

Signed-off-by: zw <zw@milvus.io>

* Add ci param is_manual_trigger

Signed-off-by: zw <zw@milvus.io>

* update ci param

Signed-off-by: zw <zw@milvus.io>

* add filter cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Fix GetEntityByID bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] fix some case bug

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update some cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update some cases (#2700)

* [skip ci] remove timeout in partition-test case

Signed-off-by: zw <zw@milvus.io>

* Update server_versiong

Signed-off-by: zw <zw@milvus.io>

* fix client_test.go

Signed-off-by: zw <zw@milvus.io>

* Add ci param is_manual_trigger

Signed-off-by: zw <zw@milvus.io>

* update ci param

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update some cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Using json to pass TermQuery and RangeQuery

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix C++ sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix C++ sdk compile error

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* GetEntityByID returns all entities when no field names provide

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Comment test_db and ssdb

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Collection create success if an invalid field name provided

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* The number of fields should be limited

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Check the validity of the parameters of creating collection: segment_size

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Index can not be created

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add changelog

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Count entities got wrong result with binary vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* No entity returned with get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Index type name should returned if index type is not supported

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* The max value of top-k should be limited

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server destroyed after delete by id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix C++ sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed when calling get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove test_case change

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* Unexpected error when insert binary entities

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add field_names judge in GetEntityByID

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned if searching with tags

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] update search cases (#2795)

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Filter case (#2825)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Distances returned by calling search is inaccurate (#2820)

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id (#2840)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Filter case (#2848)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Test scalar field filtering (#2861)

* fix test_flush.py to meet the entity of branch scalar_field_filtering

* update test_flush.py to meet hybrid search

* Filter case (#2876)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Server crashed after calling delete_entity_by_id (#2870)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed during inserting, and can not restart

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed after calling delete_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID valid_row

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Test scalar field filtering (#2881)

* fix test_flush.py to meet the entity of branch scalar_field_filtering

* update test_flush.py to meet hybrid search

* fix test_flush.py to meet the entity of branch scalar_field_filtering

* update test_flush.py to meet hybrid search

* update test_compact.py for hybrid query

* Filter case (#2898)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* [skip ci] update index params gen  (#2911)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* [skip ci] fix cases (#2913)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* [skip ci] Filter case (#2914)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* [skip ci] Filter case (#2915)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* [skip ci] Filter case (#2916)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update sq8h to cpu_not_support

Signed-off-by: zw <zw@milvus.io>

* [skip ci] assert entity is None entity not in collection

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* [skip ci] Filter case (#2919)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update sq8h to cpu_not_support

Signed-off-by: zw <zw@milvus.io>

* [skip ci] assert entity is None entity not in collection

Signed-off-by: zw <zw@milvus.io>

* [skip ci] todo: check segment_size 1.0

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* [skip ci] Filter case (#2922)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update sq8h to cpu_not_support

Signed-off-by: zw <zw@milvus.io>

* [skip ci] assert entity is None entity not in collection

Signed-off-by: zw <zw@milvus.io>

* [skip ci] todo: check segment_size 1.0

Signed-off-by: zw <zw@milvus.io>

* [skip ci] change field name in cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Create index failed with binary vectors (#2895)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed during inserting, and can not restart

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed after calling delete_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID valid_row

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix index type name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Create index failed with binary vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add extra_params in DescribeCollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Insert binary data failed

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix binary index issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wrong field name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Filter case (#2928)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update sq8h to cpu_not_support

Signed-off-by: zw <zw@milvus.io>

* [skip ci] assert entity is None entity not in collection

Signed-off-by: zw <zw@milvus.io>

* [skip ci] todo: check segment_size 1.0

Signed-off-by: zw <zw@milvus.io>

* [skip ci] change field name in cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update list id in segment

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Fix GET_TIMEOUT in test_list_id_in_segment.py (#2929)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed during inserting, and can not restart

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed after calling delete_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID valid_row

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix index type name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Create index failed with binary vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add extra_params in DescribeCollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Insert binary data failed

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix binary index issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wrong field name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix assert status.OK() bugs in test cases

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci]Fix GET_TIMEOUT in test_list_id_in_segment.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_list_id_in_segment.py bugs (#2935)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed during inserting, and can not restart

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed after calling delete_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID valid_row

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix index type name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Create index failed with binary vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add extra_params in DescribeCollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Insert binary data failed

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix binary index issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wrong field name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix assert status.OK() bugs in test cases

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci]Fix GET_TIMEOUT in test_list_id_in_segment.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_list_id_in_segment.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Filter case (#2938)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update sq8h to cpu_not_support

Signed-off-by: zw <zw@milvus.io>

* [skip ci] assert entity is None entity not in collection

Signed-off-by: zw <zw@milvus.io>

* [skip ci] todo: check segment_size 1.0

Signed-off-by: zw <zw@milvus.io>

* [skip ci] change field name in cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update list id in segment

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update casses

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Fix test_search.py bugs (#2951)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed during inserting, and can not restart

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed after calling delete_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID valid_row

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix index type name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Create index failed with binary vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add extra_params in DescribeCollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Insert binary data failed

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix binary index issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wrong field name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix assert status.OK() bugs in test cases

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci]Fix GET_TIMEOUT in test_list_id_in_segment.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_list_id_in_segment.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_search.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Filter case (#2956)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update sq8h to cpu_not_support

Signed-off-by: zw <zw@milvus.io>

* [skip ci] assert entity is None entity not in collection

Signed-off-by: zw <zw@milvus.io>

* [skip ci] todo: check segment_size 1.0

Signed-off-by: zw <zw@milvus.io>

* [skip ci] change field name in cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update list id in segment

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update casses

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Fix test_search.py invalid_param bugs (#2959)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed during inserting, and can not restart

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed after calling delete_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID valid_row

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix index type name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Create index failed with binary vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add extra_params in DescribeCollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Insert binary data failed

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix binary index issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wrong field name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix assert status.OK() bugs in test cases

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci]Fix GET_TIMEOUT in test_list_id_in_segment.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_list_id_in_segment.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_search.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_search.py invalid_param bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_partition.py bugs (#2963)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed during inserting, and can not restart

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed after calling delete_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID valid_row

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix index type name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Create index failed with binary vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add extra_params in DescribeCollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Insert binary data failed

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix binary index issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wrong field name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix assert status.OK() bugs in test cases

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci]Fix GET_TIMEOUT in test_list_id_in_segment.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_list_id_in_segment.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_search.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_search.py invalid_param bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_index.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_partition.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Filter case (#2964)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update sq8h to cpu_not_support

Signed-off-by: zw <zw@milvus.io>

* [skip ci] assert entity is None entity not in collection

Signed-off-by: zw <zw@milvus.io>

* [skip ci] todo: check segment_size 1.0

Signed-off-by: zw <zw@milvus.io>

* [skip ci] change field name in cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update list id in segment

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update casses

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update level2

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Filter case (#2966)

* [skip ci] update search cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update cases

Signed-off-by: zw <zw@milvus.io>

* update cases

Signed-off-by: zw <zw@milvus.io>

* update index string

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index params gen

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update sq8h to cpu_not_support

Signed-off-by: zw <zw@milvus.io>

* [skip ci] assert entity is None entity not in collection

Signed-off-by: zw <zw@milvus.io>

* [skip ci] todo: check segment_size 1.0

Signed-off-by: zw <zw@milvus.io>

* [skip ci] change field name in cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update list id in segment

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update casses

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update index cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update level2

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix insert cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>

* Fix test_compact.py (#2967)

* Distances returned by calling search is inaccurate

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Wrong result returned by get_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed during inserting, and can not restart

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Server crashed after calling delete_entity_by_id

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID valid_row

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix index type name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Create index failed with binary vectors

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add extra_params in DescribeCollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Insert binary data failed

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix binary index issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wrong field name problem

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix assert status.OK() bugs in test cases

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci]Fix GET_TIMEOUT in test_list_id_in_segment.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_list_id_in_segment.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_search.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_search.py invalid_param bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_index.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_partition.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_insert.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_insert.py bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang-format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci] Fix test_compact.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix C++ sdk DataType

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix collection test cases bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_rpc

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: zw <zw@milvus.io>
Co-authored-by: wxyu <xy.wang@zilliz.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: ThreadDao <zongyufen@foxmail.com>
2020-07-23 11:21:34 +08:00
XuanYang-cn 9a0daa582b
Add options to build.sh for cuda arch Issue#2940 (#2950)
* add option -s in build.sh for cuda arch

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* modify changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* modify ci configs about cuda arch

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* modify ci configs about cuda arch in jenkins ci

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* fix bug

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* fix bug

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* modify changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bug

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* fix bug

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* fix bugs

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix cmake cannot recognize space bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix conflict

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-07-23 09:40:19 +08:00
groot fbe14a5997
snapshot build index (#2939)
* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* ui error

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* build index

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* add utils

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* build index

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* build index

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* execution engine

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* build error

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-23 01:37:59 +00:00
BossZou c878700474
(db/snapshot) Inactivate gc event (#2960)
* Add API to Get inactivate res in Store

Signed-off-by: yhz <413554850@qq.com>

* Update select logic in MetaAdapter

Signed-off-by: yhz <413554850@qq.com>

* Add event test case

Signed-off-by: yhz <413554850@qq.com>

* Add deactive collection test in SSEventTest.TestInActiveResGcEvent

Signed-off-by: yhz <413554850@qq.com>

* Add CollectinCommit in event test

Signed-off-by: yhz <413554850@qq.com>

* Add more res in event test

Signed-off-by: yhz <413554850@qq.com>

* Set url to mock in ssdb test

Signed-off-by: yhz <413554850@qq.com>
2020-07-22 13:55:55 +00:00
shengjun.li b548b38222
Fix the result merging of IVF_PQ IP (#2955)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-22 09:53:08 +00:00
BossZou d4f305aa7b
(db/snapshot) Add root path for snapshot store (#2945)
* Add root path for snapshot GC

Signed-off-by: yhz <413554850@qq.com>

* Change Fun name from GetResPath to GetRootPath

Signed-off-by: yhz <413554850@qq.com>
2020-07-22 09:00:01 +00:00
op-hunter 0e0a731ddd
fix a bug of annoy search parameter exisitence check (#2958)
Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-22 08:11:59 +00:00
XuPeng-SH efe1034f5b
(db/snapshot): Update DropAllIndexOperation (#2947)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Store.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update store related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add field element modification operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change new operation name

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add Segment File Operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): crtp for BaseResource

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add InActiveResourcesGCEvent

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix ut error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update snapshot segmentcommit operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update drop all index operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-22 15:39:38 +08:00
Cai Yudong b3608e1ae7
snapshot scheduler (#2961)
* update interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add test_ss_job

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update Query

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add dir_root for SSSearchJob and SSBuildIndexJob

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-22 06:11:28 +00:00
Xiaohai Xu d85b3f95fb
#2890 Fix wrong index size (#2942)
* fix NM index size

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add raw data size of hnsw_nm and nsg_nm

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-21 09:53:14 +00:00
Cai Yudong 525257a2d7
scheduler support snapshot (#2944)
* using BlockingQueue in JobMgr

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update SSDBImpl::HybridQuery

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add QueryTest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add SearchJob interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add SSSearchJob and SSSearchTask

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update AddSegmentVisitor

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add SSBuildIndexTask and SSBuildIndexJob

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add SSTestTask

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add test_ss_job and test_ss_task

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update TaskCreator

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-21 09:32:56 +00:00
Xiaohai Xu 7ba30c7830
#2890 Fix wrong index size (#2930)
* fix update index size

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add GetSize() interface 4 SPTAG

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix index size of index hnsw, annoy and nsg

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix clang

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add sdk 4 non-ivf index test

Signed-off-by: cmli <chengming.li@zilliz.com>

* remove std::cout and make clang-format

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix cout

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* checkout sdk

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix binary ivf

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix hnsw

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-21 06:02:44 +00:00
BossZou 2bfc108f5a
(db/snapshot) Add root path for snapshot GC (#2936)
* Add root path for snapshot GC

Signed-off-by: yhz <413554850@qq.com>

* Add subfolder db in root path

Signed-off-by: yhz <413554850@qq.com>
2020-07-21 05:26:32 +00:00
XuPeng-SH 6c301be1bf
(db/snapshot): add GC event and implement crtp for base resource (#2926)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Store.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update store related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add field element modification operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change new operation name

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add Segment File Operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): crtp for BaseResource

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add InActiveResourcesGCEvent

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix ut error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-21 02:01:34 +00:00
groot dc93524df0
refine code (#2927)
* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* excution engine

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-21 09:40:42 +08:00
godchen0212 e0dfc5e147
add web_impl testcase (#2920)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-07-20 15:30:40 +08:00
XuanYang-cn 29fab296b1
Rearrange core cmakelists (#2900)
* sort out cmake commands in before project

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* update

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

* rearrange core CmakeLists.txt

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix conflict

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bugs on ENABLE_FIU

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: Xiangyu Wang <xy.wang@zilliz.com>
2020-07-20 15:24:00 +08:00
BossZou 924960b69d
(db/snapshot) Optimize snapshot mock db (#2896)
* Add mysql time statices

Signed-off-by: yhz <413554850@qq.com>

* Add detail timestamp recorder

Signed-off-by: yhz <413554850@qq.com>

* Optimize snapshot mock DB

Signed-off-by: yhz <413554850@qq.com>

* Remove surplus space

Signed-off-by: yhz <413554850@qq.com>

* Updat meta test

Signed-off-by: yhz <413554850@qq.com>
2020-07-20 05:17:56 +00:00
XuPeng-SH f8cb9e3d43
(db/snapshot): add AddSegmentFileOperation (#2924)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Store.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update store related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add field element modification operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change new operation name

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add Segment File Operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-19 16:11:02 +08:00
XuPeng-SH 482bc53950
(db/snapshot): Update Store (#2897)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update for store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Store.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update store related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add field element modification operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): change new operation name

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-18 19:30:45 +08:00
XuanYang-cn d0018307b8 Add python functional tests about timeout (#2793)
* Add python tests about param timeout

Signed-off-by: yangxuan <jumpthepig@gmail.com>

* add faiss configure args msg print

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change assertion conditions

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-18 15:30:27 +08:00
groot f80c592679 fix #2768 (#2809)
* fix #2752

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix #2768

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo again

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-18 15:24:10 +08:00
cqy123456 01437cef39
Fix warning master (#2894)
* fix clean unused variable warning in knowhere

Signed-off-by: cqy <yaya645@126.com>

* clean unused variable warning in knowhere

Signed-off-by: cqy <yaya645@126.com>

* clean unused variable warning in knowhere

Signed-off-by: cqy <yaya645@126.com>

* clean unused variable warning in knowhere

Signed-off-by: cqy <yaya645@126.com>

* fix konwhere warning

Signed-off-by: cqy <yaya645@126.com>
2020-07-18 04:47:29 +00:00
groot 708bad368a
segment writer (#2873)
* redefine SegmentWriter

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* redefine SegmentWriter

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* mem insert

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* unittest

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix some issues

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* segment reader

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* segment writer

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove files

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* merge

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix merge

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* get entities

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-17 20:53:45 +08:00
Cai Yudong 771585ba0c
use BlockingQueue in JobMgr (#2885)
* using BlockingQueue in JobMgr

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-17 09:37:00 +08:00
cqy123456 52ab18fe0e
opt faiss build (#2883)
* opt faiss build

Signed-off-by: cqy <yaya645@126.com>
2020-07-17 09:34:34 +08:00
XuanYang-cn 96e9ef235d Add some cpp unittests about scheduler algorithm (#2888)
* add some testcases

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* reformat code

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
(cherry picked from commit 8135cee414)
2020-07-16 19:49:08 +08:00
XuanYang-cn 7a39a00498
Fix Prometheus rebuild problem (#2878)
* Solve prometheus repeatedly build problem

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* recover build.sh

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* refactor build.sh

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* altering changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm not-useful comments

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-16 19:45:24 +08:00
BossZou 285f849137
(db/snapshot) Add snapshot DB unittest (#2856)
* (snapshot) Add snapshot DB unittest

Signed-off-by: yhz <413554850@qq.com>

* Optimize mock db

Signed-off-by: yhz <413554850@qq.com>

* correct server context file name

Signed-off-by: yhz <413554850@qq.com>
2020-07-16 08:06:34 +00:00
XuPeng-SH 3dddbb72f7
(db/snapshot): update size related logic (#2877)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-16 15:33:56 +08:00
cqy123456 38dfdf4034
# 2828 opt faiss build (#2855)
* add FAISS_USE_FLOAT16

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix faiss build

Signed-off-by: cqy <yaya645@126.com>

Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-16 09:03:26 +08:00
Cai Yudong 1d9ccd9bb7
add MILVUS_SUPPORT_SPTAG for some code (#2866)
* add MILVUS_SUPPORT_SPTAG for some code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use knowhere::IndexEnum in db

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* keep EngineType order

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 17:42:44 +08:00
XuPeng-SH 5bf9b8f030
(db/snapshot): Update row count related logic (#2862)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-15 17:31:00 +08:00
Xiaohai Xu 77cf783d4c
#2802 Add new index: IVFSQ8NR_NM (#2865)
* add ivfsq8nr_nm

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* refactor

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix error

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* [skip ci] remove unused param

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-07-15 16:46:39 +08:00
Cai Yudong d473c7ad2b
snapshot integrate (#2854)
* add test_segment

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update interface GetResPath

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update SSSegmentWriter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 14:32:09 +08:00
Cai Yudong 4cb8383775
move index type try2 (#2860)
* move EngineType and MetricType to MetaTypes.h

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move IndexType

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 11:37:05 +08:00
groot 7bd60398a2
redefine SegmentWriter (#2853)
* redefine SegmentWriter

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* redefine SegmentWriter

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-15 02:02:31 +00:00
BossZou a8033a5954
(db/snapshot) Add snapshot DB module (#2851)
* New db impl

Signed-off-by: yhz <413554850@qq.com>

* Add db impl for snapshot

Signed-off-by: yhz <413554850@qq.com>

* Update operations step holders

Signed-off-by: yhz <413554850@qq.com>

* Update snapshot dbimpl & create collection test pass

Signed-off-by: yhz <413554850@qq.com>

* Delete operation pass

Signed-off-by: yhz <413554850@qq.com>

* Add constraints for db table

Signed-off-by: yhz <413554850@qq.com>

* Update index operation steps behavior

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add lock in mysql engine and remove lock in store

Signed-off-by: yhz <413554850@qq.com>

* Index unittest case pass

Signed-off-by: yhz <413554850@qq.com>

* Add merge operation step context

Signed-off-by: yhz <413554850@qq.com>

* Remove constraints in DB and snapshot ut pass

Signed-off-by: yhz <413554850@qq.com>

* update DBImple

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add DBHelper to generate sql & add mock Mem db & snaoshot ut pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add mock db engine

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update DB select API using template for resource

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update snapshot db name and move them under folder meta

Signed-off-by: yhz <413554850@qq.com>

* clang-format

Signed-off-by: yhz <413554850@qq.com>
2020-07-14 19:11:24 +08:00
dwq 6779ee29da
Update sqlite_6_to_4.sql (#2832)
Simplify SQL statements

Signed-off-by: dddddai <853238012@qq.com>
2020-07-14 15:36:20 +08:00
groot 66add7b9d1
remove old api (#2833)
* remove old api

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine insert code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-14 09:48:53 +08:00
op-hunter dc31742538
Hnsw sq8 support (#2835)
* modify for SQ8

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* add hnsw-sq8-support

Signed-off-by: cmli <chengming.li@zilliz.com>

* add unittest 4 hnsw_sq8nr and fix several bugs

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-14 09:45:08 +08:00