milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,903 Commits
136 Branches
115 Tags
568 MiB
Commit Graph

438 Commits (24a6fc096bf8ba7458146592d1936aeec6706786)

Author SHA1 Message Date
yukun 8b3893e030
Add more error messages in segcore (#8012) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-16 10:23:53 +08:00
yukun 9a6f2e618c
Change Assert to AssertInfo in SegmentGrowing (#7952) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 22:04:39 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 15:15:52 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 12:57:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 10:35:52 +08:00
Cai Yudong c16ab5b35c
Use better segcoe variable name (#7869) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 10:06:00 +08:00
yukun 80ae6b7d31
Change Assert to AssertInfo in SegmentSealedImpl (#7903) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 18:43:48 +08:00
Cai Yudong 4dc9a64f01
Improve segcore code readability (#7868) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 16:07:48 +08:00
Cai Yudong b5923ff27d
Update segcore unittest format (#7860) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 11:22:57 +08:00
Cai Yudong 74ac528095
Improve segcore (#7851) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 10:53:04 +08:00
yukun 5c997710ab
Change Assert() to AssertInfo() to return error messages (#7843) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 10:06:40 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-11 14:40:01 +08:00
groot 16a6afa9bd
Fix build version typo (#7639) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-10 11:10:00 +08:00
zhenshan.cao b0524adbd8
Support specified shard number when create collection (#7482) 
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-08 15:00:00 +08:00
yukun a560aefc36
Fix search result is wrong when the term content in expression is not in order (#7557) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-08 11:49:59 +08:00
xige-16 468bef4478
Fix dataset's memory leak in knowWhere when search (#7527) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-07 14:25:59 +08:00
yukun 94272bba87
Support query by expression (#7386) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-03 17:12:55 +08:00
cai.zhang 880aa540e6
Fix bug for expression boundary (#7339) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-08-28 10:13:57 +08:00
groot 8701c477e2
Add delete api into proto (#7304) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-26 12:15:52 +08:00
xige-16 76066b5659
Fix IVF_FLAT index's wrong meta_data (#7167) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-19 14:26:11 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-18 10:12:10 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-17 10:06:11 +08:00
yukun 61bda45e35
Add ConfAdapter to check search (#6971) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 18:54:10 +08:00
yukun 671b2737d2
Remove RetrieveRequest and RetrieveTask (#6848) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 17:06:10 +08:00
Cai Yudong e771bda92f
optimize retrieve output vector code structure (#7102) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-14 11:18:10 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
Cai Yudong 6c75301c70
optimize search reduce logic (#7066) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-12 18:00:11 +08:00
Cai Yudong 85ea051ddc
change growing segment default value to -1 (#7054) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-12 12:32:07 +08:00
dragondriver d2767f920c
Fix index parameters check of RHNSWPQ (#6950) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-03 10:25:25 +08:00
xige-16 87c5a49d9a
Refactor showCollection/showPartition to get load state in memory (#6935) 
* refactor showCollection/showPartition to get load state in memory

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update milvus.proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add show result log to debug

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix wrong err message

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update pymilvus-orm version

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix repeated load error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix status nil error

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-02 22:39:25 +08:00
cai.zhang d51fec6678
Enhance log when create index failed (#6871) 
* Enhance log when create index failed

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for repeatedly drop index

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-29 14:47:22 +08:00
xaxys e43b43e7d8
Refactor `RangeExpr` & `CompareExpr` (#6786) 
* Changed `RangeExpr` proto to `UnaryRangeExpr` & `BinaryRangeExpr`
Several unit test unpassed.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix bugs to pass unit test. Fix format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Remove debug information.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix format.
Remove debug information.
Unify variable name.
Add error information.
Remove `CompareExpr` test in `test_c_api.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix code format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Update `Plan.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>
 2021-07-25 10:23:19 +08:00
dragondriver 2821c08560
Add unittests for metric_type: tanimoto (#6773) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-23 20:59:33 +08:00
FluorineDog aba21baf82
refactor expr executor to use single bitset (#6667) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-23 15:30:12 +08:00
dragondriver 67c1fdd2c0
Show/Describe collections/partitions with created timestamp (#6700) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-21 18:00:14 +08:00
Cai Yudong 744f2c7f51
optimize test_c_api.cpp (#6637) 
* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* clean redundant file

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change DIM to const

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update reduce testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-20 17:13:21 +08:00
FluorineDog 234954931f
remove deprecated (#6623) 
* remove deprecated

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix timeout

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-20 15:18:08 +08:00
dragondriver 99249a0224
Fix bug: override the compare function of SearchResultPair (#6628) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-20 14:38:11 +08:00
Cai Yudong a992dcf6a8
Support query return vector output field (#6570) 
* improve code readibility

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add offset in RetrieveResults

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add VectorFieldInfo into Segment struct

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add new interface for query vector

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fill in field name in query result

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add FieldId into FieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add fillVectorOutputFieldsIfNeeded

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update data_codec_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add DeserializeFieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* realize query return vector output field

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable query vector case

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-16 17:19:55 +08:00
dragondriver 7f99d9d714
Loose the limit of dimension when searching on a binary vector field (#6503) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-14 14:33:54 +08:00
Cai Yudong 1c29b42434
change output_fields to out_fields_id for RetrieveRequest (#6506) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-14 13:11:54 +08:00
Cai Yudong 724f10b9a0
Unify the usage of query and search (#6467) 
Unify the usage of query and search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-13 22:20:33 +08:00
dragondriver 25b8c37383
Fix 6421, split raw vectors to serveral smaller one (#6449) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-13 16:05:36 +08:00
xaxys e5f8a77a2d
Extend grammar of boolean expression (#6460) 
* Extend grammar of boolean expression

Signed-off-by: xaxys <tpnnghd@163.com>
 2021-07-13 14:37:03 +08:00
FluorineDog 99ed122d11
Remove Dead Code, use signed type (#6398) 
* make type signed

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* remove dead code

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* remove code

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-09 18:25:11 +08:00
FluorineDog 2ff072ea7b
Use larger dim for binary test to avoid false positive test failed (#6416) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-09 18:12:40 +08:00
FluorineDog d972a0361d
Weaken debug message (#6324) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-08 15:50:57 +08:00
quicksilver 7d920e9c9c
Fix compile error on CentOS (#6359) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-07-08 15:43:45 +08:00
shengjun.li a1ba9e9dcd
Fix comile on CentOS (#6334) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-07-07 12:34:02 +08:00
FluorineDog 97b1426666
fix benchmark, add support for primary key in schemaHelper (#6281) 
* fix benchmark

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix tests

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-06 09:50:01 +08:00
Cai Yudong 21a9bcd844
Create default partition when receive CreateCollectionMsg (#6305) 
* create default partition when create collection

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* adjust sleep time for unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-06 09:16:03 +08:00
shengjun.li 1f42b4ec9d
fix the case that knng is not full (#6308) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-07-05 17:26:07 +08:00
Cai Yudong bc8392eb1e
Add collectionID and partitionID into SegmentIndexInfo (#6289) 
* add collectionID and partitionID into SegmentIndexInfo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add partID2SegID into meta table

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DropIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-03 20:00:40 +08:00
neza2017 111a24a49f
remove msgstream of segment info (#6280) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 14:36:18 +08:00
dragondriver 8dd2051a9a
Fix 5045, decrease the nb and nlist in unittest (#6282) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-02 18:20:14 +08:00
groot a364d7303b
Implement calculate vectors distance in server (#6219) 
* calc distance stage 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 5

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 6

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code style

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-01 18:56:17 +08:00
FluorineDog bf8b2be4a7
Deprecate num_groups to simplify search API (#6230) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-01 10:32:15 +08:00
zhenshan.cao ff4c6c7ff4
Fix travel timestamp and guarantee timestamp (#6234) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-30 21:02:13 +08:00
FluorineDog b90b4f2058
renaming (#6192) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-30 10:18:26 +08:00
yukun b87baa108a
Add topks in searchResult (#6168) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-28 15:28:11 +08:00
yukun eb818d05ab
Remove vector fields from output fields (#6112) 
* Remove vector fields from output fields

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add empty_collection error_code

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 16:52:11 +08:00
sunby 46f86a0354
Return sealed segments when calling flush (#6011) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-23 16:56:11 +08:00
yukun b2eb596c23
Change search result to columnBased and return target_entry (#5896) 
* Change search result to columnBased and return target_entry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: fluorinedog <fluorinedog@gmail.com>

* synchronize the latest pymilvus-orm version

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change pymilvus-orm version to 40

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-21 20:18:13 +08:00
dragondriver 2642415bc3
Redefine the auto_id and primary_key (#5903) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-21 11:42:18 +08:00
zhenshan.cao 958280ebb8
Add support for time travel (#5897) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-21 10:42:10 +08:00
FluorineDog 255e3959af
support time travel (#5894) 
* support time travel

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-19 17:38:11 +08:00
zhenshan.cao ebe5073749 Update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:56:09 +08:00
FluorineDog bec9f2c182
Split segcore and plan proto for future feature (#5767) 
* Split segcore and plan proto for future feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-15 14:43:57 +08:00
bigsheeper cdbc6d2c94
Refactor query node and query service (#5751) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-15 12:41:40 +08:00
FluorineDog 006dae35c3
fix retrieve bug (#5727) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-11 00:06:55 +08:00
Xiangyu Wang 68f703f983
Add Query impl in proxynode (#5644) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-06-07 17:21:36 +08:00
shengjun.li 8ead67ef95
IVF_SQ8 and IVF_PQ cannot be built on multiple GPUs (#5624) 
* IVF_SQ8 and IVF_PQ cannot be built on multiple GPUs

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* index created by std::make_shared

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-06-05 17:19:34 +08:00
FluorineDog 1ff4764ba6
Fix wrong primary key (#5604) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-04 18:35:36 +08:00
Xiangyu Wang afa5da7df0
Add query rpc into proto (#5592) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-06-04 12:02:34 +08:00
FluorineDog 9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-04 10:38:34 +08:00
dragondriver 99699b2021
Support to show collections which are loaded into memory (#5567) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-03 19:09:33 +08:00
dragondriver e76830ab09
Support column-based insert request in proxy (#5560) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-03 15:03:34 +08:00
Xiangyu Wang ca0993c274 Update OWNERS 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-30 18:58:47 +08:00
FluorineDog b1a9aea6a6
support get entity by ids in segcore (#5456) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-05-28 10:39:30 +08:00
Xiangyu Wang 88b42304ef
Add dummy RPC (#5376) 
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last. 
At this time, this is helpful for debugging.

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-25 06:44:43 +00:00
shengjun.li b688cc5f51
Improve IVF query on GPU when no entity deleted (#5359) 
Not to call getListIndex() if bitset is empty.

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-05-24 07:38:56 +00:00
FluorineDog 3f42a9ed12
reduce unittest time (#5363) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-05-24 03:54:06 +00:00
sunby c1efa53779
Remove redundant fields in SegmentInfo and related structure (#5280) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-05-21 06:51:25 +00:00
yukun f18dfb4ff6
Add RetrieveTask implementation (#5313) 
Resolves: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-20 07:02:31 +00:00
yukun a7bb701f73
Add Retrieve method grpc definition (#5294) 
See also: #5253 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-19 10:45:15 +00:00
quicksilver 3db653f2d0
Update cpp thirdparty source URL (#5295) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Resolves: #5293
 2021-05-19 09:39:29 +00:00
neza2017 d68ee3fbc2
query base on timeline (#5279) 
query base on timeline, add timestamp on these queries:
- ShowCollections
- HasCollection
- DescribeCollection

Resolves: #5219

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-18 09:12:17 +00:00
Cai Yudong e8ceb37f81
Add ShardsNum when create collection (#5245) 
Updata PhysicalChannelNames and VirtualChannelNames based
on ShardsNum when create collection, and update collVChan2Chan
map.

Resolves: #5240 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-17 11:15:01 +00:00
yukun ecaef24fea
Change should_not to must_not in dsl (#5131) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-07 11:52:24 +00:00
FluorineDog b1974aede2
Merge knowhere unittests (#5139) 
Re-enable knowhere unittests and merge them all together. 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-05-07 11:50:13 +00:00
dragondriver b7977698a8
Change the codec style of expr plan from text to binary (#5129) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-05-07 11:27:17 +00:00
dragondriver e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118) 
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-05-07 07:20:47 +00:00
FluorineDog 396b3f33e9
Support TermExpr, NotExpr, LogicalExpr (#5096) 
1. Support Term, like `A in [1, 2, 3]`
2. Support Not, like `! A < 3`
3. Support logical combination, like `A < 3 && B > 5 or C == 0`

Type: Feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-04-30 07:19:52 +00:00
shengjun.li b46ae44087
Zero size allocation in StackDeviceMemory (#5100) 
When the remaining space is empty, the zero size allocation will
get the pointer `end_`. However, `cudafree` the pointer `end_` will
cause to crash.

Fix: #5078 #4770 #4412 #4340 #3646

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-30 04:21:02 +00:00
FluorineDog 88f5642603
Add plan proto and support basic boolean expr parser (#5088) 
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
 2021-04-29 08:48:06 +00:00
godchen 060f7ca0d2
Add get index build progress proto (#5049) 
Add get index build progress proto.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-04-27 07:46:45 +00:00
shengjun.li a3e4339027
improve rhnsw (#5059) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-27 06:17:52 +00:00
neza2017 262c484cec
the return struct of "DescribeIndex" should contain "filed_name" (#5055) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-04-27 02:30:55 +00:00
shengjun.li a2875f9d95
Update knowhere (#5006) 
Import performance of ivf::train and hnsw, and fix bugs
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-04-23 18:03:49 +08:00
Xiangyu Wang 82ccd4cec0
Rename module (#4988) 
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-04-22 14:45:57 +08:00