milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,062 Commits
148 Branches
122 Tags
578 MiB
Commit Graph

514 Commits (27771817ed9a324defdbb8e5ad195f38f3433a16)

Author SHA1 Message Date
Cai Yudong 06dad68f91
Add common/Consts.h (#10631) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 13:08:18 +08:00
godchen 6a0a5cf274
Add delete request hash values proto (#10601) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-25 21:20:44 +08:00
yukun 6c13008dc3
Fix sealed segment get deleted bitmap assert (#10572) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-25 21:18:47 +08:00
yukun b8fd695838
Fix duplicate delete bug in growing segment (#10570) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-25 20:15:49 +08:00
Cai Yudong e4909c1c0b
Optimize segcore API GetResultData (#10548) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-25 17:53:20 +08:00
Cai Yudong be57e8fdd8
Remove redundant code (#10343) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-25 14:27:12 +08:00
yukun 7acb48919b
Add Delete func in Segcore SegmentSealed (#10501) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-24 14:19:10 +08:00
yukun bc083950a8
Add delete in segcore segment sealed (#10470) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 23:35:18 +08:00
yukun 0304a8014b
Support delete in query (#10452) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 20:05:12 +08:00
yukun f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 18:51:14 +08:00
groot 73c9ab43e0
Simplify cpp (#10413) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-22 14:33:11 +08:00
yukun fe1927c05d
Support delete in SegmentSealed (#10181) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 13:11:11 +08:00
Cai Yudong 824005115a
Remove duplicated search results in proxy (#10355) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-21 19:52:28 +08:00
groot a91486e966
Fix a compile error (#10358) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-21 19:10:37 +08:00
yukun ac581c5a38
Fix bitmap bug when delete without expression (#10325) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 11:01:07 +08:00
groot 525a85ef06
Remove unused code (#10285) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-20 19:21:18 +08:00
yukun e91eafd871
Fix Bitsetview bug in segcore (#10272) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-20 16:34:36 +08:00
Cai Yudong 983bd1d473
Reorder header files for LoadInfo.h (#10264) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:46:47 +08:00
Cai Yudong 597523bf40
Reorder header files for FieldMeta.h (#10263) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:44:41 +08:00
Cai Yudong 48648c818b
Remove duplicated search results in segcore reduce (#10117) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:40:49 +08:00
Cai Yudong ced29480cf
Format CGoHelper.h (#10261) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 14:56:35 +08:00
Cai Yudong 56f97aa07b
Move Log out of Milvus namespace (#10178) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 17:10:35 +08:00
yukun e108476601
Support delete in SegmentGrowing (#10154) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-19 11:54:34 +08:00
Cai Yudong 39bf58d8cb
Remove deprecated API get_offset_opt (#10150) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:46:34 +08:00
Cai Yudong 693220fe0a
Remove dummy structure EntityResult (#10149) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:28:34 +08:00
Cai Yudong eda9d550a8
Code clean for test_timestamp_index (#10148) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:10:34 +08:00
Cai Yudong d54f3426e8
Reorder header files for test_segcore (#10051) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:38:47 +08:00
Cai Yudong 027103b4f6
Reorder header files for test_span (#10053) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:10:57 +08:00
Cai Yudong 3e3f8b825a
Reorder header files for test_sealed (#10049) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:09:04 +08:00
Cai Yudong ffd67de9cb
Reorder header files for test_reduce (#9934) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 17:00:43 +08:00
Cai Yudong 356b7e36ba
Reorder header files for test_query (#9932) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 16:56:51 +08:00
Cai Yudong bb721f1cf4
Format internal/core/CMakeLists.txt (#9931) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 16:52:43 +08:00
XuanYang-cn ea7abf49c3
Fix protobuf compilation error (#9881) 
resolves:#9876

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-14 18:14:32 +08:00
Cai Yudong 5a8aca01fd
Reorder header files for test_plan_proto (#9871) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 16:52:33 +08:00
Cai Yudong 8dbc3db393
Remove dummy test_naive (#9850) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 12:52:33 +08:00
Cai Yudong 30661321f2
Remove dummy test_interface (#9848) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 12:50:37 +08:00
Cai Yudong 937e59f6c3
Remove dummy test_load (#9847) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 11:06:39 +08:00
ZhiShen 6a770e5c38
Make knowhere compile independently (#7606) 
Make knowhere compile independently

1. Make knowhere compile independently
    * Add gtest, arrow, and some other libraries to index.
    * Add cache, log and some other files to knowhere.
    * Add CMakeLists files to index's thirdparty.

2. Modified the compilation content of knowhere
    * Delete some content of compile library.
    * Add IMPORTED_GLOBAL property to faiss.

3.  Change the compilation location of some libraries
    * Make OpenBLas compiled in thirdpartycore.cmake.
    * Make faiss compiled in thirdparty/CMakeLists.

Change the content of knowhere/CMakeLists

1. Change easyloggingpp and nlohmann into index/thirdparty.
2. Change MILVUS_THIRDPARTY_SRC into KNOWHERE_THIRDPARTY_SRC.

Delete FindOpenBLAS

1. Delete Openblas.cmake.

2. The search task for openBlas is assigned to ThirdpartyCore.

3. Some changes were made to build.sh in index.

Fix the openBLas compilation problem

Delete the if-else in compilation of faiss;

Now when complie faiss, it will find the Openblas as we wish.

Fix some problem:

1. delete arrow

2. set openblas_source to AUTO

3. change a include_dir

4. delete MKL

5. delete the CMakeLists in index/utils,cache,log

Change variable build_test to knowhere_build_test in index/build.sh

Change the include location of  GNUInstallDirs

set CMAKE_INSTALL_LIBDIR

Resolves: milvus-io#5183
See also: milvus-io#6604

Signed-off-by: Shen Zhi <m13120163046@163.com>
 2021-10-13 17:06:33 +08:00
yukun 6c88774624
Add get final filtered bitmap in SegmentGrowing (#9780) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-13 16:54:34 +08:00
Cai Yudong 92c7eb5a09
Code clean for test_interface (#9767) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 11:06:33 +08:00
Cai Yudong ca5e3e8644
Code clean for test_indexing (#9765) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 11:00:39 +08:00
Cai Yudong 01db5dc6dd
Code clean for test_init (#9766) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 10:58:33 +08:00
Cai Yudong 2d8e86692a
Format test_expr.cpp (#9698) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:48:34 +08:00
Cai Yudong e790ba3e41
Reorder header files (#9700) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:44:33 +08:00
Cai Yudong 6f7031111a
Update header file (#9696) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:42:33 +08:00
Cai Yudong 9229d56c96
Clear redundant code line for test_bitmap (#9632) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 17:08:29 +08:00
Cai Yudong b8519416c0
Clear redundant code line (#9631) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 17:04:29 +08:00
Cai Yudong 4908b1c461
Update header file (#9625) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 16:35:52 +08:00
bigsheeper 3a4df03b70
Add SealedSegmentsChangeInfo and changeInfoMsg (#9479) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-09 14:45:00 +08:00
Xiangyu Wang e281b623d2
Fix compilation error of core on macOS (#9317) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-08 20:48:56 +08:00
elfisworking d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574) 
Signed-off-by: elfisworking <zymustb@126.com>
 2021-10-08 17:39:55 +08:00
Cai Yudong d18c3bc5fd
Add db_name for alias proto (#9010) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-01 21:40:21 +08:00
dragondriver a10f421c14
Get SIMD type used in faiss (#8849) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 20:50:19 +08:00
ZhiShen 0e767f0e1b
Change cmake version (#8666) 
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
 2021-09-28 14:00:03 +08:00
yukun ff3573c921
Add segcore error messages (#8681) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-27 20:30:23 +08:00
congqixia c17f845ab3
Add StartPositions fields in proto (#8657) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-27 14:13:58 +08:00
zhenshan.cao b71bffe26f
Replace ChannelID with ShardName in DML Request (#8539) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-27 10:01:59 +08:00
Cai Yudong 3e487bde0b
Clean test_concurrent_vector.cpp (#8532) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-25 12:13:56 +08:00
yukun 1913ec9e94
Add segcore error messages (#8515) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-24 22:17:56 +08:00
groot 985e63cbf2
Reduce cpp unittest time cost (#8424) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-23 21:50:11 +08:00
yukun 3c77eda7ac
Add error msgs in segcore (#8410) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-23 18:59:54 +08:00
groot af1bdaf202
Reduce cpp unittest time cost (#8409) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-23 17:55:54 +08:00
groot 8b81ceb5d7
Reduce cpp unittest time cost (#8403) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-23 16:55:54 +08:00
groot b897ca5703
Fix unittest build problem (#8369) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-23 14:19:54 +08:00
cai.zhang 0d9ab7ab7d
Remove useless debug message in indexbuilder (#8303) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-22 19:37:53 +08:00
yukun c5beef16a9
Add error msgs in segcore visitors (#8306) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 18:07:54 +08:00
Cai Yudong 83ffa18c37
[skip ci] Update test_concurrent_vector (#8273) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-22 17:21:53 +08:00
Cai Yudong 07aa453270
[skip ci] Update test_segcore (#8270) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-22 17:19:53 +08:00
dragondriver 78fe530d87
Initialize the simd type when initialize an indexnode (#8276) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 16:05:59 +08:00
Cai Yudong c1e229cb7e
Add segcore logger (#8262) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-22 10:11:52 +08:00
groot b6e43e0439
Fix cpp code coverage bug (#8203) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-18 16:15:51 +08:00
yukun 82e48fb379
Add more error messages in segcore visitors (#8195) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-18 15:53:51 +08:00
Cai Yudong 2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 14:41:50 +08:00
Yusup ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
zhenshan.cao 4c184921f0
Add comments and enchanme unittest for retrieve (#8114) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-16 23:43:49 +08:00
zhenshan.cao 5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068) 
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-16 20:11:49 +08:00
yukun 8b3893e030
Add more error messages in segcore (#8012) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-16 10:23:53 +08:00
yukun 9a6f2e618c
Change Assert to AssertInfo in SegmentGrowing (#7952) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 22:04:39 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 15:15:52 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 12:57:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 10:35:52 +08:00
Cai Yudong c16ab5b35c
Use better segcoe variable name (#7869) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 10:06:00 +08:00
yukun 80ae6b7d31
Change Assert to AssertInfo in SegmentSealedImpl (#7903) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 18:43:48 +08:00
Cai Yudong 4dc9a64f01
Improve segcore code readability (#7868) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 16:07:48 +08:00
Cai Yudong b5923ff27d
Update segcore unittest format (#7860) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 11:22:57 +08:00
Cai Yudong 74ac528095
Improve segcore (#7851) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 10:53:04 +08:00
yukun 5c997710ab
Change Assert() to AssertInfo() to return error messages (#7843) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 10:06:40 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-11 14:40:01 +08:00
groot 16a6afa9bd
Fix build version typo (#7639) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-10 11:10:00 +08:00
zhenshan.cao b0524adbd8
Support specified shard number when create collection (#7482) 
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-08 15:00:00 +08:00
yukun a560aefc36
Fix search result is wrong when the term content in expression is not in order (#7557) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-08 11:49:59 +08:00
xige-16 468bef4478
Fix dataset's memory leak in knowWhere when search (#7527) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-07 14:25:59 +08:00
yukun 94272bba87
Support query by expression (#7386) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-03 17:12:55 +08:00
cai.zhang 880aa540e6
Fix bug for expression boundary (#7339) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-08-28 10:13:57 +08:00
groot 8701c477e2
Add delete api into proto (#7304) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-26 12:15:52 +08:00
xige-16 76066b5659
Fix IVF_FLAT index's wrong meta_data (#7167) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-19 14:26:11 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-18 10:12:10 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-17 10:06:11 +08:00
yukun 61bda45e35
Add ConfAdapter to check search (#6971) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 18:54:10 +08:00
yukun 671b2737d2
Remove RetrieveRequest and RetrieveTask (#6848) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 17:06:10 +08:00