milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,142 Commits
152 Branches
122 Tags
588 MiB
Commit Graph

562 Commits (6bdbe23e9f9327c98d78ce2a8b7f2138d9a9d8ce)

Author SHA1 Message Date
Cai Yudong 64b47ee4b3
Reorder header files for segcore/reduce_c.h (#11481) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-09 16:27:20 +08:00
Cai Yudong ba49490b04
Reorder header files for segcore/reduce_c.cpp (#11480) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-09 16:25:32 +08:00
Bingyi Sun 50791765d5
Add GetCompactionStateWithPlans rpc interface in milvus.proto (#11491) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-09 15:47:00 +08:00
Cai Yudong dae65640a7
Remove redundant header file in segcore/Record.h (#11478) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-09 15:03:09 +08:00
Bingyi Sun c3f0c5a3ff
Add compaction interfaces in proxy (#11431) 
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-09 14:47:02 +08:00
Cai Yudong 14c37058e3
Rename simd configuration valid values for better readability (#11410) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 22:07:05 +08:00
Cai Yudong caf3a2405d
Update KnowhereException (#11425) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 22:05:05 +08:00
Cai Yudong feb7f47faa
Reorder header files for segcore/plan_c.h (#11405) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 16:11:16 +08:00
Cai Yudong f609f3f1c8
Reorder header files for segcore/plan_c.cpp (#11404) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 16:09:26 +08:00
Cai Yudong 315aa0aff9
Merge GetResultData and ResetResultData into ReduceResultData (#11396) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 15:58:58 +08:00
bigsheeper 38375ee1d3
Add LoadBalance (#9945) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-06 16:54:59 +08:00
Cai Yudong db2a0a3bd3
Fix reduce panic (#11325) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-05 18:17:00 +08:00
godchen 09f8fa1040
Add query coord watch delta channel (#11218) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-05 14:47:19 +08:00
xige-16 b567a8e5b5
Add SystemInfo msgType for getMetricRequest (#11151) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-04 10:58:11 +08:00
Cai Yudong f25def79ed
Add debug logs for search results handling (#11186) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 19:12:10 +08:00
Ji Bin 68d6839ab0
Improvements: Some adaptation for gcc-10 (#7853) 
Support windows compile with MSYS (partial). This part including:

- CMakeLists.txt using CMAKE_SHARED_LIBRARY_SUFFIX instead .so
- Replace finite() with std::isfinite()
  ref: https://github.com/facebookresearch/faiss/pull/1341
- Replace bzero (deprecated in POSIX 2001) with memset.
  ref: https://github.com/facebookresearch/faiss/pull/1340
- Some int types match.

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-11-03 16:00:16 +08:00
zhenshan.cao cd79fd07c4
Fix timetravel bug on sealed segment (#11152) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-03 12:40:12 +08:00
Cai Yudong e059c99ada
Reorder header files for segcore/load_index_c.h (#11143) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 12:16:12 +08:00
Cai Yudong 9531fc5adf
Reorder header files for segcore/load_index_c.cpp (#11140) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 11:46:12 +08:00
Cai Yudong 40d254d09c
Reorder header files for segcore/InsertRecord.h (#11139) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 11:42:12 +08:00
Cai Yudong 885e5f4210
Remove redundant empty lines (#11138) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 11:38:15 +08:00
Cai Yudong dca0f1a463
Reorder header files for segcore/DeletedRecord.h (#11064) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 14:16:31 +08:00
Cai Yudong 93339c7f49
Reorder header files for segcore/FieldIndexing.h (#11067) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 11:14:33 +08:00
Cai Yudong 5397449f2a
Reorder header files for segcore/FieldIndexing.cpp (#11066) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 11:06:30 +08:00
Cai Yudong 623a31ab42
Reorder header files for segcore/ConcurrentVector.h (#11063) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 11:02:28 +08:00
Cai Yudong 6d5755998b
Reorder header files for segcore/Collection.h (#11059) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 10:46:33 +08:00
Cai Yudong ca936affac
Reorder header files for segcore/AckResponder.h (#11058) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 10:44:34 +08:00
Cai Yudong 4241326524
Update test API CheckSearchResultDuplicate (#11019) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-01 18:31:59 +08:00
yukun d8044299a0
Add uids and seg_offsets check in segcore (#10983) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-01 15:21:52 +08:00
Cai Yudong da0cb4a702
Use primary key only to check search result duplicate (#10949) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-01 10:06:03 +08:00
yukun 8153beffb2
[skip ci]Remove unused code in segcore (#10905) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-29 17:26:44 +08:00
yukun 64d5584670
[skip ci]Format segcore comments (#10904) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-29 17:24:51 +08:00
groot 57783827fb
Add cpp coverage (#10801) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-28 18:54:35 +08:00
yukun 36e19ab9cd
[skip ci]Format segcore code (#10815) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-28 17:22:28 +08:00
yukun 1cfafb9ee0
[skip ci]Remove unused code in segcore Search (#10814) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-28 17:20:34 +08:00
yukun b76c526907
[skip ci]Remove unused code in segcore (#10813) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-28 17:18:41 +08:00
Cai Yudong 4186e785ab
Optimize GetResultData in reduce_c.cpp (#10797) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-28 14:24:22 +08:00
Cai Yudong 5ad4cdda25
Clean search result duplicates removal debug log (#10769) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-27 20:02:26 +08:00
xige-16 80215eb2f0
Retruen segment state when get query segment info (#10730) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-27 19:28:21 +08:00
yukun 5cd935729c
Fix bitmap merge in segcore (#10711) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-27 14:34:31 +08:00
Cai Yudong 07fe3758c4
Remove core/src/utils/Log.h (#10675) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 19:34:22 +08:00
Cai Yudong 492dd1a66f
Remove redundant file (#10674) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 19:32:33 +08:00
Cai Yudong 403b41084f
Remove redundant head files for SegmentGrowingImpl.cpp (#10672) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 19:30:44 +08:00
yukun 471ddb07b2
Decide the final offset when repeated keys (#10671) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-26 19:28:52 +08:00
Cai Yudong 1227b9ebae
Rename utils/tools.h to utils/Utils.h (#10665) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 17:28:23 +08:00
Cai Yudong fa01a888a0
Remove redundant files under internal/core (#10658) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 17:26:30 +08:00
Cai Yudong 04d34bfcd7
Remove redundant code (#10635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 13:12:21 +08:00
Cai Yudong 4cd83e78ed
Reorder header files for segcore/Collection.cpp (#10634) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 13:10:30 +08:00
Cai Yudong 06dad68f91
Add common/Consts.h (#10631) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 13:08:18 +08:00
godchen 6a0a5cf274
Add delete request hash values proto (#10601) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-25 21:20:44 +08:00
yukun 6c13008dc3
Fix sealed segment get deleted bitmap assert (#10572) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-25 21:18:47 +08:00
yukun b8fd695838
Fix duplicate delete bug in growing segment (#10570) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-25 20:15:49 +08:00
Cai Yudong e4909c1c0b
Optimize segcore API GetResultData (#10548) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-25 17:53:20 +08:00
Cai Yudong be57e8fdd8
Remove redundant code (#10343) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-25 14:27:12 +08:00
yukun 7acb48919b
Add Delete func in Segcore SegmentSealed (#10501) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-24 14:19:10 +08:00
yukun bc083950a8
Add delete in segcore segment sealed (#10470) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 23:35:18 +08:00
yukun 0304a8014b
Support delete in query (#10452) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 20:05:12 +08:00
yukun f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 18:51:14 +08:00
groot 73c9ab43e0
Simplify cpp (#10413) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-22 14:33:11 +08:00
yukun fe1927c05d
Support delete in SegmentSealed (#10181) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 13:11:11 +08:00
Cai Yudong 824005115a
Remove duplicated search results in proxy (#10355) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-21 19:52:28 +08:00
groot a91486e966
Fix a compile error (#10358) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-21 19:10:37 +08:00
yukun ac581c5a38
Fix bitmap bug when delete without expression (#10325) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 11:01:07 +08:00
groot 525a85ef06
Remove unused code (#10285) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-20 19:21:18 +08:00
yukun e91eafd871
Fix Bitsetview bug in segcore (#10272) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-20 16:34:36 +08:00
Cai Yudong 983bd1d473
Reorder header files for LoadInfo.h (#10264) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:46:47 +08:00
Cai Yudong 597523bf40
Reorder header files for FieldMeta.h (#10263) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:44:41 +08:00
Cai Yudong 48648c818b
Remove duplicated search results in segcore reduce (#10117) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:40:49 +08:00
Cai Yudong ced29480cf
Format CGoHelper.h (#10261) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 14:56:35 +08:00
Cai Yudong 56f97aa07b
Move Log out of Milvus namespace (#10178) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 17:10:35 +08:00
yukun e108476601
Support delete in SegmentGrowing (#10154) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-19 11:54:34 +08:00
Cai Yudong 39bf58d8cb
Remove deprecated API get_offset_opt (#10150) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:46:34 +08:00
Cai Yudong 693220fe0a
Remove dummy structure EntityResult (#10149) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:28:34 +08:00
Cai Yudong eda9d550a8
Code clean for test_timestamp_index (#10148) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:10:34 +08:00
Cai Yudong d54f3426e8
Reorder header files for test_segcore (#10051) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:38:47 +08:00
Cai Yudong 027103b4f6
Reorder header files for test_span (#10053) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:10:57 +08:00
Cai Yudong 3e3f8b825a
Reorder header files for test_sealed (#10049) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:09:04 +08:00
Cai Yudong ffd67de9cb
Reorder header files for test_reduce (#9934) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 17:00:43 +08:00
Cai Yudong 356b7e36ba
Reorder header files for test_query (#9932) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 16:56:51 +08:00
Cai Yudong bb721f1cf4
Format internal/core/CMakeLists.txt (#9931) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 16:52:43 +08:00
XuanYang-cn ea7abf49c3
Fix protobuf compilation error (#9881) 
resolves:#9876

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-14 18:14:32 +08:00
Cai Yudong 5a8aca01fd
Reorder header files for test_plan_proto (#9871) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 16:52:33 +08:00
Cai Yudong 8dbc3db393
Remove dummy test_naive (#9850) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 12:52:33 +08:00
Cai Yudong 30661321f2
Remove dummy test_interface (#9848) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 12:50:37 +08:00
Cai Yudong 937e59f6c3
Remove dummy test_load (#9847) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 11:06:39 +08:00
ZhiShen 6a770e5c38
Make knowhere compile independently (#7606) 
Make knowhere compile independently

1. Make knowhere compile independently
    * Add gtest, arrow, and some other libraries to index.
    * Add cache, log and some other files to knowhere.
    * Add CMakeLists files to index's thirdparty.

2. Modified the compilation content of knowhere
    * Delete some content of compile library.
    * Add IMPORTED_GLOBAL property to faiss.

3.  Change the compilation location of some libraries
    * Make OpenBLas compiled in thirdpartycore.cmake.
    * Make faiss compiled in thirdparty/CMakeLists.

Change the content of knowhere/CMakeLists

1. Change easyloggingpp and nlohmann into index/thirdparty.
2. Change MILVUS_THIRDPARTY_SRC into KNOWHERE_THIRDPARTY_SRC.

Delete FindOpenBLAS

1. Delete Openblas.cmake.

2. The search task for openBlas is assigned to ThirdpartyCore.

3. Some changes were made to build.sh in index.

Fix the openBLas compilation problem

Delete the if-else in compilation of faiss;

Now when complie faiss, it will find the Openblas as we wish.

Fix some problem:

1. delete arrow

2. set openblas_source to AUTO

3. change a include_dir

4. delete MKL

5. delete the CMakeLists in index/utils,cache,log

Change variable build_test to knowhere_build_test in index/build.sh

Change the include location of  GNUInstallDirs

set CMAKE_INSTALL_LIBDIR

Resolves: milvus-io#5183
See also: milvus-io#6604

Signed-off-by: Shen Zhi <m13120163046@163.com>
 2021-10-13 17:06:33 +08:00
yukun 6c88774624
Add get final filtered bitmap in SegmentGrowing (#9780) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-13 16:54:34 +08:00
Cai Yudong 92c7eb5a09
Code clean for test_interface (#9767) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 11:06:33 +08:00
Cai Yudong ca5e3e8644
Code clean for test_indexing (#9765) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 11:00:39 +08:00
Cai Yudong 01db5dc6dd
Code clean for test_init (#9766) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 10:58:33 +08:00
Cai Yudong 2d8e86692a
Format test_expr.cpp (#9698) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:48:34 +08:00
Cai Yudong e790ba3e41
Reorder header files (#9700) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:44:33 +08:00
Cai Yudong 6f7031111a
Update header file (#9696) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:42:33 +08:00
Cai Yudong 9229d56c96
Clear redundant code line for test_bitmap (#9632) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 17:08:29 +08:00
Cai Yudong b8519416c0
Clear redundant code line (#9631) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 17:04:29 +08:00
Cai Yudong 4908b1c461
Update header file (#9625) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 16:35:52 +08:00
bigsheeper 3a4df03b70
Add SealedSegmentsChangeInfo and changeInfoMsg (#9479) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-09 14:45:00 +08:00
Xiangyu Wang e281b623d2
Fix compilation error of core on macOS (#9317) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-08 20:48:56 +08:00
elfisworking d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574) 
Signed-off-by: elfisworking <zymustb@126.com>
 2021-10-08 17:39:55 +08:00
Cai Yudong d18c3bc5fd
Add db_name for alias proto (#9010) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-01 21:40:21 +08:00