milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
16,271 Commits
146 Branches
120 Tags
569 MiB
Commit Graph

316 Commits (3c9840d6d3daff609a57cf71f44642c657f60e60)

Author SHA1 Message Date
Jiquan Long c5149c7e85
Replace text codec of pb with binary codec (#16955) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-13 09:53:53 +08:00
xige-16 08ad77c71b
Delete all repeated primary keys (#16863) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-05-12 14:09:53 +08:00
bigsheeper 64d2793fe9
Fix wrong result topks when reduce search result (#16815) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-06 21:17:51 +08:00
Cai Yudong 21a1311f66
Merge utils/Utils.h into common/Utils.h (#16762) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-05-03 12:05:50 +08:00
Cai Yudong 6a62ff18bf
Support easylogging config for segcore and knowhere (#16751) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-05-03 08:39:49 +08:00
Cai Yudong d5db4ae463
Merge utils/Types.h with common/Types.h (#16445) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-05-02 22:21:51 +08:00
xige-16 515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
Aivin V. Solatorio 04fffb08ef
Support arithmetic operations on numerical fields for scalar filtering (#16520) 
Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
 2022-04-24 16:43:45 +08:00
yah01 3f5733b738
Return the local variable directly, make RVO enabled (#16201) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-22 17:43:42 +08:00
zhenshan.cao 58ea38142f
Use boost dynamic_bitset in segcore (#16476) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-04-14 22:37:34 +08:00
Cai Yudong 70bd6b6e6d
Remove dependency on knowhere::scalar (#16458) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-04-12 09:49:33 +08:00
xige-16 27b4cbc098
Cherry pick remove translateHits commit to mater (#16436) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
 2022-04-08 20:27:31 +08:00
Cai Yudong a37479d728
Upgrade to knowhere-v1.1.2 to support all index types for mac (#16416) 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2022-04-08 15:29:31 +08:00
Cai Yudong 6c4d497d73
Fix mac build error (#16415) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-04-07 17:29:31 +08:00
Cai Yudong 543ec4a209
Rename log to milvus_log (#16383) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-04-05 22:55:30 +08:00
Cai Yudong 7323180861
Move bench to directory unittest (#16386) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-04-05 12:43:30 +08:00
Cai Yudong 0c53f06a33
Fix build error on mac (#16380) 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2022-04-04 21:09:32 +08:00
Jiquan Long fd589baca7
Integrates marisa trie index (#16192) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-01 15:31:29 +08:00
zhenshan.cao b03da87df5
Accelerate query speed in sealed segment (#16287) 
Fix delete duplicate key

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-31 17:33:28 +08:00
Cai Yudong f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-25 13:49:25 +08:00
Jiquan Long 48706f416f
Migrate scalar index from knowhere (#16174) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-24 14:57:26 +08:00
Letian Jiang 321105cc01
Add column-based insert interface in segcore (#16100) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-03-23 19:05:25 +08:00
Jiquan Long f8d9bc919d
Unify interface of vector index & scalar index. (#15959) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-21 14:23:24 +08:00
Letian Jiang 8f52e5b6c7
Add unit tests in segcore (#15960) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-03-10 16:33:59 +08:00
Cai Yudong 9a6ee61731
Change all fields in Expr to const to avoid modification (#15663) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-22 14:45:51 +08:00
zhenshan.cao 142848fcc3
Abandon using protobuf to pass binaryset parameter (#15626) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-02-18 18:39:50 +08:00
jaime 307a8ce535
Support compile and run on Mac (#15491) 
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
 2022-02-09 14:27:46 +08:00
bigsheeper ebed1a68ff
Add log for segcore search (#15159) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-11 18:07:34 +08:00
zhenshan.cao f729853be7
Add unittest for delete and retrieve (#14373) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-12-28 22:18:47 +08:00
Cai Yudong 4884541896
Update unittest log (#13161) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-10 15:55:08 +08:00
Cai Yudong 15b932c63c
Add unittest IVFFlatNM for Indexing (#13044) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-09 14:21:28 +08:00
Cai Yudong 1ae249adb5
Update profiler CMakeLists.txt (#13001) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-08 23:23:06 +08:00
Cai Yudong 45bac3e4ec
Move profiler under core/thirdparty (#12949) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-08 13:01:04 +08:00
Cai Yudong 41ba52bb28
Support C unittest profiling (#12899) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-07 20:17:03 +08:00
Cai Yudong b053317545
Rename FaissMetricTypeToString to MetricTypeToString (#12767) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-07 10:13:53 +08:00
Cai Yudong cbb01051f0
Update Search return type (#12578) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-02 11:45:32 +08:00
dragondriver a44c00b0d0
Format test_c_api.cpp (#12515) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 15:28:00 +08:00
dragondriver 1db1cf2104
Fix similarity correlation (#12511) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 15:26:02 +08:00
Cai Yudong 365b5a5d01
Rename SubSearchResult fields for better readability (#12341) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 17:07:40 +08:00
Cai Yudong cb952d6036
Rename SearchResult fields for better readability (#12327) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 14:57:18 +08:00
Cai Yudong 45fac75889
Fix segcore unittest fail (#12326) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 12:27:17 +08:00
dragondriver 73f18c564f
Refine logs when search with unsupported metric type (#12185) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-23 10:13:14 +08:00
Cai Yudong 3aca73969f
Optimize segcore API arrangement (#12135) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-19 17:23:12 +08:00
dragondriver 8c951217ee
Fix wrong distances caused by metric type (#11901) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-16 19:11:10 +08:00
Cai Yudong b0054f1b48
Update C API NewSegment (#11809) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-15 16:57:09 +08:00
Cai Yudong 5fdc6626cb
Change API retrieve return type from CProtoResult to CProto (#11555) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-12 10:04:49 +08:00
dragondriver daaeb27ee1
Make AdapterMgr.GetAdapter thread-safe (#11674) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-11 20:42:44 +08:00
Cai Yudong db2a0a3bd3
Fix reduce panic (#11325) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-05 18:17:00 +08:00
zhenshan.cao cd79fd07c4
Fix timetravel bug on sealed segment (#11152) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-03 12:40:12 +08:00
Cai Yudong 4241326524
Update test API CheckSearchResultDuplicate (#11019) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-01 18:31:59 +08:00
yukun d8044299a0
Add uids and seg_offsets check in segcore (#10983) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-01 15:21:52 +08:00
groot 57783827fb
Add cpp coverage (#10801) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-28 18:54:35 +08:00
Cai Yudong 1227b9ebae
Rename utils/tools.h to utils/Utils.h (#10665) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 17:28:23 +08:00
yukun 7acb48919b
Add Delete func in Segcore SegmentSealed (#10501) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-24 14:19:10 +08:00
yukun bc083950a8
Add delete in segcore segment sealed (#10470) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 23:35:18 +08:00
yukun fe1927c05d
Support delete in SegmentSealed (#10181) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 13:11:11 +08:00
Cai Yudong 48648c818b
Remove duplicated search results in segcore reduce (#10117) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:40:49 +08:00
Cai Yudong eda9d550a8
Code clean for test_timestamp_index (#10148) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:10:34 +08:00
Cai Yudong d54f3426e8
Reorder header files for test_segcore (#10051) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:38:47 +08:00
Cai Yudong 027103b4f6
Reorder header files for test_span (#10053) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:10:57 +08:00
Cai Yudong 3e3f8b825a
Reorder header files for test_sealed (#10049) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:09:04 +08:00
Cai Yudong ffd67de9cb
Reorder header files for test_reduce (#9934) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 17:00:43 +08:00
Cai Yudong 356b7e36ba
Reorder header files for test_query (#9932) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 16:56:51 +08:00
Cai Yudong 5a8aca01fd
Reorder header files for test_plan_proto (#9871) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 16:52:33 +08:00
Cai Yudong 8dbc3db393
Remove dummy test_naive (#9850) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 12:52:33 +08:00
Cai Yudong 30661321f2
Remove dummy test_interface (#9848) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 12:50:37 +08:00
Cai Yudong 937e59f6c3
Remove dummy test_load (#9847) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 11:06:39 +08:00
yukun 6c88774624
Add get final filtered bitmap in SegmentGrowing (#9780) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-13 16:54:34 +08:00
Cai Yudong 92c7eb5a09
Code clean for test_interface (#9767) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 11:06:33 +08:00
Cai Yudong ca5e3e8644
Code clean for test_indexing (#9765) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 11:00:39 +08:00
Cai Yudong 01db5dc6dd
Code clean for test_init (#9766) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 10:58:33 +08:00
Cai Yudong 2d8e86692a
Format test_expr.cpp (#9698) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:48:34 +08:00
Cai Yudong e790ba3e41
Reorder header files (#9700) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:44:33 +08:00
Cai Yudong 6f7031111a
Update header file (#9696) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:42:33 +08:00
Cai Yudong 9229d56c96
Clear redundant code line for test_bitmap (#9632) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 17:08:29 +08:00
Cai Yudong b8519416c0
Clear redundant code line (#9631) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 17:04:29 +08:00
Cai Yudong 4908b1c461
Update header file (#9625) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-11 16:35:52 +08:00
elfisworking d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574) 
Signed-off-by: elfisworking <zymustb@126.com>
 2021-10-08 17:39:55 +08:00
Cai Yudong 3e487bde0b
Clean test_concurrent_vector.cpp (#8532) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-25 12:13:56 +08:00
groot af1bdaf202
Reduce cpp unittest time cost (#8409) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-23 17:55:54 +08:00
groot 8b81ceb5d7
Reduce cpp unittest time cost (#8403) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-23 16:55:54 +08:00
Cai Yudong 83ffa18c37
[skip ci] Update test_concurrent_vector (#8273) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-22 17:21:53 +08:00
Cai Yudong 07aa453270
[skip ci] Update test_segcore (#8270) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-22 17:19:53 +08:00
yukun 82e48fb379
Add more error messages in segcore visitors (#8195) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-18 15:53:51 +08:00
Cai Yudong 2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 14:41:50 +08:00
zhenshan.cao 4c184921f0
Add comments and enchanme unittest for retrieve (#8114) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-16 23:43:49 +08:00
zhenshan.cao 5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068) 
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-16 20:11:49 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 15:15:52 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 12:57:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 10:35:52 +08:00
Cai Yudong b5923ff27d
Update segcore unittest format (#7860) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 11:22:57 +08:00
Cai Yudong 74ac528095
Improve segcore (#7851) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 10:53:04 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-11 14:40:01 +08:00
yukun 94272bba87
Support query by expression (#7386) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-03 17:12:55 +08:00
xige-16 76066b5659
Fix IVF_FLAT index's wrong meta_data (#7167) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-19 14:26:11 +08:00
Cai Yudong 6c75301c70
optimize search reduce logic (#7066) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-12 18:00:11 +08:00
xaxys e43b43e7d8
Refactor `RangeExpr` & `CompareExpr` (#6786) 
* Changed `RangeExpr` proto to `UnaryRangeExpr` & `BinaryRangeExpr`
Several unit test unpassed.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix bugs to pass unit test. Fix format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Remove debug information.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix format.
Remove debug information.
Unify variable name.
Add error information.
Remove `CompareExpr` test in `test_c_api.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix code format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Update `Plan.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>
 2021-07-25 10:23:19 +08:00
dragondriver 2821c08560
Add unittests for metric_type: tanimoto (#6773) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-23 20:59:33 +08:00
FluorineDog aba21baf82
refactor expr executor to use single bitset (#6667) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-23 15:30:12 +08:00
Cai Yudong 744f2c7f51
optimize test_c_api.cpp (#6637) 
* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* clean redundant file

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change DIM to const

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update reduce testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-20 17:13:21 +08:00