Commit Graph

896 Commits (d0d0db8c6441efe5dc8480b3658f9e6082f78818)

Author SHA1 Message Date
zhenshan.cao a32c637776
[skip e2e]Update license (#13919)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-21 21:57:11 +08:00
Jiquan Long 8a63dba149
Add consistency level field in collection meta (#13766)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-21 19:49:02 +08:00
cxytz01 8961c2da51
[skip e2e] Grammar correction (#13825)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-21 15:40:25 +08:00
cxytz01 def735db73
[skip e2e] Grammar correction (#13826)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-21 15:19:24 +08:00
cxytz01 89fee68fec
[skip e2e] Grammar correction (#13823)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-21 15:17:02 +08:00
Cai Yudong fbfebf1cf9
[skip e2e] Reorder header files for query/PlanProto.cpp (#13851)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-21 14:30:55 +08:00
Cai Yudong 42ca867708
[skip e2e] Update comments (#13850)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-21 14:29:01 +08:00
Cai Yudong 83624d5850
[skip e2e] Reorder header files for query/ScalarIndex.h (#13854)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-21 12:10:54 +08:00
Cai Yudong dbd6408158
[skip e2e] Reorder header files for query/PlanProto.h (#13853)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-21 12:09:03 +08:00
Cai Yudong dd35141774
[skip e2e] Remove useless comments (#13849)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-21 12:07:09 +08:00
Xieql f332e14034
[skip e2e] improve annotation (#13838)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-21 11:59:33 +08:00
zhenshan.cao 12bfa1a414
[skip e2e]Update license (#13817)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-20 23:42:53 +08:00
zhenshan.cao 207ab1e1f2
[skip e2e]Update license (#13816)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-20 23:41:00 +08:00
zhenshan.cao db13166197
[skip e2e]Update license (#13815)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-20 23:39:05 +08:00
cxytz01 88e399b729
[skip e2e] Grammar correction (#13772)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-20 19:24:08 +08:00
cxytz01 bdf9e338c4
[skip e2e] Grammar correction (#13770)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-20 19:20:31 +08:00
cxytz01 fcddbc2401
[skip e2e] Grammar correction (#13738)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-20 19:10:44 +08:00
Cai Yudong 96598ab276
[skip e2e] Reorder header files for query/PlanNode.h (#13741)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:39:03 +08:00
Cai Yudong 9849a800d8
[skip e2e] Reorder header files for query/PlanImpl.h (#13740)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:37:55 +08:00
Cai Yudong 92bee96b74
[skip e2e] Reorder header files for query/ExprImpl.h (#13717)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:31:00 +08:00
Cai Yudong b8db99b91b
Seperate Parser.h and Parser.cpp from query/Plan.cpp (#13739)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 14:27:16 +08:00
Cai Yudong 0a2bfae4a2
[skip e2e] Reorder header files for query/Expr.h (#13715)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 14:11:14 +08:00
zhenshan.cao 6099d4c55f
[skip e2e]Update license (#13669)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-17 21:14:41 +08:00
zhenshan.cao 9506e75e21
[skip e2e]Update license (#13668)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-17 20:54:42 +08:00
zhenshan.cao dcebee2367
[skip e2e]Update license (#13667)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-17 20:52:45 +08:00
zhenshan.cao 930e9daeaf
[skip ci] Update License (#13536)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-16 20:23:28 +08:00
zhenshan.cao a5e762bb4a
[skip ci]Update license (#13535)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-16 20:21:29 +08:00
zhenshan.cao 177c57a7c7
[skip ci]Update license (#13532)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-16 20:19:41 +08:00
xige-16 6f8ea8cc7b
Fix querycoord panic at getRecoveryInfo (#12983)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-13 10:29:27 +08:00
Cai Yudong 4884541896
Update unittest log (#13161)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-10 15:55:08 +08:00
Cai Yudong 15b932c63c
Add unittest IVFFlatNM for Indexing (#13044)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-09 14:21:28 +08:00
zhenshan.cao 3bb2412ddb
Remove dependency with etcd_meta in segcore (#12987)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-09 11:45:06 +08:00
Cai Yudong 1ae249adb5
Update profiler CMakeLists.txt (#13001)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 23:23:06 +08:00
Cai Yudong 85efcd8582
Move fiu nlohmann and easylogging to core/thirdparty (#12981)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 18:45:07 +08:00
Cai Yudong 45bac3e4ec
Move profiler under core/thirdparty (#12949)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 13:01:04 +08:00
Cai Yudong df875c5985
Clean useless thirdparty version (#12944)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 12:15:03 +08:00
Cai Yudong 7b97b155e8
Remove duplicated thirdparty (#12925)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 10:37:37 +08:00
Cai Yudong 2c42abf23b
Optimize segcore CMakeLists.txt (#12924)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 10:35:04 +08:00
Cai Yudong 41ba52bb28
Support C unittest profiling (#12899)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-07 20:17:03 +08:00
Cai Yudong d40af885b9
Update header files for segcore/SegmentInterface.cpp (#12770)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-07 10:17:51 +08:00
Cai Yudong 55c4d4754a
Remove useless header file for segment_c.cpp (#12768)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-07 10:15:59 +08:00
Cai Yudong b053317545
Rename FaissMetricTypeToString to MetricTypeToString (#12767)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-07 10:13:53 +08:00
Cai Yudong 32f3f78790
Reorder header files for segcore/TimestampIndex.h (#12766)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-06 18:11:07 +08:00
Cai Yudong 35cd7b5689
Format TimestampIndex.cpp (#12764)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-06 18:07:31 +08:00
Cai Yudong 1a806a174a
Support load collection with multiple vector column (#12630)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-03 11:29:33 +08:00
Cai Yudong cbb01051f0
Update Search return type (#12578)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-02 11:45:32 +08:00
Ji Bin 26b9d0e9f7
Support cpu/qemu only support SSE42 (#12337)
Compiler options for compiling faiss updated:
- for common objs using -mss4.2 for tunning, remove -mf16c, which may
  need newer CPU.
- for avx2 objs using -mavx2 and -mf16c
- for avx512 objs using -mavx512* and -mf16c

Issue: #12335

Signed-off-by: Ji Bin <matrixji@live.com>
2021-12-01 17:05:32 +08:00
dragondriver a44c00b0d0
Format test_c_api.cpp (#12515)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-01 15:28:00 +08:00
dragondriver 1db1cf2104
Fix similarity correlation (#12511)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-01 15:26:02 +08:00
dragondriver 6d92b8499c
Revert #11901, Fix wrong jaccard distance (#12487)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-30 20:31:35 +08:00
Cai Yudong 7f9a41496d
Reorder header files for segcore/SegmentSealedImpl.h (#12439)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:45:35 +08:00
Cai Yudong f899644e88
Update header files for segcore/SegmentSealedImpl.cpp (#12438)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:43:40 +08:00
Cai Yudong 97c2d2aec2
Reorder header files for segcore/SegmentSealed.h (#12435)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:41:44 +08:00
Cai Yudong d24cc8f846
Reorder header files for segcore/SegmentInterface.h (#12434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:39:49 +08:00
Cai Yudong 8f1e75718c
Clean code (#12433)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:37:41 +08:00
yukun 7bb9ae8802
Deleted data could not be searched using timestamp before delete time (#12437)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-30 12:39:41 +08:00
Cai Yudong 486ceca7fb
Remove useless type (#12375)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 09:53:52 +08:00
Cai Yudong 365b5a5d01
Rename SubSearchResult fields for better readability (#12341)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 17:07:40 +08:00
Cai Yudong cb952d6036
Rename SearchResult fields for better readability (#12327)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 14:57:18 +08:00
Cai Yudong 45fac75889
Fix segcore unittest fail (#12326)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 12:27:17 +08:00
zhenshan.cao f95ef2260b
Add GetFlushState grpc method (#12220)
Update sdk version

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-23 22:57:17 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170)
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 10:55:14 +08:00
dragondriver 73f18c564f
Refine logs when search with unsupported metric type (#12185)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-23 10:13:14 +08:00
congqixia 8a9fb9b287
Fix CMakeLists.txt comment error (#12141)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-19 19:33:13 +08:00
jaime 11110906a4
[skip ci] Add a TODO for a faiss cpp file (#12117)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-19 17:57:46 +08:00
jaime c6fea64aa7
[skip ci] Add a comment to faiss CMakeLists (#12116)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-19 17:55:40 +08:00
Cai Yudong 3aca73969f
Optimize segcore API arrangement (#12135)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-19 17:23:12 +08:00
dragondriver 8c951217ee
Fix wrong distances caused by metric type (#11901)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 19:11:10 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
Cai Yudong fd45a7ee5f
Remove redundant header file in segcore/SegmentGrowingImpl.cpp (#11831)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 10:37:12 +08:00
Cai Yudong a58f6b4820
Reorder header files for segcore/SegmentGrowing.h (#11829)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 10:35:16 +08:00
Cai Yudong e920b6d6ff
Reorder header files for segcore/SegmentGrowingImpl.h (#11830)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 10:33:16 +08:00
Cai Yudong ecae18ad40
Use LOG_SEGCORE_ERROR_ instead of std::cout (#11802)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 18:13:09 +08:00
Cai Yudong b0054f1b48
Update C API NewSegment (#11809)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:57:09 +08:00
Cai Yudong 106ed4d4ee
Reorder header files for segcore/segment_c.cpp (#11800)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 15:43:10 +08:00
Cai Yudong a35db8eda0
Optimize retrieve to use batch mode assignment (#11647)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-12 10:06:44 +08:00
Cai Yudong 5fdc6626cb
Change API retrieve return type from CProtoResult to CProto (#11555)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-12 10:04:49 +08:00
dragondriver daaeb27ee1
Make AdapterMgr.GetAdapter thread-safe (#11674)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-11 20:42:44 +08:00
Cai Yudong c5f566357a
Remove debug code (#11556)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-10 17:31:37 +08:00
Cai Yudong 4df4dc8f80
Reorder header files for segcore/SealedIndexingRecord.h (#11541)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-10 17:13:41 +08:00
Cai Yudong 87b4fe2220
Remove empty file SealedIndexingRecord.cpp (#11538)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-10 17:11:45 +08:00
Cai Yudong 72340d7c36
Remove duplicated SIMD setting (#11536)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-10 17:09:37 +08:00
congqixia 85af0b571d
Add dropped segment state (#11499)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-09 18:41:37 +08:00
Cai Yudong 993d8ec4d3
Reorder header files for ScalarIndex (#11482)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-09 16:29:04 +08:00
Cai Yudong 64b47ee4b3
Reorder header files for segcore/reduce_c.h (#11481)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-09 16:27:20 +08:00
Cai Yudong ba49490b04
Reorder header files for segcore/reduce_c.cpp (#11480)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-09 16:25:32 +08:00
Bingyi Sun 50791765d5
Add GetCompactionStateWithPlans rpc interface in milvus.proto (#11491)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 15:47:00 +08:00
Cai Yudong dae65640a7
Remove redundant header file in segcore/Record.h (#11478)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-09 15:03:09 +08:00
Bingyi Sun c3f0c5a3ff
Add compaction interfaces in proxy (#11431)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 14:47:02 +08:00
Cai Yudong 14c37058e3
Rename simd configuration valid values for better readability (#11410)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 22:07:05 +08:00
Cai Yudong caf3a2405d
Update KnowhereException (#11425)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 22:05:05 +08:00
Cai Yudong feb7f47faa
Reorder header files for segcore/plan_c.h (#11405)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 16:11:16 +08:00
Cai Yudong f609f3f1c8
Reorder header files for segcore/plan_c.cpp (#11404)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 16:09:26 +08:00
Cai Yudong 315aa0aff9
Merge GetResultData and ResetResultData into ReduceResultData (#11396)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-08 15:58:58 +08:00
bigsheeper 38375ee1d3
Add LoadBalance (#9945)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 16:54:59 +08:00
Cai Yudong db2a0a3bd3
Fix reduce panic (#11325)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-05 18:17:00 +08:00
godchen 09f8fa1040
Add query coord watch delta channel (#11218)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
xige-16 b567a8e5b5
Add SystemInfo msgType for getMetricRequest (#11151)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-04 10:58:11 +08:00
Cai Yudong f25def79ed
Add debug logs for search results handling (#11186)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 19:12:10 +08:00
Ji Bin 68d6839ab0
Improvements: Some adaptation for gcc-10 (#7853)
Support windows compile with MSYS (partial). This part including:

- CMakeLists.txt using CMAKE_SHARED_LIBRARY_SUFFIX instead .so
- Replace finite() with std::isfinite()
  ref: https://github.com/facebookresearch/faiss/pull/1341
- Replace bzero (deprecated in POSIX 2001) with memset.
  ref: https://github.com/facebookresearch/faiss/pull/1340
- Some int types match.

Signed-off-by: Ji Bin <matrixji@live.com>
2021-11-03 16:00:16 +08:00
zhenshan.cao cd79fd07c4
Fix timetravel bug on sealed segment (#11152)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 12:40:12 +08:00
Cai Yudong e059c99ada
Reorder header files for segcore/load_index_c.h (#11143)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 12:16:12 +08:00
Cai Yudong 9531fc5adf
Reorder header files for segcore/load_index_c.cpp (#11140)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 11:46:12 +08:00
Cai Yudong 40d254d09c
Reorder header files for segcore/InsertRecord.h (#11139)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 11:42:12 +08:00
Cai Yudong 885e5f4210
Remove redundant empty lines (#11138)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 11:38:15 +08:00
Cai Yudong dca0f1a463
Reorder header files for segcore/DeletedRecord.h (#11064)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 14:16:31 +08:00
Cai Yudong 93339c7f49
Reorder header files for segcore/FieldIndexing.h (#11067)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 11:14:33 +08:00
Cai Yudong 5397449f2a
Reorder header files for segcore/FieldIndexing.cpp (#11066)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 11:06:30 +08:00
Cai Yudong 623a31ab42
Reorder header files for segcore/ConcurrentVector.h (#11063)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 11:02:28 +08:00
Cai Yudong 6d5755998b
Reorder header files for segcore/Collection.h (#11059)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 10:46:33 +08:00
Cai Yudong ca936affac
Reorder header files for segcore/AckResponder.h (#11058)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 10:44:34 +08:00
Cai Yudong 4241326524
Update test API CheckSearchResultDuplicate (#11019)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 18:31:59 +08:00
yukun d8044299a0
Add uids and seg_offsets check in segcore (#10983)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-01 15:21:52 +08:00
Cai Yudong da0cb4a702
Use primary key only to check search result duplicate (#10949)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 10:06:03 +08:00
yukun 8153beffb2
[skip ci]Remove unused code in segcore (#10905)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-29 17:26:44 +08:00
yukun 64d5584670
[skip ci]Format segcore comments (#10904)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-29 17:24:51 +08:00
groot 57783827fb
Add cpp coverage (#10801)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-28 18:54:35 +08:00
yukun 36e19ab9cd
[skip ci]Format segcore code (#10815)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-28 17:22:28 +08:00
yukun 1cfafb9ee0
[skip ci]Remove unused code in segcore Search (#10814)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-28 17:20:34 +08:00
yukun b76c526907
[skip ci]Remove unused code in segcore (#10813)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-28 17:18:41 +08:00
Cai Yudong 4186e785ab
Optimize GetResultData in reduce_c.cpp (#10797)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-28 14:24:22 +08:00
Cai Yudong 5ad4cdda25
Clean search result duplicates removal debug log (#10769)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-27 20:02:26 +08:00
xige-16 80215eb2f0
Retruen segment state when get query segment info (#10730)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-27 19:28:21 +08:00
yukun 5cd935729c
Fix bitmap merge in segcore (#10711)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-27 14:34:31 +08:00
Cai Yudong 07fe3758c4
Remove core/src/utils/Log.h (#10675)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 19:34:22 +08:00
Cai Yudong 492dd1a66f
Remove redundant file (#10674)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 19:32:33 +08:00
Cai Yudong 403b41084f
Remove redundant head files for SegmentGrowingImpl.cpp (#10672)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 19:30:44 +08:00
yukun 471ddb07b2
Decide the final offset when repeated keys (#10671)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 19:28:52 +08:00
Cai Yudong 1227b9ebae
Rename utils/tools.h to utils/Utils.h (#10665)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 17:28:23 +08:00
Cai Yudong fa01a888a0
Remove redundant files under internal/core (#10658)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 17:26:30 +08:00
Cai Yudong 04d34bfcd7
Remove redundant code (#10635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:12:21 +08:00
Cai Yudong 4cd83e78ed
Reorder header files for segcore/Collection.cpp (#10634)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:10:30 +08:00
Cai Yudong 06dad68f91
Add common/Consts.h (#10631)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:08:18 +08:00
godchen 6a0a5cf274
Add delete request hash values proto (#10601)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 21:20:44 +08:00
yukun 6c13008dc3
Fix sealed segment get deleted bitmap assert (#10572)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 21:18:47 +08:00
yukun b8fd695838
Fix duplicate delete bug in growing segment (#10570)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:15:49 +08:00
Cai Yudong e4909c1c0b
Optimize segcore API GetResultData (#10548)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 17:53:20 +08:00
Cai Yudong be57e8fdd8
Remove redundant code (#10343)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 14:27:12 +08:00
yukun 7acb48919b
Add Delete func in Segcore SegmentSealed (#10501)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-24 14:19:10 +08:00
yukun bc083950a8
Add delete in segcore segment sealed (#10470)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 23:35:18 +08:00
yukun 0304a8014b
Support delete in query (#10452)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 20:05:12 +08:00
yukun f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 18:51:14 +08:00
groot 73c9ab43e0
Simplify cpp (#10413)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:33:11 +08:00
yukun fe1927c05d
Support delete in SegmentSealed (#10181)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 13:11:11 +08:00
Cai Yudong 824005115a
Remove duplicated search results in proxy (#10355)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-21 19:52:28 +08:00
groot a91486e966
Fix a compile error (#10358)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-21 19:10:37 +08:00
yukun ac581c5a38
Fix bitmap bug when delete without expression (#10325)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 11:01:07 +08:00
groot 525a85ef06
Remove unused code (#10285)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-20 19:21:18 +08:00
yukun e91eafd871
Fix Bitsetview bug in segcore (#10272)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-20 16:34:36 +08:00
Cai Yudong 983bd1d473
Reorder header files for LoadInfo.h (#10264)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 15:46:47 +08:00
Cai Yudong 597523bf40
Reorder header files for FieldMeta.h (#10263)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 15:44:41 +08:00
Cai Yudong 48648c818b
Remove duplicated search results in segcore reduce (#10117)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 15:40:49 +08:00
Cai Yudong ced29480cf
Format CGoHelper.h (#10261)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 14:56:35 +08:00
Cai Yudong 56f97aa07b
Move Log out of Milvus namespace (#10178)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 17:10:35 +08:00
yukun e108476601
Support delete in SegmentGrowing (#10154)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-19 11:54:34 +08:00
Cai Yudong 39bf58d8cb
Remove deprecated API get_offset_opt (#10150)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 11:46:34 +08:00
Cai Yudong 693220fe0a
Remove dummy structure EntityResult (#10149)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 11:28:34 +08:00
Cai Yudong eda9d550a8
Code clean for test_timestamp_index (#10148)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 11:10:34 +08:00
Cai Yudong d54f3426e8
Reorder header files for test_segcore (#10051)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:38:47 +08:00
Cai Yudong 027103b4f6
Reorder header files for test_span (#10053)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:10:57 +08:00
Cai Yudong 3e3f8b825a
Reorder header files for test_sealed (#10049)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:09:04 +08:00
Cai Yudong ffd67de9cb
Reorder header files for test_reduce (#9934)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 17:00:43 +08:00
Cai Yudong 356b7e36ba
Reorder header files for test_query (#9932)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 16:56:51 +08:00
Cai Yudong bb721f1cf4
Format internal/core/CMakeLists.txt (#9931)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 16:52:43 +08:00
XuanYang-cn ea7abf49c3
Fix protobuf compilation error (#9881)
resolves:#9876

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-14 18:14:32 +08:00
Cai Yudong 5a8aca01fd
Reorder header files for test_plan_proto (#9871)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 16:52:33 +08:00
Cai Yudong 8dbc3db393
Remove dummy test_naive (#9850)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 12:52:33 +08:00
Cai Yudong 30661321f2
Remove dummy test_interface (#9848)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 12:50:37 +08:00
Cai Yudong 937e59f6c3
Remove dummy test_load (#9847)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 11:06:39 +08:00
ZhiShen 6a770e5c38
Make knowhere compile independently (#7606)
Make knowhere compile independently

1. Make knowhere compile independently
    * Add gtest, arrow, and some other libraries to index.
    * Add cache, log and some other files to knowhere.
    * Add CMakeLists files to index's thirdparty.

2. Modified the compilation content of knowhere
    * Delete some content of compile library.
    * Add IMPORTED_GLOBAL property to faiss.

3.  Change the compilation location of some libraries
    * Make OpenBLas compiled in thirdpartycore.cmake.
    * Make faiss compiled in thirdparty/CMakeLists.

Change the content of knowhere/CMakeLists

1. Change easyloggingpp and nlohmann into index/thirdparty.
2. Change MILVUS_THIRDPARTY_SRC into KNOWHERE_THIRDPARTY_SRC.

Delete FindOpenBLAS

1. Delete Openblas.cmake.

2. The search task for openBlas is assigned to ThirdpartyCore.

3. Some changes were made to build.sh in index.

Fix the openBLas compilation problem

Delete the if-else in compilation of faiss;

Now when complie faiss, it will find the Openblas as we wish.

Fix some problem:

1. delete arrow

2. set openblas_source to AUTO

3. change a include_dir

4. delete MKL

5. delete the CMakeLists in index/utils,cache,log

Change variable build_test to knowhere_build_test in index/build.sh

Change the include location of  GNUInstallDirs

set CMAKE_INSTALL_LIBDIR

Resolves: milvus-io#5183
See also: milvus-io#6604

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-10-13 17:06:33 +08:00
yukun 6c88774624
Add get final filtered bitmap in SegmentGrowing (#9780)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 16:54:34 +08:00
Cai Yudong 92c7eb5a09
Code clean for test_interface (#9767)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 11:06:33 +08:00
Cai Yudong ca5e3e8644
Code clean for test_indexing (#9765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 11:00:39 +08:00
Cai Yudong 01db5dc6dd
Code clean for test_init (#9766)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 10:58:33 +08:00
Cai Yudong 2d8e86692a
Format test_expr.cpp (#9698)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:48:34 +08:00
Cai Yudong e790ba3e41
Reorder header files (#9700)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:44:33 +08:00
Cai Yudong 6f7031111a
Update header file (#9696)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:42:33 +08:00
Cai Yudong 9229d56c96
Clear redundant code line for test_bitmap (#9632)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 17:08:29 +08:00
Cai Yudong b8519416c0
Clear redundant code line (#9631)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 17:04:29 +08:00
Cai Yudong 4908b1c461
Update header file (#9625)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 16:35:52 +08:00
bigsheeper 3a4df03b70
Add SealedSegmentsChangeInfo and changeInfoMsg (#9479)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-09 14:45:00 +08:00
Xiangyu Wang e281b623d2
Fix compilation error of core on macOS (#9317)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-08 20:48:56 +08:00
elfisworking d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574)
Signed-off-by: elfisworking <zymustb@126.com>
2021-10-08 17:39:55 +08:00
Cai Yudong d18c3bc5fd
Add db_name for alias proto (#9010)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-01 21:40:21 +08:00
dragondriver a10f421c14
Get SIMD type used in faiss (#8849)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 20:50:19 +08:00
ZhiShen 0e767f0e1b
Change cmake version (#8666)
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-28 14:00:03 +08:00
yukun ff3573c921
Add segcore error messages (#8681)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-27 20:30:23 +08:00
congqixia c17f845ab3
Add StartPositions fields in proto (#8657)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-27 14:13:58 +08:00
zhenshan.cao b71bffe26f
Replace ChannelID with ShardName in DML Request (#8539)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-27 10:01:59 +08:00
Cai Yudong 3e487bde0b
Clean test_concurrent_vector.cpp (#8532)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-25 12:13:56 +08:00
yukun 1913ec9e94
Add segcore error messages (#8515)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-24 22:17:56 +08:00
groot 985e63cbf2
Reduce cpp unittest time cost (#8424)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 21:50:11 +08:00
yukun 3c77eda7ac
Add error msgs in segcore (#8410)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 18:59:54 +08:00
groot af1bdaf202
Reduce cpp unittest time cost (#8409)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 17:55:54 +08:00
groot 8b81ceb5d7
Reduce cpp unittest time cost (#8403)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 16:55:54 +08:00
groot b897ca5703
Fix unittest build problem (#8369)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 14:19:54 +08:00
cai.zhang 0d9ab7ab7d
Remove useless debug message in indexbuilder (#8303)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:37:53 +08:00
yukun c5beef16a9
Add error msgs in segcore visitors (#8306)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 18:07:54 +08:00
Cai Yudong 83ffa18c37
[skip ci] Update test_concurrent_vector (#8273)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:21:53 +08:00
Cai Yudong 07aa453270
[skip ci] Update test_segcore (#8270)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:19:53 +08:00
dragondriver 78fe530d87
Initialize the simd type when initialize an indexnode (#8276)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:05:59 +08:00
Cai Yudong c1e229cb7e
Add segcore logger (#8262)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 10:11:52 +08:00
groot b6e43e0439
Fix cpp code coverage bug (#8203)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 16:15:51 +08:00
yukun 82e48fb379
Add more error messages in segcore visitors (#8195)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 15:53:51 +08:00
Cai Yudong 2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 14:41:50 +08:00
Yusup ccb57ba4b2
add collection alias (#7255)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
zhenshan.cao 4c184921f0
Add comments and enchanme unittest for retrieve (#8114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 23:43:49 +08:00
zhenshan.cao 5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 20:11:49 +08:00
yukun 8b3893e030
Add more error messages in segcore (#8012)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-16 10:23:53 +08:00
yukun 9a6f2e618c
Change Assert to AssertInfo in SegmentGrowing (#7952)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 22:04:39 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 15:15:52 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 12:57:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:35:52 +08:00
Cai Yudong c16ab5b35c
Use better segcoe variable name (#7869)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:06:00 +08:00
yukun 80ae6b7d31
Change Assert to AssertInfo in SegmentSealedImpl (#7903)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 18:43:48 +08:00
Cai Yudong 4dc9a64f01
Improve segcore code readability (#7868)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 16:07:48 +08:00
Cai Yudong b5923ff27d
Update segcore unittest format (#7860)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 11:22:57 +08:00
Cai Yudong 74ac528095
Improve segcore (#7851)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 10:53:04 +08:00
yukun 5c997710ab
Change Assert() to AssertInfo() to return error messages (#7843)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 10:06:40 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-11 14:40:01 +08:00
groot 16a6afa9bd
Fix build version typo (#7639)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-10 11:10:00 +08:00
zhenshan.cao b0524adbd8
Support specified shard number when create collection (#7482)
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-08 15:00:00 +08:00
yukun a560aefc36
Fix search result is wrong when the term content in expression is not in order (#7557)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-08 11:49:59 +08:00
xige-16 468bef4478
Fix dataset's memory leak in knowWhere when search (#7527)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-07 14:25:59 +08:00
yukun 94272bba87
Support query by expression (#7386)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-03 17:12:55 +08:00
cai.zhang 880aa540e6
Fix bug for expression boundary (#7339)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-08-28 10:13:57 +08:00
groot 8701c477e2
Add delete api into proto (#7304)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-08-26 12:15:52 +08:00
xige-16 76066b5659
Fix IVF_FLAT index's wrong meta_data (#7167)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-19 14:26:11 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-18 10:12:10 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-17 10:06:11 +08:00
yukun 61bda45e35
Add ConfAdapter to check search (#6971)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 18:54:10 +08:00
yukun 671b2737d2
Remove RetrieveRequest and RetrieveTask (#6848)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 17:06:10 +08:00
Cai Yudong e771bda92f
optimize retrieve output vector code structure (#7102)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-14 11:18:10 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
Cai Yudong 6c75301c70
optimize search reduce logic (#7066)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 18:00:11 +08:00
Cai Yudong 85ea051ddc
change growing segment default value to -1 (#7054)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 12:32:07 +08:00
dragondriver d2767f920c
Fix index parameters check of RHNSWPQ (#6950)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-03 10:25:25 +08:00
xige-16 87c5a49d9a
Refactor showCollection/showPartition to get load state in memory (#6935)
* refactor showCollection/showPartition to get load state in memory

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update milvus.proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add show result log to debug

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix wrong err message

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update pymilvus-orm version

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix repeated load error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix status nil error

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-02 22:39:25 +08:00
cai.zhang d51fec6678
Enhance log when create index failed (#6871)
* Enhance log when create index failed

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for repeatedly drop index

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-29 14:47:22 +08:00
xaxys e43b43e7d8
Refactor `RangeExpr` & `CompareExpr` (#6786)
* Changed `RangeExpr` proto to `UnaryRangeExpr` & `BinaryRangeExpr`
Several unit test unpassed.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix bugs to pass unit test. Fix format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Remove debug information.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix format.
Remove debug information.
Unify variable name.
Add error information.
Remove `CompareExpr` test in `test_c_api.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix code format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Update `Plan.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>
2021-07-25 10:23:19 +08:00
dragondriver 2821c08560
Add unittests for metric_type: tanimoto (#6773)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-23 20:59:33 +08:00
FluorineDog aba21baf82
refactor expr executor to use single bitset (#6667)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-23 15:30:12 +08:00
dragondriver 67c1fdd2c0
Show/Describe collections/partitions with created timestamp (#6700)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-21 18:00:14 +08:00
Cai Yudong 744f2c7f51
optimize test_c_api.cpp (#6637)
* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* clean redundant file

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change DIM to const

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update reduce testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-20 17:13:21 +08:00
FluorineDog 234954931f
remove deprecated (#6623)
* remove deprecated

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix timeout

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-20 15:18:08 +08:00
dragondriver 99249a0224
Fix bug: override the compare function of SearchResultPair (#6628)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-20 14:38:11 +08:00
Cai Yudong a992dcf6a8
Support query return vector output field (#6570)
* improve code readibility

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add offset in RetrieveResults

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add VectorFieldInfo into Segment struct

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add new interface for query vector

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fill in field name in query result

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add FieldId into FieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add fillVectorOutputFieldsIfNeeded

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update data_codec_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add DeserializeFieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* realize query return vector output field

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable query vector case

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-16 17:19:55 +08:00
dragondriver 7f99d9d714
Loose the limit of dimension when searching on a binary vector field (#6503)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-14 14:33:54 +08:00
Cai Yudong 1c29b42434
change output_fields to out_fields_id for RetrieveRequest (#6506)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-14 13:11:54 +08:00
Cai Yudong 724f10b9a0
Unify the usage of query and search (#6467)
Unify the usage of query and search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-13 22:20:33 +08:00
dragondriver 25b8c37383
Fix 6421, split raw vectors to serveral smaller one (#6449)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-13 16:05:36 +08:00
xaxys e5f8a77a2d
Extend grammar of boolean expression (#6460)
* Extend grammar of boolean expression

Signed-off-by: xaxys <tpnnghd@163.com>
2021-07-13 14:37:03 +08:00
FluorineDog 99ed122d11
Remove Dead Code, use signed type (#6398)
* make type signed

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* remove dead code

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* remove code

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-09 18:25:11 +08:00
FluorineDog 2ff072ea7b
Use larger dim for binary test to avoid false positive test failed (#6416)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-09 18:12:40 +08:00
FluorineDog d972a0361d
Weaken debug message (#6324)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-08 15:50:57 +08:00
quicksilver 7d920e9c9c
Fix compile error on CentOS (#6359)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
shengjun.li a1ba9e9dcd
Fix comile on CentOS (#6334)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-07-07 12:34:02 +08:00
FluorineDog 97b1426666
fix benchmark, add support for primary key in schemaHelper (#6281)
* fix benchmark

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix tests

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-06 09:50:01 +08:00
Cai Yudong 21a9bcd844
Create default partition when receive CreateCollectionMsg (#6305)
* create default partition when create collection

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* adjust sleep time for unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-06 09:16:03 +08:00
shengjun.li 1f42b4ec9d
fix the case that knng is not full (#6308)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-07-05 17:26:07 +08:00
Cai Yudong bc8392eb1e
Add collectionID and partitionID into SegmentIndexInfo (#6289)
* add collectionID and partitionID into SegmentIndexInfo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add partID2SegID into meta table

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DropIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-03 20:00:40 +08:00
neza2017 111a24a49f
remove msgstream of segment info (#6280)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-03 14:36:18 +08:00
dragondriver 8dd2051a9a
Fix 5045, decrease the nb and nlist in unittest (#6282)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-02 18:20:14 +08:00
groot a364d7303b
Implement calculate vectors distance in server (#6219)
* calc distance stage 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 5

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 6

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code style

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-07-01 18:56:17 +08:00
FluorineDog bf8b2be4a7
Deprecate num_groups to simplify search API (#6230)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-01 10:32:15 +08:00
zhenshan.cao ff4c6c7ff4
Fix travel timestamp and guarantee timestamp (#6234)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-30 21:02:13 +08:00
FluorineDog b90b4f2058
renaming (#6192)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-30 10:18:26 +08:00
yukun b87baa108a
Add topks in searchResult (#6168)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-28 15:28:11 +08:00
yukun eb818d05ab
Remove vector fields from output fields (#6112)
* Remove vector fields from output fields

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add empty_collection error_code

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-25 16:52:11 +08:00
sunby 46f86a0354
Return sealed segments when calling flush (#6011)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-23 16:56:11 +08:00
yukun b2eb596c23
Change search result to columnBased and return target_entry (#5896)
* Change search result to columnBased and return target_entry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: fluorinedog <fluorinedog@gmail.com>

* synchronize the latest pymilvus-orm version

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change pymilvus-orm version to 40

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: fluorinedog <fluorinedog@gmail.com>
2021-06-21 20:18:13 +08:00
dragondriver 2642415bc3
Redefine the auto_id and primary_key (#5903)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-21 11:42:18 +08:00
zhenshan.cao 958280ebb8
Add support for time travel (#5897)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-21 10:42:10 +08:00
FluorineDog 255e3959af
support time travel (#5894)
* support time travel

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-19 17:38:11 +08:00
zhenshan.cao ebe5073749 Update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:56:09 +08:00
FluorineDog bec9f2c182
Split segcore and plan proto for future feature (#5767)
* Split segcore and plan proto for future feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-15 14:43:57 +08:00
bigsheeper cdbc6d2c94
Refactor query node and query service (#5751)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 12:41:40 +08:00
FluorineDog 006dae35c3
fix retrieve bug (#5727)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-11 00:06:55 +08:00
Xiangyu Wang 68f703f983
Add Query impl in proxynode (#5644)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-07 17:21:36 +08:00
shengjun.li 8ead67ef95
IVF_SQ8 and IVF_PQ cannot be built on multiple GPUs (#5624)
* IVF_SQ8 and IVF_PQ cannot be built on multiple GPUs

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* index created by std::make_shared

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-06-05 17:19:34 +08:00
FluorineDog 1ff4764ba6
Fix wrong primary key (#5604)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 18:35:36 +08:00
Xiangyu Wang afa5da7df0
Add query rpc into proto (#5592)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-04 12:02:34 +08:00
FluorineDog 9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 10:38:34 +08:00
dragondriver 99699b2021
Support to show collections which are loaded into memory (#5567)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 19:09:33 +08:00
dragondriver e76830ab09
Support column-based insert request in proxy (#5560)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 15:03:34 +08:00
Xiangyu Wang ca0993c274 Update OWNERS
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
FluorineDog b1a9aea6a6
support get entity by ids in segcore (#5456)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-28 10:39:30 +08:00
Xiangyu Wang 88b42304ef
Add dummy RPC (#5376)
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last. 
At this time, this is helpful for debugging.

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-25 06:44:43 +00:00
shengjun.li b688cc5f51
Improve IVF query on GPU when no entity deleted (#5359)
Not to call getListIndex() if bitset is empty.

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-05-24 07:38:56 +00:00
FluorineDog 3f42a9ed12
reduce unittest time (#5363)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-24 03:54:06 +00:00
sunby c1efa53779
Remove redundant fields in SegmentInfo and related structure (#5280)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 06:51:25 +00:00
yukun f18dfb4ff6
Add RetrieveTask implementation (#5313)
Resolves: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-20 07:02:31 +00:00
yukun a7bb701f73
Add Retrieve method grpc definition (#5294)
See also: #5253 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-19 10:45:15 +00:00
quicksilver 3db653f2d0
Update cpp thirdparty source URL (#5295)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Resolves: #5293
2021-05-19 09:39:29 +00:00
neza2017 d68ee3fbc2
query base on timeline (#5279)
query base on timeline, add timestamp on these queries:
- ShowCollections
- HasCollection
- DescribeCollection

Resolves: #5219

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-18 09:12:17 +00:00
Cai Yudong e8ceb37f81
Add ShardsNum when create collection (#5245)
Updata PhysicalChannelNames and VirtualChannelNames based
on ShardsNum when create collection, and update collVChan2Chan
map.

Resolves: #5240 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-17 11:15:01 +00:00
yukun ecaef24fea
Change should_not to must_not in dsl (#5131)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-07 11:52:24 +00:00
FluorineDog b1974aede2
Merge knowhere unittests (#5139)
Re-enable knowhere unittests and merge them all together. 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-07 11:50:13 +00:00
dragondriver b7977698a8
Change the codec style of expr plan from text to binary (#5129)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 11:27:17 +00:00
dragondriver e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118)
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 07:20:47 +00:00
FluorineDog 396b3f33e9
Support TermExpr, NotExpr, LogicalExpr (#5096)
1. Support Term, like `A in [1, 2, 3]`
2. Support Not, like `! A < 3`
3. Support logical combination, like `A < 3 && B > 5 or C == 0`

Type: Feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-04-30 07:19:52 +00:00
shengjun.li b46ae44087
Zero size allocation in StackDeviceMemory (#5100)
When the remaining space is empty, the zero size allocation will
get the pointer `end_`. However, `cudafree` the pointer `end_` will
cause to crash.

Fix: #5078 #4770 #4412 #4340 #3646

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-30 04:21:02 +00:00
FluorineDog 88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
godchen 060f7ca0d2
Add get index build progress proto (#5049)
Add get index build progress proto.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-27 07:46:45 +00:00
shengjun.li a3e4339027
improve rhnsw (#5059)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-27 06:17:52 +00:00
neza2017 262c484cec
the return struct of "DescribeIndex" should contain "filed_name" (#5055)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-27 02:30:55 +00:00
shengjun.li a2875f9d95
Update knowhere (#5006)
Import performance of ivf::train and hnsw, and fix bugs
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-23 18:03:49 +08:00
Xiangyu Wang 82ccd4cec0
Rename module (#4988)
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
xige-16 1165db75f6 Optimize search performance
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-19 19:30:36 +08:00
cai.zhang 9ccaff8005 Add copyright
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-19 19:28:11 +08:00
FluorineDog 43b39cc9c9 Fix memory leak, temp solution
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-19 16:39:23 +08:00
FluorineDog 6059558698 Add license files
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-19 11:16:16 +08:00
cai.zhang a54097708d Adjust the DropIndex logic of the indexservice
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-16 15:37:13 +08:00
FluorineDog ce7a5ea699 Support segcoreinit
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-16 14:02:49 +08:00
xige-16 22eda19bc4 Fix mem leak when load index
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-10 10:10:53 +08:00
XuanYang-cn 46d27e37d7 Skip install gtest when build with test
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-08 10:01:18 +08:00
FluorineDog 1446cd5453 Fix flat unsupported bug
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-07 10:39:35 +08:00
xige-16 a6f1de036b Optimize search performance in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-30 22:16:58 +08:00
FluorineDog f39dcdb8f3 Support error code in segcore
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-26 16:18:30 +08:00
dragondriver 9d062b54ee Add benchmark for indexbuilder, refactor test utils
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-23 18:44:57 +08:00
zhenshan.cao c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
dragondriver 7554b8afe7 Add default nbits when build ivf-pq index
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-19 16:37:13 +08:00
FluorineDog 2cec04ed90 Fix empty schema proto hack
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-17 11:35:28 +08:00
xige-16 8a5c039137 Fix search error when running single node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-12 19:23:06 +08:00
FluorineDog e33d0a797c Migrate knowhere to segcore
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-12 15:54:59 +08:00
godchen f3649f0419 Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
ThreadDao ca916a5c47 Add ci nightly
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-11 14:14:29 +08:00
xige-16 09ae985daa Fix wrong error code in master_service_test.go
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
neza2017 7b2d67242d Fix describe segment if index not exist
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 14:45:35 +08:00
FluorineDog af1900b42a Remove ConcurrentBitsetPtr in segcore
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-09 16:16:43 +08:00
quicksilver 455cc59dbb Update publish-test-images.yaml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
Cai Yudong c795cdbe2a Change minSegmentSizeToEnableIndex default to 1024
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-03-07 13:37:25 -06:00
neza2017 014c4fe8ce Add config of minSegmentSizeToEnableIndex
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-08 15:46:51 +08:00
neza2017 2835bcdc4e Update masterservice unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-05 20:41:34 +08:00
bigsheeper 447a15207e Add zap log to query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-05 09:21:35 +08:00
dragondriver 801396e3ef Disable register link logic, use proxy node directly
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-04 22:27:12 +08:00
FluorineDog ef98dab2a9 Support segcore config
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-04 17:09:48 +08:00
FluorineDog b7a00e30e2 Fix memory leak
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-01 11:14:51 +08:00
FluorineDog 66146223ca Support flat
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-27 12:46:37 +08:00
FluorineDog bf75c2fbb4 Fix bug (#1053)
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-25 17:56:43 +08:00
neza2017 d5631b09e8 Describe collection by id
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-25 16:08:56 +08:00
xige-16 4c491471ee Add release collection and release partition interface for query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-24 15:58:55 +08:00
zhenshan.cao 6b392cbe58 Fix memory leak
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 14:35:00 +08:00
xige-16 7a7a73e89c Fix high memory usage in pulsarTtStream
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-23 11:40:12 +08:00
FluorineDog 15dd17488e Support benchmark
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-23 10:47:21 +08:00
dragondriver 68518fec38 Fix memory leak in indexnode
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-22 18:33:40 +08:00
neza2017 1d3fdebcf4 Add drop index for proxy
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-20 15:38:44 +08:00
xige-16 f62078c027 Fix crash error when search
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-20 10:14:03 +08:00
sunby 5769c000a1 Find failed python tests and add skip mark "r0.3-test"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
bigsheeper d8f41db823 Fix search crash error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00