milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
18,623 Commits
145 Branches
120 Tags
580 MiB
Commit Graph

1284 Commits (58dbb7872a9224fece05476351741666bae4e658)

Author SHA1 Message Date
foxspy 31173727b2
growing segment index memory opt & get vector bugfix (#25272) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-07-05 00:04:25 +08:00
Enwei Jiao 816158e4af
Remove outdated searchplan (#25282) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-04 18:30:25 +08:00
sre-ci-robot df63e3a295
Update knowhere commit (#25308) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-07-04 14:12:26 +08:00
congqixia 549c4a0e1b
Enlarge integration test timeout (#25283) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-03 17:40:25 +08:00
cai.zhang 4fdbc5af89
Support search with default params(#24516) (#25255) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-03 17:00:24 +08:00
sre-ci-robot 595d04e112
Update knowhere commit (#25270) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-07-03 09:22:24 +08:00
sre-ci-robot d58f577ded
Update knowhere commit (#25247) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-30 15:20:23 +08:00
cai.zhang 7f3f18e71f
Fix program crash caused by incorrect use of noexcept modifier (#25194) (#25214) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-06-30 15:08:22 +08:00
sre-ci-robot b3594e8fdd
Update knowhere commit (#25229) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-29 15:50:22 +08:00
yihao.dai 37fe3393d1
Remove const to enable move semantics and improve schema util functions (#25193) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-29 11:04:22 +08:00
yah01 cb4b88d5cf
Refactor the column type (#25147) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-27 19:50:45 +08:00
Cai Yudong 23492fed99
Correct range search param check error msg (#25066) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-06-25 15:34:44 +08:00
xige-16 04082b3de2
Migrate the ability to upload and download binlog to cpp (#22984) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-25 14:38:44 +08:00
sre-ci-robot 4ac391db40
Update knowhere commit (#25086) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-25 10:42:44 +08:00
Enwei Jiao de78fe719d
Fix aws-c-http missing (#25055) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-21 15:58:42 +08:00
PowderLi 3f4356df10
fix the spelling of `field` (#25008) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-06-21 14:00:42 +08:00
zhagnlu a79fd1c5a2
Fix GetObject return null value bug in MacOs (#24959) (#25002) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-21 13:40:42 +08:00
sre-ci-robot a1ea9f6cf8
Update knowhere commit (#25019) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-21 03:32:42 +08:00
yah01 73b7cf5df4
Fix bool unary expression sometimes returns no data (#25016) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 16:38:41 +08:00
yah01 247f117096
Refine segcore code style (#24999) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 14:16:46 +08:00
Xiaofan af1d84e5e1
Support sync when cp is lagged (#24989) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-06-20 10:00:41 +08:00
sre-ci-robot 2176907220
Update knowhere commit (#24963) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-19 15:46:41 +08:00
Bingyi Sun cc56efb134
Fix build index performance downgrade (#24651) (#24708) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-06-19 10:50:47 +08:00
yah01 a413842e38
Fix deleted data is still visible (#24849) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-16 17:16:41 +08:00
Jiquan Long 8885fa2bc7
Fix BinaryArithOpEvalRange integer overflow case (#24943) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-16 17:10:39 +08:00
zhagnlu c5b1533fdc
Change segcore search_id from travelling all bits to select true bits(#24659) (#24800) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-16 16:48:44 +08:00
cqy123456 a519213316
Update knowhere version, update diskann api and generate cache nodes in build process (#24898) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-06-16 14:20:39 +08:00
congqixia cbfbc4e63a
Memset sigaction before using it (#24933) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-16 14:08:40 +08:00
Jiquan Long 26a6e1b946
Fix BinaryRange expression on integer overflow case (#24920) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-16 09:56:39 +08:00
aoiasd 4d8d34e370
Refine Rocksdb option (#24394) (#24503) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-06-15 15:12:39 +08:00
zhagnlu f3f3f8a849
Segcore retrieve by pk optimazation (#24659) (#24660) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-15 15:04:39 +08:00
Jiquan Long 7faf934f91
Fix UnaryRange expression on integer overflow case (#24893) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-15 14:06:39 +08:00
sre-ci-robot 7f7fe85592
Update knowhere commit (#24908) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-15 14:04:39 +08:00
zhagnlu f60b839127
Support element in json array in segcore part(#24677) (#24829) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-14 14:38:37 +08:00
sre-ci-robot ee2d458da4
Update knowhere commit (#24883) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-14 13:58:39 +08:00
Jiquan Long c6a6998ba7
Fix term expression on interger overflow case (#24867) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-14 11:44:38 +08:00
congqixia 561021ec5a
Refine sigpipe handling (#24872) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-14 10:10:38 +08:00
Cai Yudong 1b3c4b26f1
Optimize range search result sort in segcore (#24837) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-06-13 19:22:38 +08:00
Enwei Jiao e538540d0d
Fix aws-c-io not found (#24777) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-10 19:08:35 +08:00
sre-ci-robot 762d1e8681
Update knowhere commit (#24779) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-09 17:28:36 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yihao.dai 2086b4f75d
Add RBAC for FlushAll (#24751) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-08 20:28:35 +08:00
congqixia e729b504ab
Use SA_ONSTACK flag for SIGPIPE handler (#24688) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-08 15:50:35 +08:00
sre-ci-robot bc2112354d
Update knowhere commit (#24742) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-08 14:20:35 +08:00
sre-ci-robot affaf61d78
Update knowhere commit (#24706) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-07 19:44:42 +08:00
cai.zhang a6dbcaeb7a
Add proto field to support reverse in (#24678) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-06-07 17:24:36 +08:00
yah01 f40e22c78c
Add array_at method to get array from JSON (#24671) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-06 14:10:36 +08:00
xige-16 732fe54775
Support partition Key (#24047) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-06 10:24:34 +08:00
Cai Yudong 25aeee5fe6
Update knowhere commit (#24655) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-06-05 19:24:33 +08:00
Enwei Jiao 6b1712e07d
Fix aws-c-cal lib missing (#24610) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-02 14:56:32 +08:00
yihao.dai b0ce4cff83
Assign metric type in search request when user has not explicitly assigned (#24591) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-01 18:10:32 +08:00
sre-ci-robot 5caa654622
Update knowhere commit (#24552) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-01 13:44:35 +08:00
yah01 852e5ce904
Convert double to int if possible with term expression (#24530) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-30 22:03:28 +08:00
zhagnlu 0fe8342648
Support google cloud for C++ chunk manager (#21100) (#24418) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-05-29 01:05:28 +08:00
congqixia aad2e5d961
Fix compile error after knowhere change prometheus header path (#24434) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-26 15:15:26 +08:00
presburger eed5f87901
update lib arrow (#24397) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-05-26 09:41:27 +08:00
yah01 99b7a6882c
Fix the nested path lost when reuse the expression (#24417) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-25 21:35:27 +08:00
yah01 7721cc73f0
Perf: Avoid copying string/json when filter on them (#24381) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-25 13:13:26 +08:00
presburger 152acb3a76
fix fmt lib conflict when compile with raft suppport (#24266) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-05-24 13:05:26 +08:00
sre-ci-robot 7f96dd8526
Update knowhere commit (#24323) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-23 16:15:25 +08:00
cai.zhang d16e18fd34
Add output fields for search/query results (#24302) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-23 10:19:26 +08:00
yah01 6da8853756
Fix the JSON parser always parse all documents (#24290) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 15:49:27 +08:00
sre-ci-robot 785fe4d543
Update knowhere commit (#24288) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-22 15:29:26 +08:00
cai.zhang ce67d024ed
Fill is_dynamic flag for output field data (#24283) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-22 14:01:25 +08:00
yah01 ceda0ed598
Optimize the performance of filter by JSON field (#24268) 
- Construct JSON pointer only once
- Avoid copying nested path for each row

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 00:47:25 +08:00
yihao.dai 45aa9779e0
Retrieve segments concurrently (#24245) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-19 18:19:24 +08:00
yah01 c75e7a5d05
Fix failed to compare int value with double value (#24229) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-19 12:57:23 +08:00
Jiquan Long bd343550a5
Support to manage connections (#24224) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-19 12:51:23 +08:00
Cai Yudong b1afd3ea2f
Update knowhere commit to fix BIN_IVF_FLAT upgrade (#24187) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-05-18 17:57:23 +08:00
congqixia e6eb477074
Fix unsupported datatype assertion when query json field (#24214) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-18 15:15:23 +08:00
cai.zhang 008285f849
Support dynamic schema for create collection (#24176) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-18 09:33:24 +08:00
Enwei Jiao 8bfb42827e
Fix aws-c-sdkutils (#24085) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-13 13:47:20 +08:00
zhagnlu 113f9a0ebc
Support SIMD of several Expr (#23715) (#23717) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-05-12 14:11:20 +08:00
Cai Yudong 58192f55f6
Update knowhere version for new GetVectorByIds interface (#24034) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-05-11 18:05:20 +08:00
sre-ci-robot b692f90be9
Update knowhere commit (#24032) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-11 15:41:21 +08:00
Enwei Jiao 2969c80c6c
Change aws-c-compression version (#24006) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-10 15:55:19 +08:00
cai.zhang 9715a850fa
Support expr with json field (#23804) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-10 10:19:19 +08:00
aoiasd 6415ee8cd9
Use boost 1.79 to avoid queue memory leak (#23977) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-10 10:01:19 +08:00
sre-ci-robot a86332b2d7
Update knowhere commit (#23941) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-08 14:02:40 +08:00
sre-ci-robot 8ffa8a28fa
Update knowhere commit (#23874) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-06 14:18:39 +08:00
cai.zhang c80d8f82ce
Reduce memory usage for diskann index (#23600) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-06 10:32:39 +08:00
Enwei Jiao e172f3e8dc
Fix dependency conflict (#23847) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-04 19:46:38 +08:00
yah01 62eea5286f
Support to filter with json expr (#23739) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-30 20:36:39 +08:00
Cai Yudong 028054ee0b
Update knowhere version (#23769) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-29 10:06:38 +08:00
Enwei Jiao 66a5efeb3d
Fix load failed with DiskANN (#23760) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-27 16:56:35 +08:00
sre-ci-robot e988256467
Update knowhere commit (#23757) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-04-27 14:44:36 +08:00
sre-ci-robot 8d3007b479
Update knowhere commit (#23727) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-04-27 09:20:43 +08:00
yah01 0d3fcd5d16
Add method to access nested field at once (#23720) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-26 14:16:34 +08:00
yah01 60fdd7e4f4
Introduce simdjson (#23644) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-26 10:30:34 +08:00
foxspy 6f4ed517de
add growing segment index (#23615) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-04-26 10:14:41 +08:00
yah01 e23af6406f
Add nested path for accessing json fields (#23651) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-24 17:14:34 +08:00
wayblink b7cb34b966
Add blank GetIndexStatistics interface (#23610) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-04-23 14:50:32 +08:00
yihao.dai 092d743917
Add support for getting vectors by ids (#23450) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-23 09:00:32 +08:00
sre-ci-robot ccba1334dd
Update knowhere commit (#23595) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-04-21 15:34:31 +08:00
Enwei Jiao 2ced6660e2
Simplify makefile (#23583) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-21 14:16:33 +08:00
yah01 546080dcdd
Support to retrieve json (#23563) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-21 11:46:32 +08:00
yah01 aa2985490c
Retrieve page size by getpagesize() (#23561) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 12:36:30 +08:00
Enwei Jiao 967a97b9bd
Support json & array types (#23408) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 11:32:31 +08:00
Cai Yudong 2725d38b9e
Add COSINE metric type (#23350) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-20 10:20:31 +08:00
Enwei Jiao f14c221123
Revert "Opt compile time for Mac (#23453)" (#23533) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-19 16:52:30 +08:00
Enwei Jiao e9dcba3050
Opt compile time for Mac (#23453) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-19 10:24:30 +08:00
yah01 5aa0ddf77b
Refine field storage of sealed segment (#23464) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-18 11:24:30 +08:00
Bennu f63d52944f
Update knowhere version from main to commit_id (#23437) 
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
 2023-04-17 16:32:33 +08:00
cqy123456 7ff6a3a246
Set query node thread pool size in milvus.yaml (#23286) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-04-17 10:44:29 +08:00
Enwei Jiao 288582b2d9
Optimize mac build time (#23390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-14 17:56:29 +08:00
congqixia 03a4f60b6e
Fix knowhere cpp header files name (#23330) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-10 20:00:30 +08:00
Cai Yudong 55202ce7d9
Support show knowhere prometheus metrics (#23102) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2023-04-07 15:34:29 +08:00
Cai Yudong 5f4673fd16
Optimize unittest to save runtime (#23248) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-07 14:20:29 +08:00
congqixia 4a53018e5f
Remove legacy annoy_inner_error (#23220) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-04 18:08:24 +08:00
Cai Yudong ef63e64ded
Remove ANNOY index type (#23189) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-04 16:30:27 +08:00
Enwei Jiao 4d2e379b09
Add prometheus-cpp (#23199) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-03 19:22:23 +08:00
yihao.dai a182594bf5
Add FlushAll support (#22942) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-30 11:28:25 +08:00
Enwei Jiao 50dab2d394
Add tracing for retrieve (#23033) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-29 18:10:02 +08:00
zhenshan.cao d55c860383
Align the maximum dim of the diskann index and collection (#23039) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-03-28 00:06:00 +08:00
Enwei Jiao ef57ba3bac
Remove easylogging and replace by GLog (#22979) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-27 18:22:02 +08:00
yah01 081572d31c
Refactor QueryNode (#21625) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-27 00:42:00 +08:00
Cai Yudong 8aebc6f3b7
Remove faiss GPU index support (#22966) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-24 17:53:58 +08:00
Jiquan Long ef93e24da7
Fix cpp lint (#22955) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-24 11:23:59 +08:00
Cai Yudong 0e9a4478e3
Remove useless index mode (#22934) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-23 21:39:59 +08:00
smellthemoon af458017f4
Add some locks when write (#22938) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-23 15:57:57 +08:00
Enwei Jiao fd974df09f
OTEL integration in cpp (#22175) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-21 16:31:57 +08:00
yah01 9efebb3df7
Optimize load segment, make load fields concurrent (#22856) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-21 16:27:57 +08:00
zhagnlu 7c633e9b9d
Support aliyun OSS for chunk manager (#22663) (#22842) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-03-20 14:45:57 +08:00
yah01 3202eb0d9f
Optimize rounding distances, avoid promoting to double (#22846) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 14:09:56 +08:00
xige-16 9aa99aedbb
[Cherry-Pick] Remove arrow uasge in FieldData (#22726) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-03-20 10:41:56 +08:00
yah01 005d178a0e
Optimize performance of insert & query & search (#22829) 
- Reduce 1x copy of inserting int8/int16 into growing segment
- Reduce 1x copy of retrieving primary keys
- Reduce 1x copy of inserting/loading/deleting/filtering primary keys
- Reduce 1x copy of reducing string results

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:19:56 +08:00
yah01 20974711a1
Optimize range search for nq > 1 (#22831) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:17:56 +08:00
yah01 65c58b3e41
Optimize performance of querying on InsertRecord (#22838) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:13:56 +08:00
yah01 99f31dc37a
Fix data after travel timestamp is still visible (#22813) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-17 18:03:55 +08:00
Jiquan Long dff15c3488
Check dimension of inserted records (#22819) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-17 17:33:58 +08:00
presburger 5841a3707b
suppport for raft gpu (#22790) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-03-17 11:59:54 +08:00
yah01 ab1ac69712
Fix inserting into growing segment copies data (#22792) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-16 20:11:55 +08:00
Jiquan Long 8139106b51
Feat: count entities by expression (#22765) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-16 19:31:55 +08:00
Cai Yudong ab3cbdfc61
Partial change to prepare for GPU index type support (#22591) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-14 23:21:56 +08:00
yah01 a4031da634
Refine string parameters, avoid coping or deref (#22708) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 17:53:53 +08:00
yah01 8f3d6e08df
Optimize the performance of matching prefix for string index (#22712) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 17:31:53 +08:00
yah01 7bc3309918
Replace NULL with nullptr (#22701) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 10:35:52 +08:00
Jiquan Long a36fefb009
Fix cpplint (#22657) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-10 09:47:54 +08:00
yah01 e4120d1671
Upgrade proto to add error code field of Status (#22656) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 18:49:51 +08:00
XuanYang-cn 955bc06165
Fix search binary pagination failure (#22477) 
See also: #22168

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-03-08 11:03:51 +08:00
smellthemoon c196c55381
Improve the assert information (#22578) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-06 14:25:50 +08:00
jaime d126f06946
Decouple mq module from internal proto definition (#22536) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-03-04 23:21:50 +08:00
smellthemoon 0dae20c938
Layer range search results (#22539) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-03 15:19:48 +08:00
yah01 bdd6bc7695
Re-format cpp code (#22513) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 15:55:49 +08:00
yah01 4d4bf99098
Fix DiskANN can't recovery after querynode reboots (#22488) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 10:17:48 +08:00
yah01 1ee10f3224
Refine the information while assertion failed (#22434) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 09:07:48 +08:00
cai.zhang 5cae49e28d
Store index files in slices to reduce memory peaks (#22369) (#22455) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-03-01 19:43:47 +08:00
yah01 7478e44911
Support using mmap to load data (#22052) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-01 18:07:49 +08:00
smellthemoon 8d05874ff9
Fix get index mode error (#22364) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-02-27 14:45:47 +08:00
smellthemoon cf999b68dd
Fix range search can not get status from knowhere (#22384) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-02-24 17:59:45 +08:00
smellthemoon 820d0bc060
Fix range search error (#22352) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-02-23 14:21:46 +08:00
yah01 3e9d497157
Avoid allocating a zero-bytes vector each search time (#22219) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-23 10:37:46 +08:00
SimFG 7e19a924b7
Add the rbac for the GetLoadingProgress and GetLoadState api (#22320) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-02-22 20:37:45 +08:00
smellthemoon 7a4dfcc72b
Add status error output (#22325) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-02-22 15:51:44 +08:00
smellthemoon 9e0ec15436
Support range search (#21652) 
Signed-off-by: smellthemoon <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
 2023-02-21 09:48:32 +08:00
Bennu ac6e879811
[skip e2e] fix etcd image for healthcheck (#22294) 
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
 2023-02-20 17:08:25 +08:00
Enwei Jiao b25b3ef431
Integreation with Velox (#22102) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-16 17:26:35 +08:00
yah01 187788059b
Fix double copy varchar field while loading (#22114) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-16 17:16:35 +08:00
xige-16 8ec5ba13dc
Fix search failed on disk index when search_list equal to limit (#21113) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-02-16 11:02:34 +08:00
Cai Yudong 68f146d5df
Show knowhere version when system up (#22172) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-02-14 19:04:34 +08:00
presburger 9950cacd10
support knowhere 2.0 (#21857) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-02-10 14:24:32 +08:00
wei liu d078441522
support rg api rbac (#22097) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-02-10 10:54:33 +08:00
liliu-z 915503de0b
Upgrade knowhere to 1.3.8 (#22087) 
Signed-off-by: Li Liu <li.liu@zilliz.com>
 2023-02-09 18:58:32 +08:00
Cai Yudong fc1d2d18cf
Optimize knowhere CMakeLists.txt (#22000) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2023-02-07 16:12:04 +08:00
yah01 73ce87dfe5
Fix reduce decreasing recall (#21981) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-06 11:23:53 +08:00
zhenshan.cao 5316743a00
Reduce memory usage of scalar index (#21970) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-02-03 19:01:53 +08:00
Enwei Jiao 6d05f102c1
Upgrade boost to 1.81 (#21954) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-03 17:21:53 +08:00
yah01 bdcff5b921
Avoid counting all bits to improve query performance (#21909) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-01 18:49:51 +08:00
Cai Yudong e3d1624e97
Handle distance Inf correctly (#21828) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2023-02-01 14:59:51 +08:00
yah01 61c2f29ab3
Fix miss to throw exception when failed to create dir (#21886) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-01-31 13:49:50 +08:00
wei liu 73c44d4b29
resource group impl (#21609) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-01-30 10:19:48 +08:00
congqixia 0480719e1a
Fix useasan format not correct (#21829) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-28 11:43:47 +08:00
jaime 1dcd9eeb79
Support rename collection (#21693) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-01-19 14:13:43 +08:00
presburger e64f55cd27
downgrade curl for compiled on aarch64 platform (#21739) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-01-17 14:53:42 +08:00
jaime 81326ca0a1
[skip e2e]Fix cpp lint errors (#21750) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-01-17 09:43:42 +08:00
Xiaofan e7f947ed0a
Check ScalarIndex deserialization (#21724) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-16 17:29:43 +08:00
yah01 836773f1a0
Optimize performance of reducing segments (#21722) 
- Improve the performance of reducing from O(knlogn) to O(nlogk)

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-01-16 15:25:42 +08:00
Enwei Jiao 90d9e165d4
Fix some configs not shown (#21653) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-13 15:31:41 +08:00
Enwei Jiao 564173dcbc
Upgrade protobuf to 3.21.9 (#21679) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-13 14:05:41 +08:00
Enwei Jiao 49f53003e9
upgrade libcurl to fix mac build failed (#21684) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-12 19:03:40 +08:00
wei liu c67070ab1f
add resource group interface (#21676) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-01-12 18:31:41 +08:00
bigsheeper 79535931ab
Return error code when deny to read/write (#21561) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-01-06 14:31:37 +08:00
yah01 e8e2696430
avoid checking search params many times (#21516) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-01-06 13:15:35 +08:00
jaime 58b79eb74c
Add based on timetravel GC for snapshot KV (#21417) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-01-04 21:37:35 +08:00
smellthemoon bf3c02155a
Support update (#20875) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-01-04 17:21:36 +08:00
bigsheeper c187de7754
Show trigger reason when deny to read/write (#21368) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-12-30 18:35:32 +08:00
Jiquan Long d7156812c1
Try using ASAN in ci ut (#21089) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-12-29 15:29:31 +08:00
Ten Thousand Leaves 30b86275ac
Make BulkInsert free DataNode workload when import segments are flushed (#21253) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-28 11:11:30 +08:00
smellthemoon 1e5cd9dc6e
Modify comment (#21362) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2022-12-26 15:27:30 +08:00
Enwei Jiao 77de8fc746
Fix boost compile error (#21374) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-26 09:57:29 +08:00
Enwei Jiao ae41a6583f
Fix compile on M1 (#21298) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-19 15:05:24 +08:00
jaime e05ac56283
Revert build arrow with Conan (#21258) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-12-16 18:27:24 +08:00
liliu-z 6188960e85
Upgrade Knowhere to 1.3.6 to fix bugs (#21240) 
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
 2022-12-15 12:15:22 +08:00
yah01 cc56d58052
Fix panic while concurrent releasing payload writer/reader (#21218) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-14 16:23:22 +08:00
SimFG 655db658c8
Empty implement of the `GetLoadState` api (#21205) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-14 10:23:22 +08:00
Enwei Jiao d553b5108e
Fix jemalloc.so not found (#21106) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-13 11:27:21 +08:00
liliu-z d326c385bb
Upgrade Knowhere to 1.3.5 to fix DiskANN aio issue (#21109) 
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
 2022-12-09 22:53:20 +08:00
Xiaofan e131915207
Support 64M Rpc Limit (#20845) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-12-07 10:07:18 +08:00
SimFG f8cff79804
Support the graceful stop for the query node (#20851) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-06 22:59:19 +08:00
liliu-z aecf2e4f4b
Upgrade knowhere to 1.3.4 (#20914) 
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
 2022-12-02 00:33:21 +08:00
xige-16 a20770c172
Delete logs that print sensitive information (#20889) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-12-01 10:35:16 +08:00
Cai Yudong 4c5ffc832c
Add param check for BruteForceSearch in segcore (#20838) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-11-30 14:53:15 +08:00
Jiquan Long 8d78d9943a
Fix term filtering failed on indexed scalar field (#20840) (#20882) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-11-30 10:05:15 +08:00
Enwei Jiao 9b61170bf0
Fix compile proto failed (#20820) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-28 09:47:14 +08:00
yah01 1eabfdb199
Avoid allocating and coping when fill column with default values (#20721) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-11-23 15:15:11 +08:00
Enwei Jiao 958e94f6f0
Use Conan as c++ package manager (#19920) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-23 10:39:11 +08:00
xige-16 34c88cea32
Fix GetDiskUsedSize not work (#20474) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-11-21 17:47:17 +08:00
xige-16 15badd0263
Fix cache disk index error (#20419) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-11-21 17:45:23 +08:00
smellthemoon f5ab719f21
timestamp decided if the pks were the same (#20166) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2022-11-21 10:55:10 +08:00
liliu-z 0ae4e5265f
Optimize some low efficient code (#20529) 
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
 2022-11-14 21:05:07 +08:00
liliu-z 174310a14e
Use all() api for bitset check (#20462) 
Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>

Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
 2022-11-10 16:15:05 +08:00
liliu-z 0dc659a04c
Upgrade Knowhere to 1.3.3 to fix potential bugs (#20434) 
Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>

Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
 2022-11-09 20:19:04 +08:00
Ten Thousand Leaves 3d25a8dc03
Improve panic error readability (#20339) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-11-08 15:37:03 +08:00
xige-16 4a66965df4
Delete RAW_DATA copy when load IVF_FLAT index data (#20274) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-11-05 17:33:05 +08:00
zhagnlu 39212bc04c
Fix get cpu num for segcore (#20120) (#20307) 
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
 2022-11-03 19:29:36 +08:00
zhagnlu cb2591d1fe
Parallel operations of disk-ann file manager (#20120) (#20122) 
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
 2022-11-03 14:39:40 +08:00
bigsheeper 37dce8a660
Make s3 client creation thread safe, prevent crashing (#20200) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-10-31 17:09:33 +08:00
xige-16 14968685a2
Limit disk index search list range (#20104) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-26 21:03:31 +08:00
XuanYang-cn c24244240e
Fix insert search concurrency problem (#20065) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-10-26 18:57:36 +08:00
xige-16 89a9b6fda0
Init storage config's SSL and IAM config (#20082) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-26 16:07:30 +08:00
Jiquan Long 377cd210c2
Make knowhere use segcore's cmake build type (#20041) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-10-25 14:17:37 +08:00
xige-16 32ba4fafb8
Delete Creating bucket when create core/minioChunkManager (#20049) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-25 14:15:30 +08:00
Enwei Jiao 4e5d1c2e5f
Add log to debug bitset (#19982) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-10-24 10:09:28 +08:00
zhagnlu 05bbb12d30
Skip build aws sdk when not need diskann (#19965) (#19966) 
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
 2022-10-21 18:35:29 +08:00
liliu-z ce8e4d17b3
Fix mis-copy of chunk in make_with_timestamps (#19970) 
Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>

Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
 2022-10-21 16:35:29 +08:00
yah01 96cf74d53a
Add more panic info (#19922) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-10-20 13:33:27 +08:00
zhagnlu 02a8a07322
Fix BucketExists bug in minio chunk manager (#19548) (#19854) 
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
 2022-10-20 10:23:27 +08:00
xige-16 158787811e
Move assemble/disassemble func to core (#19420) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-16 21:17:25 +08:00
SimFG a55f739608
Separate public proto files (#19782) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-10-16 20:49:27 +08:00
xige-16 a1db9038fb
Move disk index params to config file (#19714) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-14 17:51:24 +08:00
xige-16 8c9c1672ae
Assign different storage config for indexes (#19517) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-14 14:45:23 +08:00
congqixia 089912baa7
Fix segcore unit test name (#19783) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-10-14 14:29:24 +08:00
congqixia a20d83bccd
Assemble RAW_DATA files before storing into index.raw_data (#19771) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-10-14 12:03:24 +08:00
mumon b48c37cb44
Fix typo in core (#19661) 
Signed-off-by: Ziyu Wang <15871035978@163.com>

Signed-off-by: Ziyu Wang <15871035978@163.com>
 2022-10-12 17:05:23 +08:00
jaime 31db01b6ae
Support TTL for collection level (#19383) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-10 20:31:22 +08:00
wayblink 85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface (#19594) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-10-10 15:55:22 +08:00
xige-16 49daee2e17
Fix lost disk index data (#19636) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-10-09 14:36:58 +08:00
congqixia 8c1c8000ac
Add TargetID in MsgBase and querynode v2 API check (#19627) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-10-08 20:26:57 +08:00
liliu-z faa9d2176a
Upgrade Knowhere to 1.3.2 to support large dim in DiskANN (#19531) 
Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>

Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
 2022-09-29 19:40:55 +08:00
aoiasd a8cabbfaa9
Fix offset in search should not equal to insert barrier (#19522) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-09-28 21:04:54 +08:00
Ten Thousand Leaves b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-09-26 18:06:54 +08:00
Cai Yudong 87d78a4a85
Ignore cases when comparing metric type in segcore (#19437) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-09-26 17:58:52 +08:00
aoiasd 2b58bd5c0a
Optimize large memory usage of InsertRecord by using vector instead of unordered_map if InsertRecord used in sealed segment (#19245) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-09-23 17:08:51 +08:00
xige-16 d4bc00423c
Fix start milvus failed on macos (#19394) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-09-23 16:54:50 +08:00
SimFG 68a257458b
Implement the `hook` interceptor (#19294) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-23 09:50:52 +08:00
xige-16 428840178c
Support diskann index for vector field (#19093) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-09-21 20:16:51 +08:00
Jenny Li d8b11121a8
Decrease build time by removing compiling openblas (#19207) 
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
 2022-09-16 17:46:47 +08:00
SimFG d7f38a803d
Separate some proto files (#19218) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-16 16:56:49 +08:00
aoiasd 58d3a49b62
Optimize large memory usage of Variant used in InsertRecord (#19197) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-09-16 10:52:47 +08:00
bigsheeper 5cdd6ca251
Add quotaCenter, rateLimiter and rateCollector (#18636) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-09-16 09:56:47 +08:00