milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
17,544 Commits
143 Branches
117 Tags
568 MiB
Commit Graph

1106 Commits (32827f538a8fa9c08cd8c71879e90bea2ad06653)

Author SHA1 Message Date
Jiquan Long 26a6e1b946
Fix BinaryRange expression on integer overflow case (#24920) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-16 09:56:39 +08:00
aoiasd 4d8d34e370
Refine Rocksdb option (#24394) (#24503) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-06-15 15:12:39 +08:00
zhagnlu f3f3f8a849
Segcore retrieve by pk optimazation (#24659) (#24660) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-15 15:04:39 +08:00
Jiquan Long 7faf934f91
Fix UnaryRange expression on integer overflow case (#24893) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-15 14:06:39 +08:00
sre-ci-robot 7f7fe85592
Update knowhere commit (#24908) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-15 14:04:39 +08:00
zhagnlu f60b839127
Support element in json array in segcore part(#24677) (#24829) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-14 14:38:37 +08:00
sre-ci-robot ee2d458da4
Update knowhere commit (#24883) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-14 13:58:39 +08:00
Jiquan Long c6a6998ba7
Fix term expression on interger overflow case (#24867) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-14 11:44:38 +08:00
congqixia 561021ec5a
Refine sigpipe handling (#24872) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-14 10:10:38 +08:00
Cai Yudong 1b3c4b26f1
Optimize range search result sort in segcore (#24837) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-06-13 19:22:38 +08:00
Enwei Jiao e538540d0d
Fix aws-c-io not found (#24777) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-10 19:08:35 +08:00
sre-ci-robot 762d1e8681
Update knowhere commit (#24779) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-09 17:28:36 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yihao.dai 2086b4f75d
Add RBAC for FlushAll (#24751) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-08 20:28:35 +08:00
congqixia e729b504ab
Use SA_ONSTACK flag for SIGPIPE handler (#24688) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-08 15:50:35 +08:00
sre-ci-robot bc2112354d
Update knowhere commit (#24742) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-08 14:20:35 +08:00
sre-ci-robot affaf61d78
Update knowhere commit (#24706) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-07 19:44:42 +08:00
cai.zhang a6dbcaeb7a
Add proto field to support reverse in (#24678) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-06-07 17:24:36 +08:00
yah01 f40e22c78c
Add array_at method to get array from JSON (#24671) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-06 14:10:36 +08:00
xige-16 732fe54775
Support partition Key (#24047) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-06 10:24:34 +08:00
Cai Yudong 25aeee5fe6
Update knowhere commit (#24655) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-06-05 19:24:33 +08:00
Enwei Jiao 6b1712e07d
Fix aws-c-cal lib missing (#24610) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-02 14:56:32 +08:00
yihao.dai b0ce4cff83
Assign metric type in search request when user has not explicitly assigned (#24591) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-01 18:10:32 +08:00
sre-ci-robot 5caa654622
Update knowhere commit (#24552) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-01 13:44:35 +08:00
yah01 852e5ce904
Convert double to int if possible with term expression (#24530) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-30 22:03:28 +08:00
zhagnlu 0fe8342648
Support google cloud for C++ chunk manager (#21100) (#24418) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-05-29 01:05:28 +08:00
congqixia aad2e5d961
Fix compile error after knowhere change prometheus header path (#24434) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-26 15:15:26 +08:00
presburger eed5f87901
update lib arrow (#24397) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-05-26 09:41:27 +08:00
yah01 99b7a6882c
Fix the nested path lost when reuse the expression (#24417) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-25 21:35:27 +08:00
yah01 7721cc73f0
Perf: Avoid copying string/json when filter on them (#24381) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-25 13:13:26 +08:00
presburger 152acb3a76
fix fmt lib conflict when compile with raft suppport (#24266) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-05-24 13:05:26 +08:00
sre-ci-robot 7f96dd8526
Update knowhere commit (#24323) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-23 16:15:25 +08:00
cai.zhang d16e18fd34
Add output fields for search/query results (#24302) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-23 10:19:26 +08:00
yah01 6da8853756
Fix the JSON parser always parse all documents (#24290) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 15:49:27 +08:00
sre-ci-robot 785fe4d543
Update knowhere commit (#24288) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-22 15:29:26 +08:00
cai.zhang ce67d024ed
Fill is_dynamic flag for output field data (#24283) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-22 14:01:25 +08:00
yah01 ceda0ed598
Optimize the performance of filter by JSON field (#24268) 
- Construct JSON pointer only once
- Avoid copying nested path for each row

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 00:47:25 +08:00
yihao.dai 45aa9779e0
Retrieve segments concurrently (#24245) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-19 18:19:24 +08:00
yah01 c75e7a5d05
Fix failed to compare int value with double value (#24229) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-19 12:57:23 +08:00
Jiquan Long bd343550a5
Support to manage connections (#24224) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-19 12:51:23 +08:00
Cai Yudong b1afd3ea2f
Update knowhere commit to fix BIN_IVF_FLAT upgrade (#24187) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-05-18 17:57:23 +08:00
congqixia e6eb477074
Fix unsupported datatype assertion when query json field (#24214) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-18 15:15:23 +08:00
cai.zhang 008285f849
Support dynamic schema for create collection (#24176) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-18 09:33:24 +08:00
Enwei Jiao 8bfb42827e
Fix aws-c-sdkutils (#24085) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-13 13:47:20 +08:00
zhagnlu 113f9a0ebc
Support SIMD of several Expr (#23715) (#23717) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-05-12 14:11:20 +08:00
Cai Yudong 58192f55f6
Update knowhere version for new GetVectorByIds interface (#24034) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-05-11 18:05:20 +08:00
sre-ci-robot b692f90be9
Update knowhere commit (#24032) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-11 15:41:21 +08:00
Enwei Jiao 2969c80c6c
Change aws-c-compression version (#24006) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-10 15:55:19 +08:00
cai.zhang 9715a850fa
Support expr with json field (#23804) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-10 10:19:19 +08:00
aoiasd 6415ee8cd9
Use boost 1.79 to avoid queue memory leak (#23977) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-10 10:01:19 +08:00
sre-ci-robot a86332b2d7
Update knowhere commit (#23941) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-08 14:02:40 +08:00
sre-ci-robot 8ffa8a28fa
Update knowhere commit (#23874) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-06 14:18:39 +08:00
cai.zhang c80d8f82ce
Reduce memory usage for diskann index (#23600) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-06 10:32:39 +08:00
Enwei Jiao e172f3e8dc
Fix dependency conflict (#23847) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-04 19:46:38 +08:00
yah01 62eea5286f
Support to filter with json expr (#23739) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-30 20:36:39 +08:00
Cai Yudong 028054ee0b
Update knowhere version (#23769) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-29 10:06:38 +08:00
Enwei Jiao 66a5efeb3d
Fix load failed with DiskANN (#23760) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-27 16:56:35 +08:00
sre-ci-robot e988256467
Update knowhere commit (#23757) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-04-27 14:44:36 +08:00
sre-ci-robot 8d3007b479
Update knowhere commit (#23727) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-04-27 09:20:43 +08:00
yah01 0d3fcd5d16
Add method to access nested field at once (#23720) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-26 14:16:34 +08:00
yah01 60fdd7e4f4
Introduce simdjson (#23644) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-26 10:30:34 +08:00
foxspy 6f4ed517de
add growing segment index (#23615) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-04-26 10:14:41 +08:00
yah01 e23af6406f
Add nested path for accessing json fields (#23651) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-24 17:14:34 +08:00
wayblink b7cb34b966
Add blank GetIndexStatistics interface (#23610) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-04-23 14:50:32 +08:00
yihao.dai 092d743917
Add support for getting vectors by ids (#23450) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-23 09:00:32 +08:00
sre-ci-robot ccba1334dd
Update knowhere commit (#23595) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-04-21 15:34:31 +08:00
Enwei Jiao 2ced6660e2
Simplify makefile (#23583) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-21 14:16:33 +08:00
yah01 546080dcdd
Support to retrieve json (#23563) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-21 11:46:32 +08:00
yah01 aa2985490c
Retrieve page size by getpagesize() (#23561) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 12:36:30 +08:00
Enwei Jiao 967a97b9bd
Support json & array types (#23408) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 11:32:31 +08:00
Cai Yudong 2725d38b9e
Add COSINE metric type (#23350) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-20 10:20:31 +08:00
Enwei Jiao f14c221123
Revert "Opt compile time for Mac (#23453)" (#23533) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-19 16:52:30 +08:00
Enwei Jiao e9dcba3050
Opt compile time for Mac (#23453) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-19 10:24:30 +08:00
yah01 5aa0ddf77b
Refine field storage of sealed segment (#23464) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-18 11:24:30 +08:00
Bennu f63d52944f
Update knowhere version from main to commit_id (#23437) 
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
 2023-04-17 16:32:33 +08:00
cqy123456 7ff6a3a246
Set query node thread pool size in milvus.yaml (#23286) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-04-17 10:44:29 +08:00
Enwei Jiao 288582b2d9
Optimize mac build time (#23390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-14 17:56:29 +08:00
congqixia 03a4f60b6e
Fix knowhere cpp header files name (#23330) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-10 20:00:30 +08:00
Cai Yudong 55202ce7d9
Support show knowhere prometheus metrics (#23102) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2023-04-07 15:34:29 +08:00
Cai Yudong 5f4673fd16
Optimize unittest to save runtime (#23248) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-07 14:20:29 +08:00
congqixia 4a53018e5f
Remove legacy annoy_inner_error (#23220) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-04 18:08:24 +08:00
Cai Yudong ef63e64ded
Remove ANNOY index type (#23189) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-04 16:30:27 +08:00
Enwei Jiao 4d2e379b09
Add prometheus-cpp (#23199) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-03 19:22:23 +08:00
yihao.dai a182594bf5
Add FlushAll support (#22942) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-30 11:28:25 +08:00
Enwei Jiao 50dab2d394
Add tracing for retrieve (#23033) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-29 18:10:02 +08:00
zhenshan.cao d55c860383
Align the maximum dim of the diskann index and collection (#23039) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-03-28 00:06:00 +08:00
Enwei Jiao ef57ba3bac
Remove easylogging and replace by GLog (#22979) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-27 18:22:02 +08:00
yah01 081572d31c
Refactor QueryNode (#21625) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-27 00:42:00 +08:00
Cai Yudong 8aebc6f3b7
Remove faiss GPU index support (#22966) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-24 17:53:58 +08:00
Jiquan Long ef93e24da7
Fix cpp lint (#22955) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-24 11:23:59 +08:00
Cai Yudong 0e9a4478e3
Remove useless index mode (#22934) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-23 21:39:59 +08:00
smellthemoon af458017f4
Add some locks when write (#22938) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-23 15:57:57 +08:00
Enwei Jiao fd974df09f
OTEL integration in cpp (#22175) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-21 16:31:57 +08:00
yah01 9efebb3df7
Optimize load segment, make load fields concurrent (#22856) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-21 16:27:57 +08:00
zhagnlu 7c633e9b9d
Support aliyun OSS for chunk manager (#22663) (#22842) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-03-20 14:45:57 +08:00
yah01 3202eb0d9f
Optimize rounding distances, avoid promoting to double (#22846) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 14:09:56 +08:00
xige-16 9aa99aedbb
[Cherry-Pick] Remove arrow uasge in FieldData (#22726) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-03-20 10:41:56 +08:00
yah01 005d178a0e
Optimize performance of insert & query & search (#22829) 
- Reduce 1x copy of inserting int8/int16 into growing segment
- Reduce 1x copy of retrieving primary keys
- Reduce 1x copy of inserting/loading/deleting/filtering primary keys
- Reduce 1x copy of reducing string results

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:19:56 +08:00
yah01 20974711a1
Optimize range search for nq > 1 (#22831) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:17:56 +08:00
yah01 65c58b3e41
Optimize performance of querying on InsertRecord (#22838) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:13:56 +08:00