milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
17,541 Commits
142 Branches
117 Tags
566 MiB
Commit Graph

7158 Commits (8f33d8784339875572ce0bd083f139ea82c0f0e6)

Author SHA1 Message Date
xige-16 04082b3de2
Migrate the ability to upload and download binlog to cpp (#22984) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-25 14:38:44 +08:00
Xiaofan e8911ebda7
Add retry time when lazy load BF (#25096) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-06-25 11:32:43 +08:00
sre-ci-robot 4ac391db40
Update knowhere commit (#25086) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-25 10:42:44 +08:00
congqixia a3630e17a0
Refine grpc Status handling: retry legacy only for Unimplemented (#25041) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-25 10:30:43 +08:00
Xiaofan 72c5e2a41a
Fix channel reassigned to other datanodes (#25015) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-06-21 21:26:42 +08:00
Enwei Jiao de78fe719d
Fix aws-c-http missing (#25055) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-21 15:58:42 +08:00
wei liu 0d51f55c48
enable config each collection has different rate limit (#24139) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-21 15:02:42 +08:00
aoiasd 7f5de9aab3
add read lock for getSegment (#25036) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-06-21 14:06:42 +08:00
PowderLi 3f4356df10
fix the spelling of `field` (#25008) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-06-21 14:00:42 +08:00
zhagnlu a79fd1c5a2
Fix GetObject return null value bug in MacOs (#24959) (#25002) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-21 13:40:42 +08:00
yihao.dai 9f5756f16e
Add cluster validation interceptor to resolve the ip-reuse issue (#25001) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-21 11:36:46 +08:00
SimFG 0c3f92d7d7
Improve the panic code about the rootcoord/session/rocksmq (#24859) (#25024) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-06-21 11:24:42 +08:00
Bingyi Sun b88e74a109
Fix querycoord close error (#25034) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-06-21 11:02:42 +08:00
sre-ci-robot a1ea9f6cf8
Update knowhere commit (#25019) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-21 03:32:42 +08:00
yah01 7eeb78726e
Fix refresh unstable (#25027) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 21:50:43 +08:00
yihao.dai 6168a55c04
Lower the log frequency when sync tasks are skipped (#25006) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-20 17:56:41 +08:00
yah01 8bc5282eb3
Fix datanode always retries to load stats even file corrupted (#25012) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 16:40:42 +08:00
yah01 73b7cf5df4
Fix bool unary expression sometimes returns no data (#25016) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 16:38:41 +08:00
yah01 247f117096
Refine segcore code style (#24999) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 14:16:46 +08:00
yah01 e962a8ba31
Limit the frequency of debug logs (#25009) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 14:14:41 +08:00
jaime b75dcf90c0
Fix Flush hang after SyncSegments timeout (#24953) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-06-20 10:20:41 +08:00
Xiaofan af1d84e5e1
Support sync when cp is lagged (#24989) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-06-20 10:00:41 +08:00
congqixia d51e1379fe
Move loadDelta operation after needTransfer check (#24922) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-19 17:14:41 +08:00
sre-ci-robot 2176907220
Update knowhere commit (#24963) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-19 15:46:41 +08:00
Xiaofan f57fe6d70b
Add compaction log (#24976) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-06-19 14:18:41 +08:00
Enwei Jiao d143682d7d
Refactor logs in proxy package. (#24936) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-19 13:28:41 +08:00
Jiquan Long e9f1515a0e
Add log for confirming gc finished (#24945) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-19 10:52:41 +08:00
Bingyi Sun cc56efb134
Fix build index performance downgrade (#24651) (#24708) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-06-19 10:50:47 +08:00
cai.zhang c9e456c6eb
Remove metric_type check and fix some minor bugs (#24921) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-06-19 09:54:41 +08:00
wei liu 46f7d903a3
enable look aside balancer on replica selection (#24791) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-16 18:38:39 +08:00
yah01 a413842e38
Fix deleted data is still visible (#24849) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-16 17:16:41 +08:00
Jiquan Long 8885fa2bc7
Fix BinaryArithOpEvalRange integer overflow case (#24943) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-16 17:10:39 +08:00
Zhao Shunjie 3b5b50bda8
add autoID to varchar dataType (#24907) 
Signed-off-by: shunjiezhao <939038111@qq.com>
 2023-06-16 17:00:40 +08:00
yihao.dai c7dc1c067a
Assign metric type in load segment request (#24917) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-16 16:50:41 +08:00
zhagnlu c5b1533fdc
Change segcore search_id from travelling all bits to select true bits(#24659) (#24800) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-16 16:48:44 +08:00
yihao.dai b62429070c
Set pchannels before dml enqueue to prevent panic (#24828) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-16 16:36:40 +08:00
yah01 9250423288
Fix QueryNode metrics (#24916) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-16 16:02:39 +08:00
cai.zhang c81bdda55a
Hide autoindex params details (#24851) (#24935) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-06-16 14:30:40 +08:00
cqy123456 a519213316
Update knowhere version, update diskann api and generate cache nodes in build process (#24898) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-06-16 14:20:39 +08:00
yihao.dai c73219a54d
Limit the number of concurrent sync tasks and allow only one sync task for the same segment (#24881) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-16 14:14:39 +08:00
congqixia cbfbc4e63a
Memset sigaction before using it (#24933) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-16 14:08:40 +08:00
Jiquan Long 26a6e1b946
Fix BinaryRange expression on integer overflow case (#24920) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-16 09:56:39 +08:00
congqixia d186f35895
Fix TestChannelMetaMockSkipBFLoad/transient_error not stable (#24928) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-16 09:50:44 +08:00
congqixia 5e7446e65e
Enlarge compact testcase timeout (#24924) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-15 20:54:43 +08:00
wei liu 75adf1df98
fix group nq metrics (#24918) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-15 19:50:39 +08:00
aoiasd 4d8d34e370
Refine Rocksdb option (#24394) (#24503) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-06-15 15:12:39 +08:00
zhagnlu f3f3f8a849
Segcore retrieve by pk optimazation (#24659) (#24660) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-15 15:04:39 +08:00
wei liu e40d95e093
add search/query request cost metrics on qn (#24413) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-15 14:24:38 +08:00
Jiquan Long 7faf934f91
Fix UnaryRange expression on integer overflow case (#24893) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-15 14:06:39 +08:00
sre-ci-robot 7f7fe85592
Update knowhere commit (#24908) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-15 14:04:39 +08:00
wei liu 59457eb75b
fix get partition progress return wrong error msg (#24899) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-15 11:14:39 +08:00
smellthemoon db31e88a73
Add length check when insert and upsert (#24759) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-06-15 10:24:38 +08:00
Enwei Jiao 1ef8f0fceb
Remove cgo PayloadWriter (#24892) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-14 18:04:38 +08:00
cui fliter 35cb0b5ba6
fix function name in comment (#24879) 
Signed-off-by: cui fliter <imcusg@gmail.com>
 2023-06-14 16:20:38 +08:00
Gao 51404abe93
Add missing indexInfo in watchDmChannelsRequest (#24696) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-14 14:40:39 +08:00
zhagnlu f60b839127
Support element in json array in segcore part(#24677) (#24829) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-06-14 14:38:37 +08:00
wayblink bfae6b49af
Remove datanode timetick mq, use rpc to report instead (#23156) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-06-14 14:16:38 +08:00
sre-ci-robot ee2d458da4
Update knowhere commit (#24883) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-14 13:58:39 +08:00
Jiquan Long c6a6998ba7
Fix term expression on interger overflow case (#24867) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-14 11:44:38 +08:00
fan yang 893c3c0409
Fix test structure for rmq (#24876) 
Signed-off-by: fan.yang <julyyangfan@gmail.com>
 2023-06-14 10:28:37 +08:00
congqixia 561021ec5a
Refine sigpipe handling (#24872) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-14 10:10:38 +08:00
yihao.dai e7125672d4
Check metric type at watchChannelTask (#24860) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-13 22:08:38 +08:00
congqixia 5659a3b728
Ignore log number check for compaction (#24835) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-13 20:04:38 +08:00
Cai Yudong 1b3c4b26f1
Optimize range search result sort in segcore (#24837) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-06-13 19:22:38 +08:00
yiwangdr 4387f36897
make etcdKV private (#24778) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-13 10:52:38 +08:00
cai.zhang f12574aaf3
Support JSON_CONTAINS or json_contains (#24814) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-06-13 10:50:37 +08:00
groot 5c3b744b0c
Fix potential crash bug of bulkinsert (#24763) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-06-13 10:22:38 +08:00
wei liu a3437e0ab5
refactor replica selection and retry policy on channel (#24367) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-13 10:20:37 +08:00
Enwei Jiao e538540d0d
Fix aws-c-io not found (#24777) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-10 19:08:35 +08:00
congqixia 864c1bbcee
Use collInfo instead of reading again (#24784) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 20:26:35 +08:00
Gao 1f8af0596e
Fix autoindex filter bug (#24775) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-09 18:18:36 +08:00
sre-ci-robot 762d1e8681
Update knowhere commit (#24779) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-09 17:28:36 +08:00
cai.zhang 853b7d0054
Support json contains for json field (#24720) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-06-09 16:10:36 +08:00
yah01 a9dccec03a
Add go payload writer (#24656) (#24762) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-09 13:52:39 +08:00
yihao.dai e81eb56b92
Add metric of waiting for tSafe latency (#24765) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-09 11:26:35 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yihao.dai 2086b4f75d
Add RBAC for FlushAll (#24751) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-08 20:28:35 +08:00
congqixia b77bee6708
Remove unused iterator initialization (#24743) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-08 19:10:35 +08:00
aoiasd 44e5daae3a
Fix querynode read quota (#24412) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-06-08 17:24:36 +08:00
Jiquan Long d531b17784
Add ut to check if two collections are identical (#24734) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-08 15:58:35 +08:00
congqixia e729b504ab
Use SA_ONSTACK flag for SIGPIPE handler (#24688) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-08 15:50:35 +08:00
congqixia 54306a10b3
Fix confusing log while plugin is not enabled (#24741) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-08 15:40:35 +08:00
yah01 ebd0279d3f
Check error by Error() and NoError() for better report message (#24736) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-08 15:36:36 +08:00
sre-ci-robot bc2112354d
Update knowhere commit (#24742) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-08 14:20:35 +08:00
yiwangdr 37c02c9927
clean up meta interface (#24729) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-08 14:18:35 +08:00
yah01 fa69c71d35
Fix data race in MetaCache (#24739) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-08 13:58:35 +08:00
yihao.dai d6dea8bcbb
Fix getting partitions in Proxy meta cache (#24719) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-08 11:14:35 +08:00
Jiquan Long 8156317c9c
Fix creating collection not idempotent (#24721) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-07 20:08:34 +08:00
sre-ci-robot affaf61d78
Update knowhere commit (#24706) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-07 19:44:42 +08:00
Enwei Jiao d3af451d92
Upgrade golangci-lint (#24707) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-07 19:34:36 +08:00
yihao.dai 89db828f71
Fix load collection failed after drop partition (#24680) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-07 19:04:36 +08:00
cai.zhang a6dbcaeb7a
Add proto field to support reverse in (#24678) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-06-07 17:24:36 +08:00
yihao.dai 711bbd6373
Check metric type before search (#24652) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-07 15:58:36 +08:00
chyezh 1593278f9d
add independent nq limit option (#24632) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-06-07 10:38:36 +08:00
congqixia d0c2fa5d19
Fix retryKeepAlive assertion panic (#24667) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-07 10:08:36 +08:00
chyezh f97127ae55
add nats mq wrappers (#24445) 
bug fixup, configurable natsmq, add unittest, pass e2e.



move natsmq to pkg project

Signed-off-by: chyezh <ye.zhen@zilliz.com>
Co-authored-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-07 10:00:37 +08:00
yihao.dai 5f7099a9bd
Fix search failed due to metric type mismatch (#24691) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-06 21:40:35 +08:00
Bingyi Sun b71c967ed7
Fix NoSuchKey error caused by special stats log (#24670) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-06-06 17:34:36 +08:00
Gao ea62922829
Disable search params rewrite while searching with filter (#24625) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-06 14:28:35 +08:00
yah01 f40e22c78c
Add array_at method to get array from JSON (#24671) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-06 14:10:36 +08:00
yah01 fb66924c90
Set metric type while init the collection (#24665) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-06 13:24:36 +08:00
xige-16 732fe54775
Support partition Key (#24047) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-06 10:24:34 +08:00
Cai Yudong 25aeee5fe6
Update knowhere commit (#24655) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-06-05 19:24:33 +08:00
Jiquan Long 283bddec3b
Fix show loaded collections (#24628) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-02 18:04:35 +08:00
Enwei Jiao 6b1712e07d
Fix aws-c-cal lib missing (#24610) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-02 14:56:32 +08:00
cai.zhang 93ea9c4925
Support return pending index rows when describe index (#24588) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-06-01 18:14:32 +08:00
yihao.dai b0ce4cff83
Assign metric type in search request when user has not explicitly assigned (#24591) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-01 18:10:32 +08:00
wayblink 5fb5b072ae
Retry keepalive when keepalive channel close (#24581) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-06-01 16:14:35 +08:00
congqixia 31880ab427
Use conc.PoolOption instead of ants.Option (#24585) 
- Add conc.PoolOption to setup conc.Pool
- Change panic default behavior
- Make future has error when job panicks

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-01 15:52:31 +08:00
groot 3022e37298
Fix bug of bulkinsert for dynamic field (#24569) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-06-01 14:14:31 +08:00
sre-ci-robot 5caa654622
Update knowhere commit (#24552) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-06-01 13:44:35 +08:00
xige-16 af42d7c2af
Fix crash when insert duplicate field datas (#24559) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-05-31 20:32:31 +08:00
SimFG d246defa4d
Return error response when an unimplemented request is received (#24545) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-05-31 20:24:31 +08:00
smellthemoon bb62cf4e60
Support upsert api rbac (#24550) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-31 19:01:09 +08:00
yihao.dai 19164ea753
Make binlog size metric to collect healthy binlog only (#24557) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-31 16:45:29 +08:00
yah01 1c64d0618c
Revert "Consume threads of the number of nq (#24410)" (#24554) 
This reverts commit 71a7fef5c5.

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-31 16:41:33 +08:00
groot 5358da2a10
Fix a crash bug for backup/restore (#24529) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-31 14:45:30 +08:00
groot 0d0e97ab7f
Fix crash issue of bulkinsert by invalid numpy array file (#24480) (#24528) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-31 14:43:39 +08:00
groot 3cb75997a3
Fix a bug of bulkinsert dynamic schema (#24405) (#24527) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-31 14:41:41 +08:00
yah01 852e5ce904
Convert double to int if possible with term expression (#24530) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-30 22:03:28 +08:00
zhenshan.cao f7924724b0
Add consistency_level paramter in search/query request (#24499) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-05-30 21:01:29 +08:00
wayblink 5958b42941
Add retry on getChannelLatestMsgID (#24518) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-05-30 20:03:28 +08:00
congqixia 39d31f8bbf
Trigger checker while waiting collection/partition released (#24523) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-30 17:41:28 +08:00
MrPresent-Han b09e7aeaf7
support detailed task metrics(#23414) (#24507) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-30 14:59:28 +08:00
smellthemoon 708c724ccc
fix default value store unknown type (#24477) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-30 14:51:28 +08:00
congqixia 48dff300db
Fix Get segment returns ambiguous result (#24505) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-30 12:25:28 +08:00
yihao.dai 0fb9131973
Improve rate limiter log (#24459) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-30 11:23:28 +08:00
Preetham 0983d1fac7
Update: Wrap common calls datanode client (#24494) 
Signed-off-by: Preetham <kamidipreetham@gmail.com>
 2023-05-30 09:33:28 +08:00
yihao.dai d8ad09b710
Fix sync partition context deadline exceeded (#24479) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-29 20:55:28 +08:00
Jiquan Long 29ae1229b6
Support AutoIndex (#24387) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-29 20:35:28 +08:00
congqixia 6375236533
Make SegmentInfo.size atomic (#24457) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-29 11:31:28 +08:00
aoiasd c84bdcea49
merge stats log when segment flushing or compacting (#23570) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-29 10:21:28 +08:00
cai.zhang dc02c5b064
Fix bug for supporting single quotes (#24464) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-29 09:55:27 +08:00
zhagnlu 0fe8342648
Support google cloud for C++ chunk manager (#21100) (#24418) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-05-29 01:05:28 +08:00
yah01 848ef7418b
Fix the refresh may be notified finished early (#24438) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-26 18:43:26 +08:00
yihao.dai 5efa49f112
Fix ddl check in rate limiter (#24436) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-26 17:37:30 +08:00
yah01 71a7fef5c5
Consume threads of the number of nq (#24410) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-26 17:33:27 +08:00
cai.zhang 6209d5d717
Remove unused code for creating index (#24442) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-26 16:49:26 +08:00
congqixia aad2e5d961
Fix compile error after knowhere change prometheus header path (#24434) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-26 15:15:26 +08:00
xige-16 fe18109aab
Clean tmp disk data when start milvus (#24404) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-05-26 15:07:26 +08:00
yihao.dai 5f84923bfa
Fix search/query unloaded data (#24368) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-26 15:01:26 +08:00
hulk 1aeff84293
Use MGet to query multi keys in RocksDB KV (#24362) 
RocksDB can performance optimizations such as async-io by io_uring.
This would benefit the performance a lot when keys are lying in
different levels of the LSM tree.

Signed-off-by: git-hulk <hulk.website@gmail.com>
 2023-05-26 11:07:27 +08:00
congqixia 165734de4e
Add unit test for invoking method after segment released (#24414) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-26 10:03:27 +08:00
presburger eed5f87901
update lib arrow (#24397) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-05-26 09:41:27 +08:00
yah01 99b7a6882c
Fix the nested path lost when reuse the expression (#24417) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-25 21:35:27 +08:00
cai.zhang 6804bda8f5
Support single quotes with string (#24386) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-25 15:47:26 +08:00
yihao.dai 6e17aa2608
Improve rate limiter interceptor (#24389) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-25 14:55:32 +08:00
yah01 7721cc73f0
Perf: Avoid copying string/json when filter on them (#24381) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-25 13:13:26 +08:00
cai.zhang 59b0a61cb2
Fill outputFields for query/search result (#24352) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-25 11:39:26 +08:00
Xiaofan 49f75e5e11
Make flow graph retry longer (#24355) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-05-25 09:53:30 +08:00
yihao.dai 014387fd94
Forbid to get quantized vector from ChunkManager (#24334) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 23:03:27 +08:00
yihao.dai 1471da846d
Fix panic due to collection not exist in quota effect (#24320) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 20:53:30 +08:00
Preetham 4ea0830c25
Update: Wrap common calls querycoord rootcoord clients (#24360) 
Signed-off-by: Preetham <kamidipreetham@gmail.com>
 2023-05-24 19:25:26 +08:00
Bingyi Sun 0c8045d66c
Fix crash caused by segment function concurrency (#24351) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-05-24 19:23:27 +08:00
wei liu 8e3ba74648
fix qc service unstable ut (#24340) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-24 18:49:25 +08:00
yihao.dai e49df11942
Fix QueryNode is not able to recovery (#24335) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 14:29:29 +08:00
presburger 152acb3a76
fix fmt lib conflict when compile with raft suppport (#24266) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-05-24 13:05:26 +08:00
Preetham 2f8032b55c
Update: Wrap common grpc calls indexnode and proxy clients (#24344) 
Signed-off-by: Preetham <kamidipreetham@gmail.com>
 2023-05-24 09:25:26 +08:00
yah01 abd250da09
Fix QueryNode is not able to recovery (#24300) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-23 17:17:26 +08:00
sre-ci-robot 7f96dd8526
Update knowhere commit (#24323) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-23 16:15:25 +08:00
wei liu ce03248b1a
simplify logic circle in search (#24110) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-23 16:01:26 +08:00
cai.zhang 7819a5733f
Hide dynamic field for describing collection (#24312) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-23 14:27:25 +08:00
groot 97cd0409e4
Support dynamic field for bulkinsert (#24265) (#24304) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-23 14:17:25 +08:00
Preetham d8a3b9d07e
Update: Wrap common grpc calls datacoord client (#24311) 
Signed-off-by: Preetham <kamidipreetham@gmail.com>
 2023-05-23 11:43:25 +08:00
cai.zhang d16e18fd34
Add output fields for search/query results (#24302) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-23 10:19:26 +08:00
MrPresent-Han 675821c79d
refine log and process for distribution handler (#24239) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-22 19:37:25 +08:00
yah01 6da8853756
Fix the JSON parser always parse all documents (#24290) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 15:49:27 +08:00
sre-ci-robot 785fe4d543
Update knowhere commit (#24288) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-22 15:29:26 +08:00
cai.zhang ce67d024ed
Fill is_dynamic flag for output field data (#24283) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-22 14:01:25 +08:00
wei liu 8965ea2a08
refine err msg about no available node in replica (#24256) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-22 11:59:26 +08:00
yah01 ceda0ed598
Optimize the performance of filter by JSON field (#24268) 
- Construct JSON pointer only once
- Avoid copying nested path for each row

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 00:47:25 +08:00
yihao.dai 3f96c335bb
Add receivedNQ metric and change receivedBytes metric to collection level (#24199) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-21 22:23:24 +08:00
smellthemoon 0b72cf2c2e
log out error (#24260) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-19 18:25:24 +08:00
yihao.dai 45aa9779e0
Retrieve segments concurrently (#24245) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-19 18:19:24 +08:00
aoiasd 9729b6079d
Fix rocksmq retention no trigger at datacoord timetick channel (#24170) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-19 16:23:24 +08:00
yah01 c75e7a5d05
Fix failed to compare int value with double value (#24229) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-19 12:57:23 +08:00
Jiquan Long bd343550a5
Support to manage connections (#24224) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-19 12:51:23 +08:00
smellthemoon 473c65cd04
Make field in metastore contains default value (#24228) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-19 12:19:23 +08:00
cai.zhang 98d86e2391
Return all dynamic field when retrieve json key (#24205) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-19 09:41:25 +08:00
MrPresent-Han 7744573d3d
support parms for import maxfilesize(#24191) (#24192) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-18 18:59:27 +08:00
Cai Yudong b1afd3ea2f
Update knowhere commit to fix BIN_IVF_FLAT upgrade (#24187) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-05-18 17:57:23 +08:00
groot b89f06dd19
Support JSON for bulkinsert (#24130) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-18 16:33:23 +08:00
congqixia e6eb477074
Fix unsupported datatype assertion when query json field (#24214) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-18 15:15:23 +08:00
congqixia 4502a16819
Fix dynamic field attribute is not set when describe (#24208) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-18 12:55:23 +08:00
congqixia 03297a7ef7
Fix event manager not closed after datanode stop (#24206) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-18 11:43:23 +08:00
Enwei Jiao 6865f93ad3
Refactor querynodeclient to remove duplicate code (#24195) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-18 11:35:23 +08:00
cai.zhang 008285f849
Support dynamic schema for create collection (#24176) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-18 09:33:24 +08:00
yihao.dai 1a3dca9b5e
Fix dynamic partitions loading (#24112) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-18 09:17:23 +08:00
yah01 99cc24b283
Fix compaction doesn't support JSON data (#24151) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-17 19:09:22 +08:00
MrPresent-Han b74770b636
support try-best query reducer methods(#24075) (#24103) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-17 16:23:23 +08:00
wei liu 2935e9f767
fix alter collection merge multi props policy (#24147) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-17 16:05:22 +08:00
Ikko Eltociear Ashimine eb9ef23cca
Fix typo in handler.go (#24125) 
postitions -> positions

Signed-off-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
 2023-05-17 14:25:23 +08:00
wei liu 6cfb4559d2
fix deny writing use wrong errcode (#24152) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-17 14:23:23 +08:00
Enwei Jiao cb2a36ab52
Change output fields with star behavior (#24162) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-17 12:41:22 +08:00
Bingyi Sun a53beba14f
Move release collection metrics to job (#24079) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-05-17 11:17:22 +08:00
yihao.dai 7384d83d2c
Support rate limit based on growing segments size (#24121) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-17 09:57:22 +08:00
Jiquan Long 6965495b9d
Check overflow for inserted integer (#24142) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-16 20:19:22 +08:00
congqixia 73a181d226
Fix get vector it timeout and improve some string const usage (#24141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 17:41:22 +08:00
cai.zhang ccd685013a
Json key must be enclosed in double quotes (#24113) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-16 16:19:22 +08:00
yah01 3ea4a39078
Fix insert node doesn't handle JSON data while merging (#24126) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-16 16:09:23 +08:00