milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
17,220 Commits
147 Branches
122 Tags
578 MiB
Commit Graph

6912 Commits (5f7099a9bdb491465fe469b3601ce16916654c99)

Author SHA1 Message Date
yihao.dai 6e17aa2608
Improve rate limiter interceptor (#24389) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-25 14:55:32 +08:00
yah01 7721cc73f0
Perf: Avoid copying string/json when filter on them (#24381) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-25 13:13:26 +08:00
cai.zhang 59b0a61cb2
Fill outputFields for query/search result (#24352) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-25 11:39:26 +08:00
Xiaofan 49f75e5e11
Make flow graph retry longer (#24355) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-05-25 09:53:30 +08:00
yihao.dai 014387fd94
Forbid to get quantized vector from ChunkManager (#24334) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 23:03:27 +08:00
yihao.dai 1471da846d
Fix panic due to collection not exist in quota effect (#24320) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 20:53:30 +08:00
Preetham 4ea0830c25
Update: Wrap common calls querycoord rootcoord clients (#24360) 
Signed-off-by: Preetham <kamidipreetham@gmail.com>
 2023-05-24 19:25:26 +08:00
Bingyi Sun 0c8045d66c
Fix crash caused by segment function concurrency (#24351) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-05-24 19:23:27 +08:00
wei liu 8e3ba74648
fix qc service unstable ut (#24340) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-24 18:49:25 +08:00
yihao.dai e49df11942
Fix QueryNode is not able to recovery (#24335) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 14:29:29 +08:00
presburger 152acb3a76
fix fmt lib conflict when compile with raft suppport (#24266) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-05-24 13:05:26 +08:00
Preetham 2f8032b55c
Update: Wrap common grpc calls indexnode and proxy clients (#24344) 
Signed-off-by: Preetham <kamidipreetham@gmail.com>
 2023-05-24 09:25:26 +08:00
yah01 abd250da09
Fix QueryNode is not able to recovery (#24300) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-23 17:17:26 +08:00
sre-ci-robot 7f96dd8526
Update knowhere commit (#24323) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-23 16:15:25 +08:00
wei liu ce03248b1a
simplify logic circle in search (#24110) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-23 16:01:26 +08:00
cai.zhang 7819a5733f
Hide dynamic field for describing collection (#24312) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-23 14:27:25 +08:00
groot 97cd0409e4
Support dynamic field for bulkinsert (#24265) (#24304) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-23 14:17:25 +08:00
Preetham d8a3b9d07e
Update: Wrap common grpc calls datacoord client (#24311) 
Signed-off-by: Preetham <kamidipreetham@gmail.com>
 2023-05-23 11:43:25 +08:00
cai.zhang d16e18fd34
Add output fields for search/query results (#24302) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-23 10:19:26 +08:00
MrPresent-Han 675821c79d
refine log and process for distribution handler (#24239) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-22 19:37:25 +08:00
yah01 6da8853756
Fix the JSON parser always parse all documents (#24290) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 15:49:27 +08:00
sre-ci-robot 785fe4d543
Update knowhere commit (#24288) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-22 15:29:26 +08:00
cai.zhang ce67d024ed
Fill is_dynamic flag for output field data (#24283) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-22 14:01:25 +08:00
wei liu 8965ea2a08
refine err msg about no available node in replica (#24256) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-22 11:59:26 +08:00
yah01 ceda0ed598
Optimize the performance of filter by JSON field (#24268) 
- Construct JSON pointer only once
- Avoid copying nested path for each row

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 00:47:25 +08:00
yihao.dai 3f96c335bb
Add receivedNQ metric and change receivedBytes metric to collection level (#24199) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-21 22:23:24 +08:00
smellthemoon 0b72cf2c2e
log out error (#24260) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-19 18:25:24 +08:00
yihao.dai 45aa9779e0
Retrieve segments concurrently (#24245) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-19 18:19:24 +08:00
aoiasd 9729b6079d
Fix rocksmq retention no trigger at datacoord timetick channel (#24170) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-19 16:23:24 +08:00
yah01 c75e7a5d05
Fix failed to compare int value with double value (#24229) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-19 12:57:23 +08:00
Jiquan Long bd343550a5
Support to manage connections (#24224) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-19 12:51:23 +08:00
smellthemoon 473c65cd04
Make field in metastore contains default value (#24228) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-19 12:19:23 +08:00
cai.zhang 98d86e2391
Return all dynamic field when retrieve json key (#24205) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-19 09:41:25 +08:00
MrPresent-Han 7744573d3d
support parms for import maxfilesize(#24191) (#24192) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-18 18:59:27 +08:00
Cai Yudong b1afd3ea2f
Update knowhere commit to fix BIN_IVF_FLAT upgrade (#24187) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-05-18 17:57:23 +08:00
groot b89f06dd19
Support JSON for bulkinsert (#24130) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-05-18 16:33:23 +08:00
congqixia e6eb477074
Fix unsupported datatype assertion when query json field (#24214) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-18 15:15:23 +08:00
congqixia 4502a16819
Fix dynamic field attribute is not set when describe (#24208) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-18 12:55:23 +08:00
congqixia 03297a7ef7
Fix event manager not closed after datanode stop (#24206) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-18 11:43:23 +08:00
Enwei Jiao 6865f93ad3
Refactor querynodeclient to remove duplicate code (#24195) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-18 11:35:23 +08:00
cai.zhang 008285f849
Support dynamic schema for create collection (#24176) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-18 09:33:24 +08:00
yihao.dai 1a3dca9b5e
Fix dynamic partitions loading (#24112) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-18 09:17:23 +08:00
yah01 99cc24b283
Fix compaction doesn't support JSON data (#24151) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-17 19:09:22 +08:00
MrPresent-Han b74770b636
support try-best query reducer methods(#24075) (#24103) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-17 16:23:23 +08:00
wei liu 2935e9f767
fix alter collection merge multi props policy (#24147) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-17 16:05:22 +08:00
Ikko Eltociear Ashimine eb9ef23cca
Fix typo in handler.go (#24125) 
postitions -> positions

Signed-off-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
 2023-05-17 14:25:23 +08:00
wei liu 6cfb4559d2
fix deny writing use wrong errcode (#24152) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-17 14:23:23 +08:00
Enwei Jiao cb2a36ab52
Change output fields with star behavior (#24162) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-17 12:41:22 +08:00
Bingyi Sun a53beba14f
Move release collection metrics to job (#24079) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-05-17 11:17:22 +08:00
yihao.dai 7384d83d2c
Support rate limit based on growing segments size (#24121) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-17 09:57:22 +08:00
Jiquan Long 6965495b9d
Check overflow for inserted integer (#24142) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-16 20:19:22 +08:00
congqixia 73a181d226
Fix get vector it timeout and improve some string const usage (#24141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 17:41:22 +08:00
cai.zhang ccd685013a
Json key must be enclosed in double quotes (#24113) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-16 16:19:22 +08:00
yah01 3ea4a39078
Fix insert node doesn't handle JSON data while merging (#24126) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-16 16:09:23 +08:00
congqixia a960cc2a1b
Fix data race in pipeline/manager (#24127) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 15:17:23 +08:00
congqixia 74bba2320a
Fix session stop/goingStop stuck after connection lost (#24131) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 14:51:22 +08:00
SimFG ef82e0f1a4
Fix the error when a role removes an already deleted user (#24049) (#24109) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-05-16 10:15:22 +08:00
congqixia df7848cf79
Fix querynode consume ts lag metrics (#24119) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 09:59:26 +08:00
yihao.dai fe0a1bc2d9
Fix panic caused by wrong logic of getting unindexed segments (#24044) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-15 20:59:28 +08:00
Jiquan Long 30415e1b83
Fix metric QueryCoordNumCollections (#24053) (#24107) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-15 16:33:22 +08:00
smellthemoon 8a85dd6869
Support Default Value (#23448) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-15 16:15:21 +08:00
foxspy 849de66be8
revert query_coord proto (#24089) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-05-15 15:09:25 +08:00
wei liu 4369915402
fix rate limit ut (#24096) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-15 11:13:21 +08:00
cai.zhang 9a0a41d2a8
Support access json key without quotation marks (#24062) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-14 22:51:21 +08:00
Enwei Jiao 8bfb42827e
Fix aws-c-sdkutils (#24085) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-13 13:47:20 +08:00
wei liu 4c956fab73
enable config collection level rate limit (#24012) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-12 18:13:26 +08:00
congqixia f6dec281c4
Add Statistic entity id log for datacoord (#24073) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-12 18:11:21 +08:00
wei liu 7407669a02
fix qc coordinator retry policy (#24057) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-12 16:59:21 +08:00
wei liu 4cd9f32dd6
enable global static rate limit (#24009) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-12 15:49:20 +08:00
zhagnlu 113f9a0ebc
Support SIMD of several Expr (#23715) (#23717) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-05-12 14:11:20 +08:00
yah01 7d0c47dd65
Check the length of JSON (#24035) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-12 11:33:20 +08:00
Enwei Jiao 7e645dabf1
Add trace log for datacoord (#24046) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-12 09:53:21 +08:00
congqixia eb27a8a8c0
Fix integration test not wait for index built (#24037) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-12 09:51:25 +08:00
Cai Yudong 58192f55f6
Update knowhere version for new GetVectorByIds interface (#24034) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-05-11 18:05:20 +08:00
sre-ci-robot b692f90be9
Update knowhere commit (#24032) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-11 15:41:21 +08:00
yah01 400364483d
Improve predict the resource usage (#23968) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-11 15:33:24 +08:00
smellthemoon ab95754069
Remove debug log (#24030) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-11 14:09:19 +08:00
congqixia 084424d636
Make data node start only once (#24031) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-11 13:51:20 +08:00
yah01 67cf23d050
Fix panic while balancing releasing collection (#24003) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-11 12:47:20 +08:00
congqixia 5aa9db0d38
Add collection level auto compaction enabled config (#24013) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-10 17:45:20 +08:00
Enwei Jiao 2969c80c6c
Change aws-c-compression version (#24006) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-10 15:55:19 +08:00
smellthemoon f1adb1c06d
can only use the topic in the list when preCreatedTopicEnabled (#23913) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-10 13:47:19 +08:00
cai.zhang 9715a850fa
Support expr with json field (#23804) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-10 10:19:19 +08:00
aoiasd 6415ee8cd9
Use boost 1.79 to avoid queue memory leak (#23977) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-10 10:01:19 +08:00
smellthemoon 146050db82
Fix some wrong ut (#23990) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-10 09:31:19 +08:00
yihao.dai 7e0d1492c7
Load delete from channel checkpoint (#23961) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 19:10:41 +08:00
yihao.dai ae6fccc3a3
Filter id field out if not specified (#23982) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 17:26:41 +08:00
wei liu d06ae53f79
make ddl rate limit be global level (#23962) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-09 16:56:40 +08:00
wei liu fb6e4ceee7
correct the behavior of create duplicate rg (#23963) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-09 14:06:40 +08:00
congqixia f6d3b4f7ac
Fix concurrent map read/write in rate limiter (#23958) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-09 11:00:40 +08:00
yihao.dai 3827ac30bc
Remove load cache (#23287) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 10:36:41 +08:00
yihao.dai 426ed30d2d
Log optimized search params (#23930) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 10:12:42 +08:00
Enwei Jiao a933b595c4
Add trace log for grpc client (#23951) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-09 10:10:41 +08:00
SimFG 4cb65c5b39
Improve the rbac log when milvus is starting (#23884) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-05-08 14:32:40 +08:00
congqixia ed81eaa963
Make CollectionObserver trigger checker more frequently during load procedure (#23928) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-08 14:06:41 +08:00
sre-ci-robot a86332b2d7
Update knowhere commit (#23941) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-05-08 14:02:40 +08:00
Enwei Jiao d7edd1b99b
Fix parse token error (#23909) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-08 10:28:39 +08:00
yihao.dai f1cc31ceee
Fix creating partition is not atomic (#23823) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-08 10:18:39 +08:00
Enwei Jiao 240c5625cd
Fix nil pointer access (#23919) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-08 10:08:39 +08:00
wayblink e13d900398
Add some log in getIndexStatisticsTask (#23897) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-05-08 10:02:39 +08:00