milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
17,721 Commits
146 Branches
120 Tags
575 MiB
Commit Graph

7292 Commits (732d92b6425df3236672c64d9a3b1dcc6dcf5b55)

Author SHA1 Message Date
congqixia 2b9ec565bb
Fix task executor can not dedup same task (#25901) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-26 08:51:02 +08:00
wei liu 302897f866
refine look aside balance logic (#25837) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 18:51:01 +08:00
congqixia a669440ee9
Allow querycoord executor load sealed segment with no index (#25902) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-25 18:47:01 +08:00
yah01 3735a097e6
Refine the memeory usage prediction (#25889) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-25 17:41:01 +08:00
congqixia 0bc03ede0d
Add eventlog pkg and support grpc streaming event observation (#25812) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-25 17:23:01 +08:00
wei liu a132122370
fix time unit in insert/delete cost metrics value (#25893) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 15:07:01 +08:00
groot a6808e6484
Fix bulkinsert row count error (#25869) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-07-25 11:29:00 +08:00
Cai Yudong 5e3cbb584a
Update Knowhere Commit (#25875) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-25 11:01:00 +08:00
aoiasd b533c68632
Forbid update checkpoint without msgID (#25694) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-07-25 10:43:04 +08:00
Zhihong Yu 150947a5f4
Conditionally log warning when DropSegment fails (#25774) 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2023-07-25 10:39:01 +08:00
cai.zhang 3d78a452d7
Support escape string (#24848) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-25 10:29:01 +08:00
cai.zhang fe1c0ffe56
Check sgement exist before check import task state (#25809) (#25817) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-25 10:09:01 +08:00
foxspy 5437fcce8e
fix range search (#25880) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-07-25 10:07:01 +08:00
cai.zhang 760a2d9aa7
Support AllocTimestamp api for Milvus (#25784) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-25 10:05:00 +08:00
wei liu 0e26486abc
fix segment num in log (#25876) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 09:13:00 +08:00
yah01 53c3bf053e
Fix unstable sealed segment bruteforce unittest (#25867) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-07-25 09:05:00 +08:00
wei liu 1748c54fd7
skip load/release segment when more than one delegator exist (#25718) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 19:01:01 +08:00
yah01 168f346620
Remove deprecated interface (#25864) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-07-24 17:47:00 +08:00
cai.zhang 779d677eb2
Remove lock for compaction sync segments (#25711) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-24 17:25:00 +08:00
congqixia 76e03fe6d3
Set reason for balance, index checker generated tasks (#25865) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 17:07:00 +08:00
jaime 8e5d6193f9
Add a timeout config for bulkinsert request (#25789) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-07-24 14:23:00 +08:00
yah01 dc37b4587e
Fix panic if channel not watched while getting shard leaders (#25820) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-24 14:13:02 +08:00
MrPresent-Han f4e72cb170
remove sync segmentLastExpire every time when assigning(#25271) (#25316) (#25557) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-24 14:11:07 +08:00
wei liu fc19b85a40
fix count(*）retrieve redundant growing segment (#25825) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 14:09:00 +08:00
Bingyi Sun 9f31fc9a31
Add broker timeout config item. (#25855) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2023-07-24 14:07:00 +08:00
congqixia efcaa07fe9
Implement Stringer for task related enums (#25860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 13:57:00 +08:00
congqixia 3c503afe7c
Use typeutil.ConcurrentMap instead of sync.Map (#25846) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 10:23:01 +08:00
congqixia 31b40b3ccc
Use typeutil.ConcurrentMap instead of sync.Map in fg manager (#25835) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 10:21:07 +08:00
congqixia 37636b2f4d
Add compaction worker max parallel config item (#25834) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 10:17:00 +08:00
cai.zhang b15e34db21
Add contraint for compaction based indexed segments (#25709) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-23 21:31:00 +08:00
cqy123456 0f3350ded4
set knowhere thread pool size in index node (#25804) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-07-21 18:50:59 +08:00
aoiasd 4cb6351f87
update isDelete of index task meta when delete task from index builder (#25717) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-07-21 17:15:00 +08:00
wei liu 32827f538a
add metrics for delegator insert/delete cost (#25733) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-21 15:30:59 +08:00
Jiquan Long 95f91e6e35
Fix segments meta not consistent between catalog and in-memory (#25799) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: czs007 <zhenshan.cao@zilliz.com>
 2023-07-21 14:21:05 +08:00
sre-ci-robot 8f33d87843
Update knowhere commit (#25827) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-07-21 14:09:05 +08:00
Enwei Jiao e0064a7bdc
Add zstd support for librdkafka (#25792) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-21 13:21:00 +08:00
smellthemoon a2f001e132
Remove max length check when autoid==true set by varchar primary field (#25728) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-07-21 11:30:59 +08:00
shaoyue 7bf39aed08
chunk manager supports using gcs & oss with accessKey (#25233) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2023-07-20 15:38:58 +08:00
presburger e418ab2f49
fix folly compile error on amazon linux (#25546) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-07-19 21:46:58 +08:00
congqixia 1045c88102
Support replace indexed field in QueryCoord (#25747) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-19 21:22:58 +08:00
yah01 361db51337
Create dir if mmap enabled for validating path (#25750) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-19 18:48:58 +08:00
yihao.dai 172db82b23
Release collection if all partition released (#25706) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-19 16:54:58 +08:00
wei liu 6534396b3d
enable config different interval for different checker (#25514) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-19 16:50:57 +08:00
Cai Yudong 9a4761dcc7
Remove binary metrics TANIMOTO/SUPERSTRUCTURE/SUBSTRUCTURE (#25708) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-19 16:16:58 +08:00
Jiquan Long bccdef1ad7
Fix segment meta only record last flushed binlog (#25707) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-07-19 15:28:57 +08:00
yah01 224515eaa3
Add segment dist containing condition for loading segment (#25736) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-19 15:02:58 +08:00
Jiquan Long 96141fa998
Fix coping segment offsets twice (#25729) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-07-19 14:24:57 +08:00
yah01 227d2c8b3a
Reduce loading index memory usage (#25698) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-19 14:02:57 +08:00
aoiasd 3545b1a608
Refine rocksmq (#25031) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-07-18 20:18:57 +08:00
yah01 079cd9dc70
Add caller skip to improve the log for segcore error (#25710) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-18 19:54:57 +08:00
Enwei Jiao 9fe62cb5f3
Fix kafka producer panic by nil (#25691) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-18 18:24:57 +08:00
congqixia 8d343bf75a
Make compaction rpc timeout and parallel maxium configurable (#25672) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-18 14:25:20 +08:00
Cai Yudong 73512c72fd
Remove calc_distance (#25663) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-18 14:23:20 +08:00
yah01 228c0df3f7
Skip record ChannelNotFound error while loading segment (#25669) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-18 11:53:18 +08:00
congqixia cc71e065e3
Support load index after segment loaded (#25567) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-18 10:51:19 +08:00
xige-16 94d6cbb238
Fix querynode panic when binlog ts wrong (#25635) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-07-18 10:41:20 +08:00
aoiasd 77a9553c3f
Add some log when node being reachable or unreachable (#25572) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-07-18 10:35:20 +08:00
congqixia c490b30db7
Fix segment loader skip wait if all segments are loading (#25643) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-17 19:51:18 +08:00
MrPresent-Han 49655d2f13
fix panic due to lack of indexInfo on querynode(#25362) (#25613) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-17 19:23:19 +08:00
Bingyi Sun 5afea0e5bf
Fix querycoord crash (#25638) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-17 16:56:35 +08:00
Bingyi Sun 7613c7842c
Fix datacoord crash (#25631) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-17 16:54:34 +08:00
yah01 948d1f1f4a
Handle errors by merr for QueryCoord (#24926) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-17 14:59:34 +08:00
wei liu 04a2ddda17
refine rated log of look aside balancer (#25637) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-17 14:49:34 +08:00
sre-ci-robot 4e5d2a311b
Update knowhere commit (#25640) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-07-17 14:04:34 +08:00
Cai Yudong ad9271c3a2
Fix knowhere prometheus metrics not show (#25601) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-17 10:30:34 +08:00
zhenshan.cao c4f009073c
Make query set guarantee ts based on default consistency level (#25578) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-07-17 09:58:38 +08:00
Zhihong Yu a7023ab3cc
Narrow the scope of deleteMut lock in loadStreamDelete (#25436) 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2023-07-17 09:30:34 +08:00
yihao.dai 74ad7c4601
Fix monitoring metrics (#25549) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-16 18:48:33 +08:00
wei liu b62c82af22
fix set target version in loading sealed segment (#25603) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-14 20:00:31 +08:00
congqixia c114d46244
Support create alias with dropping collection name (#25616) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 19:46:31 +08:00
congqixia f2b14b43de
Add log field for local worker call (#25594) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 17:34:31 +08:00
congqixia a7e6f08183
Fix DeleteCollection not protected (#25599) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 17:04:31 +08:00
SimFG 69d274d233
Improve the operation log (#25589) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-07-14 16:08:31 +08:00
yihao.dai f19621fc8c
Support refund the tokens to limiter (#25598) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-14 15:58:32 +08:00
Enwei Jiao 66fdc71479
Refactor logs in DataCoord & DataNode (#25574) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-14 15:56:31 +08:00
yah01 d216f9abda
Clear collection meta after all channels/segments released (#25486) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-14 10:28:30 +08:00
yiwangdr b9189b9f41
Organize mocks from types.go (#25466) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-07-14 10:12:31 +08:00
wei liu fc9a6dc241
fix compute score on replica selection (#25582) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-14 10:02:31 +08:00
wayblink 587237a3c9
Fix dead loop in session (#25451) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-07-13 18:02:29 +08:00
zhagnlu 65cb52d06b
Support dynamic simd framework and using term expr as example (#25260) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-07-13 16:22:30 +08:00
Enwei Jiao 4aed32ff61
Use librdkafka for all platform (#25538) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-13 15:34:33 +08:00
wayblink 53b4b70316
Reduce log frequency in timetick_sender (#25532) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-07-13 14:38:29 +08:00
wei liu b72809db15
fix release sealed segment on unwatch channel (#25555) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-13 14:30:29 +08:00
wei liu 012fd1152a
fix datacoord consume datanode tt metrics (#25524) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-13 14:26:29 +08:00
congqixia dbfade77c5
Retry on SyncSegment failure (#25540) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-13 14:12:29 +08:00
Bingyi Sun b22d6d2a5d
Avoid update all binlogs every a segment is updated (#25526) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-13 14:08:29 +08:00
wayblink ed3e4b0bc5
Fix unstable ut in timetick_sender_test (#25539) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-07-13 10:04:29 +08:00
MrPresent-Han ea3817fbbc
refinement towards sync_cp_lag_too_behind_policy to avoid submit syncTasks too frequently(#25441) (#25442) (#25500) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-12 20:22:29 +08:00
yah01 205a7c430a
Fix QueryNode panic while inserting to released segment (#25495) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-12 19:48:29 +08:00
Jiquan Long a577cac46b
Fix incorrect IP distance (#25527) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-07-12 19:28:29 +08:00
SimFG f9e2d00f91
Prevent `exclusive consumer` exception in pulsar (#25376) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-07-12 17:26:30 +08:00
wayblink fc12d3997c
Rename newTimeTickManager to newTimeTickSender (#25415) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-07-12 14:56:28 +08:00
sre-ci-robot 74c4b28ef1
Update knowhere commit (#25519) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-07-12 14:44:30 +08:00
yihao.dai 4c93495587
Add segment size metric in querynode (#25406) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-12 14:26:28 +08:00
Xiaofan dbf0130803
Faster garbage collect on compacted data (#25088) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-07-12 10:14:29 +08:00
congqixia 7d00020c9e
Reduce DataScope to historical for segment release task (#25489) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-12 09:12:28 +08:00
Bingyi Sun 70c4ddc6c5
Replace LoadWithPrefix with HasPrefix (#25471) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-11 19:38:28 +08:00
congqixia bcd3abf644
Separate segments/shards reduce latency metrics (#25475) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 18:18:28 +08:00
yah01 cb721781f3
Improve error message throwed from knowhere (#25473) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-11 17:26:29 +08:00
groot 96c987ed62
Bulkinsert supports partition keys (#25284) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-07-11 15:18:28 +08:00
congqixia 5aec6036dc
Add index info in GetDataDistribution response (#25444) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 11:22:29 +08:00
smellthemoon d63323d117
Add rate limit and deny write in upsert (#25351) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-07-11 11:20:34 +08:00
congqixia 28200acb67
Fix indexnode memory leakage when update index fails (#25460) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 11:18:28 +08:00
Bingyi Sun 6539396bbe
Add HasPrefix in kv (#25462) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-11 10:28:28 +08:00
wei liu 986208bca0
fix set wrong consistency level in proxy (#25458) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-11 10:06:28 +08:00
yah01 a1a4b649e7
Set aio pool (#25450) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-11 10:04:27 +08:00
cai.zhang 81278f4aea
Fix bug of missing JSON type when sorting retrieve results (#25412) (#25455) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-10 20:02:28 +08:00
Bingyi Sun f75201bbfd
Add Has interface in kv (#25439) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-10 19:40:27 +08:00
congqixia 9e3a591bda
Fix segment released early in case of balancing (#25453) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-10 18:58:28 +08:00
wei liu cc730c1ee5
fix consume growing from dml after release (#25421) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-10 17:36:28 +08:00
Enwei Jiao aaac1e27d1
Fix aws-c-event-stream not found (#25437) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-10 14:04:31 +08:00
congqixia 412b2fab67
Fix rootcoord restoration missing gcConfirmStep (#25293) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-10 10:16:26 +08:00
Bingyi Sun 3112dad356
Remove kv mocks (#25426) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-08 13:20:26 +08:00
Bingyi Sun 268368031c
Remove redundant kv mocks (#25420) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-07 19:38:26 +08:00
wei liu d4704ab9b6
fix set shard unservicable when sync target version (#25418) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 19:32:25 +08:00
wei liu a47fc28023
fix querynode panic in get distribution (#25405) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 18:26:25 +08:00
congqixia f07c934558
Fix querynodev2 grace stop condition reversed (#25409) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-07 17:28:25 +08:00
yihao.dai 2d1ed6af45
Use PK index for string data type (#25390) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-07 15:26:26 +08:00
wei liu b7740835fe
fix metric label for sq count metrics (#25399) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 14:06:25 +08:00
Ikko Eltociear Ashimine 1d6f646579
Fix typo in suffix_snapshot.go (#24810) 
Signed-off-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
 2023-07-07 10:58:25 +08:00
Jiquan Long 823ede3a51
Fix BinaryRange expression on indexed chunk (#25372) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-07-06 21:10:25 +08:00
Bingyi Sun 54acb5b725
Remove alter segment interface (#25382) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-06 20:46:25 +08:00
chyezh dc1cb54404
[Fixup] unexpected read_task_ready_len metric (#25349) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-06 20:02:29 +08:00
congqixia 2bed5bc461
Fix false load success for partition load timeout but collection remains (#25379) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-06 19:10:25 +08:00
wei liu b7b249770c
enable metrics expire for replica selection (#25360) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 19:04:25 +08:00
Bingyi Sun fe22720ff3
Avoid rewriting all binlogs every time a segment is updated (#25339) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-06 18:20:26 +08:00
wei liu d5ec7dda80
fix metric label in search/query count (#25377) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 17:48:26 +08:00
congqixia 3f9384b515
Fix exclude segment info dml position for flushed segments (#25200) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-06 17:30:26 +08:00
yah01 cd29b863d0
Fix data race in session (#25354) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 14:52:25 +08:00
yah01 3d2283415f
Fix delegator leaked (#25347) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 14:18:26 +08:00
yah01 dd5f896dc8
Load batch by batch (#25212) 
This will significantly reduce the memory usage while loading
- 1x memory usage and MBs overhead for buffer (memory mode)
- only MBs overhead for buffer (mmap mode)

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 13:58:27 +08:00
wei liu 2ae6def394
fix sync target version with wrong segment list (#25337) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 10:30:26 +08:00
yah01 4c0e36d28c
Stop blocking until all channels & segments released (#25328) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 10:04:25 +08:00
wei liu 71d99d4ec2
fix unexpected metrics value cause by wrong time unit (#25240) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 08:48:27 +08:00
wei liu c84496a1ba
fix sq count metrics (#25287) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 08:46:26 +08:00
wei liu 951c312ef9
refine grafana metrics for replica selection (#25319) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-05 17:00:25 +08:00
congqixia efdd71c640
Make cgo pool size larger than worker pool size (#25318) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-05 16:56:26 +08:00
Jiquan Long c2a2ece551
Fix expression on integer overflow case (#25320) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-07-05 10:18:24 +08:00
foxspy 31173727b2
growing segment index memory opt & get vector bugfix (#25272) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-07-05 00:04:25 +08:00
Enwei Jiao 816158e4af
Remove outdated searchplan (#25282) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-04 18:30:25 +08:00
Gao 4a87b9f60a
Fix queryHook ut data race (#25306) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-07-04 15:34:25 +08:00
sre-ci-robot df63e3a295
Update knowhere commit (#25308) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2023-07-04 14:12:26 +08:00
yihao.dai c56a26a556
Add SetMetricType and set metric only for shard leader (#25285) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-04 10:20:25 +08:00
congqixia b68fa2049b
Fix querycoord segment checker nil reference (#25290) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-03 18:48:24 +08:00
wei liu cba0feb119
add coordinator broker, to unify rootcoord api access (#25187) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-03 18:28:25 +08:00
chyezh d7d61f529c
[Feature|Pick] enable scheduler policy and add user-task-polling policy (#24839) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-03 18:24:25 +08:00
congqixia 549c4a0e1b
Enlarge integration test timeout (#25283) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-03 17:40:25 +08:00
cai.zhang 4fdbc5af89
Support search with default params(#24516) (#25255) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-03 17:00:24 +08:00
yihao.dai 3be502c155
Fix not fully loaded error after restart (#25243) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-03 16:58:28 +08:00
smellthemoon 948d04cdd8
Check field type when create index (#25248) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-07-03 15:26:26 +08:00