Commit Graph

7092 Commits (8b06941da35af2f22369bcd8f07f74ac9b827166)

Author SHA1 Message Date
congqixia 5aec6036dc
Add index info in GetDataDistribution response (#25444)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-11 11:22:29 +08:00
smellthemoon d63323d117
Add rate limit and deny write in upsert (#25351)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-07-11 11:20:34 +08:00
congqixia 28200acb67
Fix indexnode memory leakage when update index fails (#25460)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-11 11:18:28 +08:00
Bingyi Sun 6539396bbe
Add HasPrefix in kv (#25462)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-07-11 10:28:28 +08:00
wei liu 986208bca0
fix set wrong consistency level in proxy (#25458)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-11 10:06:28 +08:00
yah01 a1a4b649e7
Set aio pool (#25450)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-11 10:04:27 +08:00
cai.zhang 81278f4aea
Fix bug of missing JSON type when sorting retrieve results (#25412) (#25455)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-07-10 20:02:28 +08:00
Bingyi Sun f75201bbfd
Add Has interface in kv (#25439)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-07-10 19:40:27 +08:00
congqixia 9e3a591bda
Fix segment released early in case of balancing (#25453)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-10 18:58:28 +08:00
wei liu cc730c1ee5
fix consume growing from dml after release (#25421)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-10 17:36:28 +08:00
Enwei Jiao aaac1e27d1
Fix aws-c-event-stream not found (#25437)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-10 14:04:31 +08:00
congqixia 412b2fab67
Fix rootcoord restoration missing gcConfirmStep (#25293)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-10 10:16:26 +08:00
Bingyi Sun 3112dad356
Remove kv mocks (#25426)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-07-08 13:20:26 +08:00
Bingyi Sun 268368031c
Remove redundant kv mocks (#25420)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-07-07 19:38:26 +08:00
wei liu d4704ab9b6
fix set shard unservicable when sync target version (#25418)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-07 19:32:25 +08:00
wei liu a47fc28023
fix querynode panic in get distribution (#25405)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-07 18:26:25 +08:00
congqixia f07c934558
Fix querynodev2 grace stop condition reversed (#25409)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-07 17:28:25 +08:00
yihao.dai 2d1ed6af45
Use PK index for string data type (#25390)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-07-07 15:26:26 +08:00
wei liu b7740835fe
fix metric label for sq count metrics (#25399)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-07 14:06:25 +08:00
Ikko Eltociear Ashimine 1d6f646579
Fix typo in suffix_snapshot.go (#24810)
Signed-off-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
2023-07-07 10:58:25 +08:00
Jiquan Long 823ede3a51
Fix BinaryRange expression on indexed chunk (#25372)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-07-06 21:10:25 +08:00
Bingyi Sun 54acb5b725
Remove alter segment interface (#25382)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-07-06 20:46:25 +08:00
chyezh dc1cb54404
[Fixup] unexpected read_task_ready_len metric (#25349)
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-07-06 20:02:29 +08:00
congqixia 2bed5bc461
Fix false load success for partition load timeout but collection remains (#25379)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-06 19:10:25 +08:00
wei liu b7b249770c
enable metrics expire for replica selection (#25360)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-06 19:04:25 +08:00
Bingyi Sun fe22720ff3
Avoid rewriting all binlogs every time a segment is updated (#25339)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-07-06 18:20:26 +08:00
wei liu d5ec7dda80
fix metric label in search/query count (#25377)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-06 17:48:26 +08:00
congqixia 3f9384b515
Fix exclude segment info dml position for flushed segments (#25200)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-06 17:30:26 +08:00
yah01 cd29b863d0
Fix data race in session (#25354)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-06 14:52:25 +08:00
yah01 3d2283415f
Fix delegator leaked (#25347)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-06 14:18:26 +08:00
yah01 dd5f896dc8
Load batch by batch (#25212)
This will significantly reduce the memory usage while loading
- 1x memory usage and MBs overhead for buffer (memory mode)
- only MBs overhead for buffer (mmap mode)

Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-06 13:58:27 +08:00
wei liu 2ae6def394
fix sync target version with wrong segment list (#25337)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-06 10:30:26 +08:00
yah01 4c0e36d28c
Stop blocking until all channels & segments released (#25328)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-06 10:04:25 +08:00
wei liu 71d99d4ec2
fix unexpected metrics value cause by wrong time unit (#25240)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-06 08:48:27 +08:00
wei liu c84496a1ba
fix sq count metrics (#25287)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-06 08:46:26 +08:00
wei liu 951c312ef9
refine grafana metrics for replica selection (#25319)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-05 17:00:25 +08:00
congqixia efdd71c640
Make cgo pool size larger than worker pool size (#25318)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-05 16:56:26 +08:00
Jiquan Long c2a2ece551
Fix expression on integer overflow case (#25320)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-07-05 10:18:24 +08:00
foxspy 31173727b2
growing segment index memory opt & get vector bugfix (#25272)
Signed-off-by: xianliang <xianliang.li@zilliz.com>
2023-07-05 00:04:25 +08:00
Enwei Jiao 816158e4af
Remove outdated searchplan (#25282)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-04 18:30:25 +08:00
Gao 4a87b9f60a
Fix queryHook ut data race (#25306)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-07-04 15:34:25 +08:00
sre-ci-robot df63e3a295
Update knowhere commit (#25308)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-07-04 14:12:26 +08:00
yihao.dai c56a26a556
Add SetMetricType and set metric only for shard leader (#25285)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-07-04 10:20:25 +08:00
congqixia b68fa2049b
Fix querycoord segment checker nil reference (#25290)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-03 18:48:24 +08:00
wei liu cba0feb119
add coordinator broker, to unify rootcoord api access (#25187)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-03 18:28:25 +08:00
chyezh d7d61f529c
[Feature|Pick] enable scheduler policy and add user-task-polling policy (#24839)
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-07-03 18:24:25 +08:00
congqixia 549c4a0e1b
Enlarge integration test timeout (#25283)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-03 17:40:25 +08:00
cai.zhang 4fdbc5af89
Support search with default params(#24516) (#25255)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-07-03 17:00:24 +08:00
yihao.dai 3be502c155
Fix not fully loaded error after restart (#25243)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-07-03 16:58:28 +08:00
smellthemoon 948d04cdd8
Check field type when create index (#25248)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-07-03 15:26:26 +08:00