milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
16,335 Commits
140 Branches
117 Tags
580 MiB
Commit Graph

16335 Commits (795dfb05bb4e2d6ae0b6ea3f924791e3e0bd394d)

Author SHA1 Message Date
sre-ci-robot 3ca7971b68
Update Pytest image changes (#21154) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2022-12-13 09:33:22 +08:00
Enwei Jiao 184d3c3583
Make TopK Limit configurable (#21155) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-12 23:01:24 +08:00
yah01 df8c67fe87
Check whether segments are fully loaded while fetching shard leaders (#20991) (#21139) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-12 21:49:22 +08:00
congqixia 0dc9a0311c
Fill collection schema after DataCoord restarts (#21161) (#21164) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-12-12 20:25:22 +08:00
yah01 f868144c46
Make progress if any channel/segment was loaded on node (#20775) (#21163) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-12 19:33:22 +08:00
smellthemoon 124ff014da
Load should base on the accurate loaded number (#21133) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
 2022-12-12 18:15:22 +08:00
bigsheeper 2823d23db0
Use channel-cp as seekPosition when FromDmlCPLoadDelete (#21150) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-12-12 17:47:22 +08:00
binbin 4d43df4f59
Update pymilvus version for 2.2 (#21146) 
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
 2022-12-12 16:57:26 +08:00
bigsheeper eb313d75ce
Move sync delete policy from deleteNode to insertBufferNode (#21137) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-12-12 16:45:21 +08:00
SimFG 0be9ba11d0
Use the copy method to get the casbin `Model` for every request (#21145) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-12 16:41:21 +08:00
XuanYang-cn cc8cc985e6
Refine search logs in querynode (#21136) 
- Make sure all logs logging with ctx
- Add an info log for searching on not-indexed segments
- Separate log prefix of shardleader and non-shardleaders

See also: #20975

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-12-12 15:23:22 +08:00
SimFG f209c9cc21
Fix the unsafe casbin `Model` (#21132) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-12 14:19:22 +08:00
liliu-z a974d72e84
Upgrade Knowhere to 1.3.5 to fix DiskANN aio issue (#21135) 
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
 2022-12-12 13:53:22 +08:00
wayblink 38e699482d
Update healthz to support standby state and fix rootcoord active-standby (#21130) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-12-12 12:21:25 +08:00
xige-16 3a6eff32f4
Fix search failed on disk index when search_list equal to limit (#21114) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-12-12 11:57:21 +08:00
Xiaofan f02ad7b71a
Fix flush didn't respect binaryvector and other schemas (#21119) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-12-12 10:33:26 +08:00
cai.zhang 50c7a80b2b
Add ut for ListWithPrefix of minio chunk manager (#21105) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-12-11 16:37:22 +08:00
zhenshan.cao 8d55a2cefa
Add indexCountLabel for metric QueryNodeNumEntities (#21081) (#21121) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-12-11 01:01:20 +08:00
Jiquan Long 41f7b10abb
Fix empty retrieve result (#21032) (#21066) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-12-09 16:37:20 +08:00
Xiaofan 714782fce1
Add more test for file reader (#21083) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-12-09 11:53:21 +08:00
zhenshan.cao 61592cdecc
Fix start of DataCoord (#20581) (#21079) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-12-08 20:03:19 +08:00
SimFG 7149b01c86
Fix the concurrent write issue when init privilege policy (#21073) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-08 19:45:20 +08:00
Jiquan Long a334853475
Fix group checker ut (#21038) (#21067) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-12-08 19:43:23 +08:00
cai.zhang 368686e149
Prevent flushWatcher watches new segment just after GetFlushedSegments (#21058) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-12-08 11:19:19 +08:00
smellthemoon d758a09490
Fix Group Checker test fail (#20911) (#21054) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2022-12-08 10:03:19 +08:00
binbin 2afebd532a
Enable test case after code fix for 2.2 (#20984) 
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
 2022-12-08 09:47:32 +08:00
NicoYuan1986 df60d85068
Modify test case same with master (#21016) 
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2022-12-08 09:45:26 +08:00
cai.zhang 5f77dbd00a
Forbid gc index meta when creating index (#21024) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-12-07 19:15:20 +08:00
yah01 2f16432eea
Improve error message when target id not match (#21043) (#21048) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-07 18:27:21 +08:00
cai.zhang 6041e5b805
Fix bug for ListWithPrefix from minio with recursive is false (#21040) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-12-07 17:11:19 +08:00
Ten Thousand Leaves 93876c39dc
Remove bad & duplicate metric (#21030) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-07 14:33:19 +08:00
congqixia 9692f4ed0e
Fix compaction handler may double release and block forever (#21015) (#21019) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-12-07 14:31:26 +08:00
Ten Thousand Leaves 35173aa35c
Refine segment stat metrics on QueryNode (#21029) 
issue: #20760

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-07 14:29:26 +08:00
Ten Thousand Leaves 790d6c324d
Fix segment_num, stored_rows_num and stored_rows_count metrics (#21028) 
TODO: better track segment with state other than flushed and dropped.

/kind bug

issue: #20146, #20145
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-07 14:27:20 +08:00
Ten Thousand Leaves c9ee4f084a
Reduce seal proportion from 0.25 to 0.23 (#21011) 
When segment are sealed with > 0.25 * segment.maxSize, we won't be able to compact 4 segments like these because the total size will be slightly over 0.25 * 4 * segment.maxSize.

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-07 14:25:19 +08:00
Ten Thousand Leaves 6dee58685e
Increase MaxWatchDuration and make it configurable (#21010) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-07 10:19:19 +08:00
Ten Thousand Leaves 3e62688eb6
Split small segment proportion and small segment compactable proportion (#21012) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-12-07 10:15:19 +08:00
Xiaofan b8be79fe27
Limit the rpc to 64M (#20844) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-12-07 10:09:19 +08:00
XuanYang-cn 7ea86ed3a3
Add ut for rootcoord/kv/kv_catalog.go (#20909) (#20974) 
Add ut for CreateCredential, GetCredential, Dropcredential,
ListCredentials, CreateRole, DropRole AlterUserRole, ListRole,
ListUser, ListUserRole, DeleteGrant, AlterGrant, ListGrant, and, ListPolicy

Fixes: #20833

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-12-05 15:39:22 +08:00
congqixia 0769e00e70
Fix BufferData limit calculation for BinaryVector (#20963) (#20971) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-12-05 15:31:19 +08:00
yah01 d14271f30c
Check target node ID for query/search (#20976) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-05 15:09:20 +08:00
yah01 90ca7e1e2d
Add time records for search path (#20924) (#20950) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-12-02 14:51:16 +08:00
Jiquan Long 5bf76a8fef
Refine log level (#20896) (#20902) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-12-02 10:11:16 +08:00
sre-ci-robot 11e37c176e
Update Pytest image changes (#20939) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2022-12-02 08:57:16 +08:00
binbin 735f853e65
Update test cases (#20940) 
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
 2022-12-02 08:55:17 +08:00
liliu-z b46601fd74
[Cherry Pick]Upgrade knowhere to 1.3.4 (#20943) 
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
 2022-12-02 00:33:22 +08:00
congqixia 8ed33d0b66
Generate unique id with ts for sync task (#20928) (#20942) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-12-01 23:19:16 +08:00
congqixia fd1a67ef64
Fix compaction target segment rowNum is always 0 (#20937) (#20941) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-12-01 22:11:17 +08:00
jingkl a3e181898f
[test]add the scalar field testcase (#20930) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>

Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-12-01 20:15:16 +08:00
binbin 5cd33cb5cb
Update pymilvus version (#20814) 
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
 2022-12-01 20:13:19 +08:00