milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
17,464 Commits
133 Branches
115 Tags
559 MiB
Commit Graph

122 Commits (8b06941da35af2f22369bcd8f07f74ac9b827166)

Author SHA1 Message Date
yihao.dai 5f7099a9bd
Fix search failed due to metric type mismatch (#24691) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-06 21:40:35 +08:00
Gao ea62922829
Disable search params rewrite while searching with filter (#24625) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-06 14:28:35 +08:00
yah01 fb66924c90
Set metric type while init the collection (#24665) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-06 13:24:36 +08:00
yihao.dai b0ce4cff83
Assign metric type in search request when user has not explicitly assigned (#24591) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-01 18:10:32 +08:00
congqixia 31880ab427
Use conc.PoolOption instead of ants.Option (#24585) 
- Add conc.PoolOption to setup conc.Pool
- Change panic default behavior
- Make future has error when job panicks

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-01 15:52:31 +08:00
yah01 1c64d0618c
Revert "Consume threads of the number of nq (#24410)" (#24554) 
This reverts commit 71a7fef5c5.

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-31 16:41:33 +08:00
congqixia 48dff300db
Fix Get segment returns ambiguous result (#24505) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-30 12:25:28 +08:00
aoiasd c84bdcea49
merge stats log when segment flushing or compacting (#23570) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-29 10:21:28 +08:00
yah01 71a7fef5c5
Consume threads of the number of nq (#24410) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-26 17:33:27 +08:00
xige-16 fe18109aab
Clean tmp disk data when start milvus (#24404) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-05-26 15:07:26 +08:00
yihao.dai 5f84923bfa
Fix search/query unloaded data (#24368) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-26 15:01:26 +08:00
congqixia 165734de4e
Add unit test for invoking method after segment released (#24414) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-26 10:03:27 +08:00
yihao.dai 014387fd94
Forbid to get quantized vector from ChunkManager (#24334) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 23:03:27 +08:00
Bingyi Sun 0c8045d66c
Fix crash caused by segment function concurrency (#24351) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-05-24 19:23:27 +08:00
yihao.dai e49df11942
Fix QueryNode is not able to recovery (#24335) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 14:29:29 +08:00
yah01 abd250da09
Fix QueryNode is not able to recovery (#24300) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-23 17:17:26 +08:00
wei liu ce03248b1a
simplify logic circle in search (#24110) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-23 16:01:26 +08:00
yihao.dai 45aa9779e0
Retrieve segments concurrently (#24245) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-19 18:19:24 +08:00
yihao.dai 1a3dca9b5e
Fix dynamic partitions loading (#24112) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-18 09:17:23 +08:00
MrPresent-Han b74770b636
support try-best query reducer methods(#24075) (#24103) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-17 16:23:23 +08:00
yihao.dai 7384d83d2c
Support rate limit based on growing segments size (#24121) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-17 09:57:22 +08:00
congqixia 73a181d226
Fix get vector it timeout and improve some string const usage (#24141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 17:41:22 +08:00
yah01 3ea4a39078
Fix insert node doesn't handle JSON data while merging (#24126) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-16 16:09:23 +08:00
congqixia a960cc2a1b
Fix data race in pipeline/manager (#24127) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 15:17:23 +08:00
congqixia df7848cf79
Fix querynode consume ts lag metrics (#24119) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 09:59:26 +08:00
congqixia eb27a8a8c0
Fix integration test not wait for index built (#24037) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-12 09:51:25 +08:00
yah01 400364483d
Improve predict the resource usage (#23968) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-11 15:33:24 +08:00
smellthemoon 146050db82
Fix some wrong ut (#23990) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-10 09:31:19 +08:00
yihao.dai 7e0d1492c7
Load delete from channel checkpoint (#23961) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 19:10:41 +08:00
yihao.dai 426ed30d2d
Log optimized search params (#23930) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 10:12:42 +08:00
yihao.dai f0eb5e8563
Fix partition released but can be searched (#23872) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-06 17:42:39 +08:00
congqixia 884f7904a1
Re-calculate segment entry num when binlog field is zero (#23883) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-06 14:24:39 +08:00
yihao.dai 02734d9eb0
Fix ignoring error when loading segment (#23830) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-04 15:10:39 +08:00
yihao.dai 4b26c0afb3
Add collection in querynode when sync new partitions (#23825) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-01 16:36:38 +08:00
Gao e467e0d451
Seperate reading build and load params for diskann (#23758) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-04-27 20:30:35 +08:00
yah01 eab94489ba
Refine the merge algorithm (#23767) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-27 18:26:35 +08:00
smellthemoon f0ababb420
Use merr in querynodev2 (#23652) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-26 17:06:34 +08:00
foxspy 6f4ed517de
add growing segment index (#23615) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-04-26 10:14:41 +08:00
yah01 f8ff97fe29
Fix travel timestamp set unique leads to disable task merge (#23605) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-25 19:04:34 +08:00
yihao.dai 092d743917
Add support for getting vectors by ids (#23450) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-23 09:00:32 +08:00
yah01 546080dcdd
Support to retrieve json (#23563) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-21 11:46:32 +08:00
yah01 71364056f9
Fix QueryNode may report succeeded to unsubscribe channel early (#23580) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 19:30:33 +08:00
LeoReeYang a2ab94ec3d
remove unused code. (#23572) 
Signed-off-by: LeoReeYang <LeoReeYang@outlook.com>
 2023-04-20 17:56:32 +08:00
Enwei Jiao 967a97b9bd
Support json & array types (#23408) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 11:32:31 +08:00
congqixia 4fe363c4b2
Add KNN cgo pool (#23526) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-19 23:56:31 +08:00
yah01 c7c89511b6
Fix data race of timerecord (#23524) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-19 14:18:30 +08:00
congqixia eb690ef033
Fix querynodev2 stop logic (#23487) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-18 17:56:30 +08:00
wei liu 3ad9ff7a9a
fix release segment failed (#23462) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-17 18:46:30 +08:00
cqy123456 7ff6a3a246
Set query node thread pool size in milvus.yaml (#23286) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-04-17 10:44:29 +08:00
yah01 7c4cafc83c
Fix task merge doesn't work (#23405) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-14 18:18:29 +08:00
congqixia a9a5f76f74
Fix AddDistribution unit test (#23418) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-13 20:46:29 +08:00
yah01 dc0eb433ae
Add IoPoolSize config (#23360) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-13 14:50:28 +08:00
cai.zhang 43a9e175a3
Exit component process when session key is deleted (#21658) (#22164) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-04-12 20:12:28 +08:00
congqixia 6cd73d4e2a
Wait safe signal before release growing (#23358) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-11 17:56:31 +08:00
Jiquan Long ad7f3d4c3e
Support Count(*) on querynodev2 (#23321) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-04-11 15:40:31 +08:00
congqixia 0527d2706c
Fix offline set always nil (#23340) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-11 14:42:30 +08:00
MrPresent-Han ba02e70301
fix bug when syncing distribution without schema and remove unused logic(#23085) (#23216) 
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
 2023-04-07 19:32:29 +08:00
jaime c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
congqixia 8db24e0a83
Support queryHook in querynodev2 (#23140) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-06 14:32:29 +08:00
congqixia 424570b2b8
Remove annoy related unit tests (#23229) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-05 08:14:28 +08:00
congqixia 3af3fe52d8
Remove partition target check in querynodev2 (#23188) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-04 13:36:32 +08:00
congqixia 42168f67fc
Add OWNERS file for qnv2 (#23196) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-03 16:22:24 +08:00
congqixia e3e3ac1525
Use peek segment info in querynodev2 (#23183) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-03 16:10:24 +08:00
yah01 2a760c108c
Add metrics for QueryNodeV2 (#23163) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-03 15:24:24 +08:00
yihao.dai b6f69fe7f2
Check if loaded before delegator search/query (#23162) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-03 14:26:23 +08:00
yihao.dai 9cecdc4f4e
Fix querynode panic (#23181) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-03 14:18:24 +08:00
smellthemoon 22aeb72eba
Fix LoadSegment req don't fill in collection id (#23136) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-31 11:28:23 +08:00
Enwei Jiao 50dab2d394
Add tracing for retrieve (#23033) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-29 18:10:02 +08:00
aoiasd 970dcb3161
Fix panic because timestamp was nil (#23096) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-29 17:20:04 +08:00
wei liu e2096965c7
fix leader view (#23038) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-29 14:06:02 +08:00
yah01 826c1fb850
Support mmap on QueryNodeV2 (#23073) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-28 21:30:05 +08:00
yah01 081572d31c
Refactor QueryNode (#21625) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-27 00:42:00 +08:00