milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
16,788 Commits
136 Branches
115 Tags
566 MiB
Commit Graph

6620 Commits (a182594bf5410a6c7e5f7261cb90a3688e0aab7a)

Author SHA1 Message Date
yihao.dai 254cd4f15f
Fix MockQueryNode (#22859) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-20 17:25:56 +08:00
congqixia 0317e0458b
Use Set[string] instead of map[string]interface{} ServerType (#22853) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-20 16:21:57 +08:00
yihao.dai 1f718118e9
Dynamic load/release partitions (#22655) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-20 14:55:57 +08:00
zhagnlu 7c633e9b9d
Support aliyun OSS for chunk manager (#22663) (#22842) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-03-20 14:45:57 +08:00
yah01 3202eb0d9f
Optimize rounding distances, avoid promoting to double (#22846) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 14:09:56 +08:00
xige-16 9aa99aedbb
[Cherry-Pick] Remove arrow uasge in FieldData (#22726) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-03-20 10:41:56 +08:00
aoiasd b8b7d1f47e
CreateIndex should wait all segments which has data insert before CreateIndex finish (#22561) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-20 10:21:56 +08:00
yah01 005d178a0e
Optimize performance of insert & query & search (#22829) 
- Reduce 1x copy of inserting int8/int16 into growing segment
- Reduce 1x copy of retrieving primary keys
- Reduce 1x copy of inserting/loading/deleting/filtering primary keys
- Reduce 1x copy of reducing string results

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:19:56 +08:00
yah01 20974711a1
Optimize range search for nq > 1 (#22831) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:17:56 +08:00
yah01 65c58b3e41
Optimize performance of querying on InsertRecord (#22838) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-20 10:13:56 +08:00
MrPresent-Han 77c9e33e70
support dml channel balancer on datacoord (#22324) (#22377) (#22692) 
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
 2023-03-20 10:01:56 +08:00
wei liu 5f571ea915
remove debug log (#22828) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-17 18:05:56 +08:00
yah01 99f31dc37a
Fix data after travel timestamp is still visible (#22813) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-17 18:03:55 +08:00
Jiquan Long dff15c3488
Check dimension of inserted records (#22819) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-17 17:33:58 +08:00
SimFG 4a90490a67
Fix the `segment not found` error (#22772) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-03-17 17:27:56 +08:00
wei liu 6b5dfa6db2
deprecate shard cache immediately if query failed (#22779) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-17 16:25:55 +08:00
presburger 5841a3707b
suppport for raft gpu (#22790) 
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
 2023-03-17 11:59:54 +08:00
congqixia a085af931d
Fix metrics info panic when network error happens (#22802) (#22809) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-17 11:55:54 +08:00
yah01 ab1ac69712
Fix inserting into growing segment copies data (#22792) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-16 20:11:55 +08:00
Jiquan Long 8139106b51
Feat: count entities by expression (#22765) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-16 19:31:55 +08:00
yah01 3d8f0156c7
Refine scheduler & executor of QueryCoord (#22761) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-16 17:43:55 +08:00
wei liu bb5088e605
fix unassign from rg (#22747) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-16 14:27:55 +08:00
wei liu 69cc68caff
support first or random strategy (#22766) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-16 14:25:55 +08:00
zhenshan.cao ecde42a493
Fix proxy's pchan statistic min ts out of order (#22757) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-03-15 11:17:55 +08:00
Cai Yudong ab3cbdfc61
Partial change to prepare for GPU index type support (#22591) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-14 23:21:56 +08:00
SimFG b57e476089
Fix the nil point about the session (#22748) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-03-14 20:07:54 +08:00
congqixia 59989e2806
Fix rmq client unit test may panic (#22759) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-14 19:15:54 +08:00
smellthemoon 8799b06dbc
Fix the data is disappeared when upsert (#22762) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-14 19:11:54 +08:00
yah01 21ba8182ee
Refine task create errors (#22745) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-14 18:51:53 +08:00
huanghaoyuanhhy 024beddfe6
Make GCS OAuth token thread-safe (#22714) 
Signed-off-by: huanghaoyuan <haoyuan.huang@zilliz.com>
 2023-03-14 18:09:54 +08:00
congqixia 732986aa04
Remove fmt.Print from internal package (#22722) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-14 17:36:05 +08:00
aoiasd 6959332b08
Fix unittest start channel event but not close (#22662) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-14 17:05:54 +08:00
MrPresent-Han 89618b7e12
fix wrong sequence of timetick stats on proxy #21855 (#22685) 
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
 2023-03-14 15:43:54 +08:00
groot 6f6bd98c27
Verify vector float data for bulkinsert and insert (#22728) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-03-14 14:03:58 +08:00
Jiquan Long 556c1cfc8a
Fix confused timetick log (#22733) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-14 09:55:54 +08:00
Enwei Jiao d5ef0448f2
Remove annoying logs when config file not found (#22717) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-13 18:20:02 +08:00
yah01 fa2c1c1f40
Fix RootCoord double updates TSO (#22715) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 18:01:53 +08:00
yah01 a4031da634
Refine string parameters, avoid coping or deref (#22708) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 17:53:53 +08:00
yah01 8f3d6e08df
Optimize the performance of matching prefix for string index (#22712) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 17:31:53 +08:00
yah01 e1cb307690
Refine RootCoord services error handle (#22689) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 14:29:53 +08:00
yah01 be33911205
Refine RBAC init error handle (#22537) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 10:59:53 +08:00
yah01 7bc3309918
Replace NULL with nullptr (#22701) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 10:35:52 +08:00
congqixia af6f0d5aa5
Make merr.Error(status) read old error code (#22698) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-10 22:37:53 +08:00
yah01 1a4732bb19
Use new errors to handle load failures cache (#22672) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-10 17:15:54 +08:00
yah01 c626b9000b
Output log if mmap enabled (#22684) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-10 15:51:52 +08:00
wayblink 28390dfe09
Add bulkinsert integration test (#22621) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-03-10 11:03:52 +08:00
congqixia 3ffa6d5302
Mark cache deprecated instead of removing it (#22674) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-10 10:19:53 +08:00
Jiquan Long a36fefb009
Fix cpplint (#22657) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-10 09:47:54 +08:00
yah01 e581fef115
Use the request's context to allocate ts (#22633) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 18:51:52 +08:00
yah01 e4120d1671
Upgrade proto to add error code field of Status (#22656) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 18:49:51 +08:00
congqixia d9908ff231
Fix TestMetaCache_ExpireShardLeaderCache unit test (#22651) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-09 18:25:52 +08:00
shaoyue 32581e6452
Support aliyun oss as object storage with ak or IAM (#22376) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2023-03-09 16:33:52 +08:00
congqixia 9e17e2660e
Fix lifetime race in indexnode (#22645) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-09 16:19:52 +08:00
yah01 90a5aa6265
Refine errors, re-define error codes (#22501) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 15:47:52 +08:00
bigsheeper f994052099
Reduce printing frequency of rate limit log (#22636) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-09 14:15:55 +08:00
wayblink aa6212d5b0
[Cherry-pick] Fix channel checkpoint issues and fix GC (#22559) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Co-authored-by: Ten Thousand Leaves <69466447+soothing-rain@users.noreply.github.com>
 2023-03-09 14:13:52 +08:00
XuanYang-cn b3287ca5ec
Fix the misleading log messages (#22606) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-03-09 10:39:51 +08:00
wei liu 11f1f4226a
support replica observer assign node (#22604) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-08 18:57:51 +08:00
yah01 efdc77bce6
Fix not fill timestamp when use collection created ts (#22629) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-08 18:53:51 +08:00
wei liu 1a1a5caafa
update shard leader cache periodically (#22595) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-08 15:13:51 +08:00
Enwei Jiao f1ec78d3c1
Ignore connection error when closing pulsar consumer (#22607) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-08 14:57:51 +08:00
XuanYang-cn 955bc06165
Fix search binary pagination failure (#22477) 
See also: #22168

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-03-08 11:03:51 +08:00
Jiquan Long e3c11069eb
Fix ddl tt go back (#22617) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-08 10:13:51 +08:00
Enwei Jiao f1a60b295c
Support multi yaml files (#22583) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-07 18:23:51 +08:00
congqixia f3e2d4a39a
Fix querynode stop meet unexpected GetComponentStates (#22590) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-07 09:51:50 +08:00
smellthemoon 29b3690c83
Upsert raise error (#22533) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-06 14:29:51 +08:00
smellthemoon c196c55381
Improve the assert information (#22578) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-06 14:25:50 +08:00
yah01 d4fccdd135
Add reason for spawning task (#22549) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-06 10:13:50 +08:00
jaime d126f06946
Decouple mq module from internal proto definition (#22536) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-03-04 23:21:50 +08:00
Enwei Jiao b21395f487
Forbid dmlChannelNum auto refresh (#22550) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-03-03 15:21:48 +08:00
smellthemoon 0dae20c938
Layer range search results (#22539) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-03 15:19:48 +08:00
congqixia ea4ab9e4a4
Replace ErrorList with multiErrors (#22532) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-03 14:59:49 +08:00
yah01 319f1773af
Fix segment not found if forward delete to empty segment (#22528) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-03 14:13:49 +08:00
Gao aa19243c22
Fix diskann param parse bug (#22498) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-03-02 19:59:50 +08:00
congqixia 51cb8590a1
Use errors.Wrap and Combine so retry error could check `errors.Is` (#22520) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-02 17:25:48 +08:00
yah01 bdd6bc7695
Re-format cpp code (#22513) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 15:55:49 +08:00
congqixia fa86de530d
Restrain gc files by collection (#22504) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-02 11:49:47 +08:00
yah01 4d4bf99098
Fix DiskANN can't recovery after querynode reboots (#22488) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 10:17:48 +08:00
yah01 1ee10f3224
Refine the information while assertion failed (#22434) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-02 09:07:48 +08:00
Ten Thousand Leaves 74d158e149
Fix enableAutoCompaction default value (#22254) 
/kind bug

issue: #22253

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2023-03-02 07:21:48 +08:00
cai.zhang 5cae49e28d
Store index files in slices to reduce memory peaks (#22369) (#22455) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-03-01 19:43:47 +08:00
yah01 7478e44911
Support using mmap to load data (#22052) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-01 18:07:49 +08:00
congqixia fa5c33975e
Fix reset connection data race (#22483) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-01 11:21:47 +08:00
wei liu c162c6ecc0
fix assign node err (#22479) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-01 11:11:47 +08:00
yah01 21eea923cc
Add util to combine multiple errors so everyone checkable (#22473) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-28 19:35:47 +08:00
yah01 60cd548bf5
Rename concurrency package to conc (#22453) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-28 14:19:47 +08:00
congqixia 608615e5bd
Add background health check if ctx err returned (#22439) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-02-28 14:11:47 +08:00
Xiaofan 256aaa1944
Change Etcd session timeout to 20s (#22401) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-28 11:13:47 +08:00
Xiaofan fa101e9751
Change RockMQ page size to 256MB (#22432) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-28 10:45:47 +08:00
cai.zhang eefa29a5e8
Fix bug for get index state (#22396) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-28 10:29:50 +08:00
yah01 1779d25e9c
Fix ignoring error while subscribing channel (#22429) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-28 08:17:49 +08:00
wei liu d433e95ce0
fix transfer node meta err (#22420) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-02-27 19:29:47 +08:00
yah01 167581c08a
Refine Pool to improve the ease of use (#22412) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-27 18:07:48 +08:00
wayblink 416866e42f
Add memory usage too large sync policy (#22244) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-02-27 17:47:51 +08:00
smellthemoon 8d05874ff9
Fix get index mode error (#22364) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-02-27 14:45:47 +08:00
aoiasd 872721e3ec
Refactor invalid unit test (#22347) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-02-27 14:27:47 +08:00
yah01 b758c305a7
Make Future generic (#22411) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-02-27 12:07:47 +08:00
Xiaofan 3d6bded115
Fix Row Number Mismatch (#22307) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-27 10:41:46 +08:00
Enwei Jiao 697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-26 11:31:49 +08:00
smellthemoon cf999b68dd
Fix range search can not get status from knowhere (#22384) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-02-24 17:59:45 +08:00