milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
17,502 Commits
127 Branches
113 Tags
553 MiB
Commit Graph

133 Commits (51c348158b5a9dd641d19bdc786e463e586357f6)

Author SHA1 Message Date
wei liu b62c82af22
fix set target version in loading sealed segment (#25603) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-14 20:00:31 +08:00
congqixia f2b14b43de
Add log field for local worker call (#25594) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 17:34:31 +08:00
congqixia a7e6f08183
Fix DeleteCollection not protected (#25599) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 17:04:31 +08:00
Enwei Jiao 66fdc71479
Refactor logs in DataCoord & DataNode (#25574) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-14 15:56:31 +08:00
yah01 d216f9abda
Clear collection meta after all channels/segments released (#25486) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-14 10:28:30 +08:00
yiwangdr b9189b9f41
Organize mocks from types.go (#25466) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-07-14 10:12:31 +08:00
wei liu b72809db15
fix release sealed segment on unwatch channel (#25555) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-13 14:30:29 +08:00
yah01 205a7c430a
Fix QueryNode panic while inserting to released segment (#25495) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-12 19:48:29 +08:00
SimFG f9e2d00f91
Prevent `exclusive consumer` exception in pulsar (#25376) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-07-12 17:26:30 +08:00
yihao.dai 4c93495587
Add segment size metric in querynode (#25406) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-12 14:26:28 +08:00
congqixia bcd3abf644
Separate segments/shards reduce latency metrics (#25475) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 18:18:28 +08:00
congqixia 5aec6036dc
Add index info in GetDataDistribution response (#25444) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 11:22:29 +08:00
cai.zhang 81278f4aea
Fix bug of missing JSON type when sorting retrieve results (#25412) (#25455) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-10 20:02:28 +08:00
congqixia 9e3a591bda
Fix segment released early in case of balancing (#25453) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-10 18:58:28 +08:00
wei liu cc730c1ee5
fix consume growing from dml after release (#25421) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-10 17:36:28 +08:00
wei liu d4704ab9b6
fix set shard unservicable when sync target version (#25418) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 19:32:25 +08:00
wei liu a47fc28023
fix querynode panic in get distribution (#25405) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 18:26:25 +08:00
congqixia f07c934558
Fix querynodev2 grace stop condition reversed (#25409) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-07 17:28:25 +08:00
wei liu b7740835fe
fix metric label for sq count metrics (#25399) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-07 14:06:25 +08:00
chyezh dc1cb54404
[Fixup] unexpected read_task_ready_len metric (#25349) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-06 20:02:29 +08:00
wei liu d5ec7dda80
fix metric label in search/query count (#25377) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 17:48:26 +08:00
congqixia 3f9384b515
Fix exclude segment info dml position for flushed segments (#25200) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-06 17:30:26 +08:00
yah01 3d2283415f
Fix delegator leaked (#25347) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 14:18:26 +08:00
yah01 dd5f896dc8
Load batch by batch (#25212) 
This will significantly reduce the memory usage while loading
- 1x memory usage and MBs overhead for buffer (memory mode)
- only MBs overhead for buffer (mmap mode)

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 13:58:27 +08:00
yah01 4c0e36d28c
Stop blocking until all channels & segments released (#25328) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-06 10:04:25 +08:00
wei liu c84496a1ba
fix sq count metrics (#25287) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 08:46:26 +08:00
congqixia efdd71c640
Make cgo pool size larger than worker pool size (#25318) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-05 16:56:26 +08:00
Enwei Jiao 816158e4af
Remove outdated searchplan (#25282) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-04 18:30:25 +08:00
Gao 4a87b9f60a
Fix queryHook ut data race (#25306) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-07-04 15:34:25 +08:00
yihao.dai c56a26a556
Add SetMetricType and set metric only for shard leader (#25285) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-04 10:20:25 +08:00
chyezh d7d61f529c
[Feature|Pick] enable scheduler policy and add user-task-polling policy (#24839) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-03 18:24:25 +08:00
Gao de6e4817a2
Support dynamic tuning config (#25152) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-07-03 15:18:24 +08:00
yah01 7b5013664d
Support graceful stop (#25226) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-30 17:28:23 +08:00
yah01 f7ecbff986
Make merged task channel buffered (#25242) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-06-30 14:58:22 +08:00
Gao 8750be1e97
Set receive searchRequest log to debug level (#25223) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-29 14:04:22 +08:00
congqixia 1357ef7043
Merge get worker process for same nodeID (#25185) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-28 18:34:24 +08:00
Jiquan Long 8d193a3e56
Skip unnecessary reduce phase during search (#25166) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-27 19:22:45 +08:00
wei liu 9b91519c88
fix search cost metrics on replica selection (#25059) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 19:02:44 +08:00
congqixia b3362c297a
Make snapshot.expired atomic (#25177) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-27 18:12:45 +08:00
yihao.dai 29b9b26de8
Improve get vector error msg (#24838) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-27 16:34:45 +08:00
wei liu 68ae199a9f
load segment with target version, avoid read redundant segment (#24929) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 11:48:45 +08:00
xige-16 33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
jaime 18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
xige-16 04082b3de2
Migrate the ability to upload and download binlog to cpp (#22984) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-25 14:38:44 +08:00
congqixia a3630e17a0
Refine grpc Status handling: retry legacy only for Unimplemented (#25041) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-25 10:30:43 +08:00
congqixia d51e1379fe
Move loadDelta operation after needTransfer check (#24922) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-19 17:14:41 +08:00
wei liu 46f7d903a3
enable look aside balancer on replica selection (#24791) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-16 18:38:39 +08:00
yah01 a413842e38
Fix deleted data is still visible (#24849) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-16 17:16:41 +08:00
yihao.dai c7dc1c067a
Assign metric type in load segment request (#24917) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-16 16:50:41 +08:00
yah01 9250423288
Fix QueryNode metrics (#24916) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-16 16:02:39 +08:00