milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
21,761 Commits
153 Branches
122 Tags
592 MiB
Commit Graph

392 Commits (893caee467d3aabe298e0cc8730c52b17ffa2273)

Author SHA1 Message Date
wei liu 8a370f115a
Fix external grpc server doesn't graceful stop (#28309) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-11-10 00:14:18 +08:00
wei liu 64f6dbabdc
Fix proxy not healthy before graceful stop (#28223) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-11-08 02:22:26 +08:00
PowderLi 0c0f012e03
add a custom http header: Accept-Type-Allow-Int64 (#27901) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-11-01 11:42:16 +08:00
yah01 9658367a3c
Refine chunk manager errors (#27590) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-10-31 12:18:15 +08:00
Filip Haltmayer 6b1a106a31
Moving etcd client into session (#27069) 
Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
 2023-10-27 07:36:12 +08:00
jaime bf7f32b025
Refine Proxy stop (#27919) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-10-26 10:24:09 +08:00
jaime 4640928280
Fix initialization and backward compatibility issue for GRPC compression (#27894) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-10-24 22:14:14 +08:00
SimFG 9b0ecbdca7
Support to replicate the mq message (#27240) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-20 14:26:09 +08:00
PowderLi dcb7a89601
[restful] new interface: upsert (#27787) 
interface: delete support expression

Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-10-20 09:54:11 +08:00
SimFG 630636c4ec
Support the apikey authentication for the restful api (#27758) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-18 16:36:12 +08:00
SimFG 84d05b939b
Support the apikey authentication (#27723) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-17 21:00:11 +08:00
congqixia 2f201c25e2
Remove deprecated io/ioutil usage (#27747) 
`io/ioutil` package is deprecated, use `io`,`os` package replacement
also added golangci-lint rule to block future reference

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: guoguangwu <guoguangwu@magic-shield.com>
 2023-10-17 20:32:09 +08:00
PowderLi 09d8b76048
[restful] new context with grpc metadata (#27668) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-10-17 20:00:14 +08:00
yah01 be980fbc38
Refine state check (#27541) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-10-11 21:01:35 +08:00
yah01 8394b3a1ec
Block creating new error from status reason (#27426) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-10-07 11:29:32 +08:00
yah01 63ac43a3b8
Refine errors for import (#27379) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-30 10:31:28 +08:00
wei liu 27046e242b
add timeout for graceful stop (#27326) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-09-26 10:15:25 +08:00
jaime 7f7c71ea7d
Decoupling client and server API in types interface (#27186) 
Co-authored-by:: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-09-26 09:57:25 +08:00
SimFG 26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
congqixia cc9974979f
Add staticcheck linter and fix existing problems (#27174) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-19 10:05:22 +08:00
yah01 168e82ee10
Fix panic while handling with the nil status (#27040) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-15 10:09:21 +08:00
congqixia f0d0651989
Do not reset connection immediately if grpc code is `Canceled` or `DeadlineExceeded` (#27014) 
We found lots of connection reset & canceled due to recent retry change
Current implementation resets connection no matter what the error code is
To sync behavior to previous retry, skip reset connection only if cancel error happens too much.

Also adds a config item for minResetInterval for grpc reset connection

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-13 15:01:18 +08:00
yihao.dai dd2cb1d44a
Flush by flush channels (#26859) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-12 21:07:19 +08:00
yah01 00c65fa0d7
Refine QueryNode errors (#27013) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-12 16:07:18 +08:00
yah01 45d9fb5929
Fix wrong error codes & names (#26904) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-12 14:41:18 +08:00
XuanYang-cn 7f1ae35e72
Add timeout in dispatcher, AsConsumer and Seek (#26686) 
See also: #25309

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-09-08 09:51:17 +08:00
Enwei Jiao fb0705df1b
Decouple basetable and componentparam (#26725) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-05 10:31:48 +08:00
yah01 3349db4aa7
Refine errors to remove changes breaking design (#26521) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-04 09:57:09 +08:00
smellthemoon e56b0018e4
Remove merr mask logic to make it ok to compare resp.status with origin error (#26773) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-09-01 11:09:00 +08:00
Xu Tong 5f08e3a72b
Fix field_name spell error (#26718) 
Signed-off-by: Writer-X <1256866856@qq.com>
 2023-08-31 11:39:02 +08:00
yah01 213db490bd
Use pointer receiver for large struct (#26668) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-30 10:24:29 +08:00
yah01 dd4bc5b6a0
Fix data race in gRPC client (#26574) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-28 18:26:28 +08:00
congqixia c2b53bb9fe
Return error response instead of panicking for unimplemented APIs (#26589) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-24 09:14:23 +08:00
yihao.dai c3128aaef3
Accelerate server id interceptor validation (#26468) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-08-20 21:24:19 +08:00
yihao.dai 63b86b32a6
Add server id validation interceptor (#26395) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-08-17 20:20:20 +08:00
congqixia e13b6b88eb
Replace deprecated grpc WithInsecure option (#26226) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-09 13:37:16 +08:00
congqixia 2770ac4df5
Fix nilness linter errors (#26218) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-09 11:31:15 +08:00
congqixia b9850ce5c0
Fix copylocks linter errors (#26217) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-08 20:41:15 +08:00
PowderLi a7eecb1be0
support high-level RESTFUL API, listen on the same port as grpc. (#25108) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-08-08 10:15:07 +08:00
cai.zhang 760a2d9aa7
Support AllocTimestamp api for Milvus (#25784) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-25 10:05:00 +08:00
yiwangdr b9189b9f41
Organize mocks from types.go (#25466) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-07-14 10:12:31 +08:00
jaime 18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
yihao.dai 9f5756f16e
Add cluster validation interceptor to resolve the ip-reuse issue (#25001) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-21 11:36:46 +08:00
wayblink bfae6b49af
Remove datanode timetick mq, use rpc to report instead (#23156) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-06-14 14:16:38 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yihao.dai 2086b4f75d
Add RBAC for FlushAll (#24751) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-08 20:28:35 +08:00
yah01 ebd0279d3f
Check error by Error() and NoError() for better report message (#24736) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-08 15:36:36 +08:00
SimFG d246defa4d
Return error response when an unimplemented request is received (#24545) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-05-31 20:24:31 +08:00
Preetham 2f8032b55c
Update: Wrap common grpc calls indexnode and proxy clients (#24344) 
Signed-off-by: Preetham <kamidipreetham@gmail.com>
 2023-05-24 09:25:26 +08:00
Jiquan Long bd343550a5
Support to manage connections (#24224) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-19 12:51:23 +08:00
wayblink 899702f13c
Implement GetIndexStatistics interface (#23603) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-05-06 10:34:39 +08:00
wayblink b7cb34b966
Add blank GetIndexStatistics interface (#23610) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-04-23 14:50:32 +08:00
wei liu cbfe7a45ef
fix pull target (#23491) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-18 18:30:32 +08:00
jaime c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
yihao.dai a182594bf5
Add FlushAll support (#22942) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-30 11:28:25 +08:00
congqixia 732986aa04
Remove fmt.Print from internal package (#22722) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-14 17:36:05 +08:00
Enwei Jiao 697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-26 11:31:49 +08:00
zhenshan.cao e768437681
Correct usage of Timer and Ticker (#22228) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-02-23 18:59:45 +08:00
wei liu 13b508103e
refine mock querycoord (#22198) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-02-16 15:38:34 +08:00
wei liu 73c44d4b29
resource group impl (#21609) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-01-30 10:19:48 +08:00
congqixia 5986106037
Make paramtable init only once (#21782) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-19 14:53:44 +08:00
jaime 1dcd9eeb79
Support rename collection (#21693) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-01-19 14:13:43 +08:00
Xiaofan f8e1566b24
Support zstd compression in grpc (#21689) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-13 10:55:41 +08:00
wayblink 6a722396bd
Integration test framework (#21283) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-01-12 19:49:40 +08:00
wei liu c67070ab1f
add resource group interface (#21676) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-01-12 18:31:41 +08:00
Enwei Jiao fb42466c65
Use opentelemetry (#21509) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-12 16:09:39 +08:00
Jiquan Long 9fd9bed2b9
Remove collection meta after GC finished (#21595) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-12 09:55:42 +08:00
cai.zhang e127cf7b99
Reset indexpb for upgrade (#21620) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-11 14:35:40 +08:00
cai.zhang aa203acfb3
Low IndexCoord weight (#21548) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-06 14:21:37 +08:00
cai.zhang e5f408dceb
Merge IndexCoord and DataCoord (#21267) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-04 19:37:36 +08:00
smellthemoon bf3c02155a
Support update (#20875) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-01-04 17:21:36 +08:00
Jiquan Long ff2a68e65a
Fix collection not exist when tried to do recovery (#21471) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-04 16:37:35 +08:00
bigsheeper c187de7754
Show trigger reason when deny to read/write (#21368) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-12-30 18:35:32 +08:00
Enwei Jiao 166e9f0da5
Refactor GrpcConfig (#21142) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-16 15:59:23 +08:00
SimFG f31d5facff
Fix the unsafe casbin `Model` (#21129) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-14 10:29:22 +08:00
SimFG 655db658c8
Empty implement of the `GetLoadState` api (#21205) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-14 10:23:22 +08:00
SimFG d67e878f96
Fix the concurrent write issue when init privilege policy (#21071) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-12-08 19:43:23 +08:00
Enwei Jiao 89b810a4db
Refactor all params into ParamItem (#20987) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-07 18:01:19 +08:00
Enwei Jiao 2ecdb4ba4a
Etcd config source support TLS (#20874) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-30 18:23:15 +08:00
shaoyue 37725d3470
[restapi] Fix insert request lost precision for int64 fields (#20468) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-11-25 10:43:12 +08:00
jaime 0a5270e8c0
Fix alter collection hang (#20694) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-11-21 10:09:10 +08:00
Enwei Jiao c05b9ad539
Add event dispatcher for config (#20393) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-17 18:59:09 +08:00
aoiasd d8f8296b03
Make internal proxy use internal port and isolate internal interface and external interface in proxy grpc server (#20558) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-11-15 16:53:07 +08:00
bigsheeper cd19d99ad7
Add channel level checkpoint (#20350) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-11-10 22:13:04 +08:00
aoiasd fca2b71e28
add access log for proxy (#19927) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-11-10 17:09:06 +08:00
Enwei Jiao 956c5e1b9d
Make Params singleton (#20088) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-04 14:25:38 +08:00
SimFG 729e9d48fe
Improve the `mockProxyComponent` methods' receiver (#20115) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-10-27 18:47:32 +08:00
smellthemoon 2f19e6595a
Fill SourceID (#20000) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2022-10-24 23:43:30 +08:00
smellthemoon 581e1d8c35
Fill MsgBase ALL (#19912) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2022-10-21 15:57:28 +08:00
jaime cf1491e41a
Add status for GetVersionResponse and CheckHealthResponse (#19895) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-20 19:47:33 +08:00
smellthemoon 108e51b2f0
[test]Create index before load and fix error message (#19874) (#19857) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2022-10-19 10:01:26 +08:00
jaime 59bcbf0cf6
Support check health for the service level (#19779) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-18 13:39:26 +08:00
Enwei Jiao 0a83cdfe1b
Refactor grpclient, make it generic (#19791) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-10-17 20:05:26 +08:00
SimFG a55f739608
Separate public proto files (#19782) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-10-16 20:49:27 +08:00
jaime 8e7a4733ec
Add GetVersion API for the client (#19694) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-14 09:59:24 +08:00
jaime 10c03de628
Refine method name from BroadCastXx to BroadcastXx (#19700) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-11 21:07:23 +08:00
jaime 31db01b6ae
Support TTL for collection level (#19383) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-10 20:31:22 +08:00
wayblink 85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface (#19594) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-10-10 15:55:22 +08:00
wayblink e7c2500c71
Implement GetPersistentSegmentInfo through datacoord (#19205) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-10-08 11:51:02 +08:00
SimFG 7d54e35fa5
Add the `GetLoadingProgress` RPC (#19491) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-10-01 09:02:55 +08:00
shaoyue 08ade66c85
Fix insert varchar, forbid insert string type (#19580) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-09-30 18:48:55 +08:00
SimFG 13ca8936d1
Deprecate `GetIndexState` and `GetIndexBuildProgress` (#19451) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-27 19:12:54 +08:00
Ten Thousand Leaves b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-09-26 18:06:54 +08:00
SimFG 68a257458b
Implement the `hook` interceptor (#19294) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-23 09:50:52 +08:00
SimFG d7f38a803d
Separate some proto files (#19218) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-16 16:56:49 +08:00
bigsheeper 5cdd6ca251
Add quotaCenter, rateLimiter and rateCollector (#18636) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-09-16 09:56:47 +08:00
Jiquan Long a5e2d6b6fb
Refactor RootCoord (#18930) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>
 2022-09-05 13:29:11 +08:00
jaime 0e4e7966ec
Refine grpc server options of interceptor (#18943) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-09-01 09:48:58 +08:00
cai.zhang c924f73105
Refactor for IndexCoord to support cloud (#18643) 
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
 2022-08-25 15:48:54 +08:00
Zach 0c9a10e8f8
1. refine logging interfaces (#18692) 
2. adjust logs for query/search requests

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
 2022-08-23 10:44:52 +08:00
aoiasd 8a70f2badb
Add ShowConfigurations for all remaining session (#18594) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-08-12 13:20:39 +08:00
SimFG ff0200210a
Support Role-Based Access Control (#18425) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-08-04 11:04:34 +08:00
codeman 5fda8261d0
Fix: Unable to list newly created credential users (#18117) (#18153) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-07-07 21:16:22 +08:00
shaoyue 96b97f7f58
RESTful api use same port as metrics & healthcheck (#17732) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-24 15:34:14 +08:00
SimFG f4c6a6734e
Fix rpc retry policy not taking effect (#17673) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-06-22 22:22:13 +08:00
shaoyue 32a3ed0791
Add e2e test for RESTful APIs, fix json encoding for on proto_oneof fields (#17362) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-20 22:06:12 +08:00
cai.zhang 141a3bbe00
Mark deleted before drop index (#17490) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-06-17 18:08:12 +08:00
cai.zhang 53a49a9255
GetIndexState only get the state generated call CreateIndex (#17549) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-06-16 20:12:11 +08:00
SimFG 0986c29d7f
proxy tls support one-way authentication (#17348) 
Signed-off-by: xiyichan <2863768433@qq.com>

Co-authored-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>

Co-authored-by: xiyichan <2863768433@qq.com>
 2022-06-02 18:56:04 +08:00
Ten Thousand Leaves f5e63177d2
Fix an issue with bulk load with multiple DataNodes (#17324) 
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-06-02 18:54:04 +08:00
shaoyue 7c52a8c535
Add RESTful API for new methods, fix err when receive empty boy (#17260) 
create collection schema use struct instead of protobuf

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-02 17:40:04 +08:00
cai.zhang bcf3b7426a
Add distributed lock for segment refgerence (#16782) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-05-31 16:36:03 +08:00
congqixia c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster (#16856) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-30 19:50:04 +08:00
zhenshan.cao b0d54ed0af
Rename Client to GrpcClient in mock package (#17230) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-05-30 17:16:08 +08:00
SimFG 731870211a
Support role-based access control (only pb) (#16987) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-05-28 00:04:01 +08:00
Jiquan Long e44afc7aa3
Fix ut: wait service ready after run Proxy server (#17208) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-05-25 18:56:00 +08:00
bigsheeper 9eeec4a2d5
Add collection load cache and InvalidateCollMetaCache by collID (#16882) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-19 10:13:56 +08:00
Jiquan Long ca3ecec5b5
Fix ut data race (#16939) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-13 17:43:53 +08:00
exia 4ee78eb5ad
proxy support tls (#16706) 
Signed-off-by: xiyichan <2863768433@qq.com>
 2022-05-10 20:05:53 +08:00
Xiaofan 333b439a6c
Support config grpc log level (#16618) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-05 10:35:50 +08:00
shaoyue 2f49db9d3c
Implements remaining rest APIs (#16387) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-04-29 15:15:47 +08:00
groot bc5e9ec929
Add list import tasks api (#16605) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-04-25 17:37:46 +08:00
Ten Thousand Leaves 289e468a7a
Make bulk load fully work (#16512) 
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-20 14:03:40 +08:00
codeman f5e1ded854
fix #16504 (#16523) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-19 16:35:39 +08:00
Ten Thousand Leaves e76a8c5ec2
Update compile options and config for embedded Milvus (#16472) 
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-14 19:57:34 +08:00
codeman 4e12271d79
Support login with username and password (#15656) (#16341) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-11 19:49:34 +08:00
godchen bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
Ten Thousand Leaves 1e6f6bd072
Implement set segment state call from RootCoord to DataCoord. (#16374) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-06 15:33:32 +08:00
XuanYang-cn 78200009a3
Impl GetReplicas in Proxy (#16390) 
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-04-06 14:57:31 +08:00
yah01 c005f07ccc
Modify proto to add GetReplicas() interface (#16328) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-01 16:15:29 +08:00
Ten Thousand Leaves 45be3deb3f
Implement RC, DC, DN calling path for import. (#16321) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-01 11:33:28 +08:00
XuanYang-cn 58addbf9f4
Add GetShardLeaders rpc in querycoord proto (#16299) 
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-03-31 16:39:29 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
groot 1c4b949a1d
modify import rpc interface (#16129) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-22 15:11:24 +08:00
groot 2078b24dca
Prepare for import (#16083) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-21 15:47:23 +08:00
shaoyue 97e5d77953
implements restful entities api (#15916) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-03-21 11:21:23 +08:00
zhenshan.cao 0bd07daae3
Add grpc healthy check (#16050) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 15:05:21 +08:00
groot 89356ebcb9
Modify import rpc interfaces (#16006) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-03-11 17:13:59 +08:00
Ten Thousand Leaves d5bae6710f
Make all logs configurable for standalone/embedded Milvus. (#15926) 
Resolves: #15919, #15708
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-10 10:35:59 +08:00
groot 5fdef607d5
Add rpc interfaces for import (#15930) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-03-09 18:33:59 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-03 21:57:56 +08:00
shaoyue 83fdc1da7c
Add web server in proxy with sample handler (#15647) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-02-23 14:37:52 +08:00
Cai Yudong f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-07 10:09:45 +08:00
Jiquan Long 675e6d352b
QueryNodes send search/query results by rpc (#15223) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-17 14:41:35 +08:00
zhenshan.cao 1601a61b78
Move logic of checking available port to service (#15222) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-14 21:17:34 +08:00
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-07 16:15:26 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-12-29 14:35:21 +08:00
Jiquan Long 8a488f1f20
Refine startup workflow of proxy (#13459) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-25 16:10:17 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 18:39:11 +08:00
jingkl 6c3f1a9162
[skip e2e]Add comments to proxy service (#14082) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-23 18:17:15 +08:00
jingkl df546bc241
[skip e2e]Add comments to proxy service (#14081) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-23 18:15:21 +08:00
jingkl df90402a7f
[skip e2e]Add comments to proxy service (#14080) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-23 18:11:31 +08:00
jingkl e3e45ef069
[skip e2e]Add comments to proxy service (#13996) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-22 19:37:19 +08:00
jingkl 7423da8cb0
[skip e2e]Add comments to proxy service (#13995) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-22 19:35:27 +08:00
shaoyue 33963955dc
[skip e2e] Add comment for distributed/proxy.Server (#13991) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-22 19:29:50 +08:00
jingkl 1e658f26ea
[skip e2e]Add comments to proxy service (#13994) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-22 19:13:14 +08:00
jingkl e4ef536bb5
[skip e2e]Add comments to proxy service (#13829) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-21 15:25:08 +08:00
jingkl 0011f39530
[skip e2e]Add comments to proxy service (#13835) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-21 15:12:55 +08:00
jingkl 398a11cda0
[skip e2e]Add comments to proxy service (#13831) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-21 11:55:31 +08:00
jingkl 93e634c189
[skip e2e]Add comments to proxy service (#13756) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-20 19:16:37 +08:00
jingkl 9e7f548ee6
[skip e2e]Add comments to proxy service (#13754) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-20 18:58:50 +08:00
Cai Yudong a101d1d3c5
[skip e2e] Unify component import alias (#13765) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-20 16:43:05 +08:00
Cai Yudong 966119526a
Rename Params to ClientParams for all component clients (#13743) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-20 14:25:25 +08:00
jingkl 572afa502c
[skip e2e]Add comments to proxy service (#13565) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-17 14:30:27 +08:00
jingkl 21189779ee
[skip e2e]Add comments to proxy service (#13564) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-17 14:27:30 +08:00
Cai Yudong cf50e9ac55
Use GrpcServerConfig and GrpcClientConfig for distributed components (#13469) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-17 10:23:15 +08:00
Jiquan Long acbb680c91
[skip ci] Fix go fmt error (#13538) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-16 20:47:14 +08:00
jingkl fd33750aec
[skip ci] Add the comments to service (#13509) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-16 16:39:52 +08:00
jingkl d4c998e6f5
[skip ci] Add the comments to service (#13508) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-16 16:37:27 +08:00
jingkl 24b8b6e4c7
[skip ci] Add the comments to service (#13507) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-16 16:33:44 +08:00
jingkl 2aa1d5d714
[skip ci] Add the comments to service (#13400) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-15 17:01:49 +08:00
jingkl 706cc9d7c2
[skip ci] Add the comments to service (#13404) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-15 16:59:56 +08:00
jingkl 3ea83d77cc
[skip ci] Add the comments to service (#13411) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-15 12:00:20 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-15 11:47:10 +08:00
jingkl f311353182
[skip ci] Add the comments to service (#13316) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-14 16:21:22 +08:00
jingkl 96a0352272
[skip ci] Add notes to service (#13315) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-14 16:19:33 +08:00
jingkl 1950beba24
[skip ci] Add comments to service (#13314) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-14 11:59:10 +08:00
jingkl 4d27c8ef14
[skip ci]Add notes to client (#13178) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-12-10 21:12:23 +08:00
jaime b97e88e859
[skip ci] Add graceful stop grpc server log in proxy (#12827) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-07 09:51:56 +08:00
zhenshan.cao af22977cd3
Fixbug: grpc connection is closed by mistake (#12307) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-12-03 15:15:32 +08:00
jingkl 8a71aa7b09
[skip ci] add client notes (#12543) 
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>

Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
 2021-12-01 17:11:31 +08:00
jingkl d68142de86
[skip ci] add notes to client.go (#12542) 
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>

Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
 2021-12-01 17:09:36 +08:00
Xiaofan 1d9f4e0a5c
Add log when server is stopped (#12233) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-30 10:59:42 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-29 22:35:41 +08:00
shaoyue 8bd7365172
[skip ci] Add Comments for exported items in proxy/service.go (#12376) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-29 19:57:57 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 14:29:24 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-29 14:25:17 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170) 
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-23 10:55:14 +08:00
shaoyue fc6bc48e3b
[skip ci] Add comments for exported items in proxy/client.go (#12087) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-18 19:19:32 +08:00
zhenshan.cao 543c4891b3
Prevent the client from closing grpc connection by mistake (#11918) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-18 11:17:12 +08:00