Commit Graph

81 Commits (summer2023)

Author SHA1 Message Date
jaime 7f7c71ea7d
Decoupling client and server API in types interface (#27186)
Co-authored-by:: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-09-26 09:57:25 +08:00
XuanYang-cn 676024ff38
Add rpc to notify channel operation (#27172)
- Add NotifyChannelOperation
- Add CheckChannelOperationProgress

See also: #25309

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-09-25 14:05:27 +08:00
SimFG 26f06dd732
Format the code (#27275)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-09-21 09:45:27 +08:00
congqixia f0d0651989
Do not reset connection immediately if grpc code is `Canceled` or `DeadlineExceeded` (#27014)
We found lots of connection reset & canceled due to recent retry change
Current implementation resets connection no matter what the error code is
To sync behavior to previous retry, skip reset connection only if cancel error happens too much.

Also adds a config item for minResetInterval for grpc reset connection

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-13 15:01:18 +08:00
yihao.dai dd2cb1d44a
Flush by flush channels (#26859)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-12 21:07:19 +08:00
yah01 dd4bc5b6a0
Fix data race in gRPC client (#26574)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-08-28 18:26:28 +08:00
yihao.dai 63b86b32a6
Add server id validation interceptor (#26395)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-08-17 20:20:20 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto (#24770)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-09 01:28:37 +08:00
Preetham 0983d1fac7
Update: Wrap common calls datanode client (#24494)
Signed-off-by: Preetham <kamidipreetham@gmail.com>
2023-05-30 09:33:28 +08:00
jaime c9d0c157ec
Move some modules from internal to public package (#22572)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00
Xiaofan f8e1566b24
Support zstd compression in grpc (#21689)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-13 10:55:41 +08:00
Enwei Jiao 166e9f0da5
Refactor GrpcConfig (#21142)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-16 15:59:23 +08:00
Enwei Jiao 956c5e1b9d
Make Params singleton (#20088)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-04 14:25:38 +08:00
smellthemoon 2f19e6595a
Fill SourceID (#20000)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-10-24 23:43:30 +08:00
Enwei Jiao 0a83cdfe1b
Refactor grpclient, make it generic (#19791)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-10-17 20:05:26 +08:00
SimFG a55f739608
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
wayblink 85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface (#19594)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-10 15:55:22 +08:00
Ten Thousand Leaves b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-26 18:06:54 +08:00
XuanYang-cn 432b5ddf2e
Add SyncSegments into proto (#19312)
See also: #19072

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-09-23 10:22:52 +08:00
SimFG d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
Enwei Jiao d9c7519107
refactor compaction concurency logic (#18660)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-08-23 15:50:52 +08:00
aoiasd 8a70f2badb
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-12 13:20:39 +08:00
SimFG f4c6a6734e
Fix rpc retry policy not taking effect (#17673)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-22 22:22:13 +08:00
Ten Thousand Leaves f5e63177d2
Fix an issue with bulk load with multiple DataNodes (#17324)
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-02 18:54:04 +08:00
Ten Thousand Leaves 5e1e7a6896
Fix an issue that causes flush hanging (#17169)
issue: #16628
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-25 14:34:00 +08:00
Xiaofan 333b439a6c
Support config grpc log level (#16618)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-05 10:35:50 +08:00
Ten Thousand Leaves 45be3deb3f
Implement RC, DC, DN calling path for import. (#16321)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-01 11:33:28 +08:00
groot 89356ebcb9
Modify import rpc interfaces (#16006)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
groot 5fdef607d5
Add rpc interfaces for import (#15930)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-09 18:33:59 +08:00
Cai Yudong a101d1d3c5
[skip e2e] Unify component import alias (#13765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:43:05 +08:00
Cai Yudong 966119526a
Rename Params to ClientParams for all component clients (#13743)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 14:25:25 +08:00
Cai Yudong cf50e9ac55
Use GrpcServerConfig and GrpcClientConfig for distributed components (#13469)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 10:23:15 +08:00
Bingyi Sun fbba24891c
[skip ci]Add comment in datanode client (#12914)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 09:29:21 +08:00
shaoyue 2371a75cc6
[skip ci] Add comment for datanode Client (#12804)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-06 19:07:47 +08:00
zhenshan.cao af22977cd3
Fixbug: grpc connection is closed by mistake (#12307)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-03 15:15:32 +08:00
shaoyue 5d21e91213
[skip ci] Add comments for distributed/datanode/client/client.go (#12525)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:47:36 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 14:29:24 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:25:17 +08:00
zhenshan.cao 543c4891b3
Prevent the client from closing grpc connection by mistake (#11918)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-18 11:17:12 +08:00
Xiaofan 71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
sunby c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
zhenshan.cao d824e029b9
[skip ci]Fix golint error in datanode (#11204)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 23:57:27 +08:00
sunby 110174bebe
[skip ci]Add comment for FlushSegments (#10775)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-27 20:32:43 +08:00
XuanYang-cn 52e9d57f91
[skip ci]Update license for distributed dn client (#10160)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 16:51:32 +08:00
sunby 2a5f94b4dc
[skip ci]Fix typo (#9751)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:30:49 +08:00
sunby 4b7e024245
[skip ci]Add comment for Client (#9669)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-11 19:28:37 +08:00
groot c982e368dd
Add unittest for distributed/datanode (#8695)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-27 19:00:22 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 19:45:42 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 10:13:15 +08:00
godchen bf2c427609
Fix connection timeout (#7203)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-20 17:52:11 +08:00