Commit Graph

118 Commits (eb046863485fdf3e130fc60484485c901b81276b)

Author SHA1 Message Date
SimFG d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
Enwei Jiao d9c7519107
refactor compaction concurency logic (#18660)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-08-23 15:50:52 +08:00
aoiasd 8a70f2badb
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-12 13:20:39 +08:00
SimFG f4c6a6734e
Fix rpc retry policy not taking effect (#17673)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-22 22:22:13 +08:00
Ten Thousand Leaves f5e63177d2
Fix an issue with bulk load with multiple DataNodes (#17324)
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-02 18:54:04 +08:00
cai.zhang bcf3b7426a
Add distributed lock for segment refgerence (#16782)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-31 16:36:03 +08:00
Xiaofan 333b439a6c
Support config grpc log level (#16618)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-05 10:35:50 +08:00
Ten Thousand Leaves 289e468a7a
Make bulk load fully work (#16512)
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-20 14:03:40 +08:00
Ten Thousand Leaves 1e6f6bd072
Implement set segment state call from RootCoord to DataCoord. (#16374)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-06 15:33:32 +08:00
Ten Thousand Leaves 45be3deb3f
Implement RC, DC, DN calling path for import. (#16321)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-01 11:33:28 +08:00
groot 1c4b949a1d
modify import rpc interface (#16129)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-22 15:11:24 +08:00
groot 89356ebcb9
Modify import rpc interfaces (#16006)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
groot 5fdef607d5
Add rpc interfaces for import (#15930)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-09 18:33:59 +08:00
Xiaofan d013134b44
Enhance error message when coordinator not healthy (#15950)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-09 15:57:58 +08:00
shaoyue cea5853cfb
[skip e2e] Add comment for datacoord client (#15088)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-01-10 18:31:51 +08:00
shaoyue 8818245d63
[skip e2e] Add comment for datacoord client params (#14924)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-01-06 13:03:30 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
shaoyue c65bb0d3c6
[skip e2e] Add comment for datacoord/client.Client (#14029)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-23 11:07:14 +08:00
Cai Yudong a101d1d3c5
[skip e2e] Unify component import alias (#13765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:43:05 +08:00
Cai Yudong 966119526a
Rename Params to ClientParams for all component clients (#13743)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 14:25:25 +08:00
Cai Yudong cf50e9ac55
Use GrpcServerConfig and GrpcClientConfig for distributed components (#13469)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 10:23:15 +08:00
congqixia 61f2db3102
Remove debug log from DataCoord client (#13313)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-15 11:09:24 +08:00
zhenshan.cao 3d8a0453b7
Remove unused log (#12793)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-08 14:45:04 +08:00
zhenshan.cao af22977cd3
Fixbug: grpc connection is closed by mistake (#12307)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-03 15:15:32 +08:00
Bingyi Sun fb2e8b0870
[skip ci]Add comment for WatchChannels in client.go (#12416)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
2021-11-29 23:13:41 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 22:35:41 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 14:29:24 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:25:17 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170)
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 10:55:14 +08:00
zhenshan.cao 543c4891b3
Prevent the client from closing grpc connection by mistake (#11918)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-18 11:17:12 +08:00
godchen 5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
Bingyi Sun c3f0c5a3ff
Add compaction interfaces in proxy (#11431)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 14:47:02 +08:00
zhenshan.cao fbb9a5a790
[skip ci]Fix golint error in datacoord (#11351)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 23:03:10 +08:00
sunby c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
sunby 1f2e0c68db
[skip ci]Add comment for Start in datacoord client (#11200)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:26:12 +08:00
sunby 8eb2700fa7
[skip ci]Add comment for Init (#11199)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:24:21 +08:00
sunby 087f05bca5
[skip ci]Add comment for GetMetrics (#11198)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:22:31 +08:00
sunby 3c5ef43783
[skip ci]Add comment for SaveBinlogPaths (#10777)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-27 20:36:24 +08:00
sunby f797c1e094
[skip ci]Add comment for GetFlushedSegments (#10776)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-27 20:34:33 +08:00
sunby 42480da5d3
[skip ci]Add comment for GetSegmentInfoChannel (#10606)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:24:22 +08:00
sunby 1888b7e1a1
[skip ci]Add comment for GetRecoveryInfo (#10605)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:22:31 +08:00
sunby e98dee296f
[skip ci]Add comment for GetCollectionStatistics (#10393)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:55:40 +08:00
sunby dcd6c1f2b2
[skip ci]Add comment for GetPartitionStatistics (#10392)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:53:48 +08:00
sunby 4adccbf03e
[skip ci]Add comment for GetSegmentInfo (#10391)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:51:55 +08:00
sunby 3fe0604b18
[skip ci]Add comment for GetInsertBinlogPaths (#10321)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:30:43 +08:00
sunby d60cd6ec6e
[skip ci]Add comment for GetSegmentStates (#10320)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:28:49 +08:00
sunby 95644f71e8
[skip ci]Add comment for AssignSegmentID (#10319)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:26:55 +08:00
XuanYang-cn cc8a526105
[skip ci]Update license for distributed dc client (#10162)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 20:25:17 +08:00
groot 7205fd3d9b
Remove unused interface (#9877)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 17:42:35 +08:00
sunby aac60959d0
[skip ci]Add comment for NewClient (#9753)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:34:33 +08:00
sunby a0e1189333
[skip ci]Add comment for datacoord client (#9752)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:32:41 +08:00
groot 1277bb659a
Add unittest for distributed/querycoord (#9567)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-11 10:02:25 +08:00
groot c982e368dd
Add unittest for distributed/datanode (#8695)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-27 19:00:22 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 19:45:42 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 10:13:15 +08:00
godchen bf2c427609
Fix connection timeout (#7203)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-20 17:52:11 +08:00
godchen 7557616fea
Change client timeout (#6982)
* Change client timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix conflicts

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-06 14:09:26 +08:00
dragondriver ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-04 13:03:24 +08:00
neza2017 8b89744c6b
search with exp (#6409)
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-10 10:21:52 +08:00
sunby 07b0989628
Add GetFlushedSegments in data coordinator (#6253)
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`

Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-02 11:16:20 +08:00
godchen 2a07124885
Change default grpc retry config (#6233)
* Change default grpc retry config

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* add retry code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-01 15:24:17 +08:00
godchen 1c1ffc8b32
Add connect err log (#6186)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-29 14:30:17 +08:00
godchen 73996aba91
Change client init timeout (#6107)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-25 15:50:23 +08:00
godchen 3785bb6330
Change retry times (#6083)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 19:05:06 +08:00
godchen 064f8f76cd
change_coord_connect_retry (#6064)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 15:20:08 +08:00
sunby 46f86a0354
Return sealed segments when calling flush (#6011)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-23 16:56:11 +08:00
godchen 99be4c09a5
change retry (#5996)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
sunby c863a193de
Rename filename from dataservice to datacoordinator (#5946)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00